00:00:00.001 Started by upstream project "autotest-nightly-lts" build number 2390 00:00:00.001 originally caused by: 00:00:00.001 Started by upstream project "nightly-trigger" build number 3651 00:00:00.001 originally caused by: 00:00:00.001 Started by timer 00:00:00.001 Started by timer 00:00:00.141 Checking out git https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool into /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4 to read jbp/jenkins/jjb-config/jobs/autotest-downstream/autotest-phy.groovy 00:00:00.141 The recommended git tool is: git 00:00:00.142 using credential 00000000-0000-0000-0000-000000000002 00:00:00.147 > git rev-parse --resolve-git-dir /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4/jbp/.git # timeout=10 00:00:00.162 Fetching changes from the remote Git repository 00:00:00.164 > git config remote.origin.url https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool # timeout=10 00:00:00.178 Using shallow fetch with depth 1 00:00:00.178 Fetching upstream changes from https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool 00:00:00.178 > git --version # timeout=10 00:00:00.190 > git --version # 'git version 2.39.2' 00:00:00.190 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:00.201 Setting http proxy: proxy-dmz.intel.com:911 00:00:00.201 > git fetch --tags --force --progress --depth=1 -- https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool refs/heads/master # timeout=5 00:00:04.614 > git rev-parse origin/FETCH_HEAD^{commit} # timeout=10 00:00:04.624 > git rev-parse FETCH_HEAD^{commit} # timeout=10 00:00:04.636 Checking out Revision db4637e8b949f278f369ec13f70585206ccd9507 (FETCH_HEAD) 00:00:04.636 > git config core.sparsecheckout # timeout=10 00:00:04.645 > git read-tree -mu HEAD # timeout=10 00:00:04.657 > git checkout -f db4637e8b949f278f369ec13f70585206ccd9507 # timeout=5 00:00:04.673 Commit message: "jenkins/jjb-config: Add missing SPDK_TEST_NVME_INTERRUPT flag" 00:00:04.674 > git rev-list --no-walk db4637e8b949f278f369ec13f70585206ccd9507 # timeout=10 00:00:04.741 [Pipeline] Start of Pipeline 00:00:04.750 [Pipeline] library 00:00:04.751 Loading library shm_lib@master 00:00:04.751 Library shm_lib@master is cached. Copying from home. 00:00:04.771 [Pipeline] node 00:00:04.782 Running on GP11 in /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:00:04.784 [Pipeline] { 00:00:04.794 [Pipeline] catchError 00:00:04.795 [Pipeline] { 00:00:04.808 [Pipeline] wrap 00:00:04.817 [Pipeline] { 00:00:04.827 [Pipeline] stage 00:00:04.829 [Pipeline] { (Prologue) 00:00:05.038 [Pipeline] sh 00:00:05.324 + logger -p user.info -t JENKINS-CI 00:00:05.344 [Pipeline] echo 00:00:05.345 Node: GP11 00:00:05.352 [Pipeline] sh 00:00:05.654 [Pipeline] setCustomBuildProperty 00:00:05.665 [Pipeline] echo 00:00:05.667 Cleanup processes 00:00:05.672 [Pipeline] sh 00:00:05.960 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:05.960 2853713 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:05.974 [Pipeline] sh 00:00:06.256 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:06.256 ++ grep -v 'sudo pgrep' 00:00:06.256 ++ awk '{print $1}' 00:00:06.256 + sudo kill -9 00:00:06.256 + true 00:00:06.272 [Pipeline] cleanWs 00:00:06.281 [WS-CLEANUP] Deleting project workspace... 00:00:06.281 [WS-CLEANUP] Deferred wipeout is used... 00:00:06.287 [WS-CLEANUP] done 00:00:06.289 [Pipeline] setCustomBuildProperty 00:00:06.298 [Pipeline] sh 00:00:06.575 + sudo git config --global --replace-all safe.directory '*' 00:00:06.662 [Pipeline] httpRequest 00:00:07.239 [Pipeline] echo 00:00:07.241 Sorcerer 10.211.164.20 is alive 00:00:07.252 [Pipeline] retry 00:00:07.254 [Pipeline] { 00:00:07.267 [Pipeline] httpRequest 00:00:07.271 HttpMethod: GET 00:00:07.272 URL: http://10.211.164.20/packages/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:07.272 Sending request to url: http://10.211.164.20/packages/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:07.286 Response Code: HTTP/1.1 200 OK 00:00:07.286 Success: Status code 200 is in the accepted range: 200,404 00:00:07.286 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:12.015 [Pipeline] } 00:00:12.032 [Pipeline] // retry 00:00:12.039 [Pipeline] sh 00:00:12.325 + tar --no-same-owner -xf jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:12.342 [Pipeline] httpRequest 00:00:12.837 [Pipeline] echo 00:00:12.839 Sorcerer 10.211.164.20 is alive 00:00:12.849 [Pipeline] retry 00:00:12.851 [Pipeline] { 00:00:12.865 [Pipeline] httpRequest 00:00:12.870 HttpMethod: GET 00:00:12.871 URL: http://10.211.164.20/packages/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:00:12.871 Sending request to url: http://10.211.164.20/packages/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:00:12.890 Response Code: HTTP/1.1 200 OK 00:00:12.891 Success: Status code 200 is in the accepted range: 200,404 00:00:12.891 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:01:08.822 [Pipeline] } 00:01:08.837 [Pipeline] // retry 00:01:08.843 [Pipeline] sh 00:01:09.123 + tar --no-same-owner -xf spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:01:12.434 [Pipeline] sh 00:01:12.745 + git -C spdk log --oneline -n5 00:01:12.745 c13c99a5e test: Various fixes for Fedora40 00:01:12.745 726a04d70 test/nvmf: adjust timeout for bigger nvmes 00:01:12.745 61c96acfb dpdk: Point dpdk submodule at a latest fix from spdk-23.11 00:01:12.745 7db6dcdb8 nvme/fio_plugin: update the way ruhs descriptors are fetched 00:01:12.745 ff6f5c41e nvme/fio_plugin: trim add support for multiple ranges 00:01:12.758 [Pipeline] } 00:01:12.774 [Pipeline] // stage 00:01:12.784 [Pipeline] stage 00:01:12.788 [Pipeline] { (Prepare) 00:01:12.806 [Pipeline] writeFile 00:01:12.822 [Pipeline] sh 00:01:13.107 + logger -p user.info -t JENKINS-CI 00:01:13.122 [Pipeline] sh 00:01:13.407 + logger -p user.info -t JENKINS-CI 00:01:13.421 [Pipeline] sh 00:01:13.706 + cat autorun-spdk.conf 00:01:13.706 SPDK_RUN_FUNCTIONAL_TEST=1 00:01:13.706 SPDK_TEST_NVMF=1 00:01:13.706 SPDK_TEST_NVME_CLI=1 00:01:13.706 SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:13.706 SPDK_TEST_NVMF_NICS=e810 00:01:13.706 SPDK_RUN_UBSAN=1 00:01:13.706 NET_TYPE=phy 00:01:13.714 RUN_NIGHTLY=1 00:01:13.719 [Pipeline] readFile 00:01:13.745 [Pipeline] withEnv 00:01:13.747 [Pipeline] { 00:01:13.760 [Pipeline] sh 00:01:14.048 + set -ex 00:01:14.048 + [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf ]] 00:01:14.048 + source /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:01:14.048 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:01:14.048 ++ SPDK_TEST_NVMF=1 00:01:14.048 ++ SPDK_TEST_NVME_CLI=1 00:01:14.048 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:14.048 ++ SPDK_TEST_NVMF_NICS=e810 00:01:14.048 ++ SPDK_RUN_UBSAN=1 00:01:14.048 ++ NET_TYPE=phy 00:01:14.048 ++ RUN_NIGHTLY=1 00:01:14.048 + case $SPDK_TEST_NVMF_NICS in 00:01:14.048 + DRIVERS=ice 00:01:14.048 + [[ tcp == \r\d\m\a ]] 00:01:14.048 + [[ -n ice ]] 00:01:14.048 + sudo rmmod mlx4_ib mlx5_ib irdma i40iw iw_cxgb4 00:01:14.048 rmmod: ERROR: Module mlx4_ib is not currently loaded 00:01:14.048 rmmod: ERROR: Module mlx5_ib is not currently loaded 00:01:14.048 rmmod: ERROR: Module irdma is not currently loaded 00:01:14.048 rmmod: ERROR: Module i40iw is not currently loaded 00:01:14.048 rmmod: ERROR: Module iw_cxgb4 is not currently loaded 00:01:14.048 + true 00:01:14.048 + for D in $DRIVERS 00:01:14.048 + sudo modprobe ice 00:01:14.048 + exit 0 00:01:14.059 [Pipeline] } 00:01:14.074 [Pipeline] // withEnv 00:01:14.079 [Pipeline] } 00:01:14.093 [Pipeline] // stage 00:01:14.103 [Pipeline] catchError 00:01:14.105 [Pipeline] { 00:01:14.119 [Pipeline] timeout 00:01:14.119 Timeout set to expire in 1 hr 0 min 00:01:14.121 [Pipeline] { 00:01:14.135 [Pipeline] stage 00:01:14.137 [Pipeline] { (Tests) 00:01:14.153 [Pipeline] sh 00:01:14.442 + jbp/jenkins/jjb-config/jobs/scripts/autoruner.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:14.442 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:14.442 + DIR_ROOT=/var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:14.442 + [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest ]] 00:01:14.442 + DIR_SPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:14.442 + DIR_OUTPUT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:01:14.442 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk ]] 00:01:14.442 + [[ ! -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:01:14.442 + mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:01:14.442 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:01:14.442 + [[ nvmf-tcp-phy-autotest == pkgdep-* ]] 00:01:14.442 + cd /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:14.442 + source /etc/os-release 00:01:14.442 ++ NAME='Fedora Linux' 00:01:14.442 ++ VERSION='39 (Cloud Edition)' 00:01:14.442 ++ ID=fedora 00:01:14.442 ++ VERSION_ID=39 00:01:14.442 ++ VERSION_CODENAME= 00:01:14.442 ++ PLATFORM_ID=platform:f39 00:01:14.442 ++ PRETTY_NAME='Fedora Linux 39 (Cloud Edition)' 00:01:14.442 ++ ANSI_COLOR='0;38;2;60;110;180' 00:01:14.442 ++ LOGO=fedora-logo-icon 00:01:14.442 ++ CPE_NAME=cpe:/o:fedoraproject:fedora:39 00:01:14.442 ++ HOME_URL=https://fedoraproject.org/ 00:01:14.442 ++ DOCUMENTATION_URL=https://docs.fedoraproject.org/en-US/fedora/f39/system-administrators-guide/ 00:01:14.442 ++ SUPPORT_URL=https://ask.fedoraproject.org/ 00:01:14.442 ++ BUG_REPORT_URL=https://bugzilla.redhat.com/ 00:01:14.442 ++ REDHAT_BUGZILLA_PRODUCT=Fedora 00:01:14.442 ++ REDHAT_BUGZILLA_PRODUCT_VERSION=39 00:01:14.442 ++ REDHAT_SUPPORT_PRODUCT=Fedora 00:01:14.442 ++ REDHAT_SUPPORT_PRODUCT_VERSION=39 00:01:14.442 ++ SUPPORT_END=2024-11-12 00:01:14.442 ++ VARIANT='Cloud Edition' 00:01:14.442 ++ VARIANT_ID=cloud 00:01:14.442 + uname -a 00:01:14.442 Linux spdk-gp-11 6.8.9-200.fc39.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Jul 24 03:04:40 UTC 2024 x86_64 GNU/Linux 00:01:14.442 + sudo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:01:15.381 Hugepages 00:01:15.381 node hugesize free / total 00:01:15.381 node0 1048576kB 0 / 0 00:01:15.381 node0 2048kB 0 / 0 00:01:15.381 node1 1048576kB 0 / 0 00:01:15.381 node1 2048kB 0 / 0 00:01:15.381 00:01:15.381 Type BDF Vendor Device NUMA Driver Device Block devices 00:01:15.381 I/OAT 0000:00:04.0 8086 0e20 0 ioatdma - - 00:01:15.381 I/OAT 0000:00:04.1 8086 0e21 0 ioatdma - - 00:01:15.381 I/OAT 0000:00:04.2 8086 0e22 0 ioatdma - - 00:01:15.381 I/OAT 0000:00:04.3 8086 0e23 0 ioatdma - - 00:01:15.381 I/OAT 0000:00:04.4 8086 0e24 0 ioatdma - - 00:01:15.381 I/OAT 0000:00:04.5 8086 0e25 0 ioatdma - - 00:01:15.381 I/OAT 0000:00:04.6 8086 0e26 0 ioatdma - - 00:01:15.381 I/OAT 0000:00:04.7 8086 0e27 0 ioatdma - - 00:01:15.381 I/OAT 0000:80:04.0 8086 0e20 1 ioatdma - - 00:01:15.381 I/OAT 0000:80:04.1 8086 0e21 1 ioatdma - - 00:01:15.381 I/OAT 0000:80:04.2 8086 0e22 1 ioatdma - - 00:01:15.381 I/OAT 0000:80:04.3 8086 0e23 1 ioatdma - - 00:01:15.381 I/OAT 0000:80:04.4 8086 0e24 1 ioatdma - - 00:01:15.381 I/OAT 0000:80:04.5 8086 0e25 1 ioatdma - - 00:01:15.381 I/OAT 0000:80:04.6 8086 0e26 1 ioatdma - - 00:01:15.381 I/OAT 0000:80:04.7 8086 0e27 1 ioatdma - - 00:01:15.381 NVMe 0000:88:00.0 8086 0a54 1 nvme nvme0 nvme0n1 00:01:15.381 + rm -f /tmp/spdk-ld-path 00:01:15.381 + source autorun-spdk.conf 00:01:15.381 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:01:15.381 ++ SPDK_TEST_NVMF=1 00:01:15.381 ++ SPDK_TEST_NVME_CLI=1 00:01:15.381 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:15.381 ++ SPDK_TEST_NVMF_NICS=e810 00:01:15.381 ++ SPDK_RUN_UBSAN=1 00:01:15.381 ++ NET_TYPE=phy 00:01:15.381 ++ RUN_NIGHTLY=1 00:01:15.381 + (( SPDK_TEST_NVME_CMB == 1 || SPDK_TEST_NVME_PMR == 1 )) 00:01:15.381 + [[ -n '' ]] 00:01:15.381 + sudo git config --global --add safe.directory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:15.381 + for M in /var/spdk/build-*-manifest.txt 00:01:15.381 + [[ -f /var/spdk/build-kernel-manifest.txt ]] 00:01:15.381 + cp /var/spdk/build-kernel-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:15.381 + for M in /var/spdk/build-*-manifest.txt 00:01:15.381 + [[ -f /var/spdk/build-pkg-manifest.txt ]] 00:01:15.381 + cp /var/spdk/build-pkg-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:15.381 + for M in /var/spdk/build-*-manifest.txt 00:01:15.381 + [[ -f /var/spdk/build-repo-manifest.txt ]] 00:01:15.381 + cp /var/spdk/build-repo-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:15.381 ++ uname 00:01:15.381 + [[ Linux == \L\i\n\u\x ]] 00:01:15.381 + sudo dmesg -T 00:01:15.381 + sudo dmesg --clear 00:01:15.381 + dmesg_pid=2854383 00:01:15.381 + [[ Fedora Linux == FreeBSD ]] 00:01:15.381 + export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:01:15.381 + UNBIND_ENTIRE_IOMMU_GROUP=yes 00:01:15.381 + [[ -e /var/spdk/dependencies/vhost/spdk_test_image.qcow2 ]] 00:01:15.381 + sudo dmesg -Tw 00:01:15.381 + [[ -x /usr/src/fio-static/fio ]] 00:01:15.381 + export FIO_BIN=/usr/src/fio-static/fio 00:01:15.381 + FIO_BIN=/usr/src/fio-static/fio 00:01:15.381 + [[ '' == \/\v\a\r\/\j\e\n\k\i\n\s\/\w\o\r\k\s\p\a\c\e\/\n\v\m\f\-\t\c\p\-\p\h\y\-\a\u\t\o\t\e\s\t\/\q\e\m\u\_\v\f\i\o\/* ]] 00:01:15.381 + [[ ! -v VFIO_QEMU_BIN ]] 00:01:15.381 + [[ -e /usr/local/qemu/vfio-user-latest ]] 00:01:15.381 + export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:01:15.381 + VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:01:15.381 + [[ -e /usr/local/qemu/vanilla-latest ]] 00:01:15.381 + export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:01:15.381 + QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:01:15.381 + spdk/autorun.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:01:15.381 Test configuration: 00:01:15.381 SPDK_RUN_FUNCTIONAL_TEST=1 00:01:15.381 SPDK_TEST_NVMF=1 00:01:15.381 SPDK_TEST_NVME_CLI=1 00:01:15.381 SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:15.381 SPDK_TEST_NVMF_NICS=e810 00:01:15.381 SPDK_RUN_UBSAN=1 00:01:15.381 NET_TYPE=phy 00:01:15.641 RUN_NIGHTLY=1 03:17:56 -- common/autotest_common.sh@1689 -- $ [[ n == y ]] 00:01:15.641 03:17:56 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:01:15.641 03:17:56 -- scripts/common.sh@433 -- $ [[ -e /bin/wpdk_common.sh ]] 00:01:15.641 03:17:56 -- scripts/common.sh@441 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:01:15.641 03:17:56 -- scripts/common.sh@442 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:01:15.641 03:17:56 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:15.641 03:17:56 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:15.641 03:17:56 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:15.641 03:17:56 -- paths/export.sh@5 -- $ export PATH 00:01:15.641 03:17:56 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:15.641 03:17:56 -- common/autobuild_common.sh@439 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:01:15.641 03:17:56 -- common/autobuild_common.sh@440 -- $ date +%s 00:01:15.641 03:17:56 -- common/autobuild_common.sh@440 -- $ mktemp -dt spdk_1732155476.XXXXXX 00:01:15.641 03:17:56 -- common/autobuild_common.sh@440 -- $ SPDK_WORKSPACE=/tmp/spdk_1732155476.WE68IR 00:01:15.641 03:17:56 -- common/autobuild_common.sh@442 -- $ [[ -n '' ]] 00:01:15.641 03:17:56 -- common/autobuild_common.sh@446 -- $ '[' -n '' ']' 00:01:15.641 03:17:56 -- common/autobuild_common.sh@449 -- $ scanbuild_exclude='--exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/' 00:01:15.641 03:17:56 -- common/autobuild_common.sh@453 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:01:15.641 03:17:56 -- common/autobuild_common.sh@455 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/ --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:01:15.641 03:17:56 -- common/autobuild_common.sh@456 -- $ get_config_params 00:01:15.641 03:17:56 -- common/autotest_common.sh@397 -- $ xtrace_disable 00:01:15.641 03:17:56 -- common/autotest_common.sh@10 -- $ set +x 00:01:15.641 03:17:56 -- common/autobuild_common.sh@456 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk' 00:01:15.641 03:17:56 -- spdk/autobuild.sh@11 -- $ SPDK_TEST_AUTOBUILD= 00:01:15.641 03:17:56 -- spdk/autobuild.sh@12 -- $ umask 022 00:01:15.641 03:17:56 -- spdk/autobuild.sh@13 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:15.641 03:17:56 -- spdk/autobuild.sh@16 -- $ date -u 00:01:15.641 Thu Nov 21 02:17:56 AM UTC 2024 00:01:15.641 03:17:56 -- spdk/autobuild.sh@17 -- $ git describe --tags 00:01:15.641 LTS-67-gc13c99a5e 00:01:15.641 03:17:56 -- spdk/autobuild.sh@19 -- $ '[' 0 -eq 1 ']' 00:01:15.641 03:17:56 -- spdk/autobuild.sh@23 -- $ '[' 1 -eq 1 ']' 00:01:15.641 03:17:56 -- spdk/autobuild.sh@24 -- $ run_test ubsan echo 'using ubsan' 00:01:15.641 03:17:56 -- common/autotest_common.sh@1087 -- $ '[' 3 -le 1 ']' 00:01:15.641 03:17:56 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:01:15.641 03:17:56 -- common/autotest_common.sh@10 -- $ set +x 00:01:15.641 ************************************ 00:01:15.641 START TEST ubsan 00:01:15.641 ************************************ 00:01:15.641 03:17:56 -- common/autotest_common.sh@1114 -- $ echo 'using ubsan' 00:01:15.641 using ubsan 00:01:15.641 00:01:15.641 real 0m0.000s 00:01:15.641 user 0m0.000s 00:01:15.641 sys 0m0.000s 00:01:15.641 03:17:56 -- common/autotest_common.sh@1115 -- $ xtrace_disable 00:01:15.641 03:17:56 -- common/autotest_common.sh@10 -- $ set +x 00:01:15.641 ************************************ 00:01:15.641 END TEST ubsan 00:01:15.641 ************************************ 00:01:15.641 03:17:56 -- spdk/autobuild.sh@27 -- $ '[' -n '' ']' 00:01:15.641 03:17:56 -- spdk/autobuild.sh@31 -- $ case "$SPDK_TEST_AUTOBUILD" in 00:01:15.641 03:17:56 -- spdk/autobuild.sh@47 -- $ [[ 0 -eq 1 ]] 00:01:15.641 03:17:56 -- spdk/autobuild.sh@51 -- $ [[ 0 -eq 1 ]] 00:01:15.641 03:17:56 -- spdk/autobuild.sh@55 -- $ [[ -n '' ]] 00:01:15.641 03:17:56 -- spdk/autobuild.sh@57 -- $ [[ 0 -eq 1 ]] 00:01:15.641 03:17:56 -- spdk/autobuild.sh@59 -- $ [[ 0 -eq 1 ]] 00:01:15.641 03:17:56 -- spdk/autobuild.sh@62 -- $ [[ 0 -eq 1 ]] 00:01:15.641 03:17:56 -- spdk/autobuild.sh@67 -- $ /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/configure --enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-shared 00:01:15.641 Using default SPDK env in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:01:15.641 Using default DPDK in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:01:15.900 Using 'verbs' RDMA provider 00:01:26.458 Configuring ISA-L (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/isa-l/spdk-isal.log)...done. 00:01:36.444 Configuring ISA-L-crypto (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/isa-l-crypto/spdk-isal-crypto.log)...done. 00:01:36.444 Creating mk/config.mk...done. 00:01:36.444 Creating mk/cc.flags.mk...done. 00:01:36.444 Type 'make' to build. 00:01:36.444 03:18:16 -- spdk/autobuild.sh@69 -- $ run_test make make -j48 00:01:36.444 03:18:16 -- common/autotest_common.sh@1087 -- $ '[' 3 -le 1 ']' 00:01:36.444 03:18:16 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:01:36.444 03:18:16 -- common/autotest_common.sh@10 -- $ set +x 00:01:36.444 ************************************ 00:01:36.444 START TEST make 00:01:36.444 ************************************ 00:01:36.444 03:18:16 -- common/autotest_common.sh@1114 -- $ make -j48 00:01:36.444 make[1]: Nothing to be done for 'all'. 00:01:44.579 The Meson build system 00:01:44.579 Version: 1.5.0 00:01:44.579 Source dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk 00:01:44.579 Build dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build-tmp 00:01:44.579 Build type: native build 00:01:44.579 Program cat found: YES (/usr/bin/cat) 00:01:44.579 Project name: DPDK 00:01:44.579 Project version: 23.11.0 00:01:44.579 C compiler for the host machine: cc (gcc 13.3.1 "cc (GCC) 13.3.1 20240522 (Red Hat 13.3.1-1)") 00:01:44.579 C linker for the host machine: cc ld.bfd 2.40-14 00:01:44.579 Host machine cpu family: x86_64 00:01:44.579 Host machine cpu: x86_64 00:01:44.579 Message: ## Building in Developer Mode ## 00:01:44.579 Program pkg-config found: YES (/usr/bin/pkg-config) 00:01:44.579 Program check-symbols.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/buildtools/check-symbols.sh) 00:01:44.579 Program options-ibverbs-static.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/buildtools/options-ibverbs-static.sh) 00:01:44.579 Program python3 found: YES (/usr/bin/python3) 00:01:44.579 Program cat found: YES (/usr/bin/cat) 00:01:44.579 Compiler for C supports arguments -march=native: YES 00:01:44.579 Checking for size of "void *" : 8 00:01:44.579 Checking for size of "void *" : 8 (cached) 00:01:44.579 Library m found: YES 00:01:44.579 Library numa found: YES 00:01:44.579 Has header "numaif.h" : YES 00:01:44.579 Library fdt found: NO 00:01:44.579 Library execinfo found: NO 00:01:44.579 Has header "execinfo.h" : YES 00:01:44.579 Found pkg-config: YES (/usr/bin/pkg-config) 1.9.5 00:01:44.579 Run-time dependency libarchive found: NO (tried pkgconfig) 00:01:44.579 Run-time dependency libbsd found: NO (tried pkgconfig) 00:01:44.579 Run-time dependency jansson found: NO (tried pkgconfig) 00:01:44.579 Run-time dependency openssl found: YES 3.1.1 00:01:44.579 Run-time dependency libpcap found: YES 1.10.4 00:01:44.579 Has header "pcap.h" with dependency libpcap: YES 00:01:44.579 Compiler for C supports arguments -Wcast-qual: YES 00:01:44.579 Compiler for C supports arguments -Wdeprecated: YES 00:01:44.579 Compiler for C supports arguments -Wformat: YES 00:01:44.579 Compiler for C supports arguments -Wformat-nonliteral: NO 00:01:44.579 Compiler for C supports arguments -Wformat-security: NO 00:01:44.579 Compiler for C supports arguments -Wmissing-declarations: YES 00:01:44.579 Compiler for C supports arguments -Wmissing-prototypes: YES 00:01:44.579 Compiler for C supports arguments -Wnested-externs: YES 00:01:44.579 Compiler for C supports arguments -Wold-style-definition: YES 00:01:44.579 Compiler for C supports arguments -Wpointer-arith: YES 00:01:44.579 Compiler for C supports arguments -Wsign-compare: YES 00:01:44.579 Compiler for C supports arguments -Wstrict-prototypes: YES 00:01:44.579 Compiler for C supports arguments -Wundef: YES 00:01:44.579 Compiler for C supports arguments -Wwrite-strings: YES 00:01:44.579 Compiler for C supports arguments -Wno-address-of-packed-member: YES 00:01:44.579 Compiler for C supports arguments -Wno-packed-not-aligned: YES 00:01:44.579 Compiler for C supports arguments -Wno-missing-field-initializers: YES 00:01:44.579 Compiler for C supports arguments -Wno-zero-length-bounds: YES 00:01:44.579 Program objdump found: YES (/usr/bin/objdump) 00:01:44.579 Compiler for C supports arguments -mavx512f: YES 00:01:44.579 Checking if "AVX512 checking" compiles: YES 00:01:44.579 Fetching value of define "__SSE4_2__" : 1 00:01:44.579 Fetching value of define "__AES__" : 1 00:01:44.579 Fetching value of define "__AVX__" : 1 00:01:44.579 Fetching value of define "__AVX2__" : (undefined) 00:01:44.579 Fetching value of define "__AVX512BW__" : (undefined) 00:01:44.579 Fetching value of define "__AVX512CD__" : (undefined) 00:01:44.579 Fetching value of define "__AVX512DQ__" : (undefined) 00:01:44.579 Fetching value of define "__AVX512F__" : (undefined) 00:01:44.579 Fetching value of define "__AVX512VL__" : (undefined) 00:01:44.579 Fetching value of define "__PCLMUL__" : 1 00:01:44.579 Fetching value of define "__RDRND__" : 1 00:01:44.579 Fetching value of define "__RDSEED__" : (undefined) 00:01:44.579 Fetching value of define "__VPCLMULQDQ__" : (undefined) 00:01:44.579 Fetching value of define "__znver1__" : (undefined) 00:01:44.579 Fetching value of define "__znver2__" : (undefined) 00:01:44.579 Fetching value of define "__znver3__" : (undefined) 00:01:44.579 Fetching value of define "__znver4__" : (undefined) 00:01:44.579 Compiler for C supports arguments -Wno-format-truncation: YES 00:01:44.579 Message: lib/log: Defining dependency "log" 00:01:44.579 Message: lib/kvargs: Defining dependency "kvargs" 00:01:44.579 Message: lib/telemetry: Defining dependency "telemetry" 00:01:44.579 Checking for function "getentropy" : NO 00:01:44.579 Message: lib/eal: Defining dependency "eal" 00:01:44.579 Message: lib/ring: Defining dependency "ring" 00:01:44.579 Message: lib/rcu: Defining dependency "rcu" 00:01:44.579 Message: lib/mempool: Defining dependency "mempool" 00:01:44.579 Message: lib/mbuf: Defining dependency "mbuf" 00:01:44.579 Fetching value of define "__PCLMUL__" : 1 (cached) 00:01:44.579 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:44.579 Compiler for C supports arguments -mpclmul: YES 00:01:44.579 Compiler for C supports arguments -maes: YES 00:01:44.579 Compiler for C supports arguments -mavx512f: YES (cached) 00:01:44.579 Compiler for C supports arguments -mavx512bw: YES 00:01:44.579 Compiler for C supports arguments -mavx512dq: YES 00:01:44.579 Compiler for C supports arguments -mavx512vl: YES 00:01:44.579 Compiler for C supports arguments -mvpclmulqdq: YES 00:01:44.579 Compiler for C supports arguments -mavx2: YES 00:01:44.579 Compiler for C supports arguments -mavx: YES 00:01:44.579 Message: lib/net: Defining dependency "net" 00:01:44.579 Message: lib/meter: Defining dependency "meter" 00:01:44.579 Message: lib/ethdev: Defining dependency "ethdev" 00:01:44.579 Message: lib/pci: Defining dependency "pci" 00:01:44.579 Message: lib/cmdline: Defining dependency "cmdline" 00:01:44.579 Message: lib/hash: Defining dependency "hash" 00:01:44.579 Message: lib/timer: Defining dependency "timer" 00:01:44.579 Message: lib/compressdev: Defining dependency "compressdev" 00:01:44.579 Message: lib/cryptodev: Defining dependency "cryptodev" 00:01:44.579 Message: lib/dmadev: Defining dependency "dmadev" 00:01:44.579 Compiler for C supports arguments -Wno-cast-qual: YES 00:01:44.579 Message: lib/power: Defining dependency "power" 00:01:44.579 Message: lib/reorder: Defining dependency "reorder" 00:01:44.579 Message: lib/security: Defining dependency "security" 00:01:44.579 Has header "linux/userfaultfd.h" : YES 00:01:44.579 Has header "linux/vduse.h" : YES 00:01:44.579 Message: lib/vhost: Defining dependency "vhost" 00:01:44.579 Compiler for C supports arguments -Wno-format-truncation: YES (cached) 00:01:44.579 Message: drivers/bus/pci: Defining dependency "bus_pci" 00:01:44.579 Message: drivers/bus/vdev: Defining dependency "bus_vdev" 00:01:44.579 Message: drivers/mempool/ring: Defining dependency "mempool_ring" 00:01:44.579 Message: Disabling raw/* drivers: missing internal dependency "rawdev" 00:01:44.579 Message: Disabling regex/* drivers: missing internal dependency "regexdev" 00:01:44.579 Message: Disabling ml/* drivers: missing internal dependency "mldev" 00:01:44.579 Message: Disabling event/* drivers: missing internal dependency "eventdev" 00:01:44.579 Message: Disabling baseband/* drivers: missing internal dependency "bbdev" 00:01:44.579 Message: Disabling gpu/* drivers: missing internal dependency "gpudev" 00:01:44.579 Program doxygen found: YES (/usr/local/bin/doxygen) 00:01:44.579 Configuring doxy-api-html.conf using configuration 00:01:44.579 Configuring doxy-api-man.conf using configuration 00:01:44.579 Program mandb found: YES (/usr/bin/mandb) 00:01:44.579 Program sphinx-build found: NO 00:01:44.579 Configuring rte_build_config.h using configuration 00:01:44.579 Message: 00:01:44.579 ================= 00:01:44.579 Applications Enabled 00:01:44.579 ================= 00:01:44.579 00:01:44.579 apps: 00:01:44.579 00:01:44.579 00:01:44.579 Message: 00:01:44.579 ================= 00:01:44.579 Libraries Enabled 00:01:44.579 ================= 00:01:44.579 00:01:44.579 libs: 00:01:44.579 log, kvargs, telemetry, eal, ring, rcu, mempool, mbuf, 00:01:44.579 net, meter, ethdev, pci, cmdline, hash, timer, compressdev, 00:01:44.579 cryptodev, dmadev, power, reorder, security, vhost, 00:01:44.579 00:01:44.579 Message: 00:01:44.579 =============== 00:01:44.579 Drivers Enabled 00:01:44.579 =============== 00:01:44.579 00:01:44.579 common: 00:01:44.579 00:01:44.579 bus: 00:01:44.579 pci, vdev, 00:01:44.579 mempool: 00:01:44.579 ring, 00:01:44.579 dma: 00:01:44.579 00:01:44.579 net: 00:01:44.579 00:01:44.579 crypto: 00:01:44.579 00:01:44.579 compress: 00:01:44.579 00:01:44.579 vdpa: 00:01:44.579 00:01:44.579 00:01:44.579 Message: 00:01:44.579 ================= 00:01:44.579 Content Skipped 00:01:44.579 ================= 00:01:44.579 00:01:44.579 apps: 00:01:44.579 dumpcap: explicitly disabled via build config 00:01:44.579 graph: explicitly disabled via build config 00:01:44.579 pdump: explicitly disabled via build config 00:01:44.579 proc-info: explicitly disabled via build config 00:01:44.579 test-acl: explicitly disabled via build config 00:01:44.579 test-bbdev: explicitly disabled via build config 00:01:44.579 test-cmdline: explicitly disabled via build config 00:01:44.579 test-compress-perf: explicitly disabled via build config 00:01:44.579 test-crypto-perf: explicitly disabled via build config 00:01:44.579 test-dma-perf: explicitly disabled via build config 00:01:44.579 test-eventdev: explicitly disabled via build config 00:01:44.579 test-fib: explicitly disabled via build config 00:01:44.579 test-flow-perf: explicitly disabled via build config 00:01:44.579 test-gpudev: explicitly disabled via build config 00:01:44.579 test-mldev: explicitly disabled via build config 00:01:44.579 test-pipeline: explicitly disabled via build config 00:01:44.579 test-pmd: explicitly disabled via build config 00:01:44.579 test-regex: explicitly disabled via build config 00:01:44.579 test-sad: explicitly disabled via build config 00:01:44.580 test-security-perf: explicitly disabled via build config 00:01:44.580 00:01:44.580 libs: 00:01:44.580 metrics: explicitly disabled via build config 00:01:44.580 acl: explicitly disabled via build config 00:01:44.580 bbdev: explicitly disabled via build config 00:01:44.580 bitratestats: explicitly disabled via build config 00:01:44.580 bpf: explicitly disabled via build config 00:01:44.580 cfgfile: explicitly disabled via build config 00:01:44.580 distributor: explicitly disabled via build config 00:01:44.580 efd: explicitly disabled via build config 00:01:44.580 eventdev: explicitly disabled via build config 00:01:44.580 dispatcher: explicitly disabled via build config 00:01:44.580 gpudev: explicitly disabled via build config 00:01:44.580 gro: explicitly disabled via build config 00:01:44.580 gso: explicitly disabled via build config 00:01:44.580 ip_frag: explicitly disabled via build config 00:01:44.580 jobstats: explicitly disabled via build config 00:01:44.580 latencystats: explicitly disabled via build config 00:01:44.580 lpm: explicitly disabled via build config 00:01:44.580 member: explicitly disabled via build config 00:01:44.580 pcapng: explicitly disabled via build config 00:01:44.580 rawdev: explicitly disabled via build config 00:01:44.580 regexdev: explicitly disabled via build config 00:01:44.580 mldev: explicitly disabled via build config 00:01:44.580 rib: explicitly disabled via build config 00:01:44.580 sched: explicitly disabled via build config 00:01:44.580 stack: explicitly disabled via build config 00:01:44.580 ipsec: explicitly disabled via build config 00:01:44.580 pdcp: explicitly disabled via build config 00:01:44.580 fib: explicitly disabled via build config 00:01:44.580 port: explicitly disabled via build config 00:01:44.580 pdump: explicitly disabled via build config 00:01:44.580 table: explicitly disabled via build config 00:01:44.580 pipeline: explicitly disabled via build config 00:01:44.580 graph: explicitly disabled via build config 00:01:44.580 node: explicitly disabled via build config 00:01:44.580 00:01:44.580 drivers: 00:01:44.580 common/cpt: not in enabled drivers build config 00:01:44.580 common/dpaax: not in enabled drivers build config 00:01:44.580 common/iavf: not in enabled drivers build config 00:01:44.580 common/idpf: not in enabled drivers build config 00:01:44.580 common/mvep: not in enabled drivers build config 00:01:44.580 common/octeontx: not in enabled drivers build config 00:01:44.580 bus/auxiliary: not in enabled drivers build config 00:01:44.580 bus/cdx: not in enabled drivers build config 00:01:44.580 bus/dpaa: not in enabled drivers build config 00:01:44.580 bus/fslmc: not in enabled drivers build config 00:01:44.580 bus/ifpga: not in enabled drivers build config 00:01:44.580 bus/platform: not in enabled drivers build config 00:01:44.580 bus/vmbus: not in enabled drivers build config 00:01:44.580 common/cnxk: not in enabled drivers build config 00:01:44.580 common/mlx5: not in enabled drivers build config 00:01:44.580 common/nfp: not in enabled drivers build config 00:01:44.580 common/qat: not in enabled drivers build config 00:01:44.580 common/sfc_efx: not in enabled drivers build config 00:01:44.580 mempool/bucket: not in enabled drivers build config 00:01:44.580 mempool/cnxk: not in enabled drivers build config 00:01:44.580 mempool/dpaa: not in enabled drivers build config 00:01:44.580 mempool/dpaa2: not in enabled drivers build config 00:01:44.580 mempool/octeontx: not in enabled drivers build config 00:01:44.580 mempool/stack: not in enabled drivers build config 00:01:44.580 dma/cnxk: not in enabled drivers build config 00:01:44.580 dma/dpaa: not in enabled drivers build config 00:01:44.580 dma/dpaa2: not in enabled drivers build config 00:01:44.580 dma/hisilicon: not in enabled drivers build config 00:01:44.580 dma/idxd: not in enabled drivers build config 00:01:44.580 dma/ioat: not in enabled drivers build config 00:01:44.580 dma/skeleton: not in enabled drivers build config 00:01:44.580 net/af_packet: not in enabled drivers build config 00:01:44.580 net/af_xdp: not in enabled drivers build config 00:01:44.580 net/ark: not in enabled drivers build config 00:01:44.580 net/atlantic: not in enabled drivers build config 00:01:44.580 net/avp: not in enabled drivers build config 00:01:44.580 net/axgbe: not in enabled drivers build config 00:01:44.580 net/bnx2x: not in enabled drivers build config 00:01:44.580 net/bnxt: not in enabled drivers build config 00:01:44.580 net/bonding: not in enabled drivers build config 00:01:44.580 net/cnxk: not in enabled drivers build config 00:01:44.580 net/cpfl: not in enabled drivers build config 00:01:44.580 net/cxgbe: not in enabled drivers build config 00:01:44.580 net/dpaa: not in enabled drivers build config 00:01:44.580 net/dpaa2: not in enabled drivers build config 00:01:44.580 net/e1000: not in enabled drivers build config 00:01:44.580 net/ena: not in enabled drivers build config 00:01:44.580 net/enetc: not in enabled drivers build config 00:01:44.580 net/enetfec: not in enabled drivers build config 00:01:44.580 net/enic: not in enabled drivers build config 00:01:44.580 net/failsafe: not in enabled drivers build config 00:01:44.580 net/fm10k: not in enabled drivers build config 00:01:44.580 net/gve: not in enabled drivers build config 00:01:44.580 net/hinic: not in enabled drivers build config 00:01:44.580 net/hns3: not in enabled drivers build config 00:01:44.580 net/i40e: not in enabled drivers build config 00:01:44.580 net/iavf: not in enabled drivers build config 00:01:44.580 net/ice: not in enabled drivers build config 00:01:44.580 net/idpf: not in enabled drivers build config 00:01:44.580 net/igc: not in enabled drivers build config 00:01:44.580 net/ionic: not in enabled drivers build config 00:01:44.580 net/ipn3ke: not in enabled drivers build config 00:01:44.580 net/ixgbe: not in enabled drivers build config 00:01:44.580 net/mana: not in enabled drivers build config 00:01:44.580 net/memif: not in enabled drivers build config 00:01:44.580 net/mlx4: not in enabled drivers build config 00:01:44.580 net/mlx5: not in enabled drivers build config 00:01:44.580 net/mvneta: not in enabled drivers build config 00:01:44.580 net/mvpp2: not in enabled drivers build config 00:01:44.580 net/netvsc: not in enabled drivers build config 00:01:44.580 net/nfb: not in enabled drivers build config 00:01:44.580 net/nfp: not in enabled drivers build config 00:01:44.580 net/ngbe: not in enabled drivers build config 00:01:44.580 net/null: not in enabled drivers build config 00:01:44.580 net/octeontx: not in enabled drivers build config 00:01:44.580 net/octeon_ep: not in enabled drivers build config 00:01:44.580 net/pcap: not in enabled drivers build config 00:01:44.580 net/pfe: not in enabled drivers build config 00:01:44.580 net/qede: not in enabled drivers build config 00:01:44.580 net/ring: not in enabled drivers build config 00:01:44.580 net/sfc: not in enabled drivers build config 00:01:44.580 net/softnic: not in enabled drivers build config 00:01:44.580 net/tap: not in enabled drivers build config 00:01:44.580 net/thunderx: not in enabled drivers build config 00:01:44.580 net/txgbe: not in enabled drivers build config 00:01:44.580 net/vdev_netvsc: not in enabled drivers build config 00:01:44.580 net/vhost: not in enabled drivers build config 00:01:44.580 net/virtio: not in enabled drivers build config 00:01:44.580 net/vmxnet3: not in enabled drivers build config 00:01:44.580 raw/*: missing internal dependency, "rawdev" 00:01:44.580 crypto/armv8: not in enabled drivers build config 00:01:44.580 crypto/bcmfs: not in enabled drivers build config 00:01:44.580 crypto/caam_jr: not in enabled drivers build config 00:01:44.580 crypto/ccp: not in enabled drivers build config 00:01:44.580 crypto/cnxk: not in enabled drivers build config 00:01:44.580 crypto/dpaa_sec: not in enabled drivers build config 00:01:44.580 crypto/dpaa2_sec: not in enabled drivers build config 00:01:44.580 crypto/ipsec_mb: not in enabled drivers build config 00:01:44.580 crypto/mlx5: not in enabled drivers build config 00:01:44.580 crypto/mvsam: not in enabled drivers build config 00:01:44.580 crypto/nitrox: not in enabled drivers build config 00:01:44.580 crypto/null: not in enabled drivers build config 00:01:44.580 crypto/octeontx: not in enabled drivers build config 00:01:44.580 crypto/openssl: not in enabled drivers build config 00:01:44.580 crypto/scheduler: not in enabled drivers build config 00:01:44.580 crypto/uadk: not in enabled drivers build config 00:01:44.580 crypto/virtio: not in enabled drivers build config 00:01:44.580 compress/isal: not in enabled drivers build config 00:01:44.580 compress/mlx5: not in enabled drivers build config 00:01:44.580 compress/octeontx: not in enabled drivers build config 00:01:44.580 compress/zlib: not in enabled drivers build config 00:01:44.580 regex/*: missing internal dependency, "regexdev" 00:01:44.580 ml/*: missing internal dependency, "mldev" 00:01:44.580 vdpa/ifc: not in enabled drivers build config 00:01:44.580 vdpa/mlx5: not in enabled drivers build config 00:01:44.580 vdpa/nfp: not in enabled drivers build config 00:01:44.580 vdpa/sfc: not in enabled drivers build config 00:01:44.580 event/*: missing internal dependency, "eventdev" 00:01:44.580 baseband/*: missing internal dependency, "bbdev" 00:01:44.580 gpu/*: missing internal dependency, "gpudev" 00:01:44.580 00:01:44.580 00:01:45.147 Build targets in project: 85 00:01:45.147 00:01:45.147 DPDK 23.11.0 00:01:45.147 00:01:45.147 User defined options 00:01:45.147 buildtype : debug 00:01:45.147 default_library : shared 00:01:45.147 libdir : lib 00:01:45.147 prefix : /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:01:45.147 c_args : -fPIC -Werror -Wno-stringop-overflow -fcommon -Wno-stringop-overread -Wno-array-bounds 00:01:45.147 c_link_args : 00:01:45.147 cpu_instruction_set: native 00:01:45.147 disable_apps : test-sad,test-acl,test-dma-perf,test-pipeline,test-compress-perf,test-fib,test-flow-perf,test-crypto-perf,test-bbdev,test-eventdev,pdump,test-mldev,test-cmdline,graph,test-security-perf,test-pmd,test,proc-info,test-regex,dumpcap,test-gpudev 00:01:45.147 disable_libs : port,sched,rib,node,ipsec,distributor,gro,eventdev,pdcp,acl,member,latencystats,efd,stack,regexdev,rawdev,bpf,metrics,gpudev,pipeline,pdump,table,fib,dispatcher,mldev,gso,cfgfile,bitratestats,ip_frag,graph,lpm,jobstats,pcapng,bbdev 00:01:45.147 enable_docs : false 00:01:45.147 enable_drivers : bus,bus/pci,bus/vdev,mempool/ring 00:01:45.147 enable_kmods : false 00:01:45.147 tests : false 00:01:45.147 00:01:45.147 Found ninja-1.11.1.git.kitware.jobserver-1 at /usr/local/bin/ninja 00:01:45.406 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build-tmp' 00:01:45.672 [1/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hypervisor.c.o 00:01:45.672 [2/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_errno.c.o 00:01:45.672 [3/265] Compiling C object lib/librte_log.a.p/log_log_linux.c.o 00:01:45.672 [4/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hexdump.c.o 00:01:45.672 [5/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_class.c.o 00:01:45.672 [6/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_cpuflags.c.o 00:01:45.672 [7/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_reciprocal.c.o 00:01:45.672 [8/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_version.c.o 00:01:45.672 [9/265] Compiling C object lib/librte_kvargs.a.p/kvargs_rte_kvargs.c.o 00:01:45.672 [10/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_debug.c.o 00:01:45.672 [11/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_uuid.c.o 00:01:45.672 [12/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_string_fns.c.o 00:01:45.672 [13/265] Linking static target lib/librte_kvargs.a 00:01:45.672 [14/265] Compiling C object lib/librte_log.a.p/log_log.c.o 00:01:45.672 [15/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_debug.c.o 00:01:45.672 [16/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_data.c.o 00:01:45.672 [17/265] Linking static target lib/librte_log.a 00:01:45.672 [18/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_cpuflags.c.o 00:01:45.672 [19/265] Compiling C object lib/librte_eal.a.p/eal_unix_rte_thread.c.o 00:01:45.672 [20/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_firmware.c.o 00:01:45.931 [21/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_thread.c.o 00:01:46.196 [22/265] Generating lib/kvargs.sym_chk with a custom command (wrapped by meson to capture output) 00:01:46.456 [23/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_random.c.o 00:01:46.456 [24/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_config.c.o 00:01:46.456 [25/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_bus.c.o 00:01:46.456 [26/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_mcfg.c.o 00:01:46.456 [27/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_tailqs.c.o 00:01:46.456 [28/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_launch.c.o 00:01:46.456 [29/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_devargs.c.o 00:01:46.456 [30/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_interrupts.c.o 00:01:46.456 [31/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_elem.c.o 00:01:46.456 [32/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dynmem.c.o 00:01:46.456 [33/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dev.c.o 00:01:46.456 [34/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memalloc.c.o 00:01:46.456 [35/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_ctf.c.o 00:01:46.456 [36/265] Compiling C object lib/librte_eal.a.p/eal_common_hotplug_mp.c.o 00:01:46.456 [37/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_file.c.o 00:01:46.456 [38/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_thread.c.o 00:01:46.456 [39/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_filesystem.c.o 00:01:46.456 [40/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_utils.c.o 00:01:46.456 [41/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memzone.c.o 00:01:46.456 [42/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace.c.o 00:01:46.456 [43/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_thread.c.o 00:01:46.456 [44/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_hypervisor.c.o 00:01:46.456 [45/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_memory.c.o 00:01:46.456 [46/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cpuflags.c.o 00:01:46.456 [47/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_spinlock.c.o 00:01:46.456 [48/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio_mp_sync.c.o 00:01:46.456 [49/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry.c.o 00:01:46.720 [50/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_lcore.c.o 00:01:46.720 [51/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_points.c.o 00:01:46.720 [52/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_lcore.c.o 00:01:46.720 [53/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_alarm.c.o 00:01:46.720 [54/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_service.c.o 00:01:46.720 [55/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_fbarray.c.o 00:01:46.720 [56/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_dev.c.o 00:01:46.720 [57/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_legacy.c.o 00:01:46.720 [58/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_heap.c.o 00:01:46.720 [59/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_keepalive.c.o 00:01:46.720 [60/265] Linking static target lib/librte_telemetry.a 00:01:46.720 [61/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_proc.c.o 00:01:46.720 [62/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_timer.c.o 00:01:46.720 [63/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_hugepage_info.c.o 00:01:46.720 [64/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal.c.o 00:01:46.720 [65/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_mp.c.o 00:01:46.720 [66/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_timer.c.o 00:01:46.720 [67/265] Generating lib/log.sym_chk with a custom command (wrapped by meson to capture output) 00:01:46.720 [68/265] Linking target lib/librte_log.so.24.0 00:01:46.981 [69/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memory.c.o 00:01:46.981 [70/265] Compiling C object lib/librte_pci.a.p/pci_rte_pci.c.o 00:01:46.981 [71/265] Linking static target lib/librte_pci.a 00:01:46.981 [72/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline.c.o 00:01:46.981 [73/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memalloc.c.o 00:01:46.981 [74/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memory.c.o 00:01:46.981 [75/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_cirbuf.c.o 00:01:46.981 [76/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_malloc.c.o 00:01:46.981 [77/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse.c.o 00:01:46.981 [78/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_timer.c.o 00:01:46.981 [79/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_portlist.c.o 00:01:47.243 [80/265] Generating symbol file lib/librte_log.so.24.0.p/librte_log.so.24.0.symbols 00:01:47.243 [81/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_socket.c.o 00:01:47.243 [82/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_num.c.o 00:01:47.243 [83/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_string.c.o 00:01:47.243 [84/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_rdline.c.o 00:01:47.243 [85/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_interrupts.c.o 00:01:47.243 [86/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_vt100.c.o 00:01:47.243 [87/265] Linking target lib/librte_kvargs.so.24.0 00:01:47.243 [88/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_options.c.o 00:01:47.243 [89/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_os_unix.c.o 00:01:47.243 [90/265] Compiling C object lib/net/libnet_crc_avx512_lib.a.p/net_crc_avx512.c.o 00:01:47.243 [91/265] Linking static target lib/net/libnet_crc_avx512_lib.a 00:01:47.504 [92/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio.c.o 00:01:47.504 [93/265] Generating lib/pci.sym_chk with a custom command (wrapped by meson to capture output) 00:01:47.504 [94/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_power_intrinsics.c.o 00:01:47.504 [95/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cycles.c.o 00:01:47.504 [96/265] Generating symbol file lib/librte_kvargs.so.24.0.p/librte_kvargs.so.24.0.symbols 00:01:47.504 [97/265] Linking static target lib/librte_eal.a 00:01:47.504 [98/265] Compiling C object lib/librte_net.a.p/net_rte_net_crc.c.o 00:01:47.504 [99/265] Compiling C object lib/librte_ring.a.p/ring_rte_ring.c.o 00:01:47.504 [100/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops_default.c.o 00:01:47.504 [101/265] Linking static target lib/librte_ring.a 00:01:47.504 [102/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_pool_ops.c.o 00:01:47.504 [103/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops.c.o 00:01:47.504 [104/265] Compiling C object lib/librte_meter.a.p/meter_rte_meter.c.o 00:01:47.504 [105/265] Compiling C object lib/librte_net.a.p/net_net_crc_sse.c.o 00:01:47.504 [106/265] Compiling C object lib/librte_mempool.a.p/mempool_mempool_trace_points.c.o 00:01:47.504 [107/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_ptype.c.o 00:01:47.504 [108/265] Linking static target lib/librte_meter.a 00:01:47.504 [109/265] Compiling C object lib/librte_power.a.p/power_guest_channel.c.o 00:01:47.770 [110/265] Compiling C object lib/librte_power.a.p/power_power_common.c.o 00:01:47.770 [111/265] Compiling C object lib/librte_power.a.p/power_power_kvm_vm.c.o 00:01:47.770 [112/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_dyn.c.o 00:01:47.770 [113/265] Compiling C object lib/librte_net.a.p/net_rte_net.c.o 00:01:47.770 [114/265] Compiling C object lib/librte_rcu.a.p/rcu_rte_rcu_qsbr.c.o 00:01:47.770 [115/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_class_eth.c.o 00:01:47.770 [116/265] Generating lib/telemetry.sym_chk with a custom command (wrapped by meson to capture output) 00:01:47.770 [117/265] Linking static target lib/librte_rcu.a 00:01:47.770 [118/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool.c.o 00:01:47.770 [119/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_profile.c.o 00:01:47.770 [120/265] Linking static target lib/librte_mempool.a 00:01:47.770 [121/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_private.c.o 00:01:47.770 [122/265] Linking target lib/librte_telemetry.so.24.0 00:01:47.770 [123/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_telemetry.c.o 00:01:47.770 [124/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_driver.c.o 00:01:47.770 [125/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_common.c.o 00:01:47.770 [126/265] Compiling C object lib/librte_vhost.a.p/vhost_fd_man.c.o 00:01:48.031 [127/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8472.c.o 00:01:48.031 [128/265] Compiling C object lib/librte_net.a.p/net_rte_ether.c.o 00:01:48.031 [129/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8636.c.o 00:01:48.031 [130/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_etheraddr.c.o 00:01:48.031 [131/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8079.c.o 00:01:48.031 [132/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_cman.c.o 00:01:48.031 [133/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_ipaddr.c.o 00:01:48.031 [134/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_telemetry.c.o 00:01:48.031 [135/265] Linking static target lib/librte_cmdline.a 00:01:48.031 [136/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_mtr.c.o 00:01:48.031 [137/265] Generating lib/ring.sym_chk with a custom command (wrapped by meson to capture output) 00:01:48.294 [138/265] Generating lib/meter.sym_chk with a custom command (wrapped by meson to capture output) 00:01:48.294 [139/265] Compiling C object lib/librte_hash.a.p/hash_rte_fbk_hash.c.o 00:01:48.294 [140/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_params.c.o 00:01:48.294 [141/265] Generating symbol file lib/librte_telemetry.so.24.0.p/librte_telemetry.so.24.0.symbols 00:01:48.294 [142/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev_pmd.c.o 00:01:48.294 [143/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_tm.c.o 00:01:48.294 [144/265] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev_params.c.o 00:01:48.294 [145/265] Generating lib/rcu.sym_chk with a custom command (wrapped by meson to capture output) 00:01:48.294 [146/265] Compiling C object lib/librte_timer.a.p/timer_rte_timer.c.o 00:01:48.294 [147/265] Linking static target lib/librte_timer.a 00:01:48.294 [148/265] Compiling C object lib/librte_net.a.p/net_rte_arp.c.o 00:01:48.294 [149/265] Linking static target lib/librte_net.a 00:01:48.294 [150/265] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev_trace_points.c.o 00:01:48.554 [151/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_trace_points.c.o 00:01:48.554 [152/265] Compiling C object lib/librte_hash.a.p/hash_rte_thash.c.o 00:01:48.554 [153/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev.c.o 00:01:48.554 [154/265] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev.c.o 00:01:48.554 [155/265] Linking static target lib/librte_dmadev.a 00:01:48.554 [156/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_pmd.c.o 00:01:48.554 [157/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_trace_points.c.o 00:01:48.554 [158/265] Compiling C object lib/librte_power.a.p/power_rte_power_uncore.c.o 00:01:48.554 [159/265] Compiling C object lib/librte_power.a.p/power_rte_power.c.o 00:01:48.554 [160/265] Compiling C object lib/librte_power.a.p/power_power_acpi_cpufreq.c.o 00:01:48.554 [161/265] Generating lib/net.sym_chk with a custom command (wrapped by meson to capture output) 00:01:48.812 [162/265] Compiling C object lib/librte_power.a.p/power_power_amd_pstate_cpufreq.c.o 00:01:48.812 [163/265] Generating lib/mempool.sym_chk with a custom command (wrapped by meson to capture output) 00:01:48.812 [164/265] Generating lib/timer.sym_chk with a custom command (wrapped by meson to capture output) 00:01:48.812 [165/265] Compiling C object lib/librte_power.a.p/power_power_cppc_cpufreq.c.o 00:01:48.812 [166/265] Compiling C object lib/librte_power.a.p/power_power_intel_uncore.c.o 00:01:48.812 [167/265] Compiling C object lib/librte_hash.a.p/hash_rte_cuckoo_hash.c.o 00:01:48.812 [168/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_comp.c.o 00:01:48.812 [169/265] Linking static target lib/librte_hash.a 00:01:48.812 [170/265] Linking static target lib/librte_compressdev.a 00:01:48.812 [171/265] Compiling C object lib/librte_power.a.p/power_rte_power_pmd_mgmt.c.o 00:01:48.812 [172/265] Compiling C object lib/librte_vhost.a.p/vhost_iotlb.c.o 00:01:48.812 [173/265] Compiling C object lib/librte_power.a.p/power_power_pstate_cpufreq.c.o 00:01:48.812 [174/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common_uio.c.o 00:01:48.812 [175/265] Linking static target lib/librte_power.a 00:01:48.812 [176/265] Compiling C object lib/librte_vhost.a.p/vhost_vdpa.c.o 00:01:48.812 [177/265] Generating lib/dmadev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:49.070 [178/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common.c.o 00:01:49.070 [179/265] Generating lib/cmdline.sym_chk with a custom command (wrapped by meson to capture output) 00:01:49.070 [180/265] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net_ctrl.c.o 00:01:49.070 [181/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf.c.o 00:01:49.070 [182/265] Linking static target lib/librte_mbuf.a 00:01:49.070 [183/265] Compiling C object lib/librte_vhost.a.p/vhost_socket.c.o 00:01:49.070 [184/265] Compiling C object lib/librte_vhost.a.p/vhost_vduse.c.o 00:01:49.070 [185/265] Compiling C object lib/librte_reorder.a.p/reorder_rte_reorder.c.o 00:01:49.070 [186/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci.c.o 00:01:49.070 [187/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_uio.c.o 00:01:49.070 [188/265] Linking static target lib/librte_reorder.a 00:01:49.070 [189/265] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev.c.o 00:01:49.070 [190/265] Linking static target drivers/libtmp_rte_bus_vdev.a 00:01:49.327 [191/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_vfio.c.o 00:01:49.327 [192/265] Generating lib/compressdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:49.327 [193/265] Linking static target drivers/libtmp_rte_bus_pci.a 00:01:49.327 [194/265] Compiling C object drivers/libtmp_rte_mempool_ring.a.p/mempool_ring_rte_mempool_ring.c.o 00:01:49.327 [195/265] Linking static target drivers/libtmp_rte_mempool_ring.a 00:01:49.327 [196/265] Generating lib/hash.sym_chk with a custom command (wrapped by meson to capture output) 00:01:49.327 [197/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost_user.c.o 00:01:49.327 [198/265] Generating drivers/rte_bus_vdev.pmd.c with a custom command 00:01:49.327 [199/265] Compiling C object drivers/librte_bus_vdev.so.24.0.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:01:49.327 [200/265] Compiling C object drivers/librte_bus_vdev.a.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:01:49.327 [201/265] Linking static target drivers/librte_bus_vdev.a 00:01:49.327 [202/265] Generating lib/power.sym_chk with a custom command (wrapped by meson to capture output) 00:01:49.327 [203/265] Generating lib/reorder.sym_chk with a custom command (wrapped by meson to capture output) 00:01:49.327 [204/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost.c.o 00:01:49.585 [205/265] Generating drivers/rte_mempool_ring.pmd.c with a custom command 00:01:49.585 [206/265] Generating drivers/rte_bus_pci.pmd.c with a custom command 00:01:49.585 [207/265] Compiling C object drivers/librte_mempool_ring.so.24.0.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:01:49.585 [208/265] Compiling C object drivers/librte_mempool_ring.a.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:01:49.585 [209/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev.c.o 00:01:49.585 [210/265] Compiling C object drivers/librte_bus_pci.a.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:01:49.585 [211/265] Compiling C object drivers/librte_bus_pci.so.24.0.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:01:49.585 [212/265] Linking static target drivers/librte_mempool_ring.a 00:01:49.585 [213/265] Linking static target drivers/librte_bus_pci.a 00:01:49.585 [214/265] Generating lib/mbuf.sym_chk with a custom command (wrapped by meson to capture output) 00:01:49.585 [215/265] Compiling C object lib/librte_security.a.p/security_rte_security.c.o 00:01:49.585 [216/265] Linking static target lib/librte_security.a 00:01:49.585 [217/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_flow.c.o 00:01:49.585 [218/265] Linking static target lib/librte_ethdev.a 00:01:49.585 [219/265] Generating drivers/rte_bus_vdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:49.843 [220/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_rte_cryptodev.c.o 00:01:49.843 [221/265] Linking static target lib/librte_cryptodev.a 00:01:49.843 [222/265] Generating lib/security.sym_chk with a custom command (wrapped by meson to capture output) 00:01:49.843 [223/265] Generating drivers/rte_bus_pci.sym_chk with a custom command (wrapped by meson to capture output) 00:01:51.219 [224/265] Generating lib/cryptodev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:52.153 [225/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost_crypto.c.o 00:01:53.529 [226/265] Generating lib/ethdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:53.786 [227/265] Generating lib/eal.sym_chk with a custom command (wrapped by meson to capture output) 00:01:53.786 [228/265] Linking target lib/librte_eal.so.24.0 00:01:53.786 [229/265] Generating symbol file lib/librte_eal.so.24.0.p/librte_eal.so.24.0.symbols 00:01:53.786 [230/265] Linking target lib/librte_ring.so.24.0 00:01:53.786 [231/265] Linking target lib/librte_meter.so.24.0 00:01:53.786 [232/265] Linking target lib/librte_pci.so.24.0 00:01:53.786 [233/265] Linking target lib/librte_timer.so.24.0 00:01:53.786 [234/265] Linking target lib/librte_dmadev.so.24.0 00:01:53.786 [235/265] Linking target drivers/librte_bus_vdev.so.24.0 00:01:54.044 [236/265] Generating symbol file lib/librte_timer.so.24.0.p/librte_timer.so.24.0.symbols 00:01:54.044 [237/265] Generating symbol file lib/librte_dmadev.so.24.0.p/librte_dmadev.so.24.0.symbols 00:01:54.044 [238/265] Generating symbol file lib/librte_meter.so.24.0.p/librte_meter.so.24.0.symbols 00:01:54.044 [239/265] Generating symbol file lib/librte_pci.so.24.0.p/librte_pci.so.24.0.symbols 00:01:54.044 [240/265] Generating symbol file lib/librte_ring.so.24.0.p/librte_ring.so.24.0.symbols 00:01:54.044 [241/265] Linking target lib/librte_rcu.so.24.0 00:01:54.044 [242/265] Linking target lib/librte_mempool.so.24.0 00:01:54.044 [243/265] Linking target drivers/librte_bus_pci.so.24.0 00:01:54.302 [244/265] Generating symbol file lib/librte_rcu.so.24.0.p/librte_rcu.so.24.0.symbols 00:01:54.302 [245/265] Generating symbol file lib/librte_mempool.so.24.0.p/librte_mempool.so.24.0.symbols 00:01:54.302 [246/265] Linking target drivers/librte_mempool_ring.so.24.0 00:01:54.302 [247/265] Linking target lib/librte_mbuf.so.24.0 00:01:54.302 [248/265] Generating symbol file lib/librte_mbuf.so.24.0.p/librte_mbuf.so.24.0.symbols 00:01:54.302 [249/265] Linking target lib/librte_reorder.so.24.0 00:01:54.302 [250/265] Linking target lib/librte_net.so.24.0 00:01:54.302 [251/265] Linking target lib/librte_compressdev.so.24.0 00:01:54.302 [252/265] Linking target lib/librte_cryptodev.so.24.0 00:01:54.560 [253/265] Generating symbol file lib/librte_net.so.24.0.p/librte_net.so.24.0.symbols 00:01:54.560 [254/265] Generating symbol file lib/librte_cryptodev.so.24.0.p/librte_cryptodev.so.24.0.symbols 00:01:54.560 [255/265] Linking target lib/librte_hash.so.24.0 00:01:54.560 [256/265] Linking target lib/librte_cmdline.so.24.0 00:01:54.560 [257/265] Linking target lib/librte_security.so.24.0 00:01:54.560 [258/265] Linking target lib/librte_ethdev.so.24.0 00:01:54.560 [259/265] Generating symbol file lib/librte_hash.so.24.0.p/librte_hash.so.24.0.symbols 00:01:54.818 [260/265] Generating symbol file lib/librte_ethdev.so.24.0.p/librte_ethdev.so.24.0.symbols 00:01:54.818 [261/265] Linking target lib/librte_power.so.24.0 00:01:57.421 [262/265] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net.c.o 00:01:57.421 [263/265] Linking static target lib/librte_vhost.a 00:01:58.358 [264/265] Generating lib/vhost.sym_chk with a custom command (wrapped by meson to capture output) 00:01:58.616 [265/265] Linking target lib/librte_vhost.so.24.0 00:01:58.616 INFO: autodetecting backend as ninja 00:01:58.616 INFO: calculating backend command to run: /usr/local/bin/ninja -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build-tmp -j 48 00:01:59.552 CC lib/ut/ut.o 00:01:59.552 CC lib/ut_mock/mock.o 00:01:59.552 CC lib/log/log.o 00:01:59.552 CC lib/log/log_flags.o 00:01:59.552 CC lib/log/log_deprecated.o 00:01:59.810 LIB libspdk_ut_mock.a 00:01:59.810 SO libspdk_ut_mock.so.5.0 00:01:59.810 LIB libspdk_log.a 00:01:59.810 LIB libspdk_ut.a 00:01:59.810 SO libspdk_ut.so.1.0 00:01:59.810 SO libspdk_log.so.6.1 00:01:59.810 SYMLINK libspdk_ut_mock.so 00:01:59.810 SYMLINK libspdk_ut.so 00:01:59.810 SYMLINK libspdk_log.so 00:02:00.069 CC lib/ioat/ioat.o 00:02:00.069 CC lib/util/base64.o 00:02:00.069 CC lib/dma/dma.o 00:02:00.069 CXX lib/trace_parser/trace.o 00:02:00.069 CC lib/util/bit_array.o 00:02:00.069 CC lib/util/cpuset.o 00:02:00.069 CC lib/util/crc16.o 00:02:00.069 CC lib/util/crc32.o 00:02:00.069 CC lib/util/crc32c.o 00:02:00.069 CC lib/util/crc32_ieee.o 00:02:00.069 CC lib/util/crc64.o 00:02:00.069 CC lib/util/dif.o 00:02:00.069 CC lib/util/fd.o 00:02:00.069 CC lib/util/file.o 00:02:00.069 CC lib/util/hexlify.o 00:02:00.069 CC lib/util/iov.o 00:02:00.069 CC lib/util/math.o 00:02:00.069 CC lib/util/pipe.o 00:02:00.069 CC lib/util/strerror_tls.o 00:02:00.069 CC lib/util/string.o 00:02:00.069 CC lib/util/uuid.o 00:02:00.069 CC lib/util/fd_group.o 00:02:00.069 CC lib/util/xor.o 00:02:00.069 CC lib/util/zipf.o 00:02:00.069 CC lib/vfio_user/host/vfio_user_pci.o 00:02:00.069 CC lib/vfio_user/host/vfio_user.o 00:02:00.327 LIB libspdk_dma.a 00:02:00.327 LIB libspdk_ioat.a 00:02:00.327 SO libspdk_dma.so.3.0 00:02:00.327 SO libspdk_ioat.so.6.0 00:02:00.327 LIB libspdk_vfio_user.a 00:02:00.328 SYMLINK libspdk_dma.so 00:02:00.328 SO libspdk_vfio_user.so.4.0 00:02:00.328 SYMLINK libspdk_ioat.so 00:02:00.328 SYMLINK libspdk_vfio_user.so 00:02:00.585 LIB libspdk_util.a 00:02:00.586 SO libspdk_util.so.8.0 00:02:00.586 SYMLINK libspdk_util.so 00:02:00.844 CC lib/json/json_parse.o 00:02:00.844 CC lib/rdma/common.o 00:02:00.844 CC lib/conf/conf.o 00:02:00.844 CC lib/json/json_util.o 00:02:00.844 CC lib/rdma/rdma_verbs.o 00:02:00.844 CC lib/env_dpdk/env.o 00:02:00.844 CC lib/json/json_write.o 00:02:00.844 CC lib/env_dpdk/memory.o 00:02:00.844 CC lib/env_dpdk/pci.o 00:02:00.844 CC lib/env_dpdk/init.o 00:02:00.844 CC lib/vmd/vmd.o 00:02:00.844 CC lib/env_dpdk/threads.o 00:02:00.844 CC lib/vmd/led.o 00:02:00.844 CC lib/env_dpdk/pci_ioat.o 00:02:00.844 CC lib/env_dpdk/pci_virtio.o 00:02:00.844 CC lib/idxd/idxd.o 00:02:00.844 CC lib/env_dpdk/pci_vmd.o 00:02:00.844 CC lib/idxd/idxd_user.o 00:02:00.844 CC lib/idxd/idxd_kernel.o 00:02:00.844 CC lib/env_dpdk/pci_idxd.o 00:02:00.844 CC lib/env_dpdk/pci_event.o 00:02:00.844 CC lib/env_dpdk/sigbus_handler.o 00:02:00.844 CC lib/env_dpdk/pci_dpdk.o 00:02:00.844 CC lib/env_dpdk/pci_dpdk_2207.o 00:02:00.844 CC lib/env_dpdk/pci_dpdk_2211.o 00:02:00.844 LIB libspdk_trace_parser.a 00:02:00.844 SO libspdk_trace_parser.so.4.0 00:02:01.103 SYMLINK libspdk_trace_parser.so 00:02:01.103 LIB libspdk_conf.a 00:02:01.103 SO libspdk_conf.so.5.0 00:02:01.103 LIB libspdk_rdma.a 00:02:01.103 SYMLINK libspdk_conf.so 00:02:01.103 SO libspdk_rdma.so.5.0 00:02:01.103 LIB libspdk_json.a 00:02:01.103 SO libspdk_json.so.5.1 00:02:01.103 SYMLINK libspdk_rdma.so 00:02:01.103 SYMLINK libspdk_json.so 00:02:01.363 CC lib/jsonrpc/jsonrpc_server.o 00:02:01.363 CC lib/jsonrpc/jsonrpc_server_tcp.o 00:02:01.363 CC lib/jsonrpc/jsonrpc_client.o 00:02:01.363 CC lib/jsonrpc/jsonrpc_client_tcp.o 00:02:01.363 LIB libspdk_idxd.a 00:02:01.363 SO libspdk_idxd.so.11.0 00:02:01.363 SYMLINK libspdk_idxd.so 00:02:01.363 LIB libspdk_vmd.a 00:02:01.363 SO libspdk_vmd.so.5.0 00:02:01.623 SYMLINK libspdk_vmd.so 00:02:01.623 LIB libspdk_jsonrpc.a 00:02:01.623 SO libspdk_jsonrpc.so.5.1 00:02:01.623 SYMLINK libspdk_jsonrpc.so 00:02:01.623 CC lib/rpc/rpc.o 00:02:01.881 LIB libspdk_rpc.a 00:02:01.881 SO libspdk_rpc.so.5.0 00:02:01.881 SYMLINK libspdk_rpc.so 00:02:02.139 CC lib/trace/trace.o 00:02:02.139 CC lib/trace/trace_flags.o 00:02:02.139 CC lib/trace/trace_rpc.o 00:02:02.139 CC lib/notify/notify.o 00:02:02.139 CC lib/notify/notify_rpc.o 00:02:02.139 CC lib/sock/sock.o 00:02:02.139 CC lib/sock/sock_rpc.o 00:02:02.139 LIB libspdk_notify.a 00:02:02.398 SO libspdk_notify.so.5.0 00:02:02.398 LIB libspdk_trace.a 00:02:02.398 SYMLINK libspdk_notify.so 00:02:02.398 SO libspdk_trace.so.9.0 00:02:02.398 SYMLINK libspdk_trace.so 00:02:02.398 LIB libspdk_sock.a 00:02:02.398 CC lib/thread/thread.o 00:02:02.398 CC lib/thread/iobuf.o 00:02:02.398 SO libspdk_sock.so.8.0 00:02:02.657 SYMLINK libspdk_sock.so 00:02:02.657 CC lib/nvme/nvme_ctrlr_cmd.o 00:02:02.657 CC lib/nvme/nvme_ctrlr.o 00:02:02.657 CC lib/nvme/nvme_fabric.o 00:02:02.657 CC lib/nvme/nvme_ns_cmd.o 00:02:02.657 CC lib/nvme/nvme_ns.o 00:02:02.657 CC lib/nvme/nvme_pcie_common.o 00:02:02.657 CC lib/nvme/nvme_pcie.o 00:02:02.657 CC lib/nvme/nvme_qpair.o 00:02:02.657 CC lib/nvme/nvme.o 00:02:02.657 CC lib/nvme/nvme_quirks.o 00:02:02.657 CC lib/nvme/nvme_transport.o 00:02:02.657 CC lib/nvme/nvme_discovery.o 00:02:02.657 CC lib/nvme/nvme_ctrlr_ocssd_cmd.o 00:02:02.657 CC lib/nvme/nvme_ns_ocssd_cmd.o 00:02:02.657 CC lib/nvme/nvme_tcp.o 00:02:02.657 CC lib/nvme/nvme_opal.o 00:02:02.657 CC lib/nvme/nvme_io_msg.o 00:02:02.657 CC lib/nvme/nvme_poll_group.o 00:02:02.657 CC lib/nvme/nvme_zns.o 00:02:02.657 CC lib/nvme/nvme_cuse.o 00:02:02.657 CC lib/nvme/nvme_rdma.o 00:02:02.657 CC lib/nvme/nvme_vfio_user.o 00:02:02.917 LIB libspdk_env_dpdk.a 00:02:02.917 SO libspdk_env_dpdk.so.13.0 00:02:02.917 SYMLINK libspdk_env_dpdk.so 00:02:04.295 LIB libspdk_thread.a 00:02:04.295 SO libspdk_thread.so.9.0 00:02:04.295 SYMLINK libspdk_thread.so 00:02:04.295 CC lib/init/json_config.o 00:02:04.295 CC lib/virtio/virtio.o 00:02:04.295 CC lib/init/subsystem.o 00:02:04.295 CC lib/accel/accel.o 00:02:04.295 CC lib/virtio/virtio_vhost_user.o 00:02:04.295 CC lib/init/subsystem_rpc.o 00:02:04.295 CC lib/accel/accel_rpc.o 00:02:04.295 CC lib/blob/blobstore.o 00:02:04.295 CC lib/virtio/virtio_vfio_user.o 00:02:04.295 CC lib/init/rpc.o 00:02:04.295 CC lib/accel/accel_sw.o 00:02:04.295 CC lib/virtio/virtio_pci.o 00:02:04.295 CC lib/blob/request.o 00:02:04.295 CC lib/blob/zeroes.o 00:02:04.295 CC lib/blob/blob_bs_dev.o 00:02:04.554 LIB libspdk_init.a 00:02:04.554 SO libspdk_init.so.4.0 00:02:04.554 SYMLINK libspdk_init.so 00:02:04.554 LIB libspdk_virtio.a 00:02:04.554 SO libspdk_virtio.so.6.0 00:02:04.813 SYMLINK libspdk_virtio.so 00:02:04.813 CC lib/event/app.o 00:02:04.813 CC lib/event/reactor.o 00:02:04.813 CC lib/event/log_rpc.o 00:02:04.813 CC lib/event/app_rpc.o 00:02:04.813 CC lib/event/scheduler_static.o 00:02:05.072 LIB libspdk_nvme.a 00:02:05.072 SO libspdk_nvme.so.12.0 00:02:05.072 LIB libspdk_event.a 00:02:05.072 SO libspdk_event.so.12.0 00:02:05.330 SYMLINK libspdk_event.so 00:02:05.330 SYMLINK libspdk_nvme.so 00:02:05.330 LIB libspdk_accel.a 00:02:05.330 SO libspdk_accel.so.14.0 00:02:05.330 SYMLINK libspdk_accel.so 00:02:05.588 CC lib/bdev/bdev.o 00:02:05.588 CC lib/bdev/bdev_rpc.o 00:02:05.588 CC lib/bdev/bdev_zone.o 00:02:05.588 CC lib/bdev/part.o 00:02:05.588 CC lib/bdev/scsi_nvme.o 00:02:06.962 LIB libspdk_blob.a 00:02:06.962 SO libspdk_blob.so.10.1 00:02:07.220 SYMLINK libspdk_blob.so 00:02:07.220 CC lib/lvol/lvol.o 00:02:07.220 CC lib/blobfs/blobfs.o 00:02:07.220 CC lib/blobfs/tree.o 00:02:08.155 LIB libspdk_blobfs.a 00:02:08.155 SO libspdk_blobfs.so.9.0 00:02:08.155 LIB libspdk_bdev.a 00:02:08.155 SO libspdk_bdev.so.14.0 00:02:08.155 SYMLINK libspdk_blobfs.so 00:02:08.155 LIB libspdk_lvol.a 00:02:08.155 SO libspdk_lvol.so.9.1 00:02:08.155 SYMLINK libspdk_bdev.so 00:02:08.155 SYMLINK libspdk_lvol.so 00:02:08.155 CC lib/scsi/dev.o 00:02:08.155 CC lib/ublk/ublk.o 00:02:08.155 CC lib/nvmf/ctrlr.o 00:02:08.155 CC lib/ublk/ublk_rpc.o 00:02:08.155 CC lib/scsi/lun.o 00:02:08.155 CC lib/nbd/nbd.o 00:02:08.155 CC lib/nvmf/ctrlr_discovery.o 00:02:08.155 CC lib/scsi/port.o 00:02:08.155 CC lib/nbd/nbd_rpc.o 00:02:08.155 CC lib/scsi/scsi.o 00:02:08.155 CC lib/nvmf/ctrlr_bdev.o 00:02:08.155 CC lib/ftl/ftl_core.o 00:02:08.422 CC lib/scsi/scsi_bdev.o 00:02:08.422 CC lib/nvmf/subsystem.o 00:02:08.422 CC lib/scsi/scsi_pr.o 00:02:08.422 CC lib/ftl/ftl_init.o 00:02:08.422 CC lib/scsi/scsi_rpc.o 00:02:08.422 CC lib/nvmf/nvmf.o 00:02:08.422 CC lib/nvmf/nvmf_rpc.o 00:02:08.422 CC lib/ftl/ftl_layout.o 00:02:08.422 CC lib/ftl/ftl_debug.o 00:02:08.422 CC lib/scsi/task.o 00:02:08.422 CC lib/nvmf/transport.o 00:02:08.422 CC lib/ftl/ftl_io.o 00:02:08.422 CC lib/nvmf/tcp.o 00:02:08.422 CC lib/ftl/ftl_sb.o 00:02:08.422 CC lib/ftl/ftl_l2p.o 00:02:08.422 CC lib/nvmf/rdma.o 00:02:08.422 CC lib/ftl/ftl_l2p_flat.o 00:02:08.422 CC lib/ftl/ftl_nv_cache.o 00:02:08.422 CC lib/ftl/ftl_band_ops.o 00:02:08.422 CC lib/ftl/ftl_band.o 00:02:08.422 CC lib/ftl/ftl_rq.o 00:02:08.422 CC lib/ftl/ftl_writer.o 00:02:08.422 CC lib/ftl/ftl_reloc.o 00:02:08.422 CC lib/ftl/ftl_l2p_cache.o 00:02:08.422 CC lib/ftl/mngt/ftl_mngt.o 00:02:08.422 CC lib/ftl/ftl_p2l.o 00:02:08.422 CC lib/ftl/mngt/ftl_mngt_bdev.o 00:02:08.422 CC lib/ftl/mngt/ftl_mngt_shutdown.o 00:02:08.422 CC lib/ftl/mngt/ftl_mngt_startup.o 00:02:08.422 CC lib/ftl/mngt/ftl_mngt_md.o 00:02:08.422 CC lib/ftl/mngt/ftl_mngt_misc.o 00:02:08.422 CC lib/ftl/mngt/ftl_mngt_ioch.o 00:02:08.422 CC lib/ftl/mngt/ftl_mngt_l2p.o 00:02:08.422 CC lib/ftl/mngt/ftl_mngt_band.o 00:02:08.422 CC lib/ftl/mngt/ftl_mngt_self_test.o 00:02:08.422 CC lib/ftl/mngt/ftl_mngt_p2l.o 00:02:08.685 CC lib/ftl/mngt/ftl_mngt_recovery.o 00:02:08.685 CC lib/ftl/mngt/ftl_mngt_upgrade.o 00:02:08.685 CC lib/ftl/utils/ftl_conf.o 00:02:08.685 CC lib/ftl/utils/ftl_md.o 00:02:08.685 CC lib/ftl/utils/ftl_mempool.o 00:02:08.685 CC lib/ftl/utils/ftl_bitmap.o 00:02:08.685 CC lib/ftl/utils/ftl_property.o 00:02:08.685 CC lib/ftl/utils/ftl_layout_tracker_bdev.o 00:02:08.685 CC lib/ftl/upgrade/ftl_layout_upgrade.o 00:02:08.685 CC lib/ftl/upgrade/ftl_sb_upgrade.o 00:02:08.685 CC lib/ftl/upgrade/ftl_p2l_upgrade.o 00:02:08.685 CC lib/ftl/upgrade/ftl_band_upgrade.o 00:02:08.685 CC lib/ftl/upgrade/ftl_chunk_upgrade.o 00:02:08.685 CC lib/ftl/upgrade/ftl_sb_v3.o 00:02:08.685 CC lib/ftl/upgrade/ftl_sb_v5.o 00:02:08.685 CC lib/ftl/nvc/ftl_nvc_dev.o 00:02:08.685 CC lib/ftl/nvc/ftl_nvc_bdev_vss.o 00:02:08.685 CC lib/ftl/base/ftl_base_dev.o 00:02:08.685 CC lib/ftl/base/ftl_base_bdev.o 00:02:08.685 CC lib/ftl/ftl_trace.o 00:02:08.943 LIB libspdk_nbd.a 00:02:08.943 SO libspdk_nbd.so.6.0 00:02:09.202 SYMLINK libspdk_nbd.so 00:02:09.202 LIB libspdk_scsi.a 00:02:09.202 SO libspdk_scsi.so.8.0 00:02:09.202 LIB libspdk_ublk.a 00:02:09.202 SYMLINK libspdk_scsi.so 00:02:09.202 SO libspdk_ublk.so.2.0 00:02:09.202 SYMLINK libspdk_ublk.so 00:02:09.459 CC lib/vhost/vhost.o 00:02:09.459 CC lib/iscsi/conn.o 00:02:09.459 CC lib/vhost/vhost_rpc.o 00:02:09.459 CC lib/iscsi/init_grp.o 00:02:09.459 CC lib/vhost/vhost_scsi.o 00:02:09.459 CC lib/iscsi/iscsi.o 00:02:09.459 CC lib/iscsi/md5.o 00:02:09.459 CC lib/vhost/vhost_blk.o 00:02:09.459 CC lib/iscsi/param.o 00:02:09.459 CC lib/vhost/rte_vhost_user.o 00:02:09.459 CC lib/iscsi/portal_grp.o 00:02:09.459 CC lib/iscsi/tgt_node.o 00:02:09.459 CC lib/iscsi/iscsi_subsystem.o 00:02:09.459 CC lib/iscsi/iscsi_rpc.o 00:02:09.459 CC lib/iscsi/task.o 00:02:09.716 LIB libspdk_ftl.a 00:02:09.716 SO libspdk_ftl.so.8.0 00:02:09.973 SYMLINK libspdk_ftl.so 00:02:10.537 LIB libspdk_vhost.a 00:02:10.537 SO libspdk_vhost.so.7.1 00:02:10.795 SYMLINK libspdk_vhost.so 00:02:10.795 LIB libspdk_nvmf.a 00:02:10.795 SO libspdk_nvmf.so.17.0 00:02:10.795 LIB libspdk_iscsi.a 00:02:10.795 SO libspdk_iscsi.so.7.0 00:02:11.052 SYMLINK libspdk_nvmf.so 00:02:11.052 SYMLINK libspdk_iscsi.so 00:02:11.309 CC module/env_dpdk/env_dpdk_rpc.o 00:02:11.309 CC module/scheduler/dpdk_governor/dpdk_governor.o 00:02:11.309 CC module/accel/error/accel_error.o 00:02:11.309 CC module/blob/bdev/blob_bdev.o 00:02:11.309 CC module/accel/dsa/accel_dsa.o 00:02:11.309 CC module/accel/ioat/accel_ioat.o 00:02:11.309 CC module/accel/error/accel_error_rpc.o 00:02:11.309 CC module/sock/posix/posix.o 00:02:11.309 CC module/accel/dsa/accel_dsa_rpc.o 00:02:11.309 CC module/accel/ioat/accel_ioat_rpc.o 00:02:11.309 CC module/scheduler/gscheduler/gscheduler.o 00:02:11.309 CC module/accel/iaa/accel_iaa.o 00:02:11.309 CC module/accel/iaa/accel_iaa_rpc.o 00:02:11.309 CC module/scheduler/dynamic/scheduler_dynamic.o 00:02:11.309 LIB libspdk_env_dpdk_rpc.a 00:02:11.309 SO libspdk_env_dpdk_rpc.so.5.0 00:02:11.309 SYMLINK libspdk_env_dpdk_rpc.so 00:02:11.309 LIB libspdk_scheduler_dpdk_governor.a 00:02:11.309 LIB libspdk_scheduler_gscheduler.a 00:02:11.309 SO libspdk_scheduler_dpdk_governor.so.3.0 00:02:11.309 SO libspdk_scheduler_gscheduler.so.3.0 00:02:11.566 LIB libspdk_accel_error.a 00:02:11.566 LIB libspdk_accel_ioat.a 00:02:11.566 LIB libspdk_scheduler_dynamic.a 00:02:11.566 SO libspdk_accel_error.so.1.0 00:02:11.566 LIB libspdk_accel_iaa.a 00:02:11.566 SO libspdk_accel_ioat.so.5.0 00:02:11.566 SO libspdk_scheduler_dynamic.so.3.0 00:02:11.566 SYMLINK libspdk_scheduler_dpdk_governor.so 00:02:11.566 SYMLINK libspdk_scheduler_gscheduler.so 00:02:11.566 SO libspdk_accel_iaa.so.2.0 00:02:11.566 LIB libspdk_accel_dsa.a 00:02:11.566 SYMLINK libspdk_accel_error.so 00:02:11.566 SYMLINK libspdk_scheduler_dynamic.so 00:02:11.566 SYMLINK libspdk_accel_ioat.so 00:02:11.566 SO libspdk_accel_dsa.so.4.0 00:02:11.566 LIB libspdk_blob_bdev.a 00:02:11.566 SYMLINK libspdk_accel_iaa.so 00:02:11.566 SO libspdk_blob_bdev.so.10.1 00:02:11.566 SYMLINK libspdk_accel_dsa.so 00:02:11.566 SYMLINK libspdk_blob_bdev.so 00:02:11.824 CC module/bdev/lvol/vbdev_lvol.o 00:02:11.824 CC module/bdev/lvol/vbdev_lvol_rpc.o 00:02:11.824 CC module/bdev/error/vbdev_error.o 00:02:11.824 CC module/bdev/null/bdev_null.o 00:02:11.824 CC module/bdev/delay/vbdev_delay.o 00:02:11.824 CC module/bdev/error/vbdev_error_rpc.o 00:02:11.824 CC module/bdev/delay/vbdev_delay_rpc.o 00:02:11.824 CC module/bdev/raid/bdev_raid_rpc.o 00:02:11.824 CC module/bdev/raid/bdev_raid.o 00:02:11.824 CC module/bdev/zone_block/vbdev_zone_block.o 00:02:11.824 CC module/bdev/null/bdev_null_rpc.o 00:02:11.824 CC module/bdev/zone_block/vbdev_zone_block_rpc.o 00:02:11.824 CC module/bdev/gpt/gpt.o 00:02:11.824 CC module/bdev/gpt/vbdev_gpt.o 00:02:11.824 CC module/bdev/raid/bdev_raid_sb.o 00:02:11.824 CC module/bdev/malloc/bdev_malloc.o 00:02:11.824 CC module/bdev/raid/raid0.o 00:02:11.824 CC module/bdev/malloc/bdev_malloc_rpc.o 00:02:11.824 CC module/bdev/aio/bdev_aio.o 00:02:11.824 CC module/bdev/passthru/vbdev_passthru.o 00:02:11.824 CC module/bdev/raid/raid1.o 00:02:11.824 CC module/bdev/raid/concat.o 00:02:11.824 CC module/bdev/aio/bdev_aio_rpc.o 00:02:11.824 CC module/bdev/passthru/vbdev_passthru_rpc.o 00:02:11.824 CC module/bdev/nvme/bdev_nvme.o 00:02:11.824 CC module/bdev/split/vbdev_split.o 00:02:11.824 CC module/bdev/nvme/bdev_nvme_rpc.o 00:02:11.824 CC module/bdev/nvme/nvme_rpc.o 00:02:11.824 CC module/bdev/nvme/bdev_mdns_client.o 00:02:11.824 CC module/bdev/split/vbdev_split_rpc.o 00:02:11.824 CC module/bdev/virtio/bdev_virtio_scsi.o 00:02:11.824 CC module/bdev/iscsi/bdev_iscsi.o 00:02:11.824 CC module/bdev/nvme/vbdev_opal.o 00:02:11.824 CC module/bdev/virtio/bdev_virtio_blk.o 00:02:11.824 CC module/bdev/iscsi/bdev_iscsi_rpc.o 00:02:11.824 CC module/bdev/nvme/vbdev_opal_rpc.o 00:02:11.824 CC module/bdev/virtio/bdev_virtio_rpc.o 00:02:11.824 CC module/bdev/nvme/bdev_nvme_cuse_rpc.o 00:02:11.824 CC module/bdev/ftl/bdev_ftl.o 00:02:11.825 CC module/bdev/ftl/bdev_ftl_rpc.o 00:02:11.825 CC module/blobfs/bdev/blobfs_bdev.o 00:02:11.825 CC module/blobfs/bdev/blobfs_bdev_rpc.o 00:02:12.083 LIB libspdk_blobfs_bdev.a 00:02:12.083 LIB libspdk_bdev_gpt.a 00:02:12.083 SO libspdk_blobfs_bdev.so.5.0 00:02:12.083 SO libspdk_bdev_gpt.so.5.0 00:02:12.083 LIB libspdk_bdev_split.a 00:02:12.083 LIB libspdk_sock_posix.a 00:02:12.083 SO libspdk_bdev_split.so.5.0 00:02:12.083 LIB libspdk_bdev_ftl.a 00:02:12.083 LIB libspdk_bdev_error.a 00:02:12.083 LIB libspdk_bdev_null.a 00:02:12.083 SYMLINK libspdk_blobfs_bdev.so 00:02:12.083 SO libspdk_sock_posix.so.5.0 00:02:12.341 SYMLINK libspdk_bdev_gpt.so 00:02:12.341 LIB libspdk_bdev_malloc.a 00:02:12.341 SO libspdk_bdev_error.so.5.0 00:02:12.341 SO libspdk_bdev_ftl.so.5.0 00:02:12.341 SO libspdk_bdev_null.so.5.0 00:02:12.341 SO libspdk_bdev_malloc.so.5.0 00:02:12.341 LIB libspdk_bdev_passthru.a 00:02:12.341 SYMLINK libspdk_bdev_split.so 00:02:12.341 SO libspdk_bdev_passthru.so.5.0 00:02:12.341 SYMLINK libspdk_sock_posix.so 00:02:12.341 SYMLINK libspdk_bdev_error.so 00:02:12.341 SYMLINK libspdk_bdev_null.so 00:02:12.341 SYMLINK libspdk_bdev_ftl.so 00:02:12.341 SYMLINK libspdk_bdev_malloc.so 00:02:12.341 LIB libspdk_bdev_zone_block.a 00:02:12.341 SYMLINK libspdk_bdev_passthru.so 00:02:12.341 SO libspdk_bdev_zone_block.so.5.0 00:02:12.341 LIB libspdk_bdev_aio.a 00:02:12.341 SO libspdk_bdev_aio.so.5.0 00:02:12.341 SYMLINK libspdk_bdev_zone_block.so 00:02:12.341 LIB libspdk_bdev_iscsi.a 00:02:12.341 LIB libspdk_bdev_delay.a 00:02:12.341 SO libspdk_bdev_iscsi.so.5.0 00:02:12.341 SO libspdk_bdev_delay.so.5.0 00:02:12.341 SYMLINK libspdk_bdev_aio.so 00:02:12.341 SYMLINK libspdk_bdev_iscsi.so 00:02:12.341 SYMLINK libspdk_bdev_delay.so 00:02:12.599 LIB libspdk_bdev_lvol.a 00:02:12.599 SO libspdk_bdev_lvol.so.5.0 00:02:12.599 LIB libspdk_bdev_virtio.a 00:02:12.599 SO libspdk_bdev_virtio.so.5.0 00:02:12.599 SYMLINK libspdk_bdev_lvol.so 00:02:12.599 SYMLINK libspdk_bdev_virtio.so 00:02:12.858 LIB libspdk_bdev_raid.a 00:02:12.858 SO libspdk_bdev_raid.so.5.0 00:02:12.858 SYMLINK libspdk_bdev_raid.so 00:02:14.236 LIB libspdk_bdev_nvme.a 00:02:14.236 SO libspdk_bdev_nvme.so.6.0 00:02:14.236 SYMLINK libspdk_bdev_nvme.so 00:02:14.494 CC module/event/subsystems/scheduler/scheduler.o 00:02:14.494 CC module/event/subsystems/vhost_blk/vhost_blk.o 00:02:14.494 CC module/event/subsystems/vmd/vmd.o 00:02:14.494 CC module/event/subsystems/vmd/vmd_rpc.o 00:02:14.494 CC module/event/subsystems/iobuf/iobuf.o 00:02:14.494 CC module/event/subsystems/iobuf/iobuf_rpc.o 00:02:14.494 CC module/event/subsystems/sock/sock.o 00:02:14.494 LIB libspdk_event_sock.a 00:02:14.494 LIB libspdk_event_vhost_blk.a 00:02:14.494 LIB libspdk_event_scheduler.a 00:02:14.494 LIB libspdk_event_vmd.a 00:02:14.494 SO libspdk_event_sock.so.4.0 00:02:14.494 LIB libspdk_event_iobuf.a 00:02:14.494 SO libspdk_event_vhost_blk.so.2.0 00:02:14.494 SO libspdk_event_scheduler.so.3.0 00:02:14.494 SO libspdk_event_vmd.so.5.0 00:02:14.494 SO libspdk_event_iobuf.so.2.0 00:02:14.494 SYMLINK libspdk_event_sock.so 00:02:14.494 SYMLINK libspdk_event_vhost_blk.so 00:02:14.494 SYMLINK libspdk_event_scheduler.so 00:02:14.494 SYMLINK libspdk_event_vmd.so 00:02:14.752 SYMLINK libspdk_event_iobuf.so 00:02:14.752 CC module/event/subsystems/accel/accel.o 00:02:14.752 LIB libspdk_event_accel.a 00:02:15.010 SO libspdk_event_accel.so.5.0 00:02:15.010 SYMLINK libspdk_event_accel.so 00:02:15.010 CC module/event/subsystems/bdev/bdev.o 00:02:15.268 LIB libspdk_event_bdev.a 00:02:15.268 SO libspdk_event_bdev.so.5.0 00:02:15.268 SYMLINK libspdk_event_bdev.so 00:02:15.526 CC module/event/subsystems/nbd/nbd.o 00:02:15.526 CC module/event/subsystems/nvmf/nvmf_rpc.o 00:02:15.526 CC module/event/subsystems/nvmf/nvmf_tgt.o 00:02:15.526 CC module/event/subsystems/scsi/scsi.o 00:02:15.526 CC module/event/subsystems/ublk/ublk.o 00:02:15.526 LIB libspdk_event_ublk.a 00:02:15.526 LIB libspdk_event_nbd.a 00:02:15.526 SO libspdk_event_ublk.so.2.0 00:02:15.526 SO libspdk_event_nbd.so.5.0 00:02:15.526 LIB libspdk_event_scsi.a 00:02:15.526 SO libspdk_event_scsi.so.5.0 00:02:15.526 SYMLINK libspdk_event_ublk.so 00:02:15.526 SYMLINK libspdk_event_nbd.so 00:02:15.526 SYMLINK libspdk_event_scsi.so 00:02:15.526 LIB libspdk_event_nvmf.a 00:02:15.785 SO libspdk_event_nvmf.so.5.0 00:02:15.785 SYMLINK libspdk_event_nvmf.so 00:02:15.785 CC module/event/subsystems/iscsi/iscsi.o 00:02:15.785 CC module/event/subsystems/vhost_scsi/vhost_scsi.o 00:02:15.785 LIB libspdk_event_vhost_scsi.a 00:02:15.785 SO libspdk_event_vhost_scsi.so.2.0 00:02:15.785 LIB libspdk_event_iscsi.a 00:02:16.043 SO libspdk_event_iscsi.so.5.0 00:02:16.043 SYMLINK libspdk_event_vhost_scsi.so 00:02:16.043 SYMLINK libspdk_event_iscsi.so 00:02:16.043 SO libspdk.so.5.0 00:02:16.043 SYMLINK libspdk.so 00:02:16.305 CC app/trace_record/trace_record.o 00:02:16.305 CC test/rpc_client/rpc_client_test.o 00:02:16.305 CXX app/trace/trace.o 00:02:16.305 CC app/spdk_lspci/spdk_lspci.o 00:02:16.305 TEST_HEADER include/spdk/accel.h 00:02:16.305 CC app/spdk_top/spdk_top.o 00:02:16.305 CC app/spdk_nvme_perf/perf.o 00:02:16.305 CC app/spdk_nvme_identify/identify.o 00:02:16.305 TEST_HEADER include/spdk/accel_module.h 00:02:16.305 CC app/spdk_nvme_discover/discovery_aer.o 00:02:16.305 TEST_HEADER include/spdk/assert.h 00:02:16.305 TEST_HEADER include/spdk/barrier.h 00:02:16.305 TEST_HEADER include/spdk/base64.h 00:02:16.305 TEST_HEADER include/spdk/bdev.h 00:02:16.305 TEST_HEADER include/spdk/bdev_module.h 00:02:16.305 TEST_HEADER include/spdk/bdev_zone.h 00:02:16.305 TEST_HEADER include/spdk/bit_array.h 00:02:16.305 TEST_HEADER include/spdk/bit_pool.h 00:02:16.305 TEST_HEADER include/spdk/blob_bdev.h 00:02:16.305 TEST_HEADER include/spdk/blobfs_bdev.h 00:02:16.305 TEST_HEADER include/spdk/blobfs.h 00:02:16.305 TEST_HEADER include/spdk/blob.h 00:02:16.305 TEST_HEADER include/spdk/conf.h 00:02:16.305 TEST_HEADER include/spdk/config.h 00:02:16.305 CC app/spdk_dd/spdk_dd.o 00:02:16.305 TEST_HEADER include/spdk/cpuset.h 00:02:16.305 CC examples/interrupt_tgt/interrupt_tgt.o 00:02:16.305 TEST_HEADER include/spdk/crc16.h 00:02:16.305 TEST_HEADER include/spdk/crc32.h 00:02:16.305 TEST_HEADER include/spdk/crc64.h 00:02:16.305 TEST_HEADER include/spdk/dif.h 00:02:16.305 TEST_HEADER include/spdk/dma.h 00:02:16.305 CC app/vhost/vhost.o 00:02:16.305 CC app/nvmf_tgt/nvmf_main.o 00:02:16.305 TEST_HEADER include/spdk/endian.h 00:02:16.305 CC app/iscsi_tgt/iscsi_tgt.o 00:02:16.305 TEST_HEADER include/spdk/env_dpdk.h 00:02:16.305 CC examples/nvme/hello_world/hello_world.o 00:02:16.305 CC examples/vmd/led/led.o 00:02:16.305 TEST_HEADER include/spdk/env.h 00:02:16.305 CC test/thread/poller_perf/poller_perf.o 00:02:16.305 CC examples/idxd/perf/perf.o 00:02:16.305 CC test/nvme/reset/reset.o 00:02:16.305 CC examples/nvme/arbitration/arbitration.o 00:02:16.305 TEST_HEADER include/spdk/event.h 00:02:16.305 CC examples/nvme/pmr_persistence/pmr_persistence.o 00:02:16.305 CC examples/nvme/hotplug/hotplug.o 00:02:16.305 TEST_HEADER include/spdk/fd_group.h 00:02:16.305 CC examples/nvme/cmb_copy/cmb_copy.o 00:02:16.305 TEST_HEADER include/spdk/fd.h 00:02:16.305 CC test/event/event_perf/event_perf.o 00:02:16.305 CC test/nvme/aer/aer.o 00:02:16.305 TEST_HEADER include/spdk/file.h 00:02:16.305 CC examples/ioat/perf/perf.o 00:02:16.305 CC examples/accel/perf/accel_perf.o 00:02:16.305 CC examples/nvme/abort/abort.o 00:02:16.305 TEST_HEADER include/spdk/ftl.h 00:02:16.305 TEST_HEADER include/spdk/gpt_spec.h 00:02:16.305 CC examples/nvme/nvme_manage/nvme_manage.o 00:02:16.305 CC app/fio/nvme/fio_plugin.o 00:02:16.305 CC examples/util/zipf/zipf.o 00:02:16.305 TEST_HEADER include/spdk/hexlify.h 00:02:16.305 TEST_HEADER include/spdk/histogram_data.h 00:02:16.305 CC examples/nvme/reconnect/reconnect.o 00:02:16.305 CC examples/vmd/lsvmd/lsvmd.o 00:02:16.305 TEST_HEADER include/spdk/idxd.h 00:02:16.305 TEST_HEADER include/spdk/idxd_spec.h 00:02:16.305 CC examples/sock/hello_world/hello_sock.o 00:02:16.305 CC app/spdk_tgt/spdk_tgt.o 00:02:16.305 TEST_HEADER include/spdk/init.h 00:02:16.305 TEST_HEADER include/spdk/ioat.h 00:02:16.305 TEST_HEADER include/spdk/ioat_spec.h 00:02:16.305 TEST_HEADER include/spdk/iscsi_spec.h 00:02:16.305 TEST_HEADER include/spdk/json.h 00:02:16.305 TEST_HEADER include/spdk/jsonrpc.h 00:02:16.305 CC examples/blob/cli/blobcli.o 00:02:16.305 TEST_HEADER include/spdk/likely.h 00:02:16.305 TEST_HEADER include/spdk/log.h 00:02:16.305 TEST_HEADER include/spdk/lvol.h 00:02:16.305 CC test/blobfs/mkfs/mkfs.o 00:02:16.305 TEST_HEADER include/spdk/memory.h 00:02:16.305 CC examples/thread/thread/thread_ex.o 00:02:16.305 CC test/accel/dif/dif.o 00:02:16.305 CC test/dma/test_dma/test_dma.o 00:02:16.305 CC examples/bdev/bdevperf/bdevperf.o 00:02:16.305 TEST_HEADER include/spdk/mmio.h 00:02:16.305 CC examples/blob/hello_world/hello_blob.o 00:02:16.305 CC examples/nvmf/nvmf/nvmf.o 00:02:16.305 CC examples/bdev/hello_world/hello_bdev.o 00:02:16.305 TEST_HEADER include/spdk/nbd.h 00:02:16.305 TEST_HEADER include/spdk/notify.h 00:02:16.305 CC test/app/bdev_svc/bdev_svc.o 00:02:16.305 CC test/bdev/bdevio/bdevio.o 00:02:16.305 TEST_HEADER include/spdk/nvme.h 00:02:16.305 TEST_HEADER include/spdk/nvme_intel.h 00:02:16.305 TEST_HEADER include/spdk/nvme_ocssd.h 00:02:16.305 TEST_HEADER include/spdk/nvme_ocssd_spec.h 00:02:16.305 TEST_HEADER include/spdk/nvme_spec.h 00:02:16.305 TEST_HEADER include/spdk/nvme_zns.h 00:02:16.305 TEST_HEADER include/spdk/nvmf_cmd.h 00:02:16.305 CC test/env/mem_callbacks/mem_callbacks.o 00:02:16.305 TEST_HEADER include/spdk/nvmf_fc_spec.h 00:02:16.305 TEST_HEADER include/spdk/nvmf.h 00:02:16.305 TEST_HEADER include/spdk/nvmf_spec.h 00:02:16.305 CC test/lvol/esnap/esnap.o 00:02:16.305 TEST_HEADER include/spdk/nvmf_transport.h 00:02:16.305 TEST_HEADER include/spdk/opal.h 00:02:16.305 TEST_HEADER include/spdk/opal_spec.h 00:02:16.305 TEST_HEADER include/spdk/pci_ids.h 00:02:16.566 TEST_HEADER include/spdk/pipe.h 00:02:16.566 TEST_HEADER include/spdk/queue.h 00:02:16.566 TEST_HEADER include/spdk/reduce.h 00:02:16.566 TEST_HEADER include/spdk/rpc.h 00:02:16.566 TEST_HEADER include/spdk/scheduler.h 00:02:16.566 TEST_HEADER include/spdk/scsi.h 00:02:16.566 TEST_HEADER include/spdk/scsi_spec.h 00:02:16.566 TEST_HEADER include/spdk/sock.h 00:02:16.566 TEST_HEADER include/spdk/stdinc.h 00:02:16.566 TEST_HEADER include/spdk/string.h 00:02:16.566 TEST_HEADER include/spdk/thread.h 00:02:16.566 TEST_HEADER include/spdk/trace.h 00:02:16.566 TEST_HEADER include/spdk/trace_parser.h 00:02:16.566 TEST_HEADER include/spdk/tree.h 00:02:16.566 TEST_HEADER include/spdk/ublk.h 00:02:16.566 TEST_HEADER include/spdk/util.h 00:02:16.566 LINK spdk_lspci 00:02:16.566 TEST_HEADER include/spdk/uuid.h 00:02:16.566 TEST_HEADER include/spdk/version.h 00:02:16.566 TEST_HEADER include/spdk/vfio_user_pci.h 00:02:16.566 TEST_HEADER include/spdk/vfio_user_spec.h 00:02:16.566 TEST_HEADER include/spdk/vhost.h 00:02:16.566 TEST_HEADER include/spdk/vmd.h 00:02:16.566 TEST_HEADER include/spdk/xor.h 00:02:16.566 TEST_HEADER include/spdk/zipf.h 00:02:16.566 CXX test/cpp_headers/accel.o 00:02:16.566 LINK rpc_client_test 00:02:16.566 LINK lsvmd 00:02:16.566 LINK poller_perf 00:02:16.566 LINK led 00:02:16.566 LINK event_perf 00:02:16.566 LINK spdk_nvme_discover 00:02:16.566 LINK zipf 00:02:16.566 LINK nvmf_tgt 00:02:16.566 LINK interrupt_tgt 00:02:16.566 LINK vhost 00:02:16.566 LINK pmr_persistence 00:02:16.566 LINK cmb_copy 00:02:16.566 LINK spdk_trace_record 00:02:16.831 LINK iscsi_tgt 00:02:16.831 LINK ioat_perf 00:02:16.831 LINK hello_world 00:02:16.831 LINK spdk_tgt 00:02:16.831 LINK bdev_svc 00:02:16.831 LINK mkfs 00:02:16.831 LINK hotplug 00:02:16.831 LINK hello_sock 00:02:16.831 LINK reset 00:02:16.831 LINK hello_blob 00:02:16.831 LINK hello_bdev 00:02:16.831 LINK thread 00:02:16.831 LINK aer 00:02:16.831 CXX test/cpp_headers/accel_module.o 00:02:16.831 LINK idxd_perf 00:02:16.831 LINK arbitration 00:02:16.831 CXX test/cpp_headers/assert.o 00:02:16.831 CC app/fio/bdev/fio_plugin.o 00:02:16.831 LINK nvmf 00:02:16.831 LINK reconnect 00:02:17.095 CC test/event/reactor/reactor.o 00:02:17.095 CC test/env/vtophys/vtophys.o 00:02:17.095 CXX test/cpp_headers/barrier.o 00:02:17.095 CXX test/cpp_headers/base64.o 00:02:17.095 CC test/event/reactor_perf/reactor_perf.o 00:02:17.095 LINK spdk_dd 00:02:17.095 LINK abort 00:02:17.095 CC test/env/env_dpdk_post_init/env_dpdk_post_init.o 00:02:17.095 CC test/event/app_repeat/app_repeat.o 00:02:17.095 CXX test/cpp_headers/bdev.o 00:02:17.095 LINK spdk_trace 00:02:17.095 CXX test/cpp_headers/bdev_module.o 00:02:17.095 LINK dif 00:02:17.095 CC test/env/memory/memory_ut.o 00:02:17.095 CC test/nvme/sgl/sgl.o 00:02:17.095 CC examples/ioat/verify/verify.o 00:02:17.095 LINK test_dma 00:02:17.095 CC test/event/scheduler/scheduler.o 00:02:17.095 CXX test/cpp_headers/bdev_zone.o 00:02:17.095 CC test/nvme/e2edp/nvme_dp.o 00:02:17.095 LINK bdevio 00:02:17.095 CXX test/cpp_headers/bit_array.o 00:02:17.095 CXX test/cpp_headers/bit_pool.o 00:02:17.095 CXX test/cpp_headers/blob_bdev.o 00:02:17.095 LINK accel_perf 00:02:17.095 CC test/env/pci/pci_ut.o 00:02:17.095 CC test/nvme/overhead/overhead.o 00:02:17.359 LINK reactor 00:02:17.359 LINK nvme_manage 00:02:17.359 CXX test/cpp_headers/blobfs_bdev.o 00:02:17.359 LINK vtophys 00:02:17.359 LINK reactor_perf 00:02:17.359 CC test/nvme/err_injection/err_injection.o 00:02:17.359 LINK blobcli 00:02:17.359 CC test/app/jsoncat/jsoncat.o 00:02:17.359 CC test/app/histogram_perf/histogram_perf.o 00:02:17.359 CC test/app/fuzz/iscsi_fuzz/iscsi_fuzz.o 00:02:17.359 CC test/app/fuzz/nvme_fuzz/nvme_fuzz.o 00:02:17.359 CC test/nvme/startup/startup.o 00:02:17.359 CC test/app/stub/stub.o 00:02:17.359 LINK env_dpdk_post_init 00:02:17.359 LINK app_repeat 00:02:17.359 CXX test/cpp_headers/blobfs.o 00:02:17.359 CXX test/cpp_headers/blob.o 00:02:17.359 LINK spdk_nvme 00:02:17.359 CC test/app/fuzz/vhost_fuzz/vhost_fuzz_rpc.o 00:02:17.359 CXX test/cpp_headers/conf.o 00:02:17.359 CC test/nvme/reserve/reserve.o 00:02:17.359 CC test/nvme/simple_copy/simple_copy.o 00:02:17.359 CXX test/cpp_headers/config.o 00:02:17.359 CXX test/cpp_headers/cpuset.o 00:02:17.359 CC test/nvme/connect_stress/connect_stress.o 00:02:17.625 CC test/app/fuzz/vhost_fuzz/vhost_fuzz.o 00:02:17.625 CXX test/cpp_headers/crc16.o 00:02:17.625 CXX test/cpp_headers/crc32.o 00:02:17.625 CXX test/cpp_headers/crc64.o 00:02:17.625 LINK verify 00:02:17.625 CXX test/cpp_headers/dif.o 00:02:17.625 CXX test/cpp_headers/dma.o 00:02:17.625 CC test/nvme/boot_partition/boot_partition.o 00:02:17.625 LINK scheduler 00:02:17.625 CC test/nvme/compliance/nvme_compliance.o 00:02:17.625 CXX test/cpp_headers/endian.o 00:02:17.625 CXX test/cpp_headers/env_dpdk.o 00:02:17.625 CXX test/cpp_headers/env.o 00:02:17.625 LINK mem_callbacks 00:02:17.625 CC test/nvme/fused_ordering/fused_ordering.o 00:02:17.625 LINK jsoncat 00:02:17.625 LINK histogram_perf 00:02:17.625 CC test/nvme/fdp/fdp.o 00:02:17.625 CC test/nvme/doorbell_aers/doorbell_aers.o 00:02:17.625 LINK sgl 00:02:17.625 LINK err_injection 00:02:17.625 CXX test/cpp_headers/event.o 00:02:17.625 LINK nvme_dp 00:02:17.625 CC test/nvme/cuse/cuse.o 00:02:17.625 CXX test/cpp_headers/fd_group.o 00:02:17.625 CXX test/cpp_headers/fd.o 00:02:17.625 LINK startup 00:02:17.625 CXX test/cpp_headers/file.o 00:02:17.625 CXX test/cpp_headers/ftl.o 00:02:17.625 LINK stub 00:02:17.625 CXX test/cpp_headers/gpt_spec.o 00:02:17.625 CXX test/cpp_headers/hexlify.o 00:02:17.625 CXX test/cpp_headers/histogram_data.o 00:02:17.887 LINK overhead 00:02:17.887 LINK reserve 00:02:17.887 CXX test/cpp_headers/idxd.o 00:02:17.887 CXX test/cpp_headers/idxd_spec.o 00:02:17.887 LINK spdk_nvme_perf 00:02:17.887 LINK connect_stress 00:02:17.887 CXX test/cpp_headers/ioat.o 00:02:17.887 CXX test/cpp_headers/init.o 00:02:17.887 LINK bdevperf 00:02:17.887 LINK simple_copy 00:02:17.887 LINK spdk_nvme_identify 00:02:17.887 LINK spdk_bdev 00:02:17.887 LINK boot_partition 00:02:17.887 CXX test/cpp_headers/ioat_spec.o 00:02:17.887 CXX test/cpp_headers/iscsi_spec.o 00:02:17.887 CXX test/cpp_headers/json.o 00:02:17.887 CXX test/cpp_headers/jsonrpc.o 00:02:17.887 LINK spdk_top 00:02:17.887 CXX test/cpp_headers/likely.o 00:02:17.887 CXX test/cpp_headers/log.o 00:02:17.887 LINK pci_ut 00:02:17.887 CXX test/cpp_headers/lvol.o 00:02:17.887 CXX test/cpp_headers/memory.o 00:02:17.887 CXX test/cpp_headers/mmio.o 00:02:17.887 CXX test/cpp_headers/nbd.o 00:02:17.887 CXX test/cpp_headers/notify.o 00:02:17.887 CXX test/cpp_headers/nvme.o 00:02:17.887 CXX test/cpp_headers/nvme_intel.o 00:02:17.887 CXX test/cpp_headers/nvme_ocssd.o 00:02:17.887 LINK fused_ordering 00:02:17.887 CXX test/cpp_headers/nvme_ocssd_spec.o 00:02:17.887 CXX test/cpp_headers/nvme_spec.o 00:02:18.154 CXX test/cpp_headers/nvme_zns.o 00:02:18.154 CXX test/cpp_headers/nvmf_cmd.o 00:02:18.154 LINK doorbell_aers 00:02:18.154 CXX test/cpp_headers/nvmf_fc_spec.o 00:02:18.154 CXX test/cpp_headers/nvmf.o 00:02:18.154 CXX test/cpp_headers/nvmf_spec.o 00:02:18.154 CXX test/cpp_headers/nvmf_transport.o 00:02:18.154 CXX test/cpp_headers/opal.o 00:02:18.154 CXX test/cpp_headers/opal_spec.o 00:02:18.154 CXX test/cpp_headers/pci_ids.o 00:02:18.154 CXX test/cpp_headers/pipe.o 00:02:18.154 CXX test/cpp_headers/queue.o 00:02:18.154 CXX test/cpp_headers/reduce.o 00:02:18.154 CXX test/cpp_headers/rpc.o 00:02:18.154 LINK nvme_fuzz 00:02:18.154 CXX test/cpp_headers/scheduler.o 00:02:18.154 CXX test/cpp_headers/scsi.o 00:02:18.154 CXX test/cpp_headers/scsi_spec.o 00:02:18.154 CXX test/cpp_headers/sock.o 00:02:18.154 CXX test/cpp_headers/stdinc.o 00:02:18.154 CXX test/cpp_headers/string.o 00:02:18.154 CXX test/cpp_headers/thread.o 00:02:18.154 LINK nvme_compliance 00:02:18.154 CXX test/cpp_headers/trace.o 00:02:18.154 CXX test/cpp_headers/trace_parser.o 00:02:18.154 CXX test/cpp_headers/tree.o 00:02:18.154 LINK fdp 00:02:18.154 CXX test/cpp_headers/ublk.o 00:02:18.154 CXX test/cpp_headers/util.o 00:02:18.154 CXX test/cpp_headers/uuid.o 00:02:18.414 CXX test/cpp_headers/version.o 00:02:18.414 LINK vhost_fuzz 00:02:18.414 CXX test/cpp_headers/vfio_user_pci.o 00:02:18.414 CXX test/cpp_headers/vfio_user_spec.o 00:02:18.414 CXX test/cpp_headers/vhost.o 00:02:18.414 CXX test/cpp_headers/vmd.o 00:02:18.414 CXX test/cpp_headers/xor.o 00:02:18.414 CXX test/cpp_headers/zipf.o 00:02:18.672 LINK memory_ut 00:02:19.238 LINK cuse 00:02:19.496 LINK iscsi_fuzz 00:02:22.141 LINK esnap 00:02:22.400 00:02:22.400 real 0m46.459s 00:02:22.400 user 9m39.925s 00:02:22.400 sys 2m9.898s 00:02:22.400 03:19:02 -- common/autotest_common.sh@1115 -- $ xtrace_disable 00:02:22.400 03:19:02 -- common/autotest_common.sh@10 -- $ set +x 00:02:22.400 ************************************ 00:02:22.400 END TEST make 00:02:22.400 ************************************ 00:02:22.400 03:19:02 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:02:22.400 03:19:02 -- common/autotest_common.sh@1690 -- # lcov --version 00:02:22.400 03:19:02 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:02:22.400 03:19:03 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:02:22.400 03:19:03 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:02:22.400 03:19:03 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:02:22.400 03:19:03 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:02:22.400 03:19:03 -- scripts/common.sh@335 -- # IFS=.-: 00:02:22.400 03:19:03 -- scripts/common.sh@335 -- # read -ra ver1 00:02:22.400 03:19:03 -- scripts/common.sh@336 -- # IFS=.-: 00:02:22.400 03:19:03 -- scripts/common.sh@336 -- # read -ra ver2 00:02:22.400 03:19:03 -- scripts/common.sh@337 -- # local 'op=<' 00:02:22.400 03:19:03 -- scripts/common.sh@339 -- # ver1_l=2 00:02:22.400 03:19:03 -- scripts/common.sh@340 -- # ver2_l=1 00:02:22.400 03:19:03 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:02:22.400 03:19:03 -- scripts/common.sh@343 -- # case "$op" in 00:02:22.400 03:19:03 -- scripts/common.sh@344 -- # : 1 00:02:22.400 03:19:03 -- scripts/common.sh@363 -- # (( v = 0 )) 00:02:22.400 03:19:03 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:02:22.400 03:19:03 -- scripts/common.sh@364 -- # decimal 1 00:02:22.400 03:19:03 -- scripts/common.sh@352 -- # local d=1 00:02:22.400 03:19:03 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:02:22.400 03:19:03 -- scripts/common.sh@354 -- # echo 1 00:02:22.400 03:19:03 -- scripts/common.sh@364 -- # ver1[v]=1 00:02:22.400 03:19:03 -- scripts/common.sh@365 -- # decimal 2 00:02:22.400 03:19:03 -- scripts/common.sh@352 -- # local d=2 00:02:22.400 03:19:03 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:02:22.400 03:19:03 -- scripts/common.sh@354 -- # echo 2 00:02:22.400 03:19:03 -- scripts/common.sh@365 -- # ver2[v]=2 00:02:22.400 03:19:03 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:02:22.400 03:19:03 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:02:22.400 03:19:03 -- scripts/common.sh@367 -- # return 0 00:02:22.400 03:19:03 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:02:22.400 03:19:03 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:02:22.400 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:22.400 --rc genhtml_branch_coverage=1 00:02:22.400 --rc genhtml_function_coverage=1 00:02:22.400 --rc genhtml_legend=1 00:02:22.400 --rc geninfo_all_blocks=1 00:02:22.400 --rc geninfo_unexecuted_blocks=1 00:02:22.400 00:02:22.400 ' 00:02:22.400 03:19:03 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:02:22.400 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:22.400 --rc genhtml_branch_coverage=1 00:02:22.400 --rc genhtml_function_coverage=1 00:02:22.400 --rc genhtml_legend=1 00:02:22.400 --rc geninfo_all_blocks=1 00:02:22.400 --rc geninfo_unexecuted_blocks=1 00:02:22.400 00:02:22.400 ' 00:02:22.400 03:19:03 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:02:22.400 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:22.400 --rc genhtml_branch_coverage=1 00:02:22.400 --rc genhtml_function_coverage=1 00:02:22.400 --rc genhtml_legend=1 00:02:22.400 --rc geninfo_all_blocks=1 00:02:22.400 --rc geninfo_unexecuted_blocks=1 00:02:22.400 00:02:22.400 ' 00:02:22.400 03:19:03 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:02:22.400 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:22.400 --rc genhtml_branch_coverage=1 00:02:22.400 --rc genhtml_function_coverage=1 00:02:22.400 --rc genhtml_legend=1 00:02:22.400 --rc geninfo_all_blocks=1 00:02:22.400 --rc geninfo_unexecuted_blocks=1 00:02:22.400 00:02:22.400 ' 00:02:22.400 03:19:03 -- spdk/autotest.sh@25 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:02:22.400 03:19:03 -- nvmf/common.sh@7 -- # uname -s 00:02:22.400 03:19:03 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:02:22.400 03:19:03 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:02:22.400 03:19:03 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:02:22.400 03:19:03 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:02:22.400 03:19:03 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:02:22.400 03:19:03 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:02:22.400 03:19:03 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:02:22.400 03:19:03 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:02:22.400 03:19:03 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:02:22.400 03:19:03 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:02:22.400 03:19:03 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:02:22.400 03:19:03 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:02:22.400 03:19:03 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:02:22.400 03:19:03 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:02:22.400 03:19:03 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:02:22.400 03:19:03 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:02:22.400 03:19:03 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:02:22.400 03:19:03 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:02:22.400 03:19:03 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:02:22.400 03:19:03 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:22.400 03:19:03 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:22.400 03:19:03 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:22.400 03:19:03 -- paths/export.sh@5 -- # export PATH 00:02:22.400 03:19:03 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:22.400 03:19:03 -- nvmf/common.sh@46 -- # : 0 00:02:22.400 03:19:03 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:02:22.400 03:19:03 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:02:22.400 03:19:03 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:02:22.400 03:19:03 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:02:22.400 03:19:03 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:02:22.400 03:19:03 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:02:22.401 03:19:03 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:02:22.401 03:19:03 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:02:22.659 03:19:03 -- spdk/autotest.sh@27 -- # '[' 0 -ne 0 ']' 00:02:22.659 03:19:03 -- spdk/autotest.sh@32 -- # uname -s 00:02:22.659 03:19:03 -- spdk/autotest.sh@32 -- # '[' Linux = Linux ']' 00:02:22.659 03:19:03 -- spdk/autotest.sh@33 -- # old_core_pattern='|/usr/lib/systemd/systemd-coredump %P %u %g %s %t %c %h' 00:02:22.659 03:19:03 -- spdk/autotest.sh@34 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:02:22.659 03:19:03 -- spdk/autotest.sh@39 -- # echo '|/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/core-collector.sh %P %s %t' 00:02:22.659 03:19:03 -- spdk/autotest.sh@40 -- # echo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:02:22.659 03:19:03 -- spdk/autotest.sh@44 -- # modprobe nbd 00:02:22.659 03:19:03 -- spdk/autotest.sh@46 -- # type -P udevadm 00:02:22.659 03:19:03 -- spdk/autotest.sh@46 -- # udevadm=/usr/sbin/udevadm 00:02:22.659 03:19:03 -- spdk/autotest.sh@48 -- # udevadm_pid=2897308 00:02:22.659 03:19:03 -- spdk/autotest.sh@47 -- # /usr/sbin/udevadm monitor --property 00:02:22.659 03:19:03 -- spdk/autotest.sh@51 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:02:22.659 03:19:03 -- spdk/autotest.sh@54 -- # echo 2897310 00:02:22.659 03:19:03 -- spdk/autotest.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-load -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:02:22.659 03:19:03 -- spdk/autotest.sh@56 -- # echo 2897311 00:02:22.659 03:19:03 -- spdk/autotest.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-vmstat -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:02:22.659 03:19:03 -- spdk/autotest.sh@58 -- # [[ ............................... != QEMU ]] 00:02:22.659 03:19:03 -- spdk/autotest.sh@60 -- # echo 2897312 00:02:22.659 03:19:03 -- spdk/autotest.sh@59 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-temp -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l 00:02:22.659 03:19:03 -- spdk/autotest.sh@62 -- # echo 2897313 00:02:22.659 03:19:03 -- spdk/autotest.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-bmc-pm -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l 00:02:22.660 03:19:03 -- spdk/autotest.sh@66 -- # trap 'autotest_cleanup || :; exit 1' SIGINT SIGTERM EXIT 00:02:22.660 03:19:03 -- spdk/autotest.sh@68 -- # timing_enter autotest 00:02:22.660 03:19:03 -- common/autotest_common.sh@722 -- # xtrace_disable 00:02:22.660 03:19:03 -- common/autotest_common.sh@10 -- # set +x 00:02:22.660 03:19:03 -- spdk/autotest.sh@70 -- # create_test_list 00:02:22.660 03:19:03 -- common/autotest_common.sh@746 -- # xtrace_disable 00:02:22.660 03:19:03 -- common/autotest_common.sh@10 -- # set +x 00:02:22.660 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-bmc-pm.bmc.pm.log 00:02:22.660 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-cpu-temp.pm.log 00:02:22.660 03:19:03 -- spdk/autotest.sh@72 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/autotest.sh 00:02:22.660 03:19:03 -- spdk/autotest.sh@72 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:02:22.660 03:19:03 -- spdk/autotest.sh@72 -- # src=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:02:22.660 03:19:03 -- spdk/autotest.sh@73 -- # out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:02:22.660 03:19:03 -- spdk/autotest.sh@74 -- # cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:02:22.660 03:19:03 -- spdk/autotest.sh@76 -- # freebsd_update_contigmem_mod 00:02:22.660 03:19:03 -- common/autotest_common.sh@1450 -- # uname 00:02:22.660 03:19:03 -- common/autotest_common.sh@1450 -- # '[' Linux = FreeBSD ']' 00:02:22.660 03:19:03 -- spdk/autotest.sh@77 -- # freebsd_set_maxsock_buf 00:02:22.660 03:19:03 -- common/autotest_common.sh@1470 -- # uname 00:02:22.660 03:19:03 -- common/autotest_common.sh@1470 -- # [[ Linux = FreeBSD ]] 00:02:22.660 03:19:03 -- spdk/autotest.sh@79 -- # [[ y == y ]] 00:02:22.660 03:19:03 -- spdk/autotest.sh@81 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 --version 00:02:22.660 lcov: LCOV version 1.15 00:02:22.660 03:19:03 -- spdk/autotest.sh@83 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -c --no-external -i -t Baseline -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info 00:02:26.843 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno:no functions found 00:02:26.843 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno 00:02:26.843 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno:no functions found 00:02:26.843 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno 00:02:26.843 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno:no functions found 00:02:26.843 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno 00:03:05.576 03:19:39 -- spdk/autotest.sh@87 -- # timing_enter pre_cleanup 00:03:05.576 03:19:39 -- common/autotest_common.sh@722 -- # xtrace_disable 00:03:05.576 03:19:39 -- common/autotest_common.sh@10 -- # set +x 00:03:05.576 03:19:39 -- spdk/autotest.sh@89 -- # rm -f 00:03:05.576 03:19:39 -- spdk/autotest.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:05.576 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:03:05.576 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:03:05.576 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:03:05.576 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:03:05.576 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:03:05.576 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:03:05.576 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:03:05.576 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:03:05.576 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:03:05.576 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:03:05.576 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:03:05.576 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:03:05.576 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:03:05.576 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:03:05.576 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:03:05.576 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:03:05.576 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:03:05.576 03:19:41 -- spdk/autotest.sh@94 -- # get_zoned_devs 00:03:05.576 03:19:41 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:03:05.576 03:19:41 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:03:05.576 03:19:41 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:03:05.576 03:19:41 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:03:05.576 03:19:41 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:03:05.576 03:19:41 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:03:05.576 03:19:41 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:03:05.576 03:19:41 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:03:05.576 03:19:41 -- spdk/autotest.sh@96 -- # (( 0 > 0 )) 00:03:05.576 03:19:41 -- spdk/autotest.sh@108 -- # ls /dev/nvme0n1 00:03:05.576 03:19:41 -- spdk/autotest.sh@108 -- # grep -v p 00:03:05.576 03:19:41 -- spdk/autotest.sh@108 -- # for dev in $(ls /dev/nvme*n* | grep -v p || true) 00:03:05.576 03:19:41 -- spdk/autotest.sh@110 -- # [[ -z '' ]] 00:03:05.576 03:19:41 -- spdk/autotest.sh@111 -- # block_in_use /dev/nvme0n1 00:03:05.576 03:19:41 -- scripts/common.sh@380 -- # local block=/dev/nvme0n1 pt 00:03:05.576 03:19:41 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py /dev/nvme0n1 00:03:05.576 No valid GPT data, bailing 00:03:05.576 03:19:41 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:03:05.576 03:19:41 -- scripts/common.sh@393 -- # pt= 00:03:05.576 03:19:41 -- scripts/common.sh@394 -- # return 1 00:03:05.576 03:19:41 -- spdk/autotest.sh@112 -- # dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=1 00:03:05.576 1+0 records in 00:03:05.576 1+0 records out 00:03:05.576 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00230714 s, 454 MB/s 00:03:05.576 03:19:41 -- spdk/autotest.sh@116 -- # sync 00:03:05.576 03:19:41 -- spdk/autotest.sh@118 -- # xtrace_disable_per_cmd reap_spdk_processes 00:03:05.576 03:19:41 -- common/autotest_common.sh@22 -- # eval 'reap_spdk_processes 12> /dev/null' 00:03:05.576 03:19:41 -- common/autotest_common.sh@22 -- # reap_spdk_processes 00:03:05.576 03:19:43 -- spdk/autotest.sh@122 -- # uname -s 00:03:05.576 03:19:43 -- spdk/autotest.sh@122 -- # '[' Linux = Linux ']' 00:03:05.576 03:19:43 -- spdk/autotest.sh@123 -- # run_test setup.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:03:05.576 03:19:43 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:05.576 03:19:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:05.576 03:19:43 -- common/autotest_common.sh@10 -- # set +x 00:03:05.576 ************************************ 00:03:05.576 START TEST setup.sh 00:03:05.576 ************************************ 00:03:05.576 03:19:43 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:03:05.576 * Looking for test storage... 00:03:05.576 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:05.576 03:19:43 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:05.576 03:19:43 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:05.576 03:19:43 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:05.576 03:19:43 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:05.576 03:19:43 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:05.576 03:19:43 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:05.576 03:19:43 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:05.576 03:19:43 -- scripts/common.sh@335 -- # IFS=.-: 00:03:05.576 03:19:43 -- scripts/common.sh@335 -- # read -ra ver1 00:03:05.576 03:19:43 -- scripts/common.sh@336 -- # IFS=.-: 00:03:05.576 03:19:43 -- scripts/common.sh@336 -- # read -ra ver2 00:03:05.576 03:19:43 -- scripts/common.sh@337 -- # local 'op=<' 00:03:05.576 03:19:43 -- scripts/common.sh@339 -- # ver1_l=2 00:03:05.576 03:19:43 -- scripts/common.sh@340 -- # ver2_l=1 00:03:05.576 03:19:43 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:05.576 03:19:43 -- scripts/common.sh@343 -- # case "$op" in 00:03:05.576 03:19:43 -- scripts/common.sh@344 -- # : 1 00:03:05.576 03:19:43 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:05.576 03:19:43 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:05.576 03:19:43 -- scripts/common.sh@364 -- # decimal 1 00:03:05.576 03:19:43 -- scripts/common.sh@352 -- # local d=1 00:03:05.576 03:19:43 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:05.576 03:19:43 -- scripts/common.sh@354 -- # echo 1 00:03:05.576 03:19:43 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:05.576 03:19:43 -- scripts/common.sh@365 -- # decimal 2 00:03:05.576 03:19:43 -- scripts/common.sh@352 -- # local d=2 00:03:05.576 03:19:43 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:05.576 03:19:43 -- scripts/common.sh@354 -- # echo 2 00:03:05.576 03:19:43 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:05.576 03:19:43 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:05.576 03:19:43 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:05.576 03:19:43 -- scripts/common.sh@367 -- # return 0 00:03:05.576 03:19:43 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:05.576 03:19:43 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:05.576 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:05.576 --rc genhtml_branch_coverage=1 00:03:05.576 --rc genhtml_function_coverage=1 00:03:05.576 --rc genhtml_legend=1 00:03:05.576 --rc geninfo_all_blocks=1 00:03:05.576 --rc geninfo_unexecuted_blocks=1 00:03:05.576 00:03:05.576 ' 00:03:05.576 03:19:43 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:05.576 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:05.576 --rc genhtml_branch_coverage=1 00:03:05.576 --rc genhtml_function_coverage=1 00:03:05.576 --rc genhtml_legend=1 00:03:05.577 --rc geninfo_all_blocks=1 00:03:05.577 --rc geninfo_unexecuted_blocks=1 00:03:05.577 00:03:05.577 ' 00:03:05.577 03:19:43 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:05.577 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:05.577 --rc genhtml_branch_coverage=1 00:03:05.577 --rc genhtml_function_coverage=1 00:03:05.577 --rc genhtml_legend=1 00:03:05.577 --rc geninfo_all_blocks=1 00:03:05.577 --rc geninfo_unexecuted_blocks=1 00:03:05.577 00:03:05.577 ' 00:03:05.577 03:19:43 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:05.577 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:05.577 --rc genhtml_branch_coverage=1 00:03:05.577 --rc genhtml_function_coverage=1 00:03:05.577 --rc genhtml_legend=1 00:03:05.577 --rc geninfo_all_blocks=1 00:03:05.577 --rc geninfo_unexecuted_blocks=1 00:03:05.577 00:03:05.577 ' 00:03:05.577 03:19:43 -- setup/test-setup.sh@10 -- # uname -s 00:03:05.577 03:19:43 -- setup/test-setup.sh@10 -- # [[ Linux == Linux ]] 00:03:05.577 03:19:43 -- setup/test-setup.sh@12 -- # run_test acl /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:03:05.577 03:19:43 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:05.577 03:19:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:05.577 03:19:43 -- common/autotest_common.sh@10 -- # set +x 00:03:05.577 ************************************ 00:03:05.577 START TEST acl 00:03:05.577 ************************************ 00:03:05.577 03:19:43 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:03:05.577 * Looking for test storage... 00:03:05.577 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:05.577 03:19:43 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:05.577 03:19:43 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:05.577 03:19:43 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:05.577 03:19:43 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:05.577 03:19:43 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:05.577 03:19:43 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:05.577 03:19:43 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:05.577 03:19:43 -- scripts/common.sh@335 -- # IFS=.-: 00:03:05.577 03:19:43 -- scripts/common.sh@335 -- # read -ra ver1 00:03:05.577 03:19:43 -- scripts/common.sh@336 -- # IFS=.-: 00:03:05.577 03:19:43 -- scripts/common.sh@336 -- # read -ra ver2 00:03:05.577 03:19:43 -- scripts/common.sh@337 -- # local 'op=<' 00:03:05.577 03:19:43 -- scripts/common.sh@339 -- # ver1_l=2 00:03:05.577 03:19:43 -- scripts/common.sh@340 -- # ver2_l=1 00:03:05.577 03:19:43 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:05.577 03:19:43 -- scripts/common.sh@343 -- # case "$op" in 00:03:05.577 03:19:43 -- scripts/common.sh@344 -- # : 1 00:03:05.577 03:19:43 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:05.577 03:19:43 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:05.577 03:19:43 -- scripts/common.sh@364 -- # decimal 1 00:03:05.577 03:19:43 -- scripts/common.sh@352 -- # local d=1 00:03:05.577 03:19:43 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:05.577 03:19:43 -- scripts/common.sh@354 -- # echo 1 00:03:05.577 03:19:43 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:05.577 03:19:43 -- scripts/common.sh@365 -- # decimal 2 00:03:05.577 03:19:43 -- scripts/common.sh@352 -- # local d=2 00:03:05.577 03:19:43 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:05.577 03:19:43 -- scripts/common.sh@354 -- # echo 2 00:03:05.577 03:19:43 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:05.577 03:19:43 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:05.577 03:19:43 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:05.577 03:19:43 -- scripts/common.sh@367 -- # return 0 00:03:05.577 03:19:43 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:05.577 03:19:43 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:05.577 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:05.577 --rc genhtml_branch_coverage=1 00:03:05.577 --rc genhtml_function_coverage=1 00:03:05.577 --rc genhtml_legend=1 00:03:05.577 --rc geninfo_all_blocks=1 00:03:05.577 --rc geninfo_unexecuted_blocks=1 00:03:05.577 00:03:05.577 ' 00:03:05.577 03:19:43 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:05.577 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:05.577 --rc genhtml_branch_coverage=1 00:03:05.577 --rc genhtml_function_coverage=1 00:03:05.577 --rc genhtml_legend=1 00:03:05.577 --rc geninfo_all_blocks=1 00:03:05.577 --rc geninfo_unexecuted_blocks=1 00:03:05.577 00:03:05.577 ' 00:03:05.577 03:19:43 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:05.577 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:05.577 --rc genhtml_branch_coverage=1 00:03:05.577 --rc genhtml_function_coverage=1 00:03:05.577 --rc genhtml_legend=1 00:03:05.577 --rc geninfo_all_blocks=1 00:03:05.577 --rc geninfo_unexecuted_blocks=1 00:03:05.577 00:03:05.577 ' 00:03:05.577 03:19:43 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:05.577 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:05.577 --rc genhtml_branch_coverage=1 00:03:05.577 --rc genhtml_function_coverage=1 00:03:05.577 --rc genhtml_legend=1 00:03:05.577 --rc geninfo_all_blocks=1 00:03:05.577 --rc geninfo_unexecuted_blocks=1 00:03:05.577 00:03:05.577 ' 00:03:05.577 03:19:43 -- setup/acl.sh@10 -- # get_zoned_devs 00:03:05.577 03:19:43 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:03:05.577 03:19:43 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:03:05.577 03:19:43 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:03:05.577 03:19:43 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:03:05.577 03:19:43 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:03:05.577 03:19:43 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:03:05.577 03:19:43 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:03:05.577 03:19:43 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:03:05.577 03:19:43 -- setup/acl.sh@12 -- # devs=() 00:03:05.577 03:19:43 -- setup/acl.sh@12 -- # declare -a devs 00:03:05.577 03:19:43 -- setup/acl.sh@13 -- # drivers=() 00:03:05.577 03:19:43 -- setup/acl.sh@13 -- # declare -A drivers 00:03:05.577 03:19:43 -- setup/acl.sh@51 -- # setup reset 00:03:05.577 03:19:43 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:05.577 03:19:43 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:05.577 03:19:45 -- setup/acl.sh@52 -- # collect_setup_devs 00:03:05.577 03:19:45 -- setup/acl.sh@16 -- # local dev driver 00:03:05.577 03:19:45 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:05.577 03:19:45 -- setup/acl.sh@15 -- # setup output status 00:03:05.577 03:19:45 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:05.577 03:19:45 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:03:05.577 Hugepages 00:03:05.577 node hugesize free / total 00:03:05.577 03:19:46 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:03:05.577 03:19:46 -- setup/acl.sh@19 -- # continue 00:03:05.577 03:19:46 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:05.577 03:19:46 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:03:05.577 03:19:46 -- setup/acl.sh@19 -- # continue 00:03:05.577 03:19:46 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:05.577 03:19:46 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:03:05.577 03:19:46 -- setup/acl.sh@19 -- # continue 00:03:05.577 03:19:46 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:05.577 00:03:05.577 Type BDF Vendor Device NUMA Driver Device Block devices 00:03:05.577 03:19:46 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:03:05.577 03:19:46 -- setup/acl.sh@19 -- # continue 00:03:05.577 03:19:46 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:05.577 03:19:46 -- setup/acl.sh@19 -- # [[ 0000:00:04.0 == *:*:*.* ]] 00:03:05.577 03:19:46 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:05.577 03:19:46 -- setup/acl.sh@20 -- # continue 00:03:05.577 03:19:46 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:05.577 03:19:46 -- setup/acl.sh@19 -- # [[ 0000:00:04.1 == *:*:*.* ]] 00:03:05.577 03:19:46 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:05.577 03:19:46 -- setup/acl.sh@20 -- # continue 00:03:05.577 03:19:46 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:05.577 03:19:46 -- setup/acl.sh@19 -- # [[ 0000:00:04.2 == *:*:*.* ]] 00:03:05.577 03:19:46 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:05.577 03:19:46 -- setup/acl.sh@20 -- # continue 00:03:05.577 03:19:46 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:05.577 03:19:46 -- setup/acl.sh@19 -- # [[ 0000:00:04.3 == *:*:*.* ]] 00:03:05.577 03:19:46 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:05.577 03:19:46 -- setup/acl.sh@20 -- # continue 00:03:05.577 03:19:46 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:05.577 03:19:46 -- setup/acl.sh@19 -- # [[ 0000:00:04.4 == *:*:*.* ]] 00:03:05.577 03:19:46 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:05.577 03:19:46 -- setup/acl.sh@20 -- # continue 00:03:05.577 03:19:46 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:05.577 03:19:46 -- setup/acl.sh@19 -- # [[ 0000:00:04.5 == *:*:*.* ]] 00:03:05.577 03:19:46 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:05.577 03:19:46 -- setup/acl.sh@20 -- # continue 00:03:05.577 03:19:46 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:05.577 03:19:46 -- setup/acl.sh@19 -- # [[ 0000:00:04.6 == *:*:*.* ]] 00:03:05.578 03:19:46 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:05.578 03:19:46 -- setup/acl.sh@20 -- # continue 00:03:05.578 03:19:46 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:05.578 03:19:46 -- setup/acl.sh@19 -- # [[ 0000:00:04.7 == *:*:*.* ]] 00:03:05.578 03:19:46 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:05.578 03:19:46 -- setup/acl.sh@20 -- # continue 00:03:05.578 03:19:46 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:05.578 03:19:46 -- setup/acl.sh@19 -- # [[ 0000:80:04.0 == *:*:*.* ]] 00:03:05.578 03:19:46 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:05.578 03:19:46 -- setup/acl.sh@20 -- # continue 00:03:05.578 03:19:46 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:05.578 03:19:46 -- setup/acl.sh@19 -- # [[ 0000:80:04.1 == *:*:*.* ]] 00:03:05.578 03:19:46 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:05.578 03:19:46 -- setup/acl.sh@20 -- # continue 00:03:05.578 03:19:46 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:05.578 03:19:46 -- setup/acl.sh@19 -- # [[ 0000:80:04.2 == *:*:*.* ]] 00:03:05.578 03:19:46 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:05.578 03:19:46 -- setup/acl.sh@20 -- # continue 00:03:05.578 03:19:46 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:05.578 03:19:46 -- setup/acl.sh@19 -- # [[ 0000:80:04.3 == *:*:*.* ]] 00:03:05.578 03:19:46 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:05.578 03:19:46 -- setup/acl.sh@20 -- # continue 00:03:05.578 03:19:46 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:05.578 03:19:46 -- setup/acl.sh@19 -- # [[ 0000:80:04.4 == *:*:*.* ]] 00:03:05.578 03:19:46 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:05.578 03:19:46 -- setup/acl.sh@20 -- # continue 00:03:05.578 03:19:46 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:05.578 03:19:46 -- setup/acl.sh@19 -- # [[ 0000:80:04.5 == *:*:*.* ]] 00:03:05.578 03:19:46 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:05.578 03:19:46 -- setup/acl.sh@20 -- # continue 00:03:05.578 03:19:46 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:05.578 03:19:46 -- setup/acl.sh@19 -- # [[ 0000:80:04.6 == *:*:*.* ]] 00:03:05.578 03:19:46 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:05.578 03:19:46 -- setup/acl.sh@20 -- # continue 00:03:05.578 03:19:46 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:05.578 03:19:46 -- setup/acl.sh@19 -- # [[ 0000:80:04.7 == *:*:*.* ]] 00:03:05.578 03:19:46 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:05.578 03:19:46 -- setup/acl.sh@20 -- # continue 00:03:05.578 03:19:46 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:05.578 03:19:46 -- setup/acl.sh@19 -- # [[ 0000:88:00.0 == *:*:*.* ]] 00:03:05.578 03:19:46 -- setup/acl.sh@20 -- # [[ nvme == nvme ]] 00:03:05.578 03:19:46 -- setup/acl.sh@21 -- # [[ '' == *\0\0\0\0\:\8\8\:\0\0\.\0* ]] 00:03:05.578 03:19:46 -- setup/acl.sh@22 -- # devs+=("$dev") 00:03:05.578 03:19:46 -- setup/acl.sh@22 -- # drivers["$dev"]=nvme 00:03:05.578 03:19:46 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:05.578 03:19:46 -- setup/acl.sh@24 -- # (( 1 > 0 )) 00:03:05.578 03:19:46 -- setup/acl.sh@54 -- # run_test denied denied 00:03:05.578 03:19:46 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:05.578 03:19:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:05.578 03:19:46 -- common/autotest_common.sh@10 -- # set +x 00:03:05.578 ************************************ 00:03:05.578 START TEST denied 00:03:05.578 ************************************ 00:03:05.578 03:19:46 -- common/autotest_common.sh@1114 -- # denied 00:03:05.578 03:19:46 -- setup/acl.sh@38 -- # PCI_BLOCKED=' 0000:88:00.0' 00:03:05.578 03:19:46 -- setup/acl.sh@38 -- # setup output config 00:03:05.578 03:19:46 -- setup/acl.sh@39 -- # grep 'Skipping denied controller at 0000:88:00.0' 00:03:05.578 03:19:46 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:05.578 03:19:46 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:07.484 0000:88:00.0 (8086 0a54): Skipping denied controller at 0000:88:00.0 00:03:07.484 03:19:47 -- setup/acl.sh@40 -- # verify 0000:88:00.0 00:03:07.484 03:19:47 -- setup/acl.sh@28 -- # local dev driver 00:03:07.484 03:19:47 -- setup/acl.sh@30 -- # for dev in "$@" 00:03:07.484 03:19:47 -- setup/acl.sh@31 -- # [[ -e /sys/bus/pci/devices/0000:88:00.0 ]] 00:03:07.484 03:19:47 -- setup/acl.sh@32 -- # readlink -f /sys/bus/pci/devices/0000:88:00.0/driver 00:03:07.484 03:19:47 -- setup/acl.sh@32 -- # driver=/sys/bus/pci/drivers/nvme 00:03:07.484 03:19:47 -- setup/acl.sh@33 -- # [[ nvme == \n\v\m\e ]] 00:03:07.484 03:19:47 -- setup/acl.sh@41 -- # setup reset 00:03:07.484 03:19:47 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:07.484 03:19:47 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:09.389 00:03:09.389 real 0m3.804s 00:03:09.389 user 0m1.103s 00:03:09.389 sys 0m1.851s 00:03:09.389 03:19:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:09.389 03:19:50 -- common/autotest_common.sh@10 -- # set +x 00:03:09.389 ************************************ 00:03:09.389 END TEST denied 00:03:09.389 ************************************ 00:03:09.389 03:19:50 -- setup/acl.sh@55 -- # run_test allowed allowed 00:03:09.389 03:19:50 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:09.389 03:19:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:09.389 03:19:50 -- common/autotest_common.sh@10 -- # set +x 00:03:09.389 ************************************ 00:03:09.389 START TEST allowed 00:03:09.389 ************************************ 00:03:09.389 03:19:50 -- common/autotest_common.sh@1114 -- # allowed 00:03:09.390 03:19:50 -- setup/acl.sh@45 -- # PCI_ALLOWED=0000:88:00.0 00:03:09.390 03:19:50 -- setup/acl.sh@45 -- # setup output config 00:03:09.390 03:19:50 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:09.390 03:19:50 -- setup/acl.sh@46 -- # grep -E '0000:88:00.0 .*: nvme -> .*' 00:03:09.390 03:19:50 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:11.925 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:03:11.926 03:19:52 -- setup/acl.sh@47 -- # verify 00:03:11.926 03:19:52 -- setup/acl.sh@28 -- # local dev driver 00:03:11.926 03:19:52 -- setup/acl.sh@48 -- # setup reset 00:03:11.926 03:19:52 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:11.926 03:19:52 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:13.301 00:03:13.301 real 0m3.852s 00:03:13.301 user 0m1.035s 00:03:13.301 sys 0m1.717s 00:03:13.301 03:19:53 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:13.301 03:19:53 -- common/autotest_common.sh@10 -- # set +x 00:03:13.301 ************************************ 00:03:13.301 END TEST allowed 00:03:13.301 ************************************ 00:03:13.301 00:03:13.301 real 0m10.451s 00:03:13.301 user 0m3.274s 00:03:13.301 sys 0m5.317s 00:03:13.301 03:19:53 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:13.302 03:19:53 -- common/autotest_common.sh@10 -- # set +x 00:03:13.302 ************************************ 00:03:13.302 END TEST acl 00:03:13.302 ************************************ 00:03:13.302 03:19:53 -- setup/test-setup.sh@13 -- # run_test hugepages /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:03:13.302 03:19:53 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:13.302 03:19:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:13.302 03:19:53 -- common/autotest_common.sh@10 -- # set +x 00:03:13.302 ************************************ 00:03:13.302 START TEST hugepages 00:03:13.302 ************************************ 00:03:13.302 03:19:53 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:03:13.560 * Looking for test storage... 00:03:13.560 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:13.560 03:19:53 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:13.560 03:19:53 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:13.560 03:19:53 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:13.560 03:19:54 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:13.560 03:19:54 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:13.560 03:19:54 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:13.560 03:19:54 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:13.560 03:19:54 -- scripts/common.sh@335 -- # IFS=.-: 00:03:13.560 03:19:54 -- scripts/common.sh@335 -- # read -ra ver1 00:03:13.560 03:19:54 -- scripts/common.sh@336 -- # IFS=.-: 00:03:13.560 03:19:54 -- scripts/common.sh@336 -- # read -ra ver2 00:03:13.560 03:19:54 -- scripts/common.sh@337 -- # local 'op=<' 00:03:13.560 03:19:54 -- scripts/common.sh@339 -- # ver1_l=2 00:03:13.560 03:19:54 -- scripts/common.sh@340 -- # ver2_l=1 00:03:13.560 03:19:54 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:13.560 03:19:54 -- scripts/common.sh@343 -- # case "$op" in 00:03:13.560 03:19:54 -- scripts/common.sh@344 -- # : 1 00:03:13.560 03:19:54 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:13.560 03:19:54 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:13.560 03:19:54 -- scripts/common.sh@364 -- # decimal 1 00:03:13.560 03:19:54 -- scripts/common.sh@352 -- # local d=1 00:03:13.560 03:19:54 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:13.560 03:19:54 -- scripts/common.sh@354 -- # echo 1 00:03:13.560 03:19:54 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:13.560 03:19:54 -- scripts/common.sh@365 -- # decimal 2 00:03:13.560 03:19:54 -- scripts/common.sh@352 -- # local d=2 00:03:13.560 03:19:54 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:13.560 03:19:54 -- scripts/common.sh@354 -- # echo 2 00:03:13.560 03:19:54 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:13.560 03:19:54 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:13.560 03:19:54 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:13.560 03:19:54 -- scripts/common.sh@367 -- # return 0 00:03:13.560 03:19:54 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:13.560 03:19:54 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:13.560 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:13.560 --rc genhtml_branch_coverage=1 00:03:13.560 --rc genhtml_function_coverage=1 00:03:13.560 --rc genhtml_legend=1 00:03:13.560 --rc geninfo_all_blocks=1 00:03:13.560 --rc geninfo_unexecuted_blocks=1 00:03:13.560 00:03:13.560 ' 00:03:13.560 03:19:54 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:13.560 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:13.560 --rc genhtml_branch_coverage=1 00:03:13.560 --rc genhtml_function_coverage=1 00:03:13.560 --rc genhtml_legend=1 00:03:13.560 --rc geninfo_all_blocks=1 00:03:13.560 --rc geninfo_unexecuted_blocks=1 00:03:13.560 00:03:13.560 ' 00:03:13.560 03:19:54 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:13.560 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:13.560 --rc genhtml_branch_coverage=1 00:03:13.560 --rc genhtml_function_coverage=1 00:03:13.560 --rc genhtml_legend=1 00:03:13.560 --rc geninfo_all_blocks=1 00:03:13.560 --rc geninfo_unexecuted_blocks=1 00:03:13.560 00:03:13.560 ' 00:03:13.560 03:19:54 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:13.560 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:13.560 --rc genhtml_branch_coverage=1 00:03:13.560 --rc genhtml_function_coverage=1 00:03:13.560 --rc genhtml_legend=1 00:03:13.560 --rc geninfo_all_blocks=1 00:03:13.560 --rc geninfo_unexecuted_blocks=1 00:03:13.560 00:03:13.560 ' 00:03:13.560 03:19:54 -- setup/hugepages.sh@10 -- # nodes_sys=() 00:03:13.560 03:19:54 -- setup/hugepages.sh@10 -- # declare -a nodes_sys 00:03:13.560 03:19:54 -- setup/hugepages.sh@12 -- # declare -i default_hugepages=0 00:03:13.560 03:19:54 -- setup/hugepages.sh@13 -- # declare -i no_nodes=0 00:03:13.560 03:19:54 -- setup/hugepages.sh@14 -- # declare -i nr_hugepages=0 00:03:13.560 03:19:54 -- setup/hugepages.sh@16 -- # get_meminfo Hugepagesize 00:03:13.560 03:19:54 -- setup/common.sh@17 -- # local get=Hugepagesize 00:03:13.560 03:19:54 -- setup/common.sh@18 -- # local node= 00:03:13.560 03:19:54 -- setup/common.sh@19 -- # local var val 00:03:13.560 03:19:54 -- setup/common.sh@20 -- # local mem_f mem 00:03:13.560 03:19:54 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:13.560 03:19:54 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:13.560 03:19:54 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:13.560 03:19:54 -- setup/common.sh@28 -- # mapfile -t mem 00:03:13.560 03:19:54 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:13.560 03:19:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.560 03:19:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.560 03:19:54 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 42390512 kB' 'MemAvailable: 46708852 kB' 'Buffers: 2708 kB' 'Cached: 11072912 kB' 'SwapCached: 0 kB' 'Active: 7475520 kB' 'Inactive: 4089812 kB' 'Active(anon): 7074400 kB' 'Inactive(anon): 0 kB' 'Active(file): 401120 kB' 'Inactive(file): 4089812 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 493100 kB' 'Mapped: 214100 kB' 'Shmem: 6584688 kB' 'KReclaimable: 472040 kB' 'Slab: 1061932 kB' 'SReclaimable: 472040 kB' 'SUnreclaim: 589892 kB' 'KernelStack: 12880 kB' 'PageTables: 8628 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 36559288 kB' 'Committed_AS: 8170476 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 199744 kB' 'VmallocChunk: 0 kB' 'Percpu: 42432 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 2048' 'HugePages_Free: 2048' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 4194304 kB' 'DirectMap4k: 2565724 kB' 'DirectMap2M: 18325504 kB' 'DirectMap1G: 49283072 kB' 00:03:13.560 03:19:54 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:13.560 03:19:54 -- setup/common.sh@32 -- # continue 00:03:13.560 03:19:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.560 03:19:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.560 03:19:54 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:13.560 03:19:54 -- setup/common.sh@32 -- # continue 00:03:13.560 03:19:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.560 03:19:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.560 03:19:54 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:13.560 03:19:54 -- setup/common.sh@32 -- # continue 00:03:13.560 03:19:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.560 03:19:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.560 03:19:54 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:13.560 03:19:54 -- setup/common.sh@32 -- # continue 00:03:13.560 03:19:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.560 03:19:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.560 03:19:54 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:13.560 03:19:54 -- setup/common.sh@32 -- # continue 00:03:13.560 03:19:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.560 03:19:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.560 03:19:54 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:13.560 03:19:54 -- setup/common.sh@32 -- # continue 00:03:13.560 03:19:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.560 03:19:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.560 03:19:54 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:13.560 03:19:54 -- setup/common.sh@32 -- # continue 00:03:13.560 03:19:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.560 03:19:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.560 03:19:54 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:13.560 03:19:54 -- setup/common.sh@32 -- # continue 00:03:13.560 03:19:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.561 03:19:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.561 03:19:54 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:13.561 03:19:54 -- setup/common.sh@32 -- # continue 00:03:13.561 03:19:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.561 03:19:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.561 03:19:54 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:13.561 03:19:54 -- setup/common.sh@32 -- # continue 00:03:13.561 03:19:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.561 03:19:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.561 03:19:54 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:13.561 03:19:54 -- setup/common.sh@32 -- # continue 00:03:13.561 03:19:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.561 03:19:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.561 03:19:54 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:13.561 03:19:54 -- setup/common.sh@32 -- # continue 00:03:13.561 03:19:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.561 03:19:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.561 03:19:54 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:13.561 03:19:54 -- setup/common.sh@32 -- # continue 00:03:13.561 03:19:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.561 03:19:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.561 03:19:54 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:13.561 03:19:54 -- setup/common.sh@32 -- # continue 00:03:13.561 03:19:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.561 03:19:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.561 03:19:54 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:13.561 03:19:54 -- setup/common.sh@32 -- # continue 00:03:13.561 03:19:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.561 03:19:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.561 03:19:54 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:13.561 03:19:54 -- setup/common.sh@32 -- # continue 00:03:13.561 03:19:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.561 03:19:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.561 03:19:54 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:13.561 03:19:54 -- setup/common.sh@32 -- # continue 00:03:13.561 03:19:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.561 03:19:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.561 03:19:54 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:13.561 03:19:54 -- setup/common.sh@32 -- # continue 00:03:13.561 03:19:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.561 03:19:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.561 03:19:54 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:13.561 03:19:54 -- setup/common.sh@32 -- # continue 00:03:13.561 03:19:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.561 03:19:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.561 03:19:54 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:13.561 03:19:54 -- setup/common.sh@32 -- # continue 00:03:13.561 03:19:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.561 03:19:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.561 03:19:54 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:13.561 03:19:54 -- setup/common.sh@32 -- # continue 00:03:13.561 03:19:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.561 03:19:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.561 03:19:54 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:13.561 03:19:54 -- setup/common.sh@32 -- # continue 00:03:13.561 03:19:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.561 03:19:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.561 03:19:54 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:13.561 03:19:54 -- setup/common.sh@32 -- # continue 00:03:13.561 03:19:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.561 03:19:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.561 03:19:54 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:13.561 03:19:54 -- setup/common.sh@32 -- # continue 00:03:13.561 03:19:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.561 03:19:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.561 03:19:54 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:13.561 03:19:54 -- setup/common.sh@32 -- # continue 00:03:13.561 03:19:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.561 03:19:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.561 03:19:54 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:13.561 03:19:54 -- setup/common.sh@32 -- # continue 00:03:13.561 03:19:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.561 03:19:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.561 03:19:54 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:13.561 03:19:54 -- setup/common.sh@32 -- # continue 00:03:13.561 03:19:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.561 03:19:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.561 03:19:54 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:13.561 03:19:54 -- setup/common.sh@32 -- # continue 00:03:13.561 03:19:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.561 03:19:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.561 03:19:54 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:13.561 03:19:54 -- setup/common.sh@32 -- # continue 00:03:13.561 03:19:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.561 03:19:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.561 03:19:54 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:13.561 03:19:54 -- setup/common.sh@32 -- # continue 00:03:13.561 03:19:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.561 03:19:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.561 03:19:54 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:13.561 03:19:54 -- setup/common.sh@32 -- # continue 00:03:13.561 03:19:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.561 03:19:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.561 03:19:54 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:13.561 03:19:54 -- setup/common.sh@32 -- # continue 00:03:13.561 03:19:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.561 03:19:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.561 03:19:54 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:13.561 03:19:54 -- setup/common.sh@32 -- # continue 00:03:13.561 03:19:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.561 03:19:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.561 03:19:54 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:13.561 03:19:54 -- setup/common.sh@32 -- # continue 00:03:13.561 03:19:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.561 03:19:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.561 03:19:54 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:13.561 03:19:54 -- setup/common.sh@32 -- # continue 00:03:13.561 03:19:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.561 03:19:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.561 03:19:54 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:13.561 03:19:54 -- setup/common.sh@32 -- # continue 00:03:13.561 03:19:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.561 03:19:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.561 03:19:54 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:13.561 03:19:54 -- setup/common.sh@32 -- # continue 00:03:13.561 03:19:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.561 03:19:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.561 03:19:54 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:13.561 03:19:54 -- setup/common.sh@32 -- # continue 00:03:13.561 03:19:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.561 03:19:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.561 03:19:54 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:13.561 03:19:54 -- setup/common.sh@32 -- # continue 00:03:13.561 03:19:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.561 03:19:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.561 03:19:54 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:13.561 03:19:54 -- setup/common.sh@32 -- # continue 00:03:13.561 03:19:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.561 03:19:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.561 03:19:54 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:13.561 03:19:54 -- setup/common.sh@32 -- # continue 00:03:13.561 03:19:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.561 03:19:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.561 03:19:54 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:13.561 03:19:54 -- setup/common.sh@32 -- # continue 00:03:13.561 03:19:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.561 03:19:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.561 03:19:54 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:13.561 03:19:54 -- setup/common.sh@32 -- # continue 00:03:13.561 03:19:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.561 03:19:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.561 03:19:54 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:13.561 03:19:54 -- setup/common.sh@32 -- # continue 00:03:13.561 03:19:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.561 03:19:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.561 03:19:54 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:13.561 03:19:54 -- setup/common.sh@32 -- # continue 00:03:13.561 03:19:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.561 03:19:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.561 03:19:54 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:13.561 03:19:54 -- setup/common.sh@32 -- # continue 00:03:13.561 03:19:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.561 03:19:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.561 03:19:54 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:13.561 03:19:54 -- setup/common.sh@32 -- # continue 00:03:13.561 03:19:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.561 03:19:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.561 03:19:54 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:13.561 03:19:54 -- setup/common.sh@32 -- # continue 00:03:13.561 03:19:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.561 03:19:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.561 03:19:54 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:13.561 03:19:54 -- setup/common.sh@32 -- # continue 00:03:13.561 03:19:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.561 03:19:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.561 03:19:54 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:13.561 03:19:54 -- setup/common.sh@32 -- # continue 00:03:13.561 03:19:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.561 03:19:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.561 03:19:54 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:13.561 03:19:54 -- setup/common.sh@32 -- # continue 00:03:13.561 03:19:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.561 03:19:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.561 03:19:54 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:13.561 03:19:54 -- setup/common.sh@32 -- # continue 00:03:13.561 03:19:54 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.561 03:19:54 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.561 03:19:54 -- setup/common.sh@32 -- # [[ Hugepagesize == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:13.561 03:19:54 -- setup/common.sh@33 -- # echo 2048 00:03:13.561 03:19:54 -- setup/common.sh@33 -- # return 0 00:03:13.561 03:19:54 -- setup/hugepages.sh@16 -- # default_hugepages=2048 00:03:13.561 03:19:54 -- setup/hugepages.sh@17 -- # default_huge_nr=/sys/kernel/mm/hugepages/hugepages-2048kB/nr_hugepages 00:03:13.561 03:19:54 -- setup/hugepages.sh@18 -- # global_huge_nr=/proc/sys/vm/nr_hugepages 00:03:13.561 03:19:54 -- setup/hugepages.sh@21 -- # unset -v HUGE_EVEN_ALLOC 00:03:13.561 03:19:54 -- setup/hugepages.sh@22 -- # unset -v HUGEMEM 00:03:13.561 03:19:54 -- setup/hugepages.sh@23 -- # unset -v HUGENODE 00:03:13.561 03:19:54 -- setup/hugepages.sh@24 -- # unset -v NRHUGE 00:03:13.561 03:19:54 -- setup/hugepages.sh@207 -- # get_nodes 00:03:13.561 03:19:54 -- setup/hugepages.sh@27 -- # local node 00:03:13.561 03:19:54 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:13.561 03:19:54 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=2048 00:03:13.561 03:19:54 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:13.561 03:19:54 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:13.561 03:19:54 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:13.561 03:19:54 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:13.561 03:19:54 -- setup/hugepages.sh@208 -- # clear_hp 00:03:13.561 03:19:54 -- setup/hugepages.sh@37 -- # local node hp 00:03:13.561 03:19:54 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:13.561 03:19:54 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:13.561 03:19:54 -- setup/hugepages.sh@41 -- # echo 0 00:03:13.561 03:19:54 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:13.561 03:19:54 -- setup/hugepages.sh@41 -- # echo 0 00:03:13.561 03:19:54 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:13.561 03:19:54 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:13.561 03:19:54 -- setup/hugepages.sh@41 -- # echo 0 00:03:13.561 03:19:54 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:13.561 03:19:54 -- setup/hugepages.sh@41 -- # echo 0 00:03:13.561 03:19:54 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:03:13.561 03:19:54 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:03:13.561 03:19:54 -- setup/hugepages.sh@210 -- # run_test default_setup default_setup 00:03:13.561 03:19:54 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:13.561 03:19:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:13.561 03:19:54 -- common/autotest_common.sh@10 -- # set +x 00:03:13.561 ************************************ 00:03:13.561 START TEST default_setup 00:03:13.561 ************************************ 00:03:13.561 03:19:54 -- common/autotest_common.sh@1114 -- # default_setup 00:03:13.561 03:19:54 -- setup/hugepages.sh@136 -- # get_test_nr_hugepages 2097152 0 00:03:13.561 03:19:54 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:13.561 03:19:54 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:03:13.561 03:19:54 -- setup/hugepages.sh@51 -- # shift 00:03:13.561 03:19:54 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:03:13.561 03:19:54 -- setup/hugepages.sh@52 -- # local node_ids 00:03:13.561 03:19:54 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:13.561 03:19:54 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:13.561 03:19:54 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:03:13.561 03:19:54 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:03:13.561 03:19:54 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:13.561 03:19:54 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:13.561 03:19:54 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:13.561 03:19:54 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:13.561 03:19:54 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:13.561 03:19:54 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:03:13.561 03:19:54 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:13.561 03:19:54 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:03:13.561 03:19:54 -- setup/hugepages.sh@73 -- # return 0 00:03:13.561 03:19:54 -- setup/hugepages.sh@137 -- # setup output 00:03:13.561 03:19:54 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:13.561 03:19:54 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:14.938 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:14.938 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:14.938 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:14.938 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:14.938 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:14.938 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:14.938 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:14.938 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:14.938 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:14.938 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:14.938 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:14.938 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:14.938 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:14.938 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:14.938 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:14.939 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:15.883 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:03:15.883 03:19:56 -- setup/hugepages.sh@138 -- # verify_nr_hugepages 00:03:15.883 03:19:56 -- setup/hugepages.sh@89 -- # local node 00:03:15.883 03:19:56 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:15.883 03:19:56 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:15.883 03:19:56 -- setup/hugepages.sh@92 -- # local surp 00:03:15.883 03:19:56 -- setup/hugepages.sh@93 -- # local resv 00:03:15.883 03:19:56 -- setup/hugepages.sh@94 -- # local anon 00:03:15.883 03:19:56 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:15.883 03:19:56 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:15.883 03:19:56 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:15.883 03:19:56 -- setup/common.sh@18 -- # local node= 00:03:15.883 03:19:56 -- setup/common.sh@19 -- # local var val 00:03:15.883 03:19:56 -- setup/common.sh@20 -- # local mem_f mem 00:03:15.883 03:19:56 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:15.883 03:19:56 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:15.883 03:19:56 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:15.883 03:19:56 -- setup/common.sh@28 -- # mapfile -t mem 00:03:15.883 03:19:56 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:15.883 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.883 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.883 03:19:56 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44528628 kB' 'MemAvailable: 48846968 kB' 'Buffers: 2708 kB' 'Cached: 11073004 kB' 'SwapCached: 0 kB' 'Active: 7476884 kB' 'Inactive: 4089812 kB' 'Active(anon): 7075764 kB' 'Inactive(anon): 0 kB' 'Active(file): 401120 kB' 'Inactive(file): 4089812 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 494288 kB' 'Mapped: 213528 kB' 'Shmem: 6584780 kB' 'KReclaimable: 472040 kB' 'Slab: 1061248 kB' 'SReclaimable: 472040 kB' 'SUnreclaim: 589208 kB' 'KernelStack: 12832 kB' 'PageTables: 8460 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 8173384 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 199824 kB' 'VmallocChunk: 0 kB' 'Percpu: 42432 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2565724 kB' 'DirectMap2M: 18325504 kB' 'DirectMap1G: 49283072 kB' 00:03:15.883 03:19:56 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.883 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.883 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.884 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.884 03:19:56 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.884 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.884 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.884 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.884 03:19:56 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.884 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.884 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.884 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.884 03:19:56 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.884 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.884 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.884 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.884 03:19:56 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.884 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.884 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.884 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.884 03:19:56 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.884 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.884 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.884 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.884 03:19:56 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.884 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.884 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.884 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.884 03:19:56 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.884 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.884 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.884 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.884 03:19:56 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.884 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.884 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.884 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.884 03:19:56 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.884 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.884 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.884 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.884 03:19:56 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.884 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.884 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.884 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.884 03:19:56 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.884 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.884 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.884 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.884 03:19:56 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.884 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.884 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.884 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.884 03:19:56 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.884 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.884 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.884 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.884 03:19:56 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.884 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.884 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.884 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.884 03:19:56 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.884 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.884 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.884 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.884 03:19:56 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.884 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.884 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.884 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.884 03:19:56 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.884 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.884 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.884 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.884 03:19:56 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.884 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.884 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.884 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.884 03:19:56 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.884 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.884 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.884 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.884 03:19:56 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.884 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.884 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.884 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.884 03:19:56 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.884 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.884 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.884 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.884 03:19:56 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.884 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.884 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.884 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.884 03:19:56 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.884 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.884 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.884 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.884 03:19:56 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.884 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.884 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.884 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.884 03:19:56 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.884 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.884 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.884 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.884 03:19:56 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.884 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.884 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.884 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.884 03:19:56 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.884 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.884 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.884 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.884 03:19:56 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.884 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.884 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.884 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.884 03:19:56 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.884 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.884 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.884 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.884 03:19:56 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.884 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.884 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.884 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.884 03:19:56 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.884 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.884 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.884 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.884 03:19:56 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.884 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.884 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.884 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.884 03:19:56 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.884 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.884 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.884 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.884 03:19:56 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.884 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.884 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.884 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.884 03:19:56 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.884 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.884 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.884 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.884 03:19:56 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.884 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.884 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.884 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.884 03:19:56 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.884 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.884 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.884 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.884 03:19:56 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.885 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.885 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.885 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.885 03:19:56 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.885 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.885 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.885 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.885 03:19:56 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:15.885 03:19:56 -- setup/common.sh@33 -- # echo 0 00:03:15.885 03:19:56 -- setup/common.sh@33 -- # return 0 00:03:15.885 03:19:56 -- setup/hugepages.sh@97 -- # anon=0 00:03:15.885 03:19:56 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:15.885 03:19:56 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:15.885 03:19:56 -- setup/common.sh@18 -- # local node= 00:03:15.885 03:19:56 -- setup/common.sh@19 -- # local var val 00:03:15.885 03:19:56 -- setup/common.sh@20 -- # local mem_f mem 00:03:15.885 03:19:56 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:15.885 03:19:56 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:15.885 03:19:56 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:15.885 03:19:56 -- setup/common.sh@28 -- # mapfile -t mem 00:03:15.885 03:19:56 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:15.885 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.885 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.885 03:19:56 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44532556 kB' 'MemAvailable: 48850896 kB' 'Buffers: 2708 kB' 'Cached: 11073008 kB' 'SwapCached: 0 kB' 'Active: 7477352 kB' 'Inactive: 4089812 kB' 'Active(anon): 7076232 kB' 'Inactive(anon): 0 kB' 'Active(file): 401120 kB' 'Inactive(file): 4089812 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 494416 kB' 'Mapped: 213544 kB' 'Shmem: 6584784 kB' 'KReclaimable: 472040 kB' 'Slab: 1061232 kB' 'SReclaimable: 472040 kB' 'SUnreclaim: 589192 kB' 'KernelStack: 12800 kB' 'PageTables: 8352 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 8173396 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 199792 kB' 'VmallocChunk: 0 kB' 'Percpu: 42432 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2565724 kB' 'DirectMap2M: 18325504 kB' 'DirectMap1G: 49283072 kB' 00:03:15.885 03:19:56 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.885 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.885 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.885 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.885 03:19:56 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.885 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.885 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.885 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.885 03:19:56 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.885 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.885 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.885 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.885 03:19:56 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.885 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.885 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.885 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.885 03:19:56 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.885 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.885 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.885 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.885 03:19:56 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.885 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.885 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.885 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.885 03:19:56 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.885 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.885 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.885 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.885 03:19:56 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.885 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.885 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.885 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.885 03:19:56 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.885 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.885 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.885 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.885 03:19:56 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.885 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.885 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.885 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.885 03:19:56 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.885 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.885 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.885 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.885 03:19:56 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.885 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.885 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.885 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.885 03:19:56 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.885 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.885 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.885 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.885 03:19:56 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.885 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.885 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.885 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.885 03:19:56 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.885 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.885 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.885 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.885 03:19:56 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.885 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.885 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.885 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.885 03:19:56 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.885 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.885 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.885 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.885 03:19:56 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.885 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.885 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.885 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.885 03:19:56 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.885 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.885 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.885 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.885 03:19:56 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.885 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.885 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.885 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.885 03:19:56 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.885 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.885 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.885 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.885 03:19:56 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.885 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.885 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.885 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.885 03:19:56 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.885 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.885 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.885 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.885 03:19:56 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.885 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.885 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.885 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.885 03:19:56 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.885 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.885 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.885 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.885 03:19:56 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.885 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.885 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.885 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.885 03:19:56 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.886 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.886 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.886 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.886 03:19:56 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.886 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.886 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.886 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.886 03:19:56 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.886 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.886 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.886 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.886 03:19:56 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.886 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.886 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.886 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.886 03:19:56 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.886 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.886 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.886 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.886 03:19:56 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.886 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.886 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.886 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.886 03:19:56 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.886 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.886 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.886 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.886 03:19:56 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.886 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.886 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.886 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.886 03:19:56 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.886 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.886 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.886 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.886 03:19:56 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.886 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.886 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.886 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.886 03:19:56 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.886 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.886 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.886 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.886 03:19:56 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.886 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.886 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.886 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.886 03:19:56 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.886 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.886 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.886 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.886 03:19:56 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.886 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.886 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.886 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.886 03:19:56 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.886 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.886 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.886 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.886 03:19:56 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.886 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.886 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.886 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.886 03:19:56 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.886 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.886 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.886 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.886 03:19:56 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.886 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.886 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.886 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.886 03:19:56 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.886 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.886 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.886 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.886 03:19:56 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.886 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.886 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.886 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.886 03:19:56 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.886 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.886 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.886 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.886 03:19:56 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.886 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.886 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.886 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.886 03:19:56 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.886 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.886 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.886 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.886 03:19:56 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.886 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.886 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.886 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.886 03:19:56 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.886 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.886 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.886 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.886 03:19:56 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.886 03:19:56 -- setup/common.sh@33 -- # echo 0 00:03:15.886 03:19:56 -- setup/common.sh@33 -- # return 0 00:03:15.886 03:19:56 -- setup/hugepages.sh@99 -- # surp=0 00:03:15.886 03:19:56 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:15.886 03:19:56 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:15.886 03:19:56 -- setup/common.sh@18 -- # local node= 00:03:15.886 03:19:56 -- setup/common.sh@19 -- # local var val 00:03:15.886 03:19:56 -- setup/common.sh@20 -- # local mem_f mem 00:03:15.886 03:19:56 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:15.886 03:19:56 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:15.886 03:19:56 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:15.886 03:19:56 -- setup/common.sh@28 -- # mapfile -t mem 00:03:15.886 03:19:56 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:15.886 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.886 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.886 03:19:56 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44534432 kB' 'MemAvailable: 48852772 kB' 'Buffers: 2708 kB' 'Cached: 11073020 kB' 'SwapCached: 0 kB' 'Active: 7476536 kB' 'Inactive: 4089812 kB' 'Active(anon): 7075416 kB' 'Inactive(anon): 0 kB' 'Active(file): 401120 kB' 'Inactive(file): 4089812 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 493936 kB' 'Mapped: 213528 kB' 'Shmem: 6584796 kB' 'KReclaimable: 472040 kB' 'Slab: 1061268 kB' 'SReclaimable: 472040 kB' 'SUnreclaim: 589228 kB' 'KernelStack: 12832 kB' 'PageTables: 8364 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 8173412 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 199824 kB' 'VmallocChunk: 0 kB' 'Percpu: 42432 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2565724 kB' 'DirectMap2M: 18325504 kB' 'DirectMap1G: 49283072 kB' 00:03:15.886 03:19:56 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.886 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.886 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.886 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.886 03:19:56 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.886 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.886 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.886 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.886 03:19:56 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.886 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.886 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.886 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.886 03:19:56 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.886 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.886 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.886 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.887 03:19:56 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.887 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.887 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.887 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.887 03:19:56 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.887 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.887 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.887 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.887 03:19:56 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.887 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.887 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.887 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.887 03:19:56 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.887 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.887 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.887 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.887 03:19:56 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.887 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.887 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.887 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.887 03:19:56 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.887 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.887 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.887 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.887 03:19:56 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.887 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.887 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.887 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.887 03:19:56 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.887 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.887 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.887 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.887 03:19:56 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.887 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.887 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.887 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.887 03:19:56 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.887 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.887 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.887 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.887 03:19:56 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.887 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.887 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.887 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.887 03:19:56 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.887 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.887 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.887 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.887 03:19:56 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.887 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.887 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.887 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.887 03:19:56 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.887 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.887 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.887 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.887 03:19:56 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.887 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.887 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.887 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.887 03:19:56 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.887 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.887 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.887 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.887 03:19:56 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.887 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.887 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.887 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.887 03:19:56 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.887 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.887 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.887 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.887 03:19:56 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.887 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.887 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.887 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.887 03:19:56 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.887 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.887 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.887 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.887 03:19:56 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.887 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.887 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.887 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.887 03:19:56 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.887 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.887 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.887 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.887 03:19:56 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.887 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.887 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.887 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.887 03:19:56 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.887 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.887 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.887 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.887 03:19:56 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.887 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.887 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.887 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.887 03:19:56 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.887 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.887 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.887 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.887 03:19:56 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.887 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.887 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.887 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.887 03:19:56 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.887 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.887 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.887 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.887 03:19:56 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.887 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.887 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.887 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.887 03:19:56 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.887 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.887 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.887 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.887 03:19:56 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.887 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.887 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.887 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.887 03:19:56 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.887 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.887 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.887 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.887 03:19:56 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.887 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.887 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.887 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.887 03:19:56 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.887 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.887 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.887 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.887 03:19:56 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.887 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.887 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.887 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.887 03:19:56 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.887 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.887 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.887 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.887 03:19:56 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.887 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.887 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.887 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.887 03:19:56 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.888 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.888 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.888 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.888 03:19:56 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.888 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.888 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.888 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.888 03:19:56 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.888 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.888 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.888 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.888 03:19:56 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.888 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.888 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.888 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.888 03:19:56 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.888 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.888 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.888 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.888 03:19:56 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.888 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.888 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.888 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.888 03:19:56 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.888 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.888 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.888 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.888 03:19:56 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.888 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.888 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.888 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.888 03:19:56 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.888 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.888 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.888 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.888 03:19:56 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:15.888 03:19:56 -- setup/common.sh@33 -- # echo 0 00:03:15.888 03:19:56 -- setup/common.sh@33 -- # return 0 00:03:15.888 03:19:56 -- setup/hugepages.sh@100 -- # resv=0 00:03:15.888 03:19:56 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:15.888 nr_hugepages=1024 00:03:15.888 03:19:56 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:15.888 resv_hugepages=0 00:03:15.888 03:19:56 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:15.888 surplus_hugepages=0 00:03:15.888 03:19:56 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:15.888 anon_hugepages=0 00:03:15.888 03:19:56 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:15.888 03:19:56 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:15.888 03:19:56 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:15.888 03:19:56 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:15.888 03:19:56 -- setup/common.sh@18 -- # local node= 00:03:15.888 03:19:56 -- setup/common.sh@19 -- # local var val 00:03:15.888 03:19:56 -- setup/common.sh@20 -- # local mem_f mem 00:03:15.888 03:19:56 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:15.888 03:19:56 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:15.888 03:19:56 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:15.888 03:19:56 -- setup/common.sh@28 -- # mapfile -t mem 00:03:15.888 03:19:56 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:15.888 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.888 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.888 03:19:56 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44534432 kB' 'MemAvailable: 48852772 kB' 'Buffers: 2708 kB' 'Cached: 11073032 kB' 'SwapCached: 0 kB' 'Active: 7476520 kB' 'Inactive: 4089812 kB' 'Active(anon): 7075400 kB' 'Inactive(anon): 0 kB' 'Active(file): 401120 kB' 'Inactive(file): 4089812 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 493940 kB' 'Mapped: 213528 kB' 'Shmem: 6584808 kB' 'KReclaimable: 472040 kB' 'Slab: 1061268 kB' 'SReclaimable: 472040 kB' 'SUnreclaim: 589228 kB' 'KernelStack: 12832 kB' 'PageTables: 8364 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 8173428 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 199824 kB' 'VmallocChunk: 0 kB' 'Percpu: 42432 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2565724 kB' 'DirectMap2M: 18325504 kB' 'DirectMap1G: 49283072 kB' 00:03:15.888 03:19:56 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.888 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.888 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.888 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.888 03:19:56 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.888 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.888 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.888 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.888 03:19:56 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.888 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.888 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.888 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.888 03:19:56 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.888 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.888 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.888 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.888 03:19:56 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.888 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.888 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.888 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.888 03:19:56 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.888 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.888 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.888 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.888 03:19:56 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.888 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.888 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.888 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.888 03:19:56 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.888 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.888 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.888 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.888 03:19:56 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.888 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.888 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.888 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.888 03:19:56 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.888 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.888 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.888 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.888 03:19:56 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.888 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.888 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.888 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.888 03:19:56 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.888 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.888 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.888 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.889 03:19:56 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.889 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.889 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.889 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.889 03:19:56 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.889 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.889 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.889 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.889 03:19:56 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.889 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.889 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.889 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.889 03:19:56 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.889 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.889 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.889 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.889 03:19:56 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.889 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.889 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.889 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.889 03:19:56 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.889 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.889 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.889 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.889 03:19:56 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.889 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.889 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.889 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.889 03:19:56 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.889 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.889 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.889 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.889 03:19:56 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.889 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.889 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.889 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.889 03:19:56 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.889 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.889 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.889 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.889 03:19:56 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.889 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.889 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.889 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.889 03:19:56 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.889 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.889 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.889 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.889 03:19:56 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.889 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.889 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.889 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.889 03:19:56 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.889 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.889 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.889 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.889 03:19:56 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.889 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.889 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.889 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.889 03:19:56 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.889 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.889 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.889 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.889 03:19:56 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.889 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.889 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.889 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.889 03:19:56 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.889 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.889 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.889 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.889 03:19:56 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.889 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.889 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.889 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.889 03:19:56 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.889 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.889 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.889 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.889 03:19:56 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.889 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.889 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.889 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.889 03:19:56 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.889 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.889 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.889 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.889 03:19:56 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.889 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.889 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.889 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.889 03:19:56 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.889 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.889 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.889 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.889 03:19:56 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.889 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.889 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.889 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.889 03:19:56 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.889 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.889 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.889 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.889 03:19:56 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.889 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.889 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.889 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.889 03:19:56 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.889 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.889 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.889 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.889 03:19:56 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.889 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.889 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.889 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.889 03:19:56 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.889 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.889 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.889 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.889 03:19:56 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.889 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.889 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.889 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.889 03:19:56 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.889 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.889 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.889 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.889 03:19:56 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.889 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.889 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.889 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.889 03:19:56 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.889 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.889 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.889 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.889 03:19:56 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.889 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.889 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.889 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.889 03:19:56 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.889 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.889 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.889 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.889 03:19:56 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:15.889 03:19:56 -- setup/common.sh@33 -- # echo 1024 00:03:15.889 03:19:56 -- setup/common.sh@33 -- # return 0 00:03:15.889 03:19:56 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:15.890 03:19:56 -- setup/hugepages.sh@112 -- # get_nodes 00:03:15.890 03:19:56 -- setup/hugepages.sh@27 -- # local node 00:03:15.890 03:19:56 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:15.890 03:19:56 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:15.890 03:19:56 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:15.890 03:19:56 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:15.890 03:19:56 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:15.890 03:19:56 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:15.890 03:19:56 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:15.890 03:19:56 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:15.890 03:19:56 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:15.890 03:19:56 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:15.890 03:19:56 -- setup/common.sh@18 -- # local node=0 00:03:15.890 03:19:56 -- setup/common.sh@19 -- # local var val 00:03:15.890 03:19:56 -- setup/common.sh@20 -- # local mem_f mem 00:03:15.890 03:19:56 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:15.890 03:19:56 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:15.890 03:19:56 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:15.890 03:19:56 -- setup/common.sh@28 -- # mapfile -t mem 00:03:15.890 03:19:56 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:15.890 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.890 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.890 03:19:56 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 19774252 kB' 'MemUsed: 13100672 kB' 'SwapCached: 0 kB' 'Active: 5852180 kB' 'Inactive: 3554096 kB' 'Active(anon): 5644672 kB' 'Inactive(anon): 0 kB' 'Active(file): 207508 kB' 'Inactive(file): 3554096 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 9193616 kB' 'Mapped: 100260 kB' 'AnonPages: 215856 kB' 'Shmem: 5432012 kB' 'KernelStack: 7288 kB' 'PageTables: 5104 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 317812 kB' 'Slab: 708328 kB' 'SReclaimable: 317812 kB' 'SUnreclaim: 390516 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:15.890 03:19:56 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.890 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.890 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.890 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.890 03:19:56 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.890 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.890 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.890 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.890 03:19:56 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.890 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.890 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.890 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.890 03:19:56 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.890 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.890 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.890 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.890 03:19:56 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.890 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.890 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.890 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.890 03:19:56 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.890 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.890 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.890 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.890 03:19:56 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.890 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.890 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.890 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.890 03:19:56 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.890 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.890 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.890 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.890 03:19:56 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.890 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.890 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.890 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.890 03:19:56 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.890 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.890 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.890 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.890 03:19:56 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.890 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.890 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.890 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.890 03:19:56 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.890 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.890 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.890 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.890 03:19:56 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.890 03:19:56 -- setup/common.sh@32 -- # continue 00:03:15.890 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.890 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.890 03:19:56 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.890 03:19:56 -- setup/common.sh@32 -- # continue 00:03:16.149 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.149 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.149 03:19:56 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.149 03:19:56 -- setup/common.sh@32 -- # continue 00:03:16.149 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.149 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.149 03:19:56 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.149 03:19:56 -- setup/common.sh@32 -- # continue 00:03:16.149 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.149 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.149 03:19:56 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.149 03:19:56 -- setup/common.sh@32 -- # continue 00:03:16.149 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.149 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.149 03:19:56 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.149 03:19:56 -- setup/common.sh@32 -- # continue 00:03:16.149 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.149 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.149 03:19:56 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.149 03:19:56 -- setup/common.sh@32 -- # continue 00:03:16.149 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.149 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.149 03:19:56 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.149 03:19:56 -- setup/common.sh@32 -- # continue 00:03:16.149 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.149 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.149 03:19:56 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.149 03:19:56 -- setup/common.sh@32 -- # continue 00:03:16.149 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.149 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.149 03:19:56 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.149 03:19:56 -- setup/common.sh@32 -- # continue 00:03:16.149 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.149 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.149 03:19:56 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.149 03:19:56 -- setup/common.sh@32 -- # continue 00:03:16.149 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.149 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.149 03:19:56 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.149 03:19:56 -- setup/common.sh@32 -- # continue 00:03:16.149 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.149 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.149 03:19:56 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.149 03:19:56 -- setup/common.sh@32 -- # continue 00:03:16.149 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.149 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.149 03:19:56 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.149 03:19:56 -- setup/common.sh@32 -- # continue 00:03:16.149 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.149 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.149 03:19:56 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.149 03:19:56 -- setup/common.sh@32 -- # continue 00:03:16.149 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.149 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.149 03:19:56 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.149 03:19:56 -- setup/common.sh@32 -- # continue 00:03:16.149 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.149 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.149 03:19:56 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.149 03:19:56 -- setup/common.sh@32 -- # continue 00:03:16.149 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.149 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.149 03:19:56 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.149 03:19:56 -- setup/common.sh@32 -- # continue 00:03:16.149 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.149 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.149 03:19:56 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.149 03:19:56 -- setup/common.sh@32 -- # continue 00:03:16.149 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.149 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.149 03:19:56 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.149 03:19:56 -- setup/common.sh@32 -- # continue 00:03:16.149 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.149 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.149 03:19:56 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.149 03:19:56 -- setup/common.sh@32 -- # continue 00:03:16.149 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.149 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.149 03:19:56 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.149 03:19:56 -- setup/common.sh@32 -- # continue 00:03:16.150 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.150 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.150 03:19:56 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.150 03:19:56 -- setup/common.sh@32 -- # continue 00:03:16.150 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.150 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.150 03:19:56 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.150 03:19:56 -- setup/common.sh@32 -- # continue 00:03:16.150 03:19:56 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.150 03:19:56 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.150 03:19:56 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.150 03:19:56 -- setup/common.sh@33 -- # echo 0 00:03:16.150 03:19:56 -- setup/common.sh@33 -- # return 0 00:03:16.150 03:19:56 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:16.150 03:19:56 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:16.150 03:19:56 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:16.150 03:19:56 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:16.150 03:19:56 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:03:16.150 node0=1024 expecting 1024 00:03:16.150 03:19:56 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:03:16.150 00:03:16.150 real 0m2.414s 00:03:16.150 user 0m0.652s 00:03:16.150 sys 0m0.893s 00:03:16.150 03:19:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:16.150 03:19:56 -- common/autotest_common.sh@10 -- # set +x 00:03:16.150 ************************************ 00:03:16.150 END TEST default_setup 00:03:16.150 ************************************ 00:03:16.150 03:19:56 -- setup/hugepages.sh@211 -- # run_test per_node_1G_alloc per_node_1G_alloc 00:03:16.150 03:19:56 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:16.150 03:19:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:16.150 03:19:56 -- common/autotest_common.sh@10 -- # set +x 00:03:16.150 ************************************ 00:03:16.150 START TEST per_node_1G_alloc 00:03:16.150 ************************************ 00:03:16.150 03:19:56 -- common/autotest_common.sh@1114 -- # per_node_1G_alloc 00:03:16.150 03:19:56 -- setup/hugepages.sh@143 -- # local IFS=, 00:03:16.150 03:19:56 -- setup/hugepages.sh@145 -- # get_test_nr_hugepages 1048576 0 1 00:03:16.150 03:19:56 -- setup/hugepages.sh@49 -- # local size=1048576 00:03:16.150 03:19:56 -- setup/hugepages.sh@50 -- # (( 3 > 1 )) 00:03:16.150 03:19:56 -- setup/hugepages.sh@51 -- # shift 00:03:16.150 03:19:56 -- setup/hugepages.sh@52 -- # node_ids=('0' '1') 00:03:16.150 03:19:56 -- setup/hugepages.sh@52 -- # local node_ids 00:03:16.150 03:19:56 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:16.150 03:19:56 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:03:16.150 03:19:56 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 1 00:03:16.150 03:19:56 -- setup/hugepages.sh@62 -- # user_nodes=('0' '1') 00:03:16.150 03:19:56 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:16.150 03:19:56 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:03:16.150 03:19:56 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:16.150 03:19:56 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:16.150 03:19:56 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:16.150 03:19:56 -- setup/hugepages.sh@69 -- # (( 2 > 0 )) 00:03:16.150 03:19:56 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:16.150 03:19:56 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:03:16.150 03:19:56 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:16.150 03:19:56 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:03:16.150 03:19:56 -- setup/hugepages.sh@73 -- # return 0 00:03:16.150 03:19:56 -- setup/hugepages.sh@146 -- # NRHUGE=512 00:03:16.150 03:19:56 -- setup/hugepages.sh@146 -- # HUGENODE=0,1 00:03:16.150 03:19:56 -- setup/hugepages.sh@146 -- # setup output 00:03:16.150 03:19:56 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:16.150 03:19:56 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:17.090 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:17.090 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:17.090 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:17.090 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:17.090 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:17.090 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:17.090 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:17.090 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:17.090 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:17.090 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:17.090 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:17.090 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:17.090 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:17.090 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:17.090 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:17.090 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:17.090 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:17.353 03:19:57 -- setup/hugepages.sh@147 -- # nr_hugepages=1024 00:03:17.353 03:19:57 -- setup/hugepages.sh@147 -- # verify_nr_hugepages 00:03:17.353 03:19:57 -- setup/hugepages.sh@89 -- # local node 00:03:17.353 03:19:57 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:17.353 03:19:57 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:17.353 03:19:57 -- setup/hugepages.sh@92 -- # local surp 00:03:17.353 03:19:57 -- setup/hugepages.sh@93 -- # local resv 00:03:17.353 03:19:57 -- setup/hugepages.sh@94 -- # local anon 00:03:17.353 03:19:57 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:17.353 03:19:57 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:17.353 03:19:57 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:17.353 03:19:57 -- setup/common.sh@18 -- # local node= 00:03:17.353 03:19:57 -- setup/common.sh@19 -- # local var val 00:03:17.353 03:19:57 -- setup/common.sh@20 -- # local mem_f mem 00:03:17.353 03:19:57 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:17.353 03:19:57 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:17.353 03:19:57 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:17.353 03:19:57 -- setup/common.sh@28 -- # mapfile -t mem 00:03:17.353 03:19:57 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:17.353 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.353 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.353 03:19:57 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44507264 kB' 'MemAvailable: 48825604 kB' 'Buffers: 2708 kB' 'Cached: 11073080 kB' 'SwapCached: 0 kB' 'Active: 7477608 kB' 'Inactive: 4089812 kB' 'Active(anon): 7076488 kB' 'Inactive(anon): 0 kB' 'Active(file): 401120 kB' 'Inactive(file): 4089812 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 494828 kB' 'Mapped: 213528 kB' 'Shmem: 6584856 kB' 'KReclaimable: 472040 kB' 'Slab: 1061300 kB' 'SReclaimable: 472040 kB' 'SUnreclaim: 589260 kB' 'KernelStack: 12832 kB' 'PageTables: 8300 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 8173588 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 200032 kB' 'VmallocChunk: 0 kB' 'Percpu: 42432 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2565724 kB' 'DirectMap2M: 18325504 kB' 'DirectMap1G: 49283072 kB' 00:03:17.353 03:19:57 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.353 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.353 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.353 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.353 03:19:57 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.353 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.353 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.353 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.353 03:19:57 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.353 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.353 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.353 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.353 03:19:57 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.353 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.354 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.354 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.354 03:19:57 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.354 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.354 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.354 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.354 03:19:57 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.354 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.354 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.354 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.354 03:19:57 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.354 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.354 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.354 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.354 03:19:57 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.354 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.354 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.354 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.354 03:19:57 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.354 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.354 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.354 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.354 03:19:57 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.354 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.354 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.354 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.354 03:19:57 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.354 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.354 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.354 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.354 03:19:57 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.354 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.354 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.354 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.354 03:19:57 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.354 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.354 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.354 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.354 03:19:57 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.354 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.354 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.354 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.354 03:19:57 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.354 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.354 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.354 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.354 03:19:57 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.354 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.354 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.354 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.354 03:19:57 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.354 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.354 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.354 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.354 03:19:57 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.354 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.354 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.354 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.354 03:19:57 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.354 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.354 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.354 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.354 03:19:57 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.354 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.354 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.354 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.354 03:19:57 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.354 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.354 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.354 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.354 03:19:57 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.354 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.354 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.354 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.354 03:19:57 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.354 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.354 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.354 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.354 03:19:57 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.354 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.354 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.354 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.354 03:19:57 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.354 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.354 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.354 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.354 03:19:57 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.354 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.354 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.354 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.354 03:19:57 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.354 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.354 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.354 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.354 03:19:57 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.354 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.354 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.354 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.354 03:19:57 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.354 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.354 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.354 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.354 03:19:57 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.354 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.354 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.354 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.354 03:19:57 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.354 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.354 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.354 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.354 03:19:57 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.354 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.354 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.354 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.354 03:19:57 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.354 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.354 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.354 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.354 03:19:57 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.354 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.354 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.354 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.354 03:19:57 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.354 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.354 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.354 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.354 03:19:57 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.354 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.354 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.354 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.354 03:19:57 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.354 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.354 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.354 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.354 03:19:57 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.354 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.354 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.354 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.354 03:19:57 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.354 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.354 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.354 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.354 03:19:57 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.354 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.354 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.354 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.354 03:19:57 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.354 03:19:57 -- setup/common.sh@33 -- # echo 0 00:03:17.355 03:19:57 -- setup/common.sh@33 -- # return 0 00:03:17.355 03:19:57 -- setup/hugepages.sh@97 -- # anon=0 00:03:17.355 03:19:57 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:17.355 03:19:57 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:17.355 03:19:57 -- setup/common.sh@18 -- # local node= 00:03:17.355 03:19:57 -- setup/common.sh@19 -- # local var val 00:03:17.355 03:19:57 -- setup/common.sh@20 -- # local mem_f mem 00:03:17.355 03:19:57 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:17.355 03:19:57 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:17.355 03:19:57 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:17.355 03:19:57 -- setup/common.sh@28 -- # mapfile -t mem 00:03:17.355 03:19:57 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:17.355 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.355 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.355 03:19:57 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44507572 kB' 'MemAvailable: 48825912 kB' 'Buffers: 2708 kB' 'Cached: 11073080 kB' 'SwapCached: 0 kB' 'Active: 7479772 kB' 'Inactive: 4089812 kB' 'Active(anon): 7078652 kB' 'Inactive(anon): 0 kB' 'Active(file): 401120 kB' 'Inactive(file): 4089812 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 496964 kB' 'Mapped: 213976 kB' 'Shmem: 6584856 kB' 'KReclaimable: 472040 kB' 'Slab: 1061284 kB' 'SReclaimable: 472040 kB' 'SUnreclaim: 589244 kB' 'KernelStack: 12896 kB' 'PageTables: 8484 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 8175512 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 200016 kB' 'VmallocChunk: 0 kB' 'Percpu: 42432 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2565724 kB' 'DirectMap2M: 18325504 kB' 'DirectMap1G: 49283072 kB' 00:03:17.355 03:19:57 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.355 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.355 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.355 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.355 03:19:57 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.355 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.355 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.355 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.355 03:19:57 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.355 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.355 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.355 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.355 03:19:57 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.355 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.355 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.355 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.355 03:19:57 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.355 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.355 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.355 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.355 03:19:57 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.355 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.355 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.355 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.355 03:19:57 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.355 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.355 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.355 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.355 03:19:57 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.355 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.355 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.355 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.355 03:19:57 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.355 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.355 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.355 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.355 03:19:57 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.355 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.355 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.355 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.355 03:19:57 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.355 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.355 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.355 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.355 03:19:57 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.355 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.355 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.355 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.355 03:19:57 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.355 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.355 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.355 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.355 03:19:57 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.355 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.355 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.355 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.355 03:19:57 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.355 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.355 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.355 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.355 03:19:57 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.355 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.355 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.355 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.355 03:19:57 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.355 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.355 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.355 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.355 03:19:57 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.355 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.355 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.355 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.355 03:19:57 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.355 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.355 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.355 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.355 03:19:57 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.355 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.355 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.355 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.355 03:19:57 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.355 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.355 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.355 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.355 03:19:57 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.355 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.355 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.355 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.355 03:19:57 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.355 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.355 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.355 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.355 03:19:57 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.355 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.355 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.355 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.355 03:19:57 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.355 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.355 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.355 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.355 03:19:57 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.355 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.355 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.355 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.355 03:19:57 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.355 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.355 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.355 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.355 03:19:57 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.355 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.355 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.355 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.356 03:19:57 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.356 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.356 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.356 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.356 03:19:57 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.356 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.356 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.356 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.356 03:19:57 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.356 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.356 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.356 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.356 03:19:57 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.356 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.356 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.356 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.356 03:19:57 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.356 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.356 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.356 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.356 03:19:57 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.356 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.356 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.356 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.356 03:19:57 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.356 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.356 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.356 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.356 03:19:57 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.356 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.356 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.356 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.356 03:19:57 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.356 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.356 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.356 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.356 03:19:57 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.356 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.356 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.356 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.356 03:19:57 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.356 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.356 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.356 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.356 03:19:57 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.356 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.356 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.356 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.356 03:19:57 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.356 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.356 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.356 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.356 03:19:57 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.356 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.356 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.356 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.356 03:19:57 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.356 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.356 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.356 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.356 03:19:57 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.356 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.356 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.356 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.356 03:19:57 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.356 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.356 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.356 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.356 03:19:57 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.356 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.356 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.356 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.356 03:19:57 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.356 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.356 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.356 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.356 03:19:57 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.356 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.356 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.356 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.356 03:19:57 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.356 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.356 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.356 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.356 03:19:57 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.356 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.356 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.356 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.356 03:19:57 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.356 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.356 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.356 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.356 03:19:57 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.356 03:19:57 -- setup/common.sh@33 -- # echo 0 00:03:17.356 03:19:57 -- setup/common.sh@33 -- # return 0 00:03:17.356 03:19:57 -- setup/hugepages.sh@99 -- # surp=0 00:03:17.356 03:19:57 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:17.356 03:19:57 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:17.356 03:19:57 -- setup/common.sh@18 -- # local node= 00:03:17.356 03:19:57 -- setup/common.sh@19 -- # local var val 00:03:17.356 03:19:57 -- setup/common.sh@20 -- # local mem_f mem 00:03:17.356 03:19:57 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:17.356 03:19:57 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:17.356 03:19:57 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:17.356 03:19:57 -- setup/common.sh@28 -- # mapfile -t mem 00:03:17.356 03:19:57 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:17.356 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.356 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.356 03:19:57 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44501652 kB' 'MemAvailable: 48819992 kB' 'Buffers: 2708 kB' 'Cached: 11073092 kB' 'SwapCached: 0 kB' 'Active: 7482796 kB' 'Inactive: 4089812 kB' 'Active(anon): 7081676 kB' 'Inactive(anon): 0 kB' 'Active(file): 401120 kB' 'Inactive(file): 4089812 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 500444 kB' 'Mapped: 213924 kB' 'Shmem: 6584868 kB' 'KReclaimable: 472040 kB' 'Slab: 1061400 kB' 'SReclaimable: 472040 kB' 'SUnreclaim: 589360 kB' 'KernelStack: 12832 kB' 'PageTables: 8244 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 8179364 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 200004 kB' 'VmallocChunk: 0 kB' 'Percpu: 42432 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2565724 kB' 'DirectMap2M: 18325504 kB' 'DirectMap1G: 49283072 kB' 00:03:17.356 03:19:57 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.356 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.356 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.356 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.356 03:19:57 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.356 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.356 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.356 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.356 03:19:57 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.356 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.356 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.356 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.356 03:19:57 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.356 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.356 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.356 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.356 03:19:57 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.356 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.356 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.356 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.356 03:19:57 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.356 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.357 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.357 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.357 03:19:57 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.357 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.357 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.357 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.357 03:19:57 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.357 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.357 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.357 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.357 03:19:57 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.357 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.357 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.357 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.357 03:19:57 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.357 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.357 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.357 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.357 03:19:57 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.357 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.357 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.357 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.357 03:19:57 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.357 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.357 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.357 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.357 03:19:57 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.357 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.357 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.357 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.357 03:19:57 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.357 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.357 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.357 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.357 03:19:57 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.357 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.357 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.357 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.357 03:19:57 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.357 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.357 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.357 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.357 03:19:57 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.357 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.357 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.357 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.357 03:19:57 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.357 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.357 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.357 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.357 03:19:57 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.357 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.357 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.357 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.357 03:19:57 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.357 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.357 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.357 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.357 03:19:57 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.357 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.357 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.357 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.357 03:19:57 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.357 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.357 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.357 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.357 03:19:57 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.357 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.357 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.357 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.357 03:19:57 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.357 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.357 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.357 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.357 03:19:57 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.357 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.357 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.357 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.357 03:19:57 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.357 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.357 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.357 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.357 03:19:57 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.357 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.357 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.357 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.357 03:19:57 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.357 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.357 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.357 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.357 03:19:57 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.357 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.357 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.357 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.357 03:19:57 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.357 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.357 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.357 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.357 03:19:57 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.357 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.357 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.357 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.357 03:19:57 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.357 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.357 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.357 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.357 03:19:57 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.357 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.357 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.357 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.357 03:19:57 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.357 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.357 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.357 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.357 03:19:57 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.357 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.357 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.357 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.357 03:19:57 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.357 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.357 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.357 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.357 03:19:57 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.357 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.357 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.357 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.357 03:19:57 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.357 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.357 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.357 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.357 03:19:57 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.357 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.357 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.357 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.357 03:19:57 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.357 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.357 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.357 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.357 03:19:57 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.357 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.357 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.357 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.357 03:19:57 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.357 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.357 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.357 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.357 03:19:57 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.358 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.358 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.358 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.358 03:19:57 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.358 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.358 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.358 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.358 03:19:57 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.358 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.358 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.358 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.358 03:19:57 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.358 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.358 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.358 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.358 03:19:57 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.358 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.358 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.358 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.358 03:19:57 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.358 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.358 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.358 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.358 03:19:57 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.358 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.358 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.358 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.358 03:19:57 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.358 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.358 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.358 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.358 03:19:57 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.358 03:19:57 -- setup/common.sh@33 -- # echo 0 00:03:17.358 03:19:57 -- setup/common.sh@33 -- # return 0 00:03:17.358 03:19:57 -- setup/hugepages.sh@100 -- # resv=0 00:03:17.358 03:19:57 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:17.358 nr_hugepages=1024 00:03:17.358 03:19:57 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:17.358 resv_hugepages=0 00:03:17.358 03:19:57 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:17.358 surplus_hugepages=0 00:03:17.358 03:19:57 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:17.358 anon_hugepages=0 00:03:17.358 03:19:57 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:17.358 03:19:57 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:17.358 03:19:57 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:17.358 03:19:57 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:17.358 03:19:57 -- setup/common.sh@18 -- # local node= 00:03:17.358 03:19:57 -- setup/common.sh@19 -- # local var val 00:03:17.358 03:19:57 -- setup/common.sh@20 -- # local mem_f mem 00:03:17.358 03:19:57 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:17.358 03:19:57 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:17.358 03:19:57 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:17.358 03:19:57 -- setup/common.sh@28 -- # mapfile -t mem 00:03:17.358 03:19:57 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:17.358 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.358 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.358 03:19:57 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44500644 kB' 'MemAvailable: 48818984 kB' 'Buffers: 2708 kB' 'Cached: 11073096 kB' 'SwapCached: 0 kB' 'Active: 7483496 kB' 'Inactive: 4089812 kB' 'Active(anon): 7082376 kB' 'Inactive(anon): 0 kB' 'Active(file): 401120 kB' 'Inactive(file): 4089812 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 500824 kB' 'Mapped: 214360 kB' 'Shmem: 6584872 kB' 'KReclaimable: 472040 kB' 'Slab: 1061400 kB' 'SReclaimable: 472040 kB' 'SUnreclaim: 589360 kB' 'KernelStack: 12880 kB' 'PageTables: 8376 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 8179384 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 199988 kB' 'VmallocChunk: 0 kB' 'Percpu: 42432 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2565724 kB' 'DirectMap2M: 18325504 kB' 'DirectMap1G: 49283072 kB' 00:03:17.358 03:19:57 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.358 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.358 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.358 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.358 03:19:57 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.358 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.358 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.358 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.358 03:19:57 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.358 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.358 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.358 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.358 03:19:57 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.358 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.358 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.358 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.358 03:19:57 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.358 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.358 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.358 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.358 03:19:57 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.358 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.358 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.358 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.358 03:19:57 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.358 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.358 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.358 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.358 03:19:57 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.358 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.358 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.358 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.358 03:19:57 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.358 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.358 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.358 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.358 03:19:57 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.358 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.359 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.359 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.359 03:19:57 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.359 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.359 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.359 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.359 03:19:57 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.359 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.359 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.359 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.359 03:19:57 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.359 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.359 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.359 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.359 03:19:57 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.359 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.359 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.359 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.359 03:19:57 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.359 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.359 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.359 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.359 03:19:57 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.359 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.359 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.359 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.359 03:19:57 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.359 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.359 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.359 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.359 03:19:57 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.359 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.359 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.359 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.359 03:19:57 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.359 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.359 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.359 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.359 03:19:57 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.359 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.359 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.359 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.359 03:19:57 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.359 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.359 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.359 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.359 03:19:57 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.359 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.359 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.359 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.359 03:19:57 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.359 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.359 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.359 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.359 03:19:57 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.359 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.359 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.359 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.359 03:19:57 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.359 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.359 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.359 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.359 03:19:57 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.359 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.359 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.359 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.359 03:19:57 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.359 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.359 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.359 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.359 03:19:57 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.359 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.359 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.359 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.359 03:19:57 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.359 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.359 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.359 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.359 03:19:57 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.359 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.359 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.359 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.359 03:19:57 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.359 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.359 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.359 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.359 03:19:57 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.359 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.359 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.359 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.359 03:19:57 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.359 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.359 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.359 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.359 03:19:57 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.359 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.359 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.359 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.359 03:19:57 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.359 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.359 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.359 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.359 03:19:57 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.359 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.359 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.359 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.359 03:19:57 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.359 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.359 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.359 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.359 03:19:57 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.359 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.359 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.359 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.359 03:19:57 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.359 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.359 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.359 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.359 03:19:57 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.359 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.359 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.359 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.359 03:19:57 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.359 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.359 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.359 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.359 03:19:57 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.359 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.359 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.359 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.359 03:19:57 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.359 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.359 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.359 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.359 03:19:57 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.359 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.359 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.359 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.359 03:19:57 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.359 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.359 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.359 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.359 03:19:57 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.359 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.360 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.360 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.360 03:19:57 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.360 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.360 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.360 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.360 03:19:57 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.360 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.360 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.360 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.360 03:19:57 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.360 03:19:57 -- setup/common.sh@33 -- # echo 1024 00:03:17.360 03:19:57 -- setup/common.sh@33 -- # return 0 00:03:17.360 03:19:57 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:17.360 03:19:57 -- setup/hugepages.sh@112 -- # get_nodes 00:03:17.360 03:19:57 -- setup/hugepages.sh@27 -- # local node 00:03:17.360 03:19:57 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:17.360 03:19:57 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:17.360 03:19:57 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:17.360 03:19:57 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:17.360 03:19:57 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:17.360 03:19:57 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:17.360 03:19:57 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:17.360 03:19:57 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:17.360 03:19:57 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:17.360 03:19:57 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:17.360 03:19:57 -- setup/common.sh@18 -- # local node=0 00:03:17.360 03:19:57 -- setup/common.sh@19 -- # local var val 00:03:17.360 03:19:57 -- setup/common.sh@20 -- # local mem_f mem 00:03:17.360 03:19:57 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:17.360 03:19:57 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:17.360 03:19:57 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:17.360 03:19:57 -- setup/common.sh@28 -- # mapfile -t mem 00:03:17.360 03:19:57 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:17.360 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.360 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.360 03:19:57 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 20801556 kB' 'MemUsed: 12073368 kB' 'SwapCached: 0 kB' 'Active: 5855056 kB' 'Inactive: 3554096 kB' 'Active(anon): 5647548 kB' 'Inactive(anon): 0 kB' 'Active(file): 207508 kB' 'Inactive(file): 3554096 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 9193616 kB' 'Mapped: 100700 kB' 'AnonPages: 218676 kB' 'Shmem: 5432012 kB' 'KernelStack: 7272 kB' 'PageTables: 5000 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 317812 kB' 'Slab: 708348 kB' 'SReclaimable: 317812 kB' 'SUnreclaim: 390536 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:17.360 03:19:57 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.360 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.360 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.360 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.360 03:19:57 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.360 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.360 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.360 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.360 03:19:57 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.360 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.360 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.360 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.360 03:19:57 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.360 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.360 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.360 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.360 03:19:57 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.360 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.360 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.360 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.360 03:19:57 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.360 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.360 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.360 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.360 03:19:57 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.360 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.360 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.360 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.360 03:19:57 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.360 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.360 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.360 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.360 03:19:57 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.360 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.360 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.360 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.360 03:19:57 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.360 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.360 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.360 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.360 03:19:57 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.360 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.360 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.360 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.360 03:19:57 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.360 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.360 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.360 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.360 03:19:57 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.360 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.360 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.360 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.360 03:19:57 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.360 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.360 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.360 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.360 03:19:57 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.360 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.360 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.360 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.360 03:19:57 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.360 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.360 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.360 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.360 03:19:57 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.360 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.360 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.360 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.360 03:19:57 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.360 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.360 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.360 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.360 03:19:57 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.360 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.360 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.360 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.360 03:19:57 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.360 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.360 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.360 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.360 03:19:57 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.360 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.360 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.360 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.360 03:19:57 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.360 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.360 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.360 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.360 03:19:57 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.360 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.360 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.360 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.360 03:19:57 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.360 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.360 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.361 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.361 03:19:57 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.361 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.361 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.361 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.361 03:19:57 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.361 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.361 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.361 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.361 03:19:57 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.361 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.361 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.361 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.361 03:19:57 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.361 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.361 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.361 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.361 03:19:57 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.361 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.361 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.361 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.361 03:19:57 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.361 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.361 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.361 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.361 03:19:57 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.361 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.361 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.361 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.361 03:19:57 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.361 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.361 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.361 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.361 03:19:57 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.361 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.361 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.361 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.361 03:19:57 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.361 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.361 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.361 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.361 03:19:57 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.361 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.361 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.361 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.361 03:19:57 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.361 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.361 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.361 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.361 03:19:57 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.361 03:19:57 -- setup/common.sh@33 -- # echo 0 00:03:17.361 03:19:57 -- setup/common.sh@33 -- # return 0 00:03:17.361 03:19:57 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:17.361 03:19:57 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:17.361 03:19:57 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:17.361 03:19:57 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:17.361 03:19:57 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:17.361 03:19:57 -- setup/common.sh@18 -- # local node=1 00:03:17.361 03:19:57 -- setup/common.sh@19 -- # local var val 00:03:17.361 03:19:57 -- setup/common.sh@20 -- # local mem_f mem 00:03:17.361 03:19:57 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:17.361 03:19:57 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:17.361 03:19:57 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:17.361 03:19:57 -- setup/common.sh@28 -- # mapfile -t mem 00:03:17.361 03:19:57 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:17.361 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.361 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.361 03:19:57 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27660748 kB' 'MemFree: 23699272 kB' 'MemUsed: 3961476 kB' 'SwapCached: 0 kB' 'Active: 1624536 kB' 'Inactive: 535716 kB' 'Active(anon): 1430924 kB' 'Inactive(anon): 0 kB' 'Active(file): 193612 kB' 'Inactive(file): 535716 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 1882220 kB' 'Mapped: 113276 kB' 'AnonPages: 278164 kB' 'Shmem: 1152892 kB' 'KernelStack: 5560 kB' 'PageTables: 3244 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 154228 kB' 'Slab: 353052 kB' 'SReclaimable: 154228 kB' 'SUnreclaim: 198824 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:17.361 03:19:57 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.361 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.361 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.361 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.361 03:19:57 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.361 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.361 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.361 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.361 03:19:57 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.361 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.361 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.361 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.361 03:19:57 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.361 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.361 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.361 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.361 03:19:57 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.361 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.361 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.361 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.361 03:19:57 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.361 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.361 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.361 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.361 03:19:57 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.361 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.361 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.361 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.361 03:19:57 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.361 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.361 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.361 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.361 03:19:57 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.361 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.361 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.361 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.361 03:19:57 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.361 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.361 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.361 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.361 03:19:57 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.361 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.361 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.361 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.361 03:19:57 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.361 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.361 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.361 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.361 03:19:57 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.361 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.361 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.361 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.361 03:19:57 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.361 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.361 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.361 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.361 03:19:57 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.361 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.361 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.361 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.361 03:19:57 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.361 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.361 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.361 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.361 03:19:57 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.361 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.362 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.362 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.362 03:19:57 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.362 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.362 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.362 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.362 03:19:57 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.362 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.362 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.362 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.362 03:19:57 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.362 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.362 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.362 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.362 03:19:57 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.362 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.362 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.362 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.362 03:19:57 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.362 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.362 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.362 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.362 03:19:57 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.362 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.362 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.362 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.362 03:19:57 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.362 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.362 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.362 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.362 03:19:57 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.362 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.362 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.362 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.362 03:19:57 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.362 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.362 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.362 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.362 03:19:57 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.362 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.362 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.362 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.362 03:19:57 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.362 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.362 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.362 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.362 03:19:57 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.362 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.362 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.362 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.362 03:19:57 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.362 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.362 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.362 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.362 03:19:57 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.362 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.362 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.362 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.362 03:19:57 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.362 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.362 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.362 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.362 03:19:57 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.362 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.362 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.362 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.362 03:19:57 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.362 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.362 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.362 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.362 03:19:57 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.362 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.362 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.362 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.362 03:19:57 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.362 03:19:57 -- setup/common.sh@32 -- # continue 00:03:17.362 03:19:57 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.362 03:19:57 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.362 03:19:57 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.362 03:19:57 -- setup/common.sh@33 -- # echo 0 00:03:17.362 03:19:57 -- setup/common.sh@33 -- # return 0 00:03:17.362 03:19:57 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:17.362 03:19:57 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:17.362 03:19:57 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:17.362 03:19:57 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:17.362 03:19:57 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:03:17.362 node0=512 expecting 512 00:03:17.362 03:19:57 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:17.362 03:19:57 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:17.362 03:19:57 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:17.362 03:19:57 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:03:17.362 node1=512 expecting 512 00:03:17.362 03:19:57 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:03:17.362 00:03:17.362 real 0m1.327s 00:03:17.362 user 0m0.513s 00:03:17.362 sys 0m0.775s 00:03:17.362 03:19:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:17.362 03:19:57 -- common/autotest_common.sh@10 -- # set +x 00:03:17.362 ************************************ 00:03:17.362 END TEST per_node_1G_alloc 00:03:17.362 ************************************ 00:03:17.362 03:19:57 -- setup/hugepages.sh@212 -- # run_test even_2G_alloc even_2G_alloc 00:03:17.362 03:19:57 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:17.362 03:19:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:17.362 03:19:57 -- common/autotest_common.sh@10 -- # set +x 00:03:17.362 ************************************ 00:03:17.362 START TEST even_2G_alloc 00:03:17.362 ************************************ 00:03:17.362 03:19:57 -- common/autotest_common.sh@1114 -- # even_2G_alloc 00:03:17.362 03:19:57 -- setup/hugepages.sh@152 -- # get_test_nr_hugepages 2097152 00:03:17.362 03:19:57 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:17.362 03:19:57 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:17.362 03:19:57 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:17.362 03:19:57 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:17.362 03:19:57 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:17.362 03:19:57 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:17.362 03:19:57 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:17.362 03:19:57 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:17.362 03:19:57 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:17.362 03:19:57 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:17.362 03:19:57 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:17.362 03:19:57 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:17.362 03:19:57 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:03:17.362 03:19:57 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:17.362 03:19:57 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:03:17.362 03:19:57 -- setup/hugepages.sh@83 -- # : 512 00:03:17.362 03:19:57 -- setup/hugepages.sh@84 -- # : 1 00:03:17.362 03:19:57 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:17.362 03:19:57 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:03:17.362 03:19:57 -- setup/hugepages.sh@83 -- # : 0 00:03:17.362 03:19:57 -- setup/hugepages.sh@84 -- # : 0 00:03:17.362 03:19:57 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:17.362 03:19:57 -- setup/hugepages.sh@153 -- # NRHUGE=1024 00:03:17.362 03:19:57 -- setup/hugepages.sh@153 -- # HUGE_EVEN_ALLOC=yes 00:03:17.362 03:19:57 -- setup/hugepages.sh@153 -- # setup output 00:03:17.362 03:19:57 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:17.362 03:19:57 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:18.771 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:18.771 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:18.771 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:18.771 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:18.771 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:18.771 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:18.771 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:18.771 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:18.771 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:18.772 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:18.772 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:18.772 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:18.772 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:18.772 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:18.772 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:18.772 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:18.772 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:18.772 03:19:59 -- setup/hugepages.sh@154 -- # verify_nr_hugepages 00:03:18.772 03:19:59 -- setup/hugepages.sh@89 -- # local node 00:03:18.772 03:19:59 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:18.772 03:19:59 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:18.772 03:19:59 -- setup/hugepages.sh@92 -- # local surp 00:03:18.772 03:19:59 -- setup/hugepages.sh@93 -- # local resv 00:03:18.772 03:19:59 -- setup/hugepages.sh@94 -- # local anon 00:03:18.772 03:19:59 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:18.772 03:19:59 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:18.772 03:19:59 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:18.772 03:19:59 -- setup/common.sh@18 -- # local node= 00:03:18.772 03:19:59 -- setup/common.sh@19 -- # local var val 00:03:18.772 03:19:59 -- setup/common.sh@20 -- # local mem_f mem 00:03:18.772 03:19:59 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:18.772 03:19:59 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:18.772 03:19:59 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:18.772 03:19:59 -- setup/common.sh@28 -- # mapfile -t mem 00:03:18.772 03:19:59 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:18.772 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.772 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.772 03:19:59 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44508928 kB' 'MemAvailable: 48827268 kB' 'Buffers: 2708 kB' 'Cached: 11073180 kB' 'SwapCached: 0 kB' 'Active: 7477728 kB' 'Inactive: 4089812 kB' 'Active(anon): 7076608 kB' 'Inactive(anon): 0 kB' 'Active(file): 401120 kB' 'Inactive(file): 4089812 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 494940 kB' 'Mapped: 213680 kB' 'Shmem: 6584956 kB' 'KReclaimable: 472040 kB' 'Slab: 1061280 kB' 'SReclaimable: 472040 kB' 'SUnreclaim: 589240 kB' 'KernelStack: 12864 kB' 'PageTables: 8344 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 8173820 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 199968 kB' 'VmallocChunk: 0 kB' 'Percpu: 42432 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2565724 kB' 'DirectMap2M: 18325504 kB' 'DirectMap1G: 49283072 kB' 00:03:18.772 03:19:59 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.772 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.772 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.772 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.772 03:19:59 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.772 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.772 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.772 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.772 03:19:59 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.772 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.772 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.772 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.772 03:19:59 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.772 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.772 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.772 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.772 03:19:59 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.772 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.772 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.772 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.772 03:19:59 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.772 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.772 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.772 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.772 03:19:59 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.772 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.772 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.772 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.772 03:19:59 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.772 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.772 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.772 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.772 03:19:59 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.772 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.772 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.772 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.772 03:19:59 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.772 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.772 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.772 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.772 03:19:59 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.772 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.772 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.772 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.772 03:19:59 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.772 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.772 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.772 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.772 03:19:59 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.772 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.772 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.772 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.772 03:19:59 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.772 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.772 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.772 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.772 03:19:59 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.772 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.772 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.772 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.772 03:19:59 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.772 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.772 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.772 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.772 03:19:59 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.772 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.772 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.772 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.772 03:19:59 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.772 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.772 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.772 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.772 03:19:59 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.772 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.772 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.772 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.772 03:19:59 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.772 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.772 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.772 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.772 03:19:59 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.772 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.772 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.772 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.772 03:19:59 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.772 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.772 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.772 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.772 03:19:59 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.772 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.772 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.772 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.772 03:19:59 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.772 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.772 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.772 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.772 03:19:59 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.772 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.772 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.772 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.772 03:19:59 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.772 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.772 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.772 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.772 03:19:59 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.772 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.772 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.772 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.772 03:19:59 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.772 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.772 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.772 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.772 03:19:59 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.772 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.772 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.772 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.772 03:19:59 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.772 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.772 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.772 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.772 03:19:59 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.772 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.772 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.772 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.772 03:19:59 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.772 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.772 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.772 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.772 03:19:59 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.772 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.772 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.772 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.772 03:19:59 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.772 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.772 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.772 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.772 03:19:59 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.772 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.772 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.772 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.772 03:19:59 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.772 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.772 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.772 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.772 03:19:59 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.772 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.772 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.772 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.772 03:19:59 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.772 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.772 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.772 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.773 03:19:59 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.773 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.773 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.773 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.773 03:19:59 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.773 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.773 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.773 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.773 03:19:59 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.773 03:19:59 -- setup/common.sh@33 -- # echo 0 00:03:18.773 03:19:59 -- setup/common.sh@33 -- # return 0 00:03:18.773 03:19:59 -- setup/hugepages.sh@97 -- # anon=0 00:03:18.773 03:19:59 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:18.773 03:19:59 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:18.773 03:19:59 -- setup/common.sh@18 -- # local node= 00:03:18.773 03:19:59 -- setup/common.sh@19 -- # local var val 00:03:18.773 03:19:59 -- setup/common.sh@20 -- # local mem_f mem 00:03:18.773 03:19:59 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:18.773 03:19:59 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:18.773 03:19:59 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:18.773 03:19:59 -- setup/common.sh@28 -- # mapfile -t mem 00:03:18.773 03:19:59 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:18.773 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.773 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.773 03:19:59 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44509936 kB' 'MemAvailable: 48828276 kB' 'Buffers: 2708 kB' 'Cached: 11073184 kB' 'SwapCached: 0 kB' 'Active: 7477848 kB' 'Inactive: 4089812 kB' 'Active(anon): 7076728 kB' 'Inactive(anon): 0 kB' 'Active(file): 401120 kB' 'Inactive(file): 4089812 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 495036 kB' 'Mapped: 213628 kB' 'Shmem: 6584960 kB' 'KReclaimable: 472040 kB' 'Slab: 1061264 kB' 'SReclaimable: 472040 kB' 'SUnreclaim: 589224 kB' 'KernelStack: 12880 kB' 'PageTables: 8352 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 8173832 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 199920 kB' 'VmallocChunk: 0 kB' 'Percpu: 42432 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2565724 kB' 'DirectMap2M: 18325504 kB' 'DirectMap1G: 49283072 kB' 00:03:18.773 03:19:59 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.773 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.773 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.773 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.773 03:19:59 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.773 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.773 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.773 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.773 03:19:59 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.773 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.773 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.773 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.773 03:19:59 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.773 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.773 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.773 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.773 03:19:59 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.773 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.773 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.773 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.773 03:19:59 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.773 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.773 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.773 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.773 03:19:59 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.773 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.773 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.773 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.773 03:19:59 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.773 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.773 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.773 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.773 03:19:59 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.773 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.773 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.773 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.773 03:19:59 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.773 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.773 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.773 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.773 03:19:59 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.773 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.773 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.773 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.773 03:19:59 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.773 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.773 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.773 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.773 03:19:59 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.773 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.773 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.773 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.773 03:19:59 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.773 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.773 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.773 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.773 03:19:59 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.773 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.773 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.773 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.773 03:19:59 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.773 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.773 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.773 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.773 03:19:59 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.773 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.773 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.773 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.773 03:19:59 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.773 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.773 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.773 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.773 03:19:59 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.773 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.773 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.773 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.773 03:19:59 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.773 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.773 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.773 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.773 03:19:59 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.773 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.773 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.773 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.773 03:19:59 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.773 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.773 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.773 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.773 03:19:59 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.773 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.773 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.773 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.773 03:19:59 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.773 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.773 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.773 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.773 03:19:59 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.773 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.773 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.773 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.773 03:19:59 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.773 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.773 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.773 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.773 03:19:59 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.773 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.773 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.773 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.773 03:19:59 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.773 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.773 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.773 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.773 03:19:59 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.773 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.773 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.773 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.773 03:19:59 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.773 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.773 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.773 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.773 03:19:59 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.773 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.773 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.773 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.773 03:19:59 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.773 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.773 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.773 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.773 03:19:59 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.773 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.773 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.773 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.773 03:19:59 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.773 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.773 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.773 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.773 03:19:59 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.773 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.773 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.773 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.773 03:19:59 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.773 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.773 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.773 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.773 03:19:59 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.773 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.773 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.773 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.773 03:19:59 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.773 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.773 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.773 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.774 03:19:59 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.774 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.774 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.774 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.774 03:19:59 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.774 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.774 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.774 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.774 03:19:59 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.774 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.774 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.774 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.774 03:19:59 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.774 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.774 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.774 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.774 03:19:59 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.774 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.774 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.774 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.774 03:19:59 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.774 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.774 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.774 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.774 03:19:59 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.774 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.774 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.774 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.774 03:19:59 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.774 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.774 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.774 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.774 03:19:59 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.774 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.774 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.774 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.774 03:19:59 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.774 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.774 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.774 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.774 03:19:59 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.774 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.774 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.774 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.774 03:19:59 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.774 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.774 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.774 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.774 03:19:59 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.774 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.774 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.774 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.774 03:19:59 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.774 03:19:59 -- setup/common.sh@33 -- # echo 0 00:03:18.774 03:19:59 -- setup/common.sh@33 -- # return 0 00:03:18.774 03:19:59 -- setup/hugepages.sh@99 -- # surp=0 00:03:18.774 03:19:59 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:18.774 03:19:59 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:18.774 03:19:59 -- setup/common.sh@18 -- # local node= 00:03:18.774 03:19:59 -- setup/common.sh@19 -- # local var val 00:03:18.774 03:19:59 -- setup/common.sh@20 -- # local mem_f mem 00:03:18.774 03:19:59 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:18.774 03:19:59 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:18.774 03:19:59 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:18.774 03:19:59 -- setup/common.sh@28 -- # mapfile -t mem 00:03:18.774 03:19:59 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:18.774 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.774 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.774 03:19:59 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44512560 kB' 'MemAvailable: 48830900 kB' 'Buffers: 2708 kB' 'Cached: 11073192 kB' 'SwapCached: 0 kB' 'Active: 7477712 kB' 'Inactive: 4089812 kB' 'Active(anon): 7076592 kB' 'Inactive(anon): 0 kB' 'Active(file): 401120 kB' 'Inactive(file): 4089812 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 494868 kB' 'Mapped: 213556 kB' 'Shmem: 6584968 kB' 'KReclaimable: 472040 kB' 'Slab: 1061240 kB' 'SReclaimable: 472040 kB' 'SUnreclaim: 589200 kB' 'KernelStack: 12880 kB' 'PageTables: 8348 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 8173848 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 199920 kB' 'VmallocChunk: 0 kB' 'Percpu: 42432 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2565724 kB' 'DirectMap2M: 18325504 kB' 'DirectMap1G: 49283072 kB' 00:03:18.774 03:19:59 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.774 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.774 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.774 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.774 03:19:59 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.774 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.774 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.774 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.774 03:19:59 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.774 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.774 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.774 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.774 03:19:59 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.774 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.774 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.774 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.774 03:19:59 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.774 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.774 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.774 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.774 03:19:59 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.774 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.774 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.774 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.774 03:19:59 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.774 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.774 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.774 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.774 03:19:59 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.774 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.774 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.774 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.774 03:19:59 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.774 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.774 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.774 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.774 03:19:59 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.774 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.774 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.774 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.774 03:19:59 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.774 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.774 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.774 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.774 03:19:59 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.774 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.774 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.774 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.774 03:19:59 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.774 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.774 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.774 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.774 03:19:59 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.774 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.774 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.774 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.774 03:19:59 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.774 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.774 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.774 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.774 03:19:59 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.774 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.774 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.774 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.774 03:19:59 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.774 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.774 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.774 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.774 03:19:59 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.774 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.774 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.774 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.774 03:19:59 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.774 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.774 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.774 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.774 03:19:59 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.774 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.774 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.774 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.774 03:19:59 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.774 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.774 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.774 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.774 03:19:59 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.774 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.774 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.774 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.774 03:19:59 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.774 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.774 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.774 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.774 03:19:59 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.774 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.774 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.774 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.774 03:19:59 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.774 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.774 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.774 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.774 03:19:59 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.774 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.774 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.774 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.774 03:19:59 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.774 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.774 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.774 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.774 03:19:59 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.774 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.774 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.774 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.775 03:19:59 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.775 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.775 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.775 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.775 03:19:59 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.775 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.775 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.775 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.775 03:19:59 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.775 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.775 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.775 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.775 03:19:59 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.775 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.775 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.775 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.775 03:19:59 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.775 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.775 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.775 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.775 03:19:59 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.775 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.775 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.775 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.775 03:19:59 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.775 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.775 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.775 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.775 03:19:59 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.775 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.775 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.775 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.775 03:19:59 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.775 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.775 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.775 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.775 03:19:59 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.775 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.775 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.775 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.775 03:19:59 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.775 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.775 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.775 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.775 03:19:59 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.775 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.775 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.775 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.775 03:19:59 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.775 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.775 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.775 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.775 03:19:59 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.775 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.775 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.775 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.775 03:19:59 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.775 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.775 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.775 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.775 03:19:59 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.775 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.775 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.775 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.775 03:19:59 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.775 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.775 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.775 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.775 03:19:59 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.775 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.775 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.775 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.775 03:19:59 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.775 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.775 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.775 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.775 03:19:59 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.775 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.775 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.775 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.775 03:19:59 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.775 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.775 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.775 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.775 03:19:59 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.775 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.775 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.775 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.775 03:19:59 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.775 03:19:59 -- setup/common.sh@33 -- # echo 0 00:03:18.775 03:19:59 -- setup/common.sh@33 -- # return 0 00:03:18.775 03:19:59 -- setup/hugepages.sh@100 -- # resv=0 00:03:18.775 03:19:59 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:18.775 nr_hugepages=1024 00:03:18.775 03:19:59 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:18.775 resv_hugepages=0 00:03:18.775 03:19:59 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:18.775 surplus_hugepages=0 00:03:18.775 03:19:59 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:18.775 anon_hugepages=0 00:03:18.775 03:19:59 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:18.775 03:19:59 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:18.775 03:19:59 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:18.775 03:19:59 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:18.775 03:19:59 -- setup/common.sh@18 -- # local node= 00:03:18.775 03:19:59 -- setup/common.sh@19 -- # local var val 00:03:18.775 03:19:59 -- setup/common.sh@20 -- # local mem_f mem 00:03:18.775 03:19:59 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:18.775 03:19:59 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:18.775 03:19:59 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:18.775 03:19:59 -- setup/common.sh@28 -- # mapfile -t mem 00:03:18.775 03:19:59 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:18.775 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.775 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.776 03:19:59 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44512560 kB' 'MemAvailable: 48830900 kB' 'Buffers: 2708 kB' 'Cached: 11073208 kB' 'SwapCached: 0 kB' 'Active: 7477676 kB' 'Inactive: 4089812 kB' 'Active(anon): 7076556 kB' 'Inactive(anon): 0 kB' 'Active(file): 401120 kB' 'Inactive(file): 4089812 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 494864 kB' 'Mapped: 213556 kB' 'Shmem: 6584984 kB' 'KReclaimable: 472040 kB' 'Slab: 1061240 kB' 'SReclaimable: 472040 kB' 'SUnreclaim: 589200 kB' 'KernelStack: 12880 kB' 'PageTables: 8348 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 8173860 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 199920 kB' 'VmallocChunk: 0 kB' 'Percpu: 42432 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2565724 kB' 'DirectMap2M: 18325504 kB' 'DirectMap1G: 49283072 kB' 00:03:18.776 03:19:59 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.776 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.776 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.776 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.776 03:19:59 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.776 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.776 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.776 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.776 03:19:59 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.776 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.776 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.776 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.776 03:19:59 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.776 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.776 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.776 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.776 03:19:59 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.776 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.776 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.776 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.776 03:19:59 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.776 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.776 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.776 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.776 03:19:59 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.776 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.776 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.776 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.776 03:19:59 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.776 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.776 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.776 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.776 03:19:59 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.776 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.776 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.776 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.776 03:19:59 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.776 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.776 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.776 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.776 03:19:59 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.776 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.776 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.776 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.776 03:19:59 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.776 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.776 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.776 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.776 03:19:59 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.777 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.777 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.777 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.777 03:19:59 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.777 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.777 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.777 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.777 03:19:59 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.777 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.777 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.777 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.777 03:19:59 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.777 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.777 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.777 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.777 03:19:59 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.777 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.777 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.777 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.777 03:19:59 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.777 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.777 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.777 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.777 03:19:59 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.777 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.777 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.777 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.777 03:19:59 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.777 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.777 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.777 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.777 03:19:59 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.777 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.777 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.777 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.777 03:19:59 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.777 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.777 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.777 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.777 03:19:59 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.777 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.777 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.777 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.777 03:19:59 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.777 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.777 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.777 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.777 03:19:59 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.777 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.777 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.777 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.777 03:19:59 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.777 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.777 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.777 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.777 03:19:59 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.777 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.777 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.777 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.777 03:19:59 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.777 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.777 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.777 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.777 03:19:59 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.777 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.777 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.777 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.777 03:19:59 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.777 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.777 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.777 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.777 03:19:59 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.777 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.777 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.777 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.777 03:19:59 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.777 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.777 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.777 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.777 03:19:59 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.777 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.777 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.777 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.777 03:19:59 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.777 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.777 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.777 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.777 03:19:59 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.777 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.777 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.777 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.777 03:19:59 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.777 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.777 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.777 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.777 03:19:59 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.777 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.777 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.777 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.777 03:19:59 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.777 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.777 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.777 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.777 03:19:59 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.777 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.777 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.777 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.777 03:19:59 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.777 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.777 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.777 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.777 03:19:59 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.777 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.777 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.777 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.777 03:19:59 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.777 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.777 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.777 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.777 03:19:59 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.777 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.777 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.777 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.777 03:19:59 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.777 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.777 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.777 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.777 03:19:59 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.777 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.777 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.777 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.777 03:19:59 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.777 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.777 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.777 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.777 03:19:59 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.777 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.777 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.777 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.777 03:19:59 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.777 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.777 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.777 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.777 03:19:59 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.777 03:19:59 -- setup/common.sh@33 -- # echo 1024 00:03:18.777 03:19:59 -- setup/common.sh@33 -- # return 0 00:03:18.777 03:19:59 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:18.777 03:19:59 -- setup/hugepages.sh@112 -- # get_nodes 00:03:18.777 03:19:59 -- setup/hugepages.sh@27 -- # local node 00:03:18.777 03:19:59 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:18.777 03:19:59 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:18.777 03:19:59 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:18.777 03:19:59 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:18.777 03:19:59 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:18.777 03:19:59 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:18.777 03:19:59 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:18.777 03:19:59 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:18.777 03:19:59 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:18.777 03:19:59 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:18.777 03:19:59 -- setup/common.sh@18 -- # local node=0 00:03:18.777 03:19:59 -- setup/common.sh@19 -- # local var val 00:03:18.777 03:19:59 -- setup/common.sh@20 -- # local mem_f mem 00:03:18.777 03:19:59 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:18.777 03:19:59 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:18.777 03:19:59 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:18.777 03:19:59 -- setup/common.sh@28 -- # mapfile -t mem 00:03:18.777 03:19:59 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:18.777 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.777 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.777 03:19:59 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 20809028 kB' 'MemUsed: 12065896 kB' 'SwapCached: 0 kB' 'Active: 5853232 kB' 'Inactive: 3554096 kB' 'Active(anon): 5645724 kB' 'Inactive(anon): 0 kB' 'Active(file): 207508 kB' 'Inactive(file): 3554096 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 9193628 kB' 'Mapped: 100272 kB' 'AnonPages: 216892 kB' 'Shmem: 5432024 kB' 'KernelStack: 7336 kB' 'PageTables: 5144 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 317812 kB' 'Slab: 708296 kB' 'SReclaimable: 317812 kB' 'SUnreclaim: 390484 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:18.777 03:19:59 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.777 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.777 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.777 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.777 03:19:59 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.777 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.777 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.777 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.777 03:19:59 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.777 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.777 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.777 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.777 03:19:59 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.777 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.777 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.777 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.777 03:19:59 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.777 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.777 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.777 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.777 03:19:59 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.778 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.778 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.778 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.778 03:19:59 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.778 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.778 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.778 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.778 03:19:59 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.778 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.778 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.778 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.778 03:19:59 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.778 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.778 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.778 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.778 03:19:59 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.778 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.778 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.778 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.778 03:19:59 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.778 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.778 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.778 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.778 03:19:59 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.778 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.778 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.778 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.778 03:19:59 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.778 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.778 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.778 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.778 03:19:59 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.778 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.778 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.778 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.778 03:19:59 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.778 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.778 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.778 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.778 03:19:59 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.778 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.778 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.778 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.778 03:19:59 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.778 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.778 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.778 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.778 03:19:59 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.778 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.778 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.778 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.778 03:19:59 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.778 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.778 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.778 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.778 03:19:59 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.778 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.778 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.778 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.778 03:19:59 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.778 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.778 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.778 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.778 03:19:59 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.778 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.778 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.778 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.778 03:19:59 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.778 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.778 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.778 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.778 03:19:59 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.778 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.778 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.778 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.778 03:19:59 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.778 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.778 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.778 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.778 03:19:59 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.778 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.778 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.778 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.778 03:19:59 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.778 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.778 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.778 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.778 03:19:59 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.778 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.778 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.778 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.778 03:19:59 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.778 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.778 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.778 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.778 03:19:59 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.778 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.778 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.778 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.778 03:19:59 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.778 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.778 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.778 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.778 03:19:59 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.778 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.778 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.778 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.778 03:19:59 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.778 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.778 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.778 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.778 03:19:59 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.778 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.778 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.778 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.778 03:19:59 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.778 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.778 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.778 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.778 03:19:59 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.778 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.778 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.778 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.778 03:19:59 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.778 03:19:59 -- setup/common.sh@33 -- # echo 0 00:03:18.778 03:19:59 -- setup/common.sh@33 -- # return 0 00:03:18.778 03:19:59 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:18.778 03:19:59 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:18.778 03:19:59 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:18.778 03:19:59 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:18.778 03:19:59 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:18.778 03:19:59 -- setup/common.sh@18 -- # local node=1 00:03:18.778 03:19:59 -- setup/common.sh@19 -- # local var val 00:03:18.778 03:19:59 -- setup/common.sh@20 -- # local mem_f mem 00:03:18.778 03:19:59 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:18.778 03:19:59 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:18.778 03:19:59 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:18.778 03:19:59 -- setup/common.sh@28 -- # mapfile -t mem 00:03:18.778 03:19:59 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:18.778 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.778 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.778 03:19:59 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27660748 kB' 'MemFree: 23705580 kB' 'MemUsed: 3955168 kB' 'SwapCached: 0 kB' 'Active: 1624804 kB' 'Inactive: 535716 kB' 'Active(anon): 1431192 kB' 'Inactive(anon): 0 kB' 'Active(file): 193612 kB' 'Inactive(file): 535716 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 1882316 kB' 'Mapped: 113284 kB' 'AnonPages: 278252 kB' 'Shmem: 1152988 kB' 'KernelStack: 5560 kB' 'PageTables: 3204 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 154228 kB' 'Slab: 352944 kB' 'SReclaimable: 154228 kB' 'SUnreclaim: 198716 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:18.778 03:19:59 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.778 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.778 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.778 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.778 03:19:59 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.778 03:19:59 -- setup/common.sh@32 -- # continue 00:03:18.778 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.778 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.778 03:19:59 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.778 03:19:59 -- setup/common.sh@32 -- # continue 00:03:19.039 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.039 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.039 03:19:59 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.039 03:19:59 -- setup/common.sh@32 -- # continue 00:03:19.039 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.039 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.039 03:19:59 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.039 03:19:59 -- setup/common.sh@32 -- # continue 00:03:19.039 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.039 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.039 03:19:59 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.039 03:19:59 -- setup/common.sh@32 -- # continue 00:03:19.039 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.039 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.039 03:19:59 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.039 03:19:59 -- setup/common.sh@32 -- # continue 00:03:19.039 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.039 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.039 03:19:59 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.039 03:19:59 -- setup/common.sh@32 -- # continue 00:03:19.039 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.039 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.039 03:19:59 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.039 03:19:59 -- setup/common.sh@32 -- # continue 00:03:19.039 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.039 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.039 03:19:59 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.039 03:19:59 -- setup/common.sh@32 -- # continue 00:03:19.039 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.039 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.039 03:19:59 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.039 03:19:59 -- setup/common.sh@32 -- # continue 00:03:19.039 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.039 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.039 03:19:59 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.039 03:19:59 -- setup/common.sh@32 -- # continue 00:03:19.039 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.039 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.039 03:19:59 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.039 03:19:59 -- setup/common.sh@32 -- # continue 00:03:19.039 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.039 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.039 03:19:59 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.039 03:19:59 -- setup/common.sh@32 -- # continue 00:03:19.039 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.039 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.039 03:19:59 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.039 03:19:59 -- setup/common.sh@32 -- # continue 00:03:19.039 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.039 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.039 03:19:59 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.039 03:19:59 -- setup/common.sh@32 -- # continue 00:03:19.039 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.039 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.039 03:19:59 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.039 03:19:59 -- setup/common.sh@32 -- # continue 00:03:19.039 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.039 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.039 03:19:59 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.039 03:19:59 -- setup/common.sh@32 -- # continue 00:03:19.039 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.039 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.039 03:19:59 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.039 03:19:59 -- setup/common.sh@32 -- # continue 00:03:19.039 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.039 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.039 03:19:59 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.039 03:19:59 -- setup/common.sh@32 -- # continue 00:03:19.039 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.039 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.039 03:19:59 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.039 03:19:59 -- setup/common.sh@32 -- # continue 00:03:19.039 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.039 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.039 03:19:59 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.039 03:19:59 -- setup/common.sh@32 -- # continue 00:03:19.039 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.039 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.039 03:19:59 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.039 03:19:59 -- setup/common.sh@32 -- # continue 00:03:19.039 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.039 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.039 03:19:59 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.039 03:19:59 -- setup/common.sh@32 -- # continue 00:03:19.039 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.039 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.039 03:19:59 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.039 03:19:59 -- setup/common.sh@32 -- # continue 00:03:19.039 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.039 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.039 03:19:59 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.039 03:19:59 -- setup/common.sh@32 -- # continue 00:03:19.039 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.039 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.039 03:19:59 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.039 03:19:59 -- setup/common.sh@32 -- # continue 00:03:19.039 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.039 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.039 03:19:59 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.039 03:19:59 -- setup/common.sh@32 -- # continue 00:03:19.039 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.039 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.040 03:19:59 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.040 03:19:59 -- setup/common.sh@32 -- # continue 00:03:19.040 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.040 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.040 03:19:59 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.040 03:19:59 -- setup/common.sh@32 -- # continue 00:03:19.040 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.040 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.040 03:19:59 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.040 03:19:59 -- setup/common.sh@32 -- # continue 00:03:19.040 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.040 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.040 03:19:59 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.040 03:19:59 -- setup/common.sh@32 -- # continue 00:03:19.040 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.040 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.040 03:19:59 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.040 03:19:59 -- setup/common.sh@32 -- # continue 00:03:19.040 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.040 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.040 03:19:59 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.040 03:19:59 -- setup/common.sh@32 -- # continue 00:03:19.040 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.040 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.040 03:19:59 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.040 03:19:59 -- setup/common.sh@32 -- # continue 00:03:19.040 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.040 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.040 03:19:59 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.040 03:19:59 -- setup/common.sh@32 -- # continue 00:03:19.040 03:19:59 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.040 03:19:59 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.040 03:19:59 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.040 03:19:59 -- setup/common.sh@33 -- # echo 0 00:03:19.040 03:19:59 -- setup/common.sh@33 -- # return 0 00:03:19.040 03:19:59 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:19.040 03:19:59 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:19.040 03:19:59 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:19.040 03:19:59 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:19.040 03:19:59 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:03:19.040 node0=512 expecting 512 00:03:19.040 03:19:59 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:19.040 03:19:59 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:19.040 03:19:59 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:19.040 03:19:59 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:03:19.040 node1=512 expecting 512 00:03:19.040 03:19:59 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:03:19.040 00:03:19.040 real 0m1.506s 00:03:19.040 user 0m0.605s 00:03:19.040 sys 0m0.868s 00:03:19.040 03:19:59 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:19.040 03:19:59 -- common/autotest_common.sh@10 -- # set +x 00:03:19.040 ************************************ 00:03:19.040 END TEST even_2G_alloc 00:03:19.040 ************************************ 00:03:19.040 03:19:59 -- setup/hugepages.sh@213 -- # run_test odd_alloc odd_alloc 00:03:19.040 03:19:59 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:19.040 03:19:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:19.040 03:19:59 -- common/autotest_common.sh@10 -- # set +x 00:03:19.040 ************************************ 00:03:19.040 START TEST odd_alloc 00:03:19.040 ************************************ 00:03:19.040 03:19:59 -- common/autotest_common.sh@1114 -- # odd_alloc 00:03:19.040 03:19:59 -- setup/hugepages.sh@159 -- # get_test_nr_hugepages 2098176 00:03:19.040 03:19:59 -- setup/hugepages.sh@49 -- # local size=2098176 00:03:19.040 03:19:59 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:19.040 03:19:59 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:19.040 03:19:59 -- setup/hugepages.sh@57 -- # nr_hugepages=1025 00:03:19.040 03:19:59 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:19.040 03:19:59 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:19.040 03:19:59 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:19.040 03:19:59 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1025 00:03:19.040 03:19:59 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:19.040 03:19:59 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:19.040 03:19:59 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:19.040 03:19:59 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:19.040 03:19:59 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:03:19.040 03:19:59 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:19.040 03:19:59 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:03:19.040 03:19:59 -- setup/hugepages.sh@83 -- # : 513 00:03:19.040 03:19:59 -- setup/hugepages.sh@84 -- # : 1 00:03:19.040 03:19:59 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:19.040 03:19:59 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=513 00:03:19.040 03:19:59 -- setup/hugepages.sh@83 -- # : 0 00:03:19.040 03:19:59 -- setup/hugepages.sh@84 -- # : 0 00:03:19.040 03:19:59 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:19.040 03:19:59 -- setup/hugepages.sh@160 -- # HUGEMEM=2049 00:03:19.040 03:19:59 -- setup/hugepages.sh@160 -- # HUGE_EVEN_ALLOC=yes 00:03:19.040 03:19:59 -- setup/hugepages.sh@160 -- # setup output 00:03:19.040 03:19:59 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:19.040 03:19:59 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:19.979 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:19.979 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:19.979 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:19.979 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:19.979 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:19.979 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:19.979 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:19.979 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:19.979 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:19.979 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:19.979 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:19.979 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:19.979 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:19.979 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:19.979 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:19.979 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:19.979 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:20.243 03:20:00 -- setup/hugepages.sh@161 -- # verify_nr_hugepages 00:03:20.243 03:20:00 -- setup/hugepages.sh@89 -- # local node 00:03:20.243 03:20:00 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:20.243 03:20:00 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:20.243 03:20:00 -- setup/hugepages.sh@92 -- # local surp 00:03:20.243 03:20:00 -- setup/hugepages.sh@93 -- # local resv 00:03:20.243 03:20:00 -- setup/hugepages.sh@94 -- # local anon 00:03:20.243 03:20:00 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:20.243 03:20:00 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:20.243 03:20:00 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:20.243 03:20:00 -- setup/common.sh@18 -- # local node= 00:03:20.243 03:20:00 -- setup/common.sh@19 -- # local var val 00:03:20.243 03:20:00 -- setup/common.sh@20 -- # local mem_f mem 00:03:20.243 03:20:00 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:20.243 03:20:00 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:20.243 03:20:00 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:20.243 03:20:00 -- setup/common.sh@28 -- # mapfile -t mem 00:03:20.243 03:20:00 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:20.243 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.243 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.244 03:20:00 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44514776 kB' 'MemAvailable: 48833116 kB' 'Buffers: 2708 kB' 'Cached: 11073268 kB' 'SwapCached: 0 kB' 'Active: 7476408 kB' 'Inactive: 4089812 kB' 'Active(anon): 7075288 kB' 'Inactive(anon): 0 kB' 'Active(file): 401120 kB' 'Inactive(file): 4089812 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 493548 kB' 'Mapped: 212716 kB' 'Shmem: 6585044 kB' 'KReclaimable: 472040 kB' 'Slab: 1060964 kB' 'SReclaimable: 472040 kB' 'SUnreclaim: 588924 kB' 'KernelStack: 12848 kB' 'PageTables: 8080 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606840 kB' 'Committed_AS: 8159908 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 199840 kB' 'VmallocChunk: 0 kB' 'Percpu: 42432 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 2565724 kB' 'DirectMap2M: 18325504 kB' 'DirectMap1G: 49283072 kB' 00:03:20.244 03:20:00 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.244 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.244 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.244 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.244 03:20:00 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.244 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.244 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.244 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.244 03:20:00 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.244 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.244 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.244 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.244 03:20:00 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.244 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.244 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.244 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.244 03:20:00 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.244 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.244 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.244 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.244 03:20:00 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.244 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.244 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.244 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.244 03:20:00 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.244 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.244 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.244 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.244 03:20:00 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.244 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.244 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.244 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.244 03:20:00 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.244 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.244 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.244 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.244 03:20:00 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.244 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.244 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.244 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.244 03:20:00 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.244 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.244 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.244 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.244 03:20:00 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.244 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.244 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.244 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.244 03:20:00 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.244 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.244 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.244 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.244 03:20:00 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.244 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.244 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.244 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.244 03:20:00 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.244 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.244 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.244 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.244 03:20:00 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.244 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.244 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.244 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.244 03:20:00 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.244 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.244 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.244 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.244 03:20:00 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.244 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.244 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.244 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.244 03:20:00 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.244 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.244 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.244 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.244 03:20:00 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.244 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.244 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.244 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.244 03:20:00 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.244 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.244 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.244 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.244 03:20:00 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.244 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.244 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.244 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.244 03:20:00 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.244 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.244 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.244 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.244 03:20:00 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.244 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.244 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.244 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.244 03:20:00 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.244 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.244 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.244 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.244 03:20:00 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.244 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.244 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.244 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.244 03:20:00 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.244 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.244 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.244 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.244 03:20:00 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.244 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.244 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.244 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.244 03:20:00 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.244 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.244 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.245 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.245 03:20:00 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.245 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.245 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.245 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.245 03:20:00 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.245 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.245 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.245 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.245 03:20:00 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.245 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.245 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.245 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.245 03:20:00 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.245 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.245 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.245 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.245 03:20:00 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.245 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.245 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.245 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.245 03:20:00 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.245 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.245 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.245 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.245 03:20:00 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.245 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.245 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.245 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.245 03:20:00 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.245 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.245 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.245 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.245 03:20:00 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.245 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.245 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.245 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.245 03:20:00 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.245 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.245 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.245 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.245 03:20:00 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.245 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.245 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.245 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.245 03:20:00 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.245 03:20:00 -- setup/common.sh@33 -- # echo 0 00:03:20.245 03:20:00 -- setup/common.sh@33 -- # return 0 00:03:20.245 03:20:00 -- setup/hugepages.sh@97 -- # anon=0 00:03:20.245 03:20:00 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:20.245 03:20:00 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:20.245 03:20:00 -- setup/common.sh@18 -- # local node= 00:03:20.245 03:20:00 -- setup/common.sh@19 -- # local var val 00:03:20.245 03:20:00 -- setup/common.sh@20 -- # local mem_f mem 00:03:20.245 03:20:00 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:20.245 03:20:00 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:20.245 03:20:00 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:20.245 03:20:00 -- setup/common.sh@28 -- # mapfile -t mem 00:03:20.245 03:20:00 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:20.245 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.245 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.245 03:20:00 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44516764 kB' 'MemAvailable: 48835104 kB' 'Buffers: 2708 kB' 'Cached: 11073268 kB' 'SwapCached: 0 kB' 'Active: 7476720 kB' 'Inactive: 4089812 kB' 'Active(anon): 7075600 kB' 'Inactive(anon): 0 kB' 'Active(file): 401120 kB' 'Inactive(file): 4089812 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 493836 kB' 'Mapped: 212792 kB' 'Shmem: 6585044 kB' 'KReclaimable: 472040 kB' 'Slab: 1061012 kB' 'SReclaimable: 472040 kB' 'SUnreclaim: 588972 kB' 'KernelStack: 12800 kB' 'PageTables: 7940 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606840 kB' 'Committed_AS: 8159920 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 199808 kB' 'VmallocChunk: 0 kB' 'Percpu: 42432 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 2565724 kB' 'DirectMap2M: 18325504 kB' 'DirectMap1G: 49283072 kB' 00:03:20.245 03:20:00 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.245 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.245 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.245 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.245 03:20:00 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.245 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.245 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.245 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.245 03:20:00 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.245 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.245 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.245 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.245 03:20:00 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.245 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.245 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.245 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.245 03:20:00 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.245 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.245 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.245 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.245 03:20:00 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.245 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.245 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.245 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.245 03:20:00 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.245 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.245 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.245 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.245 03:20:00 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.245 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.245 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.245 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.245 03:20:00 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.245 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.245 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.245 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.245 03:20:00 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.245 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.245 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.246 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.246 03:20:00 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.246 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.246 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.246 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.246 03:20:00 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.246 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.246 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.246 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.246 03:20:00 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.246 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.246 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.246 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.246 03:20:00 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.246 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.246 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.246 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.246 03:20:00 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.246 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.246 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.246 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.246 03:20:00 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.246 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.246 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.246 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.246 03:20:00 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.246 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.246 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.246 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.246 03:20:00 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.246 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.246 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.246 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.246 03:20:00 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.246 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.246 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.246 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.246 03:20:00 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.246 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.246 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.246 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.246 03:20:00 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.246 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.246 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.246 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.246 03:20:00 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.246 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.246 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.246 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.246 03:20:00 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.246 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.246 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.246 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.246 03:20:00 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.246 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.246 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.246 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.246 03:20:00 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.246 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.246 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.246 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.246 03:20:00 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.246 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.246 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.246 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.246 03:20:00 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.246 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.246 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.246 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.246 03:20:00 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.246 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.246 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.246 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.246 03:20:00 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.246 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.246 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.246 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.246 03:20:00 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.246 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.246 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.246 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.246 03:20:00 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.246 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.246 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.246 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.246 03:20:00 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.246 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.246 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.246 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.246 03:20:00 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.246 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.246 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.246 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.246 03:20:00 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.246 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.246 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.246 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.246 03:20:00 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.246 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.246 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.246 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.246 03:20:00 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.246 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.246 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.246 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.246 03:20:00 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.246 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.246 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.246 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.246 03:20:00 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.246 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.246 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.246 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.246 03:20:00 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.246 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.246 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.247 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.247 03:20:00 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.247 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.247 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.247 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.247 03:20:00 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.247 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.247 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.247 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.247 03:20:00 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.247 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.247 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.247 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.247 03:20:00 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.247 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.247 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.247 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.247 03:20:00 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.247 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.247 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.247 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.247 03:20:00 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.247 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.247 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.247 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.247 03:20:00 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.247 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.247 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.247 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.247 03:20:00 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.247 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.247 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.247 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.247 03:20:00 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.247 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.247 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.247 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.247 03:20:00 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.247 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.247 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.247 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.247 03:20:00 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.247 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.247 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.247 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.247 03:20:00 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.247 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.247 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.247 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.247 03:20:00 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.247 03:20:00 -- setup/common.sh@33 -- # echo 0 00:03:20.247 03:20:00 -- setup/common.sh@33 -- # return 0 00:03:20.247 03:20:00 -- setup/hugepages.sh@99 -- # surp=0 00:03:20.247 03:20:00 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:20.247 03:20:00 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:20.247 03:20:00 -- setup/common.sh@18 -- # local node= 00:03:20.247 03:20:00 -- setup/common.sh@19 -- # local var val 00:03:20.247 03:20:00 -- setup/common.sh@20 -- # local mem_f mem 00:03:20.247 03:20:00 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:20.247 03:20:00 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:20.247 03:20:00 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:20.247 03:20:00 -- setup/common.sh@28 -- # mapfile -t mem 00:03:20.247 03:20:00 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:20.247 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.247 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.247 03:20:00 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44516260 kB' 'MemAvailable: 48834600 kB' 'Buffers: 2708 kB' 'Cached: 11073284 kB' 'SwapCached: 0 kB' 'Active: 7476352 kB' 'Inactive: 4089812 kB' 'Active(anon): 7075232 kB' 'Inactive(anon): 0 kB' 'Active(file): 401120 kB' 'Inactive(file): 4089812 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 493456 kB' 'Mapped: 212620 kB' 'Shmem: 6585060 kB' 'KReclaimable: 472040 kB' 'Slab: 1061012 kB' 'SReclaimable: 472040 kB' 'SUnreclaim: 588972 kB' 'KernelStack: 12864 kB' 'PageTables: 8036 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606840 kB' 'Committed_AS: 8159936 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 199824 kB' 'VmallocChunk: 0 kB' 'Percpu: 42432 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 2565724 kB' 'DirectMap2M: 18325504 kB' 'DirectMap1G: 49283072 kB' 00:03:20.247 03:20:00 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.247 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.247 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.247 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.247 03:20:00 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.247 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.247 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.247 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.247 03:20:00 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.247 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.247 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.247 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.247 03:20:00 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.247 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.247 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.247 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.247 03:20:00 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.247 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.247 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.247 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.247 03:20:00 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.247 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.247 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.247 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.247 03:20:00 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.247 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.247 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.247 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.247 03:20:00 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.247 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.247 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.247 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.247 03:20:00 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.247 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.247 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.247 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.247 03:20:00 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.247 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.247 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.247 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.247 03:20:00 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.247 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.247 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.248 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.248 03:20:00 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.248 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.248 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.248 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.248 03:20:00 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.248 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.248 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.248 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.248 03:20:00 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.248 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.248 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.248 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.248 03:20:00 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.248 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.248 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.248 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.248 03:20:00 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.248 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.248 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.248 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.248 03:20:00 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.248 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.248 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.248 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.248 03:20:00 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.248 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.248 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.248 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.248 03:20:00 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.248 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.248 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.248 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.248 03:20:00 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.248 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.248 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.248 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.248 03:20:00 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.248 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.248 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.248 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.248 03:20:00 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.248 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.248 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.248 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.248 03:20:00 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.248 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.248 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.248 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.248 03:20:00 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.248 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.248 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.248 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.248 03:20:00 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.248 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.248 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.248 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.248 03:20:00 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.248 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.248 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.248 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.248 03:20:00 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.248 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.248 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.248 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.248 03:20:00 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.248 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.248 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.248 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.248 03:20:00 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.248 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.248 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.248 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.248 03:20:00 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.248 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.248 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.248 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.248 03:20:00 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.248 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.248 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.248 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.248 03:20:00 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.248 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.248 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.248 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.248 03:20:00 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.248 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.248 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.248 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.248 03:20:00 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.248 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.248 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.248 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.248 03:20:00 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.248 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.248 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.248 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.248 03:20:00 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.248 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.248 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.248 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.248 03:20:00 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.248 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.248 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.248 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.248 03:20:00 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.248 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.248 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.248 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.248 03:20:00 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.248 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.248 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.248 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.248 03:20:00 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.248 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.248 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.248 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.248 03:20:00 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.248 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.248 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.248 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.248 03:20:00 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.248 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.248 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.248 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.248 03:20:00 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.248 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.248 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.248 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.249 03:20:00 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.249 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.249 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.249 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.249 03:20:00 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.249 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.249 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.249 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.249 03:20:00 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.249 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.249 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.249 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.249 03:20:00 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.249 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.249 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.249 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.249 03:20:00 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.249 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.249 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.249 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.249 03:20:00 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.249 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.249 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.249 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.249 03:20:00 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.249 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.249 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.249 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.249 03:20:00 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.249 03:20:00 -- setup/common.sh@33 -- # echo 0 00:03:20.249 03:20:00 -- setup/common.sh@33 -- # return 0 00:03:20.249 03:20:00 -- setup/hugepages.sh@100 -- # resv=0 00:03:20.249 03:20:00 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1025 00:03:20.249 nr_hugepages=1025 00:03:20.249 03:20:00 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:20.249 resv_hugepages=0 00:03:20.249 03:20:00 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:20.249 surplus_hugepages=0 00:03:20.249 03:20:00 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:20.249 anon_hugepages=0 00:03:20.249 03:20:00 -- setup/hugepages.sh@107 -- # (( 1025 == nr_hugepages + surp + resv )) 00:03:20.249 03:20:00 -- setup/hugepages.sh@109 -- # (( 1025 == nr_hugepages )) 00:03:20.249 03:20:00 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:20.249 03:20:00 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:20.249 03:20:00 -- setup/common.sh@18 -- # local node= 00:03:20.249 03:20:00 -- setup/common.sh@19 -- # local var val 00:03:20.249 03:20:00 -- setup/common.sh@20 -- # local mem_f mem 00:03:20.249 03:20:00 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:20.249 03:20:00 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:20.249 03:20:00 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:20.249 03:20:00 -- setup/common.sh@28 -- # mapfile -t mem 00:03:20.249 03:20:00 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:20.249 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.249 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.249 03:20:00 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44516532 kB' 'MemAvailable: 48834872 kB' 'Buffers: 2708 kB' 'Cached: 11073296 kB' 'SwapCached: 0 kB' 'Active: 7476128 kB' 'Inactive: 4089812 kB' 'Active(anon): 7075008 kB' 'Inactive(anon): 0 kB' 'Active(file): 401120 kB' 'Inactive(file): 4089812 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 493148 kB' 'Mapped: 212544 kB' 'Shmem: 6585072 kB' 'KReclaimable: 472040 kB' 'Slab: 1061004 kB' 'SReclaimable: 472040 kB' 'SUnreclaim: 588964 kB' 'KernelStack: 12864 kB' 'PageTables: 8032 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606840 kB' 'Committed_AS: 8159948 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 199824 kB' 'VmallocChunk: 0 kB' 'Percpu: 42432 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 2565724 kB' 'DirectMap2M: 18325504 kB' 'DirectMap1G: 49283072 kB' 00:03:20.249 03:20:00 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.249 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.249 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.249 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.249 03:20:00 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.249 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.249 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.249 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.249 03:20:00 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.249 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.249 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.249 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.249 03:20:00 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.249 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.249 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.249 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.249 03:20:00 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.249 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.249 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.249 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.249 03:20:00 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.249 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.249 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.249 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.249 03:20:00 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.249 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.249 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.249 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.249 03:20:00 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.249 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.249 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.249 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.249 03:20:00 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.249 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.249 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.249 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.249 03:20:00 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.249 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.250 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.250 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.250 03:20:00 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.250 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.250 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.250 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.250 03:20:00 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.250 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.250 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.250 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.250 03:20:00 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.250 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.250 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.250 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.250 03:20:00 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.250 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.250 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.250 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.250 03:20:00 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.250 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.250 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.250 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.250 03:20:00 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.250 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.250 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.250 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.250 03:20:00 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.250 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.250 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.250 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.250 03:20:00 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.250 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.250 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.250 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.250 03:20:00 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.250 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.250 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.250 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.250 03:20:00 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.250 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.250 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.250 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.250 03:20:00 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.250 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.250 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.250 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.250 03:20:00 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.250 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.250 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.250 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.250 03:20:00 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.250 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.250 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.250 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.250 03:20:00 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.250 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.250 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.250 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.250 03:20:00 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.250 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.250 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.250 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.250 03:20:00 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.250 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.250 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.250 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.250 03:20:00 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.250 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.250 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.250 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.250 03:20:00 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.250 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.250 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.250 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.250 03:20:00 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.250 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.250 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.250 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.250 03:20:00 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.250 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.250 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.250 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.250 03:20:00 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.250 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.250 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.250 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.250 03:20:00 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.250 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.250 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.250 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.250 03:20:00 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.250 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.250 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.250 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.250 03:20:00 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.250 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.250 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.250 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.250 03:20:00 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.250 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.250 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.250 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.250 03:20:00 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.250 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.250 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.250 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.250 03:20:00 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.250 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.250 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.250 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.250 03:20:00 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.250 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.250 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.250 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.250 03:20:00 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.250 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.250 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.251 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.251 03:20:00 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.251 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.251 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.251 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.251 03:20:00 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.251 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.251 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.251 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.251 03:20:00 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.251 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.251 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.251 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.251 03:20:00 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.251 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.251 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.251 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.251 03:20:00 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.251 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.251 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.251 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.251 03:20:00 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.251 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.251 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.251 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.251 03:20:00 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.251 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.251 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.251 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.251 03:20:00 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.251 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.251 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.251 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.251 03:20:00 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.251 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.251 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.251 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.251 03:20:00 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.251 03:20:00 -- setup/common.sh@33 -- # echo 1025 00:03:20.251 03:20:00 -- setup/common.sh@33 -- # return 0 00:03:20.251 03:20:00 -- setup/hugepages.sh@110 -- # (( 1025 == nr_hugepages + surp + resv )) 00:03:20.251 03:20:00 -- setup/hugepages.sh@112 -- # get_nodes 00:03:20.251 03:20:00 -- setup/hugepages.sh@27 -- # local node 00:03:20.251 03:20:00 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:20.251 03:20:00 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:20.251 03:20:00 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:20.251 03:20:00 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=513 00:03:20.251 03:20:00 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:20.251 03:20:00 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:20.251 03:20:00 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:20.251 03:20:00 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:20.251 03:20:00 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:20.251 03:20:00 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:20.251 03:20:00 -- setup/common.sh@18 -- # local node=0 00:03:20.251 03:20:00 -- setup/common.sh@19 -- # local var val 00:03:20.251 03:20:00 -- setup/common.sh@20 -- # local mem_f mem 00:03:20.251 03:20:00 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:20.251 03:20:00 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:20.251 03:20:00 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:20.251 03:20:00 -- setup/common.sh@28 -- # mapfile -t mem 00:03:20.251 03:20:00 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:20.251 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.251 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.251 03:20:00 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 20811824 kB' 'MemUsed: 12063100 kB' 'SwapCached: 0 kB' 'Active: 5852148 kB' 'Inactive: 3554096 kB' 'Active(anon): 5644640 kB' 'Inactive(anon): 0 kB' 'Active(file): 207508 kB' 'Inactive(file): 3554096 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 9193632 kB' 'Mapped: 99488 kB' 'AnonPages: 215824 kB' 'Shmem: 5432028 kB' 'KernelStack: 7368 kB' 'PageTables: 5028 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 317812 kB' 'Slab: 708188 kB' 'SReclaimable: 317812 kB' 'SUnreclaim: 390376 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:20.251 03:20:00 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.251 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.251 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.251 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.251 03:20:00 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.251 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.251 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.251 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.251 03:20:00 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.251 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.251 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.251 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.251 03:20:00 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.251 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.251 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.251 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.251 03:20:00 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.251 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.251 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.251 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.251 03:20:00 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.251 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.251 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.251 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.251 03:20:00 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.251 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.251 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.251 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.251 03:20:00 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.251 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.251 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.251 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.251 03:20:00 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.251 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.251 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.251 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.251 03:20:00 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.251 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.251 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.251 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.252 03:20:00 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.252 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.252 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.252 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.252 03:20:00 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.252 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.252 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.252 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.252 03:20:00 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.252 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.252 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.252 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.252 03:20:00 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.252 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.252 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.252 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.252 03:20:00 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.252 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.252 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.252 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.252 03:20:00 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.252 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.252 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.252 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.252 03:20:00 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.252 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.252 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.252 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.252 03:20:00 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.252 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.252 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.252 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.252 03:20:00 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.252 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.252 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.252 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.252 03:20:00 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.252 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.252 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.252 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.252 03:20:00 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.252 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.252 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.252 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.252 03:20:00 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.252 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.252 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.252 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.252 03:20:00 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.252 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.252 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.252 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.252 03:20:00 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.252 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.252 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.252 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.252 03:20:00 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.252 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.252 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.252 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.252 03:20:00 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.252 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.252 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.252 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.252 03:20:00 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.252 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.252 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.252 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.252 03:20:00 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.252 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.252 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.252 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.252 03:20:00 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.252 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.252 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.252 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.252 03:20:00 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.252 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.252 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.252 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.252 03:20:00 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.252 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.252 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.252 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.252 03:20:00 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.252 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.252 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.252 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.252 03:20:00 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.252 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.252 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.252 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.252 03:20:00 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.252 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.252 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.252 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.252 03:20:00 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.252 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.252 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.252 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.252 03:20:00 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.252 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.252 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.252 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.252 03:20:00 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.252 03:20:00 -- setup/common.sh@33 -- # echo 0 00:03:20.252 03:20:00 -- setup/common.sh@33 -- # return 0 00:03:20.252 03:20:00 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:20.252 03:20:00 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:20.252 03:20:00 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:20.252 03:20:00 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:20.252 03:20:00 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:20.252 03:20:00 -- setup/common.sh@18 -- # local node=1 00:03:20.252 03:20:00 -- setup/common.sh@19 -- # local var val 00:03:20.252 03:20:00 -- setup/common.sh@20 -- # local mem_f mem 00:03:20.252 03:20:00 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:20.252 03:20:00 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:20.252 03:20:00 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:20.252 03:20:00 -- setup/common.sh@28 -- # mapfile -t mem 00:03:20.252 03:20:00 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:20.252 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.252 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.253 03:20:00 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27660748 kB' 'MemFree: 23705464 kB' 'MemUsed: 3955284 kB' 'SwapCached: 0 kB' 'Active: 1624636 kB' 'Inactive: 535716 kB' 'Active(anon): 1431024 kB' 'Inactive(anon): 0 kB' 'Active(file): 193612 kB' 'Inactive(file): 535716 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 1882400 kB' 'Mapped: 113056 kB' 'AnonPages: 278068 kB' 'Shmem: 1153072 kB' 'KernelStack: 5528 kB' 'PageTables: 3128 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 154228 kB' 'Slab: 352816 kB' 'SReclaimable: 154228 kB' 'SUnreclaim: 198588 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 513' 'HugePages_Free: 513' 'HugePages_Surp: 0' 00:03:20.253 03:20:00 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.253 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.253 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.253 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.253 03:20:00 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.253 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.253 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.253 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.253 03:20:00 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.253 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.253 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.253 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.253 03:20:00 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.253 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.253 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.253 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.253 03:20:00 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.253 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.253 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.253 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.253 03:20:00 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.253 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.253 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.253 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.253 03:20:00 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.253 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.253 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.253 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.253 03:20:00 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.253 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.253 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.253 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.253 03:20:00 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.253 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.253 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.253 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.253 03:20:00 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.253 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.253 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.253 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.253 03:20:00 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.253 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.253 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.253 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.253 03:20:00 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.253 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.253 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.253 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.253 03:20:00 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.253 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.253 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.253 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.253 03:20:00 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.253 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.253 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.253 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.253 03:20:00 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.253 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.253 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.253 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.253 03:20:00 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.253 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.253 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.253 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.253 03:20:00 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.253 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.253 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.253 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.253 03:20:00 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.253 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.253 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.253 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.253 03:20:00 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.253 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.253 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.253 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.253 03:20:00 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.253 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.253 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.253 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.253 03:20:00 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.253 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.253 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.253 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.253 03:20:00 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.253 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.253 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.253 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.253 03:20:00 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.253 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.253 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.253 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.253 03:20:00 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.253 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.253 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.253 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.253 03:20:00 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.253 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.253 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.253 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.253 03:20:00 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.253 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.253 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.253 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.253 03:20:00 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.253 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.253 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.253 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.253 03:20:00 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.253 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.253 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.253 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.253 03:20:00 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.254 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.254 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.254 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.254 03:20:00 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.254 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.254 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.254 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.254 03:20:00 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.254 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.254 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.254 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.254 03:20:00 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.254 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.254 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.254 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.254 03:20:00 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.254 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.254 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.254 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.254 03:20:00 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.254 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.254 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.254 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.254 03:20:00 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.254 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.254 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.254 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.254 03:20:00 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.254 03:20:00 -- setup/common.sh@32 -- # continue 00:03:20.254 03:20:00 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.254 03:20:00 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.254 03:20:00 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.254 03:20:00 -- setup/common.sh@33 -- # echo 0 00:03:20.254 03:20:00 -- setup/common.sh@33 -- # return 0 00:03:20.254 03:20:00 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:20.254 03:20:00 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:20.254 03:20:00 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:20.254 03:20:00 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:20.254 03:20:00 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 513' 00:03:20.254 node0=512 expecting 513 00:03:20.254 03:20:00 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:20.254 03:20:00 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:20.254 03:20:00 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:20.254 03:20:00 -- setup/hugepages.sh@128 -- # echo 'node1=513 expecting 512' 00:03:20.254 node1=513 expecting 512 00:03:20.254 03:20:00 -- setup/hugepages.sh@130 -- # [[ 512 513 == \5\1\2\ \5\1\3 ]] 00:03:20.254 00:03:20.254 real 0m1.423s 00:03:20.254 user 0m0.594s 00:03:20.254 sys 0m0.793s 00:03:20.254 03:20:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:20.254 03:20:00 -- common/autotest_common.sh@10 -- # set +x 00:03:20.254 ************************************ 00:03:20.254 END TEST odd_alloc 00:03:20.254 ************************************ 00:03:20.514 03:20:00 -- setup/hugepages.sh@214 -- # run_test custom_alloc custom_alloc 00:03:20.514 03:20:00 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:20.514 03:20:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:20.514 03:20:00 -- common/autotest_common.sh@10 -- # set +x 00:03:20.514 ************************************ 00:03:20.514 START TEST custom_alloc 00:03:20.514 ************************************ 00:03:20.514 03:20:00 -- common/autotest_common.sh@1114 -- # custom_alloc 00:03:20.514 03:20:00 -- setup/hugepages.sh@167 -- # local IFS=, 00:03:20.514 03:20:00 -- setup/hugepages.sh@169 -- # local node 00:03:20.514 03:20:00 -- setup/hugepages.sh@170 -- # nodes_hp=() 00:03:20.514 03:20:00 -- setup/hugepages.sh@170 -- # local nodes_hp 00:03:20.514 03:20:00 -- setup/hugepages.sh@172 -- # local nr_hugepages=0 _nr_hugepages=0 00:03:20.514 03:20:00 -- setup/hugepages.sh@174 -- # get_test_nr_hugepages 1048576 00:03:20.514 03:20:00 -- setup/hugepages.sh@49 -- # local size=1048576 00:03:20.514 03:20:00 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:20.514 03:20:00 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:20.514 03:20:00 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:03:20.514 03:20:00 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:20.514 03:20:00 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:20.514 03:20:00 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:20.514 03:20:00 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:03:20.514 03:20:00 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:20.514 03:20:00 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:20.514 03:20:00 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:20.514 03:20:00 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:20.514 03:20:00 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:03:20.514 03:20:00 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:20.515 03:20:00 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:03:20.515 03:20:00 -- setup/hugepages.sh@83 -- # : 256 00:03:20.515 03:20:00 -- setup/hugepages.sh@84 -- # : 1 00:03:20.515 03:20:00 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:20.515 03:20:00 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:03:20.515 03:20:00 -- setup/hugepages.sh@83 -- # : 0 00:03:20.515 03:20:00 -- setup/hugepages.sh@84 -- # : 0 00:03:20.515 03:20:00 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:20.515 03:20:00 -- setup/hugepages.sh@175 -- # nodes_hp[0]=512 00:03:20.515 03:20:00 -- setup/hugepages.sh@176 -- # (( 2 > 1 )) 00:03:20.515 03:20:00 -- setup/hugepages.sh@177 -- # get_test_nr_hugepages 2097152 00:03:20.515 03:20:00 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:20.515 03:20:00 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:20.515 03:20:00 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:20.515 03:20:00 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:20.515 03:20:00 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:20.515 03:20:00 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:20.515 03:20:00 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:20.515 03:20:00 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:20.515 03:20:00 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:20.515 03:20:00 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:20.515 03:20:00 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:20.515 03:20:00 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:20.515 03:20:00 -- setup/hugepages.sh@74 -- # (( 1 > 0 )) 00:03:20.515 03:20:00 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:03:20.515 03:20:00 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:03:20.515 03:20:00 -- setup/hugepages.sh@78 -- # return 0 00:03:20.515 03:20:00 -- setup/hugepages.sh@178 -- # nodes_hp[1]=1024 00:03:20.515 03:20:00 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:03:20.515 03:20:00 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:03:20.515 03:20:00 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:03:20.515 03:20:00 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:03:20.515 03:20:00 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:03:20.515 03:20:00 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:03:20.515 03:20:00 -- setup/hugepages.sh@186 -- # get_test_nr_hugepages_per_node 00:03:20.515 03:20:00 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:20.515 03:20:00 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:20.515 03:20:00 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:20.515 03:20:00 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:20.515 03:20:00 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:20.515 03:20:00 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:20.515 03:20:00 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:20.515 03:20:00 -- setup/hugepages.sh@74 -- # (( 2 > 0 )) 00:03:20.515 03:20:00 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:03:20.515 03:20:00 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:03:20.515 03:20:00 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:03:20.515 03:20:00 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=1024 00:03:20.515 03:20:00 -- setup/hugepages.sh@78 -- # return 0 00:03:20.515 03:20:00 -- setup/hugepages.sh@187 -- # HUGENODE='nodes_hp[0]=512,nodes_hp[1]=1024' 00:03:20.515 03:20:00 -- setup/hugepages.sh@187 -- # setup output 00:03:20.515 03:20:00 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:20.515 03:20:00 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:21.462 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:21.462 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:21.462 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:21.462 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:21.462 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:21.462 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:21.462 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:21.462 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:21.462 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:21.462 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:21.462 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:21.462 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:21.462 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:21.462 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:21.462 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:21.462 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:21.462 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:21.727 03:20:02 -- setup/hugepages.sh@188 -- # nr_hugepages=1536 00:03:21.727 03:20:02 -- setup/hugepages.sh@188 -- # verify_nr_hugepages 00:03:21.727 03:20:02 -- setup/hugepages.sh@89 -- # local node 00:03:21.727 03:20:02 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:21.727 03:20:02 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:21.727 03:20:02 -- setup/hugepages.sh@92 -- # local surp 00:03:21.727 03:20:02 -- setup/hugepages.sh@93 -- # local resv 00:03:21.727 03:20:02 -- setup/hugepages.sh@94 -- # local anon 00:03:21.727 03:20:02 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:21.727 03:20:02 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:21.727 03:20:02 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:21.727 03:20:02 -- setup/common.sh@18 -- # local node= 00:03:21.727 03:20:02 -- setup/common.sh@19 -- # local var val 00:03:21.727 03:20:02 -- setup/common.sh@20 -- # local mem_f mem 00:03:21.727 03:20:02 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:21.727 03:20:02 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:21.727 03:20:02 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:21.727 03:20:02 -- setup/common.sh@28 -- # mapfile -t mem 00:03:21.727 03:20:02 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:21.727 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.727 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.727 03:20:02 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 43465268 kB' 'MemAvailable: 47783608 kB' 'Buffers: 2708 kB' 'Cached: 11073364 kB' 'SwapCached: 0 kB' 'Active: 7476040 kB' 'Inactive: 4089812 kB' 'Active(anon): 7074920 kB' 'Inactive(anon): 0 kB' 'Active(file): 401120 kB' 'Inactive(file): 4089812 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 493056 kB' 'Mapped: 212508 kB' 'Shmem: 6585140 kB' 'KReclaimable: 472040 kB' 'Slab: 1061228 kB' 'SReclaimable: 472040 kB' 'SUnreclaim: 589188 kB' 'KernelStack: 12864 kB' 'PageTables: 7980 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083576 kB' 'Committed_AS: 8159768 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 199920 kB' 'VmallocChunk: 0 kB' 'Percpu: 42432 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 2565724 kB' 'DirectMap2M: 18325504 kB' 'DirectMap1G: 49283072 kB' 00:03:21.727 03:20:02 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.727 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.727 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.727 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.727 03:20:02 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.727 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.727 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.727 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.727 03:20:02 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.727 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.727 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.727 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.727 03:20:02 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.727 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.727 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.727 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.727 03:20:02 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.727 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.727 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.727 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.727 03:20:02 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.727 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.727 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.727 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.727 03:20:02 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.727 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.727 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.727 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.727 03:20:02 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.727 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.727 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.727 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.727 03:20:02 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.727 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.727 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.727 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.727 03:20:02 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.727 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.727 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.727 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.727 03:20:02 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.727 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.727 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.727 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.727 03:20:02 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.727 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.727 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.727 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.728 03:20:02 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.728 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.728 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.728 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.728 03:20:02 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.728 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.728 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.728 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.728 03:20:02 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.728 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.728 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.728 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.728 03:20:02 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.728 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.728 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.728 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.728 03:20:02 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.728 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.728 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.728 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.728 03:20:02 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.728 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.728 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.728 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.728 03:20:02 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.728 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.728 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.728 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.728 03:20:02 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.728 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.728 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.728 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.728 03:20:02 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.728 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.728 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.728 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.728 03:20:02 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.728 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.728 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.728 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.728 03:20:02 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.728 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.728 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.728 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.728 03:20:02 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.728 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.728 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.728 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.728 03:20:02 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.728 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.728 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.728 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.728 03:20:02 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.728 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.728 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.728 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.728 03:20:02 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.728 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.728 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.728 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.728 03:20:02 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.728 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.728 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.728 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.728 03:20:02 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.728 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.728 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.728 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.728 03:20:02 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.728 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.728 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.728 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.728 03:20:02 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.728 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.728 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.728 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.728 03:20:02 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.728 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.728 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.728 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.728 03:20:02 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.728 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.728 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.728 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.728 03:20:02 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.728 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.728 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.728 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.728 03:20:02 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.728 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.728 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.728 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.728 03:20:02 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.728 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.728 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.728 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.728 03:20:02 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.728 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.728 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.728 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.728 03:20:02 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.728 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.728 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.728 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.728 03:20:02 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.728 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.728 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.728 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.728 03:20:02 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.728 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.728 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.729 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.729 03:20:02 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.729 03:20:02 -- setup/common.sh@33 -- # echo 0 00:03:21.729 03:20:02 -- setup/common.sh@33 -- # return 0 00:03:21.729 03:20:02 -- setup/hugepages.sh@97 -- # anon=0 00:03:21.729 03:20:02 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:21.729 03:20:02 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:21.729 03:20:02 -- setup/common.sh@18 -- # local node= 00:03:21.729 03:20:02 -- setup/common.sh@19 -- # local var val 00:03:21.729 03:20:02 -- setup/common.sh@20 -- # local mem_f mem 00:03:21.729 03:20:02 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:21.729 03:20:02 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:21.729 03:20:02 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:21.729 03:20:02 -- setup/common.sh@28 -- # mapfile -t mem 00:03:21.729 03:20:02 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:21.729 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.729 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.729 03:20:02 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 43469056 kB' 'MemAvailable: 47787396 kB' 'Buffers: 2708 kB' 'Cached: 11073368 kB' 'SwapCached: 0 kB' 'Active: 7476560 kB' 'Inactive: 4089812 kB' 'Active(anon): 7075440 kB' 'Inactive(anon): 0 kB' 'Active(file): 401120 kB' 'Inactive(file): 4089812 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 493596 kB' 'Mapped: 212508 kB' 'Shmem: 6585144 kB' 'KReclaimable: 472040 kB' 'Slab: 1061208 kB' 'SReclaimable: 472040 kB' 'SUnreclaim: 589168 kB' 'KernelStack: 12848 kB' 'PageTables: 7928 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083576 kB' 'Committed_AS: 8159784 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 199872 kB' 'VmallocChunk: 0 kB' 'Percpu: 42432 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 2565724 kB' 'DirectMap2M: 18325504 kB' 'DirectMap1G: 49283072 kB' 00:03:21.729 03:20:02 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.729 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.729 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.729 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.729 03:20:02 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.729 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.729 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.729 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.729 03:20:02 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.729 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.729 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.729 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.729 03:20:02 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.729 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.729 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.729 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.729 03:20:02 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.729 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.729 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.729 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.729 03:20:02 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.729 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.729 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.729 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.729 03:20:02 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.729 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.729 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.729 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.729 03:20:02 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.729 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.729 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.729 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.729 03:20:02 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.729 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.729 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.729 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.729 03:20:02 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.729 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.729 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.729 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.729 03:20:02 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.729 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.729 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.729 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.729 03:20:02 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.729 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.729 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.729 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.729 03:20:02 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.729 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.729 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.729 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.729 03:20:02 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.729 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.729 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.729 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.729 03:20:02 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.729 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.729 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.729 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.729 03:20:02 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.729 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.729 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.729 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.729 03:20:02 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.729 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.729 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.729 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.729 03:20:02 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.729 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.729 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.729 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.729 03:20:02 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.729 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.729 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.729 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.729 03:20:02 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.729 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.729 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.729 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.729 03:20:02 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.729 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.729 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.729 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.729 03:20:02 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.729 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.729 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.729 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.729 03:20:02 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.729 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.729 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.729 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.729 03:20:02 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.729 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.729 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.730 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.730 03:20:02 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.730 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.730 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.730 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.730 03:20:02 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.730 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.730 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.730 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.730 03:20:02 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.730 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.730 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.730 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.730 03:20:02 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.730 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.730 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.730 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.730 03:20:02 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.730 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.730 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.730 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.730 03:20:02 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.730 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.730 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.730 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.730 03:20:02 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.730 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.730 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.730 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.730 03:20:02 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.730 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.730 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.730 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.730 03:20:02 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.730 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.730 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.730 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.730 03:20:02 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.730 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.730 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.730 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.730 03:20:02 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.730 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.730 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.730 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.730 03:20:02 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.730 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.730 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.730 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.730 03:20:02 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.730 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.730 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.730 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.730 03:20:02 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.730 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.730 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.730 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.730 03:20:02 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.730 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.730 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.730 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.730 03:20:02 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.730 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.730 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.730 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.730 03:20:02 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.730 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.730 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.730 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.730 03:20:02 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.730 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.730 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.730 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.730 03:20:02 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.730 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.730 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.730 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.730 03:20:02 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.730 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.730 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.730 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.730 03:20:02 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.730 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.730 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.730 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.730 03:20:02 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.730 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.730 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.730 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.730 03:20:02 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.730 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.730 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.730 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.730 03:20:02 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.730 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.730 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.730 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.730 03:20:02 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.730 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.730 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.730 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.730 03:20:02 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.730 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.730 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.730 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.730 03:20:02 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.730 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.730 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.730 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.730 03:20:02 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.730 03:20:02 -- setup/common.sh@33 -- # echo 0 00:03:21.730 03:20:02 -- setup/common.sh@33 -- # return 0 00:03:21.730 03:20:02 -- setup/hugepages.sh@99 -- # surp=0 00:03:21.730 03:20:02 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:21.730 03:20:02 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:21.730 03:20:02 -- setup/common.sh@18 -- # local node= 00:03:21.730 03:20:02 -- setup/common.sh@19 -- # local var val 00:03:21.730 03:20:02 -- setup/common.sh@20 -- # local mem_f mem 00:03:21.730 03:20:02 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:21.730 03:20:02 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:21.730 03:20:02 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:21.730 03:20:02 -- setup/common.sh@28 -- # mapfile -t mem 00:03:21.730 03:20:02 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:21.730 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.730 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.731 03:20:02 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 43469412 kB' 'MemAvailable: 47787752 kB' 'Buffers: 2708 kB' 'Cached: 11073384 kB' 'SwapCached: 0 kB' 'Active: 7475748 kB' 'Inactive: 4089812 kB' 'Active(anon): 7074628 kB' 'Inactive(anon): 0 kB' 'Active(file): 401120 kB' 'Inactive(file): 4089812 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 492780 kB' 'Mapped: 212500 kB' 'Shmem: 6585160 kB' 'KReclaimable: 472040 kB' 'Slab: 1061232 kB' 'SReclaimable: 472040 kB' 'SUnreclaim: 589192 kB' 'KernelStack: 12864 kB' 'PageTables: 7972 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083576 kB' 'Committed_AS: 8160300 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 199888 kB' 'VmallocChunk: 0 kB' 'Percpu: 42432 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 2565724 kB' 'DirectMap2M: 18325504 kB' 'DirectMap1G: 49283072 kB' 00:03:21.731 03:20:02 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.731 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.731 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.731 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.731 03:20:02 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.731 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.731 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.731 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.731 03:20:02 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.731 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.731 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.731 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.731 03:20:02 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.731 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.731 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.731 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.731 03:20:02 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.731 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.731 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.731 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.731 03:20:02 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.731 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.731 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.731 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.731 03:20:02 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.731 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.731 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.731 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.731 03:20:02 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.731 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.731 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.731 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.731 03:20:02 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.731 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.731 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.731 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.731 03:20:02 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.731 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.731 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.731 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.731 03:20:02 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.731 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.731 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.731 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.731 03:20:02 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.731 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.731 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.731 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.731 03:20:02 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.731 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.731 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.731 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.731 03:20:02 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.731 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.731 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.731 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.731 03:20:02 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.731 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.731 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.731 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.731 03:20:02 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.731 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.731 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.731 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.731 03:20:02 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.731 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.731 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.731 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.731 03:20:02 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.731 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.731 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.731 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.731 03:20:02 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.731 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.731 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.731 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.731 03:20:02 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.731 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.731 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.731 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.731 03:20:02 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.731 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.731 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.731 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.731 03:20:02 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.731 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.731 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.731 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.731 03:20:02 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.731 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.731 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.731 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.731 03:20:02 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.731 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.731 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.731 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.731 03:20:02 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.731 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.731 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.731 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.731 03:20:02 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.731 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.731 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.731 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.731 03:20:02 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.731 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.731 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.731 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.731 03:20:02 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.731 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.732 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.732 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.732 03:20:02 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.732 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.732 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.732 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.732 03:20:02 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.732 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.732 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.732 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.732 03:20:02 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.732 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.732 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.732 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.732 03:20:02 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.732 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.732 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.732 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.732 03:20:02 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.732 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.732 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.732 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.732 03:20:02 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.732 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.732 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.732 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.732 03:20:02 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.732 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.732 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.732 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.732 03:20:02 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.732 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.732 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.732 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.732 03:20:02 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.732 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.732 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.732 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.732 03:20:02 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.732 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.732 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.732 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.732 03:20:02 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.732 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.732 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.732 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.732 03:20:02 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.732 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.732 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.732 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.732 03:20:02 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.732 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.732 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.732 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.732 03:20:02 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.732 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.732 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.732 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.732 03:20:02 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.732 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.732 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.732 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.732 03:20:02 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.732 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.732 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.732 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.732 03:20:02 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.732 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.732 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.732 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.732 03:20:02 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.732 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.732 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.732 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.732 03:20:02 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.732 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.732 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.732 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.732 03:20:02 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.732 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.732 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.732 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.732 03:20:02 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.732 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.732 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.732 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.732 03:20:02 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.732 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.732 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.732 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.732 03:20:02 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.732 03:20:02 -- setup/common.sh@33 -- # echo 0 00:03:21.732 03:20:02 -- setup/common.sh@33 -- # return 0 00:03:21.732 03:20:02 -- setup/hugepages.sh@100 -- # resv=0 00:03:21.732 03:20:02 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1536 00:03:21.732 nr_hugepages=1536 00:03:21.732 03:20:02 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:21.732 resv_hugepages=0 00:03:21.732 03:20:02 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:21.732 surplus_hugepages=0 00:03:21.732 03:20:02 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:21.732 anon_hugepages=0 00:03:21.732 03:20:02 -- setup/hugepages.sh@107 -- # (( 1536 == nr_hugepages + surp + resv )) 00:03:21.732 03:20:02 -- setup/hugepages.sh@109 -- # (( 1536 == nr_hugepages )) 00:03:21.732 03:20:02 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:21.732 03:20:02 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:21.732 03:20:02 -- setup/common.sh@18 -- # local node= 00:03:21.732 03:20:02 -- setup/common.sh@19 -- # local var val 00:03:21.732 03:20:02 -- setup/common.sh@20 -- # local mem_f mem 00:03:21.732 03:20:02 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:21.732 03:20:02 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:21.732 03:20:02 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:21.732 03:20:02 -- setup/common.sh@28 -- # mapfile -t mem 00:03:21.732 03:20:02 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:21.732 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.732 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.733 03:20:02 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 43469604 kB' 'MemAvailable: 47787944 kB' 'Buffers: 2708 kB' 'Cached: 11073396 kB' 'SwapCached: 0 kB' 'Active: 7476044 kB' 'Inactive: 4089812 kB' 'Active(anon): 7074924 kB' 'Inactive(anon): 0 kB' 'Active(file): 401120 kB' 'Inactive(file): 4089812 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 493068 kB' 'Mapped: 212552 kB' 'Shmem: 6585172 kB' 'KReclaimable: 472040 kB' 'Slab: 1061232 kB' 'SReclaimable: 472040 kB' 'SUnreclaim: 589192 kB' 'KernelStack: 12880 kB' 'PageTables: 8028 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083576 kB' 'Committed_AS: 8160312 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 199888 kB' 'VmallocChunk: 0 kB' 'Percpu: 42432 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 2565724 kB' 'DirectMap2M: 18325504 kB' 'DirectMap1G: 49283072 kB' 00:03:21.733 03:20:02 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.733 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.733 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.733 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.733 03:20:02 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.733 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.733 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.733 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.733 03:20:02 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.733 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.733 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.733 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.733 03:20:02 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.733 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.733 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.733 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.733 03:20:02 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.733 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.733 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.733 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.733 03:20:02 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.733 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.733 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.733 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.733 03:20:02 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.733 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.733 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.733 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.733 03:20:02 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.733 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.733 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.733 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.733 03:20:02 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.733 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.733 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.733 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.733 03:20:02 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.733 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.733 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.733 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.733 03:20:02 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.733 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.733 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.733 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.733 03:20:02 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.733 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.733 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.733 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.733 03:20:02 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.733 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.733 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.733 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.733 03:20:02 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.733 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.733 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.733 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.733 03:20:02 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.733 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.733 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.733 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.733 03:20:02 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.733 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.733 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.733 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.733 03:20:02 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.733 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.733 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.733 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.733 03:20:02 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.733 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.733 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.733 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.733 03:20:02 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.733 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.733 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.733 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.733 03:20:02 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.733 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.733 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.733 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.733 03:20:02 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.733 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.733 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.733 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.733 03:20:02 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.734 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.734 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.734 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.734 03:20:02 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.734 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.734 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.734 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.734 03:20:02 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.734 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.734 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.734 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.734 03:20:02 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.734 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.734 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.734 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.734 03:20:02 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.734 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.734 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.734 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.734 03:20:02 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.734 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.734 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.734 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.734 03:20:02 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.734 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.734 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.734 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.734 03:20:02 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.734 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.734 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.734 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.734 03:20:02 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.734 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.734 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.734 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.734 03:20:02 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.734 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.734 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.734 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.734 03:20:02 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.734 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.734 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.734 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.734 03:20:02 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.734 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.734 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.734 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.734 03:20:02 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.734 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.734 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.734 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.734 03:20:02 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.734 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.734 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.734 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.734 03:20:02 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.734 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.734 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.734 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.734 03:20:02 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.734 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.734 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.734 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.734 03:20:02 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.734 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.734 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.734 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.734 03:20:02 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.734 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.734 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.734 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.734 03:20:02 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.734 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.734 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.734 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.734 03:20:02 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.734 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.734 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.734 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.734 03:20:02 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.734 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.734 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.734 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.734 03:20:02 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.734 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.734 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.734 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.734 03:20:02 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.734 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.734 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.734 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.734 03:20:02 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.734 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.734 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.734 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.734 03:20:02 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.734 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.734 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.734 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.734 03:20:02 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.734 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.734 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.734 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.734 03:20:02 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.734 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.734 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.734 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.734 03:20:02 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.734 03:20:02 -- setup/common.sh@33 -- # echo 1536 00:03:21.734 03:20:02 -- setup/common.sh@33 -- # return 0 00:03:21.734 03:20:02 -- setup/hugepages.sh@110 -- # (( 1536 == nr_hugepages + surp + resv )) 00:03:21.734 03:20:02 -- setup/hugepages.sh@112 -- # get_nodes 00:03:21.734 03:20:02 -- setup/hugepages.sh@27 -- # local node 00:03:21.734 03:20:02 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:21.734 03:20:02 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:21.734 03:20:02 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:21.734 03:20:02 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:21.734 03:20:02 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:21.734 03:20:02 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:21.734 03:20:02 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:21.734 03:20:02 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:21.735 03:20:02 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:21.735 03:20:02 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:21.735 03:20:02 -- setup/common.sh@18 -- # local node=0 00:03:21.735 03:20:02 -- setup/common.sh@19 -- # local var val 00:03:21.735 03:20:02 -- setup/common.sh@20 -- # local mem_f mem 00:03:21.735 03:20:02 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:21.735 03:20:02 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:21.735 03:20:02 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:21.735 03:20:02 -- setup/common.sh@28 -- # mapfile -t mem 00:03:21.735 03:20:02 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:21.735 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.735 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.735 03:20:02 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 20816972 kB' 'MemUsed: 12057952 kB' 'SwapCached: 0 kB' 'Active: 5851296 kB' 'Inactive: 3554096 kB' 'Active(anon): 5643788 kB' 'Inactive(anon): 0 kB' 'Active(file): 207508 kB' 'Inactive(file): 3554096 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 9193652 kB' 'Mapped: 99488 kB' 'AnonPages: 214916 kB' 'Shmem: 5432048 kB' 'KernelStack: 7336 kB' 'PageTables: 4856 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 317812 kB' 'Slab: 708352 kB' 'SReclaimable: 317812 kB' 'SUnreclaim: 390540 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:21.735 03:20:02 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.735 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.735 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.735 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.735 03:20:02 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.735 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.735 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.735 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.735 03:20:02 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.735 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.735 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.735 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.735 03:20:02 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.735 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.735 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.735 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.735 03:20:02 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.735 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.735 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.735 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.735 03:20:02 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.735 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.735 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.735 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.735 03:20:02 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.735 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.735 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.735 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.735 03:20:02 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.735 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.735 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.735 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.735 03:20:02 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.735 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.735 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.735 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.735 03:20:02 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.735 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.735 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.735 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.735 03:20:02 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.735 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.735 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.735 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.735 03:20:02 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.735 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.735 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.735 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.735 03:20:02 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.735 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.735 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.735 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.735 03:20:02 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.735 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.735 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.735 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.735 03:20:02 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.735 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.735 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.735 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.735 03:20:02 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.735 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.735 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.735 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.735 03:20:02 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.735 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.735 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.735 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.735 03:20:02 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.735 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.735 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.735 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.735 03:20:02 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.735 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.735 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.735 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.735 03:20:02 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.735 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.735 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.735 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.735 03:20:02 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.735 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.735 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.735 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.735 03:20:02 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.735 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.735 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.735 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.735 03:20:02 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.735 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.735 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.735 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.735 03:20:02 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.735 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.735 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.735 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.735 03:20:02 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.735 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.735 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.735 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.736 03:20:02 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.736 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.736 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.736 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.736 03:20:02 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.736 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.736 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.736 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.736 03:20:02 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.736 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.736 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.736 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.736 03:20:02 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.736 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.736 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.736 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.736 03:20:02 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.736 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.736 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.736 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.736 03:20:02 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.736 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.736 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.736 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.736 03:20:02 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.736 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.736 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.736 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.736 03:20:02 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.736 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.736 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.736 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.736 03:20:02 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.736 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.736 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.736 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.736 03:20:02 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.736 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.736 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.736 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.736 03:20:02 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.736 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.736 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.736 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.736 03:20:02 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.736 03:20:02 -- setup/common.sh@33 -- # echo 0 00:03:21.736 03:20:02 -- setup/common.sh@33 -- # return 0 00:03:21.736 03:20:02 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:21.736 03:20:02 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:21.736 03:20:02 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:21.736 03:20:02 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:21.736 03:20:02 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:21.736 03:20:02 -- setup/common.sh@18 -- # local node=1 00:03:21.736 03:20:02 -- setup/common.sh@19 -- # local var val 00:03:21.736 03:20:02 -- setup/common.sh@20 -- # local mem_f mem 00:03:21.736 03:20:02 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:21.736 03:20:02 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:21.736 03:20:02 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:21.736 03:20:02 -- setup/common.sh@28 -- # mapfile -t mem 00:03:21.736 03:20:02 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:21.736 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.736 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.736 03:20:02 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27660748 kB' 'MemFree: 22651444 kB' 'MemUsed: 5009304 kB' 'SwapCached: 0 kB' 'Active: 1624796 kB' 'Inactive: 535716 kB' 'Active(anon): 1431184 kB' 'Inactive(anon): 0 kB' 'Active(file): 193612 kB' 'Inactive(file): 535716 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 1882480 kB' 'Mapped: 113064 kB' 'AnonPages: 278156 kB' 'Shmem: 1153152 kB' 'KernelStack: 5544 kB' 'PageTables: 3172 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 154228 kB' 'Slab: 352880 kB' 'SReclaimable: 154228 kB' 'SUnreclaim: 198652 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:21.736 03:20:02 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.736 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.736 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.736 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.736 03:20:02 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.736 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.736 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.736 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.736 03:20:02 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.736 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.736 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.736 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.736 03:20:02 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.736 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.736 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.736 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.736 03:20:02 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.736 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.736 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.736 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.736 03:20:02 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.736 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.736 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.736 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.736 03:20:02 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.736 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.736 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.736 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.736 03:20:02 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.736 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.736 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.736 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.736 03:20:02 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.736 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.736 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.736 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.736 03:20:02 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.736 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.736 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.736 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.736 03:20:02 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.736 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.736 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.736 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.737 03:20:02 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.737 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.737 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.737 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.737 03:20:02 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.737 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.737 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.737 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.737 03:20:02 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.737 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.737 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.737 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.737 03:20:02 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.737 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.737 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.737 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.737 03:20:02 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.737 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.737 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.737 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.737 03:20:02 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.737 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.737 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.737 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.737 03:20:02 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.737 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.737 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.737 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.737 03:20:02 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.737 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.737 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.737 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.737 03:20:02 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.737 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.737 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.737 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.737 03:20:02 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.737 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.737 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.737 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.737 03:20:02 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.737 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.737 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.737 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.737 03:20:02 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.737 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.737 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.737 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.737 03:20:02 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.737 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.737 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.737 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.737 03:20:02 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.737 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.737 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.737 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.737 03:20:02 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.737 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.737 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.737 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.737 03:20:02 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.737 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.737 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.737 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.737 03:20:02 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.737 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.737 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.737 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.737 03:20:02 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.737 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.737 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.737 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.737 03:20:02 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.737 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.737 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.737 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.737 03:20:02 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.737 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.737 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.737 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.737 03:20:02 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.737 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.737 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.737 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.737 03:20:02 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.737 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.737 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.737 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.737 03:20:02 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.737 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.737 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.737 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.737 03:20:02 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.737 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.737 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.737 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.737 03:20:02 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.737 03:20:02 -- setup/common.sh@32 -- # continue 00:03:21.737 03:20:02 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.737 03:20:02 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.737 03:20:02 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.737 03:20:02 -- setup/common.sh@33 -- # echo 0 00:03:21.737 03:20:02 -- setup/common.sh@33 -- # return 0 00:03:21.737 03:20:02 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:21.737 03:20:02 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:21.737 03:20:02 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:21.737 03:20:02 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:21.737 03:20:02 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:03:21.737 node0=512 expecting 512 00:03:21.737 03:20:02 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:21.737 03:20:02 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:21.738 03:20:02 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:21.738 03:20:02 -- setup/hugepages.sh@128 -- # echo 'node1=1024 expecting 1024' 00:03:21.738 node1=1024 expecting 1024 00:03:21.738 03:20:02 -- setup/hugepages.sh@130 -- # [[ 512,1024 == \5\1\2\,\1\0\2\4 ]] 00:03:21.738 00:03:21.738 real 0m1.401s 00:03:21.738 user 0m0.583s 00:03:21.738 sys 0m0.781s 00:03:21.738 03:20:02 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:21.738 03:20:02 -- common/autotest_common.sh@10 -- # set +x 00:03:21.738 ************************************ 00:03:21.738 END TEST custom_alloc 00:03:21.738 ************************************ 00:03:21.738 03:20:02 -- setup/hugepages.sh@215 -- # run_test no_shrink_alloc no_shrink_alloc 00:03:21.738 03:20:02 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:21.738 03:20:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:21.738 03:20:02 -- common/autotest_common.sh@10 -- # set +x 00:03:21.738 ************************************ 00:03:21.738 START TEST no_shrink_alloc 00:03:21.738 ************************************ 00:03:21.738 03:20:02 -- common/autotest_common.sh@1114 -- # no_shrink_alloc 00:03:21.738 03:20:02 -- setup/hugepages.sh@195 -- # get_test_nr_hugepages 2097152 0 00:03:21.738 03:20:02 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:21.738 03:20:02 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:03:21.738 03:20:02 -- setup/hugepages.sh@51 -- # shift 00:03:21.738 03:20:02 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:03:21.738 03:20:02 -- setup/hugepages.sh@52 -- # local node_ids 00:03:21.738 03:20:02 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:21.738 03:20:02 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:21.738 03:20:02 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:03:21.738 03:20:02 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:03:21.738 03:20:02 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:21.738 03:20:02 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:21.738 03:20:02 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:21.738 03:20:02 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:21.738 03:20:02 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:21.738 03:20:02 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:03:21.738 03:20:02 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:21.738 03:20:02 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:03:21.738 03:20:02 -- setup/hugepages.sh@73 -- # return 0 00:03:21.738 03:20:02 -- setup/hugepages.sh@198 -- # setup output 00:03:21.738 03:20:02 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:21.738 03:20:02 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:23.156 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:23.156 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:23.156 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:23.156 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:23.156 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:23.156 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:23.156 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:23.156 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:23.156 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:23.156 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:23.156 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:23.156 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:23.156 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:23.156 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:23.156 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:23.156 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:23.156 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:23.156 03:20:03 -- setup/hugepages.sh@199 -- # verify_nr_hugepages 00:03:23.156 03:20:03 -- setup/hugepages.sh@89 -- # local node 00:03:23.156 03:20:03 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:23.156 03:20:03 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:23.156 03:20:03 -- setup/hugepages.sh@92 -- # local surp 00:03:23.156 03:20:03 -- setup/hugepages.sh@93 -- # local resv 00:03:23.156 03:20:03 -- setup/hugepages.sh@94 -- # local anon 00:03:23.156 03:20:03 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:23.156 03:20:03 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:23.156 03:20:03 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:23.156 03:20:03 -- setup/common.sh@18 -- # local node= 00:03:23.156 03:20:03 -- setup/common.sh@19 -- # local var val 00:03:23.156 03:20:03 -- setup/common.sh@20 -- # local mem_f mem 00:03:23.156 03:20:03 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:23.156 03:20:03 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:23.156 03:20:03 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:23.156 03:20:03 -- setup/common.sh@28 -- # mapfile -t mem 00:03:23.156 03:20:03 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:23.156 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.156 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.156 03:20:03 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44484056 kB' 'MemAvailable: 48802396 kB' 'Buffers: 2708 kB' 'Cached: 11073456 kB' 'SwapCached: 0 kB' 'Active: 7476576 kB' 'Inactive: 4089812 kB' 'Active(anon): 7075456 kB' 'Inactive(anon): 0 kB' 'Active(file): 401120 kB' 'Inactive(file): 4089812 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 493468 kB' 'Mapped: 213088 kB' 'Shmem: 6585232 kB' 'KReclaimable: 472040 kB' 'Slab: 1061216 kB' 'SReclaimable: 472040 kB' 'SUnreclaim: 589176 kB' 'KernelStack: 12848 kB' 'PageTables: 8040 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 8160360 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 199968 kB' 'VmallocChunk: 0 kB' 'Percpu: 42432 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2565724 kB' 'DirectMap2M: 18325504 kB' 'DirectMap1G: 49283072 kB' 00:03:23.156 03:20:03 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.156 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.156 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.156 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.156 03:20:03 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.156 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.156 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.156 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.156 03:20:03 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.156 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.156 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.156 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.156 03:20:03 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.156 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.156 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.156 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.156 03:20:03 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.156 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.156 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.156 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.156 03:20:03 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.156 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.156 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.156 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.156 03:20:03 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.156 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.156 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.156 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.156 03:20:03 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.156 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.156 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.156 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.156 03:20:03 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.156 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.156 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.156 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.156 03:20:03 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.156 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.156 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.156 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.156 03:20:03 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.156 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.156 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.156 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.156 03:20:03 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.156 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.156 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.156 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.156 03:20:03 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.156 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.156 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.156 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.156 03:20:03 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.156 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.156 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.156 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.156 03:20:03 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.156 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.156 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.156 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.156 03:20:03 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.156 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.156 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.156 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.156 03:20:03 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.156 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.156 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.156 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.157 03:20:03 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.157 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.157 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.157 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.157 03:20:03 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.157 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.157 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.157 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.157 03:20:03 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.157 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.157 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.157 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.157 03:20:03 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.157 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.157 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.157 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.157 03:20:03 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.157 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.157 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.157 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.157 03:20:03 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.157 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.157 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.157 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.157 03:20:03 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.157 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.157 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.157 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.157 03:20:03 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.157 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.157 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.157 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.157 03:20:03 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.157 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.157 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.157 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.157 03:20:03 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.157 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.157 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.157 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.157 03:20:03 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.157 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.157 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.157 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.157 03:20:03 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.157 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.157 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.157 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.157 03:20:03 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.157 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.157 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.157 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.157 03:20:03 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.157 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.157 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.157 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.157 03:20:03 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.157 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.157 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.157 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.157 03:20:03 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.157 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.157 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.157 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.157 03:20:03 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.157 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.157 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.157 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.157 03:20:03 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.157 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.157 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.157 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.157 03:20:03 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.157 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.157 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.157 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.157 03:20:03 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.157 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.157 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.157 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.157 03:20:03 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.157 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.157 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.157 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.157 03:20:03 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.157 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.157 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.157 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.157 03:20:03 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.157 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.157 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.157 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.157 03:20:03 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.157 03:20:03 -- setup/common.sh@33 -- # echo 0 00:03:23.157 03:20:03 -- setup/common.sh@33 -- # return 0 00:03:23.157 03:20:03 -- setup/hugepages.sh@97 -- # anon=0 00:03:23.157 03:20:03 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:23.157 03:20:03 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:23.157 03:20:03 -- setup/common.sh@18 -- # local node= 00:03:23.157 03:20:03 -- setup/common.sh@19 -- # local var val 00:03:23.157 03:20:03 -- setup/common.sh@20 -- # local mem_f mem 00:03:23.157 03:20:03 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:23.157 03:20:03 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:23.157 03:20:03 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:23.157 03:20:03 -- setup/common.sh@28 -- # mapfile -t mem 00:03:23.157 03:20:03 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:23.157 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.157 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.157 03:20:03 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44485728 kB' 'MemAvailable: 48804068 kB' 'Buffers: 2708 kB' 'Cached: 11073460 kB' 'SwapCached: 0 kB' 'Active: 7476372 kB' 'Inactive: 4089812 kB' 'Active(anon): 7075252 kB' 'Inactive(anon): 0 kB' 'Active(file): 401120 kB' 'Inactive(file): 4089812 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 493308 kB' 'Mapped: 212640 kB' 'Shmem: 6585236 kB' 'KReclaimable: 472040 kB' 'Slab: 1061216 kB' 'SReclaimable: 472040 kB' 'SUnreclaim: 589176 kB' 'KernelStack: 12864 kB' 'PageTables: 8044 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 8160372 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 199968 kB' 'VmallocChunk: 0 kB' 'Percpu: 42432 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2565724 kB' 'DirectMap2M: 18325504 kB' 'DirectMap1G: 49283072 kB' 00:03:23.157 03:20:03 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.157 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.157 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.157 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.157 03:20:03 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.157 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.157 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.157 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.157 03:20:03 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.157 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.158 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.158 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.158 03:20:03 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.158 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.158 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.158 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.158 03:20:03 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.158 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.158 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.158 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.158 03:20:03 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.158 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.158 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.158 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.158 03:20:03 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.158 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.158 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.158 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.158 03:20:03 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.158 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.158 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.158 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.158 03:20:03 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.158 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.158 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.158 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.158 03:20:03 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.158 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.158 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.158 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.158 03:20:03 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.158 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.158 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.158 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.158 03:20:03 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.158 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.158 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.158 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.158 03:20:03 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.158 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.158 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.158 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.158 03:20:03 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.158 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.158 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.158 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.158 03:20:03 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.158 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.158 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.158 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.158 03:20:03 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.158 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.158 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.158 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.158 03:20:03 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.158 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.158 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.158 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.158 03:20:03 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.158 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.158 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.158 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.158 03:20:03 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.158 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.158 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.158 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.158 03:20:03 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.158 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.158 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.158 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.158 03:20:03 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.158 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.158 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.158 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.158 03:20:03 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.158 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.158 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.158 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.158 03:20:03 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.158 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.158 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.158 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.158 03:20:03 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.158 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.158 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.158 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.158 03:20:03 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.158 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.158 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.158 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.158 03:20:03 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.158 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.158 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.158 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.158 03:20:03 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.158 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.158 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.158 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.158 03:20:03 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.158 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.158 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.158 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.158 03:20:03 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.158 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.158 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.158 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.158 03:20:03 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.158 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.158 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.158 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.158 03:20:03 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.158 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.158 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.158 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.158 03:20:03 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.158 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.158 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.158 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.158 03:20:03 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.158 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.158 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.158 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.158 03:20:03 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.158 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.158 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.158 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.158 03:20:03 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.158 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.158 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.158 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.158 03:20:03 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.158 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.158 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.158 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.158 03:20:03 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.158 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.158 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.158 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.158 03:20:03 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.158 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.158 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.158 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.158 03:20:03 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.158 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.158 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.158 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.158 03:20:03 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.158 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.158 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.159 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.159 03:20:03 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.159 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.159 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.159 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.159 03:20:03 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.159 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.159 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.159 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.159 03:20:03 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.159 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.159 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.159 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.159 03:20:03 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.159 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.159 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.159 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.159 03:20:03 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.159 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.159 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.159 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.159 03:20:03 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.159 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.159 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.159 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.159 03:20:03 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.159 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.159 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.159 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.159 03:20:03 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.159 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.159 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.159 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.159 03:20:03 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.159 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.159 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.159 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.159 03:20:03 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.159 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.159 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.159 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.159 03:20:03 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.159 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.159 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.159 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.159 03:20:03 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.159 03:20:03 -- setup/common.sh@33 -- # echo 0 00:03:23.159 03:20:03 -- setup/common.sh@33 -- # return 0 00:03:23.159 03:20:03 -- setup/hugepages.sh@99 -- # surp=0 00:03:23.159 03:20:03 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:23.159 03:20:03 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:23.159 03:20:03 -- setup/common.sh@18 -- # local node= 00:03:23.159 03:20:03 -- setup/common.sh@19 -- # local var val 00:03:23.159 03:20:03 -- setup/common.sh@20 -- # local mem_f mem 00:03:23.159 03:20:03 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:23.159 03:20:03 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:23.159 03:20:03 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:23.159 03:20:03 -- setup/common.sh@28 -- # mapfile -t mem 00:03:23.159 03:20:03 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:23.159 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.159 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.159 03:20:03 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44485872 kB' 'MemAvailable: 48804212 kB' 'Buffers: 2708 kB' 'Cached: 11073472 kB' 'SwapCached: 0 kB' 'Active: 7476212 kB' 'Inactive: 4089812 kB' 'Active(anon): 7075092 kB' 'Inactive(anon): 0 kB' 'Active(file): 401120 kB' 'Inactive(file): 4089812 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 493104 kB' 'Mapped: 212560 kB' 'Shmem: 6585248 kB' 'KReclaimable: 472040 kB' 'Slab: 1061160 kB' 'SReclaimable: 472040 kB' 'SUnreclaim: 589120 kB' 'KernelStack: 12848 kB' 'PageTables: 7984 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 8160388 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 199968 kB' 'VmallocChunk: 0 kB' 'Percpu: 42432 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2565724 kB' 'DirectMap2M: 18325504 kB' 'DirectMap1G: 49283072 kB' 00:03:23.159 03:20:03 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.159 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.159 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.159 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.159 03:20:03 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.159 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.159 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.159 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.159 03:20:03 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.159 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.159 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.159 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.159 03:20:03 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.159 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.159 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.159 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.159 03:20:03 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.159 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.159 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.159 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.159 03:20:03 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.159 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.159 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.159 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.159 03:20:03 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.159 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.159 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.159 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.159 03:20:03 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.159 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.159 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.159 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.159 03:20:03 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.159 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.159 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.159 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.159 03:20:03 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.159 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.159 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.159 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.159 03:20:03 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.159 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.159 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.159 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.159 03:20:03 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.159 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.159 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.159 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.159 03:20:03 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.159 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.159 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.159 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.159 03:20:03 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.159 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.159 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.159 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.159 03:20:03 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.159 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.159 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.159 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.159 03:20:03 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.159 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.159 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.159 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.159 03:20:03 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.159 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.159 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.159 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.160 03:20:03 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.160 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.160 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.160 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.160 03:20:03 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.160 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.160 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.160 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.160 03:20:03 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.160 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.160 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.160 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.160 03:20:03 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.160 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.160 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.160 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.160 03:20:03 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.160 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.160 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.160 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.160 03:20:03 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.160 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.160 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.160 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.160 03:20:03 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.160 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.160 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.160 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.160 03:20:03 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.160 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.160 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.160 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.160 03:20:03 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.160 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.160 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.160 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.160 03:20:03 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.160 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.160 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.160 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.160 03:20:03 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.160 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.160 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.160 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.160 03:20:03 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.160 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.160 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.160 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.160 03:20:03 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.160 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.160 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.160 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.160 03:20:03 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.160 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.160 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.160 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.160 03:20:03 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.160 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.160 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.160 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.160 03:20:03 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.160 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.160 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.160 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.160 03:20:03 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.160 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.160 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.160 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.160 03:20:03 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.160 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.160 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.160 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.160 03:20:03 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.160 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.160 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.160 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.160 03:20:03 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.160 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.160 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.160 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.160 03:20:03 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.160 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.160 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.160 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.160 03:20:03 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.160 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.160 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.160 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.160 03:20:03 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.160 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.160 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.160 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.160 03:20:03 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.160 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.160 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.160 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.160 03:20:03 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.160 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.160 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.160 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.160 03:20:03 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.160 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.160 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.160 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.160 03:20:03 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.160 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.160 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.160 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.160 03:20:03 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.160 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.160 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.160 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.160 03:20:03 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.160 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.160 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.160 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.160 03:20:03 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.160 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.160 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.160 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.160 03:20:03 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.160 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.160 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.160 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.160 03:20:03 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.160 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.160 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.160 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.160 03:20:03 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.160 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.160 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.160 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.160 03:20:03 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.160 03:20:03 -- setup/common.sh@33 -- # echo 0 00:03:23.160 03:20:03 -- setup/common.sh@33 -- # return 0 00:03:23.160 03:20:03 -- setup/hugepages.sh@100 -- # resv=0 00:03:23.160 03:20:03 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:23.160 nr_hugepages=1024 00:03:23.160 03:20:03 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:23.160 resv_hugepages=0 00:03:23.160 03:20:03 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:23.160 surplus_hugepages=0 00:03:23.160 03:20:03 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:23.160 anon_hugepages=0 00:03:23.160 03:20:03 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:23.160 03:20:03 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:23.160 03:20:03 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:23.160 03:20:03 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:23.160 03:20:03 -- setup/common.sh@18 -- # local node= 00:03:23.160 03:20:03 -- setup/common.sh@19 -- # local var val 00:03:23.161 03:20:03 -- setup/common.sh@20 -- # local mem_f mem 00:03:23.161 03:20:03 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:23.161 03:20:03 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:23.161 03:20:03 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:23.161 03:20:03 -- setup/common.sh@28 -- # mapfile -t mem 00:03:23.161 03:20:03 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:23.161 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.161 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.161 03:20:03 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44486308 kB' 'MemAvailable: 48804648 kB' 'Buffers: 2708 kB' 'Cached: 11073472 kB' 'SwapCached: 0 kB' 'Active: 7475988 kB' 'Inactive: 4089812 kB' 'Active(anon): 7074868 kB' 'Inactive(anon): 0 kB' 'Active(file): 401120 kB' 'Inactive(file): 4089812 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 492856 kB' 'Mapped: 212560 kB' 'Shmem: 6585248 kB' 'KReclaimable: 472040 kB' 'Slab: 1061160 kB' 'SReclaimable: 472040 kB' 'SUnreclaim: 589120 kB' 'KernelStack: 12864 kB' 'PageTables: 8032 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 8160404 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 199984 kB' 'VmallocChunk: 0 kB' 'Percpu: 42432 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2565724 kB' 'DirectMap2M: 18325504 kB' 'DirectMap1G: 49283072 kB' 00:03:23.161 03:20:03 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.161 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.161 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.161 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.161 03:20:03 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.161 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.161 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.161 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.161 03:20:03 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.161 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.161 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.161 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.161 03:20:03 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.161 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.161 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.161 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.161 03:20:03 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.161 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.161 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.161 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.161 03:20:03 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.161 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.161 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.161 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.161 03:20:03 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.161 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.161 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.161 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.161 03:20:03 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.161 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.161 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.161 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.161 03:20:03 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.161 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.161 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.161 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.161 03:20:03 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.161 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.161 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.161 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.161 03:20:03 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.161 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.161 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.161 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.161 03:20:03 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.161 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.161 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.161 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.161 03:20:03 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.161 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.161 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.161 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.161 03:20:03 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.161 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.161 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.161 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.161 03:20:03 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.161 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.161 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.161 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.161 03:20:03 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.161 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.161 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.161 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.161 03:20:03 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.161 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.161 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.161 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.161 03:20:03 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.161 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.161 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.161 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.161 03:20:03 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.161 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.161 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.161 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.161 03:20:03 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.161 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.161 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.161 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.161 03:20:03 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.161 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.161 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.161 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.161 03:20:03 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.161 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.161 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.161 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.161 03:20:03 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.161 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.161 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.161 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.161 03:20:03 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.161 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.161 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.161 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.161 03:20:03 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.161 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.162 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.162 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.162 03:20:03 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.162 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.162 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.162 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.162 03:20:03 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.162 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.162 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.162 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.162 03:20:03 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.162 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.162 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.162 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.162 03:20:03 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.162 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.162 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.162 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.162 03:20:03 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.162 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.162 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.162 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.162 03:20:03 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.162 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.162 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.162 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.162 03:20:03 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.162 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.162 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.162 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.162 03:20:03 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.162 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.162 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.162 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.162 03:20:03 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.162 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.162 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.162 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.162 03:20:03 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.162 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.162 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.162 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.162 03:20:03 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.162 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.162 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.162 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.162 03:20:03 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.162 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.162 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.162 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.162 03:20:03 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.162 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.162 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.162 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.162 03:20:03 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.162 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.162 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.162 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.162 03:20:03 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.162 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.162 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.162 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.162 03:20:03 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.162 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.162 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.162 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.162 03:20:03 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.162 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.162 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.162 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.162 03:20:03 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.162 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.162 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.162 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.162 03:20:03 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.162 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.162 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.162 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.162 03:20:03 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.162 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.162 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.162 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.162 03:20:03 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.162 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.162 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.162 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.162 03:20:03 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.162 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.162 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.162 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.162 03:20:03 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.162 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.162 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.162 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.162 03:20:03 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.162 03:20:03 -- setup/common.sh@33 -- # echo 1024 00:03:23.162 03:20:03 -- setup/common.sh@33 -- # return 0 00:03:23.162 03:20:03 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:23.162 03:20:03 -- setup/hugepages.sh@112 -- # get_nodes 00:03:23.162 03:20:03 -- setup/hugepages.sh@27 -- # local node 00:03:23.162 03:20:03 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:23.162 03:20:03 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:23.162 03:20:03 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:23.162 03:20:03 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:23.162 03:20:03 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:23.162 03:20:03 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:23.162 03:20:03 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:23.162 03:20:03 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:23.162 03:20:03 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:23.162 03:20:03 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:23.162 03:20:03 -- setup/common.sh@18 -- # local node=0 00:03:23.162 03:20:03 -- setup/common.sh@19 -- # local var val 00:03:23.162 03:20:03 -- setup/common.sh@20 -- # local mem_f mem 00:03:23.162 03:20:03 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:23.162 03:20:03 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:23.162 03:20:03 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:23.162 03:20:03 -- setup/common.sh@28 -- # mapfile -t mem 00:03:23.162 03:20:03 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:23.162 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.162 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.162 03:20:03 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 19774436 kB' 'MemUsed: 13100488 kB' 'SwapCached: 0 kB' 'Active: 5851096 kB' 'Inactive: 3554096 kB' 'Active(anon): 5643588 kB' 'Inactive(anon): 0 kB' 'Active(file): 207508 kB' 'Inactive(file): 3554096 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 9193652 kB' 'Mapped: 99488 kB' 'AnonPages: 214696 kB' 'Shmem: 5432048 kB' 'KernelStack: 7336 kB' 'PageTables: 4808 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 317812 kB' 'Slab: 708352 kB' 'SReclaimable: 317812 kB' 'SUnreclaim: 390540 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:23.162 03:20:03 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.162 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.162 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.162 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.162 03:20:03 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.162 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.162 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.162 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.162 03:20:03 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.162 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.162 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.162 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.162 03:20:03 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.162 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.163 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.163 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.163 03:20:03 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.163 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.163 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.163 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.163 03:20:03 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.163 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.163 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.163 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.163 03:20:03 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.163 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.163 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.163 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.163 03:20:03 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.163 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.163 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.163 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.163 03:20:03 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.163 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.163 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.163 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.163 03:20:03 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.163 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.163 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.163 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.163 03:20:03 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.163 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.163 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.163 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.163 03:20:03 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.163 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.163 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.163 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.163 03:20:03 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.163 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.163 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.163 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.163 03:20:03 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.163 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.163 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.163 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.163 03:20:03 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.163 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.163 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.163 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.163 03:20:03 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.163 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.163 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.163 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.163 03:20:03 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.163 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.163 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.163 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.163 03:20:03 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.163 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.163 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.163 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.163 03:20:03 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.163 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.163 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.163 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.163 03:20:03 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.163 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.163 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.163 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.163 03:20:03 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.163 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.163 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.163 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.163 03:20:03 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.163 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.163 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.163 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.163 03:20:03 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.163 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.163 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.163 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.163 03:20:03 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.163 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.163 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.163 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.163 03:20:03 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.163 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.163 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.163 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.163 03:20:03 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.163 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.163 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.163 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.163 03:20:03 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.163 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.163 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.163 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.163 03:20:03 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.163 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.163 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.163 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.163 03:20:03 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.163 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.163 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.163 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.163 03:20:03 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.163 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.163 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.163 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.163 03:20:03 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.163 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.163 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.163 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.163 03:20:03 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.163 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.163 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.163 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.163 03:20:03 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.163 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.163 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.163 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.163 03:20:03 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.163 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.163 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.163 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.163 03:20:03 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.163 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.163 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.163 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.163 03:20:03 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.163 03:20:03 -- setup/common.sh@32 -- # continue 00:03:23.163 03:20:03 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.163 03:20:03 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.163 03:20:03 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.163 03:20:03 -- setup/common.sh@33 -- # echo 0 00:03:23.163 03:20:03 -- setup/common.sh@33 -- # return 0 00:03:23.163 03:20:03 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:23.163 03:20:03 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:23.163 03:20:03 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:23.163 03:20:03 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:23.163 03:20:03 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:03:23.163 node0=1024 expecting 1024 00:03:23.163 03:20:03 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:03:23.163 03:20:03 -- setup/hugepages.sh@202 -- # CLEAR_HUGE=no 00:03:23.163 03:20:03 -- setup/hugepages.sh@202 -- # NRHUGE=512 00:03:23.163 03:20:03 -- setup/hugepages.sh@202 -- # setup output 00:03:23.163 03:20:03 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:23.163 03:20:03 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:24.545 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:24.545 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:24.545 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:24.545 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:24.545 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:24.545 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:24.545 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:24.545 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:24.545 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:24.545 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:24.545 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:24.545 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:24.545 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:24.545 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:24.545 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:24.545 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:24.545 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:24.545 INFO: Requested 512 hugepages but 1024 already allocated on node0 00:03:24.545 03:20:05 -- setup/hugepages.sh@204 -- # verify_nr_hugepages 00:03:24.545 03:20:05 -- setup/hugepages.sh@89 -- # local node 00:03:24.545 03:20:05 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:24.545 03:20:05 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:24.545 03:20:05 -- setup/hugepages.sh@92 -- # local surp 00:03:24.545 03:20:05 -- setup/hugepages.sh@93 -- # local resv 00:03:24.545 03:20:05 -- setup/hugepages.sh@94 -- # local anon 00:03:24.545 03:20:05 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:24.545 03:20:05 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:24.545 03:20:05 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:24.545 03:20:05 -- setup/common.sh@18 -- # local node= 00:03:24.545 03:20:05 -- setup/common.sh@19 -- # local var val 00:03:24.545 03:20:05 -- setup/common.sh@20 -- # local mem_f mem 00:03:24.545 03:20:05 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:24.545 03:20:05 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:24.545 03:20:05 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:24.545 03:20:05 -- setup/common.sh@28 -- # mapfile -t mem 00:03:24.545 03:20:05 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:24.546 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.546 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.546 03:20:05 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44475444 kB' 'MemAvailable: 48793784 kB' 'Buffers: 2708 kB' 'Cached: 11073532 kB' 'SwapCached: 0 kB' 'Active: 7476812 kB' 'Inactive: 4089812 kB' 'Active(anon): 7075692 kB' 'Inactive(anon): 0 kB' 'Active(file): 401120 kB' 'Inactive(file): 4089812 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 493600 kB' 'Mapped: 212596 kB' 'Shmem: 6585308 kB' 'KReclaimable: 472040 kB' 'Slab: 1061072 kB' 'SReclaimable: 472040 kB' 'SUnreclaim: 589032 kB' 'KernelStack: 12880 kB' 'PageTables: 7988 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 8160568 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 199984 kB' 'VmallocChunk: 0 kB' 'Percpu: 42432 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2565724 kB' 'DirectMap2M: 18325504 kB' 'DirectMap1G: 49283072 kB' 00:03:24.546 03:20:05 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.546 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.546 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.546 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.546 03:20:05 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.546 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.546 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.546 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.546 03:20:05 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.546 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.546 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.546 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.546 03:20:05 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.546 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.546 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.546 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.546 03:20:05 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.546 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.546 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.546 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.546 03:20:05 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.546 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.546 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.546 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.546 03:20:05 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.546 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.546 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.546 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.546 03:20:05 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.546 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.546 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.546 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.546 03:20:05 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.546 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.546 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.546 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.546 03:20:05 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.546 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.546 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.546 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.546 03:20:05 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.546 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.546 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.546 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.546 03:20:05 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.546 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.546 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.546 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.546 03:20:05 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.546 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.546 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.546 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.546 03:20:05 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.546 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.546 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.546 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.546 03:20:05 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.546 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.546 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.546 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.546 03:20:05 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.546 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.546 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.546 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.546 03:20:05 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.546 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.546 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.546 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.546 03:20:05 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.546 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.546 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.546 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.546 03:20:05 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.546 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.546 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.546 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.546 03:20:05 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.546 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.546 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.546 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.546 03:20:05 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.546 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.546 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.546 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.546 03:20:05 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.546 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.546 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.546 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.546 03:20:05 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.546 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.546 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.546 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.546 03:20:05 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.546 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.546 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.546 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.546 03:20:05 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.546 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.546 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.546 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.546 03:20:05 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.546 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.546 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.546 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.546 03:20:05 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.546 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.546 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.546 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.546 03:20:05 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.546 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.546 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.546 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.546 03:20:05 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.546 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.546 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.546 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.546 03:20:05 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.546 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.546 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.546 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.546 03:20:05 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.546 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.546 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.546 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.546 03:20:05 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.546 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.546 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.547 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.547 03:20:05 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.547 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.547 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.547 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.547 03:20:05 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.547 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.547 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.547 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.547 03:20:05 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.547 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.547 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.547 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.547 03:20:05 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.547 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.547 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.547 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.547 03:20:05 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.547 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.547 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.547 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.547 03:20:05 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.547 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.547 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.547 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.547 03:20:05 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.547 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.547 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.547 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.547 03:20:05 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.547 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.547 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.547 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.547 03:20:05 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.547 03:20:05 -- setup/common.sh@33 -- # echo 0 00:03:24.547 03:20:05 -- setup/common.sh@33 -- # return 0 00:03:24.547 03:20:05 -- setup/hugepages.sh@97 -- # anon=0 00:03:24.547 03:20:05 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:24.547 03:20:05 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:24.547 03:20:05 -- setup/common.sh@18 -- # local node= 00:03:24.547 03:20:05 -- setup/common.sh@19 -- # local var val 00:03:24.547 03:20:05 -- setup/common.sh@20 -- # local mem_f mem 00:03:24.547 03:20:05 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:24.547 03:20:05 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:24.547 03:20:05 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:24.547 03:20:05 -- setup/common.sh@28 -- # mapfile -t mem 00:03:24.547 03:20:05 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:24.547 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.547 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.547 03:20:05 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44475532 kB' 'MemAvailable: 48793872 kB' 'Buffers: 2708 kB' 'Cached: 11073532 kB' 'SwapCached: 0 kB' 'Active: 7476936 kB' 'Inactive: 4089812 kB' 'Active(anon): 7075816 kB' 'Inactive(anon): 0 kB' 'Active(file): 401120 kB' 'Inactive(file): 4089812 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 493704 kB' 'Mapped: 212596 kB' 'Shmem: 6585308 kB' 'KReclaimable: 472040 kB' 'Slab: 1061072 kB' 'SReclaimable: 472040 kB' 'SUnreclaim: 589032 kB' 'KernelStack: 12848 kB' 'PageTables: 7880 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 8160580 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 199968 kB' 'VmallocChunk: 0 kB' 'Percpu: 42432 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2565724 kB' 'DirectMap2M: 18325504 kB' 'DirectMap1G: 49283072 kB' 00:03:24.547 03:20:05 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.547 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.547 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.547 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.547 03:20:05 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.547 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.547 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.547 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.547 03:20:05 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.547 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.547 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.547 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.547 03:20:05 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.547 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.547 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.547 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.547 03:20:05 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.547 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.547 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.547 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.547 03:20:05 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.547 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.547 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.547 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.547 03:20:05 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.547 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.547 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.547 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.547 03:20:05 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.547 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.547 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.547 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.547 03:20:05 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.547 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.547 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.547 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.547 03:20:05 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.547 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.547 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.547 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.547 03:20:05 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.547 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.547 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.547 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.547 03:20:05 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.547 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.547 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.547 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.547 03:20:05 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.547 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.547 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.547 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.547 03:20:05 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.547 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.547 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.547 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.547 03:20:05 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.547 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.547 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.547 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.547 03:20:05 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.547 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.547 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.547 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.547 03:20:05 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.547 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.547 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.547 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.547 03:20:05 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.547 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.547 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.547 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.547 03:20:05 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.547 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.547 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.547 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.547 03:20:05 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.547 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.547 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.547 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.547 03:20:05 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.548 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.548 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.548 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.548 03:20:05 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.548 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.548 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.548 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.548 03:20:05 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.548 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.548 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.548 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.548 03:20:05 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.548 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.548 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.548 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.548 03:20:05 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.548 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.548 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.548 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.548 03:20:05 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.548 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.548 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.548 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.548 03:20:05 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.548 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.548 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.548 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.548 03:20:05 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.548 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.548 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.548 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.548 03:20:05 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.548 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.548 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.548 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.548 03:20:05 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.548 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.548 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.548 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.548 03:20:05 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.548 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.548 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.548 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.548 03:20:05 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.548 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.548 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.548 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.548 03:20:05 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.548 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.548 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.548 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.548 03:20:05 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.548 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.548 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.548 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.548 03:20:05 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.548 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.548 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.548 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.548 03:20:05 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.548 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.548 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.548 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.548 03:20:05 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.548 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.548 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.548 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.548 03:20:05 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.548 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.548 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.548 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.548 03:20:05 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.548 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.548 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.548 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.548 03:20:05 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.548 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.548 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.548 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.548 03:20:05 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.548 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.548 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.548 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.548 03:20:05 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.548 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.548 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.548 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.548 03:20:05 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.548 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.548 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.548 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.548 03:20:05 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.548 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.548 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.548 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.548 03:20:05 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.548 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.548 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.548 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.548 03:20:05 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.548 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.548 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.548 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.548 03:20:05 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.548 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.548 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.548 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.548 03:20:05 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.548 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.548 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.548 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.548 03:20:05 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.548 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.548 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.548 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.548 03:20:05 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.548 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.548 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.548 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.548 03:20:05 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.548 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.548 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.548 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.548 03:20:05 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.548 03:20:05 -- setup/common.sh@33 -- # echo 0 00:03:24.548 03:20:05 -- setup/common.sh@33 -- # return 0 00:03:24.548 03:20:05 -- setup/hugepages.sh@99 -- # surp=0 00:03:24.548 03:20:05 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:24.548 03:20:05 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:24.548 03:20:05 -- setup/common.sh@18 -- # local node= 00:03:24.548 03:20:05 -- setup/common.sh@19 -- # local var val 00:03:24.548 03:20:05 -- setup/common.sh@20 -- # local mem_f mem 00:03:24.548 03:20:05 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:24.548 03:20:05 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:24.548 03:20:05 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:24.548 03:20:05 -- setup/common.sh@28 -- # mapfile -t mem 00:03:24.548 03:20:05 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:24.548 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.548 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.549 03:20:05 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44475532 kB' 'MemAvailable: 48793872 kB' 'Buffers: 2708 kB' 'Cached: 11073548 kB' 'SwapCached: 0 kB' 'Active: 7476196 kB' 'Inactive: 4089812 kB' 'Active(anon): 7075076 kB' 'Inactive(anon): 0 kB' 'Active(file): 401120 kB' 'Inactive(file): 4089812 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 492936 kB' 'Mapped: 212568 kB' 'Shmem: 6585324 kB' 'KReclaimable: 472040 kB' 'Slab: 1061040 kB' 'SReclaimable: 472040 kB' 'SUnreclaim: 589000 kB' 'KernelStack: 12848 kB' 'PageTables: 7868 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 8160596 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 199952 kB' 'VmallocChunk: 0 kB' 'Percpu: 42432 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2565724 kB' 'DirectMap2M: 18325504 kB' 'DirectMap1G: 49283072 kB' 00:03:24.549 03:20:05 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.549 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.549 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.549 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.549 03:20:05 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.549 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.549 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.549 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.549 03:20:05 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.549 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.549 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.549 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.549 03:20:05 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.549 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.549 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.549 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.549 03:20:05 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.549 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.549 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.549 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.549 03:20:05 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.549 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.549 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.549 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.549 03:20:05 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.549 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.549 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.549 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.549 03:20:05 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.549 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.549 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.549 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.549 03:20:05 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.549 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.549 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.549 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.549 03:20:05 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.549 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.549 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.549 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.549 03:20:05 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.549 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.549 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.549 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.549 03:20:05 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.549 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.549 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.549 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.549 03:20:05 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.549 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.549 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.549 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.549 03:20:05 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.549 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.549 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.549 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.549 03:20:05 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.549 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.549 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.549 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.549 03:20:05 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.549 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.549 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.549 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.549 03:20:05 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.549 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.549 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.549 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.549 03:20:05 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.549 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.549 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.549 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.549 03:20:05 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.549 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.549 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.549 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.549 03:20:05 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.549 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.549 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.549 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.549 03:20:05 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.549 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.549 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.549 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.549 03:20:05 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.549 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.549 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.549 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.549 03:20:05 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.549 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.549 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.549 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.549 03:20:05 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.549 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.549 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.549 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.549 03:20:05 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.549 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.549 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.549 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.549 03:20:05 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.549 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.549 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.549 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.549 03:20:05 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.549 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.549 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.549 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.549 03:20:05 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.549 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.549 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.549 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.549 03:20:05 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.549 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.549 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.549 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.549 03:20:05 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.549 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.549 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.549 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.549 03:20:05 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.549 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.549 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.549 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.549 03:20:05 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.549 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.549 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.549 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.549 03:20:05 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.549 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.549 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.549 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.549 03:20:05 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.549 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.549 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.549 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.549 03:20:05 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.550 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.550 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.550 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.550 03:20:05 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.550 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.550 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.550 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.550 03:20:05 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.550 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.550 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.550 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.550 03:20:05 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.550 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.550 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.550 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.550 03:20:05 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.550 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.550 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.550 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.550 03:20:05 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.550 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.550 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.550 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.550 03:20:05 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.550 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.550 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.550 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.550 03:20:05 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.550 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.550 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.550 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.550 03:20:05 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.550 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.550 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.550 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.550 03:20:05 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.550 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.550 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.550 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.550 03:20:05 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.550 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.550 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.550 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.550 03:20:05 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.550 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.550 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.550 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.550 03:20:05 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.550 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.550 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.550 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.550 03:20:05 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.550 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.550 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.550 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.550 03:20:05 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.550 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.550 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.550 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.550 03:20:05 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.550 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.550 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.550 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.550 03:20:05 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.550 03:20:05 -- setup/common.sh@33 -- # echo 0 00:03:24.550 03:20:05 -- setup/common.sh@33 -- # return 0 00:03:24.550 03:20:05 -- setup/hugepages.sh@100 -- # resv=0 00:03:24.550 03:20:05 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:24.550 nr_hugepages=1024 00:03:24.550 03:20:05 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:24.550 resv_hugepages=0 00:03:24.550 03:20:05 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:24.550 surplus_hugepages=0 00:03:24.550 03:20:05 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:24.550 anon_hugepages=0 00:03:24.550 03:20:05 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:24.550 03:20:05 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:24.550 03:20:05 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:24.550 03:20:05 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:24.550 03:20:05 -- setup/common.sh@18 -- # local node= 00:03:24.550 03:20:05 -- setup/common.sh@19 -- # local var val 00:03:24.550 03:20:05 -- setup/common.sh@20 -- # local mem_f mem 00:03:24.550 03:20:05 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:24.550 03:20:05 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:24.550 03:20:05 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:24.550 03:20:05 -- setup/common.sh@28 -- # mapfile -t mem 00:03:24.550 03:20:05 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:24.550 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.550 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.550 03:20:05 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 44475532 kB' 'MemAvailable: 48793872 kB' 'Buffers: 2708 kB' 'Cached: 11073548 kB' 'SwapCached: 0 kB' 'Active: 7476376 kB' 'Inactive: 4089812 kB' 'Active(anon): 7075256 kB' 'Inactive(anon): 0 kB' 'Active(file): 401120 kB' 'Inactive(file): 4089812 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 493156 kB' 'Mapped: 212568 kB' 'Shmem: 6585324 kB' 'KReclaimable: 472040 kB' 'Slab: 1061040 kB' 'SReclaimable: 472040 kB' 'SUnreclaim: 589000 kB' 'KernelStack: 12880 kB' 'PageTables: 7964 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 8160612 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 199968 kB' 'VmallocChunk: 0 kB' 'Percpu: 42432 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2565724 kB' 'DirectMap2M: 18325504 kB' 'DirectMap1G: 49283072 kB' 00:03:24.550 03:20:05 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.550 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.550 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.550 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.550 03:20:05 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.550 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.550 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.550 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.550 03:20:05 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.550 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.550 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.550 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.550 03:20:05 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.550 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.550 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.550 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.550 03:20:05 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.550 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.550 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.550 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.551 03:20:05 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.551 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.551 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.551 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.551 03:20:05 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.551 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.551 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.551 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.551 03:20:05 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.551 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.551 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.551 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.551 03:20:05 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.551 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.551 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.551 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.551 03:20:05 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.551 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.551 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.551 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.551 03:20:05 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.551 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.551 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.551 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.551 03:20:05 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.551 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.551 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.551 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.551 03:20:05 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.551 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.551 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.811 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.811 03:20:05 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.811 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.811 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.811 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.811 03:20:05 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.811 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.811 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.811 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.811 03:20:05 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.811 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.811 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.811 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.811 03:20:05 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.811 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.811 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.811 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.811 03:20:05 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.811 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.811 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.811 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.811 03:20:05 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.811 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.811 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.811 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.811 03:20:05 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.811 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.811 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.811 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.811 03:20:05 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.811 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.811 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.811 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.811 03:20:05 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.811 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.811 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.811 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.811 03:20:05 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.811 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.812 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.812 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.812 03:20:05 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.812 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.812 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.812 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.812 03:20:05 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.812 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.812 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.812 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.812 03:20:05 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.812 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.812 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.812 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.812 03:20:05 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.812 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.812 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.812 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.812 03:20:05 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.812 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.812 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.812 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.812 03:20:05 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.812 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.812 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.812 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.812 03:20:05 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.812 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.812 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.812 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.812 03:20:05 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.812 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.812 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.812 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.812 03:20:05 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.812 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.812 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.812 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.812 03:20:05 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.812 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.812 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.812 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.812 03:20:05 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.812 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.812 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.812 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.812 03:20:05 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.812 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.812 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.812 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.812 03:20:05 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.812 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.812 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.812 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.812 03:20:05 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.812 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.812 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.812 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.812 03:20:05 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.812 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.812 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.812 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.812 03:20:05 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.812 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.812 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.812 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.812 03:20:05 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.812 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.812 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.812 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.812 03:20:05 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.812 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.812 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.812 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.812 03:20:05 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.812 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.812 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.812 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.812 03:20:05 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.812 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.812 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.812 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.812 03:20:05 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.812 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.812 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.812 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.812 03:20:05 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.812 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.812 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.812 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.812 03:20:05 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.812 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.812 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.812 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.812 03:20:05 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.812 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.812 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.812 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.812 03:20:05 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.812 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.812 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.812 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.812 03:20:05 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.812 03:20:05 -- setup/common.sh@33 -- # echo 1024 00:03:24.812 03:20:05 -- setup/common.sh@33 -- # return 0 00:03:24.812 03:20:05 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:24.812 03:20:05 -- setup/hugepages.sh@112 -- # get_nodes 00:03:24.812 03:20:05 -- setup/hugepages.sh@27 -- # local node 00:03:24.812 03:20:05 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:24.812 03:20:05 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:24.812 03:20:05 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:24.812 03:20:05 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:24.812 03:20:05 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:24.812 03:20:05 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:24.812 03:20:05 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:24.812 03:20:05 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:24.812 03:20:05 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:24.813 03:20:05 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:24.813 03:20:05 -- setup/common.sh@18 -- # local node=0 00:03:24.813 03:20:05 -- setup/common.sh@19 -- # local var val 00:03:24.813 03:20:05 -- setup/common.sh@20 -- # local mem_f mem 00:03:24.813 03:20:05 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:24.813 03:20:05 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:24.813 03:20:05 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:24.813 03:20:05 -- setup/common.sh@28 -- # mapfile -t mem 00:03:24.813 03:20:05 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:24.813 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.813 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.813 03:20:05 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 19770912 kB' 'MemUsed: 13104012 kB' 'SwapCached: 0 kB' 'Active: 5851428 kB' 'Inactive: 3554096 kB' 'Active(anon): 5643920 kB' 'Inactive(anon): 0 kB' 'Active(file): 207508 kB' 'Inactive(file): 3554096 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 9193656 kB' 'Mapped: 99488 kB' 'AnonPages: 215052 kB' 'Shmem: 5432052 kB' 'KernelStack: 7368 kB' 'PageTables: 4900 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 317812 kB' 'Slab: 708244 kB' 'SReclaimable: 317812 kB' 'SUnreclaim: 390432 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:24.813 03:20:05 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.813 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.813 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.813 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.813 03:20:05 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.813 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.813 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.813 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.813 03:20:05 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.813 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.813 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.813 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.813 03:20:05 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.813 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.813 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.813 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.813 03:20:05 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.813 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.813 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.813 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.813 03:20:05 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.813 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.813 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.813 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.813 03:20:05 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.813 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.813 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.813 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.813 03:20:05 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.813 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.813 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.813 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.813 03:20:05 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.813 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.813 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.813 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.813 03:20:05 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.813 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.813 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.813 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.813 03:20:05 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.813 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.813 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.813 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.813 03:20:05 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.813 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.813 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.813 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.813 03:20:05 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.813 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.813 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.813 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.813 03:20:05 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.813 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.813 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.813 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.813 03:20:05 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.813 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.813 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.813 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.813 03:20:05 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.813 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.813 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.813 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.813 03:20:05 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.813 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.813 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.813 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.813 03:20:05 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.813 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.813 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.813 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.813 03:20:05 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.813 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.813 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.813 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.813 03:20:05 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.813 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.813 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.813 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.813 03:20:05 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.813 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.813 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.813 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.813 03:20:05 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.813 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.813 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.813 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.813 03:20:05 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.813 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.813 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.813 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.813 03:20:05 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.813 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.813 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.813 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.813 03:20:05 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.813 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.813 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.813 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.814 03:20:05 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.814 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.814 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.814 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.814 03:20:05 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.814 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.814 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.814 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.814 03:20:05 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.814 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.814 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.814 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.814 03:20:05 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.814 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.814 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.814 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.814 03:20:05 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.814 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.814 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.814 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.814 03:20:05 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.814 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.814 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.814 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.814 03:20:05 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.814 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.814 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.814 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.814 03:20:05 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.814 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.814 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.814 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.814 03:20:05 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.814 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.814 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.814 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.814 03:20:05 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.814 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.814 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.814 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.814 03:20:05 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.814 03:20:05 -- setup/common.sh@32 -- # continue 00:03:24.814 03:20:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.814 03:20:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.814 03:20:05 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.814 03:20:05 -- setup/common.sh@33 -- # echo 0 00:03:24.814 03:20:05 -- setup/common.sh@33 -- # return 0 00:03:24.814 03:20:05 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:24.814 03:20:05 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:24.814 03:20:05 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:24.814 03:20:05 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:24.814 03:20:05 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:03:24.814 node0=1024 expecting 1024 00:03:24.814 03:20:05 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:03:24.814 00:03:24.814 real 0m2.908s 00:03:24.814 user 0m1.138s 00:03:24.814 sys 0m1.702s 00:03:24.814 03:20:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:24.814 03:20:05 -- common/autotest_common.sh@10 -- # set +x 00:03:24.814 ************************************ 00:03:24.814 END TEST no_shrink_alloc 00:03:24.814 ************************************ 00:03:24.814 03:20:05 -- setup/hugepages.sh@217 -- # clear_hp 00:03:24.814 03:20:05 -- setup/hugepages.sh@37 -- # local node hp 00:03:24.814 03:20:05 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:24.814 03:20:05 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:24.814 03:20:05 -- setup/hugepages.sh@41 -- # echo 0 00:03:24.814 03:20:05 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:24.814 03:20:05 -- setup/hugepages.sh@41 -- # echo 0 00:03:24.814 03:20:05 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:24.814 03:20:05 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:24.814 03:20:05 -- setup/hugepages.sh@41 -- # echo 0 00:03:24.814 03:20:05 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:24.814 03:20:05 -- setup/hugepages.sh@41 -- # echo 0 00:03:24.814 03:20:05 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:03:24.814 03:20:05 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:03:24.814 00:03:24.814 real 0m11.345s 00:03:24.814 user 0m4.287s 00:03:24.814 sys 0m6.009s 00:03:24.814 03:20:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:24.814 03:20:05 -- common/autotest_common.sh@10 -- # set +x 00:03:24.814 ************************************ 00:03:24.814 END TEST hugepages 00:03:24.814 ************************************ 00:03:24.814 03:20:05 -- setup/test-setup.sh@14 -- # run_test driver /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:03:24.814 03:20:05 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:24.814 03:20:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:24.814 03:20:05 -- common/autotest_common.sh@10 -- # set +x 00:03:24.814 ************************************ 00:03:24.814 START TEST driver 00:03:24.814 ************************************ 00:03:24.814 03:20:05 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:03:24.814 * Looking for test storage... 00:03:24.814 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:24.814 03:20:05 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:24.814 03:20:05 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:24.814 03:20:05 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:24.814 03:20:05 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:24.814 03:20:05 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:24.814 03:20:05 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:24.814 03:20:05 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:24.814 03:20:05 -- scripts/common.sh@335 -- # IFS=.-: 00:03:24.814 03:20:05 -- scripts/common.sh@335 -- # read -ra ver1 00:03:24.814 03:20:05 -- scripts/common.sh@336 -- # IFS=.-: 00:03:24.814 03:20:05 -- scripts/common.sh@336 -- # read -ra ver2 00:03:24.814 03:20:05 -- scripts/common.sh@337 -- # local 'op=<' 00:03:24.814 03:20:05 -- scripts/common.sh@339 -- # ver1_l=2 00:03:24.814 03:20:05 -- scripts/common.sh@340 -- # ver2_l=1 00:03:24.814 03:20:05 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:24.814 03:20:05 -- scripts/common.sh@343 -- # case "$op" in 00:03:24.814 03:20:05 -- scripts/common.sh@344 -- # : 1 00:03:24.814 03:20:05 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:24.815 03:20:05 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:24.815 03:20:05 -- scripts/common.sh@364 -- # decimal 1 00:03:24.815 03:20:05 -- scripts/common.sh@352 -- # local d=1 00:03:24.815 03:20:05 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:24.815 03:20:05 -- scripts/common.sh@354 -- # echo 1 00:03:24.815 03:20:05 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:24.815 03:20:05 -- scripts/common.sh@365 -- # decimal 2 00:03:24.815 03:20:05 -- scripts/common.sh@352 -- # local d=2 00:03:24.815 03:20:05 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:24.815 03:20:05 -- scripts/common.sh@354 -- # echo 2 00:03:24.815 03:20:05 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:24.815 03:20:05 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:24.815 03:20:05 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:24.815 03:20:05 -- scripts/common.sh@367 -- # return 0 00:03:24.815 03:20:05 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:24.815 03:20:05 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:24.815 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:24.815 --rc genhtml_branch_coverage=1 00:03:24.815 --rc genhtml_function_coverage=1 00:03:24.815 --rc genhtml_legend=1 00:03:24.815 --rc geninfo_all_blocks=1 00:03:24.815 --rc geninfo_unexecuted_blocks=1 00:03:24.815 00:03:24.815 ' 00:03:24.815 03:20:05 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:24.815 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:24.815 --rc genhtml_branch_coverage=1 00:03:24.815 --rc genhtml_function_coverage=1 00:03:24.815 --rc genhtml_legend=1 00:03:24.815 --rc geninfo_all_blocks=1 00:03:24.815 --rc geninfo_unexecuted_blocks=1 00:03:24.815 00:03:24.815 ' 00:03:24.815 03:20:05 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:24.815 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:24.815 --rc genhtml_branch_coverage=1 00:03:24.815 --rc genhtml_function_coverage=1 00:03:24.815 --rc genhtml_legend=1 00:03:24.815 --rc geninfo_all_blocks=1 00:03:24.815 --rc geninfo_unexecuted_blocks=1 00:03:24.815 00:03:24.815 ' 00:03:24.815 03:20:05 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:24.815 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:24.815 --rc genhtml_branch_coverage=1 00:03:24.815 --rc genhtml_function_coverage=1 00:03:24.815 --rc genhtml_legend=1 00:03:24.815 --rc geninfo_all_blocks=1 00:03:24.815 --rc geninfo_unexecuted_blocks=1 00:03:24.815 00:03:24.815 ' 00:03:24.815 03:20:05 -- setup/driver.sh@68 -- # setup reset 00:03:24.815 03:20:05 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:24.815 03:20:05 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:27.355 03:20:07 -- setup/driver.sh@69 -- # run_test guess_driver guess_driver 00:03:27.355 03:20:07 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:27.355 03:20:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:27.355 03:20:07 -- common/autotest_common.sh@10 -- # set +x 00:03:27.355 ************************************ 00:03:27.355 START TEST guess_driver 00:03:27.355 ************************************ 00:03:27.355 03:20:07 -- common/autotest_common.sh@1114 -- # guess_driver 00:03:27.355 03:20:07 -- setup/driver.sh@46 -- # local driver setup_driver marker 00:03:27.355 03:20:07 -- setup/driver.sh@47 -- # local fail=0 00:03:27.355 03:20:07 -- setup/driver.sh@49 -- # pick_driver 00:03:27.355 03:20:07 -- setup/driver.sh@36 -- # vfio 00:03:27.355 03:20:07 -- setup/driver.sh@21 -- # local iommu_grups 00:03:27.355 03:20:07 -- setup/driver.sh@22 -- # local unsafe_vfio 00:03:27.355 03:20:07 -- setup/driver.sh@24 -- # [[ -e /sys/module/vfio/parameters/enable_unsafe_noiommu_mode ]] 00:03:27.355 03:20:07 -- setup/driver.sh@25 -- # unsafe_vfio=N 00:03:27.355 03:20:07 -- setup/driver.sh@27 -- # iommu_groups=(/sys/kernel/iommu_groups/*) 00:03:27.355 03:20:07 -- setup/driver.sh@29 -- # (( 141 > 0 )) 00:03:27.355 03:20:07 -- setup/driver.sh@30 -- # is_driver vfio_pci 00:03:27.355 03:20:07 -- setup/driver.sh@14 -- # mod vfio_pci 00:03:27.355 03:20:07 -- setup/driver.sh@12 -- # dep vfio_pci 00:03:27.355 03:20:07 -- setup/driver.sh@11 -- # modprobe --show-depends vfio_pci 00:03:27.355 03:20:07 -- setup/driver.sh@12 -- # [[ insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/virt/lib/irqbypass.ko.xz 00:03:27.355 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:03:27.355 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:03:27.355 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:03:27.355 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:03:27.355 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio_iommu_type1.ko.xz 00:03:27.355 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/pci/vfio-pci-core.ko.xz 00:03:27.355 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/pci/vfio-pci.ko.xz == *\.\k\o* ]] 00:03:27.355 03:20:07 -- setup/driver.sh@30 -- # return 0 00:03:27.355 03:20:07 -- setup/driver.sh@37 -- # echo vfio-pci 00:03:27.355 03:20:07 -- setup/driver.sh@49 -- # driver=vfio-pci 00:03:27.355 03:20:07 -- setup/driver.sh@51 -- # [[ vfio-pci == \N\o\ \v\a\l\i\d\ \d\r\i\v\e\r\ \f\o\u\n\d ]] 00:03:27.355 03:20:07 -- setup/driver.sh@56 -- # echo 'Looking for driver=vfio-pci' 00:03:27.355 Looking for driver=vfio-pci 00:03:27.355 03:20:07 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:27.355 03:20:07 -- setup/driver.sh@45 -- # setup output config 00:03:27.355 03:20:07 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:27.355 03:20:07 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:28.733 03:20:09 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:28.733 03:20:09 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:28.733 03:20:09 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:28.733 03:20:09 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:28.733 03:20:09 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:28.733 03:20:09 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:28.733 03:20:09 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:28.733 03:20:09 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:28.733 03:20:09 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:28.733 03:20:09 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:28.733 03:20:09 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:28.733 03:20:09 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:28.733 03:20:09 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:28.733 03:20:09 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:28.733 03:20:09 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:28.733 03:20:09 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:28.733 03:20:09 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:28.733 03:20:09 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:28.733 03:20:09 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:28.733 03:20:09 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:28.733 03:20:09 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:28.733 03:20:09 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:28.733 03:20:09 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:28.733 03:20:09 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:28.733 03:20:09 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:28.733 03:20:09 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:28.733 03:20:09 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:28.733 03:20:09 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:28.733 03:20:09 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:28.733 03:20:09 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:28.733 03:20:09 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:28.733 03:20:09 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:28.733 03:20:09 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:28.733 03:20:09 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:28.733 03:20:09 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:28.733 03:20:09 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:28.733 03:20:09 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:28.733 03:20:09 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:28.733 03:20:09 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:28.733 03:20:09 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:28.733 03:20:09 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:28.733 03:20:09 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:28.733 03:20:09 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:28.733 03:20:09 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:28.733 03:20:09 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:28.733 03:20:09 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:28.733 03:20:09 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:28.733 03:20:09 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:29.674 03:20:10 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:29.674 03:20:10 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:29.674 03:20:10 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:29.933 03:20:10 -- setup/driver.sh@64 -- # (( fail == 0 )) 00:03:29.933 03:20:10 -- setup/driver.sh@65 -- # setup reset 00:03:29.933 03:20:10 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:29.933 03:20:10 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:32.467 00:03:32.467 real 0m4.893s 00:03:32.467 user 0m1.131s 00:03:32.467 sys 0m1.958s 00:03:32.467 03:20:12 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:32.467 03:20:12 -- common/autotest_common.sh@10 -- # set +x 00:03:32.467 ************************************ 00:03:32.467 END TEST guess_driver 00:03:32.467 ************************************ 00:03:32.467 00:03:32.467 real 0m7.598s 00:03:32.467 user 0m1.814s 00:03:32.467 sys 0m3.039s 00:03:32.467 03:20:12 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:32.467 03:20:12 -- common/autotest_common.sh@10 -- # set +x 00:03:32.467 ************************************ 00:03:32.467 END TEST driver 00:03:32.467 ************************************ 00:03:32.467 03:20:12 -- setup/test-setup.sh@15 -- # run_test devices /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:03:32.467 03:20:12 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:32.467 03:20:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:32.467 03:20:12 -- common/autotest_common.sh@10 -- # set +x 00:03:32.467 ************************************ 00:03:32.467 START TEST devices 00:03:32.467 ************************************ 00:03:32.467 03:20:12 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:03:32.467 * Looking for test storage... 00:03:32.467 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:32.467 03:20:12 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:32.467 03:20:12 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:32.467 03:20:12 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:32.467 03:20:13 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:32.467 03:20:13 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:32.467 03:20:13 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:32.467 03:20:13 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:32.467 03:20:13 -- scripts/common.sh@335 -- # IFS=.-: 00:03:32.467 03:20:13 -- scripts/common.sh@335 -- # read -ra ver1 00:03:32.467 03:20:13 -- scripts/common.sh@336 -- # IFS=.-: 00:03:32.467 03:20:13 -- scripts/common.sh@336 -- # read -ra ver2 00:03:32.467 03:20:13 -- scripts/common.sh@337 -- # local 'op=<' 00:03:32.467 03:20:13 -- scripts/common.sh@339 -- # ver1_l=2 00:03:32.467 03:20:13 -- scripts/common.sh@340 -- # ver2_l=1 00:03:32.467 03:20:13 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:32.467 03:20:13 -- scripts/common.sh@343 -- # case "$op" in 00:03:32.467 03:20:13 -- scripts/common.sh@344 -- # : 1 00:03:32.467 03:20:13 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:32.467 03:20:13 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:32.467 03:20:13 -- scripts/common.sh@364 -- # decimal 1 00:03:32.467 03:20:13 -- scripts/common.sh@352 -- # local d=1 00:03:32.467 03:20:13 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:32.467 03:20:13 -- scripts/common.sh@354 -- # echo 1 00:03:32.467 03:20:13 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:32.467 03:20:13 -- scripts/common.sh@365 -- # decimal 2 00:03:32.467 03:20:13 -- scripts/common.sh@352 -- # local d=2 00:03:32.467 03:20:13 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:32.467 03:20:13 -- scripts/common.sh@354 -- # echo 2 00:03:32.467 03:20:13 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:32.467 03:20:13 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:32.467 03:20:13 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:32.467 03:20:13 -- scripts/common.sh@367 -- # return 0 00:03:32.467 03:20:13 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:32.467 03:20:13 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:32.467 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:32.467 --rc genhtml_branch_coverage=1 00:03:32.467 --rc genhtml_function_coverage=1 00:03:32.467 --rc genhtml_legend=1 00:03:32.467 --rc geninfo_all_blocks=1 00:03:32.467 --rc geninfo_unexecuted_blocks=1 00:03:32.467 00:03:32.467 ' 00:03:32.467 03:20:13 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:32.467 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:32.467 --rc genhtml_branch_coverage=1 00:03:32.467 --rc genhtml_function_coverage=1 00:03:32.467 --rc genhtml_legend=1 00:03:32.468 --rc geninfo_all_blocks=1 00:03:32.468 --rc geninfo_unexecuted_blocks=1 00:03:32.468 00:03:32.468 ' 00:03:32.468 03:20:13 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:32.468 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:32.468 --rc genhtml_branch_coverage=1 00:03:32.468 --rc genhtml_function_coverage=1 00:03:32.468 --rc genhtml_legend=1 00:03:32.468 --rc geninfo_all_blocks=1 00:03:32.468 --rc geninfo_unexecuted_blocks=1 00:03:32.468 00:03:32.468 ' 00:03:32.468 03:20:13 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:32.468 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:32.468 --rc genhtml_branch_coverage=1 00:03:32.468 --rc genhtml_function_coverage=1 00:03:32.468 --rc genhtml_legend=1 00:03:32.468 --rc geninfo_all_blocks=1 00:03:32.468 --rc geninfo_unexecuted_blocks=1 00:03:32.468 00:03:32.468 ' 00:03:32.468 03:20:13 -- setup/devices.sh@190 -- # trap cleanup EXIT 00:03:32.468 03:20:13 -- setup/devices.sh@192 -- # setup reset 00:03:32.468 03:20:13 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:32.468 03:20:13 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:34.371 03:20:14 -- setup/devices.sh@194 -- # get_zoned_devs 00:03:34.371 03:20:14 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:03:34.371 03:20:14 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:03:34.371 03:20:14 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:03:34.371 03:20:14 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:03:34.371 03:20:14 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:03:34.371 03:20:14 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:03:34.371 03:20:14 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:03:34.371 03:20:14 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:03:34.371 03:20:14 -- setup/devices.sh@196 -- # blocks=() 00:03:34.371 03:20:14 -- setup/devices.sh@196 -- # declare -a blocks 00:03:34.371 03:20:14 -- setup/devices.sh@197 -- # blocks_to_pci=() 00:03:34.371 03:20:14 -- setup/devices.sh@197 -- # declare -A blocks_to_pci 00:03:34.371 03:20:14 -- setup/devices.sh@198 -- # min_disk_size=3221225472 00:03:34.371 03:20:14 -- setup/devices.sh@200 -- # for block in "/sys/block/nvme"!(*c*) 00:03:34.371 03:20:14 -- setup/devices.sh@201 -- # ctrl=nvme0n1 00:03:34.371 03:20:14 -- setup/devices.sh@201 -- # ctrl=nvme0 00:03:34.371 03:20:14 -- setup/devices.sh@202 -- # pci=0000:88:00.0 00:03:34.371 03:20:14 -- setup/devices.sh@203 -- # [[ '' == *\0\0\0\0\:\8\8\:\0\0\.\0* ]] 00:03:34.371 03:20:14 -- setup/devices.sh@204 -- # block_in_use nvme0n1 00:03:34.371 03:20:14 -- scripts/common.sh@380 -- # local block=nvme0n1 pt 00:03:34.371 03:20:14 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:03:34.371 No valid GPT data, bailing 00:03:34.371 03:20:14 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:03:34.371 03:20:14 -- scripts/common.sh@393 -- # pt= 00:03:34.371 03:20:14 -- scripts/common.sh@394 -- # return 1 00:03:34.371 03:20:14 -- setup/devices.sh@204 -- # sec_size_to_bytes nvme0n1 00:03:34.371 03:20:14 -- setup/common.sh@76 -- # local dev=nvme0n1 00:03:34.371 03:20:14 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:03:34.371 03:20:14 -- setup/common.sh@80 -- # echo 1000204886016 00:03:34.371 03:20:14 -- setup/devices.sh@204 -- # (( 1000204886016 >= min_disk_size )) 00:03:34.371 03:20:14 -- setup/devices.sh@205 -- # blocks+=("${block##*/}") 00:03:34.371 03:20:14 -- setup/devices.sh@206 -- # blocks_to_pci["${block##*/}"]=0000:88:00.0 00:03:34.371 03:20:14 -- setup/devices.sh@209 -- # (( 1 > 0 )) 00:03:34.371 03:20:14 -- setup/devices.sh@211 -- # declare -r test_disk=nvme0n1 00:03:34.371 03:20:14 -- setup/devices.sh@213 -- # run_test nvme_mount nvme_mount 00:03:34.371 03:20:14 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:34.371 03:20:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:34.371 03:20:14 -- common/autotest_common.sh@10 -- # set +x 00:03:34.371 ************************************ 00:03:34.371 START TEST nvme_mount 00:03:34.371 ************************************ 00:03:34.371 03:20:14 -- common/autotest_common.sh@1114 -- # nvme_mount 00:03:34.371 03:20:14 -- setup/devices.sh@95 -- # nvme_disk=nvme0n1 00:03:34.371 03:20:14 -- setup/devices.sh@96 -- # nvme_disk_p=nvme0n1p1 00:03:34.371 03:20:14 -- setup/devices.sh@97 -- # nvme_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:34.371 03:20:14 -- setup/devices.sh@98 -- # nvme_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:34.371 03:20:14 -- setup/devices.sh@101 -- # partition_drive nvme0n1 1 00:03:34.371 03:20:14 -- setup/common.sh@39 -- # local disk=nvme0n1 00:03:34.371 03:20:14 -- setup/common.sh@40 -- # local part_no=1 00:03:34.371 03:20:14 -- setup/common.sh@41 -- # local size=1073741824 00:03:34.371 03:20:14 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:03:34.371 03:20:14 -- setup/common.sh@44 -- # parts=() 00:03:34.371 03:20:14 -- setup/common.sh@44 -- # local parts 00:03:34.371 03:20:14 -- setup/common.sh@46 -- # (( part = 1 )) 00:03:34.371 03:20:14 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:34.371 03:20:14 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:03:34.371 03:20:14 -- setup/common.sh@46 -- # (( part++ )) 00:03:34.371 03:20:14 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:34.371 03:20:14 -- setup/common.sh@51 -- # (( size /= 512 )) 00:03:34.371 03:20:14 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:03:34.371 03:20:14 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 00:03:35.311 Creating new GPT entries in memory. 00:03:35.311 GPT data structures destroyed! You may now partition the disk using fdisk or 00:03:35.311 other utilities. 00:03:35.311 03:20:15 -- setup/common.sh@57 -- # (( part = 1 )) 00:03:35.311 03:20:15 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:35.311 03:20:15 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:03:35.311 03:20:15 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:03:35.311 03:20:15 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:03:36.251 Creating new GPT entries in memory. 00:03:36.251 The operation has completed successfully. 00:03:36.251 03:20:16 -- setup/common.sh@57 -- # (( part++ )) 00:03:36.251 03:20:16 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:36.251 03:20:16 -- setup/common.sh@62 -- # wait 2917780 00:03:36.251 03:20:16 -- setup/devices.sh@102 -- # mkfs /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:36.252 03:20:16 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1p1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size= 00:03:36.252 03:20:16 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:36.252 03:20:16 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1p1 ]] 00:03:36.252 03:20:16 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1p1 00:03:36.252 03:20:16 -- setup/common.sh@72 -- # mount /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:36.252 03:20:16 -- setup/devices.sh@105 -- # verify 0000:88:00.0 nvme0n1:nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:36.252 03:20:16 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:36.252 03:20:16 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1p1 00:03:36.252 03:20:16 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:36.252 03:20:16 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:36.252 03:20:16 -- setup/devices.sh@53 -- # local found=0 00:03:36.252 03:20:16 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:36.252 03:20:16 -- setup/devices.sh@56 -- # : 00:03:36.252 03:20:16 -- setup/devices.sh@59 -- # local pci status 00:03:36.252 03:20:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:36.252 03:20:16 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:36.252 03:20:16 -- setup/devices.sh@47 -- # setup output config 00:03:36.252 03:20:16 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:36.252 03:20:16 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:37.188 03:20:17 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:37.188 03:20:17 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1p1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1\p\1* ]] 00:03:37.188 03:20:17 -- setup/devices.sh@63 -- # found=1 00:03:37.188 03:20:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:37.188 03:20:17 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:37.188 03:20:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:37.188 03:20:17 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:37.188 03:20:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:37.188 03:20:17 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:37.188 03:20:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:37.188 03:20:17 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:37.188 03:20:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:37.188 03:20:17 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:37.188 03:20:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:37.188 03:20:17 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:37.188 03:20:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:37.188 03:20:17 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:37.188 03:20:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:37.188 03:20:17 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:37.188 03:20:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:37.188 03:20:17 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:37.188 03:20:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:37.188 03:20:17 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:37.188 03:20:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:37.447 03:20:17 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:37.447 03:20:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:37.447 03:20:17 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:37.447 03:20:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:37.447 03:20:17 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:37.447 03:20:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:37.447 03:20:17 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:37.447 03:20:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:37.447 03:20:17 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:37.447 03:20:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:37.447 03:20:17 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:37.447 03:20:17 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:37.447 03:20:18 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:37.447 03:20:18 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:03:37.447 03:20:18 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:37.447 03:20:18 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:37.447 03:20:18 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:37.447 03:20:18 -- setup/devices.sh@110 -- # cleanup_nvme 00:03:37.447 03:20:18 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:37.447 03:20:18 -- setup/devices.sh@21 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:37.447 03:20:18 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:37.447 03:20:18 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:03:37.447 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:03:37.447 03:20:18 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:03:37.447 03:20:18 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:03:37.709 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:03:37.709 /dev/nvme0n1: 8 bytes were erased at offset 0xe8e0db5e00 (gpt): 45 46 49 20 50 41 52 54 00:03:37.709 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:03:37.709 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:03:37.709 03:20:18 -- setup/devices.sh@113 -- # mkfs /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 1024M 00:03:37.709 03:20:18 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size=1024M 00:03:37.709 03:20:18 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:37.709 03:20:18 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1 ]] 00:03:37.709 03:20:18 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1 1024M 00:03:37.970 03:20:18 -- setup/common.sh@72 -- # mount /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:37.970 03:20:18 -- setup/devices.sh@116 -- # verify 0000:88:00.0 nvme0n1:nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:37.970 03:20:18 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:37.970 03:20:18 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1 00:03:37.970 03:20:18 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:37.970 03:20:18 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:37.970 03:20:18 -- setup/devices.sh@53 -- # local found=0 00:03:37.970 03:20:18 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:37.970 03:20:18 -- setup/devices.sh@56 -- # : 00:03:37.970 03:20:18 -- setup/devices.sh@59 -- # local pci status 00:03:37.970 03:20:18 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:37.970 03:20:18 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:37.970 03:20:18 -- setup/devices.sh@47 -- # setup output config 00:03:37.970 03:20:18 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:37.970 03:20:18 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:38.910 03:20:19 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.910 03:20:19 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1* ]] 00:03:38.910 03:20:19 -- setup/devices.sh@63 -- # found=1 00:03:38.910 03:20:19 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.910 03:20:19 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.910 03:20:19 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.910 03:20:19 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.910 03:20:19 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.910 03:20:19 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.910 03:20:19 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.910 03:20:19 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.910 03:20:19 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.910 03:20:19 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.910 03:20:19 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.910 03:20:19 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.910 03:20:19 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.910 03:20:19 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.910 03:20:19 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.910 03:20:19 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.910 03:20:19 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.910 03:20:19 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.910 03:20:19 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.910 03:20:19 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.910 03:20:19 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.910 03:20:19 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.910 03:20:19 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.910 03:20:19 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.910 03:20:19 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.910 03:20:19 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.910 03:20:19 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.910 03:20:19 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.910 03:20:19 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.910 03:20:19 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.910 03:20:19 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.910 03:20:19 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.910 03:20:19 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:39.170 03:20:19 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:39.170 03:20:19 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:03:39.170 03:20:19 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:39.170 03:20:19 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:39.170 03:20:19 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:39.170 03:20:19 -- setup/devices.sh@123 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:39.170 03:20:19 -- setup/devices.sh@125 -- # verify 0000:88:00.0 data@nvme0n1 '' '' 00:03:39.170 03:20:19 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:39.170 03:20:19 -- setup/devices.sh@49 -- # local mounts=data@nvme0n1 00:03:39.170 03:20:19 -- setup/devices.sh@50 -- # local mount_point= 00:03:39.170 03:20:19 -- setup/devices.sh@51 -- # local test_file= 00:03:39.170 03:20:19 -- setup/devices.sh@53 -- # local found=0 00:03:39.170 03:20:19 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:03:39.170 03:20:19 -- setup/devices.sh@59 -- # local pci status 00:03:39.170 03:20:19 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:39.170 03:20:19 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:39.170 03:20:19 -- setup/devices.sh@47 -- # setup output config 00:03:39.170 03:20:19 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:39.170 03:20:19 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:40.110 03:20:20 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:40.110 03:20:20 -- setup/devices.sh@62 -- # [[ Active devices: data@nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\d\a\t\a\@\n\v\m\e\0\n\1* ]] 00:03:40.110 03:20:20 -- setup/devices.sh@63 -- # found=1 00:03:40.110 03:20:20 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.110 03:20:20 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:40.110 03:20:20 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.110 03:20:20 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:40.110 03:20:20 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.110 03:20:20 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:40.110 03:20:20 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.110 03:20:20 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:40.110 03:20:20 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.110 03:20:20 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:40.110 03:20:20 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.110 03:20:20 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:40.110 03:20:20 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.110 03:20:20 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:40.110 03:20:20 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.369 03:20:20 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:40.369 03:20:20 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.369 03:20:20 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:40.369 03:20:20 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.369 03:20:20 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:40.369 03:20:20 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.369 03:20:20 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:40.369 03:20:20 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.369 03:20:20 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:40.369 03:20:20 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.369 03:20:20 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:40.369 03:20:20 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.369 03:20:20 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:40.369 03:20:20 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.369 03:20:20 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:40.369 03:20:20 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.369 03:20:20 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:40.369 03:20:20 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.369 03:20:20 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:40.369 03:20:20 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:03:40.369 03:20:20 -- setup/devices.sh@68 -- # return 0 00:03:40.369 03:20:20 -- setup/devices.sh@128 -- # cleanup_nvme 00:03:40.369 03:20:20 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:40.369 03:20:20 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:40.369 03:20:20 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:03:40.369 03:20:20 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:03:40.369 /dev/nvme0n1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:03:40.369 00:03:40.369 real 0m6.384s 00:03:40.369 user 0m1.477s 00:03:40.369 sys 0m2.501s 00:03:40.369 03:20:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:40.369 03:20:20 -- common/autotest_common.sh@10 -- # set +x 00:03:40.369 ************************************ 00:03:40.369 END TEST nvme_mount 00:03:40.369 ************************************ 00:03:40.369 03:20:20 -- setup/devices.sh@214 -- # run_test dm_mount dm_mount 00:03:40.369 03:20:20 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:40.369 03:20:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:40.369 03:20:20 -- common/autotest_common.sh@10 -- # set +x 00:03:40.369 ************************************ 00:03:40.369 START TEST dm_mount 00:03:40.369 ************************************ 00:03:40.369 03:20:20 -- common/autotest_common.sh@1114 -- # dm_mount 00:03:40.369 03:20:20 -- setup/devices.sh@144 -- # pv=nvme0n1 00:03:40.369 03:20:20 -- setup/devices.sh@145 -- # pv0=nvme0n1p1 00:03:40.369 03:20:20 -- setup/devices.sh@146 -- # pv1=nvme0n1p2 00:03:40.369 03:20:20 -- setup/devices.sh@148 -- # partition_drive nvme0n1 00:03:40.369 03:20:20 -- setup/common.sh@39 -- # local disk=nvme0n1 00:03:40.369 03:20:20 -- setup/common.sh@40 -- # local part_no=2 00:03:40.369 03:20:20 -- setup/common.sh@41 -- # local size=1073741824 00:03:40.369 03:20:20 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:03:40.369 03:20:20 -- setup/common.sh@44 -- # parts=() 00:03:40.369 03:20:20 -- setup/common.sh@44 -- # local parts 00:03:40.369 03:20:20 -- setup/common.sh@46 -- # (( part = 1 )) 00:03:40.369 03:20:20 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:40.369 03:20:20 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:03:40.369 03:20:20 -- setup/common.sh@46 -- # (( part++ )) 00:03:40.369 03:20:20 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:40.369 03:20:20 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:03:40.370 03:20:20 -- setup/common.sh@46 -- # (( part++ )) 00:03:40.370 03:20:20 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:40.370 03:20:20 -- setup/common.sh@51 -- # (( size /= 512 )) 00:03:40.370 03:20:20 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:03:40.370 03:20:20 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 nvme0n1p2 00:03:41.756 Creating new GPT entries in memory. 00:03:41.756 GPT data structures destroyed! You may now partition the disk using fdisk or 00:03:41.756 other utilities. 00:03:41.756 03:20:22 -- setup/common.sh@57 -- # (( part = 1 )) 00:03:41.756 03:20:22 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:41.756 03:20:22 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:03:41.756 03:20:22 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:03:41.756 03:20:22 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:03:42.699 Creating new GPT entries in memory. 00:03:42.699 The operation has completed successfully. 00:03:42.699 03:20:23 -- setup/common.sh@57 -- # (( part++ )) 00:03:42.699 03:20:23 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:42.699 03:20:23 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:03:42.699 03:20:23 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:03:42.699 03:20:23 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=2:2099200:4196351 00:03:43.638 The operation has completed successfully. 00:03:43.638 03:20:24 -- setup/common.sh@57 -- # (( part++ )) 00:03:43.638 03:20:24 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:43.638 03:20:24 -- setup/common.sh@62 -- # wait 2920243 00:03:43.638 03:20:24 -- setup/devices.sh@150 -- # dm_name=nvme_dm_test 00:03:43.638 03:20:24 -- setup/devices.sh@151 -- # dm_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:43.638 03:20:24 -- setup/devices.sh@152 -- # dm_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:43.638 03:20:24 -- setup/devices.sh@155 -- # dmsetup create nvme_dm_test 00:03:43.638 03:20:24 -- setup/devices.sh@160 -- # for t in {1..5} 00:03:43.638 03:20:24 -- setup/devices.sh@161 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:03:43.638 03:20:24 -- setup/devices.sh@161 -- # break 00:03:43.638 03:20:24 -- setup/devices.sh@164 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:03:43.638 03:20:24 -- setup/devices.sh@165 -- # readlink -f /dev/mapper/nvme_dm_test 00:03:43.638 03:20:24 -- setup/devices.sh@165 -- # dm=/dev/dm-0 00:03:43.638 03:20:24 -- setup/devices.sh@166 -- # dm=dm-0 00:03:43.638 03:20:24 -- setup/devices.sh@168 -- # [[ -e /sys/class/block/nvme0n1p1/holders/dm-0 ]] 00:03:43.638 03:20:24 -- setup/devices.sh@169 -- # [[ -e /sys/class/block/nvme0n1p2/holders/dm-0 ]] 00:03:43.638 03:20:24 -- setup/devices.sh@171 -- # mkfs /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:43.638 03:20:24 -- setup/common.sh@66 -- # local dev=/dev/mapper/nvme_dm_test mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount size= 00:03:43.638 03:20:24 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:43.638 03:20:24 -- setup/common.sh@70 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:03:43.638 03:20:24 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/mapper/nvme_dm_test 00:03:43.638 03:20:24 -- setup/common.sh@72 -- # mount /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:43.638 03:20:24 -- setup/devices.sh@174 -- # verify 0000:88:00.0 nvme0n1:nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:43.638 03:20:24 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:43.638 03:20:24 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme_dm_test 00:03:43.638 03:20:24 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:43.638 03:20:24 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:43.638 03:20:24 -- setup/devices.sh@53 -- # local found=0 00:03:43.638 03:20:24 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:03:43.639 03:20:24 -- setup/devices.sh@56 -- # : 00:03:43.639 03:20:24 -- setup/devices.sh@59 -- # local pci status 00:03:43.639 03:20:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.639 03:20:24 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:43.639 03:20:24 -- setup/devices.sh@47 -- # setup output config 00:03:43.639 03:20:24 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:43.639 03:20:24 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:44.579 03:20:25 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:44.579 03:20:25 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0,mount@nvme0n1:nvme_dm_test, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\_\d\m\_\t\e\s\t* ]] 00:03:44.579 03:20:25 -- setup/devices.sh@63 -- # found=1 00:03:44.579 03:20:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:44.579 03:20:25 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:44.579 03:20:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:44.579 03:20:25 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:44.579 03:20:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:44.579 03:20:25 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:44.579 03:20:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:44.579 03:20:25 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:44.579 03:20:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:44.579 03:20:25 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:44.579 03:20:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:44.579 03:20:25 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:44.579 03:20:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:44.579 03:20:25 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:44.579 03:20:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:44.579 03:20:25 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:44.579 03:20:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:44.579 03:20:25 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:44.579 03:20:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:44.579 03:20:25 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:44.579 03:20:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:44.579 03:20:25 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:44.579 03:20:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:44.579 03:20:25 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:44.579 03:20:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:44.579 03:20:25 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:44.579 03:20:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:44.579 03:20:25 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:44.579 03:20:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:44.579 03:20:25 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:44.579 03:20:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:44.579 03:20:25 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:44.579 03:20:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:44.838 03:20:25 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:44.838 03:20:25 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount ]] 00:03:44.839 03:20:25 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:44.839 03:20:25 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:03:44.839 03:20:25 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:44.839 03:20:25 -- setup/devices.sh@182 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:44.839 03:20:25 -- setup/devices.sh@184 -- # verify 0000:88:00.0 holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 '' '' 00:03:44.839 03:20:25 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:44.839 03:20:25 -- setup/devices.sh@49 -- # local mounts=holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 00:03:44.839 03:20:25 -- setup/devices.sh@50 -- # local mount_point= 00:03:44.839 03:20:25 -- setup/devices.sh@51 -- # local test_file= 00:03:44.839 03:20:25 -- setup/devices.sh@53 -- # local found=0 00:03:44.839 03:20:25 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:03:44.839 03:20:25 -- setup/devices.sh@59 -- # local pci status 00:03:44.839 03:20:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:44.839 03:20:25 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:44.839 03:20:25 -- setup/devices.sh@47 -- # setup output config 00:03:44.839 03:20:25 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:44.839 03:20:25 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:45.777 03:20:26 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:45.777 03:20:26 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\1\:\d\m\-\0\,\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\2\:\d\m\-\0* ]] 00:03:45.777 03:20:26 -- setup/devices.sh@63 -- # found=1 00:03:45.777 03:20:26 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:45.777 03:20:26 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:45.777 03:20:26 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.038 03:20:26 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.038 03:20:26 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.038 03:20:26 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.038 03:20:26 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.038 03:20:26 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.038 03:20:26 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.038 03:20:26 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.038 03:20:26 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.038 03:20:26 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.038 03:20:26 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.038 03:20:26 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.038 03:20:26 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.038 03:20:26 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.038 03:20:26 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.038 03:20:26 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.038 03:20:26 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.038 03:20:26 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.038 03:20:26 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.038 03:20:26 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.038 03:20:26 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.038 03:20:26 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.038 03:20:26 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.038 03:20:26 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.038 03:20:26 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.038 03:20:26 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.038 03:20:26 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.038 03:20:26 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.038 03:20:26 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.038 03:20:26 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.038 03:20:26 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.038 03:20:26 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:46.038 03:20:26 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:03:46.038 03:20:26 -- setup/devices.sh@68 -- # return 0 00:03:46.038 03:20:26 -- setup/devices.sh@187 -- # cleanup_dm 00:03:46.038 03:20:26 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:46.038 03:20:26 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:03:46.038 03:20:26 -- setup/devices.sh@37 -- # dmsetup remove --force nvme_dm_test 00:03:46.300 03:20:26 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:46.300 03:20:26 -- setup/devices.sh@40 -- # wipefs --all /dev/nvme0n1p1 00:03:46.300 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:03:46.300 03:20:26 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:03:46.300 03:20:26 -- setup/devices.sh@43 -- # wipefs --all /dev/nvme0n1p2 00:03:46.300 00:03:46.300 real 0m5.728s 00:03:46.300 user 0m0.909s 00:03:46.300 sys 0m1.679s 00:03:46.300 03:20:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:46.300 03:20:26 -- common/autotest_common.sh@10 -- # set +x 00:03:46.300 ************************************ 00:03:46.300 END TEST dm_mount 00:03:46.300 ************************************ 00:03:46.300 03:20:26 -- setup/devices.sh@1 -- # cleanup 00:03:46.300 03:20:26 -- setup/devices.sh@11 -- # cleanup_nvme 00:03:46.300 03:20:26 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:46.300 03:20:26 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:46.300 03:20:26 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:03:46.300 03:20:26 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:03:46.300 03:20:26 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:03:46.559 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:03:46.559 /dev/nvme0n1: 8 bytes were erased at offset 0xe8e0db5e00 (gpt): 45 46 49 20 50 41 52 54 00:03:46.559 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:03:46.559 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:03:46.559 03:20:27 -- setup/devices.sh@12 -- # cleanup_dm 00:03:46.559 03:20:27 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:46.559 03:20:27 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:03:46.559 03:20:27 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:46.559 03:20:27 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:03:46.559 03:20:27 -- setup/devices.sh@14 -- # [[ -b /dev/nvme0n1 ]] 00:03:46.559 03:20:27 -- setup/devices.sh@15 -- # wipefs --all /dev/nvme0n1 00:03:46.559 00:03:46.559 real 0m14.102s 00:03:46.559 user 0m3.085s 00:03:46.559 sys 0m5.252s 00:03:46.559 03:20:27 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:46.559 03:20:27 -- common/autotest_common.sh@10 -- # set +x 00:03:46.559 ************************************ 00:03:46.559 END TEST devices 00:03:46.559 ************************************ 00:03:46.559 00:03:46.559 real 0m43.743s 00:03:46.559 user 0m12.601s 00:03:46.559 sys 0m19.749s 00:03:46.559 03:20:27 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:46.559 03:20:27 -- common/autotest_common.sh@10 -- # set +x 00:03:46.559 ************************************ 00:03:46.559 END TEST setup.sh 00:03:46.559 ************************************ 00:03:46.559 03:20:27 -- spdk/autotest.sh@126 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:03:47.497 Hugepages 00:03:47.497 node hugesize free / total 00:03:47.497 node0 1048576kB 0 / 0 00:03:47.497 node0 2048kB 2048 / 2048 00:03:47.497 node1 1048576kB 0 / 0 00:03:47.756 node1 2048kB 0 / 0 00:03:47.756 00:03:47.756 Type BDF Vendor Device NUMA Driver Device Block devices 00:03:47.756 I/OAT 0000:00:04.0 8086 0e20 0 ioatdma - - 00:03:47.756 I/OAT 0000:00:04.1 8086 0e21 0 ioatdma - - 00:03:47.756 I/OAT 0000:00:04.2 8086 0e22 0 ioatdma - - 00:03:47.756 I/OAT 0000:00:04.3 8086 0e23 0 ioatdma - - 00:03:47.756 I/OAT 0000:00:04.4 8086 0e24 0 ioatdma - - 00:03:47.756 I/OAT 0000:00:04.5 8086 0e25 0 ioatdma - - 00:03:47.756 I/OAT 0000:00:04.6 8086 0e26 0 ioatdma - - 00:03:47.756 I/OAT 0000:00:04.7 8086 0e27 0 ioatdma - - 00:03:47.756 I/OAT 0000:80:04.0 8086 0e20 1 ioatdma - - 00:03:47.757 I/OAT 0000:80:04.1 8086 0e21 1 ioatdma - - 00:03:47.757 I/OAT 0000:80:04.2 8086 0e22 1 ioatdma - - 00:03:47.757 I/OAT 0000:80:04.3 8086 0e23 1 ioatdma - - 00:03:47.757 I/OAT 0000:80:04.4 8086 0e24 1 ioatdma - - 00:03:47.757 I/OAT 0000:80:04.5 8086 0e25 1 ioatdma - - 00:03:47.757 I/OAT 0000:80:04.6 8086 0e26 1 ioatdma - - 00:03:47.757 I/OAT 0000:80:04.7 8086 0e27 1 ioatdma - - 00:03:47.757 NVMe 0000:88:00.0 8086 0a54 1 nvme nvme0 nvme0n1 00:03:47.757 03:20:28 -- spdk/autotest.sh@128 -- # uname -s 00:03:47.757 03:20:28 -- spdk/autotest.sh@128 -- # [[ Linux == Linux ]] 00:03:47.757 03:20:28 -- spdk/autotest.sh@130 -- # nvme_namespace_revert 00:03:47.757 03:20:28 -- common/autotest_common.sh@1526 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:49.144 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:49.144 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:49.144 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:49.144 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:49.144 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:49.144 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:49.144 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:49.144 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:49.144 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:49.144 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:49.144 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:49.144 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:49.144 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:49.144 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:49.144 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:49.144 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:50.088 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:03:50.088 03:20:30 -- common/autotest_common.sh@1527 -- # sleep 1 00:03:51.028 03:20:31 -- common/autotest_common.sh@1528 -- # bdfs=() 00:03:51.028 03:20:31 -- common/autotest_common.sh@1528 -- # local bdfs 00:03:51.028 03:20:31 -- common/autotest_common.sh@1529 -- # bdfs=($(get_nvme_bdfs)) 00:03:51.028 03:20:31 -- common/autotest_common.sh@1529 -- # get_nvme_bdfs 00:03:51.028 03:20:31 -- common/autotest_common.sh@1508 -- # bdfs=() 00:03:51.028 03:20:31 -- common/autotest_common.sh@1508 -- # local bdfs 00:03:51.028 03:20:31 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:03:51.028 03:20:31 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:03:51.028 03:20:31 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:03:51.286 03:20:31 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:03:51.286 03:20:31 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:03:51.286 03:20:31 -- common/autotest_common.sh@1531 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:52.253 Waiting for block devices as requested 00:03:52.253 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:03:52.535 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:03:52.535 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:03:52.535 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:03:52.794 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:03:52.794 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:03:52.794 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:03:52.794 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:03:53.053 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:03:53.053 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:03:53.053 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:03:53.053 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:03:53.312 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:03:53.312 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:03:53.312 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:03:53.312 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:03:53.571 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:03:53.571 03:20:34 -- common/autotest_common.sh@1533 -- # for bdf in "${bdfs[@]}" 00:03:53.571 03:20:34 -- common/autotest_common.sh@1534 -- # get_nvme_ctrlr_from_bdf 0000:88:00.0 00:03:53.571 03:20:34 -- common/autotest_common.sh@1497 -- # readlink -f /sys/class/nvme/nvme0 00:03:53.571 03:20:34 -- common/autotest_common.sh@1497 -- # grep 0000:88:00.0/nvme/nvme 00:03:53.571 03:20:34 -- common/autotest_common.sh@1497 -- # bdf_sysfs_path=/sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 00:03:53.571 03:20:34 -- common/autotest_common.sh@1498 -- # [[ -z /sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 ]] 00:03:53.571 03:20:34 -- common/autotest_common.sh@1502 -- # basename /sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 00:03:53.571 03:20:34 -- common/autotest_common.sh@1502 -- # printf '%s\n' nvme0 00:03:53.571 03:20:34 -- common/autotest_common.sh@1534 -- # nvme_ctrlr=/dev/nvme0 00:03:53.571 03:20:34 -- common/autotest_common.sh@1535 -- # [[ -z /dev/nvme0 ]] 00:03:53.571 03:20:34 -- common/autotest_common.sh@1540 -- # nvme id-ctrl /dev/nvme0 00:03:53.571 03:20:34 -- common/autotest_common.sh@1540 -- # grep oacs 00:03:53.571 03:20:34 -- common/autotest_common.sh@1540 -- # cut -d: -f2 00:03:53.571 03:20:34 -- common/autotest_common.sh@1540 -- # oacs=' 0xf' 00:03:53.571 03:20:34 -- common/autotest_common.sh@1541 -- # oacs_ns_manage=8 00:03:53.571 03:20:34 -- common/autotest_common.sh@1543 -- # [[ 8 -ne 0 ]] 00:03:53.571 03:20:34 -- common/autotest_common.sh@1549 -- # nvme id-ctrl /dev/nvme0 00:03:53.571 03:20:34 -- common/autotest_common.sh@1549 -- # grep unvmcap 00:03:53.571 03:20:34 -- common/autotest_common.sh@1549 -- # cut -d: -f2 00:03:53.571 03:20:34 -- common/autotest_common.sh@1549 -- # unvmcap=' 0' 00:03:53.571 03:20:34 -- common/autotest_common.sh@1550 -- # [[ 0 -eq 0 ]] 00:03:53.571 03:20:34 -- common/autotest_common.sh@1552 -- # continue 00:03:53.571 03:20:34 -- spdk/autotest.sh@133 -- # timing_exit pre_cleanup 00:03:53.571 03:20:34 -- common/autotest_common.sh@728 -- # xtrace_disable 00:03:53.571 03:20:34 -- common/autotest_common.sh@10 -- # set +x 00:03:53.571 03:20:34 -- spdk/autotest.sh@136 -- # timing_enter afterboot 00:03:53.571 03:20:34 -- common/autotest_common.sh@722 -- # xtrace_disable 00:03:53.571 03:20:34 -- common/autotest_common.sh@10 -- # set +x 00:03:53.571 03:20:34 -- spdk/autotest.sh@137 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:54.956 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:54.956 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:54.956 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:54.956 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:54.956 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:54.956 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:54.956 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:54.956 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:54.956 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:54.956 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:54.956 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:54.956 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:54.956 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:54.957 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:54.957 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:54.957 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:55.898 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:03:55.898 03:20:36 -- spdk/autotest.sh@138 -- # timing_exit afterboot 00:03:55.898 03:20:36 -- common/autotest_common.sh@728 -- # xtrace_disable 00:03:55.898 03:20:36 -- common/autotest_common.sh@10 -- # set +x 00:03:56.158 03:20:36 -- spdk/autotest.sh@142 -- # opal_revert_cleanup 00:03:56.158 03:20:36 -- common/autotest_common.sh@1586 -- # mapfile -t bdfs 00:03:56.158 03:20:36 -- common/autotest_common.sh@1586 -- # get_nvme_bdfs_by_id 0x0a54 00:03:56.158 03:20:36 -- common/autotest_common.sh@1572 -- # bdfs=() 00:03:56.158 03:20:36 -- common/autotest_common.sh@1572 -- # local bdfs 00:03:56.158 03:20:36 -- common/autotest_common.sh@1574 -- # get_nvme_bdfs 00:03:56.158 03:20:36 -- common/autotest_common.sh@1508 -- # bdfs=() 00:03:56.159 03:20:36 -- common/autotest_common.sh@1508 -- # local bdfs 00:03:56.159 03:20:36 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:03:56.159 03:20:36 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:03:56.159 03:20:36 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:03:56.159 03:20:36 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:03:56.159 03:20:36 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:03:56.159 03:20:36 -- common/autotest_common.sh@1574 -- # for bdf in $(get_nvme_bdfs) 00:03:56.159 03:20:36 -- common/autotest_common.sh@1575 -- # cat /sys/bus/pci/devices/0000:88:00.0/device 00:03:56.159 03:20:36 -- common/autotest_common.sh@1575 -- # device=0x0a54 00:03:56.159 03:20:36 -- common/autotest_common.sh@1576 -- # [[ 0x0a54 == \0\x\0\a\5\4 ]] 00:03:56.159 03:20:36 -- common/autotest_common.sh@1577 -- # bdfs+=($bdf) 00:03:56.159 03:20:36 -- common/autotest_common.sh@1581 -- # printf '%s\n' 0000:88:00.0 00:03:56.159 03:20:36 -- common/autotest_common.sh@1587 -- # [[ -z 0000:88:00.0 ]] 00:03:56.159 03:20:36 -- common/autotest_common.sh@1592 -- # spdk_tgt_pid=2925547 00:03:56.159 03:20:36 -- common/autotest_common.sh@1591 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:03:56.159 03:20:36 -- common/autotest_common.sh@1593 -- # waitforlisten 2925547 00:03:56.159 03:20:36 -- common/autotest_common.sh@829 -- # '[' -z 2925547 ']' 00:03:56.159 03:20:36 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:03:56.159 03:20:36 -- common/autotest_common.sh@834 -- # local max_retries=100 00:03:56.159 03:20:36 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:03:56.159 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:03:56.159 03:20:36 -- common/autotest_common.sh@838 -- # xtrace_disable 00:03:56.159 03:20:36 -- common/autotest_common.sh@10 -- # set +x 00:03:56.159 [2024-11-21 03:20:36.672226] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:03:56.159 [2024-11-21 03:20:36.672324] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2925547 ] 00:03:56.159 EAL: No free 2048 kB hugepages reported on node 1 00:03:56.159 [2024-11-21 03:20:36.732564] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:03:56.418 [2024-11-21 03:20:36.839881] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:03:56.418 [2024-11-21 03:20:36.840029] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:03:57.354 03:20:37 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:03:57.354 03:20:37 -- common/autotest_common.sh@862 -- # return 0 00:03:57.354 03:20:37 -- common/autotest_common.sh@1595 -- # bdf_id=0 00:03:57.354 03:20:37 -- common/autotest_common.sh@1596 -- # for bdf in "${bdfs[@]}" 00:03:57.354 03:20:37 -- common/autotest_common.sh@1597 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b nvme0 -t pcie -a 0000:88:00.0 00:04:00.653 nvme0n1 00:04:00.653 03:20:40 -- common/autotest_common.sh@1599 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_opal_revert -b nvme0 -p test 00:04:00.653 [2024-11-21 03:20:41.082720] nvme_opal.c:2059:spdk_opal_cmd_revert_tper: *ERROR*: Error on starting admin SP session with error 18 00:04:00.653 [2024-11-21 03:20:41.082771] vbdev_opal_rpc.c: 134:rpc_bdev_nvme_opal_revert: *ERROR*: Revert TPer failure: 18 00:04:00.653 request: 00:04:00.653 { 00:04:00.653 "nvme_ctrlr_name": "nvme0", 00:04:00.653 "password": "test", 00:04:00.653 "method": "bdev_nvme_opal_revert", 00:04:00.653 "req_id": 1 00:04:00.653 } 00:04:00.653 Got JSON-RPC error response 00:04:00.653 response: 00:04:00.653 { 00:04:00.653 "code": -32603, 00:04:00.653 "message": "Internal error" 00:04:00.653 } 00:04:00.653 03:20:41 -- common/autotest_common.sh@1599 -- # true 00:04:00.653 03:20:41 -- common/autotest_common.sh@1600 -- # (( ++bdf_id )) 00:04:00.653 03:20:41 -- common/autotest_common.sh@1603 -- # killprocess 2925547 00:04:00.653 03:20:41 -- common/autotest_common.sh@936 -- # '[' -z 2925547 ']' 00:04:00.653 03:20:41 -- common/autotest_common.sh@940 -- # kill -0 2925547 00:04:00.653 03:20:41 -- common/autotest_common.sh@941 -- # uname 00:04:00.653 03:20:41 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:00.653 03:20:41 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2925547 00:04:00.653 03:20:41 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:00.653 03:20:41 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:00.653 03:20:41 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2925547' 00:04:00.653 killing process with pid 2925547 00:04:00.653 03:20:41 -- common/autotest_common.sh@955 -- # kill 2925547 00:04:00.653 03:20:41 -- common/autotest_common.sh@960 -- # wait 2925547 00:04:02.560 03:20:42 -- spdk/autotest.sh@148 -- # '[' 0 -eq 1 ']' 00:04:02.560 03:20:42 -- spdk/autotest.sh@152 -- # '[' 1 -eq 1 ']' 00:04:02.560 03:20:42 -- spdk/autotest.sh@153 -- # [[ 0 -eq 1 ]] 00:04:02.560 03:20:42 -- spdk/autotest.sh@153 -- # [[ 0 -eq 1 ]] 00:04:02.560 03:20:42 -- spdk/autotest.sh@160 -- # timing_enter lib 00:04:02.560 03:20:42 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:02.560 03:20:42 -- common/autotest_common.sh@10 -- # set +x 00:04:02.560 03:20:42 -- spdk/autotest.sh@162 -- # run_test env /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:04:02.560 03:20:42 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:02.560 03:20:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:02.560 03:20:42 -- common/autotest_common.sh@10 -- # set +x 00:04:02.560 ************************************ 00:04:02.560 START TEST env 00:04:02.560 ************************************ 00:04:02.560 03:20:42 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:04:02.560 * Looking for test storage... 00:04:02.560 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env 00:04:02.560 03:20:43 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:02.560 03:20:43 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:02.560 03:20:43 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:02.561 03:20:43 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:02.561 03:20:43 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:02.561 03:20:43 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:02.561 03:20:43 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:02.561 03:20:43 -- scripts/common.sh@335 -- # IFS=.-: 00:04:02.561 03:20:43 -- scripts/common.sh@335 -- # read -ra ver1 00:04:02.561 03:20:43 -- scripts/common.sh@336 -- # IFS=.-: 00:04:02.561 03:20:43 -- scripts/common.sh@336 -- # read -ra ver2 00:04:02.561 03:20:43 -- scripts/common.sh@337 -- # local 'op=<' 00:04:02.561 03:20:43 -- scripts/common.sh@339 -- # ver1_l=2 00:04:02.561 03:20:43 -- scripts/common.sh@340 -- # ver2_l=1 00:04:02.561 03:20:43 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:02.561 03:20:43 -- scripts/common.sh@343 -- # case "$op" in 00:04:02.561 03:20:43 -- scripts/common.sh@344 -- # : 1 00:04:02.561 03:20:43 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:02.561 03:20:43 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:02.561 03:20:43 -- scripts/common.sh@364 -- # decimal 1 00:04:02.561 03:20:43 -- scripts/common.sh@352 -- # local d=1 00:04:02.561 03:20:43 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:02.561 03:20:43 -- scripts/common.sh@354 -- # echo 1 00:04:02.561 03:20:43 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:02.561 03:20:43 -- scripts/common.sh@365 -- # decimal 2 00:04:02.561 03:20:43 -- scripts/common.sh@352 -- # local d=2 00:04:02.561 03:20:43 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:02.561 03:20:43 -- scripts/common.sh@354 -- # echo 2 00:04:02.561 03:20:43 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:02.561 03:20:43 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:02.561 03:20:43 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:02.561 03:20:43 -- scripts/common.sh@367 -- # return 0 00:04:02.561 03:20:43 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:02.561 03:20:43 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:02.561 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:02.561 --rc genhtml_branch_coverage=1 00:04:02.561 --rc genhtml_function_coverage=1 00:04:02.561 --rc genhtml_legend=1 00:04:02.561 --rc geninfo_all_blocks=1 00:04:02.561 --rc geninfo_unexecuted_blocks=1 00:04:02.561 00:04:02.561 ' 00:04:02.561 03:20:43 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:02.561 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:02.561 --rc genhtml_branch_coverage=1 00:04:02.561 --rc genhtml_function_coverage=1 00:04:02.561 --rc genhtml_legend=1 00:04:02.561 --rc geninfo_all_blocks=1 00:04:02.561 --rc geninfo_unexecuted_blocks=1 00:04:02.561 00:04:02.561 ' 00:04:02.561 03:20:43 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:02.561 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:02.561 --rc genhtml_branch_coverage=1 00:04:02.561 --rc genhtml_function_coverage=1 00:04:02.561 --rc genhtml_legend=1 00:04:02.561 --rc geninfo_all_blocks=1 00:04:02.561 --rc geninfo_unexecuted_blocks=1 00:04:02.561 00:04:02.561 ' 00:04:02.561 03:20:43 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:02.561 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:02.561 --rc genhtml_branch_coverage=1 00:04:02.561 --rc genhtml_function_coverage=1 00:04:02.561 --rc genhtml_legend=1 00:04:02.561 --rc geninfo_all_blocks=1 00:04:02.561 --rc geninfo_unexecuted_blocks=1 00:04:02.561 00:04:02.561 ' 00:04:02.561 03:20:43 -- env/env.sh@10 -- # run_test env_memory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:04:02.561 03:20:43 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:02.561 03:20:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:02.561 03:20:43 -- common/autotest_common.sh@10 -- # set +x 00:04:02.561 ************************************ 00:04:02.561 START TEST env_memory 00:04:02.561 ************************************ 00:04:02.561 03:20:43 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:04:02.561 00:04:02.561 00:04:02.561 CUnit - A unit testing framework for C - Version 2.1-3 00:04:02.561 http://cunit.sourceforge.net/ 00:04:02.561 00:04:02.561 00:04:02.561 Suite: memory 00:04:02.561 Test: alloc and free memory map ...[2024-11-21 03:20:43.131883] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 283:spdk_mem_map_alloc: *ERROR*: Initial mem_map notify failed 00:04:02.561 passed 00:04:02.561 Test: mem map translation ...[2024-11-21 03:20:43.151999] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=2097152 len=1234 00:04:02.561 [2024-11-21 03:20:43.152021] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=1234 len=2097152 00:04:02.561 [2024-11-21 03:20:43.152081] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 584:spdk_mem_map_set_translation: *ERROR*: invalid usermode virtual address 281474976710656 00:04:02.561 [2024-11-21 03:20:43.152095] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 600:spdk_mem_map_set_translation: *ERROR*: could not get 0xffffffe00000 map 00:04:02.561 passed 00:04:02.561 Test: mem map registration ...[2024-11-21 03:20:43.195082] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x200000 len=1234 00:04:02.561 [2024-11-21 03:20:43.195105] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x4d2 len=2097152 00:04:02.821 passed 00:04:02.821 Test: mem map adjacent registrations ...passed 00:04:02.821 00:04:02.821 Run Summary: Type Total Ran Passed Failed Inactive 00:04:02.821 suites 1 1 n/a 0 0 00:04:02.821 tests 4 4 4 0 0 00:04:02.821 asserts 152 152 152 0 n/a 00:04:02.821 00:04:02.821 Elapsed time = 0.149 seconds 00:04:02.821 00:04:02.821 real 0m0.157s 00:04:02.821 user 0m0.149s 00:04:02.821 sys 0m0.008s 00:04:02.821 03:20:43 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:02.821 03:20:43 -- common/autotest_common.sh@10 -- # set +x 00:04:02.821 ************************************ 00:04:02.821 END TEST env_memory 00:04:02.821 ************************************ 00:04:02.821 03:20:43 -- env/env.sh@11 -- # run_test env_vtophys /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:04:02.821 03:20:43 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:02.821 03:20:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:02.821 03:20:43 -- common/autotest_common.sh@10 -- # set +x 00:04:02.821 ************************************ 00:04:02.821 START TEST env_vtophys 00:04:02.821 ************************************ 00:04:02.821 03:20:43 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:04:02.821 EAL: lib.eal log level changed from notice to debug 00:04:02.821 EAL: Detected lcore 0 as core 0 on socket 0 00:04:02.821 EAL: Detected lcore 1 as core 1 on socket 0 00:04:02.821 EAL: Detected lcore 2 as core 2 on socket 0 00:04:02.821 EAL: Detected lcore 3 as core 3 on socket 0 00:04:02.821 EAL: Detected lcore 4 as core 4 on socket 0 00:04:02.821 EAL: Detected lcore 5 as core 5 on socket 0 00:04:02.821 EAL: Detected lcore 6 as core 8 on socket 0 00:04:02.821 EAL: Detected lcore 7 as core 9 on socket 0 00:04:02.821 EAL: Detected lcore 8 as core 10 on socket 0 00:04:02.821 EAL: Detected lcore 9 as core 11 on socket 0 00:04:02.821 EAL: Detected lcore 10 as core 12 on socket 0 00:04:02.821 EAL: Detected lcore 11 as core 13 on socket 0 00:04:02.821 EAL: Detected lcore 12 as core 0 on socket 1 00:04:02.821 EAL: Detected lcore 13 as core 1 on socket 1 00:04:02.821 EAL: Detected lcore 14 as core 2 on socket 1 00:04:02.821 EAL: Detected lcore 15 as core 3 on socket 1 00:04:02.821 EAL: Detected lcore 16 as core 4 on socket 1 00:04:02.821 EAL: Detected lcore 17 as core 5 on socket 1 00:04:02.821 EAL: Detected lcore 18 as core 8 on socket 1 00:04:02.821 EAL: Detected lcore 19 as core 9 on socket 1 00:04:02.821 EAL: Detected lcore 20 as core 10 on socket 1 00:04:02.821 EAL: Detected lcore 21 as core 11 on socket 1 00:04:02.821 EAL: Detected lcore 22 as core 12 on socket 1 00:04:02.821 EAL: Detected lcore 23 as core 13 on socket 1 00:04:02.821 EAL: Detected lcore 24 as core 0 on socket 0 00:04:02.821 EAL: Detected lcore 25 as core 1 on socket 0 00:04:02.821 EAL: Detected lcore 26 as core 2 on socket 0 00:04:02.821 EAL: Detected lcore 27 as core 3 on socket 0 00:04:02.821 EAL: Detected lcore 28 as core 4 on socket 0 00:04:02.821 EAL: Detected lcore 29 as core 5 on socket 0 00:04:02.821 EAL: Detected lcore 30 as core 8 on socket 0 00:04:02.821 EAL: Detected lcore 31 as core 9 on socket 0 00:04:02.821 EAL: Detected lcore 32 as core 10 on socket 0 00:04:02.821 EAL: Detected lcore 33 as core 11 on socket 0 00:04:02.821 EAL: Detected lcore 34 as core 12 on socket 0 00:04:02.821 EAL: Detected lcore 35 as core 13 on socket 0 00:04:02.821 EAL: Detected lcore 36 as core 0 on socket 1 00:04:02.821 EAL: Detected lcore 37 as core 1 on socket 1 00:04:02.822 EAL: Detected lcore 38 as core 2 on socket 1 00:04:02.822 EAL: Detected lcore 39 as core 3 on socket 1 00:04:02.822 EAL: Detected lcore 40 as core 4 on socket 1 00:04:02.822 EAL: Detected lcore 41 as core 5 on socket 1 00:04:02.822 EAL: Detected lcore 42 as core 8 on socket 1 00:04:02.822 EAL: Detected lcore 43 as core 9 on socket 1 00:04:02.822 EAL: Detected lcore 44 as core 10 on socket 1 00:04:02.822 EAL: Detected lcore 45 as core 11 on socket 1 00:04:02.822 EAL: Detected lcore 46 as core 12 on socket 1 00:04:02.822 EAL: Detected lcore 47 as core 13 on socket 1 00:04:02.822 EAL: Maximum logical cores by configuration: 128 00:04:02.822 EAL: Detected CPU lcores: 48 00:04:02.822 EAL: Detected NUMA nodes: 2 00:04:02.822 EAL: Checking presence of .so 'librte_eal.so.24.0' 00:04:02.822 EAL: Detected shared linkage of DPDK 00:04:02.822 EAL: No shared files mode enabled, IPC will be disabled 00:04:02.822 EAL: Bus pci wants IOVA as 'DC' 00:04:02.822 EAL: Buses did not request a specific IOVA mode. 00:04:02.822 EAL: IOMMU is available, selecting IOVA as VA mode. 00:04:02.822 EAL: Selected IOVA mode 'VA' 00:04:02.822 EAL: No free 2048 kB hugepages reported on node 1 00:04:02.822 EAL: Probing VFIO support... 00:04:02.822 EAL: IOMMU type 1 (Type 1) is supported 00:04:02.822 EAL: IOMMU type 7 (sPAPR) is not supported 00:04:02.822 EAL: IOMMU type 8 (No-IOMMU) is not supported 00:04:02.822 EAL: VFIO support initialized 00:04:02.822 EAL: Ask a virtual area of 0x2e000 bytes 00:04:02.822 EAL: Virtual area found at 0x200000000000 (size = 0x2e000) 00:04:02.822 EAL: Setting up physically contiguous memory... 00:04:02.822 EAL: Setting maximum number of open files to 524288 00:04:02.822 EAL: Detected memory type: socket_id:0 hugepage_sz:2097152 00:04:02.822 EAL: Detected memory type: socket_id:1 hugepage_sz:2097152 00:04:02.822 EAL: Creating 4 segment lists: n_segs:8192 socket_id:0 hugepage_sz:2097152 00:04:02.822 EAL: Ask a virtual area of 0x61000 bytes 00:04:02.822 EAL: Virtual area found at 0x20000002e000 (size = 0x61000) 00:04:02.822 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:04:02.822 EAL: Ask a virtual area of 0x400000000 bytes 00:04:02.822 EAL: Virtual area found at 0x200000200000 (size = 0x400000000) 00:04:02.822 EAL: VA reserved for memseg list at 0x200000200000, size 400000000 00:04:02.822 EAL: Ask a virtual area of 0x61000 bytes 00:04:02.822 EAL: Virtual area found at 0x200400200000 (size = 0x61000) 00:04:02.822 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:04:02.822 EAL: Ask a virtual area of 0x400000000 bytes 00:04:02.822 EAL: Virtual area found at 0x200400400000 (size = 0x400000000) 00:04:02.822 EAL: VA reserved for memseg list at 0x200400400000, size 400000000 00:04:02.822 EAL: Ask a virtual area of 0x61000 bytes 00:04:02.822 EAL: Virtual area found at 0x200800400000 (size = 0x61000) 00:04:02.822 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:04:02.822 EAL: Ask a virtual area of 0x400000000 bytes 00:04:02.822 EAL: Virtual area found at 0x200800600000 (size = 0x400000000) 00:04:02.822 EAL: VA reserved for memseg list at 0x200800600000, size 400000000 00:04:02.822 EAL: Ask a virtual area of 0x61000 bytes 00:04:02.822 EAL: Virtual area found at 0x200c00600000 (size = 0x61000) 00:04:02.822 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:04:02.822 EAL: Ask a virtual area of 0x400000000 bytes 00:04:02.822 EAL: Virtual area found at 0x200c00800000 (size = 0x400000000) 00:04:02.822 EAL: VA reserved for memseg list at 0x200c00800000, size 400000000 00:04:02.822 EAL: Creating 4 segment lists: n_segs:8192 socket_id:1 hugepage_sz:2097152 00:04:02.822 EAL: Ask a virtual area of 0x61000 bytes 00:04:02.822 EAL: Virtual area found at 0x201000800000 (size = 0x61000) 00:04:02.822 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:04:02.822 EAL: Ask a virtual area of 0x400000000 bytes 00:04:02.822 EAL: Virtual area found at 0x201000a00000 (size = 0x400000000) 00:04:02.822 EAL: VA reserved for memseg list at 0x201000a00000, size 400000000 00:04:02.822 EAL: Ask a virtual area of 0x61000 bytes 00:04:02.822 EAL: Virtual area found at 0x201400a00000 (size = 0x61000) 00:04:02.822 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:04:02.822 EAL: Ask a virtual area of 0x400000000 bytes 00:04:02.822 EAL: Virtual area found at 0x201400c00000 (size = 0x400000000) 00:04:02.822 EAL: VA reserved for memseg list at 0x201400c00000, size 400000000 00:04:02.822 EAL: Ask a virtual area of 0x61000 bytes 00:04:02.822 EAL: Virtual area found at 0x201800c00000 (size = 0x61000) 00:04:02.822 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:04:02.822 EAL: Ask a virtual area of 0x400000000 bytes 00:04:02.822 EAL: Virtual area found at 0x201800e00000 (size = 0x400000000) 00:04:02.822 EAL: VA reserved for memseg list at 0x201800e00000, size 400000000 00:04:02.822 EAL: Ask a virtual area of 0x61000 bytes 00:04:02.822 EAL: Virtual area found at 0x201c00e00000 (size = 0x61000) 00:04:02.822 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:04:02.822 EAL: Ask a virtual area of 0x400000000 bytes 00:04:02.822 EAL: Virtual area found at 0x201c01000000 (size = 0x400000000) 00:04:02.822 EAL: VA reserved for memseg list at 0x201c01000000, size 400000000 00:04:02.822 EAL: Hugepages will be freed exactly as allocated. 00:04:02.822 EAL: No shared files mode enabled, IPC is disabled 00:04:02.822 EAL: No shared files mode enabled, IPC is disabled 00:04:02.822 EAL: TSC frequency is ~2700000 KHz 00:04:02.822 EAL: Main lcore 0 is ready (tid=7fa54fc33a00;cpuset=[0]) 00:04:02.822 EAL: Trying to obtain current memory policy. 00:04:02.822 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:02.822 EAL: Restoring previous memory policy: 0 00:04:02.822 EAL: request: mp_malloc_sync 00:04:02.822 EAL: No shared files mode enabled, IPC is disabled 00:04:02.822 EAL: Heap on socket 0 was expanded by 2MB 00:04:02.822 EAL: No shared files mode enabled, IPC is disabled 00:04:02.822 EAL: No PCI address specified using 'addr=' in: bus=pci 00:04:02.822 EAL: Mem event callback 'spdk:(nil)' registered 00:04:02.822 00:04:02.822 00:04:02.822 CUnit - A unit testing framework for C - Version 2.1-3 00:04:02.822 http://cunit.sourceforge.net/ 00:04:02.822 00:04:02.822 00:04:02.822 Suite: components_suite 00:04:02.822 Test: vtophys_malloc_test ...passed 00:04:02.822 Test: vtophys_spdk_malloc_test ...EAL: Trying to obtain current memory policy. 00:04:02.822 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:02.822 EAL: Restoring previous memory policy: 4 00:04:02.822 EAL: Calling mem event callback 'spdk:(nil)' 00:04:02.822 EAL: request: mp_malloc_sync 00:04:02.822 EAL: No shared files mode enabled, IPC is disabled 00:04:02.822 EAL: Heap on socket 0 was expanded by 4MB 00:04:02.822 EAL: Calling mem event callback 'spdk:(nil)' 00:04:02.822 EAL: request: mp_malloc_sync 00:04:02.822 EAL: No shared files mode enabled, IPC is disabled 00:04:02.822 EAL: Heap on socket 0 was shrunk by 4MB 00:04:02.822 EAL: Trying to obtain current memory policy. 00:04:02.822 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:02.822 EAL: Restoring previous memory policy: 4 00:04:02.822 EAL: Calling mem event callback 'spdk:(nil)' 00:04:02.822 EAL: request: mp_malloc_sync 00:04:02.822 EAL: No shared files mode enabled, IPC is disabled 00:04:02.822 EAL: Heap on socket 0 was expanded by 6MB 00:04:02.822 EAL: Calling mem event callback 'spdk:(nil)' 00:04:02.822 EAL: request: mp_malloc_sync 00:04:02.822 EAL: No shared files mode enabled, IPC is disabled 00:04:02.822 EAL: Heap on socket 0 was shrunk by 6MB 00:04:02.822 EAL: Trying to obtain current memory policy. 00:04:02.822 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:02.822 EAL: Restoring previous memory policy: 4 00:04:02.822 EAL: Calling mem event callback 'spdk:(nil)' 00:04:02.822 EAL: request: mp_malloc_sync 00:04:02.822 EAL: No shared files mode enabled, IPC is disabled 00:04:02.822 EAL: Heap on socket 0 was expanded by 10MB 00:04:02.822 EAL: Calling mem event callback 'spdk:(nil)' 00:04:02.822 EAL: request: mp_malloc_sync 00:04:02.822 EAL: No shared files mode enabled, IPC is disabled 00:04:02.822 EAL: Heap on socket 0 was shrunk by 10MB 00:04:02.822 EAL: Trying to obtain current memory policy. 00:04:02.822 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:02.822 EAL: Restoring previous memory policy: 4 00:04:02.822 EAL: Calling mem event callback 'spdk:(nil)' 00:04:02.822 EAL: request: mp_malloc_sync 00:04:02.822 EAL: No shared files mode enabled, IPC is disabled 00:04:02.822 EAL: Heap on socket 0 was expanded by 18MB 00:04:02.822 EAL: Calling mem event callback 'spdk:(nil)' 00:04:02.822 EAL: request: mp_malloc_sync 00:04:02.822 EAL: No shared files mode enabled, IPC is disabled 00:04:02.822 EAL: Heap on socket 0 was shrunk by 18MB 00:04:02.822 EAL: Trying to obtain current memory policy. 00:04:02.822 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:02.822 EAL: Restoring previous memory policy: 4 00:04:02.822 EAL: Calling mem event callback 'spdk:(nil)' 00:04:02.822 EAL: request: mp_malloc_sync 00:04:02.822 EAL: No shared files mode enabled, IPC is disabled 00:04:02.822 EAL: Heap on socket 0 was expanded by 34MB 00:04:02.822 EAL: Calling mem event callback 'spdk:(nil)' 00:04:02.822 EAL: request: mp_malloc_sync 00:04:02.822 EAL: No shared files mode enabled, IPC is disabled 00:04:02.822 EAL: Heap on socket 0 was shrunk by 34MB 00:04:02.822 EAL: Trying to obtain current memory policy. 00:04:02.822 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:02.822 EAL: Restoring previous memory policy: 4 00:04:02.822 EAL: Calling mem event callback 'spdk:(nil)' 00:04:02.822 EAL: request: mp_malloc_sync 00:04:02.822 EAL: No shared files mode enabled, IPC is disabled 00:04:02.822 EAL: Heap on socket 0 was expanded by 66MB 00:04:02.822 EAL: Calling mem event callback 'spdk:(nil)' 00:04:02.822 EAL: request: mp_malloc_sync 00:04:02.822 EAL: No shared files mode enabled, IPC is disabled 00:04:02.822 EAL: Heap on socket 0 was shrunk by 66MB 00:04:02.822 EAL: Trying to obtain current memory policy. 00:04:02.822 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:02.822 EAL: Restoring previous memory policy: 4 00:04:02.822 EAL: Calling mem event callback 'spdk:(nil)' 00:04:02.823 EAL: request: mp_malloc_sync 00:04:02.823 EAL: No shared files mode enabled, IPC is disabled 00:04:02.823 EAL: Heap on socket 0 was expanded by 130MB 00:04:03.081 EAL: Calling mem event callback 'spdk:(nil)' 00:04:03.081 EAL: request: mp_malloc_sync 00:04:03.081 EAL: No shared files mode enabled, IPC is disabled 00:04:03.081 EAL: Heap on socket 0 was shrunk by 130MB 00:04:03.081 EAL: Trying to obtain current memory policy. 00:04:03.081 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:03.081 EAL: Restoring previous memory policy: 4 00:04:03.081 EAL: Calling mem event callback 'spdk:(nil)' 00:04:03.081 EAL: request: mp_malloc_sync 00:04:03.081 EAL: No shared files mode enabled, IPC is disabled 00:04:03.081 EAL: Heap on socket 0 was expanded by 258MB 00:04:03.081 EAL: Calling mem event callback 'spdk:(nil)' 00:04:03.081 EAL: request: mp_malloc_sync 00:04:03.082 EAL: No shared files mode enabled, IPC is disabled 00:04:03.082 EAL: Heap on socket 0 was shrunk by 258MB 00:04:03.082 EAL: Trying to obtain current memory policy. 00:04:03.082 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:03.341 EAL: Restoring previous memory policy: 4 00:04:03.341 EAL: Calling mem event callback 'spdk:(nil)' 00:04:03.341 EAL: request: mp_malloc_sync 00:04:03.341 EAL: No shared files mode enabled, IPC is disabled 00:04:03.341 EAL: Heap on socket 0 was expanded by 514MB 00:04:03.341 EAL: Calling mem event callback 'spdk:(nil)' 00:04:03.601 EAL: request: mp_malloc_sync 00:04:03.601 EAL: No shared files mode enabled, IPC is disabled 00:04:03.601 EAL: Heap on socket 0 was shrunk by 514MB 00:04:03.601 EAL: Trying to obtain current memory policy. 00:04:03.601 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:03.862 EAL: Restoring previous memory policy: 4 00:04:03.862 EAL: Calling mem event callback 'spdk:(nil)' 00:04:03.862 EAL: request: mp_malloc_sync 00:04:03.862 EAL: No shared files mode enabled, IPC is disabled 00:04:03.862 EAL: Heap on socket 0 was expanded by 1026MB 00:04:04.123 EAL: Calling mem event callback 'spdk:(nil)' 00:04:04.384 EAL: request: mp_malloc_sync 00:04:04.384 EAL: No shared files mode enabled, IPC is disabled 00:04:04.384 EAL: Heap on socket 0 was shrunk by 1026MB 00:04:04.384 passed 00:04:04.384 00:04:04.384 Run Summary: Type Total Ran Passed Failed Inactive 00:04:04.384 suites 1 1 n/a 0 0 00:04:04.384 tests 2 2 2 0 0 00:04:04.384 asserts 497 497 497 0 n/a 00:04:04.384 00:04:04.384 Elapsed time = 1.382 seconds 00:04:04.384 EAL: Calling mem event callback 'spdk:(nil)' 00:04:04.384 EAL: request: mp_malloc_sync 00:04:04.384 EAL: No shared files mode enabled, IPC is disabled 00:04:04.384 EAL: Heap on socket 0 was shrunk by 2MB 00:04:04.384 EAL: No shared files mode enabled, IPC is disabled 00:04:04.384 EAL: No shared files mode enabled, IPC is disabled 00:04:04.384 EAL: No shared files mode enabled, IPC is disabled 00:04:04.384 00:04:04.384 real 0m1.505s 00:04:04.384 user 0m0.865s 00:04:04.384 sys 0m0.598s 00:04:04.384 03:20:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:04.384 03:20:44 -- common/autotest_common.sh@10 -- # set +x 00:04:04.384 ************************************ 00:04:04.384 END TEST env_vtophys 00:04:04.384 ************************************ 00:04:04.384 03:20:44 -- env/env.sh@12 -- # run_test env_pci /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:04:04.384 03:20:44 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:04.384 03:20:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:04.384 03:20:44 -- common/autotest_common.sh@10 -- # set +x 00:04:04.384 ************************************ 00:04:04.384 START TEST env_pci 00:04:04.384 ************************************ 00:04:04.384 03:20:44 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:04:04.384 00:04:04.384 00:04:04.384 CUnit - A unit testing framework for C - Version 2.1-3 00:04:04.384 http://cunit.sourceforge.net/ 00:04:04.384 00:04:04.384 00:04:04.384 Suite: pci 00:04:04.384 Test: pci_hook ...[2024-11-21 03:20:44.823257] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/pci.c:1040:spdk_pci_device_claim: *ERROR*: Cannot create lock on device /var/tmp/spdk_pci_lock_10000:00:01.0, probably process 2926594 has claimed it 00:04:04.384 EAL: Cannot find device (10000:00:01.0) 00:04:04.384 EAL: Failed to attach device on primary process 00:04:04.384 passed 00:04:04.384 00:04:04.384 Run Summary: Type Total Ran Passed Failed Inactive 00:04:04.384 suites 1 1 n/a 0 0 00:04:04.384 tests 1 1 1 0 0 00:04:04.384 asserts 25 25 25 0 n/a 00:04:04.384 00:04:04.384 Elapsed time = 0.021 seconds 00:04:04.384 00:04:04.384 real 0m0.034s 00:04:04.384 user 0m0.009s 00:04:04.384 sys 0m0.025s 00:04:04.384 03:20:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:04.384 03:20:44 -- common/autotest_common.sh@10 -- # set +x 00:04:04.384 ************************************ 00:04:04.384 END TEST env_pci 00:04:04.384 ************************************ 00:04:04.384 03:20:44 -- env/env.sh@14 -- # argv='-c 0x1 ' 00:04:04.384 03:20:44 -- env/env.sh@15 -- # uname 00:04:04.384 03:20:44 -- env/env.sh@15 -- # '[' Linux = Linux ']' 00:04:04.384 03:20:44 -- env/env.sh@22 -- # argv+=--base-virtaddr=0x200000000000 00:04:04.384 03:20:44 -- env/env.sh@24 -- # run_test env_dpdk_post_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:04:04.384 03:20:44 -- common/autotest_common.sh@1087 -- # '[' 5 -le 1 ']' 00:04:04.384 03:20:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:04.384 03:20:44 -- common/autotest_common.sh@10 -- # set +x 00:04:04.384 ************************************ 00:04:04.384 START TEST env_dpdk_post_init 00:04:04.384 ************************************ 00:04:04.384 03:20:44 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:04:04.384 EAL: Detected CPU lcores: 48 00:04:04.384 EAL: Detected NUMA nodes: 2 00:04:04.384 EAL: Detected shared linkage of DPDK 00:04:04.384 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:04:04.384 EAL: Selected IOVA mode 'VA' 00:04:04.384 EAL: No free 2048 kB hugepages reported on node 1 00:04:04.384 EAL: VFIO support initialized 00:04:04.384 TELEMETRY: No legacy callbacks, legacy socket not created 00:04:04.384 EAL: Using IOMMU type 1 (Type 1) 00:04:04.384 EAL: Probe PCI driver: spdk_ioat (8086:0e20) device: 0000:00:04.0 (socket 0) 00:04:04.384 EAL: Probe PCI driver: spdk_ioat (8086:0e21) device: 0000:00:04.1 (socket 0) 00:04:04.384 EAL: Probe PCI driver: spdk_ioat (8086:0e22) device: 0000:00:04.2 (socket 0) 00:04:04.384 EAL: Probe PCI driver: spdk_ioat (8086:0e23) device: 0000:00:04.3 (socket 0) 00:04:04.644 EAL: Probe PCI driver: spdk_ioat (8086:0e24) device: 0000:00:04.4 (socket 0) 00:04:04.644 EAL: Probe PCI driver: spdk_ioat (8086:0e25) device: 0000:00:04.5 (socket 0) 00:04:04.645 EAL: Probe PCI driver: spdk_ioat (8086:0e26) device: 0000:00:04.6 (socket 0) 00:04:04.645 EAL: Probe PCI driver: spdk_ioat (8086:0e27) device: 0000:00:04.7 (socket 0) 00:04:04.645 EAL: Probe PCI driver: spdk_ioat (8086:0e20) device: 0000:80:04.0 (socket 1) 00:04:04.645 EAL: Probe PCI driver: spdk_ioat (8086:0e21) device: 0000:80:04.1 (socket 1) 00:04:04.645 EAL: Probe PCI driver: spdk_ioat (8086:0e22) device: 0000:80:04.2 (socket 1) 00:04:04.645 EAL: Probe PCI driver: spdk_ioat (8086:0e23) device: 0000:80:04.3 (socket 1) 00:04:04.645 EAL: Probe PCI driver: spdk_ioat (8086:0e24) device: 0000:80:04.4 (socket 1) 00:04:04.645 EAL: Probe PCI driver: spdk_ioat (8086:0e25) device: 0000:80:04.5 (socket 1) 00:04:04.645 EAL: Probe PCI driver: spdk_ioat (8086:0e26) device: 0000:80:04.6 (socket 1) 00:04:04.645 EAL: Probe PCI driver: spdk_ioat (8086:0e27) device: 0000:80:04.7 (socket 1) 00:04:05.584 EAL: Probe PCI driver: spdk_nvme (8086:0a54) device: 0000:88:00.0 (socket 1) 00:04:08.879 EAL: Releasing PCI mapped resource for 0000:88:00.0 00:04:08.879 EAL: Calling pci_unmap_resource for 0000:88:00.0 at 0x202001040000 00:04:08.879 Starting DPDK initialization... 00:04:08.879 Starting SPDK post initialization... 00:04:08.879 SPDK NVMe probe 00:04:08.879 Attaching to 0000:88:00.0 00:04:08.879 Attached to 0000:88:00.0 00:04:08.879 Cleaning up... 00:04:08.879 00:04:08.879 real 0m4.388s 00:04:08.879 user 0m3.265s 00:04:08.879 sys 0m0.176s 00:04:08.879 03:20:49 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:08.879 03:20:49 -- common/autotest_common.sh@10 -- # set +x 00:04:08.879 ************************************ 00:04:08.879 END TEST env_dpdk_post_init 00:04:08.879 ************************************ 00:04:08.879 03:20:49 -- env/env.sh@26 -- # uname 00:04:08.879 03:20:49 -- env/env.sh@26 -- # '[' Linux = Linux ']' 00:04:08.879 03:20:49 -- env/env.sh@29 -- # run_test env_mem_callbacks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:04:08.879 03:20:49 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:08.879 03:20:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:08.879 03:20:49 -- common/autotest_common.sh@10 -- # set +x 00:04:08.879 ************************************ 00:04:08.879 START TEST env_mem_callbacks 00:04:08.879 ************************************ 00:04:08.879 03:20:49 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:04:08.879 EAL: Detected CPU lcores: 48 00:04:08.879 EAL: Detected NUMA nodes: 2 00:04:08.879 EAL: Detected shared linkage of DPDK 00:04:08.879 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:04:08.879 EAL: Selected IOVA mode 'VA' 00:04:08.879 EAL: No free 2048 kB hugepages reported on node 1 00:04:08.879 EAL: VFIO support initialized 00:04:08.879 TELEMETRY: No legacy callbacks, legacy socket not created 00:04:08.879 00:04:08.879 00:04:08.879 CUnit - A unit testing framework for C - Version 2.1-3 00:04:08.879 http://cunit.sourceforge.net/ 00:04:08.879 00:04:08.879 00:04:08.879 Suite: memory 00:04:08.879 Test: test ... 00:04:08.879 register 0x200000200000 2097152 00:04:08.879 malloc 3145728 00:04:08.879 register 0x200000400000 4194304 00:04:08.879 buf 0x200000500000 len 3145728 PASSED 00:04:08.879 malloc 64 00:04:08.879 buf 0x2000004fff40 len 64 PASSED 00:04:08.879 malloc 4194304 00:04:08.879 register 0x200000800000 6291456 00:04:08.879 buf 0x200000a00000 len 4194304 PASSED 00:04:08.879 free 0x200000500000 3145728 00:04:08.879 free 0x2000004fff40 64 00:04:08.879 unregister 0x200000400000 4194304 PASSED 00:04:08.879 free 0x200000a00000 4194304 00:04:08.879 unregister 0x200000800000 6291456 PASSED 00:04:08.879 malloc 8388608 00:04:08.879 register 0x200000400000 10485760 00:04:08.879 buf 0x200000600000 len 8388608 PASSED 00:04:08.879 free 0x200000600000 8388608 00:04:08.879 unregister 0x200000400000 10485760 PASSED 00:04:08.879 passed 00:04:08.879 00:04:08.879 Run Summary: Type Total Ran Passed Failed Inactive 00:04:08.879 suites 1 1 n/a 0 0 00:04:08.879 tests 1 1 1 0 0 00:04:08.879 asserts 15 15 15 0 n/a 00:04:08.879 00:04:08.879 Elapsed time = 0.005 seconds 00:04:08.879 00:04:08.879 real 0m0.048s 00:04:08.879 user 0m0.012s 00:04:08.879 sys 0m0.036s 00:04:08.879 03:20:49 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:08.879 03:20:49 -- common/autotest_common.sh@10 -- # set +x 00:04:08.879 ************************************ 00:04:08.879 END TEST env_mem_callbacks 00:04:08.879 ************************************ 00:04:08.879 00:04:08.879 real 0m6.402s 00:04:08.879 user 0m4.445s 00:04:08.879 sys 0m0.998s 00:04:08.879 03:20:49 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:08.879 03:20:49 -- common/autotest_common.sh@10 -- # set +x 00:04:08.879 ************************************ 00:04:08.879 END TEST env 00:04:08.879 ************************************ 00:04:08.879 03:20:49 -- spdk/autotest.sh@163 -- # run_test rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:04:08.879 03:20:49 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:08.879 03:20:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:08.879 03:20:49 -- common/autotest_common.sh@10 -- # set +x 00:04:08.879 ************************************ 00:04:08.879 START TEST rpc 00:04:08.879 ************************************ 00:04:08.879 03:20:49 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:04:08.879 * Looking for test storage... 00:04:08.879 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:04:08.879 03:20:49 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:08.879 03:20:49 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:08.879 03:20:49 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:08.879 03:20:49 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:08.879 03:20:49 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:09.139 03:20:49 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:09.139 03:20:49 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:09.139 03:20:49 -- scripts/common.sh@335 -- # IFS=.-: 00:04:09.139 03:20:49 -- scripts/common.sh@335 -- # read -ra ver1 00:04:09.139 03:20:49 -- scripts/common.sh@336 -- # IFS=.-: 00:04:09.139 03:20:49 -- scripts/common.sh@336 -- # read -ra ver2 00:04:09.139 03:20:49 -- scripts/common.sh@337 -- # local 'op=<' 00:04:09.139 03:20:49 -- scripts/common.sh@339 -- # ver1_l=2 00:04:09.139 03:20:49 -- scripts/common.sh@340 -- # ver2_l=1 00:04:09.139 03:20:49 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:09.139 03:20:49 -- scripts/common.sh@343 -- # case "$op" in 00:04:09.139 03:20:49 -- scripts/common.sh@344 -- # : 1 00:04:09.139 03:20:49 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:09.139 03:20:49 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:09.139 03:20:49 -- scripts/common.sh@364 -- # decimal 1 00:04:09.139 03:20:49 -- scripts/common.sh@352 -- # local d=1 00:04:09.139 03:20:49 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:09.139 03:20:49 -- scripts/common.sh@354 -- # echo 1 00:04:09.139 03:20:49 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:09.139 03:20:49 -- scripts/common.sh@365 -- # decimal 2 00:04:09.139 03:20:49 -- scripts/common.sh@352 -- # local d=2 00:04:09.139 03:20:49 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:09.139 03:20:49 -- scripts/common.sh@354 -- # echo 2 00:04:09.139 03:20:49 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:09.139 03:20:49 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:09.139 03:20:49 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:09.139 03:20:49 -- scripts/common.sh@367 -- # return 0 00:04:09.139 03:20:49 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:09.139 03:20:49 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:09.139 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:09.139 --rc genhtml_branch_coverage=1 00:04:09.139 --rc genhtml_function_coverage=1 00:04:09.139 --rc genhtml_legend=1 00:04:09.139 --rc geninfo_all_blocks=1 00:04:09.139 --rc geninfo_unexecuted_blocks=1 00:04:09.139 00:04:09.139 ' 00:04:09.139 03:20:49 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:09.139 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:09.139 --rc genhtml_branch_coverage=1 00:04:09.139 --rc genhtml_function_coverage=1 00:04:09.139 --rc genhtml_legend=1 00:04:09.139 --rc geninfo_all_blocks=1 00:04:09.139 --rc geninfo_unexecuted_blocks=1 00:04:09.139 00:04:09.139 ' 00:04:09.139 03:20:49 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:09.139 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:09.139 --rc genhtml_branch_coverage=1 00:04:09.139 --rc genhtml_function_coverage=1 00:04:09.139 --rc genhtml_legend=1 00:04:09.139 --rc geninfo_all_blocks=1 00:04:09.139 --rc geninfo_unexecuted_blocks=1 00:04:09.139 00:04:09.139 ' 00:04:09.139 03:20:49 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:09.139 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:09.139 --rc genhtml_branch_coverage=1 00:04:09.139 --rc genhtml_function_coverage=1 00:04:09.139 --rc genhtml_legend=1 00:04:09.139 --rc geninfo_all_blocks=1 00:04:09.139 --rc geninfo_unexecuted_blocks=1 00:04:09.139 00:04:09.139 ' 00:04:09.139 03:20:49 -- rpc/rpc.sh@65 -- # spdk_pid=2927274 00:04:09.140 03:20:49 -- rpc/rpc.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -e bdev 00:04:09.140 03:20:49 -- rpc/rpc.sh@66 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:04:09.140 03:20:49 -- rpc/rpc.sh@67 -- # waitforlisten 2927274 00:04:09.140 03:20:49 -- common/autotest_common.sh@829 -- # '[' -z 2927274 ']' 00:04:09.140 03:20:49 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:09.140 03:20:49 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:09.140 03:20:49 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:09.140 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:09.140 03:20:49 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:09.140 03:20:49 -- common/autotest_common.sh@10 -- # set +x 00:04:09.140 [2024-11-21 03:20:49.578911] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:09.140 [2024-11-21 03:20:49.579004] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2927274 ] 00:04:09.140 EAL: No free 2048 kB hugepages reported on node 1 00:04:09.140 [2024-11-21 03:20:49.635714] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:09.140 [2024-11-21 03:20:49.746120] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:09.140 [2024-11-21 03:20:49.746298] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask bdev specified. 00:04:09.140 [2024-11-21 03:20:49.746325] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s spdk_tgt -p 2927274' to capture a snapshot of events at runtime. 00:04:09.140 [2024-11-21 03:20:49.746340] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/spdk_tgt_trace.pid2927274 for offline analysis/debug. 00:04:09.140 [2024-11-21 03:20:49.746372] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:10.075 03:20:50 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:10.075 03:20:50 -- common/autotest_common.sh@862 -- # return 0 00:04:10.075 03:20:50 -- rpc/rpc.sh@69 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:04:10.075 03:20:50 -- rpc/rpc.sh@69 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:04:10.075 03:20:50 -- rpc/rpc.sh@72 -- # rpc=rpc_cmd 00:04:10.075 03:20:50 -- rpc/rpc.sh@73 -- # run_test rpc_integrity rpc_integrity 00:04:10.075 03:20:50 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:10.075 03:20:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:10.075 03:20:50 -- common/autotest_common.sh@10 -- # set +x 00:04:10.075 ************************************ 00:04:10.075 START TEST rpc_integrity 00:04:10.075 ************************************ 00:04:10.075 03:20:50 -- common/autotest_common.sh@1114 -- # rpc_integrity 00:04:10.075 03:20:50 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:04:10.075 03:20:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:10.075 03:20:50 -- common/autotest_common.sh@10 -- # set +x 00:04:10.075 03:20:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:10.075 03:20:50 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:04:10.075 03:20:50 -- rpc/rpc.sh@13 -- # jq length 00:04:10.075 03:20:50 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:04:10.075 03:20:50 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:04:10.075 03:20:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:10.075 03:20:50 -- common/autotest_common.sh@10 -- # set +x 00:04:10.075 03:20:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:10.075 03:20:50 -- rpc/rpc.sh@15 -- # malloc=Malloc0 00:04:10.075 03:20:50 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:04:10.075 03:20:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:10.075 03:20:50 -- common/autotest_common.sh@10 -- # set +x 00:04:10.075 03:20:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:10.075 03:20:50 -- rpc/rpc.sh@16 -- # bdevs='[ 00:04:10.075 { 00:04:10.075 "name": "Malloc0", 00:04:10.075 "aliases": [ 00:04:10.075 "73bcda75-e9e8-41c9-a1f5-df3f65206b3d" 00:04:10.075 ], 00:04:10.075 "product_name": "Malloc disk", 00:04:10.075 "block_size": 512, 00:04:10.075 "num_blocks": 16384, 00:04:10.075 "uuid": "73bcda75-e9e8-41c9-a1f5-df3f65206b3d", 00:04:10.075 "assigned_rate_limits": { 00:04:10.075 "rw_ios_per_sec": 0, 00:04:10.075 "rw_mbytes_per_sec": 0, 00:04:10.075 "r_mbytes_per_sec": 0, 00:04:10.075 "w_mbytes_per_sec": 0 00:04:10.075 }, 00:04:10.075 "claimed": false, 00:04:10.075 "zoned": false, 00:04:10.075 "supported_io_types": { 00:04:10.075 "read": true, 00:04:10.075 "write": true, 00:04:10.075 "unmap": true, 00:04:10.075 "write_zeroes": true, 00:04:10.075 "flush": true, 00:04:10.075 "reset": true, 00:04:10.075 "compare": false, 00:04:10.075 "compare_and_write": false, 00:04:10.075 "abort": true, 00:04:10.075 "nvme_admin": false, 00:04:10.075 "nvme_io": false 00:04:10.075 }, 00:04:10.075 "memory_domains": [ 00:04:10.075 { 00:04:10.075 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:10.075 "dma_device_type": 2 00:04:10.075 } 00:04:10.075 ], 00:04:10.075 "driver_specific": {} 00:04:10.075 } 00:04:10.075 ]' 00:04:10.075 03:20:50 -- rpc/rpc.sh@17 -- # jq length 00:04:10.075 03:20:50 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:04:10.075 03:20:50 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc0 -p Passthru0 00:04:10.075 03:20:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:10.075 03:20:50 -- common/autotest_common.sh@10 -- # set +x 00:04:10.075 [2024-11-21 03:20:50.628828] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc0 00:04:10.075 [2024-11-21 03:20:50.628880] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:04:10.075 [2024-11-21 03:20:50.628904] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0x1414cb0 00:04:10.075 [2024-11-21 03:20:50.628919] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:04:10.075 [2024-11-21 03:20:50.630403] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:04:10.075 [2024-11-21 03:20:50.630434] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:04:10.075 Passthru0 00:04:10.075 03:20:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:10.075 03:20:50 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:04:10.075 03:20:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:10.075 03:20:50 -- common/autotest_common.sh@10 -- # set +x 00:04:10.075 03:20:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:10.075 03:20:50 -- rpc/rpc.sh@20 -- # bdevs='[ 00:04:10.075 { 00:04:10.075 "name": "Malloc0", 00:04:10.075 "aliases": [ 00:04:10.075 "73bcda75-e9e8-41c9-a1f5-df3f65206b3d" 00:04:10.075 ], 00:04:10.075 "product_name": "Malloc disk", 00:04:10.075 "block_size": 512, 00:04:10.075 "num_blocks": 16384, 00:04:10.075 "uuid": "73bcda75-e9e8-41c9-a1f5-df3f65206b3d", 00:04:10.075 "assigned_rate_limits": { 00:04:10.075 "rw_ios_per_sec": 0, 00:04:10.075 "rw_mbytes_per_sec": 0, 00:04:10.075 "r_mbytes_per_sec": 0, 00:04:10.075 "w_mbytes_per_sec": 0 00:04:10.075 }, 00:04:10.075 "claimed": true, 00:04:10.075 "claim_type": "exclusive_write", 00:04:10.075 "zoned": false, 00:04:10.075 "supported_io_types": { 00:04:10.075 "read": true, 00:04:10.075 "write": true, 00:04:10.075 "unmap": true, 00:04:10.075 "write_zeroes": true, 00:04:10.076 "flush": true, 00:04:10.076 "reset": true, 00:04:10.076 "compare": false, 00:04:10.076 "compare_and_write": false, 00:04:10.076 "abort": true, 00:04:10.076 "nvme_admin": false, 00:04:10.076 "nvme_io": false 00:04:10.076 }, 00:04:10.076 "memory_domains": [ 00:04:10.076 { 00:04:10.076 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:10.076 "dma_device_type": 2 00:04:10.076 } 00:04:10.076 ], 00:04:10.076 "driver_specific": {} 00:04:10.076 }, 00:04:10.076 { 00:04:10.076 "name": "Passthru0", 00:04:10.076 "aliases": [ 00:04:10.076 "caa21199-7876-5db3-aed6-97312eedc896" 00:04:10.076 ], 00:04:10.076 "product_name": "passthru", 00:04:10.076 "block_size": 512, 00:04:10.076 "num_blocks": 16384, 00:04:10.076 "uuid": "caa21199-7876-5db3-aed6-97312eedc896", 00:04:10.076 "assigned_rate_limits": { 00:04:10.076 "rw_ios_per_sec": 0, 00:04:10.076 "rw_mbytes_per_sec": 0, 00:04:10.076 "r_mbytes_per_sec": 0, 00:04:10.076 "w_mbytes_per_sec": 0 00:04:10.076 }, 00:04:10.076 "claimed": false, 00:04:10.076 "zoned": false, 00:04:10.076 "supported_io_types": { 00:04:10.076 "read": true, 00:04:10.076 "write": true, 00:04:10.076 "unmap": true, 00:04:10.076 "write_zeroes": true, 00:04:10.076 "flush": true, 00:04:10.076 "reset": true, 00:04:10.076 "compare": false, 00:04:10.076 "compare_and_write": false, 00:04:10.076 "abort": true, 00:04:10.076 "nvme_admin": false, 00:04:10.076 "nvme_io": false 00:04:10.076 }, 00:04:10.076 "memory_domains": [ 00:04:10.076 { 00:04:10.076 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:10.076 "dma_device_type": 2 00:04:10.076 } 00:04:10.076 ], 00:04:10.076 "driver_specific": { 00:04:10.076 "passthru": { 00:04:10.076 "name": "Passthru0", 00:04:10.076 "base_bdev_name": "Malloc0" 00:04:10.076 } 00:04:10.076 } 00:04:10.076 } 00:04:10.076 ]' 00:04:10.076 03:20:50 -- rpc/rpc.sh@21 -- # jq length 00:04:10.076 03:20:50 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:04:10.076 03:20:50 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:04:10.076 03:20:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:10.076 03:20:50 -- common/autotest_common.sh@10 -- # set +x 00:04:10.076 03:20:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:10.076 03:20:50 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc0 00:04:10.076 03:20:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:10.076 03:20:50 -- common/autotest_common.sh@10 -- # set +x 00:04:10.076 03:20:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:10.076 03:20:50 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:04:10.076 03:20:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:10.076 03:20:50 -- common/autotest_common.sh@10 -- # set +x 00:04:10.076 03:20:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:10.076 03:20:50 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:04:10.076 03:20:50 -- rpc/rpc.sh@26 -- # jq length 00:04:10.334 03:20:50 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:04:10.334 00:04:10.334 real 0m0.221s 00:04:10.334 user 0m0.148s 00:04:10.334 sys 0m0.019s 00:04:10.334 03:20:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:10.334 03:20:50 -- common/autotest_common.sh@10 -- # set +x 00:04:10.334 ************************************ 00:04:10.334 END TEST rpc_integrity 00:04:10.334 ************************************ 00:04:10.334 03:20:50 -- rpc/rpc.sh@74 -- # run_test rpc_plugins rpc_plugins 00:04:10.334 03:20:50 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:10.334 03:20:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:10.334 03:20:50 -- common/autotest_common.sh@10 -- # set +x 00:04:10.334 ************************************ 00:04:10.334 START TEST rpc_plugins 00:04:10.334 ************************************ 00:04:10.334 03:20:50 -- common/autotest_common.sh@1114 -- # rpc_plugins 00:04:10.334 03:20:50 -- rpc/rpc.sh@30 -- # rpc_cmd --plugin rpc_plugin create_malloc 00:04:10.334 03:20:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:10.334 03:20:50 -- common/autotest_common.sh@10 -- # set +x 00:04:10.334 03:20:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:10.334 03:20:50 -- rpc/rpc.sh@30 -- # malloc=Malloc1 00:04:10.334 03:20:50 -- rpc/rpc.sh@31 -- # rpc_cmd bdev_get_bdevs 00:04:10.334 03:20:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:10.334 03:20:50 -- common/autotest_common.sh@10 -- # set +x 00:04:10.334 03:20:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:10.334 03:20:50 -- rpc/rpc.sh@31 -- # bdevs='[ 00:04:10.334 { 00:04:10.334 "name": "Malloc1", 00:04:10.334 "aliases": [ 00:04:10.334 "57e2cfad-6f91-4862-8a82-4e7b5f0ae391" 00:04:10.334 ], 00:04:10.334 "product_name": "Malloc disk", 00:04:10.334 "block_size": 4096, 00:04:10.334 "num_blocks": 256, 00:04:10.334 "uuid": "57e2cfad-6f91-4862-8a82-4e7b5f0ae391", 00:04:10.334 "assigned_rate_limits": { 00:04:10.334 "rw_ios_per_sec": 0, 00:04:10.334 "rw_mbytes_per_sec": 0, 00:04:10.334 "r_mbytes_per_sec": 0, 00:04:10.334 "w_mbytes_per_sec": 0 00:04:10.334 }, 00:04:10.334 "claimed": false, 00:04:10.334 "zoned": false, 00:04:10.334 "supported_io_types": { 00:04:10.334 "read": true, 00:04:10.334 "write": true, 00:04:10.334 "unmap": true, 00:04:10.334 "write_zeroes": true, 00:04:10.334 "flush": true, 00:04:10.334 "reset": true, 00:04:10.334 "compare": false, 00:04:10.334 "compare_and_write": false, 00:04:10.334 "abort": true, 00:04:10.334 "nvme_admin": false, 00:04:10.334 "nvme_io": false 00:04:10.335 }, 00:04:10.335 "memory_domains": [ 00:04:10.335 { 00:04:10.335 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:10.335 "dma_device_type": 2 00:04:10.335 } 00:04:10.335 ], 00:04:10.335 "driver_specific": {} 00:04:10.335 } 00:04:10.335 ]' 00:04:10.335 03:20:50 -- rpc/rpc.sh@32 -- # jq length 00:04:10.335 03:20:50 -- rpc/rpc.sh@32 -- # '[' 1 == 1 ']' 00:04:10.335 03:20:50 -- rpc/rpc.sh@34 -- # rpc_cmd --plugin rpc_plugin delete_malloc Malloc1 00:04:10.335 03:20:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:10.335 03:20:50 -- common/autotest_common.sh@10 -- # set +x 00:04:10.335 03:20:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:10.335 03:20:50 -- rpc/rpc.sh@35 -- # rpc_cmd bdev_get_bdevs 00:04:10.335 03:20:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:10.335 03:20:50 -- common/autotest_common.sh@10 -- # set +x 00:04:10.335 03:20:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:10.335 03:20:50 -- rpc/rpc.sh@35 -- # bdevs='[]' 00:04:10.335 03:20:50 -- rpc/rpc.sh@36 -- # jq length 00:04:10.335 03:20:50 -- rpc/rpc.sh@36 -- # '[' 0 == 0 ']' 00:04:10.335 00:04:10.335 real 0m0.114s 00:04:10.335 user 0m0.076s 00:04:10.335 sys 0m0.008s 00:04:10.335 03:20:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:10.335 03:20:50 -- common/autotest_common.sh@10 -- # set +x 00:04:10.335 ************************************ 00:04:10.335 END TEST rpc_plugins 00:04:10.335 ************************************ 00:04:10.335 03:20:50 -- rpc/rpc.sh@75 -- # run_test rpc_trace_cmd_test rpc_trace_cmd_test 00:04:10.335 03:20:50 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:10.335 03:20:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:10.335 03:20:50 -- common/autotest_common.sh@10 -- # set +x 00:04:10.335 ************************************ 00:04:10.335 START TEST rpc_trace_cmd_test 00:04:10.335 ************************************ 00:04:10.335 03:20:50 -- common/autotest_common.sh@1114 -- # rpc_trace_cmd_test 00:04:10.335 03:20:50 -- rpc/rpc.sh@40 -- # local info 00:04:10.335 03:20:50 -- rpc/rpc.sh@42 -- # rpc_cmd trace_get_info 00:04:10.335 03:20:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:10.335 03:20:50 -- common/autotest_common.sh@10 -- # set +x 00:04:10.335 03:20:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:10.335 03:20:50 -- rpc/rpc.sh@42 -- # info='{ 00:04:10.335 "tpoint_shm_path": "/dev/shm/spdk_tgt_trace.pid2927274", 00:04:10.335 "tpoint_group_mask": "0x8", 00:04:10.335 "iscsi_conn": { 00:04:10.335 "mask": "0x2", 00:04:10.335 "tpoint_mask": "0x0" 00:04:10.335 }, 00:04:10.335 "scsi": { 00:04:10.335 "mask": "0x4", 00:04:10.335 "tpoint_mask": "0x0" 00:04:10.335 }, 00:04:10.335 "bdev": { 00:04:10.335 "mask": "0x8", 00:04:10.335 "tpoint_mask": "0xffffffffffffffff" 00:04:10.335 }, 00:04:10.335 "nvmf_rdma": { 00:04:10.335 "mask": "0x10", 00:04:10.335 "tpoint_mask": "0x0" 00:04:10.335 }, 00:04:10.335 "nvmf_tcp": { 00:04:10.335 "mask": "0x20", 00:04:10.335 "tpoint_mask": "0x0" 00:04:10.335 }, 00:04:10.335 "ftl": { 00:04:10.335 "mask": "0x40", 00:04:10.335 "tpoint_mask": "0x0" 00:04:10.335 }, 00:04:10.335 "blobfs": { 00:04:10.335 "mask": "0x80", 00:04:10.335 "tpoint_mask": "0x0" 00:04:10.335 }, 00:04:10.335 "dsa": { 00:04:10.335 "mask": "0x200", 00:04:10.335 "tpoint_mask": "0x0" 00:04:10.335 }, 00:04:10.335 "thread": { 00:04:10.335 "mask": "0x400", 00:04:10.335 "tpoint_mask": "0x0" 00:04:10.335 }, 00:04:10.335 "nvme_pcie": { 00:04:10.335 "mask": "0x800", 00:04:10.335 "tpoint_mask": "0x0" 00:04:10.335 }, 00:04:10.335 "iaa": { 00:04:10.335 "mask": "0x1000", 00:04:10.335 "tpoint_mask": "0x0" 00:04:10.335 }, 00:04:10.335 "nvme_tcp": { 00:04:10.335 "mask": "0x2000", 00:04:10.335 "tpoint_mask": "0x0" 00:04:10.335 }, 00:04:10.335 "bdev_nvme": { 00:04:10.335 "mask": "0x4000", 00:04:10.335 "tpoint_mask": "0x0" 00:04:10.335 } 00:04:10.335 }' 00:04:10.335 03:20:50 -- rpc/rpc.sh@43 -- # jq length 00:04:10.335 03:20:50 -- rpc/rpc.sh@43 -- # '[' 15 -gt 2 ']' 00:04:10.335 03:20:50 -- rpc/rpc.sh@44 -- # jq 'has("tpoint_group_mask")' 00:04:10.593 03:20:51 -- rpc/rpc.sh@44 -- # '[' true = true ']' 00:04:10.593 03:20:51 -- rpc/rpc.sh@45 -- # jq 'has("tpoint_shm_path")' 00:04:10.593 03:20:51 -- rpc/rpc.sh@45 -- # '[' true = true ']' 00:04:10.593 03:20:51 -- rpc/rpc.sh@46 -- # jq 'has("bdev")' 00:04:10.593 03:20:51 -- rpc/rpc.sh@46 -- # '[' true = true ']' 00:04:10.593 03:20:51 -- rpc/rpc.sh@47 -- # jq -r .bdev.tpoint_mask 00:04:10.593 03:20:51 -- rpc/rpc.sh@47 -- # '[' 0xffffffffffffffff '!=' 0x0 ']' 00:04:10.593 00:04:10.593 real 0m0.197s 00:04:10.593 user 0m0.172s 00:04:10.593 sys 0m0.017s 00:04:10.593 03:20:51 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:10.593 03:20:51 -- common/autotest_common.sh@10 -- # set +x 00:04:10.593 ************************************ 00:04:10.593 END TEST rpc_trace_cmd_test 00:04:10.593 ************************************ 00:04:10.593 03:20:51 -- rpc/rpc.sh@76 -- # [[ 0 -eq 1 ]] 00:04:10.593 03:20:51 -- rpc/rpc.sh@80 -- # rpc=rpc_cmd 00:04:10.593 03:20:51 -- rpc/rpc.sh@81 -- # run_test rpc_daemon_integrity rpc_integrity 00:04:10.593 03:20:51 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:10.593 03:20:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:10.593 03:20:51 -- common/autotest_common.sh@10 -- # set +x 00:04:10.593 ************************************ 00:04:10.593 START TEST rpc_daemon_integrity 00:04:10.593 ************************************ 00:04:10.593 03:20:51 -- common/autotest_common.sh@1114 -- # rpc_integrity 00:04:10.593 03:20:51 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:04:10.593 03:20:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:10.593 03:20:51 -- common/autotest_common.sh@10 -- # set +x 00:04:10.593 03:20:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:10.593 03:20:51 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:04:10.593 03:20:51 -- rpc/rpc.sh@13 -- # jq length 00:04:10.593 03:20:51 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:04:10.593 03:20:51 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:04:10.593 03:20:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:10.593 03:20:51 -- common/autotest_common.sh@10 -- # set +x 00:04:10.593 03:20:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:10.593 03:20:51 -- rpc/rpc.sh@15 -- # malloc=Malloc2 00:04:10.593 03:20:51 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:04:10.593 03:20:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:10.593 03:20:51 -- common/autotest_common.sh@10 -- # set +x 00:04:10.593 03:20:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:10.593 03:20:51 -- rpc/rpc.sh@16 -- # bdevs='[ 00:04:10.593 { 00:04:10.593 "name": "Malloc2", 00:04:10.593 "aliases": [ 00:04:10.593 "0d4c2986-424f-4f81-ad36-b6ad24ecfe57" 00:04:10.593 ], 00:04:10.593 "product_name": "Malloc disk", 00:04:10.593 "block_size": 512, 00:04:10.593 "num_blocks": 16384, 00:04:10.593 "uuid": "0d4c2986-424f-4f81-ad36-b6ad24ecfe57", 00:04:10.593 "assigned_rate_limits": { 00:04:10.593 "rw_ios_per_sec": 0, 00:04:10.593 "rw_mbytes_per_sec": 0, 00:04:10.593 "r_mbytes_per_sec": 0, 00:04:10.593 "w_mbytes_per_sec": 0 00:04:10.593 }, 00:04:10.593 "claimed": false, 00:04:10.593 "zoned": false, 00:04:10.593 "supported_io_types": { 00:04:10.593 "read": true, 00:04:10.593 "write": true, 00:04:10.593 "unmap": true, 00:04:10.593 "write_zeroes": true, 00:04:10.593 "flush": true, 00:04:10.593 "reset": true, 00:04:10.593 "compare": false, 00:04:10.593 "compare_and_write": false, 00:04:10.593 "abort": true, 00:04:10.593 "nvme_admin": false, 00:04:10.593 "nvme_io": false 00:04:10.593 }, 00:04:10.593 "memory_domains": [ 00:04:10.593 { 00:04:10.593 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:10.593 "dma_device_type": 2 00:04:10.593 } 00:04:10.593 ], 00:04:10.593 "driver_specific": {} 00:04:10.593 } 00:04:10.593 ]' 00:04:10.593 03:20:51 -- rpc/rpc.sh@17 -- # jq length 00:04:10.852 03:20:51 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:04:10.852 03:20:51 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc2 -p Passthru0 00:04:10.852 03:20:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:10.852 03:20:51 -- common/autotest_common.sh@10 -- # set +x 00:04:10.852 [2024-11-21 03:20:51.246593] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc2 00:04:10.852 [2024-11-21 03:20:51.246642] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:04:10.852 [2024-11-21 03:20:51.246666] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0x1416590 00:04:10.852 [2024-11-21 03:20:51.246681] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:04:10.852 [2024-11-21 03:20:51.248020] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:04:10.852 [2024-11-21 03:20:51.248049] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:04:10.852 Passthru0 00:04:10.852 03:20:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:10.852 03:20:51 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:04:10.852 03:20:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:10.852 03:20:51 -- common/autotest_common.sh@10 -- # set +x 00:04:10.852 03:20:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:10.852 03:20:51 -- rpc/rpc.sh@20 -- # bdevs='[ 00:04:10.852 { 00:04:10.852 "name": "Malloc2", 00:04:10.852 "aliases": [ 00:04:10.852 "0d4c2986-424f-4f81-ad36-b6ad24ecfe57" 00:04:10.852 ], 00:04:10.852 "product_name": "Malloc disk", 00:04:10.852 "block_size": 512, 00:04:10.852 "num_blocks": 16384, 00:04:10.853 "uuid": "0d4c2986-424f-4f81-ad36-b6ad24ecfe57", 00:04:10.853 "assigned_rate_limits": { 00:04:10.853 "rw_ios_per_sec": 0, 00:04:10.853 "rw_mbytes_per_sec": 0, 00:04:10.853 "r_mbytes_per_sec": 0, 00:04:10.853 "w_mbytes_per_sec": 0 00:04:10.853 }, 00:04:10.853 "claimed": true, 00:04:10.853 "claim_type": "exclusive_write", 00:04:10.853 "zoned": false, 00:04:10.853 "supported_io_types": { 00:04:10.853 "read": true, 00:04:10.853 "write": true, 00:04:10.853 "unmap": true, 00:04:10.853 "write_zeroes": true, 00:04:10.853 "flush": true, 00:04:10.853 "reset": true, 00:04:10.853 "compare": false, 00:04:10.853 "compare_and_write": false, 00:04:10.853 "abort": true, 00:04:10.853 "nvme_admin": false, 00:04:10.853 "nvme_io": false 00:04:10.853 }, 00:04:10.853 "memory_domains": [ 00:04:10.853 { 00:04:10.853 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:10.853 "dma_device_type": 2 00:04:10.853 } 00:04:10.853 ], 00:04:10.853 "driver_specific": {} 00:04:10.853 }, 00:04:10.853 { 00:04:10.853 "name": "Passthru0", 00:04:10.853 "aliases": [ 00:04:10.853 "a376536b-8820-51f4-821a-1fc4a683720a" 00:04:10.853 ], 00:04:10.853 "product_name": "passthru", 00:04:10.853 "block_size": 512, 00:04:10.853 "num_blocks": 16384, 00:04:10.853 "uuid": "a376536b-8820-51f4-821a-1fc4a683720a", 00:04:10.853 "assigned_rate_limits": { 00:04:10.853 "rw_ios_per_sec": 0, 00:04:10.853 "rw_mbytes_per_sec": 0, 00:04:10.853 "r_mbytes_per_sec": 0, 00:04:10.853 "w_mbytes_per_sec": 0 00:04:10.853 }, 00:04:10.853 "claimed": false, 00:04:10.853 "zoned": false, 00:04:10.853 "supported_io_types": { 00:04:10.853 "read": true, 00:04:10.853 "write": true, 00:04:10.853 "unmap": true, 00:04:10.853 "write_zeroes": true, 00:04:10.853 "flush": true, 00:04:10.853 "reset": true, 00:04:10.853 "compare": false, 00:04:10.853 "compare_and_write": false, 00:04:10.853 "abort": true, 00:04:10.853 "nvme_admin": false, 00:04:10.853 "nvme_io": false 00:04:10.853 }, 00:04:10.853 "memory_domains": [ 00:04:10.853 { 00:04:10.853 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:10.853 "dma_device_type": 2 00:04:10.853 } 00:04:10.853 ], 00:04:10.853 "driver_specific": { 00:04:10.853 "passthru": { 00:04:10.853 "name": "Passthru0", 00:04:10.853 "base_bdev_name": "Malloc2" 00:04:10.853 } 00:04:10.853 } 00:04:10.853 } 00:04:10.853 ]' 00:04:10.853 03:20:51 -- rpc/rpc.sh@21 -- # jq length 00:04:10.853 03:20:51 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:04:10.853 03:20:51 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:04:10.853 03:20:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:10.853 03:20:51 -- common/autotest_common.sh@10 -- # set +x 00:04:10.853 03:20:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:10.853 03:20:51 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc2 00:04:10.853 03:20:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:10.853 03:20:51 -- common/autotest_common.sh@10 -- # set +x 00:04:10.853 03:20:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:10.853 03:20:51 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:04:10.853 03:20:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:10.853 03:20:51 -- common/autotest_common.sh@10 -- # set +x 00:04:10.853 03:20:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:10.853 03:20:51 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:04:10.853 03:20:51 -- rpc/rpc.sh@26 -- # jq length 00:04:10.853 03:20:51 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:04:10.853 00:04:10.853 real 0m0.229s 00:04:10.853 user 0m0.160s 00:04:10.853 sys 0m0.014s 00:04:10.853 03:20:51 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:10.853 03:20:51 -- common/autotest_common.sh@10 -- # set +x 00:04:10.853 ************************************ 00:04:10.853 END TEST rpc_daemon_integrity 00:04:10.853 ************************************ 00:04:10.853 03:20:51 -- rpc/rpc.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:04:10.853 03:20:51 -- rpc/rpc.sh@84 -- # killprocess 2927274 00:04:10.853 03:20:51 -- common/autotest_common.sh@936 -- # '[' -z 2927274 ']' 00:04:10.853 03:20:51 -- common/autotest_common.sh@940 -- # kill -0 2927274 00:04:10.853 03:20:51 -- common/autotest_common.sh@941 -- # uname 00:04:10.853 03:20:51 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:10.853 03:20:51 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2927274 00:04:10.853 03:20:51 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:10.853 03:20:51 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:10.853 03:20:51 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2927274' 00:04:10.853 killing process with pid 2927274 00:04:10.853 03:20:51 -- common/autotest_common.sh@955 -- # kill 2927274 00:04:10.853 03:20:51 -- common/autotest_common.sh@960 -- # wait 2927274 00:04:11.419 00:04:11.419 real 0m2.492s 00:04:11.419 user 0m3.131s 00:04:11.419 sys 0m0.597s 00:04:11.419 03:20:51 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:11.419 03:20:51 -- common/autotest_common.sh@10 -- # set +x 00:04:11.419 ************************************ 00:04:11.419 END TEST rpc 00:04:11.419 ************************************ 00:04:11.419 03:20:51 -- spdk/autotest.sh@164 -- # run_test rpc_client /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:04:11.419 03:20:51 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:11.419 03:20:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:11.419 03:20:51 -- common/autotest_common.sh@10 -- # set +x 00:04:11.419 ************************************ 00:04:11.419 START TEST rpc_client 00:04:11.419 ************************************ 00:04:11.419 03:20:51 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:04:11.419 * Looking for test storage... 00:04:11.419 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client 00:04:11.419 03:20:51 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:11.419 03:20:51 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:11.419 03:20:51 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:11.419 03:20:52 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:11.419 03:20:52 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:11.419 03:20:52 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:11.419 03:20:52 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:11.419 03:20:52 -- scripts/common.sh@335 -- # IFS=.-: 00:04:11.419 03:20:52 -- scripts/common.sh@335 -- # read -ra ver1 00:04:11.419 03:20:52 -- scripts/common.sh@336 -- # IFS=.-: 00:04:11.419 03:20:52 -- scripts/common.sh@336 -- # read -ra ver2 00:04:11.419 03:20:52 -- scripts/common.sh@337 -- # local 'op=<' 00:04:11.419 03:20:52 -- scripts/common.sh@339 -- # ver1_l=2 00:04:11.419 03:20:52 -- scripts/common.sh@340 -- # ver2_l=1 00:04:11.419 03:20:52 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:11.419 03:20:52 -- scripts/common.sh@343 -- # case "$op" in 00:04:11.419 03:20:52 -- scripts/common.sh@344 -- # : 1 00:04:11.419 03:20:52 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:11.419 03:20:52 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:11.419 03:20:52 -- scripts/common.sh@364 -- # decimal 1 00:04:11.419 03:20:52 -- scripts/common.sh@352 -- # local d=1 00:04:11.419 03:20:52 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:11.419 03:20:52 -- scripts/common.sh@354 -- # echo 1 00:04:11.419 03:20:52 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:11.419 03:20:52 -- scripts/common.sh@365 -- # decimal 2 00:04:11.419 03:20:52 -- scripts/common.sh@352 -- # local d=2 00:04:11.419 03:20:52 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:11.419 03:20:52 -- scripts/common.sh@354 -- # echo 2 00:04:11.419 03:20:52 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:11.419 03:20:52 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:11.419 03:20:52 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:11.419 03:20:52 -- scripts/common.sh@367 -- # return 0 00:04:11.419 03:20:52 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:11.419 03:20:52 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:11.419 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:11.419 --rc genhtml_branch_coverage=1 00:04:11.419 --rc genhtml_function_coverage=1 00:04:11.419 --rc genhtml_legend=1 00:04:11.419 --rc geninfo_all_blocks=1 00:04:11.419 --rc geninfo_unexecuted_blocks=1 00:04:11.419 00:04:11.419 ' 00:04:11.419 03:20:52 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:11.419 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:11.419 --rc genhtml_branch_coverage=1 00:04:11.419 --rc genhtml_function_coverage=1 00:04:11.419 --rc genhtml_legend=1 00:04:11.419 --rc geninfo_all_blocks=1 00:04:11.419 --rc geninfo_unexecuted_blocks=1 00:04:11.419 00:04:11.419 ' 00:04:11.419 03:20:52 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:11.419 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:11.419 --rc genhtml_branch_coverage=1 00:04:11.419 --rc genhtml_function_coverage=1 00:04:11.419 --rc genhtml_legend=1 00:04:11.419 --rc geninfo_all_blocks=1 00:04:11.419 --rc geninfo_unexecuted_blocks=1 00:04:11.419 00:04:11.419 ' 00:04:11.419 03:20:52 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:11.419 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:11.419 --rc genhtml_branch_coverage=1 00:04:11.419 --rc genhtml_function_coverage=1 00:04:11.419 --rc genhtml_legend=1 00:04:11.419 --rc geninfo_all_blocks=1 00:04:11.419 --rc geninfo_unexecuted_blocks=1 00:04:11.419 00:04:11.419 ' 00:04:11.419 03:20:52 -- rpc_client/rpc_client.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client_test 00:04:11.677 OK 00:04:11.677 03:20:52 -- rpc_client/rpc_client.sh@12 -- # trap - SIGINT SIGTERM EXIT 00:04:11.677 00:04:11.677 real 0m0.168s 00:04:11.677 user 0m0.118s 00:04:11.677 sys 0m0.058s 00:04:11.677 03:20:52 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:11.677 03:20:52 -- common/autotest_common.sh@10 -- # set +x 00:04:11.677 ************************************ 00:04:11.677 END TEST rpc_client 00:04:11.677 ************************************ 00:04:11.677 03:20:52 -- spdk/autotest.sh@165 -- # run_test json_config /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:04:11.677 03:20:52 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:11.677 03:20:52 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:11.677 03:20:52 -- common/autotest_common.sh@10 -- # set +x 00:04:11.677 ************************************ 00:04:11.677 START TEST json_config 00:04:11.677 ************************************ 00:04:11.677 03:20:52 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:04:11.677 03:20:52 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:11.677 03:20:52 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:11.677 03:20:52 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:11.677 03:20:52 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:11.677 03:20:52 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:11.677 03:20:52 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:11.677 03:20:52 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:11.677 03:20:52 -- scripts/common.sh@335 -- # IFS=.-: 00:04:11.677 03:20:52 -- scripts/common.sh@335 -- # read -ra ver1 00:04:11.677 03:20:52 -- scripts/common.sh@336 -- # IFS=.-: 00:04:11.677 03:20:52 -- scripts/common.sh@336 -- # read -ra ver2 00:04:11.677 03:20:52 -- scripts/common.sh@337 -- # local 'op=<' 00:04:11.677 03:20:52 -- scripts/common.sh@339 -- # ver1_l=2 00:04:11.677 03:20:52 -- scripts/common.sh@340 -- # ver2_l=1 00:04:11.677 03:20:52 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:11.677 03:20:52 -- scripts/common.sh@343 -- # case "$op" in 00:04:11.677 03:20:52 -- scripts/common.sh@344 -- # : 1 00:04:11.677 03:20:52 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:11.677 03:20:52 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:11.677 03:20:52 -- scripts/common.sh@364 -- # decimal 1 00:04:11.677 03:20:52 -- scripts/common.sh@352 -- # local d=1 00:04:11.677 03:20:52 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:11.677 03:20:52 -- scripts/common.sh@354 -- # echo 1 00:04:11.677 03:20:52 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:11.677 03:20:52 -- scripts/common.sh@365 -- # decimal 2 00:04:11.677 03:20:52 -- scripts/common.sh@352 -- # local d=2 00:04:11.677 03:20:52 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:11.677 03:20:52 -- scripts/common.sh@354 -- # echo 2 00:04:11.677 03:20:52 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:11.677 03:20:52 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:11.677 03:20:52 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:11.677 03:20:52 -- scripts/common.sh@367 -- # return 0 00:04:11.677 03:20:52 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:11.677 03:20:52 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:11.677 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:11.677 --rc genhtml_branch_coverage=1 00:04:11.677 --rc genhtml_function_coverage=1 00:04:11.677 --rc genhtml_legend=1 00:04:11.677 --rc geninfo_all_blocks=1 00:04:11.677 --rc geninfo_unexecuted_blocks=1 00:04:11.677 00:04:11.677 ' 00:04:11.677 03:20:52 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:11.677 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:11.677 --rc genhtml_branch_coverage=1 00:04:11.677 --rc genhtml_function_coverage=1 00:04:11.677 --rc genhtml_legend=1 00:04:11.677 --rc geninfo_all_blocks=1 00:04:11.677 --rc geninfo_unexecuted_blocks=1 00:04:11.677 00:04:11.677 ' 00:04:11.677 03:20:52 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:11.677 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:11.677 --rc genhtml_branch_coverage=1 00:04:11.677 --rc genhtml_function_coverage=1 00:04:11.677 --rc genhtml_legend=1 00:04:11.677 --rc geninfo_all_blocks=1 00:04:11.677 --rc geninfo_unexecuted_blocks=1 00:04:11.677 00:04:11.677 ' 00:04:11.677 03:20:52 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:11.677 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:11.677 --rc genhtml_branch_coverage=1 00:04:11.677 --rc genhtml_function_coverage=1 00:04:11.677 --rc genhtml_legend=1 00:04:11.677 --rc geninfo_all_blocks=1 00:04:11.677 --rc geninfo_unexecuted_blocks=1 00:04:11.677 00:04:11.677 ' 00:04:11.677 03:20:52 -- json_config/json_config.sh@8 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:04:11.677 03:20:52 -- nvmf/common.sh@7 -- # uname -s 00:04:11.677 03:20:52 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:04:11.677 03:20:52 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:04:11.677 03:20:52 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:04:11.677 03:20:52 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:04:11.677 03:20:52 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:04:11.677 03:20:52 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:04:11.677 03:20:52 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:04:11.677 03:20:52 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:04:11.677 03:20:52 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:04:11.677 03:20:52 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:04:11.677 03:20:52 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:04:11.677 03:20:52 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:04:11.677 03:20:52 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:04:11.677 03:20:52 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:04:11.677 03:20:52 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:04:11.677 03:20:52 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:04:11.677 03:20:52 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:04:11.677 03:20:52 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:04:11.677 03:20:52 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:04:11.677 03:20:52 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:11.677 03:20:52 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:11.678 03:20:52 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:11.678 03:20:52 -- paths/export.sh@5 -- # export PATH 00:04:11.678 03:20:52 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:11.678 03:20:52 -- nvmf/common.sh@46 -- # : 0 00:04:11.678 03:20:52 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:04:11.678 03:20:52 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:04:11.678 03:20:52 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:04:11.678 03:20:52 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:04:11.678 03:20:52 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:04:11.678 03:20:52 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:04:11.678 03:20:52 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:04:11.678 03:20:52 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:04:11.678 03:20:52 -- json_config/json_config.sh@10 -- # [[ 0 -eq 1 ]] 00:04:11.678 03:20:52 -- json_config/json_config.sh@14 -- # [[ 0 -ne 1 ]] 00:04:11.678 03:20:52 -- json_config/json_config.sh@14 -- # [[ 0 -eq 1 ]] 00:04:11.678 03:20:52 -- json_config/json_config.sh@25 -- # (( SPDK_TEST_BLOCKDEV + SPDK_TEST_ISCSI + SPDK_TEST_NVMF + SPDK_TEST_VHOST + SPDK_TEST_VHOST_INIT + SPDK_TEST_RBD == 0 )) 00:04:11.678 03:20:52 -- json_config/json_config.sh@30 -- # app_pid=(['target']='' ['initiator']='') 00:04:11.678 03:20:52 -- json_config/json_config.sh@30 -- # declare -A app_pid 00:04:11.678 03:20:52 -- json_config/json_config.sh@31 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock' ['initiator']='/var/tmp/spdk_initiator.sock') 00:04:11.678 03:20:52 -- json_config/json_config.sh@31 -- # declare -A app_socket 00:04:11.678 03:20:52 -- json_config/json_config.sh@32 -- # app_params=(['target']='-m 0x1 -s 1024' ['initiator']='-m 0x2 -g -u -s 1024') 00:04:11.678 03:20:52 -- json_config/json_config.sh@32 -- # declare -A app_params 00:04:11.678 03:20:52 -- json_config/json_config.sh@33 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json' ['initiator']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json') 00:04:11.678 03:20:52 -- json_config/json_config.sh@33 -- # declare -A configs_path 00:04:11.678 03:20:52 -- json_config/json_config.sh@43 -- # last_event_id=0 00:04:11.678 03:20:52 -- json_config/json_config.sh@418 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:04:11.678 03:20:52 -- json_config/json_config.sh@419 -- # echo 'INFO: JSON configuration test init' 00:04:11.678 INFO: JSON configuration test init 00:04:11.678 03:20:52 -- json_config/json_config.sh@420 -- # json_config_test_init 00:04:11.678 03:20:52 -- json_config/json_config.sh@315 -- # timing_enter json_config_test_init 00:04:11.678 03:20:52 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:11.678 03:20:52 -- common/autotest_common.sh@10 -- # set +x 00:04:11.678 03:20:52 -- json_config/json_config.sh@316 -- # timing_enter json_config_setup_target 00:04:11.678 03:20:52 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:11.678 03:20:52 -- common/autotest_common.sh@10 -- # set +x 00:04:11.678 03:20:52 -- json_config/json_config.sh@318 -- # json_config_test_start_app target --wait-for-rpc 00:04:11.678 03:20:52 -- json_config/json_config.sh@98 -- # local app=target 00:04:11.678 03:20:52 -- json_config/json_config.sh@99 -- # shift 00:04:11.678 03:20:52 -- json_config/json_config.sh@101 -- # [[ -n 22 ]] 00:04:11.678 03:20:52 -- json_config/json_config.sh@102 -- # [[ -z '' ]] 00:04:11.678 03:20:52 -- json_config/json_config.sh@104 -- # local app_extra_params= 00:04:11.678 03:20:52 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:04:11.678 03:20:52 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:04:11.678 03:20:52 -- json_config/json_config.sh@111 -- # app_pid[$app]=2927772 00:04:11.678 03:20:52 -- json_config/json_config.sh@110 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --wait-for-rpc 00:04:11.678 03:20:52 -- json_config/json_config.sh@113 -- # echo 'Waiting for target to run...' 00:04:11.678 Waiting for target to run... 00:04:11.678 03:20:52 -- json_config/json_config.sh@114 -- # waitforlisten 2927772 /var/tmp/spdk_tgt.sock 00:04:11.678 03:20:52 -- common/autotest_common.sh@829 -- # '[' -z 2927772 ']' 00:04:11.678 03:20:52 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:04:11.678 03:20:52 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:11.678 03:20:52 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:04:11.678 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:04:11.678 03:20:52 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:11.678 03:20:52 -- common/autotest_common.sh@10 -- # set +x 00:04:11.678 [2024-11-21 03:20:52.288894] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:11.678 [2024-11-21 03:20:52.288991] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2927772 ] 00:04:11.678 EAL: No free 2048 kB hugepages reported on node 1 00:04:12.243 [2024-11-21 03:20:52.616149] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:12.243 [2024-11-21 03:20:52.702265] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:12.243 [2024-11-21 03:20:52.702455] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:12.807 03:20:53 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:12.807 03:20:53 -- common/autotest_common.sh@862 -- # return 0 00:04:12.807 03:20:53 -- json_config/json_config.sh@115 -- # echo '' 00:04:12.807 00:04:12.807 03:20:53 -- json_config/json_config.sh@322 -- # create_accel_config 00:04:12.807 03:20:53 -- json_config/json_config.sh@146 -- # timing_enter create_accel_config 00:04:12.807 03:20:53 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:12.807 03:20:53 -- common/autotest_common.sh@10 -- # set +x 00:04:12.807 03:20:53 -- json_config/json_config.sh@148 -- # [[ 0 -eq 1 ]] 00:04:12.807 03:20:53 -- json_config/json_config.sh@154 -- # timing_exit create_accel_config 00:04:12.807 03:20:53 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:12.807 03:20:53 -- common/autotest_common.sh@10 -- # set +x 00:04:12.807 03:20:53 -- json_config/json_config.sh@326 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh --json-with-subsystems 00:04:12.807 03:20:53 -- json_config/json_config.sh@327 -- # tgt_rpc load_config 00:04:12.807 03:20:53 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock load_config 00:04:16.090 03:20:56 -- json_config/json_config.sh@329 -- # tgt_check_notification_types 00:04:16.090 03:20:56 -- json_config/json_config.sh@46 -- # timing_enter tgt_check_notification_types 00:04:16.090 03:20:56 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:16.090 03:20:56 -- common/autotest_common.sh@10 -- # set +x 00:04:16.090 03:20:56 -- json_config/json_config.sh@48 -- # local ret=0 00:04:16.090 03:20:56 -- json_config/json_config.sh@49 -- # enabled_types=('bdev_register' 'bdev_unregister') 00:04:16.090 03:20:56 -- json_config/json_config.sh@49 -- # local enabled_types 00:04:16.090 03:20:56 -- json_config/json_config.sh@51 -- # tgt_rpc notify_get_types 00:04:16.090 03:20:56 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock notify_get_types 00:04:16.090 03:20:56 -- json_config/json_config.sh@51 -- # jq -r '.[]' 00:04:16.090 03:20:56 -- json_config/json_config.sh@51 -- # get_types=('bdev_register' 'bdev_unregister') 00:04:16.090 03:20:56 -- json_config/json_config.sh@51 -- # local get_types 00:04:16.090 03:20:56 -- json_config/json_config.sh@52 -- # [[ bdev_register bdev_unregister != \b\d\e\v\_\r\e\g\i\s\t\e\r\ \b\d\e\v\_\u\n\r\e\g\i\s\t\e\r ]] 00:04:16.090 03:20:56 -- json_config/json_config.sh@57 -- # timing_exit tgt_check_notification_types 00:04:16.090 03:20:56 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:16.090 03:20:56 -- common/autotest_common.sh@10 -- # set +x 00:04:16.348 03:20:56 -- json_config/json_config.sh@58 -- # return 0 00:04:16.348 03:20:56 -- json_config/json_config.sh@331 -- # [[ 0 -eq 1 ]] 00:04:16.348 03:20:56 -- json_config/json_config.sh@335 -- # [[ 0 -eq 1 ]] 00:04:16.348 03:20:56 -- json_config/json_config.sh@339 -- # [[ 0 -eq 1 ]] 00:04:16.348 03:20:56 -- json_config/json_config.sh@343 -- # [[ 1 -eq 1 ]] 00:04:16.348 03:20:56 -- json_config/json_config.sh@344 -- # create_nvmf_subsystem_config 00:04:16.348 03:20:56 -- json_config/json_config.sh@283 -- # timing_enter create_nvmf_subsystem_config 00:04:16.348 03:20:56 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:16.348 03:20:56 -- common/autotest_common.sh@10 -- # set +x 00:04:16.348 03:20:56 -- json_config/json_config.sh@285 -- # NVMF_FIRST_TARGET_IP=127.0.0.1 00:04:16.348 03:20:56 -- json_config/json_config.sh@286 -- # [[ tcp == \r\d\m\a ]] 00:04:16.348 03:20:56 -- json_config/json_config.sh@290 -- # [[ -z 127.0.0.1 ]] 00:04:16.348 03:20:56 -- json_config/json_config.sh@295 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocForNvmf0 00:04:16.348 03:20:56 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocForNvmf0 00:04:16.348 MallocForNvmf0 00:04:16.606 03:20:57 -- json_config/json_config.sh@296 -- # tgt_rpc bdev_malloc_create 4 1024 --name MallocForNvmf1 00:04:16.606 03:20:57 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 4 1024 --name MallocForNvmf1 00:04:16.606 MallocForNvmf1 00:04:16.606 03:20:57 -- json_config/json_config.sh@298 -- # tgt_rpc nvmf_create_transport -t tcp -u 8192 -c 0 00:04:16.606 03:20:57 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_transport -t tcp -u 8192 -c 0 00:04:16.865 [2024-11-21 03:20:57.472615] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:04:16.865 03:20:57 -- json_config/json_config.sh@299 -- # tgt_rpc nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:04:16.865 03:20:57 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:04:17.122 03:20:57 -- json_config/json_config.sh@300 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:04:17.122 03:20:57 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:04:17.380 03:20:57 -- json_config/json_config.sh@301 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:04:17.380 03:20:57 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:04:17.638 03:20:58 -- json_config/json_config.sh@302 -- # tgt_rpc nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:04:17.638 03:20:58 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:04:17.896 [2024-11-21 03:20:58.463923] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:04:17.896 03:20:58 -- json_config/json_config.sh@304 -- # timing_exit create_nvmf_subsystem_config 00:04:17.896 03:20:58 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:17.896 03:20:58 -- common/autotest_common.sh@10 -- # set +x 00:04:17.896 03:20:58 -- json_config/json_config.sh@346 -- # timing_exit json_config_setup_target 00:04:17.896 03:20:58 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:17.896 03:20:58 -- common/autotest_common.sh@10 -- # set +x 00:04:17.896 03:20:58 -- json_config/json_config.sh@348 -- # [[ 0 -eq 1 ]] 00:04:17.896 03:20:58 -- json_config/json_config.sh@353 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:04:17.896 03:20:58 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:04:18.153 MallocBdevForConfigChangeCheck 00:04:18.153 03:20:58 -- json_config/json_config.sh@355 -- # timing_exit json_config_test_init 00:04:18.153 03:20:58 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:18.153 03:20:58 -- common/autotest_common.sh@10 -- # set +x 00:04:18.411 03:20:58 -- json_config/json_config.sh@422 -- # tgt_rpc save_config 00:04:18.411 03:20:58 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:18.674 03:20:59 -- json_config/json_config.sh@424 -- # echo 'INFO: shutting down applications...' 00:04:18.674 INFO: shutting down applications... 00:04:18.674 03:20:59 -- json_config/json_config.sh@425 -- # [[ 0 -eq 1 ]] 00:04:18.674 03:20:59 -- json_config/json_config.sh@431 -- # json_config_clear target 00:04:18.674 03:20:59 -- json_config/json_config.sh@385 -- # [[ -n 22 ]] 00:04:18.674 03:20:59 -- json_config/json_config.sh@386 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py -s /var/tmp/spdk_tgt.sock clear_config 00:04:20.577 Calling clear_iscsi_subsystem 00:04:20.577 Calling clear_nvmf_subsystem 00:04:20.577 Calling clear_nbd_subsystem 00:04:20.577 Calling clear_ublk_subsystem 00:04:20.577 Calling clear_vhost_blk_subsystem 00:04:20.577 Calling clear_vhost_scsi_subsystem 00:04:20.577 Calling clear_scheduler_subsystem 00:04:20.577 Calling clear_bdev_subsystem 00:04:20.577 Calling clear_accel_subsystem 00:04:20.577 Calling clear_vmd_subsystem 00:04:20.577 Calling clear_sock_subsystem 00:04:20.577 Calling clear_iobuf_subsystem 00:04:20.577 03:21:00 -- json_config/json_config.sh@390 -- # local config_filter=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py 00:04:20.577 03:21:00 -- json_config/json_config.sh@396 -- # count=100 00:04:20.577 03:21:00 -- json_config/json_config.sh@397 -- # '[' 100 -gt 0 ']' 00:04:20.577 03:21:00 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:20.577 03:21:00 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method delete_global_parameters 00:04:20.577 03:21:00 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method check_empty 00:04:20.577 03:21:01 -- json_config/json_config.sh@398 -- # break 00:04:20.577 03:21:01 -- json_config/json_config.sh@403 -- # '[' 100 -eq 0 ']' 00:04:20.577 03:21:01 -- json_config/json_config.sh@432 -- # json_config_test_shutdown_app target 00:04:20.577 03:21:01 -- json_config/json_config.sh@120 -- # local app=target 00:04:20.577 03:21:01 -- json_config/json_config.sh@123 -- # [[ -n 22 ]] 00:04:20.577 03:21:01 -- json_config/json_config.sh@124 -- # [[ -n 2927772 ]] 00:04:20.577 03:21:01 -- json_config/json_config.sh@127 -- # kill -SIGINT 2927772 00:04:20.577 03:21:01 -- json_config/json_config.sh@129 -- # (( i = 0 )) 00:04:20.577 03:21:01 -- json_config/json_config.sh@129 -- # (( i < 30 )) 00:04:20.577 03:21:01 -- json_config/json_config.sh@130 -- # kill -0 2927772 00:04:20.577 03:21:01 -- json_config/json_config.sh@134 -- # sleep 0.5 00:04:21.144 03:21:01 -- json_config/json_config.sh@129 -- # (( i++ )) 00:04:21.144 03:21:01 -- json_config/json_config.sh@129 -- # (( i < 30 )) 00:04:21.144 03:21:01 -- json_config/json_config.sh@130 -- # kill -0 2927772 00:04:21.144 03:21:01 -- json_config/json_config.sh@131 -- # app_pid[$app]= 00:04:21.144 03:21:01 -- json_config/json_config.sh@132 -- # break 00:04:21.144 03:21:01 -- json_config/json_config.sh@137 -- # [[ -n '' ]] 00:04:21.144 03:21:01 -- json_config/json_config.sh@142 -- # echo 'SPDK target shutdown done' 00:04:21.144 SPDK target shutdown done 00:04:21.144 03:21:01 -- json_config/json_config.sh@434 -- # echo 'INFO: relaunching applications...' 00:04:21.144 INFO: relaunching applications... 00:04:21.144 03:21:01 -- json_config/json_config.sh@435 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:21.144 03:21:01 -- json_config/json_config.sh@98 -- # local app=target 00:04:21.144 03:21:01 -- json_config/json_config.sh@99 -- # shift 00:04:21.144 03:21:01 -- json_config/json_config.sh@101 -- # [[ -n 22 ]] 00:04:21.144 03:21:01 -- json_config/json_config.sh@102 -- # [[ -z '' ]] 00:04:21.144 03:21:01 -- json_config/json_config.sh@104 -- # local app_extra_params= 00:04:21.144 03:21:01 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:04:21.144 03:21:01 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:04:21.144 03:21:01 -- json_config/json_config.sh@111 -- # app_pid[$app]=2929220 00:04:21.144 03:21:01 -- json_config/json_config.sh@110 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:21.144 03:21:01 -- json_config/json_config.sh@113 -- # echo 'Waiting for target to run...' 00:04:21.144 Waiting for target to run... 00:04:21.144 03:21:01 -- json_config/json_config.sh@114 -- # waitforlisten 2929220 /var/tmp/spdk_tgt.sock 00:04:21.144 03:21:01 -- common/autotest_common.sh@829 -- # '[' -z 2929220 ']' 00:04:21.144 03:21:01 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:04:21.144 03:21:01 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:21.144 03:21:01 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:04:21.144 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:04:21.144 03:21:01 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:21.144 03:21:01 -- common/autotest_common.sh@10 -- # set +x 00:04:21.144 [2024-11-21 03:21:01.728041] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:21.144 [2024-11-21 03:21:01.728139] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2929220 ] 00:04:21.144 EAL: No free 2048 kB hugepages reported on node 1 00:04:21.711 [2024-11-21 03:21:02.235986] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:21.711 [2024-11-21 03:21:02.338202] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:21.711 [2024-11-21 03:21:02.338405] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:25.061 [2024-11-21 03:21:05.371978] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:04:25.061 [2024-11-21 03:21:05.404486] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:04:25.061 03:21:05 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:25.061 03:21:05 -- common/autotest_common.sh@862 -- # return 0 00:04:25.061 03:21:05 -- json_config/json_config.sh@115 -- # echo '' 00:04:25.061 00:04:25.061 03:21:05 -- json_config/json_config.sh@436 -- # [[ 0 -eq 1 ]] 00:04:25.061 03:21:05 -- json_config/json_config.sh@440 -- # echo 'INFO: Checking if target configuration is the same...' 00:04:25.061 INFO: Checking if target configuration is the same... 00:04:25.061 03:21:05 -- json_config/json_config.sh@441 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:25.061 03:21:05 -- json_config/json_config.sh@441 -- # tgt_rpc save_config 00:04:25.061 03:21:05 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:25.061 + '[' 2 -ne 2 ']' 00:04:25.061 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:04:25.061 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:04:25.061 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:04:25.061 +++ basename /dev/fd/62 00:04:25.061 ++ mktemp /tmp/62.XXX 00:04:25.061 + tmp_file_1=/tmp/62.MFv 00:04:25.061 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:25.061 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:04:25.061 + tmp_file_2=/tmp/spdk_tgt_config.json.eXo 00:04:25.061 + ret=0 00:04:25.061 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:25.627 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:25.627 + diff -u /tmp/62.MFv /tmp/spdk_tgt_config.json.eXo 00:04:25.627 + echo 'INFO: JSON config files are the same' 00:04:25.627 INFO: JSON config files are the same 00:04:25.627 + rm /tmp/62.MFv /tmp/spdk_tgt_config.json.eXo 00:04:25.627 + exit 0 00:04:25.627 03:21:06 -- json_config/json_config.sh@442 -- # [[ 0 -eq 1 ]] 00:04:25.627 03:21:06 -- json_config/json_config.sh@447 -- # echo 'INFO: changing configuration and checking if this can be detected...' 00:04:25.627 INFO: changing configuration and checking if this can be detected... 00:04:25.627 03:21:06 -- json_config/json_config.sh@449 -- # tgt_rpc bdev_malloc_delete MallocBdevForConfigChangeCheck 00:04:25.627 03:21:06 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_delete MallocBdevForConfigChangeCheck 00:04:25.885 03:21:06 -- json_config/json_config.sh@450 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:25.885 03:21:06 -- json_config/json_config.sh@450 -- # tgt_rpc save_config 00:04:25.885 03:21:06 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:25.885 + '[' 2 -ne 2 ']' 00:04:25.885 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:04:25.885 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:04:25.885 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:04:25.885 +++ basename /dev/fd/62 00:04:25.885 ++ mktemp /tmp/62.XXX 00:04:25.885 + tmp_file_1=/tmp/62.xfg 00:04:25.886 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:25.886 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:04:25.886 + tmp_file_2=/tmp/spdk_tgt_config.json.cLP 00:04:25.886 + ret=0 00:04:25.886 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:26.144 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:26.144 + diff -u /tmp/62.xfg /tmp/spdk_tgt_config.json.cLP 00:04:26.144 + ret=1 00:04:26.144 + echo '=== Start of file: /tmp/62.xfg ===' 00:04:26.144 + cat /tmp/62.xfg 00:04:26.144 + echo '=== End of file: /tmp/62.xfg ===' 00:04:26.144 + echo '' 00:04:26.144 + echo '=== Start of file: /tmp/spdk_tgt_config.json.cLP ===' 00:04:26.144 + cat /tmp/spdk_tgt_config.json.cLP 00:04:26.144 + echo '=== End of file: /tmp/spdk_tgt_config.json.cLP ===' 00:04:26.144 + echo '' 00:04:26.144 + rm /tmp/62.xfg /tmp/spdk_tgt_config.json.cLP 00:04:26.144 + exit 1 00:04:26.144 03:21:06 -- json_config/json_config.sh@454 -- # echo 'INFO: configuration change detected.' 00:04:26.144 INFO: configuration change detected. 00:04:26.144 03:21:06 -- json_config/json_config.sh@457 -- # json_config_test_fini 00:04:26.144 03:21:06 -- json_config/json_config.sh@359 -- # timing_enter json_config_test_fini 00:04:26.144 03:21:06 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:26.144 03:21:06 -- common/autotest_common.sh@10 -- # set +x 00:04:26.144 03:21:06 -- json_config/json_config.sh@360 -- # local ret=0 00:04:26.144 03:21:06 -- json_config/json_config.sh@362 -- # [[ -n '' ]] 00:04:26.144 03:21:06 -- json_config/json_config.sh@370 -- # [[ -n 2929220 ]] 00:04:26.144 03:21:06 -- json_config/json_config.sh@373 -- # cleanup_bdev_subsystem_config 00:04:26.144 03:21:06 -- json_config/json_config.sh@237 -- # timing_enter cleanup_bdev_subsystem_config 00:04:26.144 03:21:06 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:26.144 03:21:06 -- common/autotest_common.sh@10 -- # set +x 00:04:26.144 03:21:06 -- json_config/json_config.sh@239 -- # [[ 0 -eq 1 ]] 00:04:26.144 03:21:06 -- json_config/json_config.sh@246 -- # uname -s 00:04:26.403 03:21:06 -- json_config/json_config.sh@246 -- # [[ Linux = Linux ]] 00:04:26.403 03:21:06 -- json_config/json_config.sh@247 -- # rm -f /sample_aio 00:04:26.403 03:21:06 -- json_config/json_config.sh@250 -- # [[ 0 -eq 1 ]] 00:04:26.403 03:21:06 -- json_config/json_config.sh@254 -- # timing_exit cleanup_bdev_subsystem_config 00:04:26.403 03:21:06 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:26.403 03:21:06 -- common/autotest_common.sh@10 -- # set +x 00:04:26.403 03:21:06 -- json_config/json_config.sh@376 -- # killprocess 2929220 00:04:26.403 03:21:06 -- common/autotest_common.sh@936 -- # '[' -z 2929220 ']' 00:04:26.403 03:21:06 -- common/autotest_common.sh@940 -- # kill -0 2929220 00:04:26.403 03:21:06 -- common/autotest_common.sh@941 -- # uname 00:04:26.403 03:21:06 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:26.403 03:21:06 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2929220 00:04:26.403 03:21:06 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:26.403 03:21:06 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:26.403 03:21:06 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2929220' 00:04:26.403 killing process with pid 2929220 00:04:26.403 03:21:06 -- common/autotest_common.sh@955 -- # kill 2929220 00:04:26.403 03:21:06 -- common/autotest_common.sh@960 -- # wait 2929220 00:04:28.306 03:21:08 -- json_config/json_config.sh@379 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:28.306 03:21:08 -- json_config/json_config.sh@380 -- # timing_exit json_config_test_fini 00:04:28.306 03:21:08 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:28.306 03:21:08 -- common/autotest_common.sh@10 -- # set +x 00:04:28.306 03:21:08 -- json_config/json_config.sh@381 -- # return 0 00:04:28.306 03:21:08 -- json_config/json_config.sh@459 -- # echo 'INFO: Success' 00:04:28.306 INFO: Success 00:04:28.306 00:04:28.306 real 0m16.427s 00:04:28.306 user 0m19.019s 00:04:28.306 sys 0m2.097s 00:04:28.306 03:21:08 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:28.306 03:21:08 -- common/autotest_common.sh@10 -- # set +x 00:04:28.306 ************************************ 00:04:28.306 END TEST json_config 00:04:28.306 ************************************ 00:04:28.306 03:21:08 -- spdk/autotest.sh@166 -- # run_test json_config_extra_key /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:04:28.306 03:21:08 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:28.306 03:21:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:28.306 03:21:08 -- common/autotest_common.sh@10 -- # set +x 00:04:28.306 ************************************ 00:04:28.306 START TEST json_config_extra_key 00:04:28.306 ************************************ 00:04:28.306 03:21:08 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:04:28.306 03:21:08 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:28.306 03:21:08 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:28.306 03:21:08 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:28.306 03:21:08 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:28.306 03:21:08 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:28.306 03:21:08 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:28.306 03:21:08 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:28.306 03:21:08 -- scripts/common.sh@335 -- # IFS=.-: 00:04:28.306 03:21:08 -- scripts/common.sh@335 -- # read -ra ver1 00:04:28.306 03:21:08 -- scripts/common.sh@336 -- # IFS=.-: 00:04:28.306 03:21:08 -- scripts/common.sh@336 -- # read -ra ver2 00:04:28.306 03:21:08 -- scripts/common.sh@337 -- # local 'op=<' 00:04:28.306 03:21:08 -- scripts/common.sh@339 -- # ver1_l=2 00:04:28.306 03:21:08 -- scripts/common.sh@340 -- # ver2_l=1 00:04:28.306 03:21:08 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:28.306 03:21:08 -- scripts/common.sh@343 -- # case "$op" in 00:04:28.306 03:21:08 -- scripts/common.sh@344 -- # : 1 00:04:28.306 03:21:08 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:28.306 03:21:08 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:28.306 03:21:08 -- scripts/common.sh@364 -- # decimal 1 00:04:28.306 03:21:08 -- scripts/common.sh@352 -- # local d=1 00:04:28.306 03:21:08 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:28.306 03:21:08 -- scripts/common.sh@354 -- # echo 1 00:04:28.306 03:21:08 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:28.306 03:21:08 -- scripts/common.sh@365 -- # decimal 2 00:04:28.306 03:21:08 -- scripts/common.sh@352 -- # local d=2 00:04:28.306 03:21:08 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:28.306 03:21:08 -- scripts/common.sh@354 -- # echo 2 00:04:28.306 03:21:08 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:28.306 03:21:08 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:28.306 03:21:08 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:28.306 03:21:08 -- scripts/common.sh@367 -- # return 0 00:04:28.306 03:21:08 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:28.306 03:21:08 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:28.306 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:28.306 --rc genhtml_branch_coverage=1 00:04:28.307 --rc genhtml_function_coverage=1 00:04:28.307 --rc genhtml_legend=1 00:04:28.307 --rc geninfo_all_blocks=1 00:04:28.307 --rc geninfo_unexecuted_blocks=1 00:04:28.307 00:04:28.307 ' 00:04:28.307 03:21:08 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:28.307 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:28.307 --rc genhtml_branch_coverage=1 00:04:28.307 --rc genhtml_function_coverage=1 00:04:28.307 --rc genhtml_legend=1 00:04:28.307 --rc geninfo_all_blocks=1 00:04:28.307 --rc geninfo_unexecuted_blocks=1 00:04:28.307 00:04:28.307 ' 00:04:28.307 03:21:08 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:28.307 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:28.307 --rc genhtml_branch_coverage=1 00:04:28.307 --rc genhtml_function_coverage=1 00:04:28.307 --rc genhtml_legend=1 00:04:28.307 --rc geninfo_all_blocks=1 00:04:28.307 --rc geninfo_unexecuted_blocks=1 00:04:28.307 00:04:28.307 ' 00:04:28.307 03:21:08 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:28.307 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:28.307 --rc genhtml_branch_coverage=1 00:04:28.307 --rc genhtml_function_coverage=1 00:04:28.307 --rc genhtml_legend=1 00:04:28.307 --rc geninfo_all_blocks=1 00:04:28.307 --rc geninfo_unexecuted_blocks=1 00:04:28.307 00:04:28.307 ' 00:04:28.307 03:21:08 -- json_config/json_config_extra_key.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:04:28.307 03:21:08 -- nvmf/common.sh@7 -- # uname -s 00:04:28.307 03:21:08 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:04:28.307 03:21:08 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:04:28.307 03:21:08 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:04:28.307 03:21:08 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:04:28.307 03:21:08 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:04:28.307 03:21:08 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:04:28.307 03:21:08 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:04:28.307 03:21:08 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:04:28.307 03:21:08 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:04:28.307 03:21:08 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:04:28.307 03:21:08 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:04:28.307 03:21:08 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:04:28.307 03:21:08 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:04:28.307 03:21:08 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:04:28.307 03:21:08 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:04:28.307 03:21:08 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:04:28.307 03:21:08 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:04:28.307 03:21:08 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:04:28.307 03:21:08 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:04:28.307 03:21:08 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:28.307 03:21:08 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:28.307 03:21:08 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:28.307 03:21:08 -- paths/export.sh@5 -- # export PATH 00:04:28.307 03:21:08 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:28.307 03:21:08 -- nvmf/common.sh@46 -- # : 0 00:04:28.307 03:21:08 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:04:28.307 03:21:08 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:04:28.307 03:21:08 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:04:28.307 03:21:08 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:04:28.307 03:21:08 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:04:28.307 03:21:08 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:04:28.307 03:21:08 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:04:28.307 03:21:08 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:04:28.307 03:21:08 -- json_config/json_config_extra_key.sh@16 -- # app_pid=(['target']='') 00:04:28.307 03:21:08 -- json_config/json_config_extra_key.sh@16 -- # declare -A app_pid 00:04:28.307 03:21:08 -- json_config/json_config_extra_key.sh@17 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock') 00:04:28.307 03:21:08 -- json_config/json_config_extra_key.sh@17 -- # declare -A app_socket 00:04:28.307 03:21:08 -- json_config/json_config_extra_key.sh@18 -- # app_params=(['target']='-m 0x1 -s 1024') 00:04:28.307 03:21:08 -- json_config/json_config_extra_key.sh@18 -- # declare -A app_params 00:04:28.307 03:21:08 -- json_config/json_config_extra_key.sh@19 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json') 00:04:28.307 03:21:08 -- json_config/json_config_extra_key.sh@19 -- # declare -A configs_path 00:04:28.307 03:21:08 -- json_config/json_config_extra_key.sh@74 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:04:28.307 03:21:08 -- json_config/json_config_extra_key.sh@76 -- # echo 'INFO: launching applications...' 00:04:28.307 INFO: launching applications... 00:04:28.307 03:21:08 -- json_config/json_config_extra_key.sh@77 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:04:28.307 03:21:08 -- json_config/json_config_extra_key.sh@24 -- # local app=target 00:04:28.307 03:21:08 -- json_config/json_config_extra_key.sh@25 -- # shift 00:04:28.307 03:21:08 -- json_config/json_config_extra_key.sh@27 -- # [[ -n 22 ]] 00:04:28.307 03:21:08 -- json_config/json_config_extra_key.sh@28 -- # [[ -z '' ]] 00:04:28.307 03:21:08 -- json_config/json_config_extra_key.sh@31 -- # app_pid[$app]=2930573 00:04:28.307 03:21:08 -- json_config/json_config_extra_key.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:04:28.307 03:21:08 -- json_config/json_config_extra_key.sh@33 -- # echo 'Waiting for target to run...' 00:04:28.307 Waiting for target to run... 00:04:28.307 03:21:08 -- json_config/json_config_extra_key.sh@34 -- # waitforlisten 2930573 /var/tmp/spdk_tgt.sock 00:04:28.307 03:21:08 -- common/autotest_common.sh@829 -- # '[' -z 2930573 ']' 00:04:28.307 03:21:08 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:04:28.307 03:21:08 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:28.307 03:21:08 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:04:28.307 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:04:28.307 03:21:08 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:28.307 03:21:08 -- common/autotest_common.sh@10 -- # set +x 00:04:28.307 [2024-11-21 03:21:08.738682] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:28.307 [2024-11-21 03:21:08.738762] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2930573 ] 00:04:28.307 EAL: No free 2048 kB hugepages reported on node 1 00:04:28.873 [2024-11-21 03:21:09.233140] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:28.873 [2024-11-21 03:21:09.325318] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:28.873 [2024-11-21 03:21:09.325475] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:29.130 03:21:09 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:29.130 03:21:09 -- common/autotest_common.sh@862 -- # return 0 00:04:29.130 03:21:09 -- json_config/json_config_extra_key.sh@35 -- # echo '' 00:04:29.130 00:04:29.130 03:21:09 -- json_config/json_config_extra_key.sh@79 -- # echo 'INFO: shutting down applications...' 00:04:29.130 INFO: shutting down applications... 00:04:29.130 03:21:09 -- json_config/json_config_extra_key.sh@80 -- # json_config_test_shutdown_app target 00:04:29.130 03:21:09 -- json_config/json_config_extra_key.sh@40 -- # local app=target 00:04:29.130 03:21:09 -- json_config/json_config_extra_key.sh@43 -- # [[ -n 22 ]] 00:04:29.130 03:21:09 -- json_config/json_config_extra_key.sh@44 -- # [[ -n 2930573 ]] 00:04:29.130 03:21:09 -- json_config/json_config_extra_key.sh@47 -- # kill -SIGINT 2930573 00:04:29.130 03:21:09 -- json_config/json_config_extra_key.sh@49 -- # (( i = 0 )) 00:04:29.130 03:21:09 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:04:29.130 03:21:09 -- json_config/json_config_extra_key.sh@50 -- # kill -0 2930573 00:04:29.130 03:21:09 -- json_config/json_config_extra_key.sh@54 -- # sleep 0.5 00:04:29.697 03:21:10 -- json_config/json_config_extra_key.sh@49 -- # (( i++ )) 00:04:29.697 03:21:10 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:04:29.697 03:21:10 -- json_config/json_config_extra_key.sh@50 -- # kill -0 2930573 00:04:29.697 03:21:10 -- json_config/json_config_extra_key.sh@54 -- # sleep 0.5 00:04:30.265 03:21:10 -- json_config/json_config_extra_key.sh@49 -- # (( i++ )) 00:04:30.265 03:21:10 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:04:30.265 03:21:10 -- json_config/json_config_extra_key.sh@50 -- # kill -0 2930573 00:04:30.265 03:21:10 -- json_config/json_config_extra_key.sh@51 -- # app_pid[$app]= 00:04:30.265 03:21:10 -- json_config/json_config_extra_key.sh@52 -- # break 00:04:30.265 03:21:10 -- json_config/json_config_extra_key.sh@57 -- # [[ -n '' ]] 00:04:30.265 03:21:10 -- json_config/json_config_extra_key.sh@62 -- # echo 'SPDK target shutdown done' 00:04:30.265 SPDK target shutdown done 00:04:30.265 03:21:10 -- json_config/json_config_extra_key.sh@82 -- # echo Success 00:04:30.265 Success 00:04:30.265 00:04:30.265 real 0m2.161s 00:04:30.265 user 0m1.535s 00:04:30.265 sys 0m0.597s 00:04:30.265 03:21:10 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:30.265 03:21:10 -- common/autotest_common.sh@10 -- # set +x 00:04:30.265 ************************************ 00:04:30.265 END TEST json_config_extra_key 00:04:30.265 ************************************ 00:04:30.265 03:21:10 -- spdk/autotest.sh@167 -- # run_test alias_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:04:30.265 03:21:10 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:30.265 03:21:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:30.265 03:21:10 -- common/autotest_common.sh@10 -- # set +x 00:04:30.265 ************************************ 00:04:30.265 START TEST alias_rpc 00:04:30.265 ************************************ 00:04:30.265 03:21:10 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:04:30.265 * Looking for test storage... 00:04:30.265 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc 00:04:30.265 03:21:10 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:30.265 03:21:10 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:30.265 03:21:10 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:30.265 03:21:10 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:30.265 03:21:10 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:30.265 03:21:10 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:30.265 03:21:10 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:30.265 03:21:10 -- scripts/common.sh@335 -- # IFS=.-: 00:04:30.265 03:21:10 -- scripts/common.sh@335 -- # read -ra ver1 00:04:30.265 03:21:10 -- scripts/common.sh@336 -- # IFS=.-: 00:04:30.265 03:21:10 -- scripts/common.sh@336 -- # read -ra ver2 00:04:30.265 03:21:10 -- scripts/common.sh@337 -- # local 'op=<' 00:04:30.265 03:21:10 -- scripts/common.sh@339 -- # ver1_l=2 00:04:30.265 03:21:10 -- scripts/common.sh@340 -- # ver2_l=1 00:04:30.265 03:21:10 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:30.265 03:21:10 -- scripts/common.sh@343 -- # case "$op" in 00:04:30.265 03:21:10 -- scripts/common.sh@344 -- # : 1 00:04:30.265 03:21:10 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:30.265 03:21:10 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:30.265 03:21:10 -- scripts/common.sh@364 -- # decimal 1 00:04:30.265 03:21:10 -- scripts/common.sh@352 -- # local d=1 00:04:30.265 03:21:10 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:30.265 03:21:10 -- scripts/common.sh@354 -- # echo 1 00:04:30.265 03:21:10 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:30.265 03:21:10 -- scripts/common.sh@365 -- # decimal 2 00:04:30.265 03:21:10 -- scripts/common.sh@352 -- # local d=2 00:04:30.265 03:21:10 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:30.265 03:21:10 -- scripts/common.sh@354 -- # echo 2 00:04:30.265 03:21:10 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:30.265 03:21:10 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:30.265 03:21:10 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:30.265 03:21:10 -- scripts/common.sh@367 -- # return 0 00:04:30.265 03:21:10 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:30.265 03:21:10 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:30.265 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:30.265 --rc genhtml_branch_coverage=1 00:04:30.265 --rc genhtml_function_coverage=1 00:04:30.265 --rc genhtml_legend=1 00:04:30.265 --rc geninfo_all_blocks=1 00:04:30.265 --rc geninfo_unexecuted_blocks=1 00:04:30.265 00:04:30.265 ' 00:04:30.265 03:21:10 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:30.265 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:30.265 --rc genhtml_branch_coverage=1 00:04:30.265 --rc genhtml_function_coverage=1 00:04:30.265 --rc genhtml_legend=1 00:04:30.265 --rc geninfo_all_blocks=1 00:04:30.265 --rc geninfo_unexecuted_blocks=1 00:04:30.265 00:04:30.265 ' 00:04:30.266 03:21:10 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:30.266 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:30.266 --rc genhtml_branch_coverage=1 00:04:30.266 --rc genhtml_function_coverage=1 00:04:30.266 --rc genhtml_legend=1 00:04:30.266 --rc geninfo_all_blocks=1 00:04:30.266 --rc geninfo_unexecuted_blocks=1 00:04:30.266 00:04:30.266 ' 00:04:30.266 03:21:10 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:30.266 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:30.266 --rc genhtml_branch_coverage=1 00:04:30.266 --rc genhtml_function_coverage=1 00:04:30.266 --rc genhtml_legend=1 00:04:30.266 --rc geninfo_all_blocks=1 00:04:30.266 --rc geninfo_unexecuted_blocks=1 00:04:30.266 00:04:30.266 ' 00:04:30.266 03:21:10 -- alias_rpc/alias_rpc.sh@10 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:04:30.266 03:21:10 -- alias_rpc/alias_rpc.sh@13 -- # spdk_tgt_pid=2931014 00:04:30.266 03:21:10 -- alias_rpc/alias_rpc.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:04:30.266 03:21:10 -- alias_rpc/alias_rpc.sh@14 -- # waitforlisten 2931014 00:04:30.266 03:21:10 -- common/autotest_common.sh@829 -- # '[' -z 2931014 ']' 00:04:30.266 03:21:10 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:30.266 03:21:10 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:30.266 03:21:10 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:30.266 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:30.266 03:21:10 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:30.266 03:21:10 -- common/autotest_common.sh@10 -- # set +x 00:04:30.525 [2024-11-21 03:21:10.926463] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:30.525 [2024-11-21 03:21:10.926542] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2931014 ] 00:04:30.525 EAL: No free 2048 kB hugepages reported on node 1 00:04:30.525 [2024-11-21 03:21:10.983228] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:30.525 [2024-11-21 03:21:11.093722] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:30.525 [2024-11-21 03:21:11.093905] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:31.459 03:21:11 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:31.459 03:21:11 -- common/autotest_common.sh@862 -- # return 0 00:04:31.459 03:21:11 -- alias_rpc/alias_rpc.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_config -i 00:04:31.717 03:21:12 -- alias_rpc/alias_rpc.sh@19 -- # killprocess 2931014 00:04:31.717 03:21:12 -- common/autotest_common.sh@936 -- # '[' -z 2931014 ']' 00:04:31.717 03:21:12 -- common/autotest_common.sh@940 -- # kill -0 2931014 00:04:31.717 03:21:12 -- common/autotest_common.sh@941 -- # uname 00:04:31.717 03:21:12 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:31.717 03:21:12 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2931014 00:04:31.717 03:21:12 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:31.717 03:21:12 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:31.717 03:21:12 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2931014' 00:04:31.717 killing process with pid 2931014 00:04:31.717 03:21:12 -- common/autotest_common.sh@955 -- # kill 2931014 00:04:31.717 03:21:12 -- common/autotest_common.sh@960 -- # wait 2931014 00:04:32.284 00:04:32.284 real 0m1.894s 00:04:32.284 user 0m2.180s 00:04:32.284 sys 0m0.461s 00:04:32.284 03:21:12 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:32.284 03:21:12 -- common/autotest_common.sh@10 -- # set +x 00:04:32.284 ************************************ 00:04:32.284 END TEST alias_rpc 00:04:32.284 ************************************ 00:04:32.284 03:21:12 -- spdk/autotest.sh@169 -- # [[ 0 -eq 0 ]] 00:04:32.284 03:21:12 -- spdk/autotest.sh@170 -- # run_test spdkcli_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:04:32.284 03:21:12 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:32.284 03:21:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:32.284 03:21:12 -- common/autotest_common.sh@10 -- # set +x 00:04:32.284 ************************************ 00:04:32.284 START TEST spdkcli_tcp 00:04:32.284 ************************************ 00:04:32.284 03:21:12 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:04:32.284 * Looking for test storage... 00:04:32.284 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:04:32.284 03:21:12 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:32.284 03:21:12 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:32.284 03:21:12 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:32.284 03:21:12 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:32.284 03:21:12 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:32.284 03:21:12 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:32.284 03:21:12 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:32.284 03:21:12 -- scripts/common.sh@335 -- # IFS=.-: 00:04:32.284 03:21:12 -- scripts/common.sh@335 -- # read -ra ver1 00:04:32.284 03:21:12 -- scripts/common.sh@336 -- # IFS=.-: 00:04:32.284 03:21:12 -- scripts/common.sh@336 -- # read -ra ver2 00:04:32.284 03:21:12 -- scripts/common.sh@337 -- # local 'op=<' 00:04:32.284 03:21:12 -- scripts/common.sh@339 -- # ver1_l=2 00:04:32.284 03:21:12 -- scripts/common.sh@340 -- # ver2_l=1 00:04:32.284 03:21:12 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:32.284 03:21:12 -- scripts/common.sh@343 -- # case "$op" in 00:04:32.284 03:21:12 -- scripts/common.sh@344 -- # : 1 00:04:32.284 03:21:12 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:32.284 03:21:12 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:32.284 03:21:12 -- scripts/common.sh@364 -- # decimal 1 00:04:32.284 03:21:12 -- scripts/common.sh@352 -- # local d=1 00:04:32.284 03:21:12 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:32.284 03:21:12 -- scripts/common.sh@354 -- # echo 1 00:04:32.284 03:21:12 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:32.284 03:21:12 -- scripts/common.sh@365 -- # decimal 2 00:04:32.284 03:21:12 -- scripts/common.sh@352 -- # local d=2 00:04:32.284 03:21:12 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:32.284 03:21:12 -- scripts/common.sh@354 -- # echo 2 00:04:32.284 03:21:12 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:32.284 03:21:12 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:32.284 03:21:12 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:32.284 03:21:12 -- scripts/common.sh@367 -- # return 0 00:04:32.284 03:21:12 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:32.284 03:21:12 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:32.284 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:32.284 --rc genhtml_branch_coverage=1 00:04:32.284 --rc genhtml_function_coverage=1 00:04:32.284 --rc genhtml_legend=1 00:04:32.284 --rc geninfo_all_blocks=1 00:04:32.284 --rc geninfo_unexecuted_blocks=1 00:04:32.284 00:04:32.284 ' 00:04:32.284 03:21:12 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:32.284 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:32.284 --rc genhtml_branch_coverage=1 00:04:32.284 --rc genhtml_function_coverage=1 00:04:32.284 --rc genhtml_legend=1 00:04:32.284 --rc geninfo_all_blocks=1 00:04:32.284 --rc geninfo_unexecuted_blocks=1 00:04:32.284 00:04:32.284 ' 00:04:32.284 03:21:12 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:32.284 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:32.284 --rc genhtml_branch_coverage=1 00:04:32.284 --rc genhtml_function_coverage=1 00:04:32.284 --rc genhtml_legend=1 00:04:32.284 --rc geninfo_all_blocks=1 00:04:32.284 --rc geninfo_unexecuted_blocks=1 00:04:32.284 00:04:32.284 ' 00:04:32.284 03:21:12 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:32.284 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:32.284 --rc genhtml_branch_coverage=1 00:04:32.284 --rc genhtml_function_coverage=1 00:04:32.284 --rc genhtml_legend=1 00:04:32.284 --rc geninfo_all_blocks=1 00:04:32.284 --rc geninfo_unexecuted_blocks=1 00:04:32.284 00:04:32.284 ' 00:04:32.284 03:21:12 -- spdkcli/tcp.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:04:32.284 03:21:12 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:04:32.284 03:21:12 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:04:32.284 03:21:12 -- spdkcli/tcp.sh@18 -- # IP_ADDRESS=127.0.0.1 00:04:32.284 03:21:12 -- spdkcli/tcp.sh@19 -- # PORT=9998 00:04:32.285 03:21:12 -- spdkcli/tcp.sh@21 -- # trap 'err_cleanup; exit 1' SIGINT SIGTERM EXIT 00:04:32.285 03:21:12 -- spdkcli/tcp.sh@23 -- # timing_enter run_spdk_tgt_tcp 00:04:32.285 03:21:12 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:32.285 03:21:12 -- common/autotest_common.sh@10 -- # set +x 00:04:32.285 03:21:12 -- spdkcli/tcp.sh@25 -- # spdk_tgt_pid=2931345 00:04:32.285 03:21:12 -- spdkcli/tcp.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x3 -p 0 00:04:32.285 03:21:12 -- spdkcli/tcp.sh@27 -- # waitforlisten 2931345 00:04:32.285 03:21:12 -- common/autotest_common.sh@829 -- # '[' -z 2931345 ']' 00:04:32.285 03:21:12 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:32.285 03:21:12 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:32.285 03:21:12 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:32.285 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:32.285 03:21:12 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:32.285 03:21:12 -- common/autotest_common.sh@10 -- # set +x 00:04:32.285 [2024-11-21 03:21:12.845047] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:32.285 [2024-11-21 03:21:12.845168] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2931345 ] 00:04:32.285 EAL: No free 2048 kB hugepages reported on node 1 00:04:32.285 [2024-11-21 03:21:12.901572] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:32.543 [2024-11-21 03:21:13.009666] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:32.543 [2024-11-21 03:21:13.010019] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:32.543 [2024-11-21 03:21:13.010024] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:33.477 03:21:13 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:33.477 03:21:13 -- common/autotest_common.sh@862 -- # return 0 00:04:33.477 03:21:13 -- spdkcli/tcp.sh@31 -- # socat_pid=2931485 00:04:33.477 03:21:13 -- spdkcli/tcp.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -r 100 -t 2 -s 127.0.0.1 -p 9998 rpc_get_methods 00:04:33.477 03:21:13 -- spdkcli/tcp.sh@30 -- # socat TCP-LISTEN:9998 UNIX-CONNECT:/var/tmp/spdk.sock 00:04:33.477 [ 00:04:33.477 "bdev_malloc_delete", 00:04:33.477 "bdev_malloc_create", 00:04:33.477 "bdev_null_resize", 00:04:33.477 "bdev_null_delete", 00:04:33.477 "bdev_null_create", 00:04:33.477 "bdev_nvme_cuse_unregister", 00:04:33.477 "bdev_nvme_cuse_register", 00:04:33.477 "bdev_opal_new_user", 00:04:33.477 "bdev_opal_set_lock_state", 00:04:33.477 "bdev_opal_delete", 00:04:33.477 "bdev_opal_get_info", 00:04:33.477 "bdev_opal_create", 00:04:33.477 "bdev_nvme_opal_revert", 00:04:33.477 "bdev_nvme_opal_init", 00:04:33.477 "bdev_nvme_send_cmd", 00:04:33.477 "bdev_nvme_get_path_iostat", 00:04:33.477 "bdev_nvme_get_mdns_discovery_info", 00:04:33.477 "bdev_nvme_stop_mdns_discovery", 00:04:33.477 "bdev_nvme_start_mdns_discovery", 00:04:33.477 "bdev_nvme_set_multipath_policy", 00:04:33.477 "bdev_nvme_set_preferred_path", 00:04:33.477 "bdev_nvme_get_io_paths", 00:04:33.477 "bdev_nvme_remove_error_injection", 00:04:33.477 "bdev_nvme_add_error_injection", 00:04:33.477 "bdev_nvme_get_discovery_info", 00:04:33.477 "bdev_nvme_stop_discovery", 00:04:33.477 "bdev_nvme_start_discovery", 00:04:33.477 "bdev_nvme_get_controller_health_info", 00:04:33.477 "bdev_nvme_disable_controller", 00:04:33.477 "bdev_nvme_enable_controller", 00:04:33.477 "bdev_nvme_reset_controller", 00:04:33.477 "bdev_nvme_get_transport_statistics", 00:04:33.477 "bdev_nvme_apply_firmware", 00:04:33.477 "bdev_nvme_detach_controller", 00:04:33.477 "bdev_nvme_get_controllers", 00:04:33.477 "bdev_nvme_attach_controller", 00:04:33.477 "bdev_nvme_set_hotplug", 00:04:33.477 "bdev_nvme_set_options", 00:04:33.477 "bdev_passthru_delete", 00:04:33.477 "bdev_passthru_create", 00:04:33.477 "bdev_lvol_grow_lvstore", 00:04:33.477 "bdev_lvol_get_lvols", 00:04:33.477 "bdev_lvol_get_lvstores", 00:04:33.477 "bdev_lvol_delete", 00:04:33.477 "bdev_lvol_set_read_only", 00:04:33.477 "bdev_lvol_resize", 00:04:33.477 "bdev_lvol_decouple_parent", 00:04:33.477 "bdev_lvol_inflate", 00:04:33.477 "bdev_lvol_rename", 00:04:33.477 "bdev_lvol_clone_bdev", 00:04:33.477 "bdev_lvol_clone", 00:04:33.477 "bdev_lvol_snapshot", 00:04:33.478 "bdev_lvol_create", 00:04:33.478 "bdev_lvol_delete_lvstore", 00:04:33.478 "bdev_lvol_rename_lvstore", 00:04:33.478 "bdev_lvol_create_lvstore", 00:04:33.478 "bdev_raid_set_options", 00:04:33.478 "bdev_raid_remove_base_bdev", 00:04:33.478 "bdev_raid_add_base_bdev", 00:04:33.478 "bdev_raid_delete", 00:04:33.478 "bdev_raid_create", 00:04:33.478 "bdev_raid_get_bdevs", 00:04:33.478 "bdev_error_inject_error", 00:04:33.478 "bdev_error_delete", 00:04:33.478 "bdev_error_create", 00:04:33.478 "bdev_split_delete", 00:04:33.478 "bdev_split_create", 00:04:33.478 "bdev_delay_delete", 00:04:33.478 "bdev_delay_create", 00:04:33.478 "bdev_delay_update_latency", 00:04:33.478 "bdev_zone_block_delete", 00:04:33.478 "bdev_zone_block_create", 00:04:33.478 "blobfs_create", 00:04:33.478 "blobfs_detect", 00:04:33.478 "blobfs_set_cache_size", 00:04:33.478 "bdev_aio_delete", 00:04:33.478 "bdev_aio_rescan", 00:04:33.478 "bdev_aio_create", 00:04:33.478 "bdev_ftl_set_property", 00:04:33.478 "bdev_ftl_get_properties", 00:04:33.478 "bdev_ftl_get_stats", 00:04:33.478 "bdev_ftl_unmap", 00:04:33.478 "bdev_ftl_unload", 00:04:33.478 "bdev_ftl_delete", 00:04:33.478 "bdev_ftl_load", 00:04:33.478 "bdev_ftl_create", 00:04:33.478 "bdev_virtio_attach_controller", 00:04:33.478 "bdev_virtio_scsi_get_devices", 00:04:33.478 "bdev_virtio_detach_controller", 00:04:33.478 "bdev_virtio_blk_set_hotplug", 00:04:33.478 "bdev_iscsi_delete", 00:04:33.478 "bdev_iscsi_create", 00:04:33.478 "bdev_iscsi_set_options", 00:04:33.478 "accel_error_inject_error", 00:04:33.478 "ioat_scan_accel_module", 00:04:33.478 "dsa_scan_accel_module", 00:04:33.478 "iaa_scan_accel_module", 00:04:33.478 "iscsi_set_options", 00:04:33.478 "iscsi_get_auth_groups", 00:04:33.478 "iscsi_auth_group_remove_secret", 00:04:33.478 "iscsi_auth_group_add_secret", 00:04:33.478 "iscsi_delete_auth_group", 00:04:33.478 "iscsi_create_auth_group", 00:04:33.478 "iscsi_set_discovery_auth", 00:04:33.478 "iscsi_get_options", 00:04:33.478 "iscsi_target_node_request_logout", 00:04:33.478 "iscsi_target_node_set_redirect", 00:04:33.478 "iscsi_target_node_set_auth", 00:04:33.478 "iscsi_target_node_add_lun", 00:04:33.478 "iscsi_get_connections", 00:04:33.478 "iscsi_portal_group_set_auth", 00:04:33.478 "iscsi_start_portal_group", 00:04:33.478 "iscsi_delete_portal_group", 00:04:33.478 "iscsi_create_portal_group", 00:04:33.478 "iscsi_get_portal_groups", 00:04:33.478 "iscsi_delete_target_node", 00:04:33.478 "iscsi_target_node_remove_pg_ig_maps", 00:04:33.478 "iscsi_target_node_add_pg_ig_maps", 00:04:33.478 "iscsi_create_target_node", 00:04:33.478 "iscsi_get_target_nodes", 00:04:33.478 "iscsi_delete_initiator_group", 00:04:33.478 "iscsi_initiator_group_remove_initiators", 00:04:33.478 "iscsi_initiator_group_add_initiators", 00:04:33.478 "iscsi_create_initiator_group", 00:04:33.478 "iscsi_get_initiator_groups", 00:04:33.478 "nvmf_set_crdt", 00:04:33.478 "nvmf_set_config", 00:04:33.478 "nvmf_set_max_subsystems", 00:04:33.478 "nvmf_subsystem_get_listeners", 00:04:33.478 "nvmf_subsystem_get_qpairs", 00:04:33.478 "nvmf_subsystem_get_controllers", 00:04:33.478 "nvmf_get_stats", 00:04:33.478 "nvmf_get_transports", 00:04:33.478 "nvmf_create_transport", 00:04:33.478 "nvmf_get_targets", 00:04:33.478 "nvmf_delete_target", 00:04:33.478 "nvmf_create_target", 00:04:33.478 "nvmf_subsystem_allow_any_host", 00:04:33.478 "nvmf_subsystem_remove_host", 00:04:33.478 "nvmf_subsystem_add_host", 00:04:33.478 "nvmf_subsystem_remove_ns", 00:04:33.478 "nvmf_subsystem_add_ns", 00:04:33.478 "nvmf_subsystem_listener_set_ana_state", 00:04:33.478 "nvmf_discovery_get_referrals", 00:04:33.478 "nvmf_discovery_remove_referral", 00:04:33.478 "nvmf_discovery_add_referral", 00:04:33.478 "nvmf_subsystem_remove_listener", 00:04:33.478 "nvmf_subsystem_add_listener", 00:04:33.478 "nvmf_delete_subsystem", 00:04:33.478 "nvmf_create_subsystem", 00:04:33.478 "nvmf_get_subsystems", 00:04:33.478 "env_dpdk_get_mem_stats", 00:04:33.478 "nbd_get_disks", 00:04:33.478 "nbd_stop_disk", 00:04:33.478 "nbd_start_disk", 00:04:33.478 "ublk_recover_disk", 00:04:33.478 "ublk_get_disks", 00:04:33.478 "ublk_stop_disk", 00:04:33.478 "ublk_start_disk", 00:04:33.478 "ublk_destroy_target", 00:04:33.478 "ublk_create_target", 00:04:33.478 "virtio_blk_create_transport", 00:04:33.478 "virtio_blk_get_transports", 00:04:33.478 "vhost_controller_set_coalescing", 00:04:33.478 "vhost_get_controllers", 00:04:33.478 "vhost_delete_controller", 00:04:33.478 "vhost_create_blk_controller", 00:04:33.478 "vhost_scsi_controller_remove_target", 00:04:33.478 "vhost_scsi_controller_add_target", 00:04:33.478 "vhost_start_scsi_controller", 00:04:33.478 "vhost_create_scsi_controller", 00:04:33.478 "thread_set_cpumask", 00:04:33.478 "framework_get_scheduler", 00:04:33.478 "framework_set_scheduler", 00:04:33.478 "framework_get_reactors", 00:04:33.478 "thread_get_io_channels", 00:04:33.478 "thread_get_pollers", 00:04:33.478 "thread_get_stats", 00:04:33.478 "framework_monitor_context_switch", 00:04:33.478 "spdk_kill_instance", 00:04:33.478 "log_enable_timestamps", 00:04:33.478 "log_get_flags", 00:04:33.478 "log_clear_flag", 00:04:33.478 "log_set_flag", 00:04:33.478 "log_get_level", 00:04:33.478 "log_set_level", 00:04:33.478 "log_get_print_level", 00:04:33.478 "log_set_print_level", 00:04:33.478 "framework_enable_cpumask_locks", 00:04:33.478 "framework_disable_cpumask_locks", 00:04:33.478 "framework_wait_init", 00:04:33.478 "framework_start_init", 00:04:33.478 "scsi_get_devices", 00:04:33.478 "bdev_get_histogram", 00:04:33.478 "bdev_enable_histogram", 00:04:33.478 "bdev_set_qos_limit", 00:04:33.478 "bdev_set_qd_sampling_period", 00:04:33.478 "bdev_get_bdevs", 00:04:33.478 "bdev_reset_iostat", 00:04:33.478 "bdev_get_iostat", 00:04:33.478 "bdev_examine", 00:04:33.478 "bdev_wait_for_examine", 00:04:33.478 "bdev_set_options", 00:04:33.478 "notify_get_notifications", 00:04:33.478 "notify_get_types", 00:04:33.478 "accel_get_stats", 00:04:33.478 "accel_set_options", 00:04:33.478 "accel_set_driver", 00:04:33.478 "accel_crypto_key_destroy", 00:04:33.478 "accel_crypto_keys_get", 00:04:33.478 "accel_crypto_key_create", 00:04:33.478 "accel_assign_opc", 00:04:33.478 "accel_get_module_info", 00:04:33.478 "accel_get_opc_assignments", 00:04:33.478 "vmd_rescan", 00:04:33.478 "vmd_remove_device", 00:04:33.478 "vmd_enable", 00:04:33.478 "sock_set_default_impl", 00:04:33.478 "sock_impl_set_options", 00:04:33.478 "sock_impl_get_options", 00:04:33.478 "iobuf_get_stats", 00:04:33.478 "iobuf_set_options", 00:04:33.478 "framework_get_pci_devices", 00:04:33.478 "framework_get_config", 00:04:33.478 "framework_get_subsystems", 00:04:33.478 "trace_get_info", 00:04:33.478 "trace_get_tpoint_group_mask", 00:04:33.478 "trace_disable_tpoint_group", 00:04:33.478 "trace_enable_tpoint_group", 00:04:33.478 "trace_clear_tpoint_mask", 00:04:33.478 "trace_set_tpoint_mask", 00:04:33.478 "spdk_get_version", 00:04:33.478 "rpc_get_methods" 00:04:33.478 ] 00:04:33.478 03:21:14 -- spdkcli/tcp.sh@35 -- # timing_exit run_spdk_tgt_tcp 00:04:33.478 03:21:14 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:33.478 03:21:14 -- common/autotest_common.sh@10 -- # set +x 00:04:33.478 03:21:14 -- spdkcli/tcp.sh@37 -- # trap - SIGINT SIGTERM EXIT 00:04:33.478 03:21:14 -- spdkcli/tcp.sh@38 -- # killprocess 2931345 00:04:33.478 03:21:14 -- common/autotest_common.sh@936 -- # '[' -z 2931345 ']' 00:04:33.479 03:21:14 -- common/autotest_common.sh@940 -- # kill -0 2931345 00:04:33.479 03:21:14 -- common/autotest_common.sh@941 -- # uname 00:04:33.479 03:21:14 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:33.479 03:21:14 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2931345 00:04:33.737 03:21:14 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:33.737 03:21:14 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:33.737 03:21:14 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2931345' 00:04:33.737 killing process with pid 2931345 00:04:33.737 03:21:14 -- common/autotest_common.sh@955 -- # kill 2931345 00:04:33.737 03:21:14 -- common/autotest_common.sh@960 -- # wait 2931345 00:04:33.995 00:04:33.995 real 0m1.932s 00:04:33.995 user 0m3.669s 00:04:33.995 sys 0m0.515s 00:04:33.995 03:21:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:33.995 03:21:14 -- common/autotest_common.sh@10 -- # set +x 00:04:33.995 ************************************ 00:04:33.995 END TEST spdkcli_tcp 00:04:33.995 ************************************ 00:04:33.995 03:21:14 -- spdk/autotest.sh@173 -- # run_test dpdk_mem_utility /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:04:33.995 03:21:14 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:33.995 03:21:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:33.995 03:21:14 -- common/autotest_common.sh@10 -- # set +x 00:04:33.995 ************************************ 00:04:33.995 START TEST dpdk_mem_utility 00:04:33.995 ************************************ 00:04:33.995 03:21:14 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:04:34.254 * Looking for test storage... 00:04:34.254 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility 00:04:34.254 03:21:14 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:34.254 03:21:14 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:34.254 03:21:14 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:34.254 03:21:14 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:34.254 03:21:14 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:34.254 03:21:14 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:34.254 03:21:14 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:34.254 03:21:14 -- scripts/common.sh@335 -- # IFS=.-: 00:04:34.254 03:21:14 -- scripts/common.sh@335 -- # read -ra ver1 00:04:34.254 03:21:14 -- scripts/common.sh@336 -- # IFS=.-: 00:04:34.254 03:21:14 -- scripts/common.sh@336 -- # read -ra ver2 00:04:34.254 03:21:14 -- scripts/common.sh@337 -- # local 'op=<' 00:04:34.254 03:21:14 -- scripts/common.sh@339 -- # ver1_l=2 00:04:34.254 03:21:14 -- scripts/common.sh@340 -- # ver2_l=1 00:04:34.254 03:21:14 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:34.254 03:21:14 -- scripts/common.sh@343 -- # case "$op" in 00:04:34.254 03:21:14 -- scripts/common.sh@344 -- # : 1 00:04:34.254 03:21:14 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:34.254 03:21:14 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:34.254 03:21:14 -- scripts/common.sh@364 -- # decimal 1 00:04:34.254 03:21:14 -- scripts/common.sh@352 -- # local d=1 00:04:34.254 03:21:14 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:34.254 03:21:14 -- scripts/common.sh@354 -- # echo 1 00:04:34.254 03:21:14 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:34.254 03:21:14 -- scripts/common.sh@365 -- # decimal 2 00:04:34.254 03:21:14 -- scripts/common.sh@352 -- # local d=2 00:04:34.254 03:21:14 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:34.254 03:21:14 -- scripts/common.sh@354 -- # echo 2 00:04:34.254 03:21:14 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:34.254 03:21:14 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:34.254 03:21:14 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:34.254 03:21:14 -- scripts/common.sh@367 -- # return 0 00:04:34.254 03:21:14 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:34.254 03:21:14 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:34.254 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:34.254 --rc genhtml_branch_coverage=1 00:04:34.254 --rc genhtml_function_coverage=1 00:04:34.254 --rc genhtml_legend=1 00:04:34.254 --rc geninfo_all_blocks=1 00:04:34.254 --rc geninfo_unexecuted_blocks=1 00:04:34.254 00:04:34.254 ' 00:04:34.254 03:21:14 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:34.254 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:34.254 --rc genhtml_branch_coverage=1 00:04:34.254 --rc genhtml_function_coverage=1 00:04:34.254 --rc genhtml_legend=1 00:04:34.254 --rc geninfo_all_blocks=1 00:04:34.254 --rc geninfo_unexecuted_blocks=1 00:04:34.254 00:04:34.254 ' 00:04:34.254 03:21:14 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:34.254 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:34.254 --rc genhtml_branch_coverage=1 00:04:34.254 --rc genhtml_function_coverage=1 00:04:34.254 --rc genhtml_legend=1 00:04:34.254 --rc geninfo_all_blocks=1 00:04:34.254 --rc geninfo_unexecuted_blocks=1 00:04:34.254 00:04:34.254 ' 00:04:34.254 03:21:14 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:34.254 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:34.254 --rc genhtml_branch_coverage=1 00:04:34.254 --rc genhtml_function_coverage=1 00:04:34.254 --rc genhtml_legend=1 00:04:34.254 --rc geninfo_all_blocks=1 00:04:34.254 --rc geninfo_unexecuted_blocks=1 00:04:34.254 00:04:34.254 ' 00:04:34.254 03:21:14 -- dpdk_memory_utility/test_dpdk_mem_info.sh@10 -- # MEM_SCRIPT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:04:34.254 03:21:14 -- dpdk_memory_utility/test_dpdk_mem_info.sh@13 -- # spdkpid=2931678 00:04:34.254 03:21:14 -- dpdk_memory_utility/test_dpdk_mem_info.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:04:34.254 03:21:14 -- dpdk_memory_utility/test_dpdk_mem_info.sh@15 -- # waitforlisten 2931678 00:04:34.254 03:21:14 -- common/autotest_common.sh@829 -- # '[' -z 2931678 ']' 00:04:34.254 03:21:14 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:34.254 03:21:14 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:34.254 03:21:14 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:34.254 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:34.254 03:21:14 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:34.254 03:21:14 -- common/autotest_common.sh@10 -- # set +x 00:04:34.254 [2024-11-21 03:21:14.807444] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:34.255 [2024-11-21 03:21:14.807533] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2931678 ] 00:04:34.255 EAL: No free 2048 kB hugepages reported on node 1 00:04:34.255 [2024-11-21 03:21:14.868292] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:34.513 [2024-11-21 03:21:14.978215] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:34.513 [2024-11-21 03:21:14.978396] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:35.447 03:21:15 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:35.447 03:21:15 -- common/autotest_common.sh@862 -- # return 0 00:04:35.447 03:21:15 -- dpdk_memory_utility/test_dpdk_mem_info.sh@17 -- # trap 'killprocess $spdkpid' SIGINT SIGTERM EXIT 00:04:35.447 03:21:15 -- dpdk_memory_utility/test_dpdk_mem_info.sh@19 -- # rpc_cmd env_dpdk_get_mem_stats 00:04:35.447 03:21:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:35.447 03:21:15 -- common/autotest_common.sh@10 -- # set +x 00:04:35.447 { 00:04:35.447 "filename": "/tmp/spdk_mem_dump.txt" 00:04:35.447 } 00:04:35.447 03:21:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:35.447 03:21:15 -- dpdk_memory_utility/test_dpdk_mem_info.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:04:35.447 DPDK memory size 814.000000 MiB in 1 heap(s) 00:04:35.447 1 heaps totaling size 814.000000 MiB 00:04:35.447 size: 814.000000 MiB heap id: 0 00:04:35.447 end heaps---------- 00:04:35.447 8 mempools totaling size 598.116089 MiB 00:04:35.447 size: 212.674988 MiB name: PDU_immediate_data_Pool 00:04:35.447 size: 158.602051 MiB name: PDU_data_out_Pool 00:04:35.447 size: 84.521057 MiB name: bdev_io_2931678 00:04:35.447 size: 51.011292 MiB name: evtpool_2931678 00:04:35.447 size: 50.003479 MiB name: msgpool_2931678 00:04:35.447 size: 21.763794 MiB name: PDU_Pool 00:04:35.447 size: 19.513306 MiB name: SCSI_TASK_Pool 00:04:35.447 size: 0.026123 MiB name: Session_Pool 00:04:35.447 end mempools------- 00:04:35.447 6 memzones totaling size 4.142822 MiB 00:04:35.447 size: 1.000366 MiB name: RG_ring_0_2931678 00:04:35.447 size: 1.000366 MiB name: RG_ring_1_2931678 00:04:35.447 size: 1.000366 MiB name: RG_ring_4_2931678 00:04:35.447 size: 1.000366 MiB name: RG_ring_5_2931678 00:04:35.448 size: 0.125366 MiB name: RG_ring_2_2931678 00:04:35.448 size: 0.015991 MiB name: RG_ring_3_2931678 00:04:35.448 end memzones------- 00:04:35.448 03:21:15 -- dpdk_memory_utility/test_dpdk_mem_info.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py -m 0 00:04:35.448 heap id: 0 total size: 814.000000 MiB number of busy elements: 41 number of free elements: 15 00:04:35.448 list of free elements. size: 12.519348 MiB 00:04:35.448 element at address: 0x200000400000 with size: 1.999512 MiB 00:04:35.448 element at address: 0x200018e00000 with size: 0.999878 MiB 00:04:35.448 element at address: 0x200019000000 with size: 0.999878 MiB 00:04:35.448 element at address: 0x200003e00000 with size: 0.996277 MiB 00:04:35.448 element at address: 0x200031c00000 with size: 0.994446 MiB 00:04:35.448 element at address: 0x200013800000 with size: 0.978699 MiB 00:04:35.448 element at address: 0x200007000000 with size: 0.959839 MiB 00:04:35.448 element at address: 0x200019200000 with size: 0.936584 MiB 00:04:35.448 element at address: 0x200000200000 with size: 0.841614 MiB 00:04:35.448 element at address: 0x20001aa00000 with size: 0.582886 MiB 00:04:35.448 element at address: 0x20000b200000 with size: 0.490723 MiB 00:04:35.448 element at address: 0x200000800000 with size: 0.487793 MiB 00:04:35.448 element at address: 0x200019400000 with size: 0.485657 MiB 00:04:35.448 element at address: 0x200027e00000 with size: 0.410034 MiB 00:04:35.448 element at address: 0x200003a00000 with size: 0.355530 MiB 00:04:35.448 list of standard malloc elements. size: 199.218079 MiB 00:04:35.448 element at address: 0x20000b3fff80 with size: 132.000122 MiB 00:04:35.448 element at address: 0x2000071fff80 with size: 64.000122 MiB 00:04:35.448 element at address: 0x200018efff80 with size: 1.000122 MiB 00:04:35.448 element at address: 0x2000190fff80 with size: 1.000122 MiB 00:04:35.448 element at address: 0x2000192fff80 with size: 1.000122 MiB 00:04:35.448 element at address: 0x2000003d9f00 with size: 0.140747 MiB 00:04:35.448 element at address: 0x2000192eff00 with size: 0.062622 MiB 00:04:35.448 element at address: 0x2000003fdf80 with size: 0.007935 MiB 00:04:35.448 element at address: 0x2000192efdc0 with size: 0.000305 MiB 00:04:35.448 element at address: 0x2000002d7740 with size: 0.000183 MiB 00:04:35.448 element at address: 0x2000002d7800 with size: 0.000183 MiB 00:04:35.448 element at address: 0x2000002d78c0 with size: 0.000183 MiB 00:04:35.448 element at address: 0x2000002d7ac0 with size: 0.000183 MiB 00:04:35.448 element at address: 0x2000002d7b80 with size: 0.000183 MiB 00:04:35.448 element at address: 0x2000002d7c40 with size: 0.000183 MiB 00:04:35.448 element at address: 0x2000003d9e40 with size: 0.000183 MiB 00:04:35.448 element at address: 0x20000087ce00 with size: 0.000183 MiB 00:04:35.448 element at address: 0x20000087cec0 with size: 0.000183 MiB 00:04:35.448 element at address: 0x2000008fd180 with size: 0.000183 MiB 00:04:35.448 element at address: 0x200003a5b040 with size: 0.000183 MiB 00:04:35.448 element at address: 0x200003adb300 with size: 0.000183 MiB 00:04:35.448 element at address: 0x200003adb500 with size: 0.000183 MiB 00:04:35.448 element at address: 0x200003adf7c0 with size: 0.000183 MiB 00:04:35.448 element at address: 0x200003affa80 with size: 0.000183 MiB 00:04:35.448 element at address: 0x200003affb40 with size: 0.000183 MiB 00:04:35.448 element at address: 0x200003eff0c0 with size: 0.000183 MiB 00:04:35.448 element at address: 0x2000070fdd80 with size: 0.000183 MiB 00:04:35.448 element at address: 0x20000b27da00 with size: 0.000183 MiB 00:04:35.448 element at address: 0x20000b27dac0 with size: 0.000183 MiB 00:04:35.448 element at address: 0x20000b2fdd80 with size: 0.000183 MiB 00:04:35.448 element at address: 0x2000138fa8c0 with size: 0.000183 MiB 00:04:35.448 element at address: 0x2000192efc40 with size: 0.000183 MiB 00:04:35.448 element at address: 0x2000192efd00 with size: 0.000183 MiB 00:04:35.448 element at address: 0x2000194bc740 with size: 0.000183 MiB 00:04:35.448 element at address: 0x20001aa95380 with size: 0.000183 MiB 00:04:35.448 element at address: 0x20001aa95440 with size: 0.000183 MiB 00:04:35.448 element at address: 0x200027e68f80 with size: 0.000183 MiB 00:04:35.448 element at address: 0x200027e69040 with size: 0.000183 MiB 00:04:35.448 element at address: 0x200027e6fc40 with size: 0.000183 MiB 00:04:35.448 element at address: 0x200027e6fe40 with size: 0.000183 MiB 00:04:35.448 element at address: 0x200027e6ff00 with size: 0.000183 MiB 00:04:35.448 list of memzone associated elements. size: 602.262573 MiB 00:04:35.448 element at address: 0x20001aa95500 with size: 211.416748 MiB 00:04:35.448 associated memzone info: size: 211.416626 MiB name: MP_PDU_immediate_data_Pool_0 00:04:35.448 element at address: 0x200027e6ffc0 with size: 157.562561 MiB 00:04:35.448 associated memzone info: size: 157.562439 MiB name: MP_PDU_data_out_Pool_0 00:04:35.448 element at address: 0x2000139fab80 with size: 84.020630 MiB 00:04:35.448 associated memzone info: size: 84.020508 MiB name: MP_bdev_io_2931678_0 00:04:35.448 element at address: 0x2000009ff380 with size: 48.003052 MiB 00:04:35.448 associated memzone info: size: 48.002930 MiB name: MP_evtpool_2931678_0 00:04:35.448 element at address: 0x200003fff380 with size: 48.003052 MiB 00:04:35.448 associated memzone info: size: 48.002930 MiB name: MP_msgpool_2931678_0 00:04:35.448 element at address: 0x2000195be940 with size: 20.255554 MiB 00:04:35.448 associated memzone info: size: 20.255432 MiB name: MP_PDU_Pool_0 00:04:35.448 element at address: 0x200031dfeb40 with size: 18.005066 MiB 00:04:35.448 associated memzone info: size: 18.004944 MiB name: MP_SCSI_TASK_Pool_0 00:04:35.448 element at address: 0x2000005ffe00 with size: 2.000488 MiB 00:04:35.448 associated memzone info: size: 2.000366 MiB name: RG_MP_evtpool_2931678 00:04:35.448 element at address: 0x200003bffe00 with size: 2.000488 MiB 00:04:35.448 associated memzone info: size: 2.000366 MiB name: RG_MP_msgpool_2931678 00:04:35.448 element at address: 0x2000002d7d00 with size: 1.008118 MiB 00:04:35.448 associated memzone info: size: 1.007996 MiB name: MP_evtpool_2931678 00:04:35.448 element at address: 0x20000b2fde40 with size: 1.008118 MiB 00:04:35.448 associated memzone info: size: 1.007996 MiB name: MP_PDU_Pool 00:04:35.448 element at address: 0x2000194bc800 with size: 1.008118 MiB 00:04:35.448 associated memzone info: size: 1.007996 MiB name: MP_PDU_immediate_data_Pool 00:04:35.448 element at address: 0x2000070fde40 with size: 1.008118 MiB 00:04:35.448 associated memzone info: size: 1.007996 MiB name: MP_PDU_data_out_Pool 00:04:35.448 element at address: 0x2000008fd240 with size: 1.008118 MiB 00:04:35.448 associated memzone info: size: 1.007996 MiB name: MP_SCSI_TASK_Pool 00:04:35.448 element at address: 0x200003eff180 with size: 1.000488 MiB 00:04:35.448 associated memzone info: size: 1.000366 MiB name: RG_ring_0_2931678 00:04:35.448 element at address: 0x200003affc00 with size: 1.000488 MiB 00:04:35.448 associated memzone info: size: 1.000366 MiB name: RG_ring_1_2931678 00:04:35.448 element at address: 0x2000138fa980 with size: 1.000488 MiB 00:04:35.448 associated memzone info: size: 1.000366 MiB name: RG_ring_4_2931678 00:04:35.448 element at address: 0x200031cfe940 with size: 1.000488 MiB 00:04:35.448 associated memzone info: size: 1.000366 MiB name: RG_ring_5_2931678 00:04:35.448 element at address: 0x200003a5b100 with size: 0.500488 MiB 00:04:35.448 associated memzone info: size: 0.500366 MiB name: RG_MP_bdev_io_2931678 00:04:35.448 element at address: 0x20000b27db80 with size: 0.500488 MiB 00:04:35.448 associated memzone info: size: 0.500366 MiB name: RG_MP_PDU_Pool 00:04:35.448 element at address: 0x20000087cf80 with size: 0.500488 MiB 00:04:35.448 associated memzone info: size: 0.500366 MiB name: RG_MP_SCSI_TASK_Pool 00:04:35.448 element at address: 0x20001947c540 with size: 0.250488 MiB 00:04:35.448 associated memzone info: size: 0.250366 MiB name: RG_MP_PDU_immediate_data_Pool 00:04:35.448 element at address: 0x200003adf880 with size: 0.125488 MiB 00:04:35.448 associated memzone info: size: 0.125366 MiB name: RG_ring_2_2931678 00:04:35.448 element at address: 0x2000070f5b80 with size: 0.031738 MiB 00:04:35.448 associated memzone info: size: 0.031616 MiB name: RG_MP_PDU_data_out_Pool 00:04:35.448 element at address: 0x200027e69100 with size: 0.023743 MiB 00:04:35.448 associated memzone info: size: 0.023621 MiB name: MP_Session_Pool_0 00:04:35.448 element at address: 0x200003adb5c0 with size: 0.016113 MiB 00:04:35.448 associated memzone info: size: 0.015991 MiB name: RG_ring_3_2931678 00:04:35.448 element at address: 0x200027e6f240 with size: 0.002441 MiB 00:04:35.448 associated memzone info: size: 0.002319 MiB name: RG_MP_Session_Pool 00:04:35.448 element at address: 0x2000002d7980 with size: 0.000305 MiB 00:04:35.448 associated memzone info: size: 0.000183 MiB name: MP_msgpool_2931678 00:04:35.448 element at address: 0x200003adb3c0 with size: 0.000305 MiB 00:04:35.448 associated memzone info: size: 0.000183 MiB name: MP_bdev_io_2931678 00:04:35.448 element at address: 0x200027e6fd00 with size: 0.000305 MiB 00:04:35.448 associated memzone info: size: 0.000183 MiB name: MP_Session_Pool 00:04:35.448 03:21:15 -- dpdk_memory_utility/test_dpdk_mem_info.sh@25 -- # trap - SIGINT SIGTERM EXIT 00:04:35.448 03:21:15 -- dpdk_memory_utility/test_dpdk_mem_info.sh@26 -- # killprocess 2931678 00:04:35.448 03:21:15 -- common/autotest_common.sh@936 -- # '[' -z 2931678 ']' 00:04:35.449 03:21:15 -- common/autotest_common.sh@940 -- # kill -0 2931678 00:04:35.449 03:21:15 -- common/autotest_common.sh@941 -- # uname 00:04:35.449 03:21:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:35.449 03:21:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2931678 00:04:35.449 03:21:15 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:35.449 03:21:15 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:35.449 03:21:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2931678' 00:04:35.449 killing process with pid 2931678 00:04:35.449 03:21:15 -- common/autotest_common.sh@955 -- # kill 2931678 00:04:35.449 03:21:15 -- common/autotest_common.sh@960 -- # wait 2931678 00:04:36.013 00:04:36.013 real 0m1.764s 00:04:36.013 user 0m1.914s 00:04:36.013 sys 0m0.484s 00:04:36.013 03:21:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:36.013 03:21:16 -- common/autotest_common.sh@10 -- # set +x 00:04:36.013 ************************************ 00:04:36.013 END TEST dpdk_mem_utility 00:04:36.013 ************************************ 00:04:36.013 03:21:16 -- spdk/autotest.sh@174 -- # run_test event /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:04:36.013 03:21:16 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:36.013 03:21:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:36.013 03:21:16 -- common/autotest_common.sh@10 -- # set +x 00:04:36.013 ************************************ 00:04:36.013 START TEST event 00:04:36.013 ************************************ 00:04:36.013 03:21:16 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:04:36.013 * Looking for test storage... 00:04:36.013 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:04:36.013 03:21:16 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:36.013 03:21:16 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:36.013 03:21:16 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:36.013 03:21:16 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:36.013 03:21:16 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:36.013 03:21:16 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:36.013 03:21:16 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:36.013 03:21:16 -- scripts/common.sh@335 -- # IFS=.-: 00:04:36.013 03:21:16 -- scripts/common.sh@335 -- # read -ra ver1 00:04:36.013 03:21:16 -- scripts/common.sh@336 -- # IFS=.-: 00:04:36.013 03:21:16 -- scripts/common.sh@336 -- # read -ra ver2 00:04:36.013 03:21:16 -- scripts/common.sh@337 -- # local 'op=<' 00:04:36.013 03:21:16 -- scripts/common.sh@339 -- # ver1_l=2 00:04:36.013 03:21:16 -- scripts/common.sh@340 -- # ver2_l=1 00:04:36.013 03:21:16 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:36.013 03:21:16 -- scripts/common.sh@343 -- # case "$op" in 00:04:36.013 03:21:16 -- scripts/common.sh@344 -- # : 1 00:04:36.013 03:21:16 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:36.013 03:21:16 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:36.013 03:21:16 -- scripts/common.sh@364 -- # decimal 1 00:04:36.013 03:21:16 -- scripts/common.sh@352 -- # local d=1 00:04:36.013 03:21:16 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:36.013 03:21:16 -- scripts/common.sh@354 -- # echo 1 00:04:36.013 03:21:16 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:36.013 03:21:16 -- scripts/common.sh@365 -- # decimal 2 00:04:36.013 03:21:16 -- scripts/common.sh@352 -- # local d=2 00:04:36.013 03:21:16 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:36.013 03:21:16 -- scripts/common.sh@354 -- # echo 2 00:04:36.013 03:21:16 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:36.013 03:21:16 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:36.013 03:21:16 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:36.013 03:21:16 -- scripts/common.sh@367 -- # return 0 00:04:36.013 03:21:16 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:36.013 03:21:16 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:36.013 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:36.013 --rc genhtml_branch_coverage=1 00:04:36.013 --rc genhtml_function_coverage=1 00:04:36.013 --rc genhtml_legend=1 00:04:36.013 --rc geninfo_all_blocks=1 00:04:36.013 --rc geninfo_unexecuted_blocks=1 00:04:36.013 00:04:36.013 ' 00:04:36.013 03:21:16 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:36.013 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:36.013 --rc genhtml_branch_coverage=1 00:04:36.013 --rc genhtml_function_coverage=1 00:04:36.013 --rc genhtml_legend=1 00:04:36.013 --rc geninfo_all_blocks=1 00:04:36.013 --rc geninfo_unexecuted_blocks=1 00:04:36.013 00:04:36.013 ' 00:04:36.013 03:21:16 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:36.013 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:36.013 --rc genhtml_branch_coverage=1 00:04:36.014 --rc genhtml_function_coverage=1 00:04:36.014 --rc genhtml_legend=1 00:04:36.014 --rc geninfo_all_blocks=1 00:04:36.014 --rc geninfo_unexecuted_blocks=1 00:04:36.014 00:04:36.014 ' 00:04:36.014 03:21:16 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:36.014 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:36.014 --rc genhtml_branch_coverage=1 00:04:36.014 --rc genhtml_function_coverage=1 00:04:36.014 --rc genhtml_legend=1 00:04:36.014 --rc geninfo_all_blocks=1 00:04:36.014 --rc geninfo_unexecuted_blocks=1 00:04:36.014 00:04:36.014 ' 00:04:36.014 03:21:16 -- event/event.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/nbd_common.sh 00:04:36.014 03:21:16 -- bdev/nbd_common.sh@6 -- # set -e 00:04:36.014 03:21:16 -- event/event.sh@45 -- # run_test event_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:04:36.014 03:21:16 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:04:36.014 03:21:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:36.014 03:21:16 -- common/autotest_common.sh@10 -- # set +x 00:04:36.014 ************************************ 00:04:36.014 START TEST event_perf 00:04:36.014 ************************************ 00:04:36.014 03:21:16 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:04:36.014 Running I/O for 1 seconds...[2024-11-21 03:21:16.565485] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:36.014 [2024-11-21 03:21:16.565566] [ DPDK EAL parameters: event_perf --no-shconf -c 0xF --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2931892 ] 00:04:36.014 EAL: No free 2048 kB hugepages reported on node 1 00:04:36.014 [2024-11-21 03:21:16.627774] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:04:36.272 [2024-11-21 03:21:16.747573] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:36.272 [2024-11-21 03:21:16.747655] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:36.272 [2024-11-21 03:21:16.747652] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:04:36.272 [2024-11-21 03:21:16.747595] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:04:37.648 Running I/O for 1 seconds... 00:04:37.648 lcore 0: 232629 00:04:37.648 lcore 1: 232628 00:04:37.648 lcore 2: 232628 00:04:37.648 lcore 3: 232628 00:04:37.648 done. 00:04:37.648 00:04:37.648 real 0m1.320s 00:04:37.648 user 0m4.226s 00:04:37.648 sys 0m0.089s 00:04:37.648 03:21:17 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:37.648 03:21:17 -- common/autotest_common.sh@10 -- # set +x 00:04:37.648 ************************************ 00:04:37.648 END TEST event_perf 00:04:37.648 ************************************ 00:04:37.648 03:21:17 -- event/event.sh@46 -- # run_test event_reactor /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:04:37.648 03:21:17 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:04:37.648 03:21:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:37.648 03:21:17 -- common/autotest_common.sh@10 -- # set +x 00:04:37.648 ************************************ 00:04:37.648 START TEST event_reactor 00:04:37.648 ************************************ 00:04:37.648 03:21:17 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:04:37.648 [2024-11-21 03:21:17.907634] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:37.648 [2024-11-21 03:21:17.907722] [ DPDK EAL parameters: reactor --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2932055 ] 00:04:37.648 EAL: No free 2048 kB hugepages reported on node 1 00:04:37.648 [2024-11-21 03:21:17.968531] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:37.648 [2024-11-21 03:21:18.083400] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:38.583 test_start 00:04:38.583 oneshot 00:04:38.583 tick 100 00:04:38.583 tick 100 00:04:38.583 tick 250 00:04:38.583 tick 100 00:04:38.583 tick 100 00:04:38.583 tick 100 00:04:38.583 tick 250 00:04:38.583 tick 500 00:04:38.583 tick 100 00:04:38.583 tick 100 00:04:38.583 tick 250 00:04:38.583 tick 100 00:04:38.583 tick 100 00:04:38.583 test_end 00:04:38.583 00:04:38.583 real 0m1.309s 00:04:38.583 user 0m1.222s 00:04:38.583 sys 0m0.082s 00:04:38.583 03:21:19 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:38.583 03:21:19 -- common/autotest_common.sh@10 -- # set +x 00:04:38.583 ************************************ 00:04:38.583 END TEST event_reactor 00:04:38.583 ************************************ 00:04:38.583 03:21:19 -- event/event.sh@47 -- # run_test event_reactor_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:04:38.583 03:21:19 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:04:38.583 03:21:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:38.583 03:21:19 -- common/autotest_common.sh@10 -- # set +x 00:04:38.841 ************************************ 00:04:38.841 START TEST event_reactor_perf 00:04:38.841 ************************************ 00:04:38.841 03:21:19 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:04:38.841 [2024-11-21 03:21:19.243880] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:38.841 [2024-11-21 03:21:19.243962] [ DPDK EAL parameters: reactor_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2932271 ] 00:04:38.841 EAL: No free 2048 kB hugepages reported on node 1 00:04:38.841 [2024-11-21 03:21:19.310503] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:38.841 [2024-11-21 03:21:19.428126] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:40.216 test_start 00:04:40.216 test_end 00:04:40.216 Performance: 350621 events per second 00:04:40.216 00:04:40.216 real 0m1.321s 00:04:40.216 user 0m1.230s 00:04:40.216 sys 0m0.085s 00:04:40.216 03:21:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:40.216 03:21:20 -- common/autotest_common.sh@10 -- # set +x 00:04:40.216 ************************************ 00:04:40.216 END TEST event_reactor_perf 00:04:40.216 ************************************ 00:04:40.216 03:21:20 -- event/event.sh@49 -- # uname -s 00:04:40.216 03:21:20 -- event/event.sh@49 -- # '[' Linux = Linux ']' 00:04:40.216 03:21:20 -- event/event.sh@50 -- # run_test event_scheduler /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:04:40.216 03:21:20 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:40.216 03:21:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:40.216 03:21:20 -- common/autotest_common.sh@10 -- # set +x 00:04:40.216 ************************************ 00:04:40.216 START TEST event_scheduler 00:04:40.216 ************************************ 00:04:40.216 03:21:20 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:04:40.216 * Looking for test storage... 00:04:40.216 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler 00:04:40.216 03:21:20 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:40.216 03:21:20 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:40.216 03:21:20 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:40.216 03:21:20 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:40.216 03:21:20 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:40.216 03:21:20 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:40.216 03:21:20 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:40.216 03:21:20 -- scripts/common.sh@335 -- # IFS=.-: 00:04:40.216 03:21:20 -- scripts/common.sh@335 -- # read -ra ver1 00:04:40.216 03:21:20 -- scripts/common.sh@336 -- # IFS=.-: 00:04:40.216 03:21:20 -- scripts/common.sh@336 -- # read -ra ver2 00:04:40.216 03:21:20 -- scripts/common.sh@337 -- # local 'op=<' 00:04:40.216 03:21:20 -- scripts/common.sh@339 -- # ver1_l=2 00:04:40.216 03:21:20 -- scripts/common.sh@340 -- # ver2_l=1 00:04:40.216 03:21:20 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:40.216 03:21:20 -- scripts/common.sh@343 -- # case "$op" in 00:04:40.216 03:21:20 -- scripts/common.sh@344 -- # : 1 00:04:40.216 03:21:20 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:40.216 03:21:20 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:40.216 03:21:20 -- scripts/common.sh@364 -- # decimal 1 00:04:40.216 03:21:20 -- scripts/common.sh@352 -- # local d=1 00:04:40.216 03:21:20 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:40.216 03:21:20 -- scripts/common.sh@354 -- # echo 1 00:04:40.216 03:21:20 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:40.216 03:21:20 -- scripts/common.sh@365 -- # decimal 2 00:04:40.216 03:21:20 -- scripts/common.sh@352 -- # local d=2 00:04:40.216 03:21:20 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:40.216 03:21:20 -- scripts/common.sh@354 -- # echo 2 00:04:40.216 03:21:20 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:40.216 03:21:20 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:40.216 03:21:20 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:40.216 03:21:20 -- scripts/common.sh@367 -- # return 0 00:04:40.216 03:21:20 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:40.216 03:21:20 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:40.216 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:40.216 --rc genhtml_branch_coverage=1 00:04:40.216 --rc genhtml_function_coverage=1 00:04:40.216 --rc genhtml_legend=1 00:04:40.216 --rc geninfo_all_blocks=1 00:04:40.216 --rc geninfo_unexecuted_blocks=1 00:04:40.216 00:04:40.216 ' 00:04:40.216 03:21:20 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:40.216 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:40.216 --rc genhtml_branch_coverage=1 00:04:40.216 --rc genhtml_function_coverage=1 00:04:40.216 --rc genhtml_legend=1 00:04:40.216 --rc geninfo_all_blocks=1 00:04:40.216 --rc geninfo_unexecuted_blocks=1 00:04:40.216 00:04:40.216 ' 00:04:40.216 03:21:20 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:40.216 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:40.216 --rc genhtml_branch_coverage=1 00:04:40.216 --rc genhtml_function_coverage=1 00:04:40.216 --rc genhtml_legend=1 00:04:40.216 --rc geninfo_all_blocks=1 00:04:40.216 --rc geninfo_unexecuted_blocks=1 00:04:40.216 00:04:40.216 ' 00:04:40.216 03:21:20 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:40.216 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:40.216 --rc genhtml_branch_coverage=1 00:04:40.216 --rc genhtml_function_coverage=1 00:04:40.216 --rc genhtml_legend=1 00:04:40.216 --rc geninfo_all_blocks=1 00:04:40.216 --rc geninfo_unexecuted_blocks=1 00:04:40.216 00:04:40.216 ' 00:04:40.216 03:21:20 -- scheduler/scheduler.sh@29 -- # rpc=rpc_cmd 00:04:40.216 03:21:20 -- scheduler/scheduler.sh@35 -- # scheduler_pid=2932524 00:04:40.216 03:21:20 -- scheduler/scheduler.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler -m 0xF -p 0x2 --wait-for-rpc -f 00:04:40.216 03:21:20 -- scheduler/scheduler.sh@36 -- # trap 'killprocess $scheduler_pid; exit 1' SIGINT SIGTERM EXIT 00:04:40.216 03:21:20 -- scheduler/scheduler.sh@37 -- # waitforlisten 2932524 00:04:40.216 03:21:20 -- common/autotest_common.sh@829 -- # '[' -z 2932524 ']' 00:04:40.216 03:21:20 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:40.216 03:21:20 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:40.216 03:21:20 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:40.216 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:40.216 03:21:20 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:40.216 03:21:20 -- common/autotest_common.sh@10 -- # set +x 00:04:40.216 [2024-11-21 03:21:20.758445] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:40.216 [2024-11-21 03:21:20.758538] [ DPDK EAL parameters: scheduler --no-shconf -c 0xF --main-lcore=2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2932524 ] 00:04:40.216 EAL: No free 2048 kB hugepages reported on node 1 00:04:40.216 [2024-11-21 03:21:20.817097] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:04:40.475 [2024-11-21 03:21:20.924576] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:40.475 [2024-11-21 03:21:20.924630] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:40.475 [2024-11-21 03:21:20.924701] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:04:40.475 [2024-11-21 03:21:20.924705] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:04:40.475 03:21:20 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:40.475 03:21:20 -- common/autotest_common.sh@862 -- # return 0 00:04:40.475 03:21:20 -- scheduler/scheduler.sh@39 -- # rpc_cmd framework_set_scheduler dynamic 00:04:40.475 03:21:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:40.475 03:21:20 -- common/autotest_common.sh@10 -- # set +x 00:04:40.475 POWER: Env isn't set yet! 00:04:40.475 POWER: Attempting to initialise ACPI cpufreq power management... 00:04:40.475 POWER: failed to open /sys/devices/system/cpu/cpu%u/cpufreq/scaling_available_frequencies 00:04:40.475 POWER: Cannot get available frequencies of lcore 0 00:04:40.475 POWER: Attempting to initialise PSTAT power management... 00:04:40.475 POWER: Power management governor of lcore 0 has been set to 'performance' successfully 00:04:40.475 POWER: Initialized successfully for lcore 0 power management 00:04:40.475 POWER: Power management governor of lcore 1 has been set to 'performance' successfully 00:04:40.475 POWER: Initialized successfully for lcore 1 power management 00:04:40.475 POWER: Power management governor of lcore 2 has been set to 'performance' successfully 00:04:40.475 POWER: Initialized successfully for lcore 2 power management 00:04:40.475 POWER: Power management governor of lcore 3 has been set to 'performance' successfully 00:04:40.475 POWER: Initialized successfully for lcore 3 power management 00:04:40.475 [2024-11-21 03:21:21.019271] scheduler_dynamic.c: 387:set_opts: *NOTICE*: Setting scheduler load limit to 20 00:04:40.475 [2024-11-21 03:21:21.019289] scheduler_dynamic.c: 389:set_opts: *NOTICE*: Setting scheduler core limit to 80 00:04:40.475 [2024-11-21 03:21:21.019300] scheduler_dynamic.c: 391:set_opts: *NOTICE*: Setting scheduler core busy to 95 00:04:40.475 03:21:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:40.475 03:21:21 -- scheduler/scheduler.sh@40 -- # rpc_cmd framework_start_init 00:04:40.475 03:21:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:40.475 03:21:21 -- common/autotest_common.sh@10 -- # set +x 00:04:40.734 [2024-11-21 03:21:21.124954] scheduler.c: 382:test_start: *NOTICE*: Scheduler test application started. 00:04:40.734 03:21:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:40.734 03:21:21 -- scheduler/scheduler.sh@43 -- # run_test scheduler_create_thread scheduler_create_thread 00:04:40.734 03:21:21 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:40.734 03:21:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:40.734 03:21:21 -- common/autotest_common.sh@10 -- # set +x 00:04:40.734 ************************************ 00:04:40.734 START TEST scheduler_create_thread 00:04:40.734 ************************************ 00:04:40.734 03:21:21 -- common/autotest_common.sh@1114 -- # scheduler_create_thread 00:04:40.734 03:21:21 -- scheduler/scheduler.sh@12 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x1 -a 100 00:04:40.734 03:21:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:40.734 03:21:21 -- common/autotest_common.sh@10 -- # set +x 00:04:40.734 2 00:04:40.734 03:21:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:40.734 03:21:21 -- scheduler/scheduler.sh@13 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x2 -a 100 00:04:40.734 03:21:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:40.734 03:21:21 -- common/autotest_common.sh@10 -- # set +x 00:04:40.734 3 00:04:40.734 03:21:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:40.734 03:21:21 -- scheduler/scheduler.sh@14 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x4 -a 100 00:04:40.734 03:21:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:40.734 03:21:21 -- common/autotest_common.sh@10 -- # set +x 00:04:40.734 4 00:04:40.734 03:21:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:40.734 03:21:21 -- scheduler/scheduler.sh@15 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x8 -a 100 00:04:40.734 03:21:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:40.734 03:21:21 -- common/autotest_common.sh@10 -- # set +x 00:04:40.734 5 00:04:40.734 03:21:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:40.734 03:21:21 -- scheduler/scheduler.sh@16 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x1 -a 0 00:04:40.734 03:21:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:40.734 03:21:21 -- common/autotest_common.sh@10 -- # set +x 00:04:40.734 6 00:04:40.734 03:21:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:40.734 03:21:21 -- scheduler/scheduler.sh@17 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x2 -a 0 00:04:40.734 03:21:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:40.734 03:21:21 -- common/autotest_common.sh@10 -- # set +x 00:04:40.734 7 00:04:40.734 03:21:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:40.734 03:21:21 -- scheduler/scheduler.sh@18 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x4 -a 0 00:04:40.734 03:21:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:40.734 03:21:21 -- common/autotest_common.sh@10 -- # set +x 00:04:40.734 8 00:04:40.734 03:21:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:40.734 03:21:21 -- scheduler/scheduler.sh@19 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x8 -a 0 00:04:40.734 03:21:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:40.734 03:21:21 -- common/autotest_common.sh@10 -- # set +x 00:04:40.734 9 00:04:40.734 03:21:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:40.734 03:21:21 -- scheduler/scheduler.sh@21 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n one_third_active -a 30 00:04:40.734 03:21:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:40.734 03:21:21 -- common/autotest_common.sh@10 -- # set +x 00:04:40.734 10 00:04:40.734 03:21:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:40.734 03:21:21 -- scheduler/scheduler.sh@22 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n half_active -a 0 00:04:40.734 03:21:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:40.734 03:21:21 -- common/autotest_common.sh@10 -- # set +x 00:04:40.734 03:21:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:40.734 03:21:21 -- scheduler/scheduler.sh@22 -- # thread_id=11 00:04:40.734 03:21:21 -- scheduler/scheduler.sh@23 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_set_active 11 50 00:04:40.734 03:21:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:40.734 03:21:21 -- common/autotest_common.sh@10 -- # set +x 00:04:41.300 03:21:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:41.300 03:21:21 -- scheduler/scheduler.sh@25 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n deleted -a 100 00:04:41.300 03:21:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:41.300 03:21:21 -- common/autotest_common.sh@10 -- # set +x 00:04:42.675 03:21:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:42.675 03:21:23 -- scheduler/scheduler.sh@25 -- # thread_id=12 00:04:42.675 03:21:23 -- scheduler/scheduler.sh@26 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_delete 12 00:04:42.675 03:21:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:42.675 03:21:23 -- common/autotest_common.sh@10 -- # set +x 00:04:43.610 03:21:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:43.610 00:04:43.610 real 0m3.102s 00:04:43.610 user 0m0.012s 00:04:43.610 sys 0m0.003s 00:04:43.610 03:21:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:43.610 03:21:24 -- common/autotest_common.sh@10 -- # set +x 00:04:43.610 ************************************ 00:04:43.610 END TEST scheduler_create_thread 00:04:43.610 ************************************ 00:04:43.868 03:21:24 -- scheduler/scheduler.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:04:43.868 03:21:24 -- scheduler/scheduler.sh@46 -- # killprocess 2932524 00:04:43.868 03:21:24 -- common/autotest_common.sh@936 -- # '[' -z 2932524 ']' 00:04:43.868 03:21:24 -- common/autotest_common.sh@940 -- # kill -0 2932524 00:04:43.868 03:21:24 -- common/autotest_common.sh@941 -- # uname 00:04:43.868 03:21:24 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:43.868 03:21:24 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2932524 00:04:43.868 03:21:24 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:04:43.868 03:21:24 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:04:43.868 03:21:24 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2932524' 00:04:43.868 killing process with pid 2932524 00:04:43.868 03:21:24 -- common/autotest_common.sh@955 -- # kill 2932524 00:04:43.868 03:21:24 -- common/autotest_common.sh@960 -- # wait 2932524 00:04:44.127 [2024-11-21 03:21:24.613653] scheduler.c: 360:test_shutdown: *NOTICE*: Scheduler test application stopped. 00:04:44.386 POWER: Power management governor of lcore 0 has been set to 'userspace' successfully 00:04:44.386 POWER: Power management of lcore 0 has exited from 'performance' mode and been set back to the original 00:04:44.386 POWER: Power management governor of lcore 1 has been set to 'schedutil' successfully 00:04:44.386 POWER: Power management of lcore 1 has exited from 'performance' mode and been set back to the original 00:04:44.386 POWER: Power management governor of lcore 2 has been set to 'schedutil' successfully 00:04:44.386 POWER: Power management of lcore 2 has exited from 'performance' mode and been set back to the original 00:04:44.386 POWER: Power management governor of lcore 3 has been set to 'schedutil' successfully 00:04:44.386 POWER: Power management of lcore 3 has exited from 'performance' mode and been set back to the original 00:04:44.386 00:04:44.386 real 0m4.330s 00:04:44.386 user 0m6.993s 00:04:44.386 sys 0m0.342s 00:04:44.386 03:21:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:44.386 03:21:24 -- common/autotest_common.sh@10 -- # set +x 00:04:44.386 ************************************ 00:04:44.386 END TEST event_scheduler 00:04:44.386 ************************************ 00:04:44.386 03:21:24 -- event/event.sh@51 -- # modprobe -n nbd 00:04:44.386 03:21:24 -- event/event.sh@52 -- # run_test app_repeat app_repeat_test 00:04:44.386 03:21:24 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:44.386 03:21:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:44.386 03:21:24 -- common/autotest_common.sh@10 -- # set +x 00:04:44.386 ************************************ 00:04:44.386 START TEST app_repeat 00:04:44.386 ************************************ 00:04:44.386 03:21:24 -- common/autotest_common.sh@1114 -- # app_repeat_test 00:04:44.386 03:21:24 -- event/event.sh@12 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:44.386 03:21:24 -- event/event.sh@13 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:44.386 03:21:24 -- event/event.sh@13 -- # local nbd_list 00:04:44.386 03:21:24 -- event/event.sh@14 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:44.386 03:21:24 -- event/event.sh@14 -- # local bdev_list 00:04:44.386 03:21:24 -- event/event.sh@15 -- # local repeat_times=4 00:04:44.386 03:21:24 -- event/event.sh@17 -- # modprobe nbd 00:04:44.386 03:21:24 -- event/event.sh@19 -- # repeat_pid=2933095 00:04:44.386 03:21:24 -- event/event.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/app_repeat/app_repeat -r /var/tmp/spdk-nbd.sock -m 0x3 -t 4 00:04:44.386 03:21:24 -- event/event.sh@20 -- # trap 'killprocess $repeat_pid; exit 1' SIGINT SIGTERM EXIT 00:04:44.386 03:21:24 -- event/event.sh@21 -- # echo 'Process app_repeat pid: 2933095' 00:04:44.386 Process app_repeat pid: 2933095 00:04:44.386 03:21:24 -- event/event.sh@23 -- # for i in {0..2} 00:04:44.386 03:21:24 -- event/event.sh@24 -- # echo 'spdk_app_start Round 0' 00:04:44.386 spdk_app_start Round 0 00:04:44.386 03:21:24 -- event/event.sh@25 -- # waitforlisten 2933095 /var/tmp/spdk-nbd.sock 00:04:44.386 03:21:24 -- common/autotest_common.sh@829 -- # '[' -z 2933095 ']' 00:04:44.386 03:21:24 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:04:44.386 03:21:24 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:44.386 03:21:24 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:04:44.386 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:04:44.386 03:21:24 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:44.386 03:21:24 -- common/autotest_common.sh@10 -- # set +x 00:04:44.386 [2024-11-21 03:21:24.960885] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:44.386 [2024-11-21 03:21:24.960970] [ DPDK EAL parameters: app_repeat --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2933095 ] 00:04:44.386 EAL: No free 2048 kB hugepages reported on node 1 00:04:44.386 [2024-11-21 03:21:25.019419] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:44.645 [2024-11-21 03:21:25.130880] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:44.645 [2024-11-21 03:21:25.130884] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:45.580 03:21:25 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:45.580 03:21:25 -- common/autotest_common.sh@862 -- # return 0 00:04:45.580 03:21:25 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:45.580 Malloc0 00:04:45.839 03:21:26 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:46.097 Malloc1 00:04:46.097 03:21:26 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:46.097 03:21:26 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:46.097 03:21:26 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:46.097 03:21:26 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:04:46.097 03:21:26 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:46.097 03:21:26 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:04:46.097 03:21:26 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:46.097 03:21:26 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:46.097 03:21:26 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:46.097 03:21:26 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:04:46.097 03:21:26 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:46.097 03:21:26 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:04:46.097 03:21:26 -- bdev/nbd_common.sh@12 -- # local i 00:04:46.097 03:21:26 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:04:46.097 03:21:26 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:46.097 03:21:26 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:04:46.355 /dev/nbd0 00:04:46.355 03:21:26 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:04:46.355 03:21:26 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:04:46.355 03:21:26 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:04:46.355 03:21:26 -- common/autotest_common.sh@867 -- # local i 00:04:46.355 03:21:26 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:04:46.355 03:21:26 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:04:46.355 03:21:26 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:04:46.355 03:21:26 -- common/autotest_common.sh@871 -- # break 00:04:46.355 03:21:26 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:04:46.355 03:21:26 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:04:46.355 03:21:26 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:46.355 1+0 records in 00:04:46.355 1+0 records out 00:04:46.355 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000146063 s, 28.0 MB/s 00:04:46.355 03:21:26 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:46.355 03:21:26 -- common/autotest_common.sh@884 -- # size=4096 00:04:46.355 03:21:26 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:46.355 03:21:26 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:04:46.355 03:21:26 -- common/autotest_common.sh@887 -- # return 0 00:04:46.355 03:21:26 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:46.355 03:21:26 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:46.355 03:21:26 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:04:46.613 /dev/nbd1 00:04:46.613 03:21:27 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:04:46.613 03:21:27 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:04:46.613 03:21:27 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:04:46.613 03:21:27 -- common/autotest_common.sh@867 -- # local i 00:04:46.613 03:21:27 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:04:46.613 03:21:27 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:04:46.613 03:21:27 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:04:46.613 03:21:27 -- common/autotest_common.sh@871 -- # break 00:04:46.613 03:21:27 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:04:46.613 03:21:27 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:04:46.613 03:21:27 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:46.614 1+0 records in 00:04:46.614 1+0 records out 00:04:46.614 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000195983 s, 20.9 MB/s 00:04:46.614 03:21:27 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:46.614 03:21:27 -- common/autotest_common.sh@884 -- # size=4096 00:04:46.614 03:21:27 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:46.614 03:21:27 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:04:46.614 03:21:27 -- common/autotest_common.sh@887 -- # return 0 00:04:46.614 03:21:27 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:46.614 03:21:27 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:46.614 03:21:27 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:46.614 03:21:27 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:46.614 03:21:27 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:46.872 03:21:27 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:04:46.872 { 00:04:46.872 "nbd_device": "/dev/nbd0", 00:04:46.872 "bdev_name": "Malloc0" 00:04:46.872 }, 00:04:46.872 { 00:04:46.872 "nbd_device": "/dev/nbd1", 00:04:46.872 "bdev_name": "Malloc1" 00:04:46.872 } 00:04:46.872 ]' 00:04:46.872 03:21:27 -- bdev/nbd_common.sh@64 -- # echo '[ 00:04:46.872 { 00:04:46.872 "nbd_device": "/dev/nbd0", 00:04:46.872 "bdev_name": "Malloc0" 00:04:46.872 }, 00:04:46.872 { 00:04:46.872 "nbd_device": "/dev/nbd1", 00:04:46.872 "bdev_name": "Malloc1" 00:04:46.872 } 00:04:46.872 ]' 00:04:46.872 03:21:27 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:46.872 03:21:27 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:04:46.872 /dev/nbd1' 00:04:46.872 03:21:27 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:04:46.872 /dev/nbd1' 00:04:46.872 03:21:27 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:46.872 03:21:27 -- bdev/nbd_common.sh@65 -- # count=2 00:04:46.872 03:21:27 -- bdev/nbd_common.sh@66 -- # echo 2 00:04:46.872 03:21:27 -- bdev/nbd_common.sh@95 -- # count=2 00:04:46.872 03:21:27 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:04:46.872 03:21:27 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:04:46.872 03:21:27 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:46.872 03:21:27 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:46.872 03:21:27 -- bdev/nbd_common.sh@71 -- # local operation=write 00:04:46.872 03:21:27 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:46.872 03:21:27 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:04:46.872 03:21:27 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:04:46.872 256+0 records in 00:04:46.872 256+0 records out 00:04:46.872 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00505985 s, 207 MB/s 00:04:46.872 03:21:27 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:46.872 03:21:27 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:04:46.872 256+0 records in 00:04:46.872 256+0 records out 00:04:46.872 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222396 s, 47.1 MB/s 00:04:46.872 03:21:27 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:46.872 03:21:27 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:04:46.872 256+0 records in 00:04:46.872 256+0 records out 00:04:46.872 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243753 s, 43.0 MB/s 00:04:46.872 03:21:27 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:04:46.872 03:21:27 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:46.872 03:21:27 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:46.872 03:21:27 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:04:46.872 03:21:27 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:46.872 03:21:27 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:04:46.872 03:21:27 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:04:46.872 03:21:27 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:46.872 03:21:27 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:04:46.872 03:21:27 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:46.872 03:21:27 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:04:46.872 03:21:27 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:46.872 03:21:27 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:04:46.872 03:21:27 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:46.872 03:21:27 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:46.872 03:21:27 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:04:46.872 03:21:27 -- bdev/nbd_common.sh@51 -- # local i 00:04:46.872 03:21:27 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:46.872 03:21:27 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:04:47.130 03:21:27 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:04:47.130 03:21:27 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:04:47.130 03:21:27 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:04:47.130 03:21:27 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:47.130 03:21:27 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:47.130 03:21:27 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:04:47.130 03:21:27 -- bdev/nbd_common.sh@41 -- # break 00:04:47.130 03:21:27 -- bdev/nbd_common.sh@45 -- # return 0 00:04:47.130 03:21:27 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:47.130 03:21:27 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:04:47.388 03:21:28 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:04:47.388 03:21:28 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:04:47.388 03:21:28 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:04:47.388 03:21:28 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:47.388 03:21:28 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:47.388 03:21:28 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:04:47.388 03:21:28 -- bdev/nbd_common.sh@41 -- # break 00:04:47.388 03:21:28 -- bdev/nbd_common.sh@45 -- # return 0 00:04:47.388 03:21:28 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:47.388 03:21:28 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:47.388 03:21:28 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:47.647 03:21:28 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:04:47.647 03:21:28 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:04:47.647 03:21:28 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:47.904 03:21:28 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:04:47.904 03:21:28 -- bdev/nbd_common.sh@65 -- # echo '' 00:04:47.904 03:21:28 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:47.904 03:21:28 -- bdev/nbd_common.sh@65 -- # true 00:04:47.904 03:21:28 -- bdev/nbd_common.sh@65 -- # count=0 00:04:47.904 03:21:28 -- bdev/nbd_common.sh@66 -- # echo 0 00:04:47.904 03:21:28 -- bdev/nbd_common.sh@104 -- # count=0 00:04:47.904 03:21:28 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:04:47.904 03:21:28 -- bdev/nbd_common.sh@109 -- # return 0 00:04:47.904 03:21:28 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:04:48.163 03:21:28 -- event/event.sh@35 -- # sleep 3 00:04:48.421 [2024-11-21 03:21:28.850951] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:48.421 [2024-11-21 03:21:28.964279] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:48.421 [2024-11-21 03:21:28.964280] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:48.421 [2024-11-21 03:21:29.024742] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:04:48.421 [2024-11-21 03:21:29.024838] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:04:51.014 03:21:31 -- event/event.sh@23 -- # for i in {0..2} 00:04:51.014 03:21:31 -- event/event.sh@24 -- # echo 'spdk_app_start Round 1' 00:04:51.014 spdk_app_start Round 1 00:04:51.014 03:21:31 -- event/event.sh@25 -- # waitforlisten 2933095 /var/tmp/spdk-nbd.sock 00:04:51.014 03:21:31 -- common/autotest_common.sh@829 -- # '[' -z 2933095 ']' 00:04:51.014 03:21:31 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:04:51.014 03:21:31 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:51.014 03:21:31 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:04:51.014 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:04:51.014 03:21:31 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:51.014 03:21:31 -- common/autotest_common.sh@10 -- # set +x 00:04:51.272 03:21:31 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:51.272 03:21:31 -- common/autotest_common.sh@862 -- # return 0 00:04:51.272 03:21:31 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:51.531 Malloc0 00:04:51.531 03:21:32 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:51.790 Malloc1 00:04:51.790 03:21:32 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:51.790 03:21:32 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:51.790 03:21:32 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:51.790 03:21:32 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:04:51.790 03:21:32 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:51.790 03:21:32 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:04:51.790 03:21:32 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:51.790 03:21:32 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:51.790 03:21:32 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:51.790 03:21:32 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:04:51.790 03:21:32 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:51.790 03:21:32 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:04:51.790 03:21:32 -- bdev/nbd_common.sh@12 -- # local i 00:04:51.790 03:21:32 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:04:51.790 03:21:32 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:51.790 03:21:32 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:04:52.048 /dev/nbd0 00:04:52.048 03:21:32 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:04:52.048 03:21:32 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:04:52.048 03:21:32 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:04:52.048 03:21:32 -- common/autotest_common.sh@867 -- # local i 00:04:52.048 03:21:32 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:04:52.048 03:21:32 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:04:52.048 03:21:32 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:04:52.048 03:21:32 -- common/autotest_common.sh@871 -- # break 00:04:52.048 03:21:32 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:04:52.048 03:21:32 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:04:52.048 03:21:32 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:52.048 1+0 records in 00:04:52.048 1+0 records out 00:04:52.048 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000182349 s, 22.5 MB/s 00:04:52.048 03:21:32 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:52.048 03:21:32 -- common/autotest_common.sh@884 -- # size=4096 00:04:52.048 03:21:32 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:52.048 03:21:32 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:04:52.048 03:21:32 -- common/autotest_common.sh@887 -- # return 0 00:04:52.048 03:21:32 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:52.048 03:21:32 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:52.048 03:21:32 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:04:52.306 /dev/nbd1 00:04:52.306 03:21:32 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:04:52.306 03:21:32 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:04:52.306 03:21:32 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:04:52.306 03:21:32 -- common/autotest_common.sh@867 -- # local i 00:04:52.306 03:21:32 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:04:52.306 03:21:32 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:04:52.306 03:21:32 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:04:52.306 03:21:32 -- common/autotest_common.sh@871 -- # break 00:04:52.306 03:21:32 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:04:52.306 03:21:32 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:04:52.306 03:21:32 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:52.564 1+0 records in 00:04:52.564 1+0 records out 00:04:52.564 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000202374 s, 20.2 MB/s 00:04:52.564 03:21:32 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:52.564 03:21:32 -- common/autotest_common.sh@884 -- # size=4096 00:04:52.564 03:21:32 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:52.564 03:21:32 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:04:52.564 03:21:32 -- common/autotest_common.sh@887 -- # return 0 00:04:52.564 03:21:32 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:52.564 03:21:32 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:52.564 03:21:32 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:52.564 03:21:32 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:52.564 03:21:32 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:52.564 03:21:33 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:04:52.564 { 00:04:52.564 "nbd_device": "/dev/nbd0", 00:04:52.564 "bdev_name": "Malloc0" 00:04:52.564 }, 00:04:52.564 { 00:04:52.564 "nbd_device": "/dev/nbd1", 00:04:52.564 "bdev_name": "Malloc1" 00:04:52.564 } 00:04:52.564 ]' 00:04:52.822 03:21:33 -- bdev/nbd_common.sh@64 -- # echo '[ 00:04:52.822 { 00:04:52.822 "nbd_device": "/dev/nbd0", 00:04:52.822 "bdev_name": "Malloc0" 00:04:52.822 }, 00:04:52.822 { 00:04:52.822 "nbd_device": "/dev/nbd1", 00:04:52.822 "bdev_name": "Malloc1" 00:04:52.822 } 00:04:52.822 ]' 00:04:52.822 03:21:33 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:52.822 03:21:33 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:04:52.822 /dev/nbd1' 00:04:52.822 03:21:33 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:04:52.822 /dev/nbd1' 00:04:52.822 03:21:33 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:52.822 03:21:33 -- bdev/nbd_common.sh@65 -- # count=2 00:04:52.822 03:21:33 -- bdev/nbd_common.sh@66 -- # echo 2 00:04:52.822 03:21:33 -- bdev/nbd_common.sh@95 -- # count=2 00:04:52.822 03:21:33 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:04:52.822 03:21:33 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:04:52.822 03:21:33 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:52.822 03:21:33 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:52.822 03:21:33 -- bdev/nbd_common.sh@71 -- # local operation=write 00:04:52.822 03:21:33 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:52.822 03:21:33 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:04:52.822 03:21:33 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:04:52.822 256+0 records in 00:04:52.822 256+0 records out 00:04:52.822 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00501466 s, 209 MB/s 00:04:52.822 03:21:33 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:52.822 03:21:33 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:04:52.822 256+0 records in 00:04:52.822 256+0 records out 00:04:52.822 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227345 s, 46.1 MB/s 00:04:52.822 03:21:33 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:52.822 03:21:33 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:04:52.822 256+0 records in 00:04:52.822 256+0 records out 00:04:52.822 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241428 s, 43.4 MB/s 00:04:52.822 03:21:33 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:04:52.822 03:21:33 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:52.822 03:21:33 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:52.822 03:21:33 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:04:52.822 03:21:33 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:52.822 03:21:33 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:04:52.822 03:21:33 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:04:52.822 03:21:33 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:52.822 03:21:33 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:04:52.822 03:21:33 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:52.822 03:21:33 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:04:52.822 03:21:33 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:52.822 03:21:33 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:04:52.822 03:21:33 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:52.822 03:21:33 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:52.822 03:21:33 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:04:52.822 03:21:33 -- bdev/nbd_common.sh@51 -- # local i 00:04:52.822 03:21:33 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:52.822 03:21:33 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:04:53.080 03:21:33 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:04:53.080 03:21:33 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:04:53.080 03:21:33 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:04:53.080 03:21:33 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:53.080 03:21:33 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:53.080 03:21:33 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:04:53.080 03:21:33 -- bdev/nbd_common.sh@41 -- # break 00:04:53.080 03:21:33 -- bdev/nbd_common.sh@45 -- # return 0 00:04:53.080 03:21:33 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:53.080 03:21:33 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:04:53.338 03:21:33 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:04:53.338 03:21:33 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:04:53.338 03:21:33 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:04:53.338 03:21:33 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:53.338 03:21:33 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:53.338 03:21:33 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:04:53.338 03:21:33 -- bdev/nbd_common.sh@41 -- # break 00:04:53.338 03:21:33 -- bdev/nbd_common.sh@45 -- # return 0 00:04:53.338 03:21:33 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:53.338 03:21:33 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:53.338 03:21:33 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:53.596 03:21:34 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:04:53.596 03:21:34 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:04:53.596 03:21:34 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:53.596 03:21:34 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:04:53.596 03:21:34 -- bdev/nbd_common.sh@65 -- # echo '' 00:04:53.596 03:21:34 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:53.596 03:21:34 -- bdev/nbd_common.sh@65 -- # true 00:04:53.596 03:21:34 -- bdev/nbd_common.sh@65 -- # count=0 00:04:53.596 03:21:34 -- bdev/nbd_common.sh@66 -- # echo 0 00:04:53.596 03:21:34 -- bdev/nbd_common.sh@104 -- # count=0 00:04:53.596 03:21:34 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:04:53.596 03:21:34 -- bdev/nbd_common.sh@109 -- # return 0 00:04:53.596 03:21:34 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:04:53.853 03:21:34 -- event/event.sh@35 -- # sleep 3 00:04:54.111 [2024-11-21 03:21:34.715182] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:54.369 [2024-11-21 03:21:34.828950] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:54.369 [2024-11-21 03:21:34.828956] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:54.369 [2024-11-21 03:21:34.890533] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:04:54.369 [2024-11-21 03:21:34.890612] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:04:56.896 03:21:37 -- event/event.sh@23 -- # for i in {0..2} 00:04:56.896 03:21:37 -- event/event.sh@24 -- # echo 'spdk_app_start Round 2' 00:04:56.896 spdk_app_start Round 2 00:04:56.896 03:21:37 -- event/event.sh@25 -- # waitforlisten 2933095 /var/tmp/spdk-nbd.sock 00:04:56.896 03:21:37 -- common/autotest_common.sh@829 -- # '[' -z 2933095 ']' 00:04:56.896 03:21:37 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:04:56.896 03:21:37 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:56.896 03:21:37 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:04:56.896 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:04:56.896 03:21:37 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:56.896 03:21:37 -- common/autotest_common.sh@10 -- # set +x 00:04:57.153 03:21:37 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:57.153 03:21:37 -- common/autotest_common.sh@862 -- # return 0 00:04:57.153 03:21:37 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:57.412 Malloc0 00:04:57.412 03:21:37 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:57.671 Malloc1 00:04:57.671 03:21:38 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:57.671 03:21:38 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:57.671 03:21:38 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:57.671 03:21:38 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:04:57.671 03:21:38 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:57.671 03:21:38 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:04:57.671 03:21:38 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:57.671 03:21:38 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:57.671 03:21:38 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:57.671 03:21:38 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:04:57.671 03:21:38 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:57.671 03:21:38 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:04:57.671 03:21:38 -- bdev/nbd_common.sh@12 -- # local i 00:04:57.671 03:21:38 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:04:57.671 03:21:38 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:57.671 03:21:38 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:04:57.929 /dev/nbd0 00:04:57.929 03:21:38 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:04:57.929 03:21:38 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:04:57.929 03:21:38 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:04:57.929 03:21:38 -- common/autotest_common.sh@867 -- # local i 00:04:57.929 03:21:38 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:04:57.929 03:21:38 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:04:57.929 03:21:38 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:04:57.929 03:21:38 -- common/autotest_common.sh@871 -- # break 00:04:57.929 03:21:38 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:04:57.929 03:21:38 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:04:57.929 03:21:38 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:57.929 1+0 records in 00:04:57.929 1+0 records out 00:04:57.929 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000143491 s, 28.5 MB/s 00:04:57.929 03:21:38 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:57.929 03:21:38 -- common/autotest_common.sh@884 -- # size=4096 00:04:57.929 03:21:38 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:57.929 03:21:38 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:04:57.929 03:21:38 -- common/autotest_common.sh@887 -- # return 0 00:04:57.929 03:21:38 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:57.929 03:21:38 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:57.929 03:21:38 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:04:58.187 /dev/nbd1 00:04:58.187 03:21:38 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:04:58.187 03:21:38 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:04:58.187 03:21:38 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:04:58.187 03:21:38 -- common/autotest_common.sh@867 -- # local i 00:04:58.187 03:21:38 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:04:58.187 03:21:38 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:04:58.187 03:21:38 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:04:58.187 03:21:38 -- common/autotest_common.sh@871 -- # break 00:04:58.187 03:21:38 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:04:58.187 03:21:38 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:04:58.187 03:21:38 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:58.187 1+0 records in 00:04:58.187 1+0 records out 00:04:58.187 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000228717 s, 17.9 MB/s 00:04:58.187 03:21:38 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:58.187 03:21:38 -- common/autotest_common.sh@884 -- # size=4096 00:04:58.187 03:21:38 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:58.187 03:21:38 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:04:58.187 03:21:38 -- common/autotest_common.sh@887 -- # return 0 00:04:58.187 03:21:38 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:58.187 03:21:38 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:58.187 03:21:38 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:58.187 03:21:38 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:58.187 03:21:38 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:58.445 03:21:39 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:04:58.445 { 00:04:58.445 "nbd_device": "/dev/nbd0", 00:04:58.445 "bdev_name": "Malloc0" 00:04:58.445 }, 00:04:58.445 { 00:04:58.445 "nbd_device": "/dev/nbd1", 00:04:58.445 "bdev_name": "Malloc1" 00:04:58.445 } 00:04:58.445 ]' 00:04:58.445 03:21:39 -- bdev/nbd_common.sh@64 -- # echo '[ 00:04:58.445 { 00:04:58.445 "nbd_device": "/dev/nbd0", 00:04:58.445 "bdev_name": "Malloc0" 00:04:58.445 }, 00:04:58.445 { 00:04:58.445 "nbd_device": "/dev/nbd1", 00:04:58.445 "bdev_name": "Malloc1" 00:04:58.445 } 00:04:58.445 ]' 00:04:58.445 03:21:39 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:58.445 03:21:39 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:04:58.445 /dev/nbd1' 00:04:58.445 03:21:39 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:04:58.445 /dev/nbd1' 00:04:58.445 03:21:39 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:58.445 03:21:39 -- bdev/nbd_common.sh@65 -- # count=2 00:04:58.445 03:21:39 -- bdev/nbd_common.sh@66 -- # echo 2 00:04:58.445 03:21:39 -- bdev/nbd_common.sh@95 -- # count=2 00:04:58.445 03:21:39 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:04:58.445 03:21:39 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:04:58.445 03:21:39 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:58.445 03:21:39 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:58.445 03:21:39 -- bdev/nbd_common.sh@71 -- # local operation=write 00:04:58.445 03:21:39 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:58.445 03:21:39 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:04:58.445 03:21:39 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:04:58.703 256+0 records in 00:04:58.704 256+0 records out 00:04:58.704 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00506678 s, 207 MB/s 00:04:58.704 03:21:39 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:58.704 03:21:39 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:04:58.704 256+0 records in 00:04:58.704 256+0 records out 00:04:58.704 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226011 s, 46.4 MB/s 00:04:58.704 03:21:39 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:58.704 03:21:39 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:04:58.704 256+0 records in 00:04:58.704 256+0 records out 00:04:58.704 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229129 s, 45.8 MB/s 00:04:58.704 03:21:39 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:04:58.704 03:21:39 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:58.704 03:21:39 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:58.704 03:21:39 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:04:58.704 03:21:39 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:58.704 03:21:39 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:04:58.704 03:21:39 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:04:58.704 03:21:39 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:58.704 03:21:39 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:04:58.704 03:21:39 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:58.704 03:21:39 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:04:58.704 03:21:39 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:58.704 03:21:39 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:04:58.704 03:21:39 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:58.704 03:21:39 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:58.704 03:21:39 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:04:58.704 03:21:39 -- bdev/nbd_common.sh@51 -- # local i 00:04:58.704 03:21:39 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:58.704 03:21:39 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:04:58.962 03:21:39 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:04:58.962 03:21:39 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:04:58.962 03:21:39 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:04:58.962 03:21:39 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:58.962 03:21:39 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:58.962 03:21:39 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:04:58.962 03:21:39 -- bdev/nbd_common.sh@41 -- # break 00:04:58.962 03:21:39 -- bdev/nbd_common.sh@45 -- # return 0 00:04:58.962 03:21:39 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:58.962 03:21:39 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:04:59.220 03:21:39 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:04:59.220 03:21:39 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:04:59.220 03:21:39 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:04:59.220 03:21:39 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:59.220 03:21:39 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:59.220 03:21:39 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:04:59.220 03:21:39 -- bdev/nbd_common.sh@41 -- # break 00:04:59.220 03:21:39 -- bdev/nbd_common.sh@45 -- # return 0 00:04:59.220 03:21:39 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:59.220 03:21:39 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:59.220 03:21:39 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:59.478 03:21:39 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:04:59.478 03:21:39 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:04:59.478 03:21:39 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:59.478 03:21:40 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:04:59.478 03:21:40 -- bdev/nbd_common.sh@65 -- # echo '' 00:04:59.478 03:21:40 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:59.478 03:21:40 -- bdev/nbd_common.sh@65 -- # true 00:04:59.478 03:21:40 -- bdev/nbd_common.sh@65 -- # count=0 00:04:59.478 03:21:40 -- bdev/nbd_common.sh@66 -- # echo 0 00:04:59.478 03:21:40 -- bdev/nbd_common.sh@104 -- # count=0 00:04:59.478 03:21:40 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:04:59.478 03:21:40 -- bdev/nbd_common.sh@109 -- # return 0 00:04:59.478 03:21:40 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:04:59.738 03:21:40 -- event/event.sh@35 -- # sleep 3 00:04:59.996 [2024-11-21 03:21:40.577950] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:05:00.256 [2024-11-21 03:21:40.693277] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:00.256 [2024-11-21 03:21:40.693283] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:00.256 [2024-11-21 03:21:40.754263] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:05:00.256 [2024-11-21 03:21:40.754337] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:05:02.793 03:21:43 -- event/event.sh@38 -- # waitforlisten 2933095 /var/tmp/spdk-nbd.sock 00:05:02.793 03:21:43 -- common/autotest_common.sh@829 -- # '[' -z 2933095 ']' 00:05:02.793 03:21:43 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:05:02.793 03:21:43 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:02.793 03:21:43 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:05:02.793 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:05:02.793 03:21:43 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:02.793 03:21:43 -- common/autotest_common.sh@10 -- # set +x 00:05:03.053 03:21:43 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:03.053 03:21:43 -- common/autotest_common.sh@862 -- # return 0 00:05:03.053 03:21:43 -- event/event.sh@39 -- # killprocess 2933095 00:05:03.053 03:21:43 -- common/autotest_common.sh@936 -- # '[' -z 2933095 ']' 00:05:03.053 03:21:43 -- common/autotest_common.sh@940 -- # kill -0 2933095 00:05:03.053 03:21:43 -- common/autotest_common.sh@941 -- # uname 00:05:03.053 03:21:43 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:03.053 03:21:43 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2933095 00:05:03.053 03:21:43 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:03.053 03:21:43 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:03.053 03:21:43 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2933095' 00:05:03.053 killing process with pid 2933095 00:05:03.053 03:21:43 -- common/autotest_common.sh@955 -- # kill 2933095 00:05:03.053 03:21:43 -- common/autotest_common.sh@960 -- # wait 2933095 00:05:03.312 spdk_app_start is called in Round 0. 00:05:03.312 Shutdown signal received, stop current app iteration 00:05:03.312 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 reinitialization... 00:05:03.312 spdk_app_start is called in Round 1. 00:05:03.312 Shutdown signal received, stop current app iteration 00:05:03.312 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 reinitialization... 00:05:03.312 spdk_app_start is called in Round 2. 00:05:03.312 Shutdown signal received, stop current app iteration 00:05:03.312 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 reinitialization... 00:05:03.312 spdk_app_start is called in Round 3. 00:05:03.312 Shutdown signal received, stop current app iteration 00:05:03.312 03:21:43 -- event/event.sh@40 -- # trap - SIGINT SIGTERM EXIT 00:05:03.312 03:21:43 -- event/event.sh@42 -- # return 0 00:05:03.312 00:05:03.312 real 0m18.906s 00:05:03.312 user 0m41.197s 00:05:03.312 sys 0m3.146s 00:05:03.312 03:21:43 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:03.312 03:21:43 -- common/autotest_common.sh@10 -- # set +x 00:05:03.312 ************************************ 00:05:03.312 END TEST app_repeat 00:05:03.312 ************************************ 00:05:03.312 03:21:43 -- event/event.sh@54 -- # (( SPDK_TEST_CRYPTO == 0 )) 00:05:03.312 03:21:43 -- event/event.sh@55 -- # run_test cpu_locks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:05:03.312 03:21:43 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:03.312 03:21:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:03.312 03:21:43 -- common/autotest_common.sh@10 -- # set +x 00:05:03.312 ************************************ 00:05:03.312 START TEST cpu_locks 00:05:03.312 ************************************ 00:05:03.312 03:21:43 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:05:03.312 * Looking for test storage... 00:05:03.312 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:05:03.312 03:21:43 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:03.312 03:21:43 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:03.313 03:21:43 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:03.572 03:21:44 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:03.572 03:21:44 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:03.572 03:21:44 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:03.572 03:21:44 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:03.572 03:21:44 -- scripts/common.sh@335 -- # IFS=.-: 00:05:03.572 03:21:44 -- scripts/common.sh@335 -- # read -ra ver1 00:05:03.572 03:21:44 -- scripts/common.sh@336 -- # IFS=.-: 00:05:03.572 03:21:44 -- scripts/common.sh@336 -- # read -ra ver2 00:05:03.572 03:21:44 -- scripts/common.sh@337 -- # local 'op=<' 00:05:03.572 03:21:44 -- scripts/common.sh@339 -- # ver1_l=2 00:05:03.572 03:21:44 -- scripts/common.sh@340 -- # ver2_l=1 00:05:03.572 03:21:44 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:03.572 03:21:44 -- scripts/common.sh@343 -- # case "$op" in 00:05:03.572 03:21:44 -- scripts/common.sh@344 -- # : 1 00:05:03.572 03:21:44 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:03.572 03:21:44 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:03.572 03:21:44 -- scripts/common.sh@364 -- # decimal 1 00:05:03.572 03:21:44 -- scripts/common.sh@352 -- # local d=1 00:05:03.572 03:21:44 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:03.572 03:21:44 -- scripts/common.sh@354 -- # echo 1 00:05:03.572 03:21:44 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:03.572 03:21:44 -- scripts/common.sh@365 -- # decimal 2 00:05:03.572 03:21:44 -- scripts/common.sh@352 -- # local d=2 00:05:03.572 03:21:44 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:03.572 03:21:44 -- scripts/common.sh@354 -- # echo 2 00:05:03.572 03:21:44 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:03.572 03:21:44 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:03.572 03:21:44 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:03.572 03:21:44 -- scripts/common.sh@367 -- # return 0 00:05:03.572 03:21:44 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:03.572 03:21:44 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:03.572 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:03.572 --rc genhtml_branch_coverage=1 00:05:03.572 --rc genhtml_function_coverage=1 00:05:03.573 --rc genhtml_legend=1 00:05:03.573 --rc geninfo_all_blocks=1 00:05:03.573 --rc geninfo_unexecuted_blocks=1 00:05:03.573 00:05:03.573 ' 00:05:03.573 03:21:44 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:03.573 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:03.573 --rc genhtml_branch_coverage=1 00:05:03.573 --rc genhtml_function_coverage=1 00:05:03.573 --rc genhtml_legend=1 00:05:03.573 --rc geninfo_all_blocks=1 00:05:03.573 --rc geninfo_unexecuted_blocks=1 00:05:03.573 00:05:03.573 ' 00:05:03.573 03:21:44 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:03.573 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:03.573 --rc genhtml_branch_coverage=1 00:05:03.573 --rc genhtml_function_coverage=1 00:05:03.573 --rc genhtml_legend=1 00:05:03.573 --rc geninfo_all_blocks=1 00:05:03.573 --rc geninfo_unexecuted_blocks=1 00:05:03.573 00:05:03.573 ' 00:05:03.573 03:21:44 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:03.573 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:03.573 --rc genhtml_branch_coverage=1 00:05:03.573 --rc genhtml_function_coverage=1 00:05:03.573 --rc genhtml_legend=1 00:05:03.573 --rc geninfo_all_blocks=1 00:05:03.573 --rc geninfo_unexecuted_blocks=1 00:05:03.573 00:05:03.573 ' 00:05:03.573 03:21:44 -- event/cpu_locks.sh@11 -- # rpc_sock1=/var/tmp/spdk.sock 00:05:03.573 03:21:44 -- event/cpu_locks.sh@12 -- # rpc_sock2=/var/tmp/spdk2.sock 00:05:03.573 03:21:44 -- event/cpu_locks.sh@164 -- # trap cleanup EXIT SIGTERM SIGINT 00:05:03.573 03:21:44 -- event/cpu_locks.sh@166 -- # run_test default_locks default_locks 00:05:03.573 03:21:44 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:03.573 03:21:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:03.573 03:21:44 -- common/autotest_common.sh@10 -- # set +x 00:05:03.573 ************************************ 00:05:03.573 START TEST default_locks 00:05:03.573 ************************************ 00:05:03.573 03:21:44 -- common/autotest_common.sh@1114 -- # default_locks 00:05:03.573 03:21:44 -- event/cpu_locks.sh@46 -- # spdk_tgt_pid=2935666 00:05:03.573 03:21:44 -- event/cpu_locks.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:05:03.573 03:21:44 -- event/cpu_locks.sh@47 -- # waitforlisten 2935666 00:05:03.573 03:21:44 -- common/autotest_common.sh@829 -- # '[' -z 2935666 ']' 00:05:03.573 03:21:44 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:03.573 03:21:44 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:03.573 03:21:44 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:03.573 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:03.573 03:21:44 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:03.573 03:21:44 -- common/autotest_common.sh@10 -- # set +x 00:05:03.573 [2024-11-21 03:21:44.064561] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:03.573 [2024-11-21 03:21:44.064648] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2935666 ] 00:05:03.573 EAL: No free 2048 kB hugepages reported on node 1 00:05:03.573 [2024-11-21 03:21:44.124054] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:03.833 [2024-11-21 03:21:44.234286] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:03.833 [2024-11-21 03:21:44.234448] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:04.404 03:21:45 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:04.404 03:21:45 -- common/autotest_common.sh@862 -- # return 0 00:05:04.404 03:21:45 -- event/cpu_locks.sh@49 -- # locks_exist 2935666 00:05:04.404 03:21:45 -- event/cpu_locks.sh@22 -- # lslocks -p 2935666 00:05:04.404 03:21:45 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:04.974 lslocks: write error 00:05:04.974 03:21:45 -- event/cpu_locks.sh@50 -- # killprocess 2935666 00:05:04.974 03:21:45 -- common/autotest_common.sh@936 -- # '[' -z 2935666 ']' 00:05:04.974 03:21:45 -- common/autotest_common.sh@940 -- # kill -0 2935666 00:05:04.974 03:21:45 -- common/autotest_common.sh@941 -- # uname 00:05:04.974 03:21:45 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:04.974 03:21:45 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2935666 00:05:04.974 03:21:45 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:04.974 03:21:45 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:04.974 03:21:45 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2935666' 00:05:04.974 killing process with pid 2935666 00:05:04.974 03:21:45 -- common/autotest_common.sh@955 -- # kill 2935666 00:05:04.974 03:21:45 -- common/autotest_common.sh@960 -- # wait 2935666 00:05:05.235 03:21:45 -- event/cpu_locks.sh@52 -- # NOT waitforlisten 2935666 00:05:05.235 03:21:45 -- common/autotest_common.sh@650 -- # local es=0 00:05:05.235 03:21:45 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 2935666 00:05:05.235 03:21:45 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:05:05.235 03:21:45 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:05.235 03:21:45 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:05:05.235 03:21:45 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:05.235 03:21:45 -- common/autotest_common.sh@653 -- # waitforlisten 2935666 00:05:05.235 03:21:45 -- common/autotest_common.sh@829 -- # '[' -z 2935666 ']' 00:05:05.235 03:21:45 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:05.235 03:21:45 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:05.235 03:21:45 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:05.235 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:05.235 03:21:45 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:05.235 03:21:45 -- common/autotest_common.sh@10 -- # set +x 00:05:05.235 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (2935666) - No such process 00:05:05.235 ERROR: process (pid: 2935666) is no longer running 00:05:05.235 03:21:45 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:05.235 03:21:45 -- common/autotest_common.sh@862 -- # return 1 00:05:05.235 03:21:45 -- common/autotest_common.sh@653 -- # es=1 00:05:05.235 03:21:45 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:05.235 03:21:45 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:05.235 03:21:45 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:05.235 03:21:45 -- event/cpu_locks.sh@54 -- # no_locks 00:05:05.235 03:21:45 -- event/cpu_locks.sh@26 -- # lock_files=() 00:05:05.235 03:21:45 -- event/cpu_locks.sh@26 -- # local lock_files 00:05:05.235 03:21:45 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:05:05.235 00:05:05.235 real 0m1.813s 00:05:05.235 user 0m1.958s 00:05:05.235 sys 0m0.543s 00:05:05.235 03:21:45 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:05.235 03:21:45 -- common/autotest_common.sh@10 -- # set +x 00:05:05.235 ************************************ 00:05:05.235 END TEST default_locks 00:05:05.235 ************************************ 00:05:05.235 03:21:45 -- event/cpu_locks.sh@167 -- # run_test default_locks_via_rpc default_locks_via_rpc 00:05:05.235 03:21:45 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:05.235 03:21:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:05.235 03:21:45 -- common/autotest_common.sh@10 -- # set +x 00:05:05.235 ************************************ 00:05:05.235 START TEST default_locks_via_rpc 00:05:05.235 ************************************ 00:05:05.235 03:21:45 -- common/autotest_common.sh@1114 -- # default_locks_via_rpc 00:05:05.235 03:21:45 -- event/cpu_locks.sh@62 -- # spdk_tgt_pid=2935844 00:05:05.235 03:21:45 -- event/cpu_locks.sh@63 -- # waitforlisten 2935844 00:05:05.235 03:21:45 -- event/cpu_locks.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:05:05.235 03:21:45 -- common/autotest_common.sh@829 -- # '[' -z 2935844 ']' 00:05:05.235 03:21:45 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:05.235 03:21:45 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:05.235 03:21:45 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:05.235 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:05.235 03:21:45 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:05.235 03:21:45 -- common/autotest_common.sh@10 -- # set +x 00:05:05.495 [2024-11-21 03:21:45.904145] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:05.495 [2024-11-21 03:21:45.904238] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2935844 ] 00:05:05.495 EAL: No free 2048 kB hugepages reported on node 1 00:05:05.495 [2024-11-21 03:21:45.961855] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:05.496 [2024-11-21 03:21:46.069022] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:05.496 [2024-11-21 03:21:46.069254] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:06.436 03:21:46 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:06.436 03:21:46 -- common/autotest_common.sh@862 -- # return 0 00:05:06.436 03:21:46 -- event/cpu_locks.sh@65 -- # rpc_cmd framework_disable_cpumask_locks 00:05:06.436 03:21:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:06.436 03:21:46 -- common/autotest_common.sh@10 -- # set +x 00:05:06.436 03:21:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:06.436 03:21:46 -- event/cpu_locks.sh@67 -- # no_locks 00:05:06.436 03:21:46 -- event/cpu_locks.sh@26 -- # lock_files=() 00:05:06.436 03:21:46 -- event/cpu_locks.sh@26 -- # local lock_files 00:05:06.436 03:21:46 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:05:06.436 03:21:46 -- event/cpu_locks.sh@69 -- # rpc_cmd framework_enable_cpumask_locks 00:05:06.436 03:21:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:06.436 03:21:46 -- common/autotest_common.sh@10 -- # set +x 00:05:06.436 03:21:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:06.436 03:21:46 -- event/cpu_locks.sh@71 -- # locks_exist 2935844 00:05:06.436 03:21:46 -- event/cpu_locks.sh@22 -- # lslocks -p 2935844 00:05:06.436 03:21:46 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:06.695 03:21:47 -- event/cpu_locks.sh@73 -- # killprocess 2935844 00:05:06.695 03:21:47 -- common/autotest_common.sh@936 -- # '[' -z 2935844 ']' 00:05:06.695 03:21:47 -- common/autotest_common.sh@940 -- # kill -0 2935844 00:05:06.695 03:21:47 -- common/autotest_common.sh@941 -- # uname 00:05:06.695 03:21:47 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:06.695 03:21:47 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2935844 00:05:06.695 03:21:47 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:06.695 03:21:47 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:06.695 03:21:47 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2935844' 00:05:06.695 killing process with pid 2935844 00:05:06.695 03:21:47 -- common/autotest_common.sh@955 -- # kill 2935844 00:05:06.695 03:21:47 -- common/autotest_common.sh@960 -- # wait 2935844 00:05:06.955 00:05:06.955 real 0m1.732s 00:05:06.955 user 0m1.895s 00:05:06.955 sys 0m0.526s 00:05:06.955 03:21:47 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:06.955 03:21:47 -- common/autotest_common.sh@10 -- # set +x 00:05:06.955 ************************************ 00:05:06.955 END TEST default_locks_via_rpc 00:05:06.955 ************************************ 00:05:07.216 03:21:47 -- event/cpu_locks.sh@168 -- # run_test non_locking_app_on_locked_coremask non_locking_app_on_locked_coremask 00:05:07.216 03:21:47 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:07.216 03:21:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:07.216 03:21:47 -- common/autotest_common.sh@10 -- # set +x 00:05:07.216 ************************************ 00:05:07.216 START TEST non_locking_app_on_locked_coremask 00:05:07.216 ************************************ 00:05:07.216 03:21:47 -- common/autotest_common.sh@1114 -- # non_locking_app_on_locked_coremask 00:05:07.216 03:21:47 -- event/cpu_locks.sh@80 -- # spdk_tgt_pid=2936145 00:05:07.216 03:21:47 -- event/cpu_locks.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:05:07.216 03:21:47 -- event/cpu_locks.sh@81 -- # waitforlisten 2936145 /var/tmp/spdk.sock 00:05:07.216 03:21:47 -- common/autotest_common.sh@829 -- # '[' -z 2936145 ']' 00:05:07.216 03:21:47 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:07.216 03:21:47 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:07.216 03:21:47 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:07.216 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:07.216 03:21:47 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:07.216 03:21:47 -- common/autotest_common.sh@10 -- # set +x 00:05:07.216 [2024-11-21 03:21:47.658627] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:07.216 [2024-11-21 03:21:47.658717] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2936145 ] 00:05:07.216 EAL: No free 2048 kB hugepages reported on node 1 00:05:07.216 [2024-11-21 03:21:47.715749] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:07.216 [2024-11-21 03:21:47.824900] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:07.216 [2024-11-21 03:21:47.825083] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:08.154 03:21:48 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:08.154 03:21:48 -- common/autotest_common.sh@862 -- # return 0 00:05:08.154 03:21:48 -- event/cpu_locks.sh@84 -- # spdk_tgt_pid2=2936285 00:05:08.154 03:21:48 -- event/cpu_locks.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks -r /var/tmp/spdk2.sock 00:05:08.154 03:21:48 -- event/cpu_locks.sh@85 -- # waitforlisten 2936285 /var/tmp/spdk2.sock 00:05:08.154 03:21:48 -- common/autotest_common.sh@829 -- # '[' -z 2936285 ']' 00:05:08.154 03:21:48 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:08.154 03:21:48 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:08.154 03:21:48 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:08.154 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:08.154 03:21:48 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:08.154 03:21:48 -- common/autotest_common.sh@10 -- # set +x 00:05:08.154 [2024-11-21 03:21:48.669575] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:08.154 [2024-11-21 03:21:48.669650] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2936285 ] 00:05:08.154 EAL: No free 2048 kB hugepages reported on node 1 00:05:08.155 [2024-11-21 03:21:48.758997] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:08.155 [2024-11-21 03:21:48.759030] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:08.414 [2024-11-21 03:21:48.990847] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:08.414 [2024-11-21 03:21:48.991029] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:08.981 03:21:49 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:08.981 03:21:49 -- common/autotest_common.sh@862 -- # return 0 00:05:08.981 03:21:49 -- event/cpu_locks.sh@87 -- # locks_exist 2936145 00:05:08.981 03:21:49 -- event/cpu_locks.sh@22 -- # lslocks -p 2936145 00:05:08.981 03:21:49 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:09.548 lslocks: write error 00:05:09.549 03:21:49 -- event/cpu_locks.sh@89 -- # killprocess 2936145 00:05:09.549 03:21:49 -- common/autotest_common.sh@936 -- # '[' -z 2936145 ']' 00:05:09.549 03:21:49 -- common/autotest_common.sh@940 -- # kill -0 2936145 00:05:09.549 03:21:49 -- common/autotest_common.sh@941 -- # uname 00:05:09.549 03:21:49 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:09.549 03:21:49 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2936145 00:05:09.549 03:21:50 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:09.549 03:21:50 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:09.549 03:21:50 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2936145' 00:05:09.549 killing process with pid 2936145 00:05:09.549 03:21:50 -- common/autotest_common.sh@955 -- # kill 2936145 00:05:09.549 03:21:50 -- common/autotest_common.sh@960 -- # wait 2936145 00:05:10.486 03:21:50 -- event/cpu_locks.sh@90 -- # killprocess 2936285 00:05:10.486 03:21:50 -- common/autotest_common.sh@936 -- # '[' -z 2936285 ']' 00:05:10.486 03:21:50 -- common/autotest_common.sh@940 -- # kill -0 2936285 00:05:10.486 03:21:50 -- common/autotest_common.sh@941 -- # uname 00:05:10.486 03:21:50 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:10.486 03:21:50 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2936285 00:05:10.486 03:21:50 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:10.486 03:21:50 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:10.486 03:21:50 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2936285' 00:05:10.486 killing process with pid 2936285 00:05:10.486 03:21:50 -- common/autotest_common.sh@955 -- # kill 2936285 00:05:10.486 03:21:50 -- common/autotest_common.sh@960 -- # wait 2936285 00:05:11.055 00:05:11.055 real 0m3.820s 00:05:11.055 user 0m4.209s 00:05:11.055 sys 0m1.029s 00:05:11.055 03:21:51 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:11.055 03:21:51 -- common/autotest_common.sh@10 -- # set +x 00:05:11.055 ************************************ 00:05:11.055 END TEST non_locking_app_on_locked_coremask 00:05:11.055 ************************************ 00:05:11.055 03:21:51 -- event/cpu_locks.sh@169 -- # run_test locking_app_on_unlocked_coremask locking_app_on_unlocked_coremask 00:05:11.055 03:21:51 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:11.055 03:21:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:11.055 03:21:51 -- common/autotest_common.sh@10 -- # set +x 00:05:11.055 ************************************ 00:05:11.055 START TEST locking_app_on_unlocked_coremask 00:05:11.055 ************************************ 00:05:11.055 03:21:51 -- common/autotest_common.sh@1114 -- # locking_app_on_unlocked_coremask 00:05:11.055 03:21:51 -- event/cpu_locks.sh@98 -- # spdk_tgt_pid=2936597 00:05:11.055 03:21:51 -- event/cpu_locks.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks 00:05:11.055 03:21:51 -- event/cpu_locks.sh@99 -- # waitforlisten 2936597 /var/tmp/spdk.sock 00:05:11.055 03:21:51 -- common/autotest_common.sh@829 -- # '[' -z 2936597 ']' 00:05:11.055 03:21:51 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:11.055 03:21:51 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:11.055 03:21:51 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:11.055 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:11.055 03:21:51 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:11.055 03:21:51 -- common/autotest_common.sh@10 -- # set +x 00:05:11.055 [2024-11-21 03:21:51.510633] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:11.055 [2024-11-21 03:21:51.510729] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2936597 ] 00:05:11.055 EAL: No free 2048 kB hugepages reported on node 1 00:05:11.055 [2024-11-21 03:21:51.571848] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:11.055 [2024-11-21 03:21:51.571903] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:11.055 [2024-11-21 03:21:51.683062] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:11.055 [2024-11-21 03:21:51.683265] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:11.989 03:21:52 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:11.989 03:21:52 -- common/autotest_common.sh@862 -- # return 0 00:05:11.989 03:21:52 -- event/cpu_locks.sh@102 -- # spdk_tgt_pid2=2936739 00:05:11.989 03:21:52 -- event/cpu_locks.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:05:11.989 03:21:52 -- event/cpu_locks.sh@103 -- # waitforlisten 2936739 /var/tmp/spdk2.sock 00:05:11.989 03:21:52 -- common/autotest_common.sh@829 -- # '[' -z 2936739 ']' 00:05:11.989 03:21:52 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:11.989 03:21:52 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:11.989 03:21:52 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:11.989 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:11.989 03:21:52 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:11.989 03:21:52 -- common/autotest_common.sh@10 -- # set +x 00:05:11.989 [2024-11-21 03:21:52.501557] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:11.989 [2024-11-21 03:21:52.501652] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2936739 ] 00:05:11.989 EAL: No free 2048 kB hugepages reported on node 1 00:05:11.989 [2024-11-21 03:21:52.597804] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:12.247 [2024-11-21 03:21:52.830517] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:12.247 [2024-11-21 03:21:52.830714] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:12.818 03:21:53 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:12.818 03:21:53 -- common/autotest_common.sh@862 -- # return 0 00:05:12.818 03:21:53 -- event/cpu_locks.sh@105 -- # locks_exist 2936739 00:05:12.818 03:21:53 -- event/cpu_locks.sh@22 -- # lslocks -p 2936739 00:05:12.818 03:21:53 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:13.384 lslocks: write error 00:05:13.384 03:21:53 -- event/cpu_locks.sh@107 -- # killprocess 2936597 00:05:13.384 03:21:53 -- common/autotest_common.sh@936 -- # '[' -z 2936597 ']' 00:05:13.384 03:21:53 -- common/autotest_common.sh@940 -- # kill -0 2936597 00:05:13.384 03:21:53 -- common/autotest_common.sh@941 -- # uname 00:05:13.384 03:21:53 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:13.384 03:21:53 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2936597 00:05:13.384 03:21:54 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:13.384 03:21:54 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:13.384 03:21:54 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2936597' 00:05:13.384 killing process with pid 2936597 00:05:13.384 03:21:54 -- common/autotest_common.sh@955 -- # kill 2936597 00:05:13.384 03:21:54 -- common/autotest_common.sh@960 -- # wait 2936597 00:05:14.324 03:21:54 -- event/cpu_locks.sh@108 -- # killprocess 2936739 00:05:14.324 03:21:54 -- common/autotest_common.sh@936 -- # '[' -z 2936739 ']' 00:05:14.324 03:21:54 -- common/autotest_common.sh@940 -- # kill -0 2936739 00:05:14.324 03:21:54 -- common/autotest_common.sh@941 -- # uname 00:05:14.324 03:21:54 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:14.324 03:21:54 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2936739 00:05:14.324 03:21:54 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:14.324 03:21:54 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:14.324 03:21:54 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2936739' 00:05:14.324 killing process with pid 2936739 00:05:14.324 03:21:54 -- common/autotest_common.sh@955 -- # kill 2936739 00:05:14.324 03:21:54 -- common/autotest_common.sh@960 -- # wait 2936739 00:05:14.891 00:05:14.891 real 0m3.954s 00:05:14.891 user 0m4.307s 00:05:14.891 sys 0m1.081s 00:05:14.891 03:21:55 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:14.891 03:21:55 -- common/autotest_common.sh@10 -- # set +x 00:05:14.891 ************************************ 00:05:14.891 END TEST locking_app_on_unlocked_coremask 00:05:14.891 ************************************ 00:05:14.891 03:21:55 -- event/cpu_locks.sh@170 -- # run_test locking_app_on_locked_coremask locking_app_on_locked_coremask 00:05:14.891 03:21:55 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:14.891 03:21:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:14.891 03:21:55 -- common/autotest_common.sh@10 -- # set +x 00:05:14.891 ************************************ 00:05:14.891 START TEST locking_app_on_locked_coremask 00:05:14.892 ************************************ 00:05:14.892 03:21:55 -- common/autotest_common.sh@1114 -- # locking_app_on_locked_coremask 00:05:14.892 03:21:55 -- event/cpu_locks.sh@115 -- # spdk_tgt_pid=2937180 00:05:14.892 03:21:55 -- event/cpu_locks.sh@114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:05:14.892 03:21:55 -- event/cpu_locks.sh@116 -- # waitforlisten 2937180 /var/tmp/spdk.sock 00:05:14.892 03:21:55 -- common/autotest_common.sh@829 -- # '[' -z 2937180 ']' 00:05:14.892 03:21:55 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:14.892 03:21:55 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:14.892 03:21:55 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:14.892 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:14.892 03:21:55 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:14.892 03:21:55 -- common/autotest_common.sh@10 -- # set +x 00:05:14.892 [2024-11-21 03:21:55.494595] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:14.892 [2024-11-21 03:21:55.494687] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2937180 ] 00:05:14.892 EAL: No free 2048 kB hugepages reported on node 1 00:05:15.151 [2024-11-21 03:21:55.552190] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:15.151 [2024-11-21 03:21:55.661304] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:15.151 [2024-11-21 03:21:55.661471] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:16.092 03:21:56 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:16.092 03:21:56 -- common/autotest_common.sh@862 -- # return 0 00:05:16.092 03:21:56 -- event/cpu_locks.sh@119 -- # spdk_tgt_pid2=2937319 00:05:16.092 03:21:56 -- event/cpu_locks.sh@120 -- # NOT waitforlisten 2937319 /var/tmp/spdk2.sock 00:05:16.092 03:21:56 -- common/autotest_common.sh@650 -- # local es=0 00:05:16.092 03:21:56 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 2937319 /var/tmp/spdk2.sock 00:05:16.092 03:21:56 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:05:16.092 03:21:56 -- event/cpu_locks.sh@118 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:05:16.092 03:21:56 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:16.092 03:21:56 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:05:16.092 03:21:56 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:16.092 03:21:56 -- common/autotest_common.sh@653 -- # waitforlisten 2937319 /var/tmp/spdk2.sock 00:05:16.092 03:21:56 -- common/autotest_common.sh@829 -- # '[' -z 2937319 ']' 00:05:16.092 03:21:56 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:16.092 03:21:56 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:16.092 03:21:56 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:16.092 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:16.092 03:21:56 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:16.092 03:21:56 -- common/autotest_common.sh@10 -- # set +x 00:05:16.092 [2024-11-21 03:21:56.515110] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:16.092 [2024-11-21 03:21:56.515206] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2937319 ] 00:05:16.092 EAL: No free 2048 kB hugepages reported on node 1 00:05:16.092 [2024-11-21 03:21:56.612252] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 0, probably process 2937180 has claimed it. 00:05:16.092 [2024-11-21 03:21:56.612322] app.c: 791:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:05:16.684 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (2937319) - No such process 00:05:16.684 ERROR: process (pid: 2937319) is no longer running 00:05:16.684 03:21:57 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:16.684 03:21:57 -- common/autotest_common.sh@862 -- # return 1 00:05:16.684 03:21:57 -- common/autotest_common.sh@653 -- # es=1 00:05:16.684 03:21:57 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:16.684 03:21:57 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:16.684 03:21:57 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:16.684 03:21:57 -- event/cpu_locks.sh@122 -- # locks_exist 2937180 00:05:16.684 03:21:57 -- event/cpu_locks.sh@22 -- # lslocks -p 2937180 00:05:16.684 03:21:57 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:16.942 lslocks: write error 00:05:16.942 03:21:57 -- event/cpu_locks.sh@124 -- # killprocess 2937180 00:05:16.942 03:21:57 -- common/autotest_common.sh@936 -- # '[' -z 2937180 ']' 00:05:16.942 03:21:57 -- common/autotest_common.sh@940 -- # kill -0 2937180 00:05:16.942 03:21:57 -- common/autotest_common.sh@941 -- # uname 00:05:16.942 03:21:57 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:16.942 03:21:57 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2937180 00:05:16.942 03:21:57 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:16.942 03:21:57 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:16.942 03:21:57 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2937180' 00:05:16.942 killing process with pid 2937180 00:05:16.942 03:21:57 -- common/autotest_common.sh@955 -- # kill 2937180 00:05:16.942 03:21:57 -- common/autotest_common.sh@960 -- # wait 2937180 00:05:17.510 00:05:17.510 real 0m2.578s 00:05:17.510 user 0m2.943s 00:05:17.510 sys 0m0.688s 00:05:17.510 03:21:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:17.510 03:21:58 -- common/autotest_common.sh@10 -- # set +x 00:05:17.510 ************************************ 00:05:17.510 END TEST locking_app_on_locked_coremask 00:05:17.510 ************************************ 00:05:17.510 03:21:58 -- event/cpu_locks.sh@171 -- # run_test locking_overlapped_coremask locking_overlapped_coremask 00:05:17.510 03:21:58 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:17.510 03:21:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:17.510 03:21:58 -- common/autotest_common.sh@10 -- # set +x 00:05:17.510 ************************************ 00:05:17.510 START TEST locking_overlapped_coremask 00:05:17.510 ************************************ 00:05:17.510 03:21:58 -- common/autotest_common.sh@1114 -- # locking_overlapped_coremask 00:05:17.510 03:21:58 -- event/cpu_locks.sh@132 -- # spdk_tgt_pid=2937487 00:05:17.510 03:21:58 -- event/cpu_locks.sh@131 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 00:05:17.510 03:21:58 -- event/cpu_locks.sh@133 -- # waitforlisten 2937487 /var/tmp/spdk.sock 00:05:17.510 03:21:58 -- common/autotest_common.sh@829 -- # '[' -z 2937487 ']' 00:05:17.510 03:21:58 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:17.510 03:21:58 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:17.511 03:21:58 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:17.511 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:17.511 03:21:58 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:17.511 03:21:58 -- common/autotest_common.sh@10 -- # set +x 00:05:17.511 [2024-11-21 03:21:58.091893] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:17.511 [2024-11-21 03:21:58.091986] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2937487 ] 00:05:17.511 EAL: No free 2048 kB hugepages reported on node 1 00:05:17.511 [2024-11-21 03:21:58.149792] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:05:17.770 [2024-11-21 03:21:58.261457] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:17.770 [2024-11-21 03:21:58.261652] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:17.770 [2024-11-21 03:21:58.261712] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:17.770 [2024-11-21 03:21:58.261715] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:18.705 03:21:59 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:18.705 03:21:59 -- common/autotest_common.sh@862 -- # return 0 00:05:18.705 03:21:59 -- event/cpu_locks.sh@136 -- # spdk_tgt_pid2=2937631 00:05:18.705 03:21:59 -- event/cpu_locks.sh@137 -- # NOT waitforlisten 2937631 /var/tmp/spdk2.sock 00:05:18.705 03:21:59 -- common/autotest_common.sh@650 -- # local es=0 00:05:18.705 03:21:59 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 2937631 /var/tmp/spdk2.sock 00:05:18.705 03:21:59 -- event/cpu_locks.sh@135 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock 00:05:18.705 03:21:59 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:05:18.705 03:21:59 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:18.705 03:21:59 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:05:18.705 03:21:59 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:18.705 03:21:59 -- common/autotest_common.sh@653 -- # waitforlisten 2937631 /var/tmp/spdk2.sock 00:05:18.705 03:21:59 -- common/autotest_common.sh@829 -- # '[' -z 2937631 ']' 00:05:18.705 03:21:59 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:18.705 03:21:59 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:18.705 03:21:59 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:18.705 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:18.705 03:21:59 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:18.705 03:21:59 -- common/autotest_common.sh@10 -- # set +x 00:05:18.705 [2024-11-21 03:21:59.098185] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:18.705 [2024-11-21 03:21:59.098275] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2937631 ] 00:05:18.705 EAL: No free 2048 kB hugepages reported on node 1 00:05:18.705 [2024-11-21 03:21:59.186548] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 2937487 has claimed it. 00:05:18.705 [2024-11-21 03:21:59.186602] app.c: 791:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:05:19.272 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (2937631) - No such process 00:05:19.272 ERROR: process (pid: 2937631) is no longer running 00:05:19.272 03:21:59 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:19.272 03:21:59 -- common/autotest_common.sh@862 -- # return 1 00:05:19.272 03:21:59 -- common/autotest_common.sh@653 -- # es=1 00:05:19.272 03:21:59 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:19.272 03:21:59 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:19.272 03:21:59 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:19.272 03:21:59 -- event/cpu_locks.sh@139 -- # check_remaining_locks 00:05:19.272 03:21:59 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:05:19.272 03:21:59 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:05:19.272 03:21:59 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:05:19.272 03:21:59 -- event/cpu_locks.sh@141 -- # killprocess 2937487 00:05:19.272 03:21:59 -- common/autotest_common.sh@936 -- # '[' -z 2937487 ']' 00:05:19.272 03:21:59 -- common/autotest_common.sh@940 -- # kill -0 2937487 00:05:19.272 03:21:59 -- common/autotest_common.sh@941 -- # uname 00:05:19.272 03:21:59 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:19.272 03:21:59 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2937487 00:05:19.272 03:21:59 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:19.272 03:21:59 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:19.272 03:21:59 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2937487' 00:05:19.272 killing process with pid 2937487 00:05:19.273 03:21:59 -- common/autotest_common.sh@955 -- # kill 2937487 00:05:19.273 03:21:59 -- common/autotest_common.sh@960 -- # wait 2937487 00:05:19.844 00:05:19.844 real 0m2.234s 00:05:19.844 user 0m6.292s 00:05:19.844 sys 0m0.505s 00:05:19.844 03:22:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:19.844 03:22:00 -- common/autotest_common.sh@10 -- # set +x 00:05:19.844 ************************************ 00:05:19.844 END TEST locking_overlapped_coremask 00:05:19.844 ************************************ 00:05:19.844 03:22:00 -- event/cpu_locks.sh@172 -- # run_test locking_overlapped_coremask_via_rpc locking_overlapped_coremask_via_rpc 00:05:19.844 03:22:00 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:19.844 03:22:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:19.844 03:22:00 -- common/autotest_common.sh@10 -- # set +x 00:05:19.844 ************************************ 00:05:19.844 START TEST locking_overlapped_coremask_via_rpc 00:05:19.844 ************************************ 00:05:19.844 03:22:00 -- common/autotest_common.sh@1114 -- # locking_overlapped_coremask_via_rpc 00:05:19.844 03:22:00 -- event/cpu_locks.sh@148 -- # spdk_tgt_pid=2937795 00:05:19.844 03:22:00 -- event/cpu_locks.sh@147 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 --disable-cpumask-locks 00:05:19.844 03:22:00 -- event/cpu_locks.sh@149 -- # waitforlisten 2937795 /var/tmp/spdk.sock 00:05:19.844 03:22:00 -- common/autotest_common.sh@829 -- # '[' -z 2937795 ']' 00:05:19.844 03:22:00 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:19.844 03:22:00 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:19.844 03:22:00 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:19.844 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:19.844 03:22:00 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:19.844 03:22:00 -- common/autotest_common.sh@10 -- # set +x 00:05:19.844 [2024-11-21 03:22:00.362312] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:19.844 [2024-11-21 03:22:00.362438] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2937795 ] 00:05:19.844 EAL: No free 2048 kB hugepages reported on node 1 00:05:19.844 [2024-11-21 03:22:00.420773] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:19.844 [2024-11-21 03:22:00.420814] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:05:20.103 [2024-11-21 03:22:00.531735] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:20.103 [2024-11-21 03:22:00.531953] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:20.103 [2024-11-21 03:22:00.532019] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:20.103 [2024-11-21 03:22:00.532022] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:21.040 03:22:01 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:21.040 03:22:01 -- common/autotest_common.sh@862 -- # return 0 00:05:21.040 03:22:01 -- event/cpu_locks.sh@152 -- # spdk_tgt_pid2=2937939 00:05:21.040 03:22:01 -- event/cpu_locks.sh@153 -- # waitforlisten 2937939 /var/tmp/spdk2.sock 00:05:21.040 03:22:01 -- common/autotest_common.sh@829 -- # '[' -z 2937939 ']' 00:05:21.040 03:22:01 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:21.040 03:22:01 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:21.040 03:22:01 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:21.040 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:21.040 03:22:01 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:21.040 03:22:01 -- event/cpu_locks.sh@151 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock --disable-cpumask-locks 00:05:21.040 03:22:01 -- common/autotest_common.sh@10 -- # set +x 00:05:21.040 [2024-11-21 03:22:01.365802] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:21.040 [2024-11-21 03:22:01.365880] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2937939 ] 00:05:21.040 EAL: No free 2048 kB hugepages reported on node 1 00:05:21.040 [2024-11-21 03:22:01.451437] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:21.040 [2024-11-21 03:22:01.451472] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:05:21.040 [2024-11-21 03:22:01.667804] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:21.040 [2024-11-21 03:22:01.668053] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:05:21.040 [2024-11-21 03:22:01.671106] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:05:21.040 [2024-11-21 03:22:01.671108] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:21.974 03:22:02 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:21.974 03:22:02 -- common/autotest_common.sh@862 -- # return 0 00:05:21.974 03:22:02 -- event/cpu_locks.sh@155 -- # rpc_cmd framework_enable_cpumask_locks 00:05:21.974 03:22:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:21.974 03:22:02 -- common/autotest_common.sh@10 -- # set +x 00:05:21.974 03:22:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:21.974 03:22:02 -- event/cpu_locks.sh@156 -- # NOT rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:05:21.974 03:22:02 -- common/autotest_common.sh@650 -- # local es=0 00:05:21.974 03:22:02 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:05:21.974 03:22:02 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:05:21.975 03:22:02 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:21.975 03:22:02 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:05:21.975 03:22:02 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:21.975 03:22:02 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:05:21.975 03:22:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:21.975 03:22:02 -- common/autotest_common.sh@10 -- # set +x 00:05:21.975 [2024-11-21 03:22:02.323168] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 2937795 has claimed it. 00:05:21.975 request: 00:05:21.975 { 00:05:21.975 "method": "framework_enable_cpumask_locks", 00:05:21.975 "req_id": 1 00:05:21.975 } 00:05:21.975 Got JSON-RPC error response 00:05:21.975 response: 00:05:21.975 { 00:05:21.975 "code": -32603, 00:05:21.975 "message": "Failed to claim CPU core: 2" 00:05:21.975 } 00:05:21.975 03:22:02 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:05:21.975 03:22:02 -- common/autotest_common.sh@653 -- # es=1 00:05:21.975 03:22:02 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:21.975 03:22:02 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:21.975 03:22:02 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:21.975 03:22:02 -- event/cpu_locks.sh@158 -- # waitforlisten 2937795 /var/tmp/spdk.sock 00:05:21.975 03:22:02 -- common/autotest_common.sh@829 -- # '[' -z 2937795 ']' 00:05:21.975 03:22:02 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:21.975 03:22:02 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:21.975 03:22:02 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:21.975 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:21.975 03:22:02 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:21.975 03:22:02 -- common/autotest_common.sh@10 -- # set +x 00:05:21.975 03:22:02 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:21.975 03:22:02 -- common/autotest_common.sh@862 -- # return 0 00:05:21.975 03:22:02 -- event/cpu_locks.sh@159 -- # waitforlisten 2937939 /var/tmp/spdk2.sock 00:05:21.975 03:22:02 -- common/autotest_common.sh@829 -- # '[' -z 2937939 ']' 00:05:21.975 03:22:02 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:21.975 03:22:02 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:21.975 03:22:02 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:21.975 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:21.975 03:22:02 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:21.975 03:22:02 -- common/autotest_common.sh@10 -- # set +x 00:05:22.233 03:22:02 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:22.233 03:22:02 -- common/autotest_common.sh@862 -- # return 0 00:05:22.233 03:22:02 -- event/cpu_locks.sh@161 -- # check_remaining_locks 00:05:22.233 03:22:02 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:05:22.233 03:22:02 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:05:22.233 03:22:02 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:05:22.233 00:05:22.233 real 0m2.516s 00:05:22.233 user 0m1.249s 00:05:22.233 sys 0m0.202s 00:05:22.233 03:22:02 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:22.233 03:22:02 -- common/autotest_common.sh@10 -- # set +x 00:05:22.233 ************************************ 00:05:22.233 END TEST locking_overlapped_coremask_via_rpc 00:05:22.233 ************************************ 00:05:22.233 03:22:02 -- event/cpu_locks.sh@174 -- # cleanup 00:05:22.233 03:22:02 -- event/cpu_locks.sh@15 -- # [[ -z 2937795 ]] 00:05:22.233 03:22:02 -- event/cpu_locks.sh@15 -- # killprocess 2937795 00:05:22.233 03:22:02 -- common/autotest_common.sh@936 -- # '[' -z 2937795 ']' 00:05:22.233 03:22:02 -- common/autotest_common.sh@940 -- # kill -0 2937795 00:05:22.233 03:22:02 -- common/autotest_common.sh@941 -- # uname 00:05:22.233 03:22:02 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:22.233 03:22:02 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2937795 00:05:22.491 03:22:02 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:22.491 03:22:02 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:22.491 03:22:02 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2937795' 00:05:22.491 killing process with pid 2937795 00:05:22.491 03:22:02 -- common/autotest_common.sh@955 -- # kill 2937795 00:05:22.491 03:22:02 -- common/autotest_common.sh@960 -- # wait 2937795 00:05:22.749 03:22:03 -- event/cpu_locks.sh@16 -- # [[ -z 2937939 ]] 00:05:22.749 03:22:03 -- event/cpu_locks.sh@16 -- # killprocess 2937939 00:05:22.749 03:22:03 -- common/autotest_common.sh@936 -- # '[' -z 2937939 ']' 00:05:22.749 03:22:03 -- common/autotest_common.sh@940 -- # kill -0 2937939 00:05:22.749 03:22:03 -- common/autotest_common.sh@941 -- # uname 00:05:22.749 03:22:03 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:22.749 03:22:03 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2937939 00:05:22.749 03:22:03 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:05:22.749 03:22:03 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:05:22.749 03:22:03 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2937939' 00:05:22.749 killing process with pid 2937939 00:05:22.749 03:22:03 -- common/autotest_common.sh@955 -- # kill 2937939 00:05:22.749 03:22:03 -- common/autotest_common.sh@960 -- # wait 2937939 00:05:23.316 03:22:03 -- event/cpu_locks.sh@18 -- # rm -f 00:05:23.316 03:22:03 -- event/cpu_locks.sh@1 -- # cleanup 00:05:23.316 03:22:03 -- event/cpu_locks.sh@15 -- # [[ -z 2937795 ]] 00:05:23.316 03:22:03 -- event/cpu_locks.sh@15 -- # killprocess 2937795 00:05:23.316 03:22:03 -- common/autotest_common.sh@936 -- # '[' -z 2937795 ']' 00:05:23.316 03:22:03 -- common/autotest_common.sh@940 -- # kill -0 2937795 00:05:23.316 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (2937795) - No such process 00:05:23.316 03:22:03 -- common/autotest_common.sh@963 -- # echo 'Process with pid 2937795 is not found' 00:05:23.316 Process with pid 2937795 is not found 00:05:23.316 03:22:03 -- event/cpu_locks.sh@16 -- # [[ -z 2937939 ]] 00:05:23.316 03:22:03 -- event/cpu_locks.sh@16 -- # killprocess 2937939 00:05:23.316 03:22:03 -- common/autotest_common.sh@936 -- # '[' -z 2937939 ']' 00:05:23.316 03:22:03 -- common/autotest_common.sh@940 -- # kill -0 2937939 00:05:23.316 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (2937939) - No such process 00:05:23.316 03:22:03 -- common/autotest_common.sh@963 -- # echo 'Process with pid 2937939 is not found' 00:05:23.316 Process with pid 2937939 is not found 00:05:23.316 03:22:03 -- event/cpu_locks.sh@18 -- # rm -f 00:05:23.316 00:05:23.316 real 0m19.946s 00:05:23.316 user 0m35.457s 00:05:23.316 sys 0m5.423s 00:05:23.316 03:22:03 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:23.316 03:22:03 -- common/autotest_common.sh@10 -- # set +x 00:05:23.316 ************************************ 00:05:23.316 END TEST cpu_locks 00:05:23.316 ************************************ 00:05:23.316 00:05:23.316 real 0m47.436s 00:05:23.316 user 1m30.467s 00:05:23.316 sys 0m9.362s 00:05:23.316 03:22:03 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:23.316 03:22:03 -- common/autotest_common.sh@10 -- # set +x 00:05:23.316 ************************************ 00:05:23.316 END TEST event 00:05:23.316 ************************************ 00:05:23.316 03:22:03 -- spdk/autotest.sh@175 -- # run_test thread /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:05:23.316 03:22:03 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:23.316 03:22:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:23.316 03:22:03 -- common/autotest_common.sh@10 -- # set +x 00:05:23.316 ************************************ 00:05:23.316 START TEST thread 00:05:23.316 ************************************ 00:05:23.316 03:22:03 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:05:23.316 * Looking for test storage... 00:05:23.316 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread 00:05:23.316 03:22:03 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:23.316 03:22:03 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:23.316 03:22:03 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:23.575 03:22:04 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:23.575 03:22:04 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:23.575 03:22:04 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:23.575 03:22:04 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:23.575 03:22:04 -- scripts/common.sh@335 -- # IFS=.-: 00:05:23.575 03:22:04 -- scripts/common.sh@335 -- # read -ra ver1 00:05:23.575 03:22:04 -- scripts/common.sh@336 -- # IFS=.-: 00:05:23.575 03:22:04 -- scripts/common.sh@336 -- # read -ra ver2 00:05:23.575 03:22:04 -- scripts/common.sh@337 -- # local 'op=<' 00:05:23.575 03:22:04 -- scripts/common.sh@339 -- # ver1_l=2 00:05:23.575 03:22:04 -- scripts/common.sh@340 -- # ver2_l=1 00:05:23.575 03:22:04 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:23.575 03:22:04 -- scripts/common.sh@343 -- # case "$op" in 00:05:23.575 03:22:04 -- scripts/common.sh@344 -- # : 1 00:05:23.575 03:22:04 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:23.575 03:22:04 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:23.575 03:22:04 -- scripts/common.sh@364 -- # decimal 1 00:05:23.575 03:22:04 -- scripts/common.sh@352 -- # local d=1 00:05:23.575 03:22:04 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:23.575 03:22:04 -- scripts/common.sh@354 -- # echo 1 00:05:23.575 03:22:04 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:23.575 03:22:04 -- scripts/common.sh@365 -- # decimal 2 00:05:23.575 03:22:04 -- scripts/common.sh@352 -- # local d=2 00:05:23.575 03:22:04 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:23.575 03:22:04 -- scripts/common.sh@354 -- # echo 2 00:05:23.575 03:22:04 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:23.575 03:22:04 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:23.575 03:22:04 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:23.575 03:22:04 -- scripts/common.sh@367 -- # return 0 00:05:23.575 03:22:04 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:23.575 03:22:04 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:23.575 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:23.575 --rc genhtml_branch_coverage=1 00:05:23.575 --rc genhtml_function_coverage=1 00:05:23.575 --rc genhtml_legend=1 00:05:23.575 --rc geninfo_all_blocks=1 00:05:23.575 --rc geninfo_unexecuted_blocks=1 00:05:23.575 00:05:23.575 ' 00:05:23.575 03:22:04 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:23.575 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:23.575 --rc genhtml_branch_coverage=1 00:05:23.575 --rc genhtml_function_coverage=1 00:05:23.575 --rc genhtml_legend=1 00:05:23.575 --rc geninfo_all_blocks=1 00:05:23.575 --rc geninfo_unexecuted_blocks=1 00:05:23.575 00:05:23.575 ' 00:05:23.575 03:22:04 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:23.575 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:23.575 --rc genhtml_branch_coverage=1 00:05:23.575 --rc genhtml_function_coverage=1 00:05:23.575 --rc genhtml_legend=1 00:05:23.575 --rc geninfo_all_blocks=1 00:05:23.575 --rc geninfo_unexecuted_blocks=1 00:05:23.575 00:05:23.575 ' 00:05:23.575 03:22:04 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:23.575 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:23.575 --rc genhtml_branch_coverage=1 00:05:23.575 --rc genhtml_function_coverage=1 00:05:23.575 --rc genhtml_legend=1 00:05:23.575 --rc geninfo_all_blocks=1 00:05:23.576 --rc geninfo_unexecuted_blocks=1 00:05:23.576 00:05:23.576 ' 00:05:23.576 03:22:04 -- thread/thread.sh@11 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:05:23.576 03:22:04 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:05:23.576 03:22:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:23.576 03:22:04 -- common/autotest_common.sh@10 -- # set +x 00:05:23.576 ************************************ 00:05:23.576 START TEST thread_poller_perf 00:05:23.576 ************************************ 00:05:23.576 03:22:04 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:05:23.576 [2024-11-21 03:22:04.042260] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:23.576 [2024-11-21 03:22:04.042345] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2938317 ] 00:05:23.576 EAL: No free 2048 kB hugepages reported on node 1 00:05:23.576 [2024-11-21 03:22:04.106757] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:23.836 [2024-11-21 03:22:04.222526] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:23.836 Running 1000 pollers for 1 seconds with 1 microseconds period. 00:05:24.775 [2024-11-21T02:22:05.423Z] ====================================== 00:05:24.775 [2024-11-21T02:22:05.423Z] busy:2716038206 (cyc) 00:05:24.775 [2024-11-21T02:22:05.423Z] total_run_count: 286000 00:05:24.775 [2024-11-21T02:22:05.423Z] tsc_hz: 2700000000 (cyc) 00:05:24.775 [2024-11-21T02:22:05.423Z] ====================================== 00:05:24.775 [2024-11-21T02:22:05.423Z] poller_cost: 9496 (cyc), 3517 (nsec) 00:05:24.775 00:05:24.775 real 0m1.323s 00:05:24.775 user 0m1.238s 00:05:24.775 sys 0m0.078s 00:05:24.775 03:22:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:24.775 03:22:05 -- common/autotest_common.sh@10 -- # set +x 00:05:24.775 ************************************ 00:05:24.775 END TEST thread_poller_perf 00:05:24.775 ************************************ 00:05:24.775 03:22:05 -- thread/thread.sh@12 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:05:24.775 03:22:05 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:05:24.775 03:22:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:24.775 03:22:05 -- common/autotest_common.sh@10 -- # set +x 00:05:24.775 ************************************ 00:05:24.775 START TEST thread_poller_perf 00:05:24.775 ************************************ 00:05:24.775 03:22:05 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:05:24.775 [2024-11-21 03:22:05.393480] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:24.775 [2024-11-21 03:22:05.393564] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2938560 ] 00:05:25.036 EAL: No free 2048 kB hugepages reported on node 1 00:05:25.036 [2024-11-21 03:22:05.456439] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:25.036 [2024-11-21 03:22:05.571813] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:25.036 Running 1000 pollers for 1 seconds with 0 microseconds period. 00:05:26.416 [2024-11-21T02:22:07.064Z] ====================================== 00:05:26.416 [2024-11-21T02:22:07.064Z] busy:2703469778 (cyc) 00:05:26.416 [2024-11-21T02:22:07.064Z] total_run_count: 3823000 00:05:26.416 [2024-11-21T02:22:07.064Z] tsc_hz: 2700000000 (cyc) 00:05:26.416 [2024-11-21T02:22:07.064Z] ====================================== 00:05:26.416 [2024-11-21T02:22:07.064Z] poller_cost: 707 (cyc), 261 (nsec) 00:05:26.416 00:05:26.416 real 0m1.309s 00:05:26.416 user 0m1.221s 00:05:26.416 sys 0m0.080s 00:05:26.416 03:22:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:26.416 03:22:06 -- common/autotest_common.sh@10 -- # set +x 00:05:26.416 ************************************ 00:05:26.416 END TEST thread_poller_perf 00:05:26.416 ************************************ 00:05:26.416 03:22:06 -- thread/thread.sh@17 -- # [[ y != \y ]] 00:05:26.416 00:05:26.416 real 0m2.839s 00:05:26.416 user 0m2.585s 00:05:26.416 sys 0m0.256s 00:05:26.416 03:22:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:26.416 03:22:06 -- common/autotest_common.sh@10 -- # set +x 00:05:26.416 ************************************ 00:05:26.416 END TEST thread 00:05:26.416 ************************************ 00:05:26.416 03:22:06 -- spdk/autotest.sh@176 -- # run_test accel /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:05:26.416 03:22:06 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:26.416 03:22:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:26.416 03:22:06 -- common/autotest_common.sh@10 -- # set +x 00:05:26.416 ************************************ 00:05:26.416 START TEST accel 00:05:26.416 ************************************ 00:05:26.416 03:22:06 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:05:26.416 * Looking for test storage... 00:05:26.416 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:05:26.416 03:22:06 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:26.416 03:22:06 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:26.416 03:22:06 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:26.416 03:22:06 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:26.416 03:22:06 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:26.416 03:22:06 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:26.416 03:22:06 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:26.417 03:22:06 -- scripts/common.sh@335 -- # IFS=.-: 00:05:26.417 03:22:06 -- scripts/common.sh@335 -- # read -ra ver1 00:05:26.417 03:22:06 -- scripts/common.sh@336 -- # IFS=.-: 00:05:26.417 03:22:06 -- scripts/common.sh@336 -- # read -ra ver2 00:05:26.417 03:22:06 -- scripts/common.sh@337 -- # local 'op=<' 00:05:26.417 03:22:06 -- scripts/common.sh@339 -- # ver1_l=2 00:05:26.417 03:22:06 -- scripts/common.sh@340 -- # ver2_l=1 00:05:26.417 03:22:06 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:26.417 03:22:06 -- scripts/common.sh@343 -- # case "$op" in 00:05:26.417 03:22:06 -- scripts/common.sh@344 -- # : 1 00:05:26.417 03:22:06 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:26.417 03:22:06 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:26.417 03:22:06 -- scripts/common.sh@364 -- # decimal 1 00:05:26.417 03:22:06 -- scripts/common.sh@352 -- # local d=1 00:05:26.417 03:22:06 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:26.417 03:22:06 -- scripts/common.sh@354 -- # echo 1 00:05:26.417 03:22:06 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:26.417 03:22:06 -- scripts/common.sh@365 -- # decimal 2 00:05:26.417 03:22:06 -- scripts/common.sh@352 -- # local d=2 00:05:26.417 03:22:06 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:26.417 03:22:06 -- scripts/common.sh@354 -- # echo 2 00:05:26.417 03:22:06 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:26.417 03:22:06 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:26.417 03:22:06 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:26.417 03:22:06 -- scripts/common.sh@367 -- # return 0 00:05:26.417 03:22:06 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:26.417 03:22:06 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:26.417 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:26.417 --rc genhtml_branch_coverage=1 00:05:26.417 --rc genhtml_function_coverage=1 00:05:26.417 --rc genhtml_legend=1 00:05:26.417 --rc geninfo_all_blocks=1 00:05:26.417 --rc geninfo_unexecuted_blocks=1 00:05:26.417 00:05:26.417 ' 00:05:26.417 03:22:06 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:26.417 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:26.417 --rc genhtml_branch_coverage=1 00:05:26.417 --rc genhtml_function_coverage=1 00:05:26.417 --rc genhtml_legend=1 00:05:26.417 --rc geninfo_all_blocks=1 00:05:26.417 --rc geninfo_unexecuted_blocks=1 00:05:26.417 00:05:26.417 ' 00:05:26.417 03:22:06 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:26.417 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:26.417 --rc genhtml_branch_coverage=1 00:05:26.417 --rc genhtml_function_coverage=1 00:05:26.417 --rc genhtml_legend=1 00:05:26.417 --rc geninfo_all_blocks=1 00:05:26.417 --rc geninfo_unexecuted_blocks=1 00:05:26.417 00:05:26.417 ' 00:05:26.417 03:22:06 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:26.417 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:26.417 --rc genhtml_branch_coverage=1 00:05:26.417 --rc genhtml_function_coverage=1 00:05:26.417 --rc genhtml_legend=1 00:05:26.417 --rc geninfo_all_blocks=1 00:05:26.417 --rc geninfo_unexecuted_blocks=1 00:05:26.417 00:05:26.417 ' 00:05:26.417 03:22:06 -- accel/accel.sh@73 -- # declare -A expected_opcs 00:05:26.417 03:22:06 -- accel/accel.sh@74 -- # get_expected_opcs 00:05:26.417 03:22:06 -- accel/accel.sh@57 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:05:26.417 03:22:06 -- accel/accel.sh@59 -- # spdk_tgt_pid=2938808 00:05:26.417 03:22:06 -- accel/accel.sh@60 -- # waitforlisten 2938808 00:05:26.417 03:22:06 -- common/autotest_common.sh@829 -- # '[' -z 2938808 ']' 00:05:26.417 03:22:06 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:26.417 03:22:06 -- accel/accel.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -c /dev/fd/63 00:05:26.417 03:22:06 -- accel/accel.sh@58 -- # build_accel_config 00:05:26.417 03:22:06 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:26.417 03:22:06 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:26.417 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:26.417 03:22:06 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:26.417 03:22:06 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:26.417 03:22:06 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:26.417 03:22:06 -- common/autotest_common.sh@10 -- # set +x 00:05:26.417 03:22:06 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:26.417 03:22:06 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:26.417 03:22:06 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:26.417 03:22:06 -- accel/accel.sh@41 -- # local IFS=, 00:05:26.417 03:22:06 -- accel/accel.sh@42 -- # jq -r . 00:05:26.417 [2024-11-21 03:22:06.924185] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:26.417 [2024-11-21 03:22:06.924281] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2938808 ] 00:05:26.417 EAL: No free 2048 kB hugepages reported on node 1 00:05:26.417 [2024-11-21 03:22:06.985504] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:26.676 [2024-11-21 03:22:07.100513] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:26.676 [2024-11-21 03:22:07.100727] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:27.615 03:22:07 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:27.615 03:22:07 -- common/autotest_common.sh@862 -- # return 0 00:05:27.615 03:22:07 -- accel/accel.sh@62 -- # exp_opcs=($($rpc_py accel_get_opc_assignments | jq -r ". | to_entries | map(\"\(.key)=\(.value)\") | .[]")) 00:05:27.615 03:22:07 -- accel/accel.sh@62 -- # rpc_cmd accel_get_opc_assignments 00:05:27.615 03:22:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:27.615 03:22:07 -- accel/accel.sh@62 -- # jq -r '. | to_entries | map("\(.key)=\(.value)") | .[]' 00:05:27.615 03:22:07 -- common/autotest_common.sh@10 -- # set +x 00:05:27.615 03:22:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:27.615 03:22:07 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:27.615 03:22:07 -- accel/accel.sh@64 -- # IFS== 00:05:27.615 03:22:07 -- accel/accel.sh@64 -- # read -r opc module 00:05:27.615 03:22:07 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:27.615 03:22:07 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:27.615 03:22:07 -- accel/accel.sh@64 -- # IFS== 00:05:27.615 03:22:07 -- accel/accel.sh@64 -- # read -r opc module 00:05:27.615 03:22:07 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:27.615 03:22:07 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:27.615 03:22:07 -- accel/accel.sh@64 -- # IFS== 00:05:27.615 03:22:07 -- accel/accel.sh@64 -- # read -r opc module 00:05:27.615 03:22:07 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:27.615 03:22:07 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:27.615 03:22:07 -- accel/accel.sh@64 -- # IFS== 00:05:27.615 03:22:07 -- accel/accel.sh@64 -- # read -r opc module 00:05:27.615 03:22:07 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:27.615 03:22:07 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:27.615 03:22:07 -- accel/accel.sh@64 -- # IFS== 00:05:27.615 03:22:07 -- accel/accel.sh@64 -- # read -r opc module 00:05:27.615 03:22:07 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:27.615 03:22:07 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:27.615 03:22:07 -- accel/accel.sh@64 -- # IFS== 00:05:27.615 03:22:07 -- accel/accel.sh@64 -- # read -r opc module 00:05:27.615 03:22:07 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:27.615 03:22:07 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:27.615 03:22:07 -- accel/accel.sh@64 -- # IFS== 00:05:27.615 03:22:07 -- accel/accel.sh@64 -- # read -r opc module 00:05:27.615 03:22:07 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:27.615 03:22:07 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:27.615 03:22:07 -- accel/accel.sh@64 -- # IFS== 00:05:27.615 03:22:07 -- accel/accel.sh@64 -- # read -r opc module 00:05:27.615 03:22:07 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:27.615 03:22:07 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:27.615 03:22:07 -- accel/accel.sh@64 -- # IFS== 00:05:27.615 03:22:07 -- accel/accel.sh@64 -- # read -r opc module 00:05:27.615 03:22:07 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:27.615 03:22:07 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:27.615 03:22:07 -- accel/accel.sh@64 -- # IFS== 00:05:27.615 03:22:07 -- accel/accel.sh@64 -- # read -r opc module 00:05:27.615 03:22:07 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:27.615 03:22:07 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:27.615 03:22:07 -- accel/accel.sh@64 -- # IFS== 00:05:27.615 03:22:07 -- accel/accel.sh@64 -- # read -r opc module 00:05:27.615 03:22:07 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:27.615 03:22:07 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:27.615 03:22:07 -- accel/accel.sh@64 -- # IFS== 00:05:27.615 03:22:07 -- accel/accel.sh@64 -- # read -r opc module 00:05:27.615 03:22:07 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:27.615 03:22:07 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:27.615 03:22:07 -- accel/accel.sh@64 -- # IFS== 00:05:27.615 03:22:07 -- accel/accel.sh@64 -- # read -r opc module 00:05:27.615 03:22:07 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:27.615 03:22:07 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:27.615 03:22:07 -- accel/accel.sh@64 -- # IFS== 00:05:27.615 03:22:07 -- accel/accel.sh@64 -- # read -r opc module 00:05:27.615 03:22:07 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:27.615 03:22:07 -- accel/accel.sh@67 -- # killprocess 2938808 00:05:27.615 03:22:07 -- common/autotest_common.sh@936 -- # '[' -z 2938808 ']' 00:05:27.615 03:22:07 -- common/autotest_common.sh@940 -- # kill -0 2938808 00:05:27.615 03:22:07 -- common/autotest_common.sh@941 -- # uname 00:05:27.615 03:22:07 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:27.615 03:22:07 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2938808 00:05:27.615 03:22:07 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:27.615 03:22:07 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:27.615 03:22:07 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2938808' 00:05:27.615 killing process with pid 2938808 00:05:27.615 03:22:07 -- common/autotest_common.sh@955 -- # kill 2938808 00:05:27.615 03:22:07 -- common/autotest_common.sh@960 -- # wait 2938808 00:05:27.875 03:22:08 -- accel/accel.sh@68 -- # trap - ERR 00:05:27.875 03:22:08 -- accel/accel.sh@81 -- # run_test accel_help accel_perf -h 00:05:27.875 03:22:08 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:05:27.875 03:22:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:27.875 03:22:08 -- common/autotest_common.sh@10 -- # set +x 00:05:27.875 03:22:08 -- common/autotest_common.sh@1114 -- # accel_perf -h 00:05:27.875 03:22:08 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -h 00:05:27.875 03:22:08 -- accel/accel.sh@12 -- # build_accel_config 00:05:27.875 03:22:08 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:27.875 03:22:08 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:27.875 03:22:08 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:27.875 03:22:08 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:27.875 03:22:08 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:27.875 03:22:08 -- accel/accel.sh@41 -- # local IFS=, 00:05:27.875 03:22:08 -- accel/accel.sh@42 -- # jq -r . 00:05:27.875 03:22:08 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:27.875 03:22:08 -- common/autotest_common.sh@10 -- # set +x 00:05:27.875 03:22:08 -- accel/accel.sh@83 -- # run_test accel_missing_filename NOT accel_perf -t 1 -w compress 00:05:27.875 03:22:08 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:27.875 03:22:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:27.875 03:22:08 -- common/autotest_common.sh@10 -- # set +x 00:05:27.875 ************************************ 00:05:27.875 START TEST accel_missing_filename 00:05:27.875 ************************************ 00:05:27.875 03:22:08 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w compress 00:05:27.875 03:22:08 -- common/autotest_common.sh@650 -- # local es=0 00:05:27.875 03:22:08 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w compress 00:05:27.875 03:22:08 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:05:27.875 03:22:08 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:27.875 03:22:08 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:05:27.875 03:22:08 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:27.875 03:22:08 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w compress 00:05:27.875 03:22:08 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress 00:05:27.875 03:22:08 -- accel/accel.sh@12 -- # build_accel_config 00:05:27.875 03:22:08 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:27.875 03:22:08 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:27.875 03:22:08 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:27.875 03:22:08 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:27.875 03:22:08 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:27.875 03:22:08 -- accel/accel.sh@41 -- # local IFS=, 00:05:27.875 03:22:08 -- accel/accel.sh@42 -- # jq -r . 00:05:28.133 [2024-11-21 03:22:08.524222] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:28.133 [2024-11-21 03:22:08.524300] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2938981 ] 00:05:28.133 EAL: No free 2048 kB hugepages reported on node 1 00:05:28.133 [2024-11-21 03:22:08.586979] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:28.133 [2024-11-21 03:22:08.704357] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:28.133 [2024-11-21 03:22:08.763485] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:05:28.394 [2024-11-21 03:22:08.840255] accel_perf.c:1385:main: *ERROR*: ERROR starting application 00:05:28.394 A filename is required. 00:05:28.394 03:22:08 -- common/autotest_common.sh@653 -- # es=234 00:05:28.394 03:22:08 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:28.394 03:22:08 -- common/autotest_common.sh@662 -- # es=106 00:05:28.394 03:22:08 -- common/autotest_common.sh@663 -- # case "$es" in 00:05:28.394 03:22:08 -- common/autotest_common.sh@670 -- # es=1 00:05:28.394 03:22:08 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:28.394 00:05:28.394 real 0m0.454s 00:05:28.394 user 0m0.355s 00:05:28.394 sys 0m0.130s 00:05:28.394 03:22:08 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:28.394 03:22:08 -- common/autotest_common.sh@10 -- # set +x 00:05:28.394 ************************************ 00:05:28.394 END TEST accel_missing_filename 00:05:28.394 ************************************ 00:05:28.394 03:22:08 -- accel/accel.sh@85 -- # run_test accel_compress_verify NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:28.394 03:22:08 -- common/autotest_common.sh@1087 -- # '[' 10 -le 1 ']' 00:05:28.394 03:22:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:28.394 03:22:08 -- common/autotest_common.sh@10 -- # set +x 00:05:28.394 ************************************ 00:05:28.394 START TEST accel_compress_verify 00:05:28.394 ************************************ 00:05:28.394 03:22:08 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:28.394 03:22:08 -- common/autotest_common.sh@650 -- # local es=0 00:05:28.394 03:22:08 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:28.394 03:22:08 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:05:28.394 03:22:08 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:28.394 03:22:08 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:05:28.394 03:22:08 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:28.394 03:22:08 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:28.394 03:22:08 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:28.394 03:22:08 -- accel/accel.sh@12 -- # build_accel_config 00:05:28.394 03:22:08 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:28.394 03:22:08 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:28.394 03:22:08 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:28.394 03:22:08 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:28.394 03:22:08 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:28.394 03:22:08 -- accel/accel.sh@41 -- # local IFS=, 00:05:28.394 03:22:08 -- accel/accel.sh@42 -- # jq -r . 00:05:28.394 [2024-11-21 03:22:09.003082] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:28.394 [2024-11-21 03:22:09.003180] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2939133 ] 00:05:28.394 EAL: No free 2048 kB hugepages reported on node 1 00:05:28.655 [2024-11-21 03:22:09.064663] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:28.655 [2024-11-21 03:22:09.181007] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:28.655 [2024-11-21 03:22:09.242798] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:05:28.913 [2024-11-21 03:22:09.327103] accel_perf.c:1385:main: *ERROR*: ERROR starting application 00:05:28.913 00:05:28.913 Compression does not support the verify option, aborting. 00:05:28.913 03:22:09 -- common/autotest_common.sh@653 -- # es=161 00:05:28.913 03:22:09 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:28.913 03:22:09 -- common/autotest_common.sh@662 -- # es=33 00:05:28.913 03:22:09 -- common/autotest_common.sh@663 -- # case "$es" in 00:05:28.913 03:22:09 -- common/autotest_common.sh@670 -- # es=1 00:05:28.913 03:22:09 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:28.913 00:05:28.913 real 0m0.468s 00:05:28.913 user 0m0.358s 00:05:28.913 sys 0m0.145s 00:05:28.913 03:22:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:28.913 03:22:09 -- common/autotest_common.sh@10 -- # set +x 00:05:28.913 ************************************ 00:05:28.913 END TEST accel_compress_verify 00:05:28.913 ************************************ 00:05:28.913 03:22:09 -- accel/accel.sh@87 -- # run_test accel_wrong_workload NOT accel_perf -t 1 -w foobar 00:05:28.913 03:22:09 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:28.913 03:22:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:28.913 03:22:09 -- common/autotest_common.sh@10 -- # set +x 00:05:28.913 ************************************ 00:05:28.913 START TEST accel_wrong_workload 00:05:28.913 ************************************ 00:05:28.913 03:22:09 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w foobar 00:05:28.913 03:22:09 -- common/autotest_common.sh@650 -- # local es=0 00:05:28.913 03:22:09 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w foobar 00:05:28.913 03:22:09 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:05:28.913 03:22:09 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:28.913 03:22:09 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:05:28.913 03:22:09 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:28.913 03:22:09 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w foobar 00:05:28.913 03:22:09 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w foobar 00:05:28.913 03:22:09 -- accel/accel.sh@12 -- # build_accel_config 00:05:28.913 03:22:09 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:28.913 03:22:09 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:28.913 03:22:09 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:28.913 03:22:09 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:28.913 03:22:09 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:28.913 03:22:09 -- accel/accel.sh@41 -- # local IFS=, 00:05:28.913 03:22:09 -- accel/accel.sh@42 -- # jq -r . 00:05:28.913 Unsupported workload type: foobar 00:05:28.913 [2024-11-21 03:22:09.492938] app.c:1292:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'w' failed: 1 00:05:28.913 accel_perf options: 00:05:28.913 [-h help message] 00:05:28.913 [-q queue depth per core] 00:05:28.913 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:05:28.913 [-T number of threads per core 00:05:28.913 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:05:28.913 [-t time in seconds] 00:05:28.913 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:05:28.913 [ dif_verify, , dif_generate, dif_generate_copy 00:05:28.913 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:05:28.913 [-l for compress/decompress workloads, name of uncompressed input file 00:05:28.913 [-S for crc32c workload, use this seed value (default 0) 00:05:28.913 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:05:28.913 [-f for fill workload, use this BYTE value (default 255) 00:05:28.913 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:05:28.913 [-y verify result if this switch is on] 00:05:28.913 [-a tasks to allocate per core (default: same value as -q)] 00:05:28.913 Can be used to spread operations across a wider range of memory. 00:05:28.913 03:22:09 -- common/autotest_common.sh@653 -- # es=1 00:05:28.913 03:22:09 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:28.913 03:22:09 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:28.913 03:22:09 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:28.913 00:05:28.913 real 0m0.023s 00:05:28.913 user 0m0.013s 00:05:28.913 sys 0m0.010s 00:05:28.913 03:22:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:28.913 03:22:09 -- common/autotest_common.sh@10 -- # set +x 00:05:28.913 ************************************ 00:05:28.913 END TEST accel_wrong_workload 00:05:28.913 ************************************ 00:05:28.913 Error: writing output failed: Broken pipe 00:05:28.914 03:22:09 -- accel/accel.sh@89 -- # run_test accel_negative_buffers NOT accel_perf -t 1 -w xor -y -x -1 00:05:28.914 03:22:09 -- common/autotest_common.sh@1087 -- # '[' 10 -le 1 ']' 00:05:28.914 03:22:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:28.914 03:22:09 -- common/autotest_common.sh@10 -- # set +x 00:05:28.914 ************************************ 00:05:28.914 START TEST accel_negative_buffers 00:05:28.914 ************************************ 00:05:28.914 03:22:09 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w xor -y -x -1 00:05:28.914 03:22:09 -- common/autotest_common.sh@650 -- # local es=0 00:05:28.914 03:22:09 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w xor -y -x -1 00:05:28.914 03:22:09 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:05:28.914 03:22:09 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:28.914 03:22:09 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:05:28.914 03:22:09 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:28.914 03:22:09 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w xor -y -x -1 00:05:28.914 03:22:09 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x -1 00:05:28.914 03:22:09 -- accel/accel.sh@12 -- # build_accel_config 00:05:28.914 03:22:09 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:28.914 03:22:09 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:28.914 03:22:09 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:28.914 03:22:09 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:28.914 03:22:09 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:28.914 03:22:09 -- accel/accel.sh@41 -- # local IFS=, 00:05:28.914 03:22:09 -- accel/accel.sh@42 -- # jq -r . 00:05:28.914 -x option must be non-negative. 00:05:28.914 [2024-11-21 03:22:09.538124] app.c:1292:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'x' failed: 1 00:05:28.914 accel_perf options: 00:05:28.914 [-h help message] 00:05:28.914 [-q queue depth per core] 00:05:28.914 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:05:28.914 [-T number of threads per core 00:05:28.914 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:05:28.914 [-t time in seconds] 00:05:28.914 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:05:28.914 [ dif_verify, , dif_generate, dif_generate_copy 00:05:28.914 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:05:28.914 [-l for compress/decompress workloads, name of uncompressed input file 00:05:28.914 [-S for crc32c workload, use this seed value (default 0) 00:05:28.914 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:05:28.914 [-f for fill workload, use this BYTE value (default 255) 00:05:28.914 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:05:28.914 [-y verify result if this switch is on] 00:05:28.914 [-a tasks to allocate per core (default: same value as -q)] 00:05:28.914 Can be used to spread operations across a wider range of memory. 00:05:28.914 03:22:09 -- common/autotest_common.sh@653 -- # es=1 00:05:28.914 03:22:09 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:28.914 03:22:09 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:28.914 03:22:09 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:28.914 00:05:28.914 real 0m0.019s 00:05:28.914 user 0m0.011s 00:05:28.914 sys 0m0.008s 00:05:28.914 03:22:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:28.914 03:22:09 -- common/autotest_common.sh@10 -- # set +x 00:05:28.914 ************************************ 00:05:28.914 END TEST accel_negative_buffers 00:05:28.914 ************************************ 00:05:29.173 03:22:09 -- accel/accel.sh@93 -- # run_test accel_crc32c accel_test -t 1 -w crc32c -S 32 -y 00:05:29.173 03:22:09 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:05:29.173 03:22:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:29.173 03:22:09 -- common/autotest_common.sh@10 -- # set +x 00:05:29.173 Error: writing output failed: Broken pipe 00:05:29.173 ************************************ 00:05:29.173 START TEST accel_crc32c 00:05:29.173 ************************************ 00:05:29.173 03:22:09 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w crc32c -S 32 -y 00:05:29.173 03:22:09 -- accel/accel.sh@16 -- # local accel_opc 00:05:29.173 03:22:09 -- accel/accel.sh@17 -- # local accel_module 00:05:29.173 03:22:09 -- accel/accel.sh@18 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:05:29.173 03:22:09 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:05:29.173 03:22:09 -- accel/accel.sh@12 -- # build_accel_config 00:05:29.173 03:22:09 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:29.173 03:22:09 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:29.173 03:22:09 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:29.173 03:22:09 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:29.173 03:22:09 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:29.173 03:22:09 -- accel/accel.sh@41 -- # local IFS=, 00:05:29.173 03:22:09 -- accel/accel.sh@42 -- # jq -r . 00:05:29.173 [2024-11-21 03:22:09.579185] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:29.173 [2024-11-21 03:22:09.579240] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2939193 ] 00:05:29.173 EAL: No free 2048 kB hugepages reported on node 1 00:05:29.173 [2024-11-21 03:22:09.640984] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:29.173 [2024-11-21 03:22:09.757772] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:30.553 03:22:11 -- accel/accel.sh@18 -- # out=' 00:05:30.553 SPDK Configuration: 00:05:30.553 Core mask: 0x1 00:05:30.553 00:05:30.553 Accel Perf Configuration: 00:05:30.553 Workload Type: crc32c 00:05:30.553 CRC-32C seed: 32 00:05:30.553 Transfer size: 4096 bytes 00:05:30.553 Vector count 1 00:05:30.553 Module: software 00:05:30.553 Queue depth: 32 00:05:30.553 Allocate depth: 32 00:05:30.553 # threads/core: 1 00:05:30.553 Run time: 1 seconds 00:05:30.553 Verify: Yes 00:05:30.553 00:05:30.553 Running for 1 seconds... 00:05:30.553 00:05:30.553 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:30.553 ------------------------------------------------------------------------------------ 00:05:30.553 0,0 411008/s 1605 MiB/s 0 0 00:05:30.553 ==================================================================================== 00:05:30.553 Total 411008/s 1605 MiB/s 0 0' 00:05:30.553 03:22:11 -- accel/accel.sh@20 -- # IFS=: 00:05:30.554 03:22:11 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:05:30.554 03:22:11 -- accel/accel.sh@20 -- # read -r var val 00:05:30.554 03:22:11 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:05:30.554 03:22:11 -- accel/accel.sh@12 -- # build_accel_config 00:05:30.554 03:22:11 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:30.554 03:22:11 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:30.554 03:22:11 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:30.554 03:22:11 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:30.554 03:22:11 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:30.554 03:22:11 -- accel/accel.sh@41 -- # local IFS=, 00:05:30.554 03:22:11 -- accel/accel.sh@42 -- # jq -r . 00:05:30.554 [2024-11-21 03:22:11.049312] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:30.554 [2024-11-21 03:22:11.049418] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2939395 ] 00:05:30.554 EAL: No free 2048 kB hugepages reported on node 1 00:05:30.554 [2024-11-21 03:22:11.116137] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:30.814 [2024-11-21 03:22:11.235880] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:30.814 03:22:11 -- accel/accel.sh@21 -- # val= 00:05:30.814 03:22:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.814 03:22:11 -- accel/accel.sh@20 -- # IFS=: 00:05:30.814 03:22:11 -- accel/accel.sh@20 -- # read -r var val 00:05:30.814 03:22:11 -- accel/accel.sh@21 -- # val= 00:05:30.814 03:22:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.814 03:22:11 -- accel/accel.sh@20 -- # IFS=: 00:05:30.814 03:22:11 -- accel/accel.sh@20 -- # read -r var val 00:05:30.814 03:22:11 -- accel/accel.sh@21 -- # val=0x1 00:05:30.814 03:22:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.814 03:22:11 -- accel/accel.sh@20 -- # IFS=: 00:05:30.814 03:22:11 -- accel/accel.sh@20 -- # read -r var val 00:05:30.814 03:22:11 -- accel/accel.sh@21 -- # val= 00:05:30.814 03:22:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.814 03:22:11 -- accel/accel.sh@20 -- # IFS=: 00:05:30.814 03:22:11 -- accel/accel.sh@20 -- # read -r var val 00:05:30.814 03:22:11 -- accel/accel.sh@21 -- # val= 00:05:30.814 03:22:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.814 03:22:11 -- accel/accel.sh@20 -- # IFS=: 00:05:30.814 03:22:11 -- accel/accel.sh@20 -- # read -r var val 00:05:30.814 03:22:11 -- accel/accel.sh@21 -- # val=crc32c 00:05:30.814 03:22:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.814 03:22:11 -- accel/accel.sh@24 -- # accel_opc=crc32c 00:05:30.814 03:22:11 -- accel/accel.sh@20 -- # IFS=: 00:05:30.814 03:22:11 -- accel/accel.sh@20 -- # read -r var val 00:05:30.814 03:22:11 -- accel/accel.sh@21 -- # val=32 00:05:30.814 03:22:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.814 03:22:11 -- accel/accel.sh@20 -- # IFS=: 00:05:30.814 03:22:11 -- accel/accel.sh@20 -- # read -r var val 00:05:30.814 03:22:11 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:30.814 03:22:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.814 03:22:11 -- accel/accel.sh@20 -- # IFS=: 00:05:30.814 03:22:11 -- accel/accel.sh@20 -- # read -r var val 00:05:30.814 03:22:11 -- accel/accel.sh@21 -- # val= 00:05:30.814 03:22:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.814 03:22:11 -- accel/accel.sh@20 -- # IFS=: 00:05:30.814 03:22:11 -- accel/accel.sh@20 -- # read -r var val 00:05:30.814 03:22:11 -- accel/accel.sh@21 -- # val=software 00:05:30.814 03:22:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.814 03:22:11 -- accel/accel.sh@23 -- # accel_module=software 00:05:30.814 03:22:11 -- accel/accel.sh@20 -- # IFS=: 00:05:30.814 03:22:11 -- accel/accel.sh@20 -- # read -r var val 00:05:30.814 03:22:11 -- accel/accel.sh@21 -- # val=32 00:05:30.814 03:22:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.814 03:22:11 -- accel/accel.sh@20 -- # IFS=: 00:05:30.814 03:22:11 -- accel/accel.sh@20 -- # read -r var val 00:05:30.814 03:22:11 -- accel/accel.sh@21 -- # val=32 00:05:30.814 03:22:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.814 03:22:11 -- accel/accel.sh@20 -- # IFS=: 00:05:30.814 03:22:11 -- accel/accel.sh@20 -- # read -r var val 00:05:30.814 03:22:11 -- accel/accel.sh@21 -- # val=1 00:05:30.814 03:22:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.814 03:22:11 -- accel/accel.sh@20 -- # IFS=: 00:05:30.814 03:22:11 -- accel/accel.sh@20 -- # read -r var val 00:05:30.814 03:22:11 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:30.814 03:22:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.814 03:22:11 -- accel/accel.sh@20 -- # IFS=: 00:05:30.814 03:22:11 -- accel/accel.sh@20 -- # read -r var val 00:05:30.814 03:22:11 -- accel/accel.sh@21 -- # val=Yes 00:05:30.814 03:22:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.814 03:22:11 -- accel/accel.sh@20 -- # IFS=: 00:05:30.814 03:22:11 -- accel/accel.sh@20 -- # read -r var val 00:05:30.814 03:22:11 -- accel/accel.sh@21 -- # val= 00:05:30.814 03:22:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.814 03:22:11 -- accel/accel.sh@20 -- # IFS=: 00:05:30.814 03:22:11 -- accel/accel.sh@20 -- # read -r var val 00:05:30.814 03:22:11 -- accel/accel.sh@21 -- # val= 00:05:30.814 03:22:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:30.814 03:22:11 -- accel/accel.sh@20 -- # IFS=: 00:05:30.814 03:22:11 -- accel/accel.sh@20 -- # read -r var val 00:05:32.193 03:22:12 -- accel/accel.sh@21 -- # val= 00:05:32.193 03:22:12 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.193 03:22:12 -- accel/accel.sh@20 -- # IFS=: 00:05:32.193 03:22:12 -- accel/accel.sh@20 -- # read -r var val 00:05:32.193 03:22:12 -- accel/accel.sh@21 -- # val= 00:05:32.193 03:22:12 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.193 03:22:12 -- accel/accel.sh@20 -- # IFS=: 00:05:32.193 03:22:12 -- accel/accel.sh@20 -- # read -r var val 00:05:32.193 03:22:12 -- accel/accel.sh@21 -- # val= 00:05:32.193 03:22:12 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.193 03:22:12 -- accel/accel.sh@20 -- # IFS=: 00:05:32.193 03:22:12 -- accel/accel.sh@20 -- # read -r var val 00:05:32.193 03:22:12 -- accel/accel.sh@21 -- # val= 00:05:32.193 03:22:12 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.193 03:22:12 -- accel/accel.sh@20 -- # IFS=: 00:05:32.193 03:22:12 -- accel/accel.sh@20 -- # read -r var val 00:05:32.193 03:22:12 -- accel/accel.sh@21 -- # val= 00:05:32.193 03:22:12 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.193 03:22:12 -- accel/accel.sh@20 -- # IFS=: 00:05:32.194 03:22:12 -- accel/accel.sh@20 -- # read -r var val 00:05:32.194 03:22:12 -- accel/accel.sh@21 -- # val= 00:05:32.194 03:22:12 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.194 03:22:12 -- accel/accel.sh@20 -- # IFS=: 00:05:32.194 03:22:12 -- accel/accel.sh@20 -- # read -r var val 00:05:32.194 03:22:12 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:32.194 03:22:12 -- accel/accel.sh@28 -- # [[ -n crc32c ]] 00:05:32.194 03:22:12 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:32.194 00:05:32.194 real 0m2.931s 00:05:32.194 user 0m2.644s 00:05:32.194 sys 0m0.278s 00:05:32.194 03:22:12 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:32.194 03:22:12 -- common/autotest_common.sh@10 -- # set +x 00:05:32.194 ************************************ 00:05:32.194 END TEST accel_crc32c 00:05:32.194 ************************************ 00:05:32.194 03:22:12 -- accel/accel.sh@94 -- # run_test accel_crc32c_C2 accel_test -t 1 -w crc32c -y -C 2 00:05:32.194 03:22:12 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:05:32.194 03:22:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:32.194 03:22:12 -- common/autotest_common.sh@10 -- # set +x 00:05:32.194 ************************************ 00:05:32.194 START TEST accel_crc32c_C2 00:05:32.194 ************************************ 00:05:32.194 03:22:12 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w crc32c -y -C 2 00:05:32.194 03:22:12 -- accel/accel.sh@16 -- # local accel_opc 00:05:32.194 03:22:12 -- accel/accel.sh@17 -- # local accel_module 00:05:32.194 03:22:12 -- accel/accel.sh@18 -- # accel_perf -t 1 -w crc32c -y -C 2 00:05:32.194 03:22:12 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:05:32.194 03:22:12 -- accel/accel.sh@12 -- # build_accel_config 00:05:32.194 03:22:12 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:32.194 03:22:12 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:32.194 03:22:12 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:32.194 03:22:12 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:32.194 03:22:12 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:32.194 03:22:12 -- accel/accel.sh@41 -- # local IFS=, 00:05:32.194 03:22:12 -- accel/accel.sh@42 -- # jq -r . 00:05:32.194 [2024-11-21 03:22:12.537473] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:32.194 [2024-11-21 03:22:12.537561] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2939618 ] 00:05:32.194 EAL: No free 2048 kB hugepages reported on node 1 00:05:32.194 [2024-11-21 03:22:12.602538] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:32.194 [2024-11-21 03:22:12.719150] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:33.577 03:22:13 -- accel/accel.sh@18 -- # out=' 00:05:33.577 SPDK Configuration: 00:05:33.577 Core mask: 0x1 00:05:33.577 00:05:33.577 Accel Perf Configuration: 00:05:33.577 Workload Type: crc32c 00:05:33.577 CRC-32C seed: 0 00:05:33.577 Transfer size: 4096 bytes 00:05:33.577 Vector count 2 00:05:33.577 Module: software 00:05:33.577 Queue depth: 32 00:05:33.577 Allocate depth: 32 00:05:33.577 # threads/core: 1 00:05:33.577 Run time: 1 seconds 00:05:33.577 Verify: Yes 00:05:33.577 00:05:33.577 Running for 1 seconds... 00:05:33.577 00:05:33.577 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:33.577 ------------------------------------------------------------------------------------ 00:05:33.577 0,0 317632/s 2481 MiB/s 0 0 00:05:33.577 ==================================================================================== 00:05:33.577 Total 317632/s 1240 MiB/s 0 0' 00:05:33.577 03:22:13 -- accel/accel.sh@20 -- # IFS=: 00:05:33.577 03:22:13 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -y -C 2 00:05:33.577 03:22:13 -- accel/accel.sh@20 -- # read -r var val 00:05:33.577 03:22:13 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:05:33.577 03:22:13 -- accel/accel.sh@12 -- # build_accel_config 00:05:33.577 03:22:13 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:33.577 03:22:13 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:33.577 03:22:13 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:33.577 03:22:13 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:33.577 03:22:13 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:33.577 03:22:13 -- accel/accel.sh@41 -- # local IFS=, 00:05:33.577 03:22:13 -- accel/accel.sh@42 -- # jq -r . 00:05:33.577 [2024-11-21 03:22:14.012510] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:33.577 [2024-11-21 03:22:14.012600] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2939764 ] 00:05:33.577 EAL: No free 2048 kB hugepages reported on node 1 00:05:33.577 [2024-11-21 03:22:14.073906] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:33.577 [2024-11-21 03:22:14.189917] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:33.836 03:22:14 -- accel/accel.sh@21 -- # val= 00:05:33.836 03:22:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.836 03:22:14 -- accel/accel.sh@20 -- # IFS=: 00:05:33.836 03:22:14 -- accel/accel.sh@20 -- # read -r var val 00:05:33.836 03:22:14 -- accel/accel.sh@21 -- # val= 00:05:33.836 03:22:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.836 03:22:14 -- accel/accel.sh@20 -- # IFS=: 00:05:33.836 03:22:14 -- accel/accel.sh@20 -- # read -r var val 00:05:33.836 03:22:14 -- accel/accel.sh@21 -- # val=0x1 00:05:33.836 03:22:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.836 03:22:14 -- accel/accel.sh@20 -- # IFS=: 00:05:33.836 03:22:14 -- accel/accel.sh@20 -- # read -r var val 00:05:33.836 03:22:14 -- accel/accel.sh@21 -- # val= 00:05:33.836 03:22:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.836 03:22:14 -- accel/accel.sh@20 -- # IFS=: 00:05:33.836 03:22:14 -- accel/accel.sh@20 -- # read -r var val 00:05:33.836 03:22:14 -- accel/accel.sh@21 -- # val= 00:05:33.836 03:22:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.836 03:22:14 -- accel/accel.sh@20 -- # IFS=: 00:05:33.836 03:22:14 -- accel/accel.sh@20 -- # read -r var val 00:05:33.836 03:22:14 -- accel/accel.sh@21 -- # val=crc32c 00:05:33.836 03:22:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.836 03:22:14 -- accel/accel.sh@24 -- # accel_opc=crc32c 00:05:33.836 03:22:14 -- accel/accel.sh@20 -- # IFS=: 00:05:33.836 03:22:14 -- accel/accel.sh@20 -- # read -r var val 00:05:33.836 03:22:14 -- accel/accel.sh@21 -- # val=0 00:05:33.836 03:22:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.836 03:22:14 -- accel/accel.sh@20 -- # IFS=: 00:05:33.836 03:22:14 -- accel/accel.sh@20 -- # read -r var val 00:05:33.836 03:22:14 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:33.836 03:22:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.836 03:22:14 -- accel/accel.sh@20 -- # IFS=: 00:05:33.836 03:22:14 -- accel/accel.sh@20 -- # read -r var val 00:05:33.836 03:22:14 -- accel/accel.sh@21 -- # val= 00:05:33.836 03:22:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.836 03:22:14 -- accel/accel.sh@20 -- # IFS=: 00:05:33.836 03:22:14 -- accel/accel.sh@20 -- # read -r var val 00:05:33.836 03:22:14 -- accel/accel.sh@21 -- # val=software 00:05:33.836 03:22:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.836 03:22:14 -- accel/accel.sh@23 -- # accel_module=software 00:05:33.836 03:22:14 -- accel/accel.sh@20 -- # IFS=: 00:05:33.836 03:22:14 -- accel/accel.sh@20 -- # read -r var val 00:05:33.836 03:22:14 -- accel/accel.sh@21 -- # val=32 00:05:33.836 03:22:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.836 03:22:14 -- accel/accel.sh@20 -- # IFS=: 00:05:33.836 03:22:14 -- accel/accel.sh@20 -- # read -r var val 00:05:33.836 03:22:14 -- accel/accel.sh@21 -- # val=32 00:05:33.836 03:22:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.836 03:22:14 -- accel/accel.sh@20 -- # IFS=: 00:05:33.836 03:22:14 -- accel/accel.sh@20 -- # read -r var val 00:05:33.836 03:22:14 -- accel/accel.sh@21 -- # val=1 00:05:33.836 03:22:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.836 03:22:14 -- accel/accel.sh@20 -- # IFS=: 00:05:33.836 03:22:14 -- accel/accel.sh@20 -- # read -r var val 00:05:33.836 03:22:14 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:33.836 03:22:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.836 03:22:14 -- accel/accel.sh@20 -- # IFS=: 00:05:33.836 03:22:14 -- accel/accel.sh@20 -- # read -r var val 00:05:33.836 03:22:14 -- accel/accel.sh@21 -- # val=Yes 00:05:33.836 03:22:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.836 03:22:14 -- accel/accel.sh@20 -- # IFS=: 00:05:33.836 03:22:14 -- accel/accel.sh@20 -- # read -r var val 00:05:33.836 03:22:14 -- accel/accel.sh@21 -- # val= 00:05:33.836 03:22:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.836 03:22:14 -- accel/accel.sh@20 -- # IFS=: 00:05:33.836 03:22:14 -- accel/accel.sh@20 -- # read -r var val 00:05:33.836 03:22:14 -- accel/accel.sh@21 -- # val= 00:05:33.836 03:22:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.836 03:22:14 -- accel/accel.sh@20 -- # IFS=: 00:05:33.836 03:22:14 -- accel/accel.sh@20 -- # read -r var val 00:05:35.219 03:22:15 -- accel/accel.sh@21 -- # val= 00:05:35.219 03:22:15 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.219 03:22:15 -- accel/accel.sh@20 -- # IFS=: 00:05:35.219 03:22:15 -- accel/accel.sh@20 -- # read -r var val 00:05:35.219 03:22:15 -- accel/accel.sh@21 -- # val= 00:05:35.219 03:22:15 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.219 03:22:15 -- accel/accel.sh@20 -- # IFS=: 00:05:35.219 03:22:15 -- accel/accel.sh@20 -- # read -r var val 00:05:35.219 03:22:15 -- accel/accel.sh@21 -- # val= 00:05:35.219 03:22:15 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.219 03:22:15 -- accel/accel.sh@20 -- # IFS=: 00:05:35.219 03:22:15 -- accel/accel.sh@20 -- # read -r var val 00:05:35.219 03:22:15 -- accel/accel.sh@21 -- # val= 00:05:35.219 03:22:15 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.219 03:22:15 -- accel/accel.sh@20 -- # IFS=: 00:05:35.219 03:22:15 -- accel/accel.sh@20 -- # read -r var val 00:05:35.219 03:22:15 -- accel/accel.sh@21 -- # val= 00:05:35.219 03:22:15 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.219 03:22:15 -- accel/accel.sh@20 -- # IFS=: 00:05:35.219 03:22:15 -- accel/accel.sh@20 -- # read -r var val 00:05:35.219 03:22:15 -- accel/accel.sh@21 -- # val= 00:05:35.219 03:22:15 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.219 03:22:15 -- accel/accel.sh@20 -- # IFS=: 00:05:35.219 03:22:15 -- accel/accel.sh@20 -- # read -r var val 00:05:35.219 03:22:15 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:35.219 03:22:15 -- accel/accel.sh@28 -- # [[ -n crc32c ]] 00:05:35.219 03:22:15 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:35.219 00:05:35.219 real 0m2.950s 00:05:35.219 user 0m2.659s 00:05:35.219 sys 0m0.279s 00:05:35.219 03:22:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:35.219 03:22:15 -- common/autotest_common.sh@10 -- # set +x 00:05:35.219 ************************************ 00:05:35.219 END TEST accel_crc32c_C2 00:05:35.219 ************************************ 00:05:35.219 03:22:15 -- accel/accel.sh@95 -- # run_test accel_copy accel_test -t 1 -w copy -y 00:05:35.219 03:22:15 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:35.219 03:22:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:35.219 03:22:15 -- common/autotest_common.sh@10 -- # set +x 00:05:35.219 ************************************ 00:05:35.219 START TEST accel_copy 00:05:35.219 ************************************ 00:05:35.219 03:22:15 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy -y 00:05:35.219 03:22:15 -- accel/accel.sh@16 -- # local accel_opc 00:05:35.219 03:22:15 -- accel/accel.sh@17 -- # local accel_module 00:05:35.219 03:22:15 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy -y 00:05:35.219 03:22:15 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:05:35.219 03:22:15 -- accel/accel.sh@12 -- # build_accel_config 00:05:35.219 03:22:15 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:35.219 03:22:15 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:35.219 03:22:15 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:35.219 03:22:15 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:35.219 03:22:15 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:35.219 03:22:15 -- accel/accel.sh@41 -- # local IFS=, 00:05:35.219 03:22:15 -- accel/accel.sh@42 -- # jq -r . 00:05:35.219 [2024-11-21 03:22:15.516296] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:35.219 [2024-11-21 03:22:15.516386] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2939917 ] 00:05:35.219 EAL: No free 2048 kB hugepages reported on node 1 00:05:35.219 [2024-11-21 03:22:15.580169] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:35.219 [2024-11-21 03:22:15.702012] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:36.602 03:22:16 -- accel/accel.sh@18 -- # out=' 00:05:36.602 SPDK Configuration: 00:05:36.602 Core mask: 0x1 00:05:36.602 00:05:36.602 Accel Perf Configuration: 00:05:36.602 Workload Type: copy 00:05:36.602 Transfer size: 4096 bytes 00:05:36.602 Vector count 1 00:05:36.602 Module: software 00:05:36.602 Queue depth: 32 00:05:36.602 Allocate depth: 32 00:05:36.602 # threads/core: 1 00:05:36.602 Run time: 1 seconds 00:05:36.602 Verify: Yes 00:05:36.602 00:05:36.602 Running for 1 seconds... 00:05:36.602 00:05:36.602 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:36.602 ------------------------------------------------------------------------------------ 00:05:36.602 0,0 278880/s 1089 MiB/s 0 0 00:05:36.602 ==================================================================================== 00:05:36.602 Total 278880/s 1089 MiB/s 0 0' 00:05:36.602 03:22:16 -- accel/accel.sh@20 -- # IFS=: 00:05:36.602 03:22:16 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy -y 00:05:36.602 03:22:16 -- accel/accel.sh@20 -- # read -r var val 00:05:36.602 03:22:16 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:05:36.602 03:22:16 -- accel/accel.sh@12 -- # build_accel_config 00:05:36.602 03:22:16 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:36.602 03:22:16 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:36.602 03:22:16 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:36.602 03:22:16 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:36.602 03:22:16 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:36.602 03:22:16 -- accel/accel.sh@41 -- # local IFS=, 00:05:36.602 03:22:16 -- accel/accel.sh@42 -- # jq -r . 00:05:36.602 [2024-11-21 03:22:16.981282] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:36.602 [2024-11-21 03:22:16.981376] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2940191 ] 00:05:36.602 EAL: No free 2048 kB hugepages reported on node 1 00:05:36.602 [2024-11-21 03:22:17.048351] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:36.602 [2024-11-21 03:22:17.165046] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:36.602 03:22:17 -- accel/accel.sh@21 -- # val= 00:05:36.602 03:22:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.602 03:22:17 -- accel/accel.sh@20 -- # IFS=: 00:05:36.602 03:22:17 -- accel/accel.sh@20 -- # read -r var val 00:05:36.602 03:22:17 -- accel/accel.sh@21 -- # val= 00:05:36.602 03:22:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.602 03:22:17 -- accel/accel.sh@20 -- # IFS=: 00:05:36.602 03:22:17 -- accel/accel.sh@20 -- # read -r var val 00:05:36.602 03:22:17 -- accel/accel.sh@21 -- # val=0x1 00:05:36.602 03:22:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.602 03:22:17 -- accel/accel.sh@20 -- # IFS=: 00:05:36.602 03:22:17 -- accel/accel.sh@20 -- # read -r var val 00:05:36.602 03:22:17 -- accel/accel.sh@21 -- # val= 00:05:36.602 03:22:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.602 03:22:17 -- accel/accel.sh@20 -- # IFS=: 00:05:36.602 03:22:17 -- accel/accel.sh@20 -- # read -r var val 00:05:36.602 03:22:17 -- accel/accel.sh@21 -- # val= 00:05:36.602 03:22:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.602 03:22:17 -- accel/accel.sh@20 -- # IFS=: 00:05:36.602 03:22:17 -- accel/accel.sh@20 -- # read -r var val 00:05:36.602 03:22:17 -- accel/accel.sh@21 -- # val=copy 00:05:36.602 03:22:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.602 03:22:17 -- accel/accel.sh@24 -- # accel_opc=copy 00:05:36.602 03:22:17 -- accel/accel.sh@20 -- # IFS=: 00:05:36.602 03:22:17 -- accel/accel.sh@20 -- # read -r var val 00:05:36.602 03:22:17 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:36.602 03:22:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.602 03:22:17 -- accel/accel.sh@20 -- # IFS=: 00:05:36.602 03:22:17 -- accel/accel.sh@20 -- # read -r var val 00:05:36.602 03:22:17 -- accel/accel.sh@21 -- # val= 00:05:36.602 03:22:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.602 03:22:17 -- accel/accel.sh@20 -- # IFS=: 00:05:36.602 03:22:17 -- accel/accel.sh@20 -- # read -r var val 00:05:36.602 03:22:17 -- accel/accel.sh@21 -- # val=software 00:05:36.602 03:22:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.602 03:22:17 -- accel/accel.sh@23 -- # accel_module=software 00:05:36.602 03:22:17 -- accel/accel.sh@20 -- # IFS=: 00:05:36.602 03:22:17 -- accel/accel.sh@20 -- # read -r var val 00:05:36.602 03:22:17 -- accel/accel.sh@21 -- # val=32 00:05:36.602 03:22:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.602 03:22:17 -- accel/accel.sh@20 -- # IFS=: 00:05:36.602 03:22:17 -- accel/accel.sh@20 -- # read -r var val 00:05:36.602 03:22:17 -- accel/accel.sh@21 -- # val=32 00:05:36.602 03:22:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.602 03:22:17 -- accel/accel.sh@20 -- # IFS=: 00:05:36.602 03:22:17 -- accel/accel.sh@20 -- # read -r var val 00:05:36.602 03:22:17 -- accel/accel.sh@21 -- # val=1 00:05:36.602 03:22:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.602 03:22:17 -- accel/accel.sh@20 -- # IFS=: 00:05:36.602 03:22:17 -- accel/accel.sh@20 -- # read -r var val 00:05:36.602 03:22:17 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:36.602 03:22:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.602 03:22:17 -- accel/accel.sh@20 -- # IFS=: 00:05:36.602 03:22:17 -- accel/accel.sh@20 -- # read -r var val 00:05:36.602 03:22:17 -- accel/accel.sh@21 -- # val=Yes 00:05:36.602 03:22:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.602 03:22:17 -- accel/accel.sh@20 -- # IFS=: 00:05:36.602 03:22:17 -- accel/accel.sh@20 -- # read -r var val 00:05:36.602 03:22:17 -- accel/accel.sh@21 -- # val= 00:05:36.602 03:22:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.602 03:22:17 -- accel/accel.sh@20 -- # IFS=: 00:05:36.602 03:22:17 -- accel/accel.sh@20 -- # read -r var val 00:05:36.602 03:22:17 -- accel/accel.sh@21 -- # val= 00:05:36.602 03:22:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.602 03:22:17 -- accel/accel.sh@20 -- # IFS=: 00:05:36.602 03:22:17 -- accel/accel.sh@20 -- # read -r var val 00:05:37.992 03:22:18 -- accel/accel.sh@21 -- # val= 00:05:37.992 03:22:18 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.992 03:22:18 -- accel/accel.sh@20 -- # IFS=: 00:05:37.992 03:22:18 -- accel/accel.sh@20 -- # read -r var val 00:05:37.992 03:22:18 -- accel/accel.sh@21 -- # val= 00:05:37.992 03:22:18 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.992 03:22:18 -- accel/accel.sh@20 -- # IFS=: 00:05:37.992 03:22:18 -- accel/accel.sh@20 -- # read -r var val 00:05:37.992 03:22:18 -- accel/accel.sh@21 -- # val= 00:05:37.992 03:22:18 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.992 03:22:18 -- accel/accel.sh@20 -- # IFS=: 00:05:37.992 03:22:18 -- accel/accel.sh@20 -- # read -r var val 00:05:37.992 03:22:18 -- accel/accel.sh@21 -- # val= 00:05:37.992 03:22:18 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.992 03:22:18 -- accel/accel.sh@20 -- # IFS=: 00:05:37.992 03:22:18 -- accel/accel.sh@20 -- # read -r var val 00:05:37.992 03:22:18 -- accel/accel.sh@21 -- # val= 00:05:37.992 03:22:18 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.992 03:22:18 -- accel/accel.sh@20 -- # IFS=: 00:05:37.992 03:22:18 -- accel/accel.sh@20 -- # read -r var val 00:05:37.992 03:22:18 -- accel/accel.sh@21 -- # val= 00:05:37.992 03:22:18 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.992 03:22:18 -- accel/accel.sh@20 -- # IFS=: 00:05:37.992 03:22:18 -- accel/accel.sh@20 -- # read -r var val 00:05:37.992 03:22:18 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:37.992 03:22:18 -- accel/accel.sh@28 -- # [[ -n copy ]] 00:05:37.992 03:22:18 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:37.992 00:05:37.992 real 0m2.943s 00:05:37.992 user 0m2.646s 00:05:37.992 sys 0m0.287s 00:05:37.992 03:22:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:37.992 03:22:18 -- common/autotest_common.sh@10 -- # set +x 00:05:37.992 ************************************ 00:05:37.992 END TEST accel_copy 00:05:37.992 ************************************ 00:05:37.992 03:22:18 -- accel/accel.sh@96 -- # run_test accel_fill accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:37.992 03:22:18 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:05:37.993 03:22:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:37.993 03:22:18 -- common/autotest_common.sh@10 -- # set +x 00:05:37.993 ************************************ 00:05:37.993 START TEST accel_fill 00:05:37.993 ************************************ 00:05:37.993 03:22:18 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:37.993 03:22:18 -- accel/accel.sh@16 -- # local accel_opc 00:05:37.993 03:22:18 -- accel/accel.sh@17 -- # local accel_module 00:05:37.993 03:22:18 -- accel/accel.sh@18 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:37.993 03:22:18 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:37.993 03:22:18 -- accel/accel.sh@12 -- # build_accel_config 00:05:37.993 03:22:18 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:37.993 03:22:18 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:37.993 03:22:18 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:37.993 03:22:18 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:37.993 03:22:18 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:37.993 03:22:18 -- accel/accel.sh@41 -- # local IFS=, 00:05:37.993 03:22:18 -- accel/accel.sh@42 -- # jq -r . 00:05:37.993 [2024-11-21 03:22:18.489495] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:37.993 [2024-11-21 03:22:18.489578] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2940346 ] 00:05:37.993 EAL: No free 2048 kB hugepages reported on node 1 00:05:37.993 [2024-11-21 03:22:18.552605] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:38.252 [2024-11-21 03:22:18.667031] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:39.633 03:22:19 -- accel/accel.sh@18 -- # out=' 00:05:39.633 SPDK Configuration: 00:05:39.633 Core mask: 0x1 00:05:39.633 00:05:39.634 Accel Perf Configuration: 00:05:39.634 Workload Type: fill 00:05:39.634 Fill pattern: 0x80 00:05:39.634 Transfer size: 4096 bytes 00:05:39.634 Vector count 1 00:05:39.634 Module: software 00:05:39.634 Queue depth: 64 00:05:39.634 Allocate depth: 64 00:05:39.634 # threads/core: 1 00:05:39.634 Run time: 1 seconds 00:05:39.634 Verify: Yes 00:05:39.634 00:05:39.634 Running for 1 seconds... 00:05:39.634 00:05:39.634 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:39.634 ------------------------------------------------------------------------------------ 00:05:39.634 0,0 404160/s 1578 MiB/s 0 0 00:05:39.634 ==================================================================================== 00:05:39.634 Total 404160/s 1578 MiB/s 0 0' 00:05:39.634 03:22:19 -- accel/accel.sh@20 -- # IFS=: 00:05:39.634 03:22:19 -- accel/accel.sh@15 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:39.634 03:22:19 -- accel/accel.sh@20 -- # read -r var val 00:05:39.634 03:22:19 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:39.634 03:22:19 -- accel/accel.sh@12 -- # build_accel_config 00:05:39.634 03:22:19 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:39.634 03:22:19 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:39.634 03:22:19 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:39.634 03:22:19 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:39.634 03:22:19 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:39.634 03:22:19 -- accel/accel.sh@41 -- # local IFS=, 00:05:39.634 03:22:19 -- accel/accel.sh@42 -- # jq -r . 00:05:39.634 [2024-11-21 03:22:19.956885] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:39.634 [2024-11-21 03:22:19.956983] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2940492 ] 00:05:39.634 EAL: No free 2048 kB hugepages reported on node 1 00:05:39.634 [2024-11-21 03:22:20.018033] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:39.634 [2024-11-21 03:22:20.141116] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:39.634 03:22:20 -- accel/accel.sh@21 -- # val= 00:05:39.634 03:22:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.634 03:22:20 -- accel/accel.sh@20 -- # IFS=: 00:05:39.634 03:22:20 -- accel/accel.sh@20 -- # read -r var val 00:05:39.634 03:22:20 -- accel/accel.sh@21 -- # val= 00:05:39.634 03:22:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.634 03:22:20 -- accel/accel.sh@20 -- # IFS=: 00:05:39.634 03:22:20 -- accel/accel.sh@20 -- # read -r var val 00:05:39.634 03:22:20 -- accel/accel.sh@21 -- # val=0x1 00:05:39.634 03:22:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.634 03:22:20 -- accel/accel.sh@20 -- # IFS=: 00:05:39.634 03:22:20 -- accel/accel.sh@20 -- # read -r var val 00:05:39.634 03:22:20 -- accel/accel.sh@21 -- # val= 00:05:39.634 03:22:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.634 03:22:20 -- accel/accel.sh@20 -- # IFS=: 00:05:39.634 03:22:20 -- accel/accel.sh@20 -- # read -r var val 00:05:39.634 03:22:20 -- accel/accel.sh@21 -- # val= 00:05:39.634 03:22:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.634 03:22:20 -- accel/accel.sh@20 -- # IFS=: 00:05:39.634 03:22:20 -- accel/accel.sh@20 -- # read -r var val 00:05:39.634 03:22:20 -- accel/accel.sh@21 -- # val=fill 00:05:39.634 03:22:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.634 03:22:20 -- accel/accel.sh@24 -- # accel_opc=fill 00:05:39.634 03:22:20 -- accel/accel.sh@20 -- # IFS=: 00:05:39.634 03:22:20 -- accel/accel.sh@20 -- # read -r var val 00:05:39.634 03:22:20 -- accel/accel.sh@21 -- # val=0x80 00:05:39.634 03:22:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.634 03:22:20 -- accel/accel.sh@20 -- # IFS=: 00:05:39.634 03:22:20 -- accel/accel.sh@20 -- # read -r var val 00:05:39.634 03:22:20 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:39.634 03:22:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.634 03:22:20 -- accel/accel.sh@20 -- # IFS=: 00:05:39.634 03:22:20 -- accel/accel.sh@20 -- # read -r var val 00:05:39.634 03:22:20 -- accel/accel.sh@21 -- # val= 00:05:39.634 03:22:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.634 03:22:20 -- accel/accel.sh@20 -- # IFS=: 00:05:39.634 03:22:20 -- accel/accel.sh@20 -- # read -r var val 00:05:39.634 03:22:20 -- accel/accel.sh@21 -- # val=software 00:05:39.634 03:22:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.634 03:22:20 -- accel/accel.sh@23 -- # accel_module=software 00:05:39.634 03:22:20 -- accel/accel.sh@20 -- # IFS=: 00:05:39.634 03:22:20 -- accel/accel.sh@20 -- # read -r var val 00:05:39.634 03:22:20 -- accel/accel.sh@21 -- # val=64 00:05:39.634 03:22:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.634 03:22:20 -- accel/accel.sh@20 -- # IFS=: 00:05:39.634 03:22:20 -- accel/accel.sh@20 -- # read -r var val 00:05:39.634 03:22:20 -- accel/accel.sh@21 -- # val=64 00:05:39.634 03:22:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.634 03:22:20 -- accel/accel.sh@20 -- # IFS=: 00:05:39.634 03:22:20 -- accel/accel.sh@20 -- # read -r var val 00:05:39.634 03:22:20 -- accel/accel.sh@21 -- # val=1 00:05:39.634 03:22:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.634 03:22:20 -- accel/accel.sh@20 -- # IFS=: 00:05:39.634 03:22:20 -- accel/accel.sh@20 -- # read -r var val 00:05:39.634 03:22:20 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:39.634 03:22:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.634 03:22:20 -- accel/accel.sh@20 -- # IFS=: 00:05:39.634 03:22:20 -- accel/accel.sh@20 -- # read -r var val 00:05:39.634 03:22:20 -- accel/accel.sh@21 -- # val=Yes 00:05:39.634 03:22:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.634 03:22:20 -- accel/accel.sh@20 -- # IFS=: 00:05:39.634 03:22:20 -- accel/accel.sh@20 -- # read -r var val 00:05:39.634 03:22:20 -- accel/accel.sh@21 -- # val= 00:05:39.634 03:22:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.634 03:22:20 -- accel/accel.sh@20 -- # IFS=: 00:05:39.634 03:22:20 -- accel/accel.sh@20 -- # read -r var val 00:05:39.634 03:22:20 -- accel/accel.sh@21 -- # val= 00:05:39.634 03:22:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.634 03:22:20 -- accel/accel.sh@20 -- # IFS=: 00:05:39.634 03:22:20 -- accel/accel.sh@20 -- # read -r var val 00:05:41.019 03:22:21 -- accel/accel.sh@21 -- # val= 00:05:41.019 03:22:21 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.019 03:22:21 -- accel/accel.sh@20 -- # IFS=: 00:05:41.019 03:22:21 -- accel/accel.sh@20 -- # read -r var val 00:05:41.019 03:22:21 -- accel/accel.sh@21 -- # val= 00:05:41.019 03:22:21 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.019 03:22:21 -- accel/accel.sh@20 -- # IFS=: 00:05:41.019 03:22:21 -- accel/accel.sh@20 -- # read -r var val 00:05:41.019 03:22:21 -- accel/accel.sh@21 -- # val= 00:05:41.019 03:22:21 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.019 03:22:21 -- accel/accel.sh@20 -- # IFS=: 00:05:41.019 03:22:21 -- accel/accel.sh@20 -- # read -r var val 00:05:41.019 03:22:21 -- accel/accel.sh@21 -- # val= 00:05:41.019 03:22:21 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.019 03:22:21 -- accel/accel.sh@20 -- # IFS=: 00:05:41.019 03:22:21 -- accel/accel.sh@20 -- # read -r var val 00:05:41.019 03:22:21 -- accel/accel.sh@21 -- # val= 00:05:41.019 03:22:21 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.019 03:22:21 -- accel/accel.sh@20 -- # IFS=: 00:05:41.019 03:22:21 -- accel/accel.sh@20 -- # read -r var val 00:05:41.019 03:22:21 -- accel/accel.sh@21 -- # val= 00:05:41.019 03:22:21 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.019 03:22:21 -- accel/accel.sh@20 -- # IFS=: 00:05:41.019 03:22:21 -- accel/accel.sh@20 -- # read -r var val 00:05:41.019 03:22:21 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:41.019 03:22:21 -- accel/accel.sh@28 -- # [[ -n fill ]] 00:05:41.019 03:22:21 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:41.019 00:05:41.020 real 0m2.945s 00:05:41.020 user 0m2.652s 00:05:41.020 sys 0m0.283s 00:05:41.020 03:22:21 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:41.020 03:22:21 -- common/autotest_common.sh@10 -- # set +x 00:05:41.020 ************************************ 00:05:41.020 END TEST accel_fill 00:05:41.020 ************************************ 00:05:41.020 03:22:21 -- accel/accel.sh@97 -- # run_test accel_copy_crc32c accel_test -t 1 -w copy_crc32c -y 00:05:41.020 03:22:21 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:41.020 03:22:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:41.020 03:22:21 -- common/autotest_common.sh@10 -- # set +x 00:05:41.020 ************************************ 00:05:41.020 START TEST accel_copy_crc32c 00:05:41.020 ************************************ 00:05:41.020 03:22:21 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy_crc32c -y 00:05:41.020 03:22:21 -- accel/accel.sh@16 -- # local accel_opc 00:05:41.020 03:22:21 -- accel/accel.sh@17 -- # local accel_module 00:05:41.020 03:22:21 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy_crc32c -y 00:05:41.020 03:22:21 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:05:41.020 03:22:21 -- accel/accel.sh@12 -- # build_accel_config 00:05:41.020 03:22:21 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:41.020 03:22:21 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:41.020 03:22:21 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:41.020 03:22:21 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:41.020 03:22:21 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:41.020 03:22:21 -- accel/accel.sh@41 -- # local IFS=, 00:05:41.020 03:22:21 -- accel/accel.sh@42 -- # jq -r . 00:05:41.020 [2024-11-21 03:22:21.457608] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:41.020 [2024-11-21 03:22:21.457697] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2940770 ] 00:05:41.020 EAL: No free 2048 kB hugepages reported on node 1 00:05:41.020 [2024-11-21 03:22:21.517174] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:41.020 [2024-11-21 03:22:21.634153] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:42.402 03:22:22 -- accel/accel.sh@18 -- # out=' 00:05:42.402 SPDK Configuration: 00:05:42.402 Core mask: 0x1 00:05:42.402 00:05:42.402 Accel Perf Configuration: 00:05:42.402 Workload Type: copy_crc32c 00:05:42.402 CRC-32C seed: 0 00:05:42.402 Vector size: 4096 bytes 00:05:42.402 Transfer size: 4096 bytes 00:05:42.402 Vector count 1 00:05:42.402 Module: software 00:05:42.402 Queue depth: 32 00:05:42.402 Allocate depth: 32 00:05:42.402 # threads/core: 1 00:05:42.402 Run time: 1 seconds 00:05:42.402 Verify: Yes 00:05:42.402 00:05:42.402 Running for 1 seconds... 00:05:42.402 00:05:42.402 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:42.402 ------------------------------------------------------------------------------------ 00:05:42.402 0,0 218688/s 854 MiB/s 0 0 00:05:42.402 ==================================================================================== 00:05:42.402 Total 218688/s 854 MiB/s 0 0' 00:05:42.402 03:22:22 -- accel/accel.sh@20 -- # IFS=: 00:05:42.402 03:22:22 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y 00:05:42.402 03:22:22 -- accel/accel.sh@20 -- # read -r var val 00:05:42.402 03:22:22 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:05:42.402 03:22:22 -- accel/accel.sh@12 -- # build_accel_config 00:05:42.402 03:22:22 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:42.402 03:22:22 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:42.402 03:22:22 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:42.402 03:22:22 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:42.402 03:22:22 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:42.402 03:22:22 -- accel/accel.sh@41 -- # local IFS=, 00:05:42.402 03:22:22 -- accel/accel.sh@42 -- # jq -r . 00:05:42.402 [2024-11-21 03:22:22.932113] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:42.402 [2024-11-21 03:22:22.932201] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2940920 ] 00:05:42.402 EAL: No free 2048 kB hugepages reported on node 1 00:05:42.402 [2024-11-21 03:22:22.994313] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:42.663 [2024-11-21 03:22:23.114601] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:42.663 03:22:23 -- accel/accel.sh@21 -- # val= 00:05:42.663 03:22:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.663 03:22:23 -- accel/accel.sh@20 -- # IFS=: 00:05:42.663 03:22:23 -- accel/accel.sh@20 -- # read -r var val 00:05:42.663 03:22:23 -- accel/accel.sh@21 -- # val= 00:05:42.663 03:22:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.663 03:22:23 -- accel/accel.sh@20 -- # IFS=: 00:05:42.663 03:22:23 -- accel/accel.sh@20 -- # read -r var val 00:05:42.663 03:22:23 -- accel/accel.sh@21 -- # val=0x1 00:05:42.663 03:22:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.663 03:22:23 -- accel/accel.sh@20 -- # IFS=: 00:05:42.663 03:22:23 -- accel/accel.sh@20 -- # read -r var val 00:05:42.663 03:22:23 -- accel/accel.sh@21 -- # val= 00:05:42.663 03:22:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.663 03:22:23 -- accel/accel.sh@20 -- # IFS=: 00:05:42.663 03:22:23 -- accel/accel.sh@20 -- # read -r var val 00:05:42.663 03:22:23 -- accel/accel.sh@21 -- # val= 00:05:42.663 03:22:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.663 03:22:23 -- accel/accel.sh@20 -- # IFS=: 00:05:42.663 03:22:23 -- accel/accel.sh@20 -- # read -r var val 00:05:42.663 03:22:23 -- accel/accel.sh@21 -- # val=copy_crc32c 00:05:42.663 03:22:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.663 03:22:23 -- accel/accel.sh@24 -- # accel_opc=copy_crc32c 00:05:42.663 03:22:23 -- accel/accel.sh@20 -- # IFS=: 00:05:42.663 03:22:23 -- accel/accel.sh@20 -- # read -r var val 00:05:42.663 03:22:23 -- accel/accel.sh@21 -- # val=0 00:05:42.663 03:22:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.663 03:22:23 -- accel/accel.sh@20 -- # IFS=: 00:05:42.663 03:22:23 -- accel/accel.sh@20 -- # read -r var val 00:05:42.663 03:22:23 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:42.663 03:22:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.663 03:22:23 -- accel/accel.sh@20 -- # IFS=: 00:05:42.663 03:22:23 -- accel/accel.sh@20 -- # read -r var val 00:05:42.663 03:22:23 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:42.663 03:22:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.663 03:22:23 -- accel/accel.sh@20 -- # IFS=: 00:05:42.663 03:22:23 -- accel/accel.sh@20 -- # read -r var val 00:05:42.663 03:22:23 -- accel/accel.sh@21 -- # val= 00:05:42.663 03:22:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.663 03:22:23 -- accel/accel.sh@20 -- # IFS=: 00:05:42.663 03:22:23 -- accel/accel.sh@20 -- # read -r var val 00:05:42.663 03:22:23 -- accel/accel.sh@21 -- # val=software 00:05:42.663 03:22:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.663 03:22:23 -- accel/accel.sh@23 -- # accel_module=software 00:05:42.663 03:22:23 -- accel/accel.sh@20 -- # IFS=: 00:05:42.663 03:22:23 -- accel/accel.sh@20 -- # read -r var val 00:05:42.663 03:22:23 -- accel/accel.sh@21 -- # val=32 00:05:42.663 03:22:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.663 03:22:23 -- accel/accel.sh@20 -- # IFS=: 00:05:42.663 03:22:23 -- accel/accel.sh@20 -- # read -r var val 00:05:42.663 03:22:23 -- accel/accel.sh@21 -- # val=32 00:05:42.663 03:22:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.663 03:22:23 -- accel/accel.sh@20 -- # IFS=: 00:05:42.663 03:22:23 -- accel/accel.sh@20 -- # read -r var val 00:05:42.663 03:22:23 -- accel/accel.sh@21 -- # val=1 00:05:42.663 03:22:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.663 03:22:23 -- accel/accel.sh@20 -- # IFS=: 00:05:42.663 03:22:23 -- accel/accel.sh@20 -- # read -r var val 00:05:42.663 03:22:23 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:42.663 03:22:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.663 03:22:23 -- accel/accel.sh@20 -- # IFS=: 00:05:42.663 03:22:23 -- accel/accel.sh@20 -- # read -r var val 00:05:42.663 03:22:23 -- accel/accel.sh@21 -- # val=Yes 00:05:42.663 03:22:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.663 03:22:23 -- accel/accel.sh@20 -- # IFS=: 00:05:42.663 03:22:23 -- accel/accel.sh@20 -- # read -r var val 00:05:42.663 03:22:23 -- accel/accel.sh@21 -- # val= 00:05:42.663 03:22:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.663 03:22:23 -- accel/accel.sh@20 -- # IFS=: 00:05:42.663 03:22:23 -- accel/accel.sh@20 -- # read -r var val 00:05:42.663 03:22:23 -- accel/accel.sh@21 -- # val= 00:05:42.663 03:22:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.663 03:22:23 -- accel/accel.sh@20 -- # IFS=: 00:05:42.663 03:22:23 -- accel/accel.sh@20 -- # read -r var val 00:05:44.107 03:22:24 -- accel/accel.sh@21 -- # val= 00:05:44.107 03:22:24 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.107 03:22:24 -- accel/accel.sh@20 -- # IFS=: 00:05:44.107 03:22:24 -- accel/accel.sh@20 -- # read -r var val 00:05:44.107 03:22:24 -- accel/accel.sh@21 -- # val= 00:05:44.107 03:22:24 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.107 03:22:24 -- accel/accel.sh@20 -- # IFS=: 00:05:44.107 03:22:24 -- accel/accel.sh@20 -- # read -r var val 00:05:44.107 03:22:24 -- accel/accel.sh@21 -- # val= 00:05:44.107 03:22:24 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.107 03:22:24 -- accel/accel.sh@20 -- # IFS=: 00:05:44.107 03:22:24 -- accel/accel.sh@20 -- # read -r var val 00:05:44.107 03:22:24 -- accel/accel.sh@21 -- # val= 00:05:44.107 03:22:24 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.107 03:22:24 -- accel/accel.sh@20 -- # IFS=: 00:05:44.107 03:22:24 -- accel/accel.sh@20 -- # read -r var val 00:05:44.107 03:22:24 -- accel/accel.sh@21 -- # val= 00:05:44.107 03:22:24 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.107 03:22:24 -- accel/accel.sh@20 -- # IFS=: 00:05:44.107 03:22:24 -- accel/accel.sh@20 -- # read -r var val 00:05:44.107 03:22:24 -- accel/accel.sh@21 -- # val= 00:05:44.107 03:22:24 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.107 03:22:24 -- accel/accel.sh@20 -- # IFS=: 00:05:44.107 03:22:24 -- accel/accel.sh@20 -- # read -r var val 00:05:44.107 03:22:24 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:44.107 03:22:24 -- accel/accel.sh@28 -- # [[ -n copy_crc32c ]] 00:05:44.107 03:22:24 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:44.107 00:05:44.107 real 0m2.960s 00:05:44.107 user 0m2.661s 00:05:44.107 sys 0m0.289s 00:05:44.107 03:22:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:44.107 03:22:24 -- common/autotest_common.sh@10 -- # set +x 00:05:44.107 ************************************ 00:05:44.107 END TEST accel_copy_crc32c 00:05:44.107 ************************************ 00:05:44.107 03:22:24 -- accel/accel.sh@98 -- # run_test accel_copy_crc32c_C2 accel_test -t 1 -w copy_crc32c -y -C 2 00:05:44.107 03:22:24 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:05:44.107 03:22:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:44.107 03:22:24 -- common/autotest_common.sh@10 -- # set +x 00:05:44.107 ************************************ 00:05:44.107 START TEST accel_copy_crc32c_C2 00:05:44.107 ************************************ 00:05:44.107 03:22:24 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy_crc32c -y -C 2 00:05:44.107 03:22:24 -- accel/accel.sh@16 -- # local accel_opc 00:05:44.107 03:22:24 -- accel/accel.sh@17 -- # local accel_module 00:05:44.107 03:22:24 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:05:44.107 03:22:24 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:05:44.107 03:22:24 -- accel/accel.sh@12 -- # build_accel_config 00:05:44.107 03:22:24 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:44.107 03:22:24 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:44.107 03:22:24 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:44.107 03:22:24 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:44.107 03:22:24 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:44.107 03:22:24 -- accel/accel.sh@41 -- # local IFS=, 00:05:44.107 03:22:24 -- accel/accel.sh@42 -- # jq -r . 00:05:44.107 [2024-11-21 03:22:24.443997] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:44.107 [2024-11-21 03:22:24.444140] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2941076 ] 00:05:44.107 EAL: No free 2048 kB hugepages reported on node 1 00:05:44.107 [2024-11-21 03:22:24.507418] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:44.107 [2024-11-21 03:22:24.630058] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:45.487 03:22:25 -- accel/accel.sh@18 -- # out=' 00:05:45.487 SPDK Configuration: 00:05:45.487 Core mask: 0x1 00:05:45.487 00:05:45.487 Accel Perf Configuration: 00:05:45.487 Workload Type: copy_crc32c 00:05:45.487 CRC-32C seed: 0 00:05:45.487 Vector size: 4096 bytes 00:05:45.487 Transfer size: 8192 bytes 00:05:45.487 Vector count 2 00:05:45.487 Module: software 00:05:45.487 Queue depth: 32 00:05:45.487 Allocate depth: 32 00:05:45.487 # threads/core: 1 00:05:45.487 Run time: 1 seconds 00:05:45.487 Verify: Yes 00:05:45.487 00:05:45.487 Running for 1 seconds... 00:05:45.487 00:05:45.487 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:45.487 ------------------------------------------------------------------------------------ 00:05:45.487 0,0 155392/s 1214 MiB/s 0 0 00:05:45.487 ==================================================================================== 00:05:45.487 Total 155392/s 607 MiB/s 0 0' 00:05:45.487 03:22:25 -- accel/accel.sh@20 -- # IFS=: 00:05:45.487 03:22:25 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:05:45.487 03:22:25 -- accel/accel.sh@20 -- # read -r var val 00:05:45.487 03:22:25 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:05:45.487 03:22:25 -- accel/accel.sh@12 -- # build_accel_config 00:05:45.487 03:22:25 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:45.487 03:22:25 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:45.487 03:22:25 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:45.487 03:22:25 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:45.487 03:22:25 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:45.487 03:22:25 -- accel/accel.sh@41 -- # local IFS=, 00:05:45.487 03:22:25 -- accel/accel.sh@42 -- # jq -r . 00:05:45.487 [2024-11-21 03:22:25.924317] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:45.487 [2024-11-21 03:22:25.924409] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2941341 ] 00:05:45.487 EAL: No free 2048 kB hugepages reported on node 1 00:05:45.487 [2024-11-21 03:22:25.990470] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:45.487 [2024-11-21 03:22:26.107785] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:45.747 03:22:26 -- accel/accel.sh@21 -- # val= 00:05:45.747 03:22:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.747 03:22:26 -- accel/accel.sh@20 -- # IFS=: 00:05:45.747 03:22:26 -- accel/accel.sh@20 -- # read -r var val 00:05:45.747 03:22:26 -- accel/accel.sh@21 -- # val= 00:05:45.747 03:22:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.747 03:22:26 -- accel/accel.sh@20 -- # IFS=: 00:05:45.747 03:22:26 -- accel/accel.sh@20 -- # read -r var val 00:05:45.747 03:22:26 -- accel/accel.sh@21 -- # val=0x1 00:05:45.747 03:22:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.747 03:22:26 -- accel/accel.sh@20 -- # IFS=: 00:05:45.747 03:22:26 -- accel/accel.sh@20 -- # read -r var val 00:05:45.747 03:22:26 -- accel/accel.sh@21 -- # val= 00:05:45.747 03:22:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.747 03:22:26 -- accel/accel.sh@20 -- # IFS=: 00:05:45.747 03:22:26 -- accel/accel.sh@20 -- # read -r var val 00:05:45.747 03:22:26 -- accel/accel.sh@21 -- # val= 00:05:45.747 03:22:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.747 03:22:26 -- accel/accel.sh@20 -- # IFS=: 00:05:45.747 03:22:26 -- accel/accel.sh@20 -- # read -r var val 00:05:45.747 03:22:26 -- accel/accel.sh@21 -- # val=copy_crc32c 00:05:45.747 03:22:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.747 03:22:26 -- accel/accel.sh@24 -- # accel_opc=copy_crc32c 00:05:45.747 03:22:26 -- accel/accel.sh@20 -- # IFS=: 00:05:45.747 03:22:26 -- accel/accel.sh@20 -- # read -r var val 00:05:45.747 03:22:26 -- accel/accel.sh@21 -- # val=0 00:05:45.747 03:22:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.747 03:22:26 -- accel/accel.sh@20 -- # IFS=: 00:05:45.747 03:22:26 -- accel/accel.sh@20 -- # read -r var val 00:05:45.747 03:22:26 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:45.747 03:22:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.747 03:22:26 -- accel/accel.sh@20 -- # IFS=: 00:05:45.747 03:22:26 -- accel/accel.sh@20 -- # read -r var val 00:05:45.747 03:22:26 -- accel/accel.sh@21 -- # val='8192 bytes' 00:05:45.747 03:22:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.747 03:22:26 -- accel/accel.sh@20 -- # IFS=: 00:05:45.747 03:22:26 -- accel/accel.sh@20 -- # read -r var val 00:05:45.747 03:22:26 -- accel/accel.sh@21 -- # val= 00:05:45.747 03:22:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.747 03:22:26 -- accel/accel.sh@20 -- # IFS=: 00:05:45.747 03:22:26 -- accel/accel.sh@20 -- # read -r var val 00:05:45.747 03:22:26 -- accel/accel.sh@21 -- # val=software 00:05:45.747 03:22:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.747 03:22:26 -- accel/accel.sh@23 -- # accel_module=software 00:05:45.747 03:22:26 -- accel/accel.sh@20 -- # IFS=: 00:05:45.747 03:22:26 -- accel/accel.sh@20 -- # read -r var val 00:05:45.747 03:22:26 -- accel/accel.sh@21 -- # val=32 00:05:45.747 03:22:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.747 03:22:26 -- accel/accel.sh@20 -- # IFS=: 00:05:45.747 03:22:26 -- accel/accel.sh@20 -- # read -r var val 00:05:45.747 03:22:26 -- accel/accel.sh@21 -- # val=32 00:05:45.747 03:22:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.747 03:22:26 -- accel/accel.sh@20 -- # IFS=: 00:05:45.747 03:22:26 -- accel/accel.sh@20 -- # read -r var val 00:05:45.747 03:22:26 -- accel/accel.sh@21 -- # val=1 00:05:45.747 03:22:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.747 03:22:26 -- accel/accel.sh@20 -- # IFS=: 00:05:45.747 03:22:26 -- accel/accel.sh@20 -- # read -r var val 00:05:45.747 03:22:26 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:45.747 03:22:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.747 03:22:26 -- accel/accel.sh@20 -- # IFS=: 00:05:45.747 03:22:26 -- accel/accel.sh@20 -- # read -r var val 00:05:45.747 03:22:26 -- accel/accel.sh@21 -- # val=Yes 00:05:45.747 03:22:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.747 03:22:26 -- accel/accel.sh@20 -- # IFS=: 00:05:45.747 03:22:26 -- accel/accel.sh@20 -- # read -r var val 00:05:45.747 03:22:26 -- accel/accel.sh@21 -- # val= 00:05:45.747 03:22:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.747 03:22:26 -- accel/accel.sh@20 -- # IFS=: 00:05:45.747 03:22:26 -- accel/accel.sh@20 -- # read -r var val 00:05:45.747 03:22:26 -- accel/accel.sh@21 -- # val= 00:05:45.747 03:22:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.747 03:22:26 -- accel/accel.sh@20 -- # IFS=: 00:05:45.747 03:22:26 -- accel/accel.sh@20 -- # read -r var val 00:05:47.128 03:22:27 -- accel/accel.sh@21 -- # val= 00:05:47.128 03:22:27 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.128 03:22:27 -- accel/accel.sh@20 -- # IFS=: 00:05:47.128 03:22:27 -- accel/accel.sh@20 -- # read -r var val 00:05:47.128 03:22:27 -- accel/accel.sh@21 -- # val= 00:05:47.128 03:22:27 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.128 03:22:27 -- accel/accel.sh@20 -- # IFS=: 00:05:47.128 03:22:27 -- accel/accel.sh@20 -- # read -r var val 00:05:47.128 03:22:27 -- accel/accel.sh@21 -- # val= 00:05:47.128 03:22:27 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.128 03:22:27 -- accel/accel.sh@20 -- # IFS=: 00:05:47.128 03:22:27 -- accel/accel.sh@20 -- # read -r var val 00:05:47.128 03:22:27 -- accel/accel.sh@21 -- # val= 00:05:47.128 03:22:27 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.128 03:22:27 -- accel/accel.sh@20 -- # IFS=: 00:05:47.128 03:22:27 -- accel/accel.sh@20 -- # read -r var val 00:05:47.128 03:22:27 -- accel/accel.sh@21 -- # val= 00:05:47.128 03:22:27 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.128 03:22:27 -- accel/accel.sh@20 -- # IFS=: 00:05:47.128 03:22:27 -- accel/accel.sh@20 -- # read -r var val 00:05:47.128 03:22:27 -- accel/accel.sh@21 -- # val= 00:05:47.128 03:22:27 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.128 03:22:27 -- accel/accel.sh@20 -- # IFS=: 00:05:47.128 03:22:27 -- accel/accel.sh@20 -- # read -r var val 00:05:47.128 03:22:27 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:47.128 03:22:27 -- accel/accel.sh@28 -- # [[ -n copy_crc32c ]] 00:05:47.128 03:22:27 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:47.128 00:05:47.128 real 0m2.959s 00:05:47.128 user 0m2.657s 00:05:47.128 sys 0m0.293s 00:05:47.128 03:22:27 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:47.128 03:22:27 -- common/autotest_common.sh@10 -- # set +x 00:05:47.128 ************************************ 00:05:47.128 END TEST accel_copy_crc32c_C2 00:05:47.128 ************************************ 00:05:47.128 03:22:27 -- accel/accel.sh@99 -- # run_test accel_dualcast accel_test -t 1 -w dualcast -y 00:05:47.128 03:22:27 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:47.128 03:22:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:47.128 03:22:27 -- common/autotest_common.sh@10 -- # set +x 00:05:47.128 ************************************ 00:05:47.128 START TEST accel_dualcast 00:05:47.128 ************************************ 00:05:47.128 03:22:27 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dualcast -y 00:05:47.128 03:22:27 -- accel/accel.sh@16 -- # local accel_opc 00:05:47.128 03:22:27 -- accel/accel.sh@17 -- # local accel_module 00:05:47.128 03:22:27 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dualcast -y 00:05:47.128 03:22:27 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:05:47.128 03:22:27 -- accel/accel.sh@12 -- # build_accel_config 00:05:47.128 03:22:27 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:47.128 03:22:27 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:47.128 03:22:27 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:47.128 03:22:27 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:47.128 03:22:27 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:47.128 03:22:27 -- accel/accel.sh@41 -- # local IFS=, 00:05:47.128 03:22:27 -- accel/accel.sh@42 -- # jq -r . 00:05:47.128 [2024-11-21 03:22:27.433499] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:47.128 [2024-11-21 03:22:27.433581] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2941504 ] 00:05:47.128 EAL: No free 2048 kB hugepages reported on node 1 00:05:47.128 [2024-11-21 03:22:27.497454] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:47.128 [2024-11-21 03:22:27.615588] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:48.507 03:22:28 -- accel/accel.sh@18 -- # out=' 00:05:48.507 SPDK Configuration: 00:05:48.507 Core mask: 0x1 00:05:48.507 00:05:48.507 Accel Perf Configuration: 00:05:48.507 Workload Type: dualcast 00:05:48.507 Transfer size: 4096 bytes 00:05:48.507 Vector count 1 00:05:48.507 Module: software 00:05:48.507 Queue depth: 32 00:05:48.507 Allocate depth: 32 00:05:48.507 # threads/core: 1 00:05:48.507 Run time: 1 seconds 00:05:48.507 Verify: Yes 00:05:48.507 00:05:48.507 Running for 1 seconds... 00:05:48.507 00:05:48.507 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:48.507 ------------------------------------------------------------------------------------ 00:05:48.507 0,0 298592/s 1166 MiB/s 0 0 00:05:48.507 ==================================================================================== 00:05:48.507 Total 298592/s 1166 MiB/s 0 0' 00:05:48.507 03:22:28 -- accel/accel.sh@20 -- # IFS=: 00:05:48.507 03:22:28 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dualcast -y 00:05:48.507 03:22:28 -- accel/accel.sh@20 -- # read -r var val 00:05:48.507 03:22:28 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:05:48.507 03:22:28 -- accel/accel.sh@12 -- # build_accel_config 00:05:48.507 03:22:28 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:48.507 03:22:28 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:48.507 03:22:28 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:48.507 03:22:28 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:48.507 03:22:28 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:48.507 03:22:28 -- accel/accel.sh@41 -- # local IFS=, 00:05:48.507 03:22:28 -- accel/accel.sh@42 -- # jq -r . 00:05:48.507 [2024-11-21 03:22:28.918030] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:48.507 [2024-11-21 03:22:28.918138] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2941650 ] 00:05:48.507 EAL: No free 2048 kB hugepages reported on node 1 00:05:48.507 [2024-11-21 03:22:28.981018] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:48.507 [2024-11-21 03:22:29.101203] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:48.765 03:22:29 -- accel/accel.sh@21 -- # val= 00:05:48.765 03:22:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.765 03:22:29 -- accel/accel.sh@20 -- # IFS=: 00:05:48.765 03:22:29 -- accel/accel.sh@20 -- # read -r var val 00:05:48.765 03:22:29 -- accel/accel.sh@21 -- # val= 00:05:48.765 03:22:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.765 03:22:29 -- accel/accel.sh@20 -- # IFS=: 00:05:48.765 03:22:29 -- accel/accel.sh@20 -- # read -r var val 00:05:48.765 03:22:29 -- accel/accel.sh@21 -- # val=0x1 00:05:48.765 03:22:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.765 03:22:29 -- accel/accel.sh@20 -- # IFS=: 00:05:48.765 03:22:29 -- accel/accel.sh@20 -- # read -r var val 00:05:48.765 03:22:29 -- accel/accel.sh@21 -- # val= 00:05:48.765 03:22:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.765 03:22:29 -- accel/accel.sh@20 -- # IFS=: 00:05:48.765 03:22:29 -- accel/accel.sh@20 -- # read -r var val 00:05:48.765 03:22:29 -- accel/accel.sh@21 -- # val= 00:05:48.765 03:22:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.765 03:22:29 -- accel/accel.sh@20 -- # IFS=: 00:05:48.766 03:22:29 -- accel/accel.sh@20 -- # read -r var val 00:05:48.766 03:22:29 -- accel/accel.sh@21 -- # val=dualcast 00:05:48.766 03:22:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.766 03:22:29 -- accel/accel.sh@24 -- # accel_opc=dualcast 00:05:48.766 03:22:29 -- accel/accel.sh@20 -- # IFS=: 00:05:48.766 03:22:29 -- accel/accel.sh@20 -- # read -r var val 00:05:48.766 03:22:29 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:48.766 03:22:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.766 03:22:29 -- accel/accel.sh@20 -- # IFS=: 00:05:48.766 03:22:29 -- accel/accel.sh@20 -- # read -r var val 00:05:48.766 03:22:29 -- accel/accel.sh@21 -- # val= 00:05:48.766 03:22:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.766 03:22:29 -- accel/accel.sh@20 -- # IFS=: 00:05:48.766 03:22:29 -- accel/accel.sh@20 -- # read -r var val 00:05:48.766 03:22:29 -- accel/accel.sh@21 -- # val=software 00:05:48.766 03:22:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.766 03:22:29 -- accel/accel.sh@23 -- # accel_module=software 00:05:48.766 03:22:29 -- accel/accel.sh@20 -- # IFS=: 00:05:48.766 03:22:29 -- accel/accel.sh@20 -- # read -r var val 00:05:48.766 03:22:29 -- accel/accel.sh@21 -- # val=32 00:05:48.766 03:22:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.766 03:22:29 -- accel/accel.sh@20 -- # IFS=: 00:05:48.766 03:22:29 -- accel/accel.sh@20 -- # read -r var val 00:05:48.766 03:22:29 -- accel/accel.sh@21 -- # val=32 00:05:48.766 03:22:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.766 03:22:29 -- accel/accel.sh@20 -- # IFS=: 00:05:48.766 03:22:29 -- accel/accel.sh@20 -- # read -r var val 00:05:48.766 03:22:29 -- accel/accel.sh@21 -- # val=1 00:05:48.766 03:22:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.766 03:22:29 -- accel/accel.sh@20 -- # IFS=: 00:05:48.766 03:22:29 -- accel/accel.sh@20 -- # read -r var val 00:05:48.766 03:22:29 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:48.766 03:22:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.766 03:22:29 -- accel/accel.sh@20 -- # IFS=: 00:05:48.766 03:22:29 -- accel/accel.sh@20 -- # read -r var val 00:05:48.766 03:22:29 -- accel/accel.sh@21 -- # val=Yes 00:05:48.766 03:22:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.766 03:22:29 -- accel/accel.sh@20 -- # IFS=: 00:05:48.766 03:22:29 -- accel/accel.sh@20 -- # read -r var val 00:05:48.766 03:22:29 -- accel/accel.sh@21 -- # val= 00:05:48.766 03:22:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.766 03:22:29 -- accel/accel.sh@20 -- # IFS=: 00:05:48.766 03:22:29 -- accel/accel.sh@20 -- # read -r var val 00:05:48.766 03:22:29 -- accel/accel.sh@21 -- # val= 00:05:48.766 03:22:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.766 03:22:29 -- accel/accel.sh@20 -- # IFS=: 00:05:48.766 03:22:29 -- accel/accel.sh@20 -- # read -r var val 00:05:50.147 03:22:30 -- accel/accel.sh@21 -- # val= 00:05:50.147 03:22:30 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.147 03:22:30 -- accel/accel.sh@20 -- # IFS=: 00:05:50.147 03:22:30 -- accel/accel.sh@20 -- # read -r var val 00:05:50.147 03:22:30 -- accel/accel.sh@21 -- # val= 00:05:50.147 03:22:30 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.147 03:22:30 -- accel/accel.sh@20 -- # IFS=: 00:05:50.147 03:22:30 -- accel/accel.sh@20 -- # read -r var val 00:05:50.147 03:22:30 -- accel/accel.sh@21 -- # val= 00:05:50.147 03:22:30 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.147 03:22:30 -- accel/accel.sh@20 -- # IFS=: 00:05:50.147 03:22:30 -- accel/accel.sh@20 -- # read -r var val 00:05:50.147 03:22:30 -- accel/accel.sh@21 -- # val= 00:05:50.147 03:22:30 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.147 03:22:30 -- accel/accel.sh@20 -- # IFS=: 00:05:50.147 03:22:30 -- accel/accel.sh@20 -- # read -r var val 00:05:50.147 03:22:30 -- accel/accel.sh@21 -- # val= 00:05:50.147 03:22:30 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.147 03:22:30 -- accel/accel.sh@20 -- # IFS=: 00:05:50.147 03:22:30 -- accel/accel.sh@20 -- # read -r var val 00:05:50.147 03:22:30 -- accel/accel.sh@21 -- # val= 00:05:50.147 03:22:30 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.147 03:22:30 -- accel/accel.sh@20 -- # IFS=: 00:05:50.147 03:22:30 -- accel/accel.sh@20 -- # read -r var val 00:05:50.147 03:22:30 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:50.147 03:22:30 -- accel/accel.sh@28 -- # [[ -n dualcast ]] 00:05:50.147 03:22:30 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:50.147 00:05:50.147 real 0m2.970s 00:05:50.147 user 0m2.672s 00:05:50.147 sys 0m0.287s 00:05:50.147 03:22:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:50.147 03:22:30 -- common/autotest_common.sh@10 -- # set +x 00:05:50.147 ************************************ 00:05:50.147 END TEST accel_dualcast 00:05:50.147 ************************************ 00:05:50.147 03:22:30 -- accel/accel.sh@100 -- # run_test accel_compare accel_test -t 1 -w compare -y 00:05:50.147 03:22:30 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:50.147 03:22:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:50.147 03:22:30 -- common/autotest_common.sh@10 -- # set +x 00:05:50.147 ************************************ 00:05:50.147 START TEST accel_compare 00:05:50.147 ************************************ 00:05:50.147 03:22:30 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w compare -y 00:05:50.147 03:22:30 -- accel/accel.sh@16 -- # local accel_opc 00:05:50.147 03:22:30 -- accel/accel.sh@17 -- # local accel_module 00:05:50.147 03:22:30 -- accel/accel.sh@18 -- # accel_perf -t 1 -w compare -y 00:05:50.147 03:22:30 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:05:50.147 03:22:30 -- accel/accel.sh@12 -- # build_accel_config 00:05:50.147 03:22:30 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:50.147 03:22:30 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:50.147 03:22:30 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:50.147 03:22:30 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:50.147 03:22:30 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:50.147 03:22:30 -- accel/accel.sh@41 -- # local IFS=, 00:05:50.147 03:22:30 -- accel/accel.sh@42 -- # jq -r . 00:05:50.147 [2024-11-21 03:22:30.427252] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:50.147 [2024-11-21 03:22:30.427332] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2941893 ] 00:05:50.147 EAL: No free 2048 kB hugepages reported on node 1 00:05:50.147 [2024-11-21 03:22:30.487953] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:50.147 [2024-11-21 03:22:30.612327] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:51.528 03:22:31 -- accel/accel.sh@18 -- # out=' 00:05:51.528 SPDK Configuration: 00:05:51.528 Core mask: 0x1 00:05:51.528 00:05:51.528 Accel Perf Configuration: 00:05:51.528 Workload Type: compare 00:05:51.528 Transfer size: 4096 bytes 00:05:51.528 Vector count 1 00:05:51.528 Module: software 00:05:51.528 Queue depth: 32 00:05:51.528 Allocate depth: 32 00:05:51.528 # threads/core: 1 00:05:51.528 Run time: 1 seconds 00:05:51.528 Verify: Yes 00:05:51.528 00:05:51.528 Running for 1 seconds... 00:05:51.528 00:05:51.528 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:51.528 ------------------------------------------------------------------------------------ 00:05:51.528 0,0 397728/s 1553 MiB/s 0 0 00:05:51.529 ==================================================================================== 00:05:51.529 Total 397728/s 1553 MiB/s 0 0' 00:05:51.529 03:22:31 -- accel/accel.sh@20 -- # IFS=: 00:05:51.529 03:22:31 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compare -y 00:05:51.529 03:22:31 -- accel/accel.sh@20 -- # read -r var val 00:05:51.529 03:22:31 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:05:51.529 03:22:31 -- accel/accel.sh@12 -- # build_accel_config 00:05:51.529 03:22:31 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:51.529 03:22:31 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:51.529 03:22:31 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:51.529 03:22:31 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:51.529 03:22:31 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:51.529 03:22:31 -- accel/accel.sh@41 -- # local IFS=, 00:05:51.529 03:22:31 -- accel/accel.sh@42 -- # jq -r . 00:05:51.529 [2024-11-21 03:22:31.903035] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:51.529 [2024-11-21 03:22:31.903145] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2942077 ] 00:05:51.529 EAL: No free 2048 kB hugepages reported on node 1 00:05:51.529 [2024-11-21 03:22:31.963888] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:51.529 [2024-11-21 03:22:32.083494] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:51.529 03:22:32 -- accel/accel.sh@21 -- # val= 00:05:51.529 03:22:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.529 03:22:32 -- accel/accel.sh@20 -- # IFS=: 00:05:51.529 03:22:32 -- accel/accel.sh@20 -- # read -r var val 00:05:51.529 03:22:32 -- accel/accel.sh@21 -- # val= 00:05:51.529 03:22:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.529 03:22:32 -- accel/accel.sh@20 -- # IFS=: 00:05:51.529 03:22:32 -- accel/accel.sh@20 -- # read -r var val 00:05:51.529 03:22:32 -- accel/accel.sh@21 -- # val=0x1 00:05:51.529 03:22:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.529 03:22:32 -- accel/accel.sh@20 -- # IFS=: 00:05:51.529 03:22:32 -- accel/accel.sh@20 -- # read -r var val 00:05:51.529 03:22:32 -- accel/accel.sh@21 -- # val= 00:05:51.529 03:22:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.529 03:22:32 -- accel/accel.sh@20 -- # IFS=: 00:05:51.529 03:22:32 -- accel/accel.sh@20 -- # read -r var val 00:05:51.529 03:22:32 -- accel/accel.sh@21 -- # val= 00:05:51.529 03:22:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.529 03:22:32 -- accel/accel.sh@20 -- # IFS=: 00:05:51.529 03:22:32 -- accel/accel.sh@20 -- # read -r var val 00:05:51.529 03:22:32 -- accel/accel.sh@21 -- # val=compare 00:05:51.529 03:22:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.529 03:22:32 -- accel/accel.sh@24 -- # accel_opc=compare 00:05:51.529 03:22:32 -- accel/accel.sh@20 -- # IFS=: 00:05:51.529 03:22:32 -- accel/accel.sh@20 -- # read -r var val 00:05:51.529 03:22:32 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:51.529 03:22:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.529 03:22:32 -- accel/accel.sh@20 -- # IFS=: 00:05:51.529 03:22:32 -- accel/accel.sh@20 -- # read -r var val 00:05:51.529 03:22:32 -- accel/accel.sh@21 -- # val= 00:05:51.529 03:22:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.529 03:22:32 -- accel/accel.sh@20 -- # IFS=: 00:05:51.529 03:22:32 -- accel/accel.sh@20 -- # read -r var val 00:05:51.529 03:22:32 -- accel/accel.sh@21 -- # val=software 00:05:51.529 03:22:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.529 03:22:32 -- accel/accel.sh@23 -- # accel_module=software 00:05:51.529 03:22:32 -- accel/accel.sh@20 -- # IFS=: 00:05:51.529 03:22:32 -- accel/accel.sh@20 -- # read -r var val 00:05:51.529 03:22:32 -- accel/accel.sh@21 -- # val=32 00:05:51.529 03:22:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.529 03:22:32 -- accel/accel.sh@20 -- # IFS=: 00:05:51.529 03:22:32 -- accel/accel.sh@20 -- # read -r var val 00:05:51.529 03:22:32 -- accel/accel.sh@21 -- # val=32 00:05:51.529 03:22:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.529 03:22:32 -- accel/accel.sh@20 -- # IFS=: 00:05:51.529 03:22:32 -- accel/accel.sh@20 -- # read -r var val 00:05:51.529 03:22:32 -- accel/accel.sh@21 -- # val=1 00:05:51.529 03:22:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.529 03:22:32 -- accel/accel.sh@20 -- # IFS=: 00:05:51.529 03:22:32 -- accel/accel.sh@20 -- # read -r var val 00:05:51.529 03:22:32 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:51.529 03:22:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.529 03:22:32 -- accel/accel.sh@20 -- # IFS=: 00:05:51.529 03:22:32 -- accel/accel.sh@20 -- # read -r var val 00:05:51.529 03:22:32 -- accel/accel.sh@21 -- # val=Yes 00:05:51.529 03:22:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.529 03:22:32 -- accel/accel.sh@20 -- # IFS=: 00:05:51.529 03:22:32 -- accel/accel.sh@20 -- # read -r var val 00:05:51.529 03:22:32 -- accel/accel.sh@21 -- # val= 00:05:51.529 03:22:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.529 03:22:32 -- accel/accel.sh@20 -- # IFS=: 00:05:51.529 03:22:32 -- accel/accel.sh@20 -- # read -r var val 00:05:51.529 03:22:32 -- accel/accel.sh@21 -- # val= 00:05:51.529 03:22:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.529 03:22:32 -- accel/accel.sh@20 -- # IFS=: 00:05:51.529 03:22:32 -- accel/accel.sh@20 -- # read -r var val 00:05:52.910 03:22:33 -- accel/accel.sh@21 -- # val= 00:05:52.910 03:22:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.910 03:22:33 -- accel/accel.sh@20 -- # IFS=: 00:05:52.910 03:22:33 -- accel/accel.sh@20 -- # read -r var val 00:05:52.910 03:22:33 -- accel/accel.sh@21 -- # val= 00:05:52.910 03:22:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.910 03:22:33 -- accel/accel.sh@20 -- # IFS=: 00:05:52.910 03:22:33 -- accel/accel.sh@20 -- # read -r var val 00:05:52.910 03:22:33 -- accel/accel.sh@21 -- # val= 00:05:52.910 03:22:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.910 03:22:33 -- accel/accel.sh@20 -- # IFS=: 00:05:52.910 03:22:33 -- accel/accel.sh@20 -- # read -r var val 00:05:52.910 03:22:33 -- accel/accel.sh@21 -- # val= 00:05:52.910 03:22:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.910 03:22:33 -- accel/accel.sh@20 -- # IFS=: 00:05:52.910 03:22:33 -- accel/accel.sh@20 -- # read -r var val 00:05:52.910 03:22:33 -- accel/accel.sh@21 -- # val= 00:05:52.910 03:22:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.910 03:22:33 -- accel/accel.sh@20 -- # IFS=: 00:05:52.910 03:22:33 -- accel/accel.sh@20 -- # read -r var val 00:05:52.910 03:22:33 -- accel/accel.sh@21 -- # val= 00:05:52.910 03:22:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.910 03:22:33 -- accel/accel.sh@20 -- # IFS=: 00:05:52.910 03:22:33 -- accel/accel.sh@20 -- # read -r var val 00:05:52.910 03:22:33 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:52.910 03:22:33 -- accel/accel.sh@28 -- # [[ -n compare ]] 00:05:52.910 03:22:33 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:52.910 00:05:52.910 real 0m2.960s 00:05:52.910 user 0m2.674s 00:05:52.910 sys 0m0.275s 00:05:52.910 03:22:33 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:52.910 03:22:33 -- common/autotest_common.sh@10 -- # set +x 00:05:52.910 ************************************ 00:05:52.910 END TEST accel_compare 00:05:52.910 ************************************ 00:05:52.910 03:22:33 -- accel/accel.sh@101 -- # run_test accel_xor accel_test -t 1 -w xor -y 00:05:52.910 03:22:33 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:52.910 03:22:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:52.910 03:22:33 -- common/autotest_common.sh@10 -- # set +x 00:05:52.910 ************************************ 00:05:52.910 START TEST accel_xor 00:05:52.910 ************************************ 00:05:52.910 03:22:33 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w xor -y 00:05:52.910 03:22:33 -- accel/accel.sh@16 -- # local accel_opc 00:05:52.910 03:22:33 -- accel/accel.sh@17 -- # local accel_module 00:05:52.910 03:22:33 -- accel/accel.sh@18 -- # accel_perf -t 1 -w xor -y 00:05:52.910 03:22:33 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:05:52.910 03:22:33 -- accel/accel.sh@12 -- # build_accel_config 00:05:52.910 03:22:33 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:52.910 03:22:33 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:52.910 03:22:33 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:52.910 03:22:33 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:52.910 03:22:33 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:52.910 03:22:33 -- accel/accel.sh@41 -- # local IFS=, 00:05:52.910 03:22:33 -- accel/accel.sh@42 -- # jq -r . 00:05:52.910 [2024-11-21 03:22:33.418341] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:52.910 [2024-11-21 03:22:33.418425] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2942231 ] 00:05:52.910 EAL: No free 2048 kB hugepages reported on node 1 00:05:52.910 [2024-11-21 03:22:33.482223] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:53.169 [2024-11-21 03:22:33.600326] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:54.549 03:22:34 -- accel/accel.sh@18 -- # out=' 00:05:54.549 SPDK Configuration: 00:05:54.549 Core mask: 0x1 00:05:54.549 00:05:54.549 Accel Perf Configuration: 00:05:54.549 Workload Type: xor 00:05:54.549 Source buffers: 2 00:05:54.549 Transfer size: 4096 bytes 00:05:54.549 Vector count 1 00:05:54.549 Module: software 00:05:54.549 Queue depth: 32 00:05:54.549 Allocate depth: 32 00:05:54.549 # threads/core: 1 00:05:54.549 Run time: 1 seconds 00:05:54.549 Verify: Yes 00:05:54.549 00:05:54.549 Running for 1 seconds... 00:05:54.549 00:05:54.549 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:54.549 ------------------------------------------------------------------------------------ 00:05:54.549 0,0 190528/s 744 MiB/s 0 0 00:05:54.549 ==================================================================================== 00:05:54.549 Total 190528/s 744 MiB/s 0 0' 00:05:54.549 03:22:34 -- accel/accel.sh@20 -- # IFS=: 00:05:54.549 03:22:34 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y 00:05:54.549 03:22:34 -- accel/accel.sh@20 -- # read -r var val 00:05:54.549 03:22:34 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:05:54.549 03:22:34 -- accel/accel.sh@12 -- # build_accel_config 00:05:54.549 03:22:34 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:54.549 03:22:34 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:54.549 03:22:34 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:54.549 03:22:34 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:54.549 03:22:34 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:54.549 03:22:34 -- accel/accel.sh@41 -- # local IFS=, 00:05:54.549 03:22:34 -- accel/accel.sh@42 -- # jq -r . 00:05:54.549 [2024-11-21 03:22:34.901590] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:54.549 [2024-11-21 03:22:34.901682] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2942402 ] 00:05:54.549 EAL: No free 2048 kB hugepages reported on node 1 00:05:54.549 [2024-11-21 03:22:34.964279] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:54.549 [2024-11-21 03:22:35.083761] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:54.549 03:22:35 -- accel/accel.sh@21 -- # val= 00:05:54.549 03:22:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.549 03:22:35 -- accel/accel.sh@20 -- # IFS=: 00:05:54.549 03:22:35 -- accel/accel.sh@20 -- # read -r var val 00:05:54.549 03:22:35 -- accel/accel.sh@21 -- # val= 00:05:54.549 03:22:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.549 03:22:35 -- accel/accel.sh@20 -- # IFS=: 00:05:54.549 03:22:35 -- accel/accel.sh@20 -- # read -r var val 00:05:54.549 03:22:35 -- accel/accel.sh@21 -- # val=0x1 00:05:54.549 03:22:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.549 03:22:35 -- accel/accel.sh@20 -- # IFS=: 00:05:54.549 03:22:35 -- accel/accel.sh@20 -- # read -r var val 00:05:54.549 03:22:35 -- accel/accel.sh@21 -- # val= 00:05:54.549 03:22:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.549 03:22:35 -- accel/accel.sh@20 -- # IFS=: 00:05:54.549 03:22:35 -- accel/accel.sh@20 -- # read -r var val 00:05:54.549 03:22:35 -- accel/accel.sh@21 -- # val= 00:05:54.549 03:22:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.549 03:22:35 -- accel/accel.sh@20 -- # IFS=: 00:05:54.549 03:22:35 -- accel/accel.sh@20 -- # read -r var val 00:05:54.549 03:22:35 -- accel/accel.sh@21 -- # val=xor 00:05:54.549 03:22:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.549 03:22:35 -- accel/accel.sh@24 -- # accel_opc=xor 00:05:54.549 03:22:35 -- accel/accel.sh@20 -- # IFS=: 00:05:54.549 03:22:35 -- accel/accel.sh@20 -- # read -r var val 00:05:54.549 03:22:35 -- accel/accel.sh@21 -- # val=2 00:05:54.549 03:22:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.549 03:22:35 -- accel/accel.sh@20 -- # IFS=: 00:05:54.549 03:22:35 -- accel/accel.sh@20 -- # read -r var val 00:05:54.549 03:22:35 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:54.549 03:22:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.549 03:22:35 -- accel/accel.sh@20 -- # IFS=: 00:05:54.549 03:22:35 -- accel/accel.sh@20 -- # read -r var val 00:05:54.549 03:22:35 -- accel/accel.sh@21 -- # val= 00:05:54.549 03:22:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.549 03:22:35 -- accel/accel.sh@20 -- # IFS=: 00:05:54.549 03:22:35 -- accel/accel.sh@20 -- # read -r var val 00:05:54.549 03:22:35 -- accel/accel.sh@21 -- # val=software 00:05:54.549 03:22:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.549 03:22:35 -- accel/accel.sh@23 -- # accel_module=software 00:05:54.549 03:22:35 -- accel/accel.sh@20 -- # IFS=: 00:05:54.549 03:22:35 -- accel/accel.sh@20 -- # read -r var val 00:05:54.549 03:22:35 -- accel/accel.sh@21 -- # val=32 00:05:54.549 03:22:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.549 03:22:35 -- accel/accel.sh@20 -- # IFS=: 00:05:54.549 03:22:35 -- accel/accel.sh@20 -- # read -r var val 00:05:54.549 03:22:35 -- accel/accel.sh@21 -- # val=32 00:05:54.549 03:22:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.549 03:22:35 -- accel/accel.sh@20 -- # IFS=: 00:05:54.549 03:22:35 -- accel/accel.sh@20 -- # read -r var val 00:05:54.549 03:22:35 -- accel/accel.sh@21 -- # val=1 00:05:54.549 03:22:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.549 03:22:35 -- accel/accel.sh@20 -- # IFS=: 00:05:54.549 03:22:35 -- accel/accel.sh@20 -- # read -r var val 00:05:54.549 03:22:35 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:54.549 03:22:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.549 03:22:35 -- accel/accel.sh@20 -- # IFS=: 00:05:54.549 03:22:35 -- accel/accel.sh@20 -- # read -r var val 00:05:54.549 03:22:35 -- accel/accel.sh@21 -- # val=Yes 00:05:54.549 03:22:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.549 03:22:35 -- accel/accel.sh@20 -- # IFS=: 00:05:54.549 03:22:35 -- accel/accel.sh@20 -- # read -r var val 00:05:54.549 03:22:35 -- accel/accel.sh@21 -- # val= 00:05:54.549 03:22:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.549 03:22:35 -- accel/accel.sh@20 -- # IFS=: 00:05:54.549 03:22:35 -- accel/accel.sh@20 -- # read -r var val 00:05:54.549 03:22:35 -- accel/accel.sh@21 -- # val= 00:05:54.549 03:22:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.549 03:22:35 -- accel/accel.sh@20 -- # IFS=: 00:05:54.549 03:22:35 -- accel/accel.sh@20 -- # read -r var val 00:05:55.927 03:22:36 -- accel/accel.sh@21 -- # val= 00:05:55.927 03:22:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.927 03:22:36 -- accel/accel.sh@20 -- # IFS=: 00:05:55.927 03:22:36 -- accel/accel.sh@20 -- # read -r var val 00:05:55.927 03:22:36 -- accel/accel.sh@21 -- # val= 00:05:55.927 03:22:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.927 03:22:36 -- accel/accel.sh@20 -- # IFS=: 00:05:55.927 03:22:36 -- accel/accel.sh@20 -- # read -r var val 00:05:55.927 03:22:36 -- accel/accel.sh@21 -- # val= 00:05:55.927 03:22:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.927 03:22:36 -- accel/accel.sh@20 -- # IFS=: 00:05:55.927 03:22:36 -- accel/accel.sh@20 -- # read -r var val 00:05:55.927 03:22:36 -- accel/accel.sh@21 -- # val= 00:05:55.927 03:22:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.927 03:22:36 -- accel/accel.sh@20 -- # IFS=: 00:05:55.927 03:22:36 -- accel/accel.sh@20 -- # read -r var val 00:05:55.927 03:22:36 -- accel/accel.sh@21 -- # val= 00:05:55.927 03:22:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.927 03:22:36 -- accel/accel.sh@20 -- # IFS=: 00:05:55.927 03:22:36 -- accel/accel.sh@20 -- # read -r var val 00:05:55.927 03:22:36 -- accel/accel.sh@21 -- # val= 00:05:55.927 03:22:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.927 03:22:36 -- accel/accel.sh@20 -- # IFS=: 00:05:55.927 03:22:36 -- accel/accel.sh@20 -- # read -r var val 00:05:55.927 03:22:36 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:55.927 03:22:36 -- accel/accel.sh@28 -- # [[ -n xor ]] 00:05:55.927 03:22:36 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:55.927 00:05:55.927 real 0m2.969s 00:05:55.927 user 0m2.667s 00:05:55.927 sys 0m0.291s 00:05:55.927 03:22:36 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:55.927 03:22:36 -- common/autotest_common.sh@10 -- # set +x 00:05:55.927 ************************************ 00:05:55.927 END TEST accel_xor 00:05:55.927 ************************************ 00:05:55.927 03:22:36 -- accel/accel.sh@102 -- # run_test accel_xor accel_test -t 1 -w xor -y -x 3 00:05:55.927 03:22:36 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:05:55.927 03:22:36 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:55.927 03:22:36 -- common/autotest_common.sh@10 -- # set +x 00:05:55.927 ************************************ 00:05:55.927 START TEST accel_xor 00:05:55.927 ************************************ 00:05:55.927 03:22:36 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w xor -y -x 3 00:05:55.927 03:22:36 -- accel/accel.sh@16 -- # local accel_opc 00:05:55.927 03:22:36 -- accel/accel.sh@17 -- # local accel_module 00:05:55.927 03:22:36 -- accel/accel.sh@18 -- # accel_perf -t 1 -w xor -y -x 3 00:05:55.927 03:22:36 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:05:55.927 03:22:36 -- accel/accel.sh@12 -- # build_accel_config 00:05:55.927 03:22:36 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:55.927 03:22:36 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:55.928 03:22:36 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:55.928 03:22:36 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:55.928 03:22:36 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:55.928 03:22:36 -- accel/accel.sh@41 -- # local IFS=, 00:05:55.928 03:22:36 -- accel/accel.sh@42 -- # jq -r . 00:05:55.928 [2024-11-21 03:22:36.411706] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:55.928 [2024-11-21 03:22:36.411793] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2942651 ] 00:05:55.928 EAL: No free 2048 kB hugepages reported on node 1 00:05:55.928 [2024-11-21 03:22:36.474349] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:56.187 [2024-11-21 03:22:36.593199] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:57.568 03:22:37 -- accel/accel.sh@18 -- # out=' 00:05:57.568 SPDK Configuration: 00:05:57.568 Core mask: 0x1 00:05:57.568 00:05:57.568 Accel Perf Configuration: 00:05:57.568 Workload Type: xor 00:05:57.568 Source buffers: 3 00:05:57.568 Transfer size: 4096 bytes 00:05:57.568 Vector count 1 00:05:57.568 Module: software 00:05:57.568 Queue depth: 32 00:05:57.568 Allocate depth: 32 00:05:57.568 # threads/core: 1 00:05:57.568 Run time: 1 seconds 00:05:57.568 Verify: Yes 00:05:57.568 00:05:57.568 Running for 1 seconds... 00:05:57.568 00:05:57.568 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:57.568 ------------------------------------------------------------------------------------ 00:05:57.568 0,0 181216/s 707 MiB/s 0 0 00:05:57.568 ==================================================================================== 00:05:57.568 Total 181216/s 707 MiB/s 0 0' 00:05:57.568 03:22:37 -- accel/accel.sh@20 -- # IFS=: 00:05:57.568 03:22:37 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y -x 3 00:05:57.568 03:22:37 -- accel/accel.sh@20 -- # read -r var val 00:05:57.568 03:22:37 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:05:57.568 03:22:37 -- accel/accel.sh@12 -- # build_accel_config 00:05:57.568 03:22:37 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:57.568 03:22:37 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:57.568 03:22:37 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:57.568 03:22:37 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:57.568 03:22:37 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:57.568 03:22:37 -- accel/accel.sh@41 -- # local IFS=, 00:05:57.568 03:22:37 -- accel/accel.sh@42 -- # jq -r . 00:05:57.568 [2024-11-21 03:22:37.892260] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:57.568 [2024-11-21 03:22:37.892352] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2942799 ] 00:05:57.568 EAL: No free 2048 kB hugepages reported on node 1 00:05:57.568 [2024-11-21 03:22:37.954698] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:57.568 [2024-11-21 03:22:38.074715] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:57.568 03:22:38 -- accel/accel.sh@21 -- # val= 00:05:57.568 03:22:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.568 03:22:38 -- accel/accel.sh@20 -- # IFS=: 00:05:57.568 03:22:38 -- accel/accel.sh@20 -- # read -r var val 00:05:57.568 03:22:38 -- accel/accel.sh@21 -- # val= 00:05:57.568 03:22:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.568 03:22:38 -- accel/accel.sh@20 -- # IFS=: 00:05:57.568 03:22:38 -- accel/accel.sh@20 -- # read -r var val 00:05:57.568 03:22:38 -- accel/accel.sh@21 -- # val=0x1 00:05:57.568 03:22:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.568 03:22:38 -- accel/accel.sh@20 -- # IFS=: 00:05:57.568 03:22:38 -- accel/accel.sh@20 -- # read -r var val 00:05:57.568 03:22:38 -- accel/accel.sh@21 -- # val= 00:05:57.568 03:22:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.568 03:22:38 -- accel/accel.sh@20 -- # IFS=: 00:05:57.568 03:22:38 -- accel/accel.sh@20 -- # read -r var val 00:05:57.568 03:22:38 -- accel/accel.sh@21 -- # val= 00:05:57.568 03:22:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.568 03:22:38 -- accel/accel.sh@20 -- # IFS=: 00:05:57.568 03:22:38 -- accel/accel.sh@20 -- # read -r var val 00:05:57.568 03:22:38 -- accel/accel.sh@21 -- # val=xor 00:05:57.568 03:22:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.568 03:22:38 -- accel/accel.sh@24 -- # accel_opc=xor 00:05:57.568 03:22:38 -- accel/accel.sh@20 -- # IFS=: 00:05:57.568 03:22:38 -- accel/accel.sh@20 -- # read -r var val 00:05:57.568 03:22:38 -- accel/accel.sh@21 -- # val=3 00:05:57.568 03:22:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.568 03:22:38 -- accel/accel.sh@20 -- # IFS=: 00:05:57.568 03:22:38 -- accel/accel.sh@20 -- # read -r var val 00:05:57.568 03:22:38 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:57.568 03:22:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.568 03:22:38 -- accel/accel.sh@20 -- # IFS=: 00:05:57.568 03:22:38 -- accel/accel.sh@20 -- # read -r var val 00:05:57.568 03:22:38 -- accel/accel.sh@21 -- # val= 00:05:57.568 03:22:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.568 03:22:38 -- accel/accel.sh@20 -- # IFS=: 00:05:57.568 03:22:38 -- accel/accel.sh@20 -- # read -r var val 00:05:57.568 03:22:38 -- accel/accel.sh@21 -- # val=software 00:05:57.568 03:22:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.568 03:22:38 -- accel/accel.sh@23 -- # accel_module=software 00:05:57.568 03:22:38 -- accel/accel.sh@20 -- # IFS=: 00:05:57.568 03:22:38 -- accel/accel.sh@20 -- # read -r var val 00:05:57.568 03:22:38 -- accel/accel.sh@21 -- # val=32 00:05:57.568 03:22:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.568 03:22:38 -- accel/accel.sh@20 -- # IFS=: 00:05:57.568 03:22:38 -- accel/accel.sh@20 -- # read -r var val 00:05:57.568 03:22:38 -- accel/accel.sh@21 -- # val=32 00:05:57.568 03:22:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.568 03:22:38 -- accel/accel.sh@20 -- # IFS=: 00:05:57.568 03:22:38 -- accel/accel.sh@20 -- # read -r var val 00:05:57.568 03:22:38 -- accel/accel.sh@21 -- # val=1 00:05:57.568 03:22:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.568 03:22:38 -- accel/accel.sh@20 -- # IFS=: 00:05:57.568 03:22:38 -- accel/accel.sh@20 -- # read -r var val 00:05:57.568 03:22:38 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:57.568 03:22:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.568 03:22:38 -- accel/accel.sh@20 -- # IFS=: 00:05:57.568 03:22:38 -- accel/accel.sh@20 -- # read -r var val 00:05:57.568 03:22:38 -- accel/accel.sh@21 -- # val=Yes 00:05:57.568 03:22:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.568 03:22:38 -- accel/accel.sh@20 -- # IFS=: 00:05:57.568 03:22:38 -- accel/accel.sh@20 -- # read -r var val 00:05:57.568 03:22:38 -- accel/accel.sh@21 -- # val= 00:05:57.568 03:22:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.568 03:22:38 -- accel/accel.sh@20 -- # IFS=: 00:05:57.568 03:22:38 -- accel/accel.sh@20 -- # read -r var val 00:05:57.568 03:22:38 -- accel/accel.sh@21 -- # val= 00:05:57.568 03:22:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.568 03:22:38 -- accel/accel.sh@20 -- # IFS=: 00:05:57.568 03:22:38 -- accel/accel.sh@20 -- # read -r var val 00:05:58.950 03:22:39 -- accel/accel.sh@21 -- # val= 00:05:58.950 03:22:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.950 03:22:39 -- accel/accel.sh@20 -- # IFS=: 00:05:58.950 03:22:39 -- accel/accel.sh@20 -- # read -r var val 00:05:58.950 03:22:39 -- accel/accel.sh@21 -- # val= 00:05:58.950 03:22:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.950 03:22:39 -- accel/accel.sh@20 -- # IFS=: 00:05:58.950 03:22:39 -- accel/accel.sh@20 -- # read -r var val 00:05:58.950 03:22:39 -- accel/accel.sh@21 -- # val= 00:05:58.950 03:22:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.950 03:22:39 -- accel/accel.sh@20 -- # IFS=: 00:05:58.950 03:22:39 -- accel/accel.sh@20 -- # read -r var val 00:05:58.950 03:22:39 -- accel/accel.sh@21 -- # val= 00:05:58.950 03:22:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.950 03:22:39 -- accel/accel.sh@20 -- # IFS=: 00:05:58.950 03:22:39 -- accel/accel.sh@20 -- # read -r var val 00:05:58.950 03:22:39 -- accel/accel.sh@21 -- # val= 00:05:58.950 03:22:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.950 03:22:39 -- accel/accel.sh@20 -- # IFS=: 00:05:58.950 03:22:39 -- accel/accel.sh@20 -- # read -r var val 00:05:58.950 03:22:39 -- accel/accel.sh@21 -- # val= 00:05:58.950 03:22:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.950 03:22:39 -- accel/accel.sh@20 -- # IFS=: 00:05:58.950 03:22:39 -- accel/accel.sh@20 -- # read -r var val 00:05:58.950 03:22:39 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:58.950 03:22:39 -- accel/accel.sh@28 -- # [[ -n xor ]] 00:05:58.950 03:22:39 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:58.950 00:05:58.950 real 0m2.968s 00:05:58.950 user 0m2.672s 00:05:58.950 sys 0m0.285s 00:05:58.950 03:22:39 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:58.950 03:22:39 -- common/autotest_common.sh@10 -- # set +x 00:05:58.950 ************************************ 00:05:58.950 END TEST accel_xor 00:05:58.950 ************************************ 00:05:58.950 03:22:39 -- accel/accel.sh@103 -- # run_test accel_dif_verify accel_test -t 1 -w dif_verify 00:05:58.950 03:22:39 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:05:58.950 03:22:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:58.950 03:22:39 -- common/autotest_common.sh@10 -- # set +x 00:05:58.950 ************************************ 00:05:58.950 START TEST accel_dif_verify 00:05:58.950 ************************************ 00:05:58.950 03:22:39 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_verify 00:05:58.950 03:22:39 -- accel/accel.sh@16 -- # local accel_opc 00:05:58.950 03:22:39 -- accel/accel.sh@17 -- # local accel_module 00:05:58.950 03:22:39 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_verify 00:05:58.950 03:22:39 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:05:58.950 03:22:39 -- accel/accel.sh@12 -- # build_accel_config 00:05:58.950 03:22:39 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:58.950 03:22:39 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:58.950 03:22:39 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:58.950 03:22:39 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:58.950 03:22:39 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:58.950 03:22:39 -- accel/accel.sh@41 -- # local IFS=, 00:05:58.950 03:22:39 -- accel/accel.sh@42 -- # jq -r . 00:05:58.950 [2024-11-21 03:22:39.404330] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:58.950 [2024-11-21 03:22:39.404432] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2942958 ] 00:05:58.950 EAL: No free 2048 kB hugepages reported on node 1 00:05:58.950 [2024-11-21 03:22:39.467204] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:58.950 [2024-11-21 03:22:39.586682] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:00.326 03:22:40 -- accel/accel.sh@18 -- # out=' 00:06:00.326 SPDK Configuration: 00:06:00.326 Core mask: 0x1 00:06:00.326 00:06:00.326 Accel Perf Configuration: 00:06:00.326 Workload Type: dif_verify 00:06:00.326 Vector size: 4096 bytes 00:06:00.326 Transfer size: 4096 bytes 00:06:00.326 Block size: 512 bytes 00:06:00.326 Metadata size: 8 bytes 00:06:00.326 Vector count 1 00:06:00.326 Module: software 00:06:00.326 Queue depth: 32 00:06:00.326 Allocate depth: 32 00:06:00.326 # threads/core: 1 00:06:00.326 Run time: 1 seconds 00:06:00.326 Verify: No 00:06:00.326 00:06:00.326 Running for 1 seconds... 00:06:00.326 00:06:00.326 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:00.326 ------------------------------------------------------------------------------------ 00:06:00.326 0,0 81536/s 323 MiB/s 0 0 00:06:00.326 ==================================================================================== 00:06:00.326 Total 81536/s 318 MiB/s 0 0' 00:06:00.326 03:22:40 -- accel/accel.sh@20 -- # IFS=: 00:06:00.326 03:22:40 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_verify 00:06:00.326 03:22:40 -- accel/accel.sh@20 -- # read -r var val 00:06:00.326 03:22:40 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:06:00.327 03:22:40 -- accel/accel.sh@12 -- # build_accel_config 00:06:00.327 03:22:40 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:00.327 03:22:40 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:00.327 03:22:40 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:00.327 03:22:40 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:00.327 03:22:40 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:00.327 03:22:40 -- accel/accel.sh@41 -- # local IFS=, 00:06:00.327 03:22:40 -- accel/accel.sh@42 -- # jq -r . 00:06:00.327 [2024-11-21 03:22:40.887953] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:00.327 [2024-11-21 03:22:40.888047] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2943217 ] 00:06:00.327 EAL: No free 2048 kB hugepages reported on node 1 00:06:00.327 [2024-11-21 03:22:40.954481] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:00.585 [2024-11-21 03:22:41.074365] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:00.585 03:22:41 -- accel/accel.sh@21 -- # val= 00:06:00.585 03:22:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.585 03:22:41 -- accel/accel.sh@20 -- # IFS=: 00:06:00.585 03:22:41 -- accel/accel.sh@20 -- # read -r var val 00:06:00.585 03:22:41 -- accel/accel.sh@21 -- # val= 00:06:00.585 03:22:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.585 03:22:41 -- accel/accel.sh@20 -- # IFS=: 00:06:00.585 03:22:41 -- accel/accel.sh@20 -- # read -r var val 00:06:00.585 03:22:41 -- accel/accel.sh@21 -- # val=0x1 00:06:00.585 03:22:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.585 03:22:41 -- accel/accel.sh@20 -- # IFS=: 00:06:00.585 03:22:41 -- accel/accel.sh@20 -- # read -r var val 00:06:00.585 03:22:41 -- accel/accel.sh@21 -- # val= 00:06:00.585 03:22:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.585 03:22:41 -- accel/accel.sh@20 -- # IFS=: 00:06:00.585 03:22:41 -- accel/accel.sh@20 -- # read -r var val 00:06:00.585 03:22:41 -- accel/accel.sh@21 -- # val= 00:06:00.585 03:22:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.585 03:22:41 -- accel/accel.sh@20 -- # IFS=: 00:06:00.585 03:22:41 -- accel/accel.sh@20 -- # read -r var val 00:06:00.585 03:22:41 -- accel/accel.sh@21 -- # val=dif_verify 00:06:00.585 03:22:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.585 03:22:41 -- accel/accel.sh@24 -- # accel_opc=dif_verify 00:06:00.585 03:22:41 -- accel/accel.sh@20 -- # IFS=: 00:06:00.585 03:22:41 -- accel/accel.sh@20 -- # read -r var val 00:06:00.585 03:22:41 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:00.585 03:22:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.585 03:22:41 -- accel/accel.sh@20 -- # IFS=: 00:06:00.585 03:22:41 -- accel/accel.sh@20 -- # read -r var val 00:06:00.585 03:22:41 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:00.585 03:22:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.585 03:22:41 -- accel/accel.sh@20 -- # IFS=: 00:06:00.585 03:22:41 -- accel/accel.sh@20 -- # read -r var val 00:06:00.585 03:22:41 -- accel/accel.sh@21 -- # val='512 bytes' 00:06:00.585 03:22:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.585 03:22:41 -- accel/accel.sh@20 -- # IFS=: 00:06:00.585 03:22:41 -- accel/accel.sh@20 -- # read -r var val 00:06:00.585 03:22:41 -- accel/accel.sh@21 -- # val='8 bytes' 00:06:00.585 03:22:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.585 03:22:41 -- accel/accel.sh@20 -- # IFS=: 00:06:00.585 03:22:41 -- accel/accel.sh@20 -- # read -r var val 00:06:00.585 03:22:41 -- accel/accel.sh@21 -- # val= 00:06:00.585 03:22:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.585 03:22:41 -- accel/accel.sh@20 -- # IFS=: 00:06:00.585 03:22:41 -- accel/accel.sh@20 -- # read -r var val 00:06:00.585 03:22:41 -- accel/accel.sh@21 -- # val=software 00:06:00.585 03:22:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.585 03:22:41 -- accel/accel.sh@23 -- # accel_module=software 00:06:00.585 03:22:41 -- accel/accel.sh@20 -- # IFS=: 00:06:00.585 03:22:41 -- accel/accel.sh@20 -- # read -r var val 00:06:00.585 03:22:41 -- accel/accel.sh@21 -- # val=32 00:06:00.585 03:22:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.585 03:22:41 -- accel/accel.sh@20 -- # IFS=: 00:06:00.585 03:22:41 -- accel/accel.sh@20 -- # read -r var val 00:06:00.585 03:22:41 -- accel/accel.sh@21 -- # val=32 00:06:00.585 03:22:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.585 03:22:41 -- accel/accel.sh@20 -- # IFS=: 00:06:00.585 03:22:41 -- accel/accel.sh@20 -- # read -r var val 00:06:00.585 03:22:41 -- accel/accel.sh@21 -- # val=1 00:06:00.585 03:22:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.585 03:22:41 -- accel/accel.sh@20 -- # IFS=: 00:06:00.585 03:22:41 -- accel/accel.sh@20 -- # read -r var val 00:06:00.585 03:22:41 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:00.585 03:22:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.585 03:22:41 -- accel/accel.sh@20 -- # IFS=: 00:06:00.585 03:22:41 -- accel/accel.sh@20 -- # read -r var val 00:06:00.585 03:22:41 -- accel/accel.sh@21 -- # val=No 00:06:00.585 03:22:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.585 03:22:41 -- accel/accel.sh@20 -- # IFS=: 00:06:00.585 03:22:41 -- accel/accel.sh@20 -- # read -r var val 00:06:00.585 03:22:41 -- accel/accel.sh@21 -- # val= 00:06:00.585 03:22:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.585 03:22:41 -- accel/accel.sh@20 -- # IFS=: 00:06:00.585 03:22:41 -- accel/accel.sh@20 -- # read -r var val 00:06:00.585 03:22:41 -- accel/accel.sh@21 -- # val= 00:06:00.585 03:22:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.585 03:22:41 -- accel/accel.sh@20 -- # IFS=: 00:06:00.585 03:22:41 -- accel/accel.sh@20 -- # read -r var val 00:06:01.967 03:22:42 -- accel/accel.sh@21 -- # val= 00:06:01.967 03:22:42 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.967 03:22:42 -- accel/accel.sh@20 -- # IFS=: 00:06:01.967 03:22:42 -- accel/accel.sh@20 -- # read -r var val 00:06:01.967 03:22:42 -- accel/accel.sh@21 -- # val= 00:06:01.967 03:22:42 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.967 03:22:42 -- accel/accel.sh@20 -- # IFS=: 00:06:01.967 03:22:42 -- accel/accel.sh@20 -- # read -r var val 00:06:01.967 03:22:42 -- accel/accel.sh@21 -- # val= 00:06:01.967 03:22:42 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.967 03:22:42 -- accel/accel.sh@20 -- # IFS=: 00:06:01.967 03:22:42 -- accel/accel.sh@20 -- # read -r var val 00:06:01.967 03:22:42 -- accel/accel.sh@21 -- # val= 00:06:01.967 03:22:42 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.967 03:22:42 -- accel/accel.sh@20 -- # IFS=: 00:06:01.967 03:22:42 -- accel/accel.sh@20 -- # read -r var val 00:06:01.967 03:22:42 -- accel/accel.sh@21 -- # val= 00:06:01.967 03:22:42 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.967 03:22:42 -- accel/accel.sh@20 -- # IFS=: 00:06:01.967 03:22:42 -- accel/accel.sh@20 -- # read -r var val 00:06:01.967 03:22:42 -- accel/accel.sh@21 -- # val= 00:06:01.967 03:22:42 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.967 03:22:42 -- accel/accel.sh@20 -- # IFS=: 00:06:01.967 03:22:42 -- accel/accel.sh@20 -- # read -r var val 00:06:01.967 03:22:42 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:01.967 03:22:42 -- accel/accel.sh@28 -- # [[ -n dif_verify ]] 00:06:01.967 03:22:42 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:01.967 00:06:01.967 real 0m2.967s 00:06:01.967 user 0m2.654s 00:06:01.967 sys 0m0.303s 00:06:01.967 03:22:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:01.967 03:22:42 -- common/autotest_common.sh@10 -- # set +x 00:06:01.967 ************************************ 00:06:01.967 END TEST accel_dif_verify 00:06:01.967 ************************************ 00:06:01.967 03:22:42 -- accel/accel.sh@104 -- # run_test accel_dif_generate accel_test -t 1 -w dif_generate 00:06:01.967 03:22:42 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:06:01.967 03:22:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:01.967 03:22:42 -- common/autotest_common.sh@10 -- # set +x 00:06:01.967 ************************************ 00:06:01.967 START TEST accel_dif_generate 00:06:01.967 ************************************ 00:06:01.967 03:22:42 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_generate 00:06:01.967 03:22:42 -- accel/accel.sh@16 -- # local accel_opc 00:06:01.967 03:22:42 -- accel/accel.sh@17 -- # local accel_module 00:06:01.967 03:22:42 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_generate 00:06:01.967 03:22:42 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:06:01.967 03:22:42 -- accel/accel.sh@12 -- # build_accel_config 00:06:01.967 03:22:42 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:01.967 03:22:42 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:01.967 03:22:42 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:01.967 03:22:42 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:01.967 03:22:42 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:01.967 03:22:42 -- accel/accel.sh@41 -- # local IFS=, 00:06:01.967 03:22:42 -- accel/accel.sh@42 -- # jq -r . 00:06:01.967 [2024-11-21 03:22:42.395756] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:01.967 [2024-11-21 03:22:42.395841] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2943382 ] 00:06:01.967 EAL: No free 2048 kB hugepages reported on node 1 00:06:01.967 [2024-11-21 03:22:42.457184] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:01.967 [2024-11-21 03:22:42.575186] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:03.346 03:22:43 -- accel/accel.sh@18 -- # out=' 00:06:03.346 SPDK Configuration: 00:06:03.346 Core mask: 0x1 00:06:03.346 00:06:03.346 Accel Perf Configuration: 00:06:03.346 Workload Type: dif_generate 00:06:03.346 Vector size: 4096 bytes 00:06:03.346 Transfer size: 4096 bytes 00:06:03.346 Block size: 512 bytes 00:06:03.346 Metadata size: 8 bytes 00:06:03.346 Vector count 1 00:06:03.346 Module: software 00:06:03.346 Queue depth: 32 00:06:03.346 Allocate depth: 32 00:06:03.346 # threads/core: 1 00:06:03.346 Run time: 1 seconds 00:06:03.346 Verify: No 00:06:03.346 00:06:03.346 Running for 1 seconds... 00:06:03.346 00:06:03.346 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:03.346 ------------------------------------------------------------------------------------ 00:06:03.346 0,0 96064/s 381 MiB/s 0 0 00:06:03.346 ==================================================================================== 00:06:03.346 Total 96064/s 375 MiB/s 0 0' 00:06:03.346 03:22:43 -- accel/accel.sh@20 -- # IFS=: 00:06:03.346 03:22:43 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate 00:06:03.346 03:22:43 -- accel/accel.sh@20 -- # read -r var val 00:06:03.346 03:22:43 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:06:03.346 03:22:43 -- accel/accel.sh@12 -- # build_accel_config 00:06:03.346 03:22:43 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:03.346 03:22:43 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:03.346 03:22:43 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:03.346 03:22:43 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:03.346 03:22:43 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:03.346 03:22:43 -- accel/accel.sh@41 -- # local IFS=, 00:06:03.346 03:22:43 -- accel/accel.sh@42 -- # jq -r . 00:06:03.346 [2024-11-21 03:22:43.877806] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:03.346 [2024-11-21 03:22:43.877900] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2943526 ] 00:06:03.346 EAL: No free 2048 kB hugepages reported on node 1 00:06:03.346 [2024-11-21 03:22:43.941597] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:03.606 [2024-11-21 03:22:44.063528] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:03.606 03:22:44 -- accel/accel.sh@21 -- # val= 00:06:03.606 03:22:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.606 03:22:44 -- accel/accel.sh@20 -- # IFS=: 00:06:03.606 03:22:44 -- accel/accel.sh@20 -- # read -r var val 00:06:03.606 03:22:44 -- accel/accel.sh@21 -- # val= 00:06:03.606 03:22:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.606 03:22:44 -- accel/accel.sh@20 -- # IFS=: 00:06:03.606 03:22:44 -- accel/accel.sh@20 -- # read -r var val 00:06:03.606 03:22:44 -- accel/accel.sh@21 -- # val=0x1 00:06:03.606 03:22:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.606 03:22:44 -- accel/accel.sh@20 -- # IFS=: 00:06:03.606 03:22:44 -- accel/accel.sh@20 -- # read -r var val 00:06:03.606 03:22:44 -- accel/accel.sh@21 -- # val= 00:06:03.606 03:22:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.606 03:22:44 -- accel/accel.sh@20 -- # IFS=: 00:06:03.606 03:22:44 -- accel/accel.sh@20 -- # read -r var val 00:06:03.606 03:22:44 -- accel/accel.sh@21 -- # val= 00:06:03.606 03:22:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.606 03:22:44 -- accel/accel.sh@20 -- # IFS=: 00:06:03.606 03:22:44 -- accel/accel.sh@20 -- # read -r var val 00:06:03.606 03:22:44 -- accel/accel.sh@21 -- # val=dif_generate 00:06:03.607 03:22:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.607 03:22:44 -- accel/accel.sh@24 -- # accel_opc=dif_generate 00:06:03.607 03:22:44 -- accel/accel.sh@20 -- # IFS=: 00:06:03.607 03:22:44 -- accel/accel.sh@20 -- # read -r var val 00:06:03.607 03:22:44 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:03.607 03:22:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.607 03:22:44 -- accel/accel.sh@20 -- # IFS=: 00:06:03.607 03:22:44 -- accel/accel.sh@20 -- # read -r var val 00:06:03.607 03:22:44 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:03.607 03:22:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.607 03:22:44 -- accel/accel.sh@20 -- # IFS=: 00:06:03.607 03:22:44 -- accel/accel.sh@20 -- # read -r var val 00:06:03.607 03:22:44 -- accel/accel.sh@21 -- # val='512 bytes' 00:06:03.607 03:22:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.607 03:22:44 -- accel/accel.sh@20 -- # IFS=: 00:06:03.607 03:22:44 -- accel/accel.sh@20 -- # read -r var val 00:06:03.607 03:22:44 -- accel/accel.sh@21 -- # val='8 bytes' 00:06:03.607 03:22:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.607 03:22:44 -- accel/accel.sh@20 -- # IFS=: 00:06:03.607 03:22:44 -- accel/accel.sh@20 -- # read -r var val 00:06:03.607 03:22:44 -- accel/accel.sh@21 -- # val= 00:06:03.607 03:22:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.607 03:22:44 -- accel/accel.sh@20 -- # IFS=: 00:06:03.607 03:22:44 -- accel/accel.sh@20 -- # read -r var val 00:06:03.607 03:22:44 -- accel/accel.sh@21 -- # val=software 00:06:03.607 03:22:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.607 03:22:44 -- accel/accel.sh@23 -- # accel_module=software 00:06:03.607 03:22:44 -- accel/accel.sh@20 -- # IFS=: 00:06:03.607 03:22:44 -- accel/accel.sh@20 -- # read -r var val 00:06:03.607 03:22:44 -- accel/accel.sh@21 -- # val=32 00:06:03.607 03:22:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.607 03:22:44 -- accel/accel.sh@20 -- # IFS=: 00:06:03.607 03:22:44 -- accel/accel.sh@20 -- # read -r var val 00:06:03.607 03:22:44 -- accel/accel.sh@21 -- # val=32 00:06:03.607 03:22:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.607 03:22:44 -- accel/accel.sh@20 -- # IFS=: 00:06:03.607 03:22:44 -- accel/accel.sh@20 -- # read -r var val 00:06:03.607 03:22:44 -- accel/accel.sh@21 -- # val=1 00:06:03.607 03:22:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.607 03:22:44 -- accel/accel.sh@20 -- # IFS=: 00:06:03.607 03:22:44 -- accel/accel.sh@20 -- # read -r var val 00:06:03.607 03:22:44 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:03.607 03:22:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.607 03:22:44 -- accel/accel.sh@20 -- # IFS=: 00:06:03.607 03:22:44 -- accel/accel.sh@20 -- # read -r var val 00:06:03.607 03:22:44 -- accel/accel.sh@21 -- # val=No 00:06:03.607 03:22:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.607 03:22:44 -- accel/accel.sh@20 -- # IFS=: 00:06:03.607 03:22:44 -- accel/accel.sh@20 -- # read -r var val 00:06:03.607 03:22:44 -- accel/accel.sh@21 -- # val= 00:06:03.607 03:22:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.607 03:22:44 -- accel/accel.sh@20 -- # IFS=: 00:06:03.607 03:22:44 -- accel/accel.sh@20 -- # read -r var val 00:06:03.607 03:22:44 -- accel/accel.sh@21 -- # val= 00:06:03.607 03:22:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.607 03:22:44 -- accel/accel.sh@20 -- # IFS=: 00:06:03.607 03:22:44 -- accel/accel.sh@20 -- # read -r var val 00:06:04.984 03:22:45 -- accel/accel.sh@21 -- # val= 00:06:04.984 03:22:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.984 03:22:45 -- accel/accel.sh@20 -- # IFS=: 00:06:04.984 03:22:45 -- accel/accel.sh@20 -- # read -r var val 00:06:04.984 03:22:45 -- accel/accel.sh@21 -- # val= 00:06:04.984 03:22:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.984 03:22:45 -- accel/accel.sh@20 -- # IFS=: 00:06:04.984 03:22:45 -- accel/accel.sh@20 -- # read -r var val 00:06:04.984 03:22:45 -- accel/accel.sh@21 -- # val= 00:06:04.984 03:22:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.984 03:22:45 -- accel/accel.sh@20 -- # IFS=: 00:06:04.984 03:22:45 -- accel/accel.sh@20 -- # read -r var val 00:06:04.984 03:22:45 -- accel/accel.sh@21 -- # val= 00:06:04.984 03:22:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.984 03:22:45 -- accel/accel.sh@20 -- # IFS=: 00:06:04.984 03:22:45 -- accel/accel.sh@20 -- # read -r var val 00:06:04.984 03:22:45 -- accel/accel.sh@21 -- # val= 00:06:04.984 03:22:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.984 03:22:45 -- accel/accel.sh@20 -- # IFS=: 00:06:04.984 03:22:45 -- accel/accel.sh@20 -- # read -r var val 00:06:04.984 03:22:45 -- accel/accel.sh@21 -- # val= 00:06:04.984 03:22:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.984 03:22:45 -- accel/accel.sh@20 -- # IFS=: 00:06:04.984 03:22:45 -- accel/accel.sh@20 -- # read -r var val 00:06:04.984 03:22:45 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:04.984 03:22:45 -- accel/accel.sh@28 -- # [[ -n dif_generate ]] 00:06:04.984 03:22:45 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:04.984 00:06:04.984 real 0m2.963s 00:06:04.984 user 0m2.670s 00:06:04.984 sys 0m0.285s 00:06:04.984 03:22:45 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:04.984 03:22:45 -- common/autotest_common.sh@10 -- # set +x 00:06:04.984 ************************************ 00:06:04.984 END TEST accel_dif_generate 00:06:04.984 ************************************ 00:06:04.984 03:22:45 -- accel/accel.sh@105 -- # run_test accel_dif_generate_copy accel_test -t 1 -w dif_generate_copy 00:06:04.984 03:22:45 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:06:04.984 03:22:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:04.984 03:22:45 -- common/autotest_common.sh@10 -- # set +x 00:06:04.984 ************************************ 00:06:04.984 START TEST accel_dif_generate_copy 00:06:04.984 ************************************ 00:06:04.984 03:22:45 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_generate_copy 00:06:04.984 03:22:45 -- accel/accel.sh@16 -- # local accel_opc 00:06:04.984 03:22:45 -- accel/accel.sh@17 -- # local accel_module 00:06:04.984 03:22:45 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_generate_copy 00:06:04.984 03:22:45 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:06:04.984 03:22:45 -- accel/accel.sh@12 -- # build_accel_config 00:06:04.984 03:22:45 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:04.984 03:22:45 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:04.984 03:22:45 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:04.984 03:22:45 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:04.984 03:22:45 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:04.984 03:22:45 -- accel/accel.sh@41 -- # local IFS=, 00:06:04.984 03:22:45 -- accel/accel.sh@42 -- # jq -r . 00:06:04.984 [2024-11-21 03:22:45.384109] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:04.984 [2024-11-21 03:22:45.384201] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2943804 ] 00:06:04.984 EAL: No free 2048 kB hugepages reported on node 1 00:06:04.984 [2024-11-21 03:22:45.447591] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:04.984 [2024-11-21 03:22:45.568352] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:06.366 03:22:46 -- accel/accel.sh@18 -- # out=' 00:06:06.366 SPDK Configuration: 00:06:06.366 Core mask: 0x1 00:06:06.366 00:06:06.366 Accel Perf Configuration: 00:06:06.366 Workload Type: dif_generate_copy 00:06:06.366 Vector size: 4096 bytes 00:06:06.366 Transfer size: 4096 bytes 00:06:06.366 Vector count 1 00:06:06.366 Module: software 00:06:06.366 Queue depth: 32 00:06:06.366 Allocate depth: 32 00:06:06.366 # threads/core: 1 00:06:06.366 Run time: 1 seconds 00:06:06.366 Verify: No 00:06:06.366 00:06:06.366 Running for 1 seconds... 00:06:06.366 00:06:06.366 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:06.366 ------------------------------------------------------------------------------------ 00:06:06.366 0,0 76032/s 301 MiB/s 0 0 00:06:06.366 ==================================================================================== 00:06:06.366 Total 76032/s 297 MiB/s 0 0' 00:06:06.366 03:22:46 -- accel/accel.sh@20 -- # IFS=: 00:06:06.366 03:22:46 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate_copy 00:06:06.366 03:22:46 -- accel/accel.sh@20 -- # read -r var val 00:06:06.366 03:22:46 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:06:06.366 03:22:46 -- accel/accel.sh@12 -- # build_accel_config 00:06:06.366 03:22:46 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:06.366 03:22:46 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:06.366 03:22:46 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:06.366 03:22:46 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:06.366 03:22:46 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:06.366 03:22:46 -- accel/accel.sh@41 -- # local IFS=, 00:06:06.366 03:22:46 -- accel/accel.sh@42 -- # jq -r . 00:06:06.366 [2024-11-21 03:22:46.865141] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:06.366 [2024-11-21 03:22:46.865243] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2943948 ] 00:06:06.366 EAL: No free 2048 kB hugepages reported on node 1 00:06:06.366 [2024-11-21 03:22:46.932355] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:06.625 [2024-11-21 03:22:47.052779] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:06.625 03:22:47 -- accel/accel.sh@21 -- # val= 00:06:06.625 03:22:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.625 03:22:47 -- accel/accel.sh@20 -- # IFS=: 00:06:06.625 03:22:47 -- accel/accel.sh@20 -- # read -r var val 00:06:06.625 03:22:47 -- accel/accel.sh@21 -- # val= 00:06:06.625 03:22:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.625 03:22:47 -- accel/accel.sh@20 -- # IFS=: 00:06:06.625 03:22:47 -- accel/accel.sh@20 -- # read -r var val 00:06:06.625 03:22:47 -- accel/accel.sh@21 -- # val=0x1 00:06:06.625 03:22:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.625 03:22:47 -- accel/accel.sh@20 -- # IFS=: 00:06:06.625 03:22:47 -- accel/accel.sh@20 -- # read -r var val 00:06:06.625 03:22:47 -- accel/accel.sh@21 -- # val= 00:06:06.625 03:22:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.625 03:22:47 -- accel/accel.sh@20 -- # IFS=: 00:06:06.625 03:22:47 -- accel/accel.sh@20 -- # read -r var val 00:06:06.625 03:22:47 -- accel/accel.sh@21 -- # val= 00:06:06.625 03:22:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.625 03:22:47 -- accel/accel.sh@20 -- # IFS=: 00:06:06.625 03:22:47 -- accel/accel.sh@20 -- # read -r var val 00:06:06.625 03:22:47 -- accel/accel.sh@21 -- # val=dif_generate_copy 00:06:06.625 03:22:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.625 03:22:47 -- accel/accel.sh@24 -- # accel_opc=dif_generate_copy 00:06:06.625 03:22:47 -- accel/accel.sh@20 -- # IFS=: 00:06:06.625 03:22:47 -- accel/accel.sh@20 -- # read -r var val 00:06:06.625 03:22:47 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:06.625 03:22:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.625 03:22:47 -- accel/accel.sh@20 -- # IFS=: 00:06:06.625 03:22:47 -- accel/accel.sh@20 -- # read -r var val 00:06:06.625 03:22:47 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:06.625 03:22:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.625 03:22:47 -- accel/accel.sh@20 -- # IFS=: 00:06:06.625 03:22:47 -- accel/accel.sh@20 -- # read -r var val 00:06:06.625 03:22:47 -- accel/accel.sh@21 -- # val= 00:06:06.625 03:22:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.625 03:22:47 -- accel/accel.sh@20 -- # IFS=: 00:06:06.625 03:22:47 -- accel/accel.sh@20 -- # read -r var val 00:06:06.625 03:22:47 -- accel/accel.sh@21 -- # val=software 00:06:06.625 03:22:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.625 03:22:47 -- accel/accel.sh@23 -- # accel_module=software 00:06:06.625 03:22:47 -- accel/accel.sh@20 -- # IFS=: 00:06:06.625 03:22:47 -- accel/accel.sh@20 -- # read -r var val 00:06:06.625 03:22:47 -- accel/accel.sh@21 -- # val=32 00:06:06.625 03:22:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.625 03:22:47 -- accel/accel.sh@20 -- # IFS=: 00:06:06.625 03:22:47 -- accel/accel.sh@20 -- # read -r var val 00:06:06.625 03:22:47 -- accel/accel.sh@21 -- # val=32 00:06:06.625 03:22:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.625 03:22:47 -- accel/accel.sh@20 -- # IFS=: 00:06:06.625 03:22:47 -- accel/accel.sh@20 -- # read -r var val 00:06:06.625 03:22:47 -- accel/accel.sh@21 -- # val=1 00:06:06.625 03:22:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.625 03:22:47 -- accel/accel.sh@20 -- # IFS=: 00:06:06.625 03:22:47 -- accel/accel.sh@20 -- # read -r var val 00:06:06.625 03:22:47 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:06.625 03:22:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.625 03:22:47 -- accel/accel.sh@20 -- # IFS=: 00:06:06.625 03:22:47 -- accel/accel.sh@20 -- # read -r var val 00:06:06.625 03:22:47 -- accel/accel.sh@21 -- # val=No 00:06:06.625 03:22:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.625 03:22:47 -- accel/accel.sh@20 -- # IFS=: 00:06:06.625 03:22:47 -- accel/accel.sh@20 -- # read -r var val 00:06:06.625 03:22:47 -- accel/accel.sh@21 -- # val= 00:06:06.625 03:22:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.625 03:22:47 -- accel/accel.sh@20 -- # IFS=: 00:06:06.625 03:22:47 -- accel/accel.sh@20 -- # read -r var val 00:06:06.625 03:22:47 -- accel/accel.sh@21 -- # val= 00:06:06.625 03:22:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.625 03:22:47 -- accel/accel.sh@20 -- # IFS=: 00:06:06.625 03:22:47 -- accel/accel.sh@20 -- # read -r var val 00:06:08.007 03:22:48 -- accel/accel.sh@21 -- # val= 00:06:08.007 03:22:48 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.007 03:22:48 -- accel/accel.sh@20 -- # IFS=: 00:06:08.007 03:22:48 -- accel/accel.sh@20 -- # read -r var val 00:06:08.007 03:22:48 -- accel/accel.sh@21 -- # val= 00:06:08.007 03:22:48 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.007 03:22:48 -- accel/accel.sh@20 -- # IFS=: 00:06:08.007 03:22:48 -- accel/accel.sh@20 -- # read -r var val 00:06:08.007 03:22:48 -- accel/accel.sh@21 -- # val= 00:06:08.007 03:22:48 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.007 03:22:48 -- accel/accel.sh@20 -- # IFS=: 00:06:08.007 03:22:48 -- accel/accel.sh@20 -- # read -r var val 00:06:08.007 03:22:48 -- accel/accel.sh@21 -- # val= 00:06:08.007 03:22:48 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.007 03:22:48 -- accel/accel.sh@20 -- # IFS=: 00:06:08.007 03:22:48 -- accel/accel.sh@20 -- # read -r var val 00:06:08.007 03:22:48 -- accel/accel.sh@21 -- # val= 00:06:08.007 03:22:48 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.007 03:22:48 -- accel/accel.sh@20 -- # IFS=: 00:06:08.007 03:22:48 -- accel/accel.sh@20 -- # read -r var val 00:06:08.007 03:22:48 -- accel/accel.sh@21 -- # val= 00:06:08.007 03:22:48 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.007 03:22:48 -- accel/accel.sh@20 -- # IFS=: 00:06:08.007 03:22:48 -- accel/accel.sh@20 -- # read -r var val 00:06:08.007 03:22:48 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:08.007 03:22:48 -- accel/accel.sh@28 -- # [[ -n dif_generate_copy ]] 00:06:08.007 03:22:48 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:08.007 00:06:08.007 real 0m2.972s 00:06:08.007 user 0m2.673s 00:06:08.007 sys 0m0.287s 00:06:08.007 03:22:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:08.007 03:22:48 -- common/autotest_common.sh@10 -- # set +x 00:06:08.007 ************************************ 00:06:08.007 END TEST accel_dif_generate_copy 00:06:08.007 ************************************ 00:06:08.007 03:22:48 -- accel/accel.sh@107 -- # [[ y == y ]] 00:06:08.007 03:22:48 -- accel/accel.sh@108 -- # run_test accel_comp accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:08.007 03:22:48 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:06:08.007 03:22:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:08.007 03:22:48 -- common/autotest_common.sh@10 -- # set +x 00:06:08.007 ************************************ 00:06:08.007 START TEST accel_comp 00:06:08.007 ************************************ 00:06:08.007 03:22:48 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:08.007 03:22:48 -- accel/accel.sh@16 -- # local accel_opc 00:06:08.007 03:22:48 -- accel/accel.sh@17 -- # local accel_module 00:06:08.007 03:22:48 -- accel/accel.sh@18 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:08.007 03:22:48 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:08.007 03:22:48 -- accel/accel.sh@12 -- # build_accel_config 00:06:08.007 03:22:48 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:08.007 03:22:48 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:08.007 03:22:48 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:08.007 03:22:48 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:08.007 03:22:48 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:08.007 03:22:48 -- accel/accel.sh@41 -- # local IFS=, 00:06:08.007 03:22:48 -- accel/accel.sh@42 -- # jq -r . 00:06:08.007 [2024-11-21 03:22:48.378567] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:08.007 [2024-11-21 03:22:48.378652] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2944112 ] 00:06:08.007 EAL: No free 2048 kB hugepages reported on node 1 00:06:08.007 [2024-11-21 03:22:48.434646] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:08.007 [2024-11-21 03:22:48.552277] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:09.387 03:22:49 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:09.387 00:06:09.387 SPDK Configuration: 00:06:09.387 Core mask: 0x1 00:06:09.387 00:06:09.387 Accel Perf Configuration: 00:06:09.387 Workload Type: compress 00:06:09.387 Transfer size: 4096 bytes 00:06:09.387 Vector count 1 00:06:09.387 Module: software 00:06:09.387 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:09.387 Queue depth: 32 00:06:09.387 Allocate depth: 32 00:06:09.387 # threads/core: 1 00:06:09.387 Run time: 1 seconds 00:06:09.387 Verify: No 00:06:09.387 00:06:09.387 Running for 1 seconds... 00:06:09.387 00:06:09.387 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:09.387 ------------------------------------------------------------------------------------ 00:06:09.387 0,0 31424/s 130 MiB/s 0 0 00:06:09.387 ==================================================================================== 00:06:09.387 Total 31424/s 122 MiB/s 0 0' 00:06:09.387 03:22:49 -- accel/accel.sh@20 -- # IFS=: 00:06:09.387 03:22:49 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:09.387 03:22:49 -- accel/accel.sh@20 -- # read -r var val 00:06:09.387 03:22:49 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:09.387 03:22:49 -- accel/accel.sh@12 -- # build_accel_config 00:06:09.387 03:22:49 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:09.387 03:22:49 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:09.387 03:22:49 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:09.387 03:22:49 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:09.387 03:22:49 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:09.387 03:22:49 -- accel/accel.sh@41 -- # local IFS=, 00:06:09.387 03:22:49 -- accel/accel.sh@42 -- # jq -r . 00:06:09.387 [2024-11-21 03:22:49.848973] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:09.387 [2024-11-21 03:22:49.849063] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2944372 ] 00:06:09.387 EAL: No free 2048 kB hugepages reported on node 1 00:06:09.387 [2024-11-21 03:22:49.911381] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:09.647 [2024-11-21 03:22:50.037102] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:09.647 03:22:50 -- accel/accel.sh@21 -- # val= 00:06:09.647 03:22:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.647 03:22:50 -- accel/accel.sh@20 -- # IFS=: 00:06:09.647 03:22:50 -- accel/accel.sh@20 -- # read -r var val 00:06:09.647 03:22:50 -- accel/accel.sh@21 -- # val= 00:06:09.647 03:22:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.647 03:22:50 -- accel/accel.sh@20 -- # IFS=: 00:06:09.647 03:22:50 -- accel/accel.sh@20 -- # read -r var val 00:06:09.647 03:22:50 -- accel/accel.sh@21 -- # val= 00:06:09.647 03:22:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.647 03:22:50 -- accel/accel.sh@20 -- # IFS=: 00:06:09.647 03:22:50 -- accel/accel.sh@20 -- # read -r var val 00:06:09.647 03:22:50 -- accel/accel.sh@21 -- # val=0x1 00:06:09.647 03:22:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.647 03:22:50 -- accel/accel.sh@20 -- # IFS=: 00:06:09.647 03:22:50 -- accel/accel.sh@20 -- # read -r var val 00:06:09.647 03:22:50 -- accel/accel.sh@21 -- # val= 00:06:09.647 03:22:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.647 03:22:50 -- accel/accel.sh@20 -- # IFS=: 00:06:09.647 03:22:50 -- accel/accel.sh@20 -- # read -r var val 00:06:09.647 03:22:50 -- accel/accel.sh@21 -- # val= 00:06:09.647 03:22:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.647 03:22:50 -- accel/accel.sh@20 -- # IFS=: 00:06:09.647 03:22:50 -- accel/accel.sh@20 -- # read -r var val 00:06:09.647 03:22:50 -- accel/accel.sh@21 -- # val=compress 00:06:09.647 03:22:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.647 03:22:50 -- accel/accel.sh@24 -- # accel_opc=compress 00:06:09.647 03:22:50 -- accel/accel.sh@20 -- # IFS=: 00:06:09.647 03:22:50 -- accel/accel.sh@20 -- # read -r var val 00:06:09.647 03:22:50 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:09.647 03:22:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.647 03:22:50 -- accel/accel.sh@20 -- # IFS=: 00:06:09.647 03:22:50 -- accel/accel.sh@20 -- # read -r var val 00:06:09.647 03:22:50 -- accel/accel.sh@21 -- # val= 00:06:09.647 03:22:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.647 03:22:50 -- accel/accel.sh@20 -- # IFS=: 00:06:09.647 03:22:50 -- accel/accel.sh@20 -- # read -r var val 00:06:09.647 03:22:50 -- accel/accel.sh@21 -- # val=software 00:06:09.647 03:22:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.647 03:22:50 -- accel/accel.sh@23 -- # accel_module=software 00:06:09.647 03:22:50 -- accel/accel.sh@20 -- # IFS=: 00:06:09.647 03:22:50 -- accel/accel.sh@20 -- # read -r var val 00:06:09.647 03:22:50 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:09.647 03:22:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.647 03:22:50 -- accel/accel.sh@20 -- # IFS=: 00:06:09.647 03:22:50 -- accel/accel.sh@20 -- # read -r var val 00:06:09.647 03:22:50 -- accel/accel.sh@21 -- # val=32 00:06:09.647 03:22:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.647 03:22:50 -- accel/accel.sh@20 -- # IFS=: 00:06:09.647 03:22:50 -- accel/accel.sh@20 -- # read -r var val 00:06:09.647 03:22:50 -- accel/accel.sh@21 -- # val=32 00:06:09.647 03:22:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.647 03:22:50 -- accel/accel.sh@20 -- # IFS=: 00:06:09.647 03:22:50 -- accel/accel.sh@20 -- # read -r var val 00:06:09.647 03:22:50 -- accel/accel.sh@21 -- # val=1 00:06:09.647 03:22:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.647 03:22:50 -- accel/accel.sh@20 -- # IFS=: 00:06:09.647 03:22:50 -- accel/accel.sh@20 -- # read -r var val 00:06:09.647 03:22:50 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:09.647 03:22:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.647 03:22:50 -- accel/accel.sh@20 -- # IFS=: 00:06:09.647 03:22:50 -- accel/accel.sh@20 -- # read -r var val 00:06:09.647 03:22:50 -- accel/accel.sh@21 -- # val=No 00:06:09.647 03:22:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.647 03:22:50 -- accel/accel.sh@20 -- # IFS=: 00:06:09.647 03:22:50 -- accel/accel.sh@20 -- # read -r var val 00:06:09.647 03:22:50 -- accel/accel.sh@21 -- # val= 00:06:09.647 03:22:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.647 03:22:50 -- accel/accel.sh@20 -- # IFS=: 00:06:09.647 03:22:50 -- accel/accel.sh@20 -- # read -r var val 00:06:09.647 03:22:50 -- accel/accel.sh@21 -- # val= 00:06:09.647 03:22:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.647 03:22:50 -- accel/accel.sh@20 -- # IFS=: 00:06:09.647 03:22:50 -- accel/accel.sh@20 -- # read -r var val 00:06:11.025 03:22:51 -- accel/accel.sh@21 -- # val= 00:06:11.025 03:22:51 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.025 03:22:51 -- accel/accel.sh@20 -- # IFS=: 00:06:11.025 03:22:51 -- accel/accel.sh@20 -- # read -r var val 00:06:11.025 03:22:51 -- accel/accel.sh@21 -- # val= 00:06:11.025 03:22:51 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.025 03:22:51 -- accel/accel.sh@20 -- # IFS=: 00:06:11.025 03:22:51 -- accel/accel.sh@20 -- # read -r var val 00:06:11.025 03:22:51 -- accel/accel.sh@21 -- # val= 00:06:11.025 03:22:51 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.025 03:22:51 -- accel/accel.sh@20 -- # IFS=: 00:06:11.025 03:22:51 -- accel/accel.sh@20 -- # read -r var val 00:06:11.025 03:22:51 -- accel/accel.sh@21 -- # val= 00:06:11.025 03:22:51 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.025 03:22:51 -- accel/accel.sh@20 -- # IFS=: 00:06:11.025 03:22:51 -- accel/accel.sh@20 -- # read -r var val 00:06:11.025 03:22:51 -- accel/accel.sh@21 -- # val= 00:06:11.025 03:22:51 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.025 03:22:51 -- accel/accel.sh@20 -- # IFS=: 00:06:11.025 03:22:51 -- accel/accel.sh@20 -- # read -r var val 00:06:11.025 03:22:51 -- accel/accel.sh@21 -- # val= 00:06:11.025 03:22:51 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.025 03:22:51 -- accel/accel.sh@20 -- # IFS=: 00:06:11.025 03:22:51 -- accel/accel.sh@20 -- # read -r var val 00:06:11.025 03:22:51 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:11.025 03:22:51 -- accel/accel.sh@28 -- # [[ -n compress ]] 00:06:11.025 03:22:51 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:11.025 00:06:11.025 real 0m2.967s 00:06:11.025 user 0m2.674s 00:06:11.025 sys 0m0.283s 00:06:11.025 03:22:51 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:11.025 03:22:51 -- common/autotest_common.sh@10 -- # set +x 00:06:11.025 ************************************ 00:06:11.025 END TEST accel_comp 00:06:11.025 ************************************ 00:06:11.025 03:22:51 -- accel/accel.sh@109 -- # run_test accel_decomp accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:11.025 03:22:51 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:06:11.025 03:22:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:11.025 03:22:51 -- common/autotest_common.sh@10 -- # set +x 00:06:11.025 ************************************ 00:06:11.025 START TEST accel_decomp 00:06:11.025 ************************************ 00:06:11.025 03:22:51 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:11.025 03:22:51 -- accel/accel.sh@16 -- # local accel_opc 00:06:11.025 03:22:51 -- accel/accel.sh@17 -- # local accel_module 00:06:11.025 03:22:51 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:11.025 03:22:51 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:11.025 03:22:51 -- accel/accel.sh@12 -- # build_accel_config 00:06:11.025 03:22:51 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:11.025 03:22:51 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:11.025 03:22:51 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:11.025 03:22:51 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:11.025 03:22:51 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:11.025 03:22:51 -- accel/accel.sh@41 -- # local IFS=, 00:06:11.025 03:22:51 -- accel/accel.sh@42 -- # jq -r . 00:06:11.025 [2024-11-21 03:22:51.374976] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:11.025 [2024-11-21 03:22:51.375057] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2944533 ] 00:06:11.025 EAL: No free 2048 kB hugepages reported on node 1 00:06:11.025 [2024-11-21 03:22:51.439508] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:11.025 [2024-11-21 03:22:51.559398] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:12.402 03:22:52 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:12.402 00:06:12.402 SPDK Configuration: 00:06:12.402 Core mask: 0x1 00:06:12.402 00:06:12.402 Accel Perf Configuration: 00:06:12.402 Workload Type: decompress 00:06:12.402 Transfer size: 4096 bytes 00:06:12.402 Vector count 1 00:06:12.402 Module: software 00:06:12.402 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:12.402 Queue depth: 32 00:06:12.402 Allocate depth: 32 00:06:12.402 # threads/core: 1 00:06:12.402 Run time: 1 seconds 00:06:12.402 Verify: Yes 00:06:12.402 00:06:12.402 Running for 1 seconds... 00:06:12.402 00:06:12.402 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:12.402 ------------------------------------------------------------------------------------ 00:06:12.402 0,0 55200/s 101 MiB/s 0 0 00:06:12.402 ==================================================================================== 00:06:12.402 Total 55200/s 215 MiB/s 0 0' 00:06:12.402 03:22:52 -- accel/accel.sh@20 -- # IFS=: 00:06:12.402 03:22:52 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:12.402 03:22:52 -- accel/accel.sh@20 -- # read -r var val 00:06:12.402 03:22:52 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:12.402 03:22:52 -- accel/accel.sh@12 -- # build_accel_config 00:06:12.402 03:22:52 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:12.402 03:22:52 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:12.402 03:22:52 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:12.402 03:22:52 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:12.402 03:22:52 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:12.402 03:22:52 -- accel/accel.sh@41 -- # local IFS=, 00:06:12.402 03:22:52 -- accel/accel.sh@42 -- # jq -r . 00:06:12.402 [2024-11-21 03:22:52.866015] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:12.402 [2024-11-21 03:22:52.866116] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2944676 ] 00:06:12.402 EAL: No free 2048 kB hugepages reported on node 1 00:06:12.402 [2024-11-21 03:22:52.930218] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:12.662 [2024-11-21 03:22:53.052556] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:12.662 03:22:53 -- accel/accel.sh@21 -- # val= 00:06:12.662 03:22:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.662 03:22:53 -- accel/accel.sh@20 -- # IFS=: 00:06:12.662 03:22:53 -- accel/accel.sh@20 -- # read -r var val 00:06:12.662 03:22:53 -- accel/accel.sh@21 -- # val= 00:06:12.662 03:22:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.662 03:22:53 -- accel/accel.sh@20 -- # IFS=: 00:06:12.662 03:22:53 -- accel/accel.sh@20 -- # read -r var val 00:06:12.662 03:22:53 -- accel/accel.sh@21 -- # val= 00:06:12.662 03:22:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.662 03:22:53 -- accel/accel.sh@20 -- # IFS=: 00:06:12.662 03:22:53 -- accel/accel.sh@20 -- # read -r var val 00:06:12.662 03:22:53 -- accel/accel.sh@21 -- # val=0x1 00:06:12.662 03:22:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.662 03:22:53 -- accel/accel.sh@20 -- # IFS=: 00:06:12.662 03:22:53 -- accel/accel.sh@20 -- # read -r var val 00:06:12.662 03:22:53 -- accel/accel.sh@21 -- # val= 00:06:12.662 03:22:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.662 03:22:53 -- accel/accel.sh@20 -- # IFS=: 00:06:12.662 03:22:53 -- accel/accel.sh@20 -- # read -r var val 00:06:12.662 03:22:53 -- accel/accel.sh@21 -- # val= 00:06:12.662 03:22:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.662 03:22:53 -- accel/accel.sh@20 -- # IFS=: 00:06:12.662 03:22:53 -- accel/accel.sh@20 -- # read -r var val 00:06:12.662 03:22:53 -- accel/accel.sh@21 -- # val=decompress 00:06:12.662 03:22:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.662 03:22:53 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:12.662 03:22:53 -- accel/accel.sh@20 -- # IFS=: 00:06:12.662 03:22:53 -- accel/accel.sh@20 -- # read -r var val 00:06:12.662 03:22:53 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:12.662 03:22:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.662 03:22:53 -- accel/accel.sh@20 -- # IFS=: 00:06:12.662 03:22:53 -- accel/accel.sh@20 -- # read -r var val 00:06:12.662 03:22:53 -- accel/accel.sh@21 -- # val= 00:06:12.662 03:22:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.662 03:22:53 -- accel/accel.sh@20 -- # IFS=: 00:06:12.662 03:22:53 -- accel/accel.sh@20 -- # read -r var val 00:06:12.662 03:22:53 -- accel/accel.sh@21 -- # val=software 00:06:12.662 03:22:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.662 03:22:53 -- accel/accel.sh@23 -- # accel_module=software 00:06:12.662 03:22:53 -- accel/accel.sh@20 -- # IFS=: 00:06:12.662 03:22:53 -- accel/accel.sh@20 -- # read -r var val 00:06:12.662 03:22:53 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:12.662 03:22:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.662 03:22:53 -- accel/accel.sh@20 -- # IFS=: 00:06:12.662 03:22:53 -- accel/accel.sh@20 -- # read -r var val 00:06:12.662 03:22:53 -- accel/accel.sh@21 -- # val=32 00:06:12.662 03:22:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.662 03:22:53 -- accel/accel.sh@20 -- # IFS=: 00:06:12.662 03:22:53 -- accel/accel.sh@20 -- # read -r var val 00:06:12.662 03:22:53 -- accel/accel.sh@21 -- # val=32 00:06:12.662 03:22:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.662 03:22:53 -- accel/accel.sh@20 -- # IFS=: 00:06:12.662 03:22:53 -- accel/accel.sh@20 -- # read -r var val 00:06:12.662 03:22:53 -- accel/accel.sh@21 -- # val=1 00:06:12.662 03:22:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.662 03:22:53 -- accel/accel.sh@20 -- # IFS=: 00:06:12.663 03:22:53 -- accel/accel.sh@20 -- # read -r var val 00:06:12.663 03:22:53 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:12.663 03:22:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.663 03:22:53 -- accel/accel.sh@20 -- # IFS=: 00:06:12.663 03:22:53 -- accel/accel.sh@20 -- # read -r var val 00:06:12.663 03:22:53 -- accel/accel.sh@21 -- # val=Yes 00:06:12.663 03:22:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.663 03:22:53 -- accel/accel.sh@20 -- # IFS=: 00:06:12.663 03:22:53 -- accel/accel.sh@20 -- # read -r var val 00:06:12.663 03:22:53 -- accel/accel.sh@21 -- # val= 00:06:12.663 03:22:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.663 03:22:53 -- accel/accel.sh@20 -- # IFS=: 00:06:12.663 03:22:53 -- accel/accel.sh@20 -- # read -r var val 00:06:12.663 03:22:53 -- accel/accel.sh@21 -- # val= 00:06:12.663 03:22:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.663 03:22:53 -- accel/accel.sh@20 -- # IFS=: 00:06:12.663 03:22:53 -- accel/accel.sh@20 -- # read -r var val 00:06:14.100 03:22:54 -- accel/accel.sh@21 -- # val= 00:06:14.100 03:22:54 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.100 03:22:54 -- accel/accel.sh@20 -- # IFS=: 00:06:14.100 03:22:54 -- accel/accel.sh@20 -- # read -r var val 00:06:14.100 03:22:54 -- accel/accel.sh@21 -- # val= 00:06:14.100 03:22:54 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.100 03:22:54 -- accel/accel.sh@20 -- # IFS=: 00:06:14.100 03:22:54 -- accel/accel.sh@20 -- # read -r var val 00:06:14.100 03:22:54 -- accel/accel.sh@21 -- # val= 00:06:14.100 03:22:54 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.100 03:22:54 -- accel/accel.sh@20 -- # IFS=: 00:06:14.100 03:22:54 -- accel/accel.sh@20 -- # read -r var val 00:06:14.100 03:22:54 -- accel/accel.sh@21 -- # val= 00:06:14.100 03:22:54 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.100 03:22:54 -- accel/accel.sh@20 -- # IFS=: 00:06:14.101 03:22:54 -- accel/accel.sh@20 -- # read -r var val 00:06:14.101 03:22:54 -- accel/accel.sh@21 -- # val= 00:06:14.101 03:22:54 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.101 03:22:54 -- accel/accel.sh@20 -- # IFS=: 00:06:14.101 03:22:54 -- accel/accel.sh@20 -- # read -r var val 00:06:14.101 03:22:54 -- accel/accel.sh@21 -- # val= 00:06:14.101 03:22:54 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.101 03:22:54 -- accel/accel.sh@20 -- # IFS=: 00:06:14.101 03:22:54 -- accel/accel.sh@20 -- # read -r var val 00:06:14.101 03:22:54 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:14.101 03:22:54 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:14.101 03:22:54 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:14.101 00:06:14.101 real 0m2.973s 00:06:14.101 user 0m2.675s 00:06:14.101 sys 0m0.288s 00:06:14.101 03:22:54 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:14.101 03:22:54 -- common/autotest_common.sh@10 -- # set +x 00:06:14.101 ************************************ 00:06:14.101 END TEST accel_decomp 00:06:14.101 ************************************ 00:06:14.101 03:22:54 -- accel/accel.sh@110 -- # run_test accel_decmop_full accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:14.101 03:22:54 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:06:14.101 03:22:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:14.101 03:22:54 -- common/autotest_common.sh@10 -- # set +x 00:06:14.101 ************************************ 00:06:14.101 START TEST accel_decmop_full 00:06:14.101 ************************************ 00:06:14.101 03:22:54 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:14.101 03:22:54 -- accel/accel.sh@16 -- # local accel_opc 00:06:14.101 03:22:54 -- accel/accel.sh@17 -- # local accel_module 00:06:14.101 03:22:54 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:14.101 03:22:54 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:14.101 03:22:54 -- accel/accel.sh@12 -- # build_accel_config 00:06:14.101 03:22:54 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:14.101 03:22:54 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:14.101 03:22:54 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:14.101 03:22:54 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:14.101 03:22:54 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:14.101 03:22:54 -- accel/accel.sh@41 -- # local IFS=, 00:06:14.101 03:22:54 -- accel/accel.sh@42 -- # jq -r . 00:06:14.101 [2024-11-21 03:22:54.373594] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:14.101 [2024-11-21 03:22:54.373686] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2944962 ] 00:06:14.101 EAL: No free 2048 kB hugepages reported on node 1 00:06:14.101 [2024-11-21 03:22:54.436540] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:14.101 [2024-11-21 03:22:54.558137] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:15.485 03:22:55 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:15.485 00:06:15.485 SPDK Configuration: 00:06:15.485 Core mask: 0x1 00:06:15.485 00:06:15.485 Accel Perf Configuration: 00:06:15.485 Workload Type: decompress 00:06:15.485 Transfer size: 111250 bytes 00:06:15.485 Vector count 1 00:06:15.485 Module: software 00:06:15.485 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:15.485 Queue depth: 32 00:06:15.485 Allocate depth: 32 00:06:15.485 # threads/core: 1 00:06:15.485 Run time: 1 seconds 00:06:15.485 Verify: Yes 00:06:15.485 00:06:15.485 Running for 1 seconds... 00:06:15.485 00:06:15.485 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:15.485 ------------------------------------------------------------------------------------ 00:06:15.485 0,0 3776/s 155 MiB/s 0 0 00:06:15.485 ==================================================================================== 00:06:15.485 Total 3776/s 400 MiB/s 0 0' 00:06:15.485 03:22:55 -- accel/accel.sh@20 -- # IFS=: 00:06:15.485 03:22:55 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:15.485 03:22:55 -- accel/accel.sh@20 -- # read -r var val 00:06:15.485 03:22:55 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:15.485 03:22:55 -- accel/accel.sh@12 -- # build_accel_config 00:06:15.485 03:22:55 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:15.485 03:22:55 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:15.485 03:22:55 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:15.485 03:22:55 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:15.485 03:22:55 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:15.485 03:22:55 -- accel/accel.sh@41 -- # local IFS=, 00:06:15.485 03:22:55 -- accel/accel.sh@42 -- # jq -r . 00:06:15.485 [2024-11-21 03:22:55.873565] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:15.485 [2024-11-21 03:22:55.873656] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2945102 ] 00:06:15.485 EAL: No free 2048 kB hugepages reported on node 1 00:06:15.485 [2024-11-21 03:22:55.934960] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:15.485 [2024-11-21 03:22:56.053704] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:15.485 03:22:56 -- accel/accel.sh@21 -- # val= 00:06:15.485 03:22:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.485 03:22:56 -- accel/accel.sh@20 -- # IFS=: 00:06:15.485 03:22:56 -- accel/accel.sh@20 -- # read -r var val 00:06:15.485 03:22:56 -- accel/accel.sh@21 -- # val= 00:06:15.485 03:22:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.485 03:22:56 -- accel/accel.sh@20 -- # IFS=: 00:06:15.485 03:22:56 -- accel/accel.sh@20 -- # read -r var val 00:06:15.485 03:22:56 -- accel/accel.sh@21 -- # val= 00:06:15.485 03:22:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.485 03:22:56 -- accel/accel.sh@20 -- # IFS=: 00:06:15.485 03:22:56 -- accel/accel.sh@20 -- # read -r var val 00:06:15.485 03:22:56 -- accel/accel.sh@21 -- # val=0x1 00:06:15.485 03:22:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.485 03:22:56 -- accel/accel.sh@20 -- # IFS=: 00:06:15.485 03:22:56 -- accel/accel.sh@20 -- # read -r var val 00:06:15.485 03:22:56 -- accel/accel.sh@21 -- # val= 00:06:15.485 03:22:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.485 03:22:56 -- accel/accel.sh@20 -- # IFS=: 00:06:15.485 03:22:56 -- accel/accel.sh@20 -- # read -r var val 00:06:15.485 03:22:56 -- accel/accel.sh@21 -- # val= 00:06:15.485 03:22:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.485 03:22:56 -- accel/accel.sh@20 -- # IFS=: 00:06:15.485 03:22:56 -- accel/accel.sh@20 -- # read -r var val 00:06:15.485 03:22:56 -- accel/accel.sh@21 -- # val=decompress 00:06:15.485 03:22:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.485 03:22:56 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:15.485 03:22:56 -- accel/accel.sh@20 -- # IFS=: 00:06:15.485 03:22:56 -- accel/accel.sh@20 -- # read -r var val 00:06:15.485 03:22:56 -- accel/accel.sh@21 -- # val='111250 bytes' 00:06:15.485 03:22:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.485 03:22:56 -- accel/accel.sh@20 -- # IFS=: 00:06:15.485 03:22:56 -- accel/accel.sh@20 -- # read -r var val 00:06:15.485 03:22:56 -- accel/accel.sh@21 -- # val= 00:06:15.485 03:22:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.485 03:22:56 -- accel/accel.sh@20 -- # IFS=: 00:06:15.485 03:22:56 -- accel/accel.sh@20 -- # read -r var val 00:06:15.485 03:22:56 -- accel/accel.sh@21 -- # val=software 00:06:15.485 03:22:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.485 03:22:56 -- accel/accel.sh@23 -- # accel_module=software 00:06:15.485 03:22:56 -- accel/accel.sh@20 -- # IFS=: 00:06:15.485 03:22:56 -- accel/accel.sh@20 -- # read -r var val 00:06:15.485 03:22:56 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:15.485 03:22:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.485 03:22:56 -- accel/accel.sh@20 -- # IFS=: 00:06:15.485 03:22:56 -- accel/accel.sh@20 -- # read -r var val 00:06:15.485 03:22:56 -- accel/accel.sh@21 -- # val=32 00:06:15.485 03:22:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.485 03:22:56 -- accel/accel.sh@20 -- # IFS=: 00:06:15.485 03:22:56 -- accel/accel.sh@20 -- # read -r var val 00:06:15.485 03:22:56 -- accel/accel.sh@21 -- # val=32 00:06:15.485 03:22:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.485 03:22:56 -- accel/accel.sh@20 -- # IFS=: 00:06:15.485 03:22:56 -- accel/accel.sh@20 -- # read -r var val 00:06:15.485 03:22:56 -- accel/accel.sh@21 -- # val=1 00:06:15.485 03:22:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.485 03:22:56 -- accel/accel.sh@20 -- # IFS=: 00:06:15.485 03:22:56 -- accel/accel.sh@20 -- # read -r var val 00:06:15.485 03:22:56 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:15.485 03:22:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.485 03:22:56 -- accel/accel.sh@20 -- # IFS=: 00:06:15.485 03:22:56 -- accel/accel.sh@20 -- # read -r var val 00:06:15.485 03:22:56 -- accel/accel.sh@21 -- # val=Yes 00:06:15.485 03:22:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.485 03:22:56 -- accel/accel.sh@20 -- # IFS=: 00:06:15.485 03:22:56 -- accel/accel.sh@20 -- # read -r var val 00:06:15.485 03:22:56 -- accel/accel.sh@21 -- # val= 00:06:15.485 03:22:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.485 03:22:56 -- accel/accel.sh@20 -- # IFS=: 00:06:15.485 03:22:56 -- accel/accel.sh@20 -- # read -r var val 00:06:15.485 03:22:56 -- accel/accel.sh@21 -- # val= 00:06:15.485 03:22:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.485 03:22:56 -- accel/accel.sh@20 -- # IFS=: 00:06:15.485 03:22:56 -- accel/accel.sh@20 -- # read -r var val 00:06:16.863 03:22:57 -- accel/accel.sh@21 -- # val= 00:06:16.863 03:22:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:16.863 03:22:57 -- accel/accel.sh@20 -- # IFS=: 00:06:16.863 03:22:57 -- accel/accel.sh@20 -- # read -r var val 00:06:16.863 03:22:57 -- accel/accel.sh@21 -- # val= 00:06:16.863 03:22:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:16.863 03:22:57 -- accel/accel.sh@20 -- # IFS=: 00:06:16.863 03:22:57 -- accel/accel.sh@20 -- # read -r var val 00:06:16.863 03:22:57 -- accel/accel.sh@21 -- # val= 00:06:16.863 03:22:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:16.863 03:22:57 -- accel/accel.sh@20 -- # IFS=: 00:06:16.863 03:22:57 -- accel/accel.sh@20 -- # read -r var val 00:06:16.863 03:22:57 -- accel/accel.sh@21 -- # val= 00:06:16.863 03:22:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:16.863 03:22:57 -- accel/accel.sh@20 -- # IFS=: 00:06:16.863 03:22:57 -- accel/accel.sh@20 -- # read -r var val 00:06:16.863 03:22:57 -- accel/accel.sh@21 -- # val= 00:06:16.863 03:22:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:16.863 03:22:57 -- accel/accel.sh@20 -- # IFS=: 00:06:16.863 03:22:57 -- accel/accel.sh@20 -- # read -r var val 00:06:16.863 03:22:57 -- accel/accel.sh@21 -- # val= 00:06:16.863 03:22:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:16.863 03:22:57 -- accel/accel.sh@20 -- # IFS=: 00:06:16.863 03:22:57 -- accel/accel.sh@20 -- # read -r var val 00:06:16.863 03:22:57 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:16.863 03:22:57 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:16.863 03:22:57 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:16.863 00:06:16.863 real 0m2.983s 00:06:16.863 user 0m2.684s 00:06:16.863 sys 0m0.288s 00:06:16.863 03:22:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:16.863 03:22:57 -- common/autotest_common.sh@10 -- # set +x 00:06:16.863 ************************************ 00:06:16.863 END TEST accel_decmop_full 00:06:16.863 ************************************ 00:06:16.863 03:22:57 -- accel/accel.sh@111 -- # run_test accel_decomp_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:16.863 03:22:57 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:06:16.863 03:22:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:16.863 03:22:57 -- common/autotest_common.sh@10 -- # set +x 00:06:16.863 ************************************ 00:06:16.863 START TEST accel_decomp_mcore 00:06:16.863 ************************************ 00:06:16.863 03:22:57 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:16.863 03:22:57 -- accel/accel.sh@16 -- # local accel_opc 00:06:16.863 03:22:57 -- accel/accel.sh@17 -- # local accel_module 00:06:16.863 03:22:57 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:16.863 03:22:57 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:16.863 03:22:57 -- accel/accel.sh@12 -- # build_accel_config 00:06:16.863 03:22:57 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:16.863 03:22:57 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:16.863 03:22:57 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:16.863 03:22:57 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:16.863 03:22:57 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:16.863 03:22:57 -- accel/accel.sh@41 -- # local IFS=, 00:06:16.863 03:22:57 -- accel/accel.sh@42 -- # jq -r . 00:06:16.863 [2024-11-21 03:22:57.379574] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:16.863 [2024-11-21 03:22:57.379665] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2945266 ] 00:06:16.863 EAL: No free 2048 kB hugepages reported on node 1 00:06:16.863 [2024-11-21 03:22:57.441481] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:17.121 [2024-11-21 03:22:57.565135] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:17.121 [2024-11-21 03:22:57.565191] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:17.121 [2024-11-21 03:22:57.565245] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:17.121 [2024-11-21 03:22:57.565249] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:18.500 03:22:58 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:18.500 00:06:18.500 SPDK Configuration: 00:06:18.500 Core mask: 0xf 00:06:18.500 00:06:18.500 Accel Perf Configuration: 00:06:18.500 Workload Type: decompress 00:06:18.500 Transfer size: 4096 bytes 00:06:18.500 Vector count 1 00:06:18.500 Module: software 00:06:18.500 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:18.500 Queue depth: 32 00:06:18.500 Allocate depth: 32 00:06:18.500 # threads/core: 1 00:06:18.500 Run time: 1 seconds 00:06:18.500 Verify: Yes 00:06:18.500 00:06:18.500 Running for 1 seconds... 00:06:18.500 00:06:18.500 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:18.500 ------------------------------------------------------------------------------------ 00:06:18.500 0,0 49952/s 92 MiB/s 0 0 00:06:18.500 3,0 50720/s 93 MiB/s 0 0 00:06:18.500 2,0 50656/s 93 MiB/s 0 0 00:06:18.500 1,0 50528/s 93 MiB/s 0 0 00:06:18.500 ==================================================================================== 00:06:18.500 Total 201856/s 788 MiB/s 0 0' 00:06:18.500 03:22:58 -- accel/accel.sh@20 -- # IFS=: 00:06:18.500 03:22:58 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:18.500 03:22:58 -- accel/accel.sh@20 -- # read -r var val 00:06:18.500 03:22:58 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:18.500 03:22:58 -- accel/accel.sh@12 -- # build_accel_config 00:06:18.500 03:22:58 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:18.500 03:22:58 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:18.500 03:22:58 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:18.500 03:22:58 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:18.500 03:22:58 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:18.500 03:22:58 -- accel/accel.sh@41 -- # local IFS=, 00:06:18.500 03:22:58 -- accel/accel.sh@42 -- # jq -r . 00:06:18.500 [2024-11-21 03:22:58.870640] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:18.500 [2024-11-21 03:22:58.870732] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2945528 ] 00:06:18.500 EAL: No free 2048 kB hugepages reported on node 1 00:06:18.500 [2024-11-21 03:22:58.933872] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:18.500 [2024-11-21 03:22:59.055242] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:18.500 [2024-11-21 03:22:59.055298] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:18.500 [2024-11-21 03:22:59.055350] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:18.500 [2024-11-21 03:22:59.055354] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:18.500 03:22:59 -- accel/accel.sh@21 -- # val= 00:06:18.500 03:22:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.500 03:22:59 -- accel/accel.sh@20 -- # IFS=: 00:06:18.500 03:22:59 -- accel/accel.sh@20 -- # read -r var val 00:06:18.501 03:22:59 -- accel/accel.sh@21 -- # val= 00:06:18.501 03:22:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.501 03:22:59 -- accel/accel.sh@20 -- # IFS=: 00:06:18.501 03:22:59 -- accel/accel.sh@20 -- # read -r var val 00:06:18.501 03:22:59 -- accel/accel.sh@21 -- # val= 00:06:18.501 03:22:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.501 03:22:59 -- accel/accel.sh@20 -- # IFS=: 00:06:18.501 03:22:59 -- accel/accel.sh@20 -- # read -r var val 00:06:18.501 03:22:59 -- accel/accel.sh@21 -- # val=0xf 00:06:18.501 03:22:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.501 03:22:59 -- accel/accel.sh@20 -- # IFS=: 00:06:18.501 03:22:59 -- accel/accel.sh@20 -- # read -r var val 00:06:18.501 03:22:59 -- accel/accel.sh@21 -- # val= 00:06:18.501 03:22:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.501 03:22:59 -- accel/accel.sh@20 -- # IFS=: 00:06:18.501 03:22:59 -- accel/accel.sh@20 -- # read -r var val 00:06:18.501 03:22:59 -- accel/accel.sh@21 -- # val= 00:06:18.501 03:22:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.501 03:22:59 -- accel/accel.sh@20 -- # IFS=: 00:06:18.501 03:22:59 -- accel/accel.sh@20 -- # read -r var val 00:06:18.501 03:22:59 -- accel/accel.sh@21 -- # val=decompress 00:06:18.501 03:22:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.501 03:22:59 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:18.501 03:22:59 -- accel/accel.sh@20 -- # IFS=: 00:06:18.501 03:22:59 -- accel/accel.sh@20 -- # read -r var val 00:06:18.501 03:22:59 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:18.501 03:22:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.501 03:22:59 -- accel/accel.sh@20 -- # IFS=: 00:06:18.501 03:22:59 -- accel/accel.sh@20 -- # read -r var val 00:06:18.501 03:22:59 -- accel/accel.sh@21 -- # val= 00:06:18.501 03:22:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.501 03:22:59 -- accel/accel.sh@20 -- # IFS=: 00:06:18.501 03:22:59 -- accel/accel.sh@20 -- # read -r var val 00:06:18.501 03:22:59 -- accel/accel.sh@21 -- # val=software 00:06:18.501 03:22:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.501 03:22:59 -- accel/accel.sh@23 -- # accel_module=software 00:06:18.501 03:22:59 -- accel/accel.sh@20 -- # IFS=: 00:06:18.501 03:22:59 -- accel/accel.sh@20 -- # read -r var val 00:06:18.501 03:22:59 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:18.501 03:22:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.501 03:22:59 -- accel/accel.sh@20 -- # IFS=: 00:06:18.501 03:22:59 -- accel/accel.sh@20 -- # read -r var val 00:06:18.501 03:22:59 -- accel/accel.sh@21 -- # val=32 00:06:18.501 03:22:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.501 03:22:59 -- accel/accel.sh@20 -- # IFS=: 00:06:18.501 03:22:59 -- accel/accel.sh@20 -- # read -r var val 00:06:18.501 03:22:59 -- accel/accel.sh@21 -- # val=32 00:06:18.501 03:22:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.501 03:22:59 -- accel/accel.sh@20 -- # IFS=: 00:06:18.501 03:22:59 -- accel/accel.sh@20 -- # read -r var val 00:06:18.501 03:22:59 -- accel/accel.sh@21 -- # val=1 00:06:18.501 03:22:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.501 03:22:59 -- accel/accel.sh@20 -- # IFS=: 00:06:18.501 03:22:59 -- accel/accel.sh@20 -- # read -r var val 00:06:18.501 03:22:59 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:18.501 03:22:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.501 03:22:59 -- accel/accel.sh@20 -- # IFS=: 00:06:18.501 03:22:59 -- accel/accel.sh@20 -- # read -r var val 00:06:18.501 03:22:59 -- accel/accel.sh@21 -- # val=Yes 00:06:18.501 03:22:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.501 03:22:59 -- accel/accel.sh@20 -- # IFS=: 00:06:18.501 03:22:59 -- accel/accel.sh@20 -- # read -r var val 00:06:18.501 03:22:59 -- accel/accel.sh@21 -- # val= 00:06:18.501 03:22:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.501 03:22:59 -- accel/accel.sh@20 -- # IFS=: 00:06:18.501 03:22:59 -- accel/accel.sh@20 -- # read -r var val 00:06:18.501 03:22:59 -- accel/accel.sh@21 -- # val= 00:06:18.501 03:22:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.501 03:22:59 -- accel/accel.sh@20 -- # IFS=: 00:06:18.501 03:22:59 -- accel/accel.sh@20 -- # read -r var val 00:06:19.880 03:23:00 -- accel/accel.sh@21 -- # val= 00:06:19.880 03:23:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.880 03:23:00 -- accel/accel.sh@20 -- # IFS=: 00:06:19.880 03:23:00 -- accel/accel.sh@20 -- # read -r var val 00:06:19.880 03:23:00 -- accel/accel.sh@21 -- # val= 00:06:19.880 03:23:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.880 03:23:00 -- accel/accel.sh@20 -- # IFS=: 00:06:19.880 03:23:00 -- accel/accel.sh@20 -- # read -r var val 00:06:19.880 03:23:00 -- accel/accel.sh@21 -- # val= 00:06:19.880 03:23:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.880 03:23:00 -- accel/accel.sh@20 -- # IFS=: 00:06:19.880 03:23:00 -- accel/accel.sh@20 -- # read -r var val 00:06:19.880 03:23:00 -- accel/accel.sh@21 -- # val= 00:06:19.880 03:23:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.881 03:23:00 -- accel/accel.sh@20 -- # IFS=: 00:06:19.881 03:23:00 -- accel/accel.sh@20 -- # read -r var val 00:06:19.881 03:23:00 -- accel/accel.sh@21 -- # val= 00:06:19.881 03:23:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.881 03:23:00 -- accel/accel.sh@20 -- # IFS=: 00:06:19.881 03:23:00 -- accel/accel.sh@20 -- # read -r var val 00:06:19.881 03:23:00 -- accel/accel.sh@21 -- # val= 00:06:19.881 03:23:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.881 03:23:00 -- accel/accel.sh@20 -- # IFS=: 00:06:19.881 03:23:00 -- accel/accel.sh@20 -- # read -r var val 00:06:19.881 03:23:00 -- accel/accel.sh@21 -- # val= 00:06:19.881 03:23:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.881 03:23:00 -- accel/accel.sh@20 -- # IFS=: 00:06:19.881 03:23:00 -- accel/accel.sh@20 -- # read -r var val 00:06:19.881 03:23:00 -- accel/accel.sh@21 -- # val= 00:06:19.881 03:23:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.881 03:23:00 -- accel/accel.sh@20 -- # IFS=: 00:06:19.881 03:23:00 -- accel/accel.sh@20 -- # read -r var val 00:06:19.881 03:23:00 -- accel/accel.sh@21 -- # val= 00:06:19.881 03:23:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.881 03:23:00 -- accel/accel.sh@20 -- # IFS=: 00:06:19.881 03:23:00 -- accel/accel.sh@20 -- # read -r var val 00:06:19.881 03:23:00 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:19.881 03:23:00 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:19.881 03:23:00 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:19.881 00:06:19.881 real 0m2.980s 00:06:19.881 user 0m9.549s 00:06:19.881 sys 0m0.313s 00:06:19.881 03:23:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:19.881 03:23:00 -- common/autotest_common.sh@10 -- # set +x 00:06:19.881 ************************************ 00:06:19.881 END TEST accel_decomp_mcore 00:06:19.881 ************************************ 00:06:19.881 03:23:00 -- accel/accel.sh@112 -- # run_test accel_decomp_full_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:19.881 03:23:00 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:06:19.881 03:23:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:19.881 03:23:00 -- common/autotest_common.sh@10 -- # set +x 00:06:19.881 ************************************ 00:06:19.881 START TEST accel_decomp_full_mcore 00:06:19.881 ************************************ 00:06:19.881 03:23:00 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:19.881 03:23:00 -- accel/accel.sh@16 -- # local accel_opc 00:06:19.881 03:23:00 -- accel/accel.sh@17 -- # local accel_module 00:06:19.881 03:23:00 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:19.881 03:23:00 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:19.881 03:23:00 -- accel/accel.sh@12 -- # build_accel_config 00:06:19.881 03:23:00 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:19.881 03:23:00 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:19.881 03:23:00 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:19.881 03:23:00 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:19.881 03:23:00 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:19.881 03:23:00 -- accel/accel.sh@41 -- # local IFS=, 00:06:19.881 03:23:00 -- accel/accel.sh@42 -- # jq -r . 00:06:19.881 [2024-11-21 03:23:00.387299] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:19.881 [2024-11-21 03:23:00.387391] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2945695 ] 00:06:19.881 EAL: No free 2048 kB hugepages reported on node 1 00:06:19.881 [2024-11-21 03:23:00.450817] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:20.141 [2024-11-21 03:23:00.575298] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:20.141 [2024-11-21 03:23:00.575354] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:20.141 [2024-11-21 03:23:00.575408] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:20.141 [2024-11-21 03:23:00.575412] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:21.519 03:23:01 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:21.519 00:06:21.519 SPDK Configuration: 00:06:21.519 Core mask: 0xf 00:06:21.519 00:06:21.519 Accel Perf Configuration: 00:06:21.519 Workload Type: decompress 00:06:21.519 Transfer size: 111250 bytes 00:06:21.519 Vector count 1 00:06:21.519 Module: software 00:06:21.519 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:21.519 Queue depth: 32 00:06:21.519 Allocate depth: 32 00:06:21.519 # threads/core: 1 00:06:21.519 Run time: 1 seconds 00:06:21.519 Verify: Yes 00:06:21.519 00:06:21.519 Running for 1 seconds... 00:06:21.519 00:06:21.519 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:21.519 ------------------------------------------------------------------------------------ 00:06:21.519 0,0 3776/s 155 MiB/s 0 0 00:06:21.519 3,0 3776/s 155 MiB/s 0 0 00:06:21.519 2,0 3776/s 155 MiB/s 0 0 00:06:21.519 1,0 3776/s 155 MiB/s 0 0 00:06:21.519 ==================================================================================== 00:06:21.519 Total 15104/s 1602 MiB/s 0 0' 00:06:21.519 03:23:01 -- accel/accel.sh@20 -- # IFS=: 00:06:21.519 03:23:01 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:21.519 03:23:01 -- accel/accel.sh@20 -- # read -r var val 00:06:21.519 03:23:01 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:21.519 03:23:01 -- accel/accel.sh@12 -- # build_accel_config 00:06:21.519 03:23:01 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:21.519 03:23:01 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:21.519 03:23:01 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:21.519 03:23:01 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:21.519 03:23:01 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:21.520 03:23:01 -- accel/accel.sh@41 -- # local IFS=, 00:06:21.520 03:23:01 -- accel/accel.sh@42 -- # jq -r . 00:06:21.520 [2024-11-21 03:23:01.894181] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:21.520 [2024-11-21 03:23:01.894282] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2945843 ] 00:06:21.520 EAL: No free 2048 kB hugepages reported on node 1 00:06:21.520 [2024-11-21 03:23:01.960148] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:21.520 [2024-11-21 03:23:02.083569] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:21.520 [2024-11-21 03:23:02.083623] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:21.520 [2024-11-21 03:23:02.083679] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:21.520 [2024-11-21 03:23:02.083683] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:21.520 03:23:02 -- accel/accel.sh@21 -- # val= 00:06:21.520 03:23:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.520 03:23:02 -- accel/accel.sh@20 -- # IFS=: 00:06:21.520 03:23:02 -- accel/accel.sh@20 -- # read -r var val 00:06:21.520 03:23:02 -- accel/accel.sh@21 -- # val= 00:06:21.520 03:23:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.520 03:23:02 -- accel/accel.sh@20 -- # IFS=: 00:06:21.520 03:23:02 -- accel/accel.sh@20 -- # read -r var val 00:06:21.520 03:23:02 -- accel/accel.sh@21 -- # val= 00:06:21.520 03:23:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.520 03:23:02 -- accel/accel.sh@20 -- # IFS=: 00:06:21.520 03:23:02 -- accel/accel.sh@20 -- # read -r var val 00:06:21.520 03:23:02 -- accel/accel.sh@21 -- # val=0xf 00:06:21.520 03:23:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.520 03:23:02 -- accel/accel.sh@20 -- # IFS=: 00:06:21.520 03:23:02 -- accel/accel.sh@20 -- # read -r var val 00:06:21.520 03:23:02 -- accel/accel.sh@21 -- # val= 00:06:21.520 03:23:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.520 03:23:02 -- accel/accel.sh@20 -- # IFS=: 00:06:21.520 03:23:02 -- accel/accel.sh@20 -- # read -r var val 00:06:21.520 03:23:02 -- accel/accel.sh@21 -- # val= 00:06:21.520 03:23:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.520 03:23:02 -- accel/accel.sh@20 -- # IFS=: 00:06:21.520 03:23:02 -- accel/accel.sh@20 -- # read -r var val 00:06:21.520 03:23:02 -- accel/accel.sh@21 -- # val=decompress 00:06:21.520 03:23:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.520 03:23:02 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:21.520 03:23:02 -- accel/accel.sh@20 -- # IFS=: 00:06:21.520 03:23:02 -- accel/accel.sh@20 -- # read -r var val 00:06:21.520 03:23:02 -- accel/accel.sh@21 -- # val='111250 bytes' 00:06:21.520 03:23:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.520 03:23:02 -- accel/accel.sh@20 -- # IFS=: 00:06:21.520 03:23:02 -- accel/accel.sh@20 -- # read -r var val 00:06:21.520 03:23:02 -- accel/accel.sh@21 -- # val= 00:06:21.520 03:23:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.520 03:23:02 -- accel/accel.sh@20 -- # IFS=: 00:06:21.520 03:23:02 -- accel/accel.sh@20 -- # read -r var val 00:06:21.520 03:23:02 -- accel/accel.sh@21 -- # val=software 00:06:21.520 03:23:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.520 03:23:02 -- accel/accel.sh@23 -- # accel_module=software 00:06:21.520 03:23:02 -- accel/accel.sh@20 -- # IFS=: 00:06:21.520 03:23:02 -- accel/accel.sh@20 -- # read -r var val 00:06:21.520 03:23:02 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:21.520 03:23:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.520 03:23:02 -- accel/accel.sh@20 -- # IFS=: 00:06:21.520 03:23:02 -- accel/accel.sh@20 -- # read -r var val 00:06:21.520 03:23:02 -- accel/accel.sh@21 -- # val=32 00:06:21.520 03:23:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.520 03:23:02 -- accel/accel.sh@20 -- # IFS=: 00:06:21.520 03:23:02 -- accel/accel.sh@20 -- # read -r var val 00:06:21.520 03:23:02 -- accel/accel.sh@21 -- # val=32 00:06:21.520 03:23:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.520 03:23:02 -- accel/accel.sh@20 -- # IFS=: 00:06:21.520 03:23:02 -- accel/accel.sh@20 -- # read -r var val 00:06:21.520 03:23:02 -- accel/accel.sh@21 -- # val=1 00:06:21.520 03:23:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.520 03:23:02 -- accel/accel.sh@20 -- # IFS=: 00:06:21.520 03:23:02 -- accel/accel.sh@20 -- # read -r var val 00:06:21.520 03:23:02 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:21.520 03:23:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.520 03:23:02 -- accel/accel.sh@20 -- # IFS=: 00:06:21.520 03:23:02 -- accel/accel.sh@20 -- # read -r var val 00:06:21.520 03:23:02 -- accel/accel.sh@21 -- # val=Yes 00:06:21.520 03:23:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.520 03:23:02 -- accel/accel.sh@20 -- # IFS=: 00:06:21.520 03:23:02 -- accel/accel.sh@20 -- # read -r var val 00:06:21.520 03:23:02 -- accel/accel.sh@21 -- # val= 00:06:21.520 03:23:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.520 03:23:02 -- accel/accel.sh@20 -- # IFS=: 00:06:21.520 03:23:02 -- accel/accel.sh@20 -- # read -r var val 00:06:21.520 03:23:02 -- accel/accel.sh@21 -- # val= 00:06:21.520 03:23:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.520 03:23:02 -- accel/accel.sh@20 -- # IFS=: 00:06:21.520 03:23:02 -- accel/accel.sh@20 -- # read -r var val 00:06:22.904 03:23:03 -- accel/accel.sh@21 -- # val= 00:06:22.904 03:23:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.904 03:23:03 -- accel/accel.sh@20 -- # IFS=: 00:06:22.904 03:23:03 -- accel/accel.sh@20 -- # read -r var val 00:06:22.904 03:23:03 -- accel/accel.sh@21 -- # val= 00:06:22.904 03:23:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.904 03:23:03 -- accel/accel.sh@20 -- # IFS=: 00:06:22.904 03:23:03 -- accel/accel.sh@20 -- # read -r var val 00:06:22.904 03:23:03 -- accel/accel.sh@21 -- # val= 00:06:22.904 03:23:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.904 03:23:03 -- accel/accel.sh@20 -- # IFS=: 00:06:22.904 03:23:03 -- accel/accel.sh@20 -- # read -r var val 00:06:22.904 03:23:03 -- accel/accel.sh@21 -- # val= 00:06:22.904 03:23:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.904 03:23:03 -- accel/accel.sh@20 -- # IFS=: 00:06:22.904 03:23:03 -- accel/accel.sh@20 -- # read -r var val 00:06:22.904 03:23:03 -- accel/accel.sh@21 -- # val= 00:06:22.904 03:23:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.904 03:23:03 -- accel/accel.sh@20 -- # IFS=: 00:06:22.904 03:23:03 -- accel/accel.sh@20 -- # read -r var val 00:06:22.904 03:23:03 -- accel/accel.sh@21 -- # val= 00:06:22.904 03:23:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.904 03:23:03 -- accel/accel.sh@20 -- # IFS=: 00:06:22.904 03:23:03 -- accel/accel.sh@20 -- # read -r var val 00:06:22.904 03:23:03 -- accel/accel.sh@21 -- # val= 00:06:22.904 03:23:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.904 03:23:03 -- accel/accel.sh@20 -- # IFS=: 00:06:22.904 03:23:03 -- accel/accel.sh@20 -- # read -r var val 00:06:22.904 03:23:03 -- accel/accel.sh@21 -- # val= 00:06:22.904 03:23:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.904 03:23:03 -- accel/accel.sh@20 -- # IFS=: 00:06:22.904 03:23:03 -- accel/accel.sh@20 -- # read -r var val 00:06:22.904 03:23:03 -- accel/accel.sh@21 -- # val= 00:06:22.904 03:23:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.904 03:23:03 -- accel/accel.sh@20 -- # IFS=: 00:06:22.904 03:23:03 -- accel/accel.sh@20 -- # read -r var val 00:06:22.904 03:23:03 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:22.904 03:23:03 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:22.904 03:23:03 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:22.904 00:06:22.904 real 0m3.015s 00:06:22.904 user 0m9.682s 00:06:22.904 sys 0m0.315s 00:06:22.904 03:23:03 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:22.904 03:23:03 -- common/autotest_common.sh@10 -- # set +x 00:06:22.904 ************************************ 00:06:22.904 END TEST accel_decomp_full_mcore 00:06:22.904 ************************************ 00:06:22.904 03:23:03 -- accel/accel.sh@113 -- # run_test accel_decomp_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:22.904 03:23:03 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:06:22.904 03:23:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:22.904 03:23:03 -- common/autotest_common.sh@10 -- # set +x 00:06:22.904 ************************************ 00:06:22.904 START TEST accel_decomp_mthread 00:06:22.904 ************************************ 00:06:22.904 03:23:03 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:22.904 03:23:03 -- accel/accel.sh@16 -- # local accel_opc 00:06:22.904 03:23:03 -- accel/accel.sh@17 -- # local accel_module 00:06:22.904 03:23:03 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:22.904 03:23:03 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:22.904 03:23:03 -- accel/accel.sh@12 -- # build_accel_config 00:06:22.904 03:23:03 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:22.904 03:23:03 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:22.904 03:23:03 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:22.904 03:23:03 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:22.904 03:23:03 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:22.904 03:23:03 -- accel/accel.sh@41 -- # local IFS=, 00:06:22.904 03:23:03 -- accel/accel.sh@42 -- # jq -r . 00:06:22.904 [2024-11-21 03:23:03.429049] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:22.904 [2024-11-21 03:23:03.429149] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2946125 ] 00:06:22.904 EAL: No free 2048 kB hugepages reported on node 1 00:06:22.904 [2024-11-21 03:23:03.490833] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:23.164 [2024-11-21 03:23:03.611688] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:24.546 03:23:04 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:24.546 00:06:24.546 SPDK Configuration: 00:06:24.546 Core mask: 0x1 00:06:24.546 00:06:24.546 Accel Perf Configuration: 00:06:24.546 Workload Type: decompress 00:06:24.546 Transfer size: 4096 bytes 00:06:24.546 Vector count 1 00:06:24.546 Module: software 00:06:24.546 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:24.546 Queue depth: 32 00:06:24.546 Allocate depth: 32 00:06:24.546 # threads/core: 2 00:06:24.546 Run time: 1 seconds 00:06:24.546 Verify: Yes 00:06:24.546 00:06:24.546 Running for 1 seconds... 00:06:24.546 00:06:24.546 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:24.546 ------------------------------------------------------------------------------------ 00:06:24.546 0,1 28032/s 51 MiB/s 0 0 00:06:24.546 0,0 27904/s 51 MiB/s 0 0 00:06:24.546 ==================================================================================== 00:06:24.546 Total 55936/s 218 MiB/s 0 0' 00:06:24.546 03:23:04 -- accel/accel.sh@20 -- # IFS=: 00:06:24.546 03:23:04 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:24.546 03:23:04 -- accel/accel.sh@20 -- # read -r var val 00:06:24.546 03:23:04 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:24.546 03:23:04 -- accel/accel.sh@12 -- # build_accel_config 00:06:24.546 03:23:04 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:24.546 03:23:04 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:24.546 03:23:04 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:24.546 03:23:04 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:24.546 03:23:04 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:24.546 03:23:04 -- accel/accel.sh@41 -- # local IFS=, 00:06:24.546 03:23:04 -- accel/accel.sh@42 -- # jq -r . 00:06:24.546 [2024-11-21 03:23:04.911945] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:24.546 [2024-11-21 03:23:04.912032] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2946269 ] 00:06:24.546 EAL: No free 2048 kB hugepages reported on node 1 00:06:24.546 [2024-11-21 03:23:04.973532] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:24.546 [2024-11-21 03:23:05.092761] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:24.546 03:23:05 -- accel/accel.sh@21 -- # val= 00:06:24.546 03:23:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.546 03:23:05 -- accel/accel.sh@20 -- # IFS=: 00:06:24.546 03:23:05 -- accel/accel.sh@20 -- # read -r var val 00:06:24.546 03:23:05 -- accel/accel.sh@21 -- # val= 00:06:24.546 03:23:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.546 03:23:05 -- accel/accel.sh@20 -- # IFS=: 00:06:24.546 03:23:05 -- accel/accel.sh@20 -- # read -r var val 00:06:24.546 03:23:05 -- accel/accel.sh@21 -- # val= 00:06:24.546 03:23:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.546 03:23:05 -- accel/accel.sh@20 -- # IFS=: 00:06:24.546 03:23:05 -- accel/accel.sh@20 -- # read -r var val 00:06:24.546 03:23:05 -- accel/accel.sh@21 -- # val=0x1 00:06:24.546 03:23:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.546 03:23:05 -- accel/accel.sh@20 -- # IFS=: 00:06:24.546 03:23:05 -- accel/accel.sh@20 -- # read -r var val 00:06:24.546 03:23:05 -- accel/accel.sh@21 -- # val= 00:06:24.546 03:23:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.546 03:23:05 -- accel/accel.sh@20 -- # IFS=: 00:06:24.546 03:23:05 -- accel/accel.sh@20 -- # read -r var val 00:06:24.546 03:23:05 -- accel/accel.sh@21 -- # val= 00:06:24.546 03:23:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.546 03:23:05 -- accel/accel.sh@20 -- # IFS=: 00:06:24.546 03:23:05 -- accel/accel.sh@20 -- # read -r var val 00:06:24.546 03:23:05 -- accel/accel.sh@21 -- # val=decompress 00:06:24.546 03:23:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.546 03:23:05 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:24.547 03:23:05 -- accel/accel.sh@20 -- # IFS=: 00:06:24.547 03:23:05 -- accel/accel.sh@20 -- # read -r var val 00:06:24.547 03:23:05 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:24.547 03:23:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.547 03:23:05 -- accel/accel.sh@20 -- # IFS=: 00:06:24.547 03:23:05 -- accel/accel.sh@20 -- # read -r var val 00:06:24.547 03:23:05 -- accel/accel.sh@21 -- # val= 00:06:24.547 03:23:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.547 03:23:05 -- accel/accel.sh@20 -- # IFS=: 00:06:24.547 03:23:05 -- accel/accel.sh@20 -- # read -r var val 00:06:24.547 03:23:05 -- accel/accel.sh@21 -- # val=software 00:06:24.547 03:23:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.547 03:23:05 -- accel/accel.sh@23 -- # accel_module=software 00:06:24.547 03:23:05 -- accel/accel.sh@20 -- # IFS=: 00:06:24.547 03:23:05 -- accel/accel.sh@20 -- # read -r var val 00:06:24.547 03:23:05 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:24.547 03:23:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.547 03:23:05 -- accel/accel.sh@20 -- # IFS=: 00:06:24.547 03:23:05 -- accel/accel.sh@20 -- # read -r var val 00:06:24.547 03:23:05 -- accel/accel.sh@21 -- # val=32 00:06:24.547 03:23:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.547 03:23:05 -- accel/accel.sh@20 -- # IFS=: 00:06:24.547 03:23:05 -- accel/accel.sh@20 -- # read -r var val 00:06:24.547 03:23:05 -- accel/accel.sh@21 -- # val=32 00:06:24.547 03:23:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.547 03:23:05 -- accel/accel.sh@20 -- # IFS=: 00:06:24.547 03:23:05 -- accel/accel.sh@20 -- # read -r var val 00:06:24.547 03:23:05 -- accel/accel.sh@21 -- # val=2 00:06:24.547 03:23:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.547 03:23:05 -- accel/accel.sh@20 -- # IFS=: 00:06:24.547 03:23:05 -- accel/accel.sh@20 -- # read -r var val 00:06:24.547 03:23:05 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:24.547 03:23:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.547 03:23:05 -- accel/accel.sh@20 -- # IFS=: 00:06:24.547 03:23:05 -- accel/accel.sh@20 -- # read -r var val 00:06:24.547 03:23:05 -- accel/accel.sh@21 -- # val=Yes 00:06:24.547 03:23:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.547 03:23:05 -- accel/accel.sh@20 -- # IFS=: 00:06:24.547 03:23:05 -- accel/accel.sh@20 -- # read -r var val 00:06:24.547 03:23:05 -- accel/accel.sh@21 -- # val= 00:06:24.547 03:23:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.547 03:23:05 -- accel/accel.sh@20 -- # IFS=: 00:06:24.547 03:23:05 -- accel/accel.sh@20 -- # read -r var val 00:06:24.547 03:23:05 -- accel/accel.sh@21 -- # val= 00:06:24.547 03:23:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.547 03:23:05 -- accel/accel.sh@20 -- # IFS=: 00:06:24.547 03:23:05 -- accel/accel.sh@20 -- # read -r var val 00:06:25.931 03:23:06 -- accel/accel.sh@21 -- # val= 00:06:25.931 03:23:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:25.931 03:23:06 -- accel/accel.sh@20 -- # IFS=: 00:06:25.931 03:23:06 -- accel/accel.sh@20 -- # read -r var val 00:06:25.931 03:23:06 -- accel/accel.sh@21 -- # val= 00:06:25.931 03:23:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:25.931 03:23:06 -- accel/accel.sh@20 -- # IFS=: 00:06:25.931 03:23:06 -- accel/accel.sh@20 -- # read -r var val 00:06:25.931 03:23:06 -- accel/accel.sh@21 -- # val= 00:06:25.931 03:23:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:25.931 03:23:06 -- accel/accel.sh@20 -- # IFS=: 00:06:25.932 03:23:06 -- accel/accel.sh@20 -- # read -r var val 00:06:25.932 03:23:06 -- accel/accel.sh@21 -- # val= 00:06:25.932 03:23:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:25.932 03:23:06 -- accel/accel.sh@20 -- # IFS=: 00:06:25.932 03:23:06 -- accel/accel.sh@20 -- # read -r var val 00:06:25.932 03:23:06 -- accel/accel.sh@21 -- # val= 00:06:25.932 03:23:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:25.932 03:23:06 -- accel/accel.sh@20 -- # IFS=: 00:06:25.932 03:23:06 -- accel/accel.sh@20 -- # read -r var val 00:06:25.932 03:23:06 -- accel/accel.sh@21 -- # val= 00:06:25.932 03:23:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:25.932 03:23:06 -- accel/accel.sh@20 -- # IFS=: 00:06:25.932 03:23:06 -- accel/accel.sh@20 -- # read -r var val 00:06:25.932 03:23:06 -- accel/accel.sh@21 -- # val= 00:06:25.932 03:23:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:25.932 03:23:06 -- accel/accel.sh@20 -- # IFS=: 00:06:25.932 03:23:06 -- accel/accel.sh@20 -- # read -r var val 00:06:25.932 03:23:06 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:25.932 03:23:06 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:25.932 03:23:06 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:25.932 00:06:25.932 real 0m2.978s 00:06:25.932 user 0m2.660s 00:06:25.932 sys 0m0.309s 00:06:25.932 03:23:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:25.932 03:23:06 -- common/autotest_common.sh@10 -- # set +x 00:06:25.932 ************************************ 00:06:25.932 END TEST accel_decomp_mthread 00:06:25.932 ************************************ 00:06:25.932 03:23:06 -- accel/accel.sh@114 -- # run_test accel_deomp_full_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:25.932 03:23:06 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:06:25.932 03:23:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:25.932 03:23:06 -- common/autotest_common.sh@10 -- # set +x 00:06:25.932 ************************************ 00:06:25.932 START TEST accel_deomp_full_mthread 00:06:25.932 ************************************ 00:06:25.932 03:23:06 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:25.932 03:23:06 -- accel/accel.sh@16 -- # local accel_opc 00:06:25.932 03:23:06 -- accel/accel.sh@17 -- # local accel_module 00:06:25.932 03:23:06 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:25.932 03:23:06 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:25.932 03:23:06 -- accel/accel.sh@12 -- # build_accel_config 00:06:25.932 03:23:06 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:25.932 03:23:06 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:25.932 03:23:06 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:25.932 03:23:06 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:25.932 03:23:06 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:25.932 03:23:06 -- accel/accel.sh@41 -- # local IFS=, 00:06:25.932 03:23:06 -- accel/accel.sh@42 -- # jq -r . 00:06:25.932 [2024-11-21 03:23:06.433836] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:25.932 [2024-11-21 03:23:06.433922] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2946431 ] 00:06:25.932 EAL: No free 2048 kB hugepages reported on node 1 00:06:25.932 [2024-11-21 03:23:06.495942] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:26.192 [2024-11-21 03:23:06.615854] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:27.576 03:23:07 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:27.576 00:06:27.576 SPDK Configuration: 00:06:27.576 Core mask: 0x1 00:06:27.576 00:06:27.576 Accel Perf Configuration: 00:06:27.576 Workload Type: decompress 00:06:27.576 Transfer size: 111250 bytes 00:06:27.576 Vector count 1 00:06:27.576 Module: software 00:06:27.576 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:27.576 Queue depth: 32 00:06:27.576 Allocate depth: 32 00:06:27.576 # threads/core: 2 00:06:27.576 Run time: 1 seconds 00:06:27.576 Verify: Yes 00:06:27.576 00:06:27.576 Running for 1 seconds... 00:06:27.576 00:06:27.576 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:27.576 ------------------------------------------------------------------------------------ 00:06:27.576 0,1 1952/s 80 MiB/s 0 0 00:06:27.576 0,0 1920/s 79 MiB/s 0 0 00:06:27.576 ==================================================================================== 00:06:27.576 Total 3872/s 410 MiB/s 0 0' 00:06:27.576 03:23:07 -- accel/accel.sh@20 -- # IFS=: 00:06:27.576 03:23:07 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:27.576 03:23:07 -- accel/accel.sh@20 -- # read -r var val 00:06:27.576 03:23:07 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:27.576 03:23:07 -- accel/accel.sh@12 -- # build_accel_config 00:06:27.576 03:23:07 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:27.576 03:23:07 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:27.576 03:23:07 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:27.576 03:23:07 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:27.576 03:23:07 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:27.576 03:23:07 -- accel/accel.sh@41 -- # local IFS=, 00:06:27.576 03:23:07 -- accel/accel.sh@42 -- # jq -r . 00:06:27.576 [2024-11-21 03:23:07.951154] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:27.577 [2024-11-21 03:23:07.951248] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2946693 ] 00:06:27.577 EAL: No free 2048 kB hugepages reported on node 1 00:06:27.577 [2024-11-21 03:23:08.013933] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:27.577 [2024-11-21 03:23:08.134343] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:27.577 03:23:08 -- accel/accel.sh@21 -- # val= 00:06:27.577 03:23:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.577 03:23:08 -- accel/accel.sh@20 -- # IFS=: 00:06:27.577 03:23:08 -- accel/accel.sh@20 -- # read -r var val 00:06:27.577 03:23:08 -- accel/accel.sh@21 -- # val= 00:06:27.577 03:23:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.577 03:23:08 -- accel/accel.sh@20 -- # IFS=: 00:06:27.577 03:23:08 -- accel/accel.sh@20 -- # read -r var val 00:06:27.577 03:23:08 -- accel/accel.sh@21 -- # val= 00:06:27.577 03:23:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.577 03:23:08 -- accel/accel.sh@20 -- # IFS=: 00:06:27.577 03:23:08 -- accel/accel.sh@20 -- # read -r var val 00:06:27.577 03:23:08 -- accel/accel.sh@21 -- # val=0x1 00:06:27.577 03:23:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.577 03:23:08 -- accel/accel.sh@20 -- # IFS=: 00:06:27.577 03:23:08 -- accel/accel.sh@20 -- # read -r var val 00:06:27.577 03:23:08 -- accel/accel.sh@21 -- # val= 00:06:27.577 03:23:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.577 03:23:08 -- accel/accel.sh@20 -- # IFS=: 00:06:27.577 03:23:08 -- accel/accel.sh@20 -- # read -r var val 00:06:27.577 03:23:08 -- accel/accel.sh@21 -- # val= 00:06:27.577 03:23:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.577 03:23:08 -- accel/accel.sh@20 -- # IFS=: 00:06:27.577 03:23:08 -- accel/accel.sh@20 -- # read -r var val 00:06:27.577 03:23:08 -- accel/accel.sh@21 -- # val=decompress 00:06:27.577 03:23:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.577 03:23:08 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:27.577 03:23:08 -- accel/accel.sh@20 -- # IFS=: 00:06:27.577 03:23:08 -- accel/accel.sh@20 -- # read -r var val 00:06:27.577 03:23:08 -- accel/accel.sh@21 -- # val='111250 bytes' 00:06:27.577 03:23:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.577 03:23:08 -- accel/accel.sh@20 -- # IFS=: 00:06:27.577 03:23:08 -- accel/accel.sh@20 -- # read -r var val 00:06:27.577 03:23:08 -- accel/accel.sh@21 -- # val= 00:06:27.577 03:23:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.577 03:23:08 -- accel/accel.sh@20 -- # IFS=: 00:06:27.577 03:23:08 -- accel/accel.sh@20 -- # read -r var val 00:06:27.577 03:23:08 -- accel/accel.sh@21 -- # val=software 00:06:27.577 03:23:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.577 03:23:08 -- accel/accel.sh@23 -- # accel_module=software 00:06:27.577 03:23:08 -- accel/accel.sh@20 -- # IFS=: 00:06:27.577 03:23:08 -- accel/accel.sh@20 -- # read -r var val 00:06:27.577 03:23:08 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:27.577 03:23:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.577 03:23:08 -- accel/accel.sh@20 -- # IFS=: 00:06:27.577 03:23:08 -- accel/accel.sh@20 -- # read -r var val 00:06:27.577 03:23:08 -- accel/accel.sh@21 -- # val=32 00:06:27.577 03:23:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.577 03:23:08 -- accel/accel.sh@20 -- # IFS=: 00:06:27.577 03:23:08 -- accel/accel.sh@20 -- # read -r var val 00:06:27.577 03:23:08 -- accel/accel.sh@21 -- # val=32 00:06:27.577 03:23:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.577 03:23:08 -- accel/accel.sh@20 -- # IFS=: 00:06:27.577 03:23:08 -- accel/accel.sh@20 -- # read -r var val 00:06:27.577 03:23:08 -- accel/accel.sh@21 -- # val=2 00:06:27.577 03:23:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.577 03:23:08 -- accel/accel.sh@20 -- # IFS=: 00:06:27.577 03:23:08 -- accel/accel.sh@20 -- # read -r var val 00:06:27.577 03:23:08 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:27.577 03:23:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.577 03:23:08 -- accel/accel.sh@20 -- # IFS=: 00:06:27.577 03:23:08 -- accel/accel.sh@20 -- # read -r var val 00:06:27.577 03:23:08 -- accel/accel.sh@21 -- # val=Yes 00:06:27.577 03:23:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.577 03:23:08 -- accel/accel.sh@20 -- # IFS=: 00:06:27.577 03:23:08 -- accel/accel.sh@20 -- # read -r var val 00:06:27.577 03:23:08 -- accel/accel.sh@21 -- # val= 00:06:27.577 03:23:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.577 03:23:08 -- accel/accel.sh@20 -- # IFS=: 00:06:27.577 03:23:08 -- accel/accel.sh@20 -- # read -r var val 00:06:27.577 03:23:08 -- accel/accel.sh@21 -- # val= 00:06:27.577 03:23:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.577 03:23:08 -- accel/accel.sh@20 -- # IFS=: 00:06:27.577 03:23:08 -- accel/accel.sh@20 -- # read -r var val 00:06:28.958 03:23:09 -- accel/accel.sh@21 -- # val= 00:06:28.958 03:23:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:28.958 03:23:09 -- accel/accel.sh@20 -- # IFS=: 00:06:28.958 03:23:09 -- accel/accel.sh@20 -- # read -r var val 00:06:28.958 03:23:09 -- accel/accel.sh@21 -- # val= 00:06:28.958 03:23:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:28.958 03:23:09 -- accel/accel.sh@20 -- # IFS=: 00:06:28.958 03:23:09 -- accel/accel.sh@20 -- # read -r var val 00:06:28.958 03:23:09 -- accel/accel.sh@21 -- # val= 00:06:28.958 03:23:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:28.958 03:23:09 -- accel/accel.sh@20 -- # IFS=: 00:06:28.958 03:23:09 -- accel/accel.sh@20 -- # read -r var val 00:06:28.958 03:23:09 -- accel/accel.sh@21 -- # val= 00:06:28.958 03:23:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:28.958 03:23:09 -- accel/accel.sh@20 -- # IFS=: 00:06:28.958 03:23:09 -- accel/accel.sh@20 -- # read -r var val 00:06:28.958 03:23:09 -- accel/accel.sh@21 -- # val= 00:06:28.958 03:23:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:28.958 03:23:09 -- accel/accel.sh@20 -- # IFS=: 00:06:28.958 03:23:09 -- accel/accel.sh@20 -- # read -r var val 00:06:28.958 03:23:09 -- accel/accel.sh@21 -- # val= 00:06:28.958 03:23:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:28.958 03:23:09 -- accel/accel.sh@20 -- # IFS=: 00:06:28.958 03:23:09 -- accel/accel.sh@20 -- # read -r var val 00:06:28.958 03:23:09 -- accel/accel.sh@21 -- # val= 00:06:28.958 03:23:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:28.958 03:23:09 -- accel/accel.sh@20 -- # IFS=: 00:06:28.958 03:23:09 -- accel/accel.sh@20 -- # read -r var val 00:06:28.958 03:23:09 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:28.958 03:23:09 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:28.958 03:23:09 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:28.958 00:06:28.958 real 0m3.046s 00:06:28.958 user 0m2.752s 00:06:28.958 sys 0m0.285s 00:06:28.958 03:23:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:28.958 03:23:09 -- common/autotest_common.sh@10 -- # set +x 00:06:28.958 ************************************ 00:06:28.958 END TEST accel_deomp_full_mthread 00:06:28.958 ************************************ 00:06:28.958 03:23:09 -- accel/accel.sh@116 -- # [[ n == y ]] 00:06:28.958 03:23:09 -- accel/accel.sh@129 -- # run_test accel_dif_functional_tests /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:06:28.958 03:23:09 -- accel/accel.sh@129 -- # build_accel_config 00:06:28.958 03:23:09 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:28.958 03:23:09 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:06:28.958 03:23:09 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:28.958 03:23:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:28.958 03:23:09 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:28.958 03:23:09 -- common/autotest_common.sh@10 -- # set +x 00:06:28.958 03:23:09 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:28.958 03:23:09 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:28.958 03:23:09 -- accel/accel.sh@41 -- # local IFS=, 00:06:28.958 03:23:09 -- accel/accel.sh@42 -- # jq -r . 00:06:28.958 ************************************ 00:06:28.958 START TEST accel_dif_functional_tests 00:06:28.958 ************************************ 00:06:28.958 03:23:09 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:06:28.958 [2024-11-21 03:23:09.526573] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:28.958 [2024-11-21 03:23:09.526656] [ DPDK EAL parameters: DIF --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2946853 ] 00:06:28.958 EAL: No free 2048 kB hugepages reported on node 1 00:06:28.958 [2024-11-21 03:23:09.588659] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:06:29.218 [2024-11-21 03:23:09.708306] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:29.218 [2024-11-21 03:23:09.708365] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:29.218 [2024-11-21 03:23:09.708368] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:29.218 00:06:29.218 00:06:29.219 CUnit - A unit testing framework for C - Version 2.1-3 00:06:29.219 http://cunit.sourceforge.net/ 00:06:29.219 00:06:29.219 00:06:29.219 Suite: accel_dif 00:06:29.219 Test: verify: DIF generated, GUARD check ...passed 00:06:29.219 Test: verify: DIF generated, APPTAG check ...passed 00:06:29.219 Test: verify: DIF generated, REFTAG check ...passed 00:06:29.219 Test: verify: DIF not generated, GUARD check ...[2024-11-21 03:23:09.810378] dif.c: 777:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:06:29.219 [2024-11-21 03:23:09.810450] dif.c: 777:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:06:29.219 passed 00:06:29.219 Test: verify: DIF not generated, APPTAG check ...[2024-11-21 03:23:09.810494] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:06:29.219 [2024-11-21 03:23:09.810524] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:06:29.219 passed 00:06:29.219 Test: verify: DIF not generated, REFTAG check ...[2024-11-21 03:23:09.810560] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:06:29.219 [2024-11-21 03:23:09.810588] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:06:29.219 passed 00:06:29.219 Test: verify: APPTAG correct, APPTAG check ...passed 00:06:29.219 Test: verify: APPTAG incorrect, APPTAG check ...[2024-11-21 03:23:09.810659] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=30, Expected=28, Actual=14 00:06:29.219 passed 00:06:29.219 Test: verify: APPTAG incorrect, no APPTAG check ...passed 00:06:29.219 Test: verify: REFTAG incorrect, REFTAG ignore ...passed 00:06:29.219 Test: verify: REFTAG_INIT correct, REFTAG check ...passed 00:06:29.219 Test: verify: REFTAG_INIT incorrect, REFTAG check ...[2024-11-21 03:23:09.810811] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=10 00:06:29.219 passed 00:06:29.219 Test: generate copy: DIF generated, GUARD check ...passed 00:06:29.219 Test: generate copy: DIF generated, APTTAG check ...passed 00:06:29.219 Test: generate copy: DIF generated, REFTAG check ...passed 00:06:29.219 Test: generate copy: DIF generated, no GUARD check flag set ...passed 00:06:29.219 Test: generate copy: DIF generated, no APPTAG check flag set ...passed 00:06:29.219 Test: generate copy: DIF generated, no REFTAG check flag set ...passed 00:06:29.219 Test: generate copy: iovecs-len validate ...[2024-11-21 03:23:09.811086] dif.c:1167:spdk_dif_generate_copy: *ERROR*: Size of bounce_iovs arrays are not valid or misaligned with block_size. 00:06:29.219 passed 00:06:29.219 Test: generate copy: buffer alignment validate ...passed 00:06:29.219 00:06:29.219 Run Summary: Type Total Ran Passed Failed Inactive 00:06:29.219 suites 1 1 n/a 0 0 00:06:29.219 tests 20 20 20 0 0 00:06:29.219 asserts 204 204 204 0 n/a 00:06:29.219 00:06:29.219 Elapsed time = 0.003 seconds 00:06:29.478 00:06:29.478 real 0m0.587s 00:06:29.478 user 0m0.890s 00:06:29.478 sys 0m0.185s 00:06:29.478 03:23:10 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:29.478 03:23:10 -- common/autotest_common.sh@10 -- # set +x 00:06:29.478 ************************************ 00:06:29.478 END TEST accel_dif_functional_tests 00:06:29.478 ************************************ 00:06:29.478 00:06:29.478 real 1m3.363s 00:06:29.478 user 1m11.119s 00:06:29.478 sys 0m7.295s 00:06:29.478 03:23:10 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:29.478 03:23:10 -- common/autotest_common.sh@10 -- # set +x 00:06:29.478 ************************************ 00:06:29.478 END TEST accel 00:06:29.478 ************************************ 00:06:29.478 03:23:10 -- spdk/autotest.sh@177 -- # run_test accel_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:06:29.478 03:23:10 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:29.478 03:23:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:29.478 03:23:10 -- common/autotest_common.sh@10 -- # set +x 00:06:29.478 ************************************ 00:06:29.478 START TEST accel_rpc 00:06:29.478 ************************************ 00:06:29.478 03:23:10 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:06:29.738 * Looking for test storage... 00:06:29.738 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:06:29.738 03:23:10 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:29.738 03:23:10 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:29.738 03:23:10 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:29.738 03:23:10 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:29.738 03:23:10 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:29.738 03:23:10 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:29.738 03:23:10 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:29.738 03:23:10 -- scripts/common.sh@335 -- # IFS=.-: 00:06:29.738 03:23:10 -- scripts/common.sh@335 -- # read -ra ver1 00:06:29.738 03:23:10 -- scripts/common.sh@336 -- # IFS=.-: 00:06:29.738 03:23:10 -- scripts/common.sh@336 -- # read -ra ver2 00:06:29.738 03:23:10 -- scripts/common.sh@337 -- # local 'op=<' 00:06:29.738 03:23:10 -- scripts/common.sh@339 -- # ver1_l=2 00:06:29.738 03:23:10 -- scripts/common.sh@340 -- # ver2_l=1 00:06:29.738 03:23:10 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:29.738 03:23:10 -- scripts/common.sh@343 -- # case "$op" in 00:06:29.738 03:23:10 -- scripts/common.sh@344 -- # : 1 00:06:29.738 03:23:10 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:29.738 03:23:10 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:29.738 03:23:10 -- scripts/common.sh@364 -- # decimal 1 00:06:29.738 03:23:10 -- scripts/common.sh@352 -- # local d=1 00:06:29.738 03:23:10 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:29.738 03:23:10 -- scripts/common.sh@354 -- # echo 1 00:06:29.738 03:23:10 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:29.738 03:23:10 -- scripts/common.sh@365 -- # decimal 2 00:06:29.738 03:23:10 -- scripts/common.sh@352 -- # local d=2 00:06:29.738 03:23:10 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:29.738 03:23:10 -- scripts/common.sh@354 -- # echo 2 00:06:29.738 03:23:10 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:29.738 03:23:10 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:29.738 03:23:10 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:29.738 03:23:10 -- scripts/common.sh@367 -- # return 0 00:06:29.738 03:23:10 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:29.738 03:23:10 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:29.738 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:29.738 --rc genhtml_branch_coverage=1 00:06:29.738 --rc genhtml_function_coverage=1 00:06:29.738 --rc genhtml_legend=1 00:06:29.738 --rc geninfo_all_blocks=1 00:06:29.738 --rc geninfo_unexecuted_blocks=1 00:06:29.738 00:06:29.738 ' 00:06:29.739 03:23:10 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:29.739 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:29.739 --rc genhtml_branch_coverage=1 00:06:29.739 --rc genhtml_function_coverage=1 00:06:29.739 --rc genhtml_legend=1 00:06:29.739 --rc geninfo_all_blocks=1 00:06:29.739 --rc geninfo_unexecuted_blocks=1 00:06:29.739 00:06:29.739 ' 00:06:29.739 03:23:10 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:29.739 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:29.739 --rc genhtml_branch_coverage=1 00:06:29.739 --rc genhtml_function_coverage=1 00:06:29.739 --rc genhtml_legend=1 00:06:29.739 --rc geninfo_all_blocks=1 00:06:29.739 --rc geninfo_unexecuted_blocks=1 00:06:29.739 00:06:29.739 ' 00:06:29.739 03:23:10 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:29.739 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:29.739 --rc genhtml_branch_coverage=1 00:06:29.739 --rc genhtml_function_coverage=1 00:06:29.739 --rc genhtml_legend=1 00:06:29.739 --rc geninfo_all_blocks=1 00:06:29.739 --rc geninfo_unexecuted_blocks=1 00:06:29.739 00:06:29.739 ' 00:06:29.739 03:23:10 -- accel/accel_rpc.sh@11 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:06:29.739 03:23:10 -- accel/accel_rpc.sh@14 -- # spdk_tgt_pid=2947050 00:06:29.739 03:23:10 -- accel/accel_rpc.sh@13 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --wait-for-rpc 00:06:29.739 03:23:10 -- accel/accel_rpc.sh@15 -- # waitforlisten 2947050 00:06:29.739 03:23:10 -- common/autotest_common.sh@829 -- # '[' -z 2947050 ']' 00:06:29.739 03:23:10 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:29.739 03:23:10 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:29.739 03:23:10 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:29.739 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:29.739 03:23:10 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:29.739 03:23:10 -- common/autotest_common.sh@10 -- # set +x 00:06:29.739 [2024-11-21 03:23:10.310404] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:29.739 [2024-11-21 03:23:10.310491] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2947050 ] 00:06:29.739 EAL: No free 2048 kB hugepages reported on node 1 00:06:29.999 [2024-11-21 03:23:10.387285] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:29.999 [2024-11-21 03:23:10.522792] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:29.999 [2024-11-21 03:23:10.523012] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:29.999 03:23:10 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:29.999 03:23:10 -- common/autotest_common.sh@862 -- # return 0 00:06:29.999 03:23:10 -- accel/accel_rpc.sh@45 -- # [[ y == y ]] 00:06:29.999 03:23:10 -- accel/accel_rpc.sh@45 -- # [[ 0 -gt 0 ]] 00:06:29.999 03:23:10 -- accel/accel_rpc.sh@49 -- # [[ y == y ]] 00:06:29.999 03:23:10 -- accel/accel_rpc.sh@49 -- # [[ 0 -gt 0 ]] 00:06:29.999 03:23:10 -- accel/accel_rpc.sh@53 -- # run_test accel_assign_opcode accel_assign_opcode_test_suite 00:06:29.999 03:23:10 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:29.999 03:23:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:29.999 03:23:10 -- common/autotest_common.sh@10 -- # set +x 00:06:29.999 ************************************ 00:06:29.999 START TEST accel_assign_opcode 00:06:29.999 ************************************ 00:06:29.999 03:23:10 -- common/autotest_common.sh@1114 -- # accel_assign_opcode_test_suite 00:06:29.999 03:23:10 -- accel/accel_rpc.sh@38 -- # rpc_cmd accel_assign_opc -o copy -m incorrect 00:06:29.999 03:23:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:29.999 03:23:10 -- common/autotest_common.sh@10 -- # set +x 00:06:29.999 [2024-11-21 03:23:10.643864] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module incorrect 00:06:30.257 03:23:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:30.257 03:23:10 -- accel/accel_rpc.sh@40 -- # rpc_cmd accel_assign_opc -o copy -m software 00:06:30.257 03:23:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:30.257 03:23:10 -- common/autotest_common.sh@10 -- # set +x 00:06:30.257 [2024-11-21 03:23:10.651875] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module software 00:06:30.257 03:23:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:30.257 03:23:10 -- accel/accel_rpc.sh@41 -- # rpc_cmd framework_start_init 00:06:30.257 03:23:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:30.257 03:23:10 -- common/autotest_common.sh@10 -- # set +x 00:06:30.257 03:23:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:30.257 03:23:10 -- accel/accel_rpc.sh@42 -- # rpc_cmd accel_get_opc_assignments 00:06:30.257 03:23:10 -- accel/accel_rpc.sh@42 -- # jq -r .copy 00:06:30.257 03:23:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:30.257 03:23:10 -- accel/accel_rpc.sh@42 -- # grep software 00:06:30.257 03:23:10 -- common/autotest_common.sh@10 -- # set +x 00:06:30.516 03:23:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:30.516 software 00:06:30.516 00:06:30.516 real 0m0.299s 00:06:30.516 user 0m0.043s 00:06:30.516 sys 0m0.005s 00:06:30.516 03:23:10 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:30.516 03:23:10 -- common/autotest_common.sh@10 -- # set +x 00:06:30.516 ************************************ 00:06:30.516 END TEST accel_assign_opcode 00:06:30.516 ************************************ 00:06:30.516 03:23:10 -- accel/accel_rpc.sh@55 -- # killprocess 2947050 00:06:30.516 03:23:10 -- common/autotest_common.sh@936 -- # '[' -z 2947050 ']' 00:06:30.516 03:23:10 -- common/autotest_common.sh@940 -- # kill -0 2947050 00:06:30.516 03:23:10 -- common/autotest_common.sh@941 -- # uname 00:06:30.516 03:23:10 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:30.516 03:23:10 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2947050 00:06:30.516 03:23:10 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:30.516 03:23:10 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:30.516 03:23:11 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2947050' 00:06:30.516 killing process with pid 2947050 00:06:30.516 03:23:11 -- common/autotest_common.sh@955 -- # kill 2947050 00:06:30.516 03:23:11 -- common/autotest_common.sh@960 -- # wait 2947050 00:06:31.085 00:06:31.085 real 0m1.345s 00:06:31.085 user 0m1.361s 00:06:31.085 sys 0m0.451s 00:06:31.085 03:23:11 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:31.085 03:23:11 -- common/autotest_common.sh@10 -- # set +x 00:06:31.085 ************************************ 00:06:31.085 END TEST accel_rpc 00:06:31.085 ************************************ 00:06:31.085 03:23:11 -- spdk/autotest.sh@178 -- # run_test app_cmdline /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:06:31.085 03:23:11 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:31.085 03:23:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:31.085 03:23:11 -- common/autotest_common.sh@10 -- # set +x 00:06:31.085 ************************************ 00:06:31.085 START TEST app_cmdline 00:06:31.085 ************************************ 00:06:31.085 03:23:11 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:06:31.085 * Looking for test storage... 00:06:31.085 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:06:31.085 03:23:11 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:31.085 03:23:11 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:31.085 03:23:11 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:31.085 03:23:11 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:31.085 03:23:11 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:31.085 03:23:11 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:31.085 03:23:11 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:31.085 03:23:11 -- scripts/common.sh@335 -- # IFS=.-: 00:06:31.085 03:23:11 -- scripts/common.sh@335 -- # read -ra ver1 00:06:31.085 03:23:11 -- scripts/common.sh@336 -- # IFS=.-: 00:06:31.085 03:23:11 -- scripts/common.sh@336 -- # read -ra ver2 00:06:31.085 03:23:11 -- scripts/common.sh@337 -- # local 'op=<' 00:06:31.085 03:23:11 -- scripts/common.sh@339 -- # ver1_l=2 00:06:31.085 03:23:11 -- scripts/common.sh@340 -- # ver2_l=1 00:06:31.085 03:23:11 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:31.085 03:23:11 -- scripts/common.sh@343 -- # case "$op" in 00:06:31.085 03:23:11 -- scripts/common.sh@344 -- # : 1 00:06:31.085 03:23:11 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:31.085 03:23:11 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:31.085 03:23:11 -- scripts/common.sh@364 -- # decimal 1 00:06:31.085 03:23:11 -- scripts/common.sh@352 -- # local d=1 00:06:31.085 03:23:11 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:31.085 03:23:11 -- scripts/common.sh@354 -- # echo 1 00:06:31.085 03:23:11 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:31.085 03:23:11 -- scripts/common.sh@365 -- # decimal 2 00:06:31.085 03:23:11 -- scripts/common.sh@352 -- # local d=2 00:06:31.085 03:23:11 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:31.085 03:23:11 -- scripts/common.sh@354 -- # echo 2 00:06:31.085 03:23:11 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:31.085 03:23:11 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:31.085 03:23:11 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:31.085 03:23:11 -- scripts/common.sh@367 -- # return 0 00:06:31.085 03:23:11 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:31.085 03:23:11 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:31.085 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:31.085 --rc genhtml_branch_coverage=1 00:06:31.085 --rc genhtml_function_coverage=1 00:06:31.085 --rc genhtml_legend=1 00:06:31.085 --rc geninfo_all_blocks=1 00:06:31.085 --rc geninfo_unexecuted_blocks=1 00:06:31.085 00:06:31.085 ' 00:06:31.085 03:23:11 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:31.085 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:31.085 --rc genhtml_branch_coverage=1 00:06:31.085 --rc genhtml_function_coverage=1 00:06:31.085 --rc genhtml_legend=1 00:06:31.085 --rc geninfo_all_blocks=1 00:06:31.085 --rc geninfo_unexecuted_blocks=1 00:06:31.085 00:06:31.085 ' 00:06:31.085 03:23:11 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:31.085 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:31.085 --rc genhtml_branch_coverage=1 00:06:31.085 --rc genhtml_function_coverage=1 00:06:31.085 --rc genhtml_legend=1 00:06:31.085 --rc geninfo_all_blocks=1 00:06:31.085 --rc geninfo_unexecuted_blocks=1 00:06:31.085 00:06:31.085 ' 00:06:31.085 03:23:11 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:31.085 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:31.085 --rc genhtml_branch_coverage=1 00:06:31.085 --rc genhtml_function_coverage=1 00:06:31.085 --rc genhtml_legend=1 00:06:31.085 --rc geninfo_all_blocks=1 00:06:31.085 --rc geninfo_unexecuted_blocks=1 00:06:31.085 00:06:31.085 ' 00:06:31.085 03:23:11 -- app/cmdline.sh@14 -- # trap 'killprocess $spdk_tgt_pid' EXIT 00:06:31.085 03:23:11 -- app/cmdline.sh@17 -- # spdk_tgt_pid=2947267 00:06:31.085 03:23:11 -- app/cmdline.sh@16 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --rpcs-allowed spdk_get_version,rpc_get_methods 00:06:31.085 03:23:11 -- app/cmdline.sh@18 -- # waitforlisten 2947267 00:06:31.085 03:23:11 -- common/autotest_common.sh@829 -- # '[' -z 2947267 ']' 00:06:31.085 03:23:11 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:31.085 03:23:11 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:31.086 03:23:11 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:31.086 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:31.086 03:23:11 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:31.086 03:23:11 -- common/autotest_common.sh@10 -- # set +x 00:06:31.086 [2024-11-21 03:23:11.697351] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:31.086 [2024-11-21 03:23:11.697469] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2947267 ] 00:06:31.086 EAL: No free 2048 kB hugepages reported on node 1 00:06:31.344 [2024-11-21 03:23:11.754606] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:31.344 [2024-11-21 03:23:11.858646] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:31.344 [2024-11-21 03:23:11.858821] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:32.283 03:23:12 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:32.283 03:23:12 -- common/autotest_common.sh@862 -- # return 0 00:06:32.283 03:23:12 -- app/cmdline.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py spdk_get_version 00:06:32.541 { 00:06:32.541 "version": "SPDK v24.01.1-pre git sha1 c13c99a5e", 00:06:32.541 "fields": { 00:06:32.541 "major": 24, 00:06:32.541 "minor": 1, 00:06:32.541 "patch": 1, 00:06:32.541 "suffix": "-pre", 00:06:32.541 "commit": "c13c99a5e" 00:06:32.541 } 00:06:32.541 } 00:06:32.541 03:23:12 -- app/cmdline.sh@22 -- # expected_methods=() 00:06:32.541 03:23:12 -- app/cmdline.sh@23 -- # expected_methods+=("rpc_get_methods") 00:06:32.541 03:23:12 -- app/cmdline.sh@24 -- # expected_methods+=("spdk_get_version") 00:06:32.541 03:23:12 -- app/cmdline.sh@26 -- # methods=($(rpc_cmd rpc_get_methods | jq -r ".[]" | sort)) 00:06:32.541 03:23:12 -- app/cmdline.sh@26 -- # rpc_cmd rpc_get_methods 00:06:32.541 03:23:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:32.541 03:23:12 -- common/autotest_common.sh@10 -- # set +x 00:06:32.541 03:23:12 -- app/cmdline.sh@26 -- # jq -r '.[]' 00:06:32.541 03:23:12 -- app/cmdline.sh@26 -- # sort 00:06:32.541 03:23:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:32.541 03:23:12 -- app/cmdline.sh@27 -- # (( 2 == 2 )) 00:06:32.541 03:23:12 -- app/cmdline.sh@28 -- # [[ rpc_get_methods spdk_get_version == \r\p\c\_\g\e\t\_\m\e\t\h\o\d\s\ \s\p\d\k\_\g\e\t\_\v\e\r\s\i\o\n ]] 00:06:32.541 03:23:12 -- app/cmdline.sh@30 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:06:32.541 03:23:12 -- common/autotest_common.sh@650 -- # local es=0 00:06:32.541 03:23:12 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:06:32.541 03:23:12 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:32.541 03:23:12 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:32.541 03:23:12 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:32.541 03:23:12 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:32.541 03:23:13 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:32.541 03:23:12 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:32.542 03:23:13 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:32.542 03:23:13 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:06:32.542 03:23:13 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:06:32.801 request: 00:06:32.801 { 00:06:32.801 "method": "env_dpdk_get_mem_stats", 00:06:32.801 "req_id": 1 00:06:32.801 } 00:06:32.801 Got JSON-RPC error response 00:06:32.801 response: 00:06:32.801 { 00:06:32.801 "code": -32601, 00:06:32.801 "message": "Method not found" 00:06:32.801 } 00:06:32.801 03:23:13 -- common/autotest_common.sh@653 -- # es=1 00:06:32.801 03:23:13 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:32.801 03:23:13 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:32.801 03:23:13 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:32.801 03:23:13 -- app/cmdline.sh@1 -- # killprocess 2947267 00:06:32.801 03:23:13 -- common/autotest_common.sh@936 -- # '[' -z 2947267 ']' 00:06:32.801 03:23:13 -- common/autotest_common.sh@940 -- # kill -0 2947267 00:06:32.801 03:23:13 -- common/autotest_common.sh@941 -- # uname 00:06:32.801 03:23:13 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:32.801 03:23:13 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2947267 00:06:32.801 03:23:13 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:32.801 03:23:13 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:32.801 03:23:13 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2947267' 00:06:32.801 killing process with pid 2947267 00:06:32.801 03:23:13 -- common/autotest_common.sh@955 -- # kill 2947267 00:06:32.801 03:23:13 -- common/autotest_common.sh@960 -- # wait 2947267 00:06:33.370 00:06:33.370 real 0m2.294s 00:06:33.370 user 0m2.896s 00:06:33.370 sys 0m0.527s 00:06:33.370 03:23:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:33.370 03:23:13 -- common/autotest_common.sh@10 -- # set +x 00:06:33.370 ************************************ 00:06:33.370 END TEST app_cmdline 00:06:33.370 ************************************ 00:06:33.370 03:23:13 -- spdk/autotest.sh@179 -- # run_test version /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:06:33.370 03:23:13 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:33.370 03:23:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:33.370 03:23:13 -- common/autotest_common.sh@10 -- # set +x 00:06:33.370 ************************************ 00:06:33.370 START TEST version 00:06:33.370 ************************************ 00:06:33.370 03:23:13 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:06:33.370 * Looking for test storage... 00:06:33.370 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:06:33.370 03:23:13 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:33.370 03:23:13 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:33.370 03:23:13 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:33.370 03:23:13 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:33.370 03:23:13 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:33.370 03:23:13 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:33.370 03:23:13 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:33.370 03:23:13 -- scripts/common.sh@335 -- # IFS=.-: 00:06:33.370 03:23:13 -- scripts/common.sh@335 -- # read -ra ver1 00:06:33.370 03:23:13 -- scripts/common.sh@336 -- # IFS=.-: 00:06:33.370 03:23:13 -- scripts/common.sh@336 -- # read -ra ver2 00:06:33.370 03:23:13 -- scripts/common.sh@337 -- # local 'op=<' 00:06:33.370 03:23:13 -- scripts/common.sh@339 -- # ver1_l=2 00:06:33.370 03:23:13 -- scripts/common.sh@340 -- # ver2_l=1 00:06:33.370 03:23:13 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:33.370 03:23:13 -- scripts/common.sh@343 -- # case "$op" in 00:06:33.370 03:23:13 -- scripts/common.sh@344 -- # : 1 00:06:33.370 03:23:13 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:33.370 03:23:13 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:33.370 03:23:13 -- scripts/common.sh@364 -- # decimal 1 00:06:33.370 03:23:13 -- scripts/common.sh@352 -- # local d=1 00:06:33.370 03:23:13 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:33.370 03:23:13 -- scripts/common.sh@354 -- # echo 1 00:06:33.370 03:23:13 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:33.370 03:23:13 -- scripts/common.sh@365 -- # decimal 2 00:06:33.370 03:23:13 -- scripts/common.sh@352 -- # local d=2 00:06:33.370 03:23:13 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:33.370 03:23:13 -- scripts/common.sh@354 -- # echo 2 00:06:33.370 03:23:13 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:33.370 03:23:13 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:33.370 03:23:13 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:33.370 03:23:13 -- scripts/common.sh@367 -- # return 0 00:06:33.370 03:23:13 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:33.370 03:23:13 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:33.370 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:33.371 --rc genhtml_branch_coverage=1 00:06:33.371 --rc genhtml_function_coverage=1 00:06:33.371 --rc genhtml_legend=1 00:06:33.371 --rc geninfo_all_blocks=1 00:06:33.371 --rc geninfo_unexecuted_blocks=1 00:06:33.371 00:06:33.371 ' 00:06:33.371 03:23:13 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:33.371 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:33.371 --rc genhtml_branch_coverage=1 00:06:33.371 --rc genhtml_function_coverage=1 00:06:33.371 --rc genhtml_legend=1 00:06:33.371 --rc geninfo_all_blocks=1 00:06:33.371 --rc geninfo_unexecuted_blocks=1 00:06:33.371 00:06:33.371 ' 00:06:33.371 03:23:13 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:33.371 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:33.371 --rc genhtml_branch_coverage=1 00:06:33.371 --rc genhtml_function_coverage=1 00:06:33.371 --rc genhtml_legend=1 00:06:33.371 --rc geninfo_all_blocks=1 00:06:33.371 --rc geninfo_unexecuted_blocks=1 00:06:33.371 00:06:33.371 ' 00:06:33.371 03:23:13 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:33.371 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:33.371 --rc genhtml_branch_coverage=1 00:06:33.371 --rc genhtml_function_coverage=1 00:06:33.371 --rc genhtml_legend=1 00:06:33.371 --rc geninfo_all_blocks=1 00:06:33.371 --rc geninfo_unexecuted_blocks=1 00:06:33.371 00:06:33.371 ' 00:06:33.371 03:23:13 -- app/version.sh@17 -- # get_header_version major 00:06:33.371 03:23:13 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MAJOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:33.371 03:23:13 -- app/version.sh@14 -- # cut -f2 00:06:33.371 03:23:13 -- app/version.sh@14 -- # tr -d '"' 00:06:33.371 03:23:13 -- app/version.sh@17 -- # major=24 00:06:33.371 03:23:13 -- app/version.sh@18 -- # get_header_version minor 00:06:33.371 03:23:13 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MINOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:33.371 03:23:13 -- app/version.sh@14 -- # cut -f2 00:06:33.371 03:23:13 -- app/version.sh@14 -- # tr -d '"' 00:06:33.371 03:23:13 -- app/version.sh@18 -- # minor=1 00:06:33.371 03:23:13 -- app/version.sh@19 -- # get_header_version patch 00:06:33.371 03:23:13 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_PATCH[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:33.371 03:23:13 -- app/version.sh@14 -- # cut -f2 00:06:33.371 03:23:13 -- app/version.sh@14 -- # tr -d '"' 00:06:33.371 03:23:13 -- app/version.sh@19 -- # patch=1 00:06:33.371 03:23:13 -- app/version.sh@20 -- # get_header_version suffix 00:06:33.371 03:23:13 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_SUFFIX[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:33.371 03:23:13 -- app/version.sh@14 -- # cut -f2 00:06:33.371 03:23:13 -- app/version.sh@14 -- # tr -d '"' 00:06:33.371 03:23:13 -- app/version.sh@20 -- # suffix=-pre 00:06:33.371 03:23:13 -- app/version.sh@22 -- # version=24.1 00:06:33.371 03:23:13 -- app/version.sh@25 -- # (( patch != 0 )) 00:06:33.371 03:23:13 -- app/version.sh@25 -- # version=24.1.1 00:06:33.371 03:23:13 -- app/version.sh@28 -- # version=24.1.1rc0 00:06:33.371 03:23:13 -- app/version.sh@30 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:06:33.371 03:23:13 -- app/version.sh@30 -- # python3 -c 'import spdk; print(spdk.__version__)' 00:06:33.630 03:23:14 -- app/version.sh@30 -- # py_version=24.1.1rc0 00:06:33.630 03:23:14 -- app/version.sh@31 -- # [[ 24.1.1rc0 == \2\4\.\1\.\1\r\c\0 ]] 00:06:33.630 00:06:33.630 real 0m0.210s 00:06:33.630 user 0m0.145s 00:06:33.630 sys 0m0.089s 00:06:33.630 03:23:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:33.630 03:23:14 -- common/autotest_common.sh@10 -- # set +x 00:06:33.630 ************************************ 00:06:33.630 END TEST version 00:06:33.630 ************************************ 00:06:33.630 03:23:14 -- spdk/autotest.sh@181 -- # '[' 0 -eq 1 ']' 00:06:33.630 03:23:14 -- spdk/autotest.sh@191 -- # uname -s 00:06:33.630 03:23:14 -- spdk/autotest.sh@191 -- # [[ Linux == Linux ]] 00:06:33.630 03:23:14 -- spdk/autotest.sh@192 -- # [[ 0 -eq 1 ]] 00:06:33.630 03:23:14 -- spdk/autotest.sh@192 -- # [[ 0 -eq 1 ]] 00:06:33.630 03:23:14 -- spdk/autotest.sh@204 -- # '[' 0 -eq 1 ']' 00:06:33.630 03:23:14 -- spdk/autotest.sh@251 -- # '[' 0 -eq 1 ']' 00:06:33.630 03:23:14 -- spdk/autotest.sh@255 -- # timing_exit lib 00:06:33.630 03:23:14 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:33.630 03:23:14 -- common/autotest_common.sh@10 -- # set +x 00:06:33.630 03:23:14 -- spdk/autotest.sh@257 -- # '[' 0 -eq 1 ']' 00:06:33.630 03:23:14 -- spdk/autotest.sh@265 -- # '[' 0 -eq 1 ']' 00:06:33.630 03:23:14 -- spdk/autotest.sh@274 -- # '[' 1 -eq 1 ']' 00:06:33.630 03:23:14 -- spdk/autotest.sh@275 -- # export NET_TYPE 00:06:33.630 03:23:14 -- spdk/autotest.sh@278 -- # '[' tcp = rdma ']' 00:06:33.630 03:23:14 -- spdk/autotest.sh@281 -- # '[' tcp = tcp ']' 00:06:33.630 03:23:14 -- spdk/autotest.sh@282 -- # run_test nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:06:33.630 03:23:14 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:33.630 03:23:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:33.630 03:23:14 -- common/autotest_common.sh@10 -- # set +x 00:06:33.630 ************************************ 00:06:33.630 START TEST nvmf_tcp 00:06:33.630 ************************************ 00:06:33.630 03:23:14 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:06:33.630 * Looking for test storage... 00:06:33.630 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf 00:06:33.630 03:23:14 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:33.630 03:23:14 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:33.630 03:23:14 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:33.630 03:23:14 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:33.630 03:23:14 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:33.630 03:23:14 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:33.631 03:23:14 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:33.631 03:23:14 -- scripts/common.sh@335 -- # IFS=.-: 00:06:33.631 03:23:14 -- scripts/common.sh@335 -- # read -ra ver1 00:06:33.631 03:23:14 -- scripts/common.sh@336 -- # IFS=.-: 00:06:33.631 03:23:14 -- scripts/common.sh@336 -- # read -ra ver2 00:06:33.631 03:23:14 -- scripts/common.sh@337 -- # local 'op=<' 00:06:33.631 03:23:14 -- scripts/common.sh@339 -- # ver1_l=2 00:06:33.631 03:23:14 -- scripts/common.sh@340 -- # ver2_l=1 00:06:33.631 03:23:14 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:33.631 03:23:14 -- scripts/common.sh@343 -- # case "$op" in 00:06:33.631 03:23:14 -- scripts/common.sh@344 -- # : 1 00:06:33.631 03:23:14 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:33.631 03:23:14 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:33.631 03:23:14 -- scripts/common.sh@364 -- # decimal 1 00:06:33.631 03:23:14 -- scripts/common.sh@352 -- # local d=1 00:06:33.631 03:23:14 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:33.631 03:23:14 -- scripts/common.sh@354 -- # echo 1 00:06:33.631 03:23:14 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:33.631 03:23:14 -- scripts/common.sh@365 -- # decimal 2 00:06:33.631 03:23:14 -- scripts/common.sh@352 -- # local d=2 00:06:33.631 03:23:14 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:33.631 03:23:14 -- scripts/common.sh@354 -- # echo 2 00:06:33.631 03:23:14 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:33.631 03:23:14 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:33.631 03:23:14 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:33.631 03:23:14 -- scripts/common.sh@367 -- # return 0 00:06:33.631 03:23:14 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:33.631 03:23:14 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:33.631 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:33.631 --rc genhtml_branch_coverage=1 00:06:33.631 --rc genhtml_function_coverage=1 00:06:33.631 --rc genhtml_legend=1 00:06:33.631 --rc geninfo_all_blocks=1 00:06:33.631 --rc geninfo_unexecuted_blocks=1 00:06:33.631 00:06:33.631 ' 00:06:33.631 03:23:14 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:33.631 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:33.631 --rc genhtml_branch_coverage=1 00:06:33.631 --rc genhtml_function_coverage=1 00:06:33.631 --rc genhtml_legend=1 00:06:33.631 --rc geninfo_all_blocks=1 00:06:33.631 --rc geninfo_unexecuted_blocks=1 00:06:33.631 00:06:33.631 ' 00:06:33.631 03:23:14 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:33.631 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:33.631 --rc genhtml_branch_coverage=1 00:06:33.631 --rc genhtml_function_coverage=1 00:06:33.631 --rc genhtml_legend=1 00:06:33.631 --rc geninfo_all_blocks=1 00:06:33.631 --rc geninfo_unexecuted_blocks=1 00:06:33.631 00:06:33.631 ' 00:06:33.631 03:23:14 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:33.631 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:33.631 --rc genhtml_branch_coverage=1 00:06:33.631 --rc genhtml_function_coverage=1 00:06:33.631 --rc genhtml_legend=1 00:06:33.631 --rc geninfo_all_blocks=1 00:06:33.631 --rc geninfo_unexecuted_blocks=1 00:06:33.631 00:06:33.631 ' 00:06:33.631 03:23:14 -- nvmf/nvmf.sh@10 -- # uname -s 00:06:33.631 03:23:14 -- nvmf/nvmf.sh@10 -- # '[' '!' Linux = Linux ']' 00:06:33.631 03:23:14 -- nvmf/nvmf.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:06:33.631 03:23:14 -- nvmf/common.sh@7 -- # uname -s 00:06:33.631 03:23:14 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:33.631 03:23:14 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:33.631 03:23:14 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:33.631 03:23:14 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:33.631 03:23:14 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:33.631 03:23:14 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:33.631 03:23:14 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:33.631 03:23:14 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:33.631 03:23:14 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:33.631 03:23:14 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:33.631 03:23:14 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:06:33.631 03:23:14 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:06:33.631 03:23:14 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:33.631 03:23:14 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:33.631 03:23:14 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:06:33.631 03:23:14 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:33.631 03:23:14 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:33.631 03:23:14 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:33.631 03:23:14 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:33.631 03:23:14 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:33.631 03:23:14 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:33.631 03:23:14 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:33.631 03:23:14 -- paths/export.sh@5 -- # export PATH 00:06:33.631 03:23:14 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:33.631 03:23:14 -- nvmf/common.sh@46 -- # : 0 00:06:33.631 03:23:14 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:06:33.631 03:23:14 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:06:33.631 03:23:14 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:06:33.631 03:23:14 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:33.631 03:23:14 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:33.631 03:23:14 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:06:33.631 03:23:14 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:06:33.631 03:23:14 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:06:33.631 03:23:14 -- nvmf/nvmf.sh@16 -- # trap 'exit 1' SIGINT SIGTERM EXIT 00:06:33.631 03:23:14 -- nvmf/nvmf.sh@18 -- # TEST_ARGS=("$@") 00:06:33.631 03:23:14 -- nvmf/nvmf.sh@20 -- # timing_enter target 00:06:33.631 03:23:14 -- common/autotest_common.sh@722 -- # xtrace_disable 00:06:33.631 03:23:14 -- common/autotest_common.sh@10 -- # set +x 00:06:33.631 03:23:14 -- nvmf/nvmf.sh@22 -- # [[ 0 -eq 0 ]] 00:06:33.631 03:23:14 -- nvmf/nvmf.sh@23 -- # run_test nvmf_example /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:06:33.631 03:23:14 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:33.631 03:23:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:33.631 03:23:14 -- common/autotest_common.sh@10 -- # set +x 00:06:33.631 ************************************ 00:06:33.631 START TEST nvmf_example 00:06:33.631 ************************************ 00:06:33.631 03:23:14 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:06:33.892 * Looking for test storage... 00:06:33.892 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:33.892 03:23:14 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:33.892 03:23:14 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:33.892 03:23:14 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:33.892 03:23:14 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:33.892 03:23:14 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:33.892 03:23:14 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:33.892 03:23:14 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:33.892 03:23:14 -- scripts/common.sh@335 -- # IFS=.-: 00:06:33.892 03:23:14 -- scripts/common.sh@335 -- # read -ra ver1 00:06:33.892 03:23:14 -- scripts/common.sh@336 -- # IFS=.-: 00:06:33.892 03:23:14 -- scripts/common.sh@336 -- # read -ra ver2 00:06:33.892 03:23:14 -- scripts/common.sh@337 -- # local 'op=<' 00:06:33.892 03:23:14 -- scripts/common.sh@339 -- # ver1_l=2 00:06:33.892 03:23:14 -- scripts/common.sh@340 -- # ver2_l=1 00:06:33.893 03:23:14 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:33.893 03:23:14 -- scripts/common.sh@343 -- # case "$op" in 00:06:33.893 03:23:14 -- scripts/common.sh@344 -- # : 1 00:06:33.893 03:23:14 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:33.893 03:23:14 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:33.893 03:23:14 -- scripts/common.sh@364 -- # decimal 1 00:06:33.893 03:23:14 -- scripts/common.sh@352 -- # local d=1 00:06:33.893 03:23:14 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:33.893 03:23:14 -- scripts/common.sh@354 -- # echo 1 00:06:33.893 03:23:14 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:33.893 03:23:14 -- scripts/common.sh@365 -- # decimal 2 00:06:33.893 03:23:14 -- scripts/common.sh@352 -- # local d=2 00:06:33.893 03:23:14 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:33.893 03:23:14 -- scripts/common.sh@354 -- # echo 2 00:06:33.893 03:23:14 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:33.893 03:23:14 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:33.893 03:23:14 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:33.893 03:23:14 -- scripts/common.sh@367 -- # return 0 00:06:33.893 03:23:14 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:33.893 03:23:14 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:33.893 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:33.893 --rc genhtml_branch_coverage=1 00:06:33.893 --rc genhtml_function_coverage=1 00:06:33.893 --rc genhtml_legend=1 00:06:33.893 --rc geninfo_all_blocks=1 00:06:33.893 --rc geninfo_unexecuted_blocks=1 00:06:33.893 00:06:33.893 ' 00:06:33.893 03:23:14 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:33.893 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:33.893 --rc genhtml_branch_coverage=1 00:06:33.893 --rc genhtml_function_coverage=1 00:06:33.893 --rc genhtml_legend=1 00:06:33.893 --rc geninfo_all_blocks=1 00:06:33.893 --rc geninfo_unexecuted_blocks=1 00:06:33.893 00:06:33.893 ' 00:06:33.893 03:23:14 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:33.893 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:33.893 --rc genhtml_branch_coverage=1 00:06:33.893 --rc genhtml_function_coverage=1 00:06:33.893 --rc genhtml_legend=1 00:06:33.893 --rc geninfo_all_blocks=1 00:06:33.893 --rc geninfo_unexecuted_blocks=1 00:06:33.893 00:06:33.893 ' 00:06:33.893 03:23:14 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:33.893 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:33.893 --rc genhtml_branch_coverage=1 00:06:33.893 --rc genhtml_function_coverage=1 00:06:33.893 --rc genhtml_legend=1 00:06:33.893 --rc geninfo_all_blocks=1 00:06:33.893 --rc geninfo_unexecuted_blocks=1 00:06:33.893 00:06:33.893 ' 00:06:33.893 03:23:14 -- target/nvmf_example.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:06:33.893 03:23:14 -- nvmf/common.sh@7 -- # uname -s 00:06:33.893 03:23:14 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:33.893 03:23:14 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:33.893 03:23:14 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:33.893 03:23:14 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:33.893 03:23:14 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:33.893 03:23:14 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:33.893 03:23:14 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:33.893 03:23:14 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:33.893 03:23:14 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:33.893 03:23:14 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:33.893 03:23:14 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:06:33.893 03:23:14 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:06:33.893 03:23:14 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:33.893 03:23:14 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:33.893 03:23:14 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:06:33.893 03:23:14 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:33.893 03:23:14 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:33.893 03:23:14 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:33.893 03:23:14 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:33.893 03:23:14 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:33.893 03:23:14 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:33.893 03:23:14 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:33.893 03:23:14 -- paths/export.sh@5 -- # export PATH 00:06:33.893 03:23:14 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:33.893 03:23:14 -- nvmf/common.sh@46 -- # : 0 00:06:33.893 03:23:14 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:06:33.893 03:23:14 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:06:33.893 03:23:14 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:06:33.893 03:23:14 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:33.893 03:23:14 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:33.893 03:23:14 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:06:33.893 03:23:14 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:06:33.893 03:23:14 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:06:33.893 03:23:14 -- target/nvmf_example.sh@11 -- # NVMF_EXAMPLE=("$SPDK_EXAMPLE_DIR/nvmf") 00:06:33.893 03:23:14 -- target/nvmf_example.sh@13 -- # MALLOC_BDEV_SIZE=64 00:06:33.893 03:23:14 -- target/nvmf_example.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:06:33.893 03:23:14 -- target/nvmf_example.sh@24 -- # build_nvmf_example_args 00:06:33.893 03:23:14 -- target/nvmf_example.sh@17 -- # '[' 0 -eq 1 ']' 00:06:33.893 03:23:14 -- target/nvmf_example.sh@20 -- # NVMF_EXAMPLE+=(-i "$NVMF_APP_SHM_ID" -g 10000) 00:06:33.893 03:23:14 -- target/nvmf_example.sh@21 -- # NVMF_EXAMPLE+=("${NO_HUGE[@]}") 00:06:33.893 03:23:14 -- target/nvmf_example.sh@40 -- # timing_enter nvmf_example_test 00:06:33.893 03:23:14 -- common/autotest_common.sh@722 -- # xtrace_disable 00:06:33.893 03:23:14 -- common/autotest_common.sh@10 -- # set +x 00:06:33.893 03:23:14 -- target/nvmf_example.sh@41 -- # nvmftestinit 00:06:33.893 03:23:14 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:06:33.893 03:23:14 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:06:33.893 03:23:14 -- nvmf/common.sh@436 -- # prepare_net_devs 00:06:33.893 03:23:14 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:06:33.893 03:23:14 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:06:33.893 03:23:14 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:33.893 03:23:14 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:33.893 03:23:14 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:33.893 03:23:14 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:06:33.893 03:23:14 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:06:33.893 03:23:14 -- nvmf/common.sh@284 -- # xtrace_disable 00:06:33.893 03:23:14 -- common/autotest_common.sh@10 -- # set +x 00:06:35.804 03:23:16 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:06:35.804 03:23:16 -- nvmf/common.sh@290 -- # pci_devs=() 00:06:35.804 03:23:16 -- nvmf/common.sh@290 -- # local -a pci_devs 00:06:35.804 03:23:16 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:06:35.804 03:23:16 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:06:35.804 03:23:16 -- nvmf/common.sh@292 -- # pci_drivers=() 00:06:35.804 03:23:16 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:06:35.804 03:23:16 -- nvmf/common.sh@294 -- # net_devs=() 00:06:35.804 03:23:16 -- nvmf/common.sh@294 -- # local -ga net_devs 00:06:35.804 03:23:16 -- nvmf/common.sh@295 -- # e810=() 00:06:35.804 03:23:16 -- nvmf/common.sh@295 -- # local -ga e810 00:06:35.804 03:23:16 -- nvmf/common.sh@296 -- # x722=() 00:06:35.804 03:23:16 -- nvmf/common.sh@296 -- # local -ga x722 00:06:35.804 03:23:16 -- nvmf/common.sh@297 -- # mlx=() 00:06:35.804 03:23:16 -- nvmf/common.sh@297 -- # local -ga mlx 00:06:35.804 03:23:16 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:06:35.804 03:23:16 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:06:35.804 03:23:16 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:06:35.804 03:23:16 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:06:35.804 03:23:16 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:06:35.804 03:23:16 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:06:35.804 03:23:16 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:06:35.804 03:23:16 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:06:35.804 03:23:16 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:06:35.804 03:23:16 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:06:35.804 03:23:16 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:06:35.804 03:23:16 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:06:35.804 03:23:16 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:06:35.804 03:23:16 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:06:35.804 03:23:16 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:06:35.804 03:23:16 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:06:35.804 03:23:16 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:06:35.804 03:23:16 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:35.804 03:23:16 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:06:35.804 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:06:35.804 03:23:16 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:35.804 03:23:16 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:35.804 03:23:16 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:35.804 03:23:16 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:35.804 03:23:16 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:35.804 03:23:16 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:35.804 03:23:16 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:06:35.804 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:06:35.804 03:23:16 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:35.804 03:23:16 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:35.804 03:23:16 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:35.804 03:23:16 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:35.804 03:23:16 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:35.804 03:23:16 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:06:35.804 03:23:16 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:06:35.804 03:23:16 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:06:35.804 03:23:16 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:35.805 03:23:16 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:35.805 03:23:16 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:35.805 03:23:16 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:35.805 03:23:16 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:06:35.805 Found net devices under 0000:0a:00.0: cvl_0_0 00:06:35.805 03:23:16 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:35.805 03:23:16 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:35.805 03:23:16 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:35.805 03:23:16 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:35.805 03:23:16 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:35.805 03:23:16 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:06:35.805 Found net devices under 0000:0a:00.1: cvl_0_1 00:06:35.805 03:23:16 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:35.805 03:23:16 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:06:35.805 03:23:16 -- nvmf/common.sh@402 -- # is_hw=yes 00:06:35.805 03:23:16 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:06:35.805 03:23:16 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:06:35.805 03:23:16 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:06:35.805 03:23:16 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:06:35.805 03:23:16 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:06:35.805 03:23:16 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:06:35.805 03:23:16 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:06:35.805 03:23:16 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:06:35.805 03:23:16 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:06:35.805 03:23:16 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:06:35.805 03:23:16 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:06:35.805 03:23:16 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:06:35.805 03:23:16 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:06:35.805 03:23:16 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:06:35.805 03:23:16 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:06:35.805 03:23:16 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:06:36.063 03:23:16 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:06:36.063 03:23:16 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:06:36.063 03:23:16 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:06:36.063 03:23:16 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:06:36.063 03:23:16 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:06:36.063 03:23:16 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:06:36.063 03:23:16 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:06:36.063 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:06:36.063 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.352 ms 00:06:36.063 00:06:36.063 --- 10.0.0.2 ping statistics --- 00:06:36.063 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:36.063 rtt min/avg/max/mdev = 0.352/0.352/0.352/0.000 ms 00:06:36.063 03:23:16 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:06:36.063 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:06:36.063 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.162 ms 00:06:36.063 00:06:36.063 --- 10.0.0.1 ping statistics --- 00:06:36.063 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:36.063 rtt min/avg/max/mdev = 0.162/0.162/0.162/0.000 ms 00:06:36.063 03:23:16 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:06:36.063 03:23:16 -- nvmf/common.sh@410 -- # return 0 00:06:36.063 03:23:16 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:06:36.063 03:23:16 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:06:36.063 03:23:16 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:06:36.063 03:23:16 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:06:36.063 03:23:16 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:06:36.063 03:23:16 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:06:36.063 03:23:16 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:06:36.063 03:23:16 -- target/nvmf_example.sh@42 -- # nvmfexamplestart '-m 0xF' 00:06:36.063 03:23:16 -- target/nvmf_example.sh@27 -- # timing_enter start_nvmf_example 00:06:36.063 03:23:16 -- common/autotest_common.sh@722 -- # xtrace_disable 00:06:36.063 03:23:16 -- common/autotest_common.sh@10 -- # set +x 00:06:36.063 03:23:16 -- target/nvmf_example.sh@29 -- # '[' tcp == tcp ']' 00:06:36.063 03:23:16 -- target/nvmf_example.sh@30 -- # NVMF_EXAMPLE=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_EXAMPLE[@]}") 00:06:36.063 03:23:16 -- target/nvmf_example.sh@34 -- # nvmfpid=2949328 00:06:36.063 03:23:16 -- target/nvmf_example.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/nvmf -i 0 -g 10000 -m 0xF 00:06:36.063 03:23:16 -- target/nvmf_example.sh@35 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:06:36.063 03:23:16 -- target/nvmf_example.sh@36 -- # waitforlisten 2949328 00:06:36.063 03:23:16 -- common/autotest_common.sh@829 -- # '[' -z 2949328 ']' 00:06:36.063 03:23:16 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:36.063 03:23:16 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:36.063 03:23:16 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:36.063 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:36.063 03:23:16 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:36.063 03:23:16 -- common/autotest_common.sh@10 -- # set +x 00:06:36.063 EAL: No free 2048 kB hugepages reported on node 1 00:06:36.321 03:23:16 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:36.321 03:23:16 -- common/autotest_common.sh@862 -- # return 0 00:06:36.321 03:23:16 -- target/nvmf_example.sh@37 -- # timing_exit start_nvmf_example 00:06:36.321 03:23:16 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:36.321 03:23:16 -- common/autotest_common.sh@10 -- # set +x 00:06:36.321 03:23:16 -- target/nvmf_example.sh@45 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:06:36.321 03:23:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:36.321 03:23:16 -- common/autotest_common.sh@10 -- # set +x 00:06:36.321 03:23:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:36.321 03:23:16 -- target/nvmf_example.sh@47 -- # rpc_cmd bdev_malloc_create 64 512 00:06:36.321 03:23:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:36.321 03:23:16 -- common/autotest_common.sh@10 -- # set +x 00:06:36.321 03:23:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:36.321 03:23:16 -- target/nvmf_example.sh@47 -- # malloc_bdevs='Malloc0 ' 00:06:36.321 03:23:16 -- target/nvmf_example.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:06:36.321 03:23:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:36.321 03:23:16 -- common/autotest_common.sh@10 -- # set +x 00:06:36.321 03:23:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:36.321 03:23:16 -- target/nvmf_example.sh@52 -- # for malloc_bdev in $malloc_bdevs 00:06:36.321 03:23:16 -- target/nvmf_example.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:06:36.321 03:23:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:36.321 03:23:16 -- common/autotest_common.sh@10 -- # set +x 00:06:36.321 03:23:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:36.321 03:23:16 -- target/nvmf_example.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:06:36.321 03:23:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:36.321 03:23:16 -- common/autotest_common.sh@10 -- # set +x 00:06:36.321 03:23:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:36.321 03:23:16 -- target/nvmf_example.sh@59 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:06:36.321 03:23:16 -- target/nvmf_example.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:06:36.321 EAL: No free 2048 kB hugepages reported on node 1 00:06:48.543 Initializing NVMe Controllers 00:06:48.543 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:06:48.543 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:06:48.543 Initialization complete. Launching workers. 00:06:48.543 ======================================================== 00:06:48.543 Latency(us) 00:06:48.543 Device Information : IOPS MiB/s Average min max 00:06:48.543 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 15760.40 61.56 4061.27 873.38 16105.31 00:06:48.543 ======================================================== 00:06:48.543 Total : 15760.40 61.56 4061.27 873.38 16105.31 00:06:48.543 00:06:48.543 03:23:27 -- target/nvmf_example.sh@65 -- # trap - SIGINT SIGTERM EXIT 00:06:48.543 03:23:27 -- target/nvmf_example.sh@66 -- # nvmftestfini 00:06:48.543 03:23:27 -- nvmf/common.sh@476 -- # nvmfcleanup 00:06:48.543 03:23:27 -- nvmf/common.sh@116 -- # sync 00:06:48.543 03:23:27 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:06:48.543 03:23:27 -- nvmf/common.sh@119 -- # set +e 00:06:48.543 03:23:27 -- nvmf/common.sh@120 -- # for i in {1..20} 00:06:48.543 03:23:27 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:06:48.543 rmmod nvme_tcp 00:06:48.543 rmmod nvme_fabrics 00:06:48.543 rmmod nvme_keyring 00:06:48.543 03:23:27 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:06:48.543 03:23:27 -- nvmf/common.sh@123 -- # set -e 00:06:48.543 03:23:27 -- nvmf/common.sh@124 -- # return 0 00:06:48.543 03:23:27 -- nvmf/common.sh@477 -- # '[' -n 2949328 ']' 00:06:48.543 03:23:27 -- nvmf/common.sh@478 -- # killprocess 2949328 00:06:48.543 03:23:27 -- common/autotest_common.sh@936 -- # '[' -z 2949328 ']' 00:06:48.543 03:23:27 -- common/autotest_common.sh@940 -- # kill -0 2949328 00:06:48.543 03:23:27 -- common/autotest_common.sh@941 -- # uname 00:06:48.543 03:23:27 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:48.543 03:23:27 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2949328 00:06:48.543 03:23:27 -- common/autotest_common.sh@942 -- # process_name=nvmf 00:06:48.543 03:23:27 -- common/autotest_common.sh@946 -- # '[' nvmf = sudo ']' 00:06:48.543 03:23:27 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2949328' 00:06:48.543 killing process with pid 2949328 00:06:48.543 03:23:27 -- common/autotest_common.sh@955 -- # kill 2949328 00:06:48.543 03:23:27 -- common/autotest_common.sh@960 -- # wait 2949328 00:06:48.543 nvmf threads initialize successfully 00:06:48.543 bdev subsystem init successfully 00:06:48.543 created a nvmf target service 00:06:48.543 create targets's poll groups done 00:06:48.543 all subsystems of target started 00:06:48.543 nvmf target is running 00:06:48.543 all subsystems of target stopped 00:06:48.543 destroy targets's poll groups done 00:06:48.543 destroyed the nvmf target service 00:06:48.543 bdev subsystem finish successfully 00:06:48.543 nvmf threads destroy successfully 00:06:48.543 03:23:27 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:06:48.543 03:23:27 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:06:48.543 03:23:27 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:06:48.543 03:23:27 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:06:48.543 03:23:27 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:06:48.543 03:23:27 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:48.543 03:23:27 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:48.543 03:23:27 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:49.113 03:23:29 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:06:49.113 03:23:29 -- target/nvmf_example.sh@67 -- # timing_exit nvmf_example_test 00:06:49.113 03:23:29 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:49.113 03:23:29 -- common/autotest_common.sh@10 -- # set +x 00:06:49.113 00:06:49.113 real 0m15.352s 00:06:49.113 user 0m42.389s 00:06:49.113 sys 0m3.277s 00:06:49.113 03:23:29 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:49.113 03:23:29 -- common/autotest_common.sh@10 -- # set +x 00:06:49.113 ************************************ 00:06:49.113 END TEST nvmf_example 00:06:49.113 ************************************ 00:06:49.113 03:23:29 -- nvmf/nvmf.sh@24 -- # run_test nvmf_filesystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:06:49.113 03:23:29 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:49.113 03:23:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:49.113 03:23:29 -- common/autotest_common.sh@10 -- # set +x 00:06:49.113 ************************************ 00:06:49.113 START TEST nvmf_filesystem 00:06:49.113 ************************************ 00:06:49.113 03:23:29 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:06:49.113 * Looking for test storage... 00:06:49.113 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:49.113 03:23:29 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:49.113 03:23:29 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:49.113 03:23:29 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:49.113 03:23:29 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:49.113 03:23:29 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:49.113 03:23:29 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:49.113 03:23:29 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:49.113 03:23:29 -- scripts/common.sh@335 -- # IFS=.-: 00:06:49.113 03:23:29 -- scripts/common.sh@335 -- # read -ra ver1 00:06:49.113 03:23:29 -- scripts/common.sh@336 -- # IFS=.-: 00:06:49.113 03:23:29 -- scripts/common.sh@336 -- # read -ra ver2 00:06:49.113 03:23:29 -- scripts/common.sh@337 -- # local 'op=<' 00:06:49.113 03:23:29 -- scripts/common.sh@339 -- # ver1_l=2 00:06:49.113 03:23:29 -- scripts/common.sh@340 -- # ver2_l=1 00:06:49.113 03:23:29 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:49.113 03:23:29 -- scripts/common.sh@343 -- # case "$op" in 00:06:49.113 03:23:29 -- scripts/common.sh@344 -- # : 1 00:06:49.113 03:23:29 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:49.113 03:23:29 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:49.113 03:23:29 -- scripts/common.sh@364 -- # decimal 1 00:06:49.113 03:23:29 -- scripts/common.sh@352 -- # local d=1 00:06:49.113 03:23:29 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:49.113 03:23:29 -- scripts/common.sh@354 -- # echo 1 00:06:49.113 03:23:29 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:49.113 03:23:29 -- scripts/common.sh@365 -- # decimal 2 00:06:49.113 03:23:29 -- scripts/common.sh@352 -- # local d=2 00:06:49.113 03:23:29 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:49.113 03:23:29 -- scripts/common.sh@354 -- # echo 2 00:06:49.113 03:23:29 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:49.113 03:23:29 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:49.113 03:23:29 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:49.113 03:23:29 -- scripts/common.sh@367 -- # return 0 00:06:49.113 03:23:29 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:49.113 03:23:29 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:49.113 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:49.113 --rc genhtml_branch_coverage=1 00:06:49.113 --rc genhtml_function_coverage=1 00:06:49.113 --rc genhtml_legend=1 00:06:49.113 --rc geninfo_all_blocks=1 00:06:49.113 --rc geninfo_unexecuted_blocks=1 00:06:49.113 00:06:49.113 ' 00:06:49.113 03:23:29 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:49.113 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:49.113 --rc genhtml_branch_coverage=1 00:06:49.113 --rc genhtml_function_coverage=1 00:06:49.113 --rc genhtml_legend=1 00:06:49.113 --rc geninfo_all_blocks=1 00:06:49.113 --rc geninfo_unexecuted_blocks=1 00:06:49.113 00:06:49.113 ' 00:06:49.113 03:23:29 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:49.113 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:49.113 --rc genhtml_branch_coverage=1 00:06:49.113 --rc genhtml_function_coverage=1 00:06:49.113 --rc genhtml_legend=1 00:06:49.113 --rc geninfo_all_blocks=1 00:06:49.113 --rc geninfo_unexecuted_blocks=1 00:06:49.113 00:06:49.113 ' 00:06:49.113 03:23:29 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:49.113 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:49.113 --rc genhtml_branch_coverage=1 00:06:49.113 --rc genhtml_function_coverage=1 00:06:49.113 --rc genhtml_legend=1 00:06:49.113 --rc geninfo_all_blocks=1 00:06:49.113 --rc geninfo_unexecuted_blocks=1 00:06:49.113 00:06:49.113 ' 00:06:49.113 03:23:29 -- target/filesystem.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh 00:06:49.113 03:23:29 -- common/autotest_common.sh@7 -- # rpc_py=rpc_cmd 00:06:49.113 03:23:29 -- common/autotest_common.sh@34 -- # set -e 00:06:49.113 03:23:29 -- common/autotest_common.sh@35 -- # shopt -s nullglob 00:06:49.113 03:23:29 -- common/autotest_common.sh@36 -- # shopt -s extglob 00:06:49.113 03:23:29 -- common/autotest_common.sh@38 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh ]] 00:06:49.113 03:23:29 -- common/autotest_common.sh@39 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh 00:06:49.113 03:23:29 -- common/build_config.sh@1 -- # CONFIG_WPDK_DIR= 00:06:49.113 03:23:29 -- common/build_config.sh@2 -- # CONFIG_ASAN=n 00:06:49.113 03:23:29 -- common/build_config.sh@3 -- # CONFIG_VBDEV_COMPRESS=n 00:06:49.113 03:23:29 -- common/build_config.sh@4 -- # CONFIG_HAVE_EXECINFO_H=y 00:06:49.113 03:23:29 -- common/build_config.sh@5 -- # CONFIG_USDT=n 00:06:49.113 03:23:29 -- common/build_config.sh@6 -- # CONFIG_CUSTOMOCF=n 00:06:49.113 03:23:29 -- common/build_config.sh@7 -- # CONFIG_PREFIX=/usr/local 00:06:49.113 03:23:29 -- common/build_config.sh@8 -- # CONFIG_RBD=n 00:06:49.113 03:23:29 -- common/build_config.sh@9 -- # CONFIG_LIBDIR= 00:06:49.113 03:23:29 -- common/build_config.sh@10 -- # CONFIG_IDXD=y 00:06:49.113 03:23:29 -- common/build_config.sh@11 -- # CONFIG_NVME_CUSE=y 00:06:49.113 03:23:29 -- common/build_config.sh@12 -- # CONFIG_SMA=n 00:06:49.113 03:23:29 -- common/build_config.sh@13 -- # CONFIG_VTUNE=n 00:06:49.113 03:23:29 -- common/build_config.sh@14 -- # CONFIG_TSAN=n 00:06:49.113 03:23:29 -- common/build_config.sh@15 -- # CONFIG_RDMA_SEND_WITH_INVAL=y 00:06:49.113 03:23:29 -- common/build_config.sh@16 -- # CONFIG_VFIO_USER_DIR= 00:06:49.113 03:23:29 -- common/build_config.sh@17 -- # CONFIG_PGO_CAPTURE=n 00:06:49.113 03:23:29 -- common/build_config.sh@18 -- # CONFIG_HAVE_UUID_GENERATE_SHA1=y 00:06:49.113 03:23:29 -- common/build_config.sh@19 -- # CONFIG_ENV=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:06:49.113 03:23:29 -- common/build_config.sh@20 -- # CONFIG_LTO=n 00:06:49.113 03:23:29 -- common/build_config.sh@21 -- # CONFIG_ISCSI_INITIATOR=y 00:06:49.114 03:23:29 -- common/build_config.sh@22 -- # CONFIG_CET=n 00:06:49.114 03:23:29 -- common/build_config.sh@23 -- # CONFIG_VBDEV_COMPRESS_MLX5=n 00:06:49.114 03:23:29 -- common/build_config.sh@24 -- # CONFIG_OCF_PATH= 00:06:49.114 03:23:29 -- common/build_config.sh@25 -- # CONFIG_RDMA_SET_TOS=y 00:06:49.114 03:23:29 -- common/build_config.sh@26 -- # CONFIG_HAVE_ARC4RANDOM=y 00:06:49.114 03:23:29 -- common/build_config.sh@27 -- # CONFIG_HAVE_LIBARCHIVE=n 00:06:49.114 03:23:29 -- common/build_config.sh@28 -- # CONFIG_UBLK=y 00:06:49.114 03:23:29 -- common/build_config.sh@29 -- # CONFIG_ISAL_CRYPTO=y 00:06:49.114 03:23:29 -- common/build_config.sh@30 -- # CONFIG_OPENSSL_PATH= 00:06:49.114 03:23:29 -- common/build_config.sh@31 -- # CONFIG_OCF=n 00:06:49.114 03:23:29 -- common/build_config.sh@32 -- # CONFIG_FUSE=n 00:06:49.114 03:23:29 -- common/build_config.sh@33 -- # CONFIG_VTUNE_DIR= 00:06:49.114 03:23:29 -- common/build_config.sh@34 -- # CONFIG_FUZZER_LIB= 00:06:49.114 03:23:29 -- common/build_config.sh@35 -- # CONFIG_FUZZER=n 00:06:49.114 03:23:29 -- common/build_config.sh@36 -- # CONFIG_DPDK_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:06:49.114 03:23:29 -- common/build_config.sh@37 -- # CONFIG_CRYPTO=n 00:06:49.114 03:23:29 -- common/build_config.sh@38 -- # CONFIG_PGO_USE=n 00:06:49.114 03:23:29 -- common/build_config.sh@39 -- # CONFIG_VHOST=y 00:06:49.114 03:23:29 -- common/build_config.sh@40 -- # CONFIG_DAOS=n 00:06:49.114 03:23:29 -- common/build_config.sh@41 -- # CONFIG_DPDK_INC_DIR= 00:06:49.114 03:23:29 -- common/build_config.sh@42 -- # CONFIG_DAOS_DIR= 00:06:49.114 03:23:29 -- common/build_config.sh@43 -- # CONFIG_UNIT_TESTS=n 00:06:49.114 03:23:29 -- common/build_config.sh@44 -- # CONFIG_RDMA_SET_ACK_TIMEOUT=y 00:06:49.114 03:23:29 -- common/build_config.sh@45 -- # CONFIG_VIRTIO=y 00:06:49.114 03:23:29 -- common/build_config.sh@46 -- # CONFIG_COVERAGE=y 00:06:49.114 03:23:29 -- common/build_config.sh@47 -- # CONFIG_RDMA=y 00:06:49.114 03:23:29 -- common/build_config.sh@48 -- # CONFIG_FIO_SOURCE_DIR=/usr/src/fio 00:06:49.114 03:23:29 -- common/build_config.sh@49 -- # CONFIG_URING_PATH= 00:06:49.114 03:23:29 -- common/build_config.sh@50 -- # CONFIG_XNVME=n 00:06:49.114 03:23:29 -- common/build_config.sh@51 -- # CONFIG_VFIO_USER=n 00:06:49.114 03:23:29 -- common/build_config.sh@52 -- # CONFIG_ARCH=native 00:06:49.114 03:23:29 -- common/build_config.sh@53 -- # CONFIG_URING_ZNS=n 00:06:49.114 03:23:29 -- common/build_config.sh@54 -- # CONFIG_WERROR=y 00:06:49.114 03:23:29 -- common/build_config.sh@55 -- # CONFIG_HAVE_LIBBSD=n 00:06:49.114 03:23:29 -- common/build_config.sh@56 -- # CONFIG_UBSAN=y 00:06:49.114 03:23:29 -- common/build_config.sh@57 -- # CONFIG_IPSEC_MB_DIR= 00:06:49.114 03:23:29 -- common/build_config.sh@58 -- # CONFIG_GOLANG=n 00:06:49.114 03:23:29 -- common/build_config.sh@59 -- # CONFIG_ISAL=y 00:06:49.114 03:23:29 -- common/build_config.sh@60 -- # CONFIG_IDXD_KERNEL=y 00:06:49.114 03:23:29 -- common/build_config.sh@61 -- # CONFIG_DPDK_LIB_DIR= 00:06:49.114 03:23:29 -- common/build_config.sh@62 -- # CONFIG_RDMA_PROV=verbs 00:06:49.114 03:23:29 -- common/build_config.sh@63 -- # CONFIG_APPS=y 00:06:49.114 03:23:29 -- common/build_config.sh@64 -- # CONFIG_SHARED=y 00:06:49.114 03:23:29 -- common/build_config.sh@65 -- # CONFIG_FC_PATH= 00:06:49.114 03:23:29 -- common/build_config.sh@66 -- # CONFIG_DPDK_PKG_CONFIG=n 00:06:49.114 03:23:29 -- common/build_config.sh@67 -- # CONFIG_FC=n 00:06:49.114 03:23:29 -- common/build_config.sh@68 -- # CONFIG_AVAHI=n 00:06:49.114 03:23:29 -- common/build_config.sh@69 -- # CONFIG_FIO_PLUGIN=y 00:06:49.114 03:23:29 -- common/build_config.sh@70 -- # CONFIG_RAID5F=n 00:06:49.114 03:23:29 -- common/build_config.sh@71 -- # CONFIG_EXAMPLES=y 00:06:49.114 03:23:29 -- common/build_config.sh@72 -- # CONFIG_TESTS=y 00:06:49.114 03:23:29 -- common/build_config.sh@73 -- # CONFIG_CRYPTO_MLX5=n 00:06:49.114 03:23:29 -- common/build_config.sh@74 -- # CONFIG_MAX_LCORES= 00:06:49.114 03:23:29 -- common/build_config.sh@75 -- # CONFIG_IPSEC_MB=n 00:06:49.114 03:23:29 -- common/build_config.sh@76 -- # CONFIG_DEBUG=y 00:06:49.114 03:23:29 -- common/build_config.sh@77 -- # CONFIG_DPDK_COMPRESSDEV=n 00:06:49.114 03:23:29 -- common/build_config.sh@78 -- # CONFIG_CROSS_PREFIX= 00:06:49.114 03:23:29 -- common/build_config.sh@79 -- # CONFIG_URING=n 00:06:49.114 03:23:29 -- common/autotest_common.sh@48 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:06:49.408 03:23:29 -- common/applications.sh@8 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:06:49.408 03:23:29 -- common/applications.sh@8 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:06:49.408 03:23:29 -- common/applications.sh@8 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:06:49.408 03:23:29 -- common/applications.sh@9 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:06:49.408 03:23:29 -- common/applications.sh@10 -- # _app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:06:49.408 03:23:29 -- common/applications.sh@11 -- # _test_app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:06:49.408 03:23:29 -- common/applications.sh@12 -- # _examples_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:06:49.408 03:23:29 -- common/applications.sh@14 -- # VHOST_FUZZ_APP=("$_test_app_dir/fuzz/vhost_fuzz/vhost_fuzz") 00:06:49.408 03:23:29 -- common/applications.sh@15 -- # ISCSI_APP=("$_app_dir/iscsi_tgt") 00:06:49.408 03:23:29 -- common/applications.sh@16 -- # NVMF_APP=("$_app_dir/nvmf_tgt") 00:06:49.408 03:23:29 -- common/applications.sh@17 -- # VHOST_APP=("$_app_dir/vhost") 00:06:49.408 03:23:29 -- common/applications.sh@18 -- # DD_APP=("$_app_dir/spdk_dd") 00:06:49.408 03:23:29 -- common/applications.sh@19 -- # SPDK_APP=("$_app_dir/spdk_tgt") 00:06:49.408 03:23:29 -- common/applications.sh@22 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/config.h ]] 00:06:49.408 03:23:29 -- common/applications.sh@23 -- # [[ #ifndef SPDK_CONFIG_H 00:06:49.408 #define SPDK_CONFIG_H 00:06:49.408 #define SPDK_CONFIG_APPS 1 00:06:49.408 #define SPDK_CONFIG_ARCH native 00:06:49.408 #undef SPDK_CONFIG_ASAN 00:06:49.408 #undef SPDK_CONFIG_AVAHI 00:06:49.408 #undef SPDK_CONFIG_CET 00:06:49.408 #define SPDK_CONFIG_COVERAGE 1 00:06:49.408 #define SPDK_CONFIG_CROSS_PREFIX 00:06:49.408 #undef SPDK_CONFIG_CRYPTO 00:06:49.408 #undef SPDK_CONFIG_CRYPTO_MLX5 00:06:49.408 #undef SPDK_CONFIG_CUSTOMOCF 00:06:49.408 #undef SPDK_CONFIG_DAOS 00:06:49.408 #define SPDK_CONFIG_DAOS_DIR 00:06:49.408 #define SPDK_CONFIG_DEBUG 1 00:06:49.408 #undef SPDK_CONFIG_DPDK_COMPRESSDEV 00:06:49.408 #define SPDK_CONFIG_DPDK_DIR /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:06:49.408 #define SPDK_CONFIG_DPDK_INC_DIR 00:06:49.408 #define SPDK_CONFIG_DPDK_LIB_DIR 00:06:49.408 #undef SPDK_CONFIG_DPDK_PKG_CONFIG 00:06:49.408 #define SPDK_CONFIG_ENV /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:06:49.408 #define SPDK_CONFIG_EXAMPLES 1 00:06:49.408 #undef SPDK_CONFIG_FC 00:06:49.408 #define SPDK_CONFIG_FC_PATH 00:06:49.408 #define SPDK_CONFIG_FIO_PLUGIN 1 00:06:49.408 #define SPDK_CONFIG_FIO_SOURCE_DIR /usr/src/fio 00:06:49.408 #undef SPDK_CONFIG_FUSE 00:06:49.408 #undef SPDK_CONFIG_FUZZER 00:06:49.408 #define SPDK_CONFIG_FUZZER_LIB 00:06:49.408 #undef SPDK_CONFIG_GOLANG 00:06:49.408 #define SPDK_CONFIG_HAVE_ARC4RANDOM 1 00:06:49.408 #define SPDK_CONFIG_HAVE_EXECINFO_H 1 00:06:49.408 #undef SPDK_CONFIG_HAVE_LIBARCHIVE 00:06:49.408 #undef SPDK_CONFIG_HAVE_LIBBSD 00:06:49.408 #define SPDK_CONFIG_HAVE_UUID_GENERATE_SHA1 1 00:06:49.408 #define SPDK_CONFIG_IDXD 1 00:06:49.408 #define SPDK_CONFIG_IDXD_KERNEL 1 00:06:49.408 #undef SPDK_CONFIG_IPSEC_MB 00:06:49.408 #define SPDK_CONFIG_IPSEC_MB_DIR 00:06:49.408 #define SPDK_CONFIG_ISAL 1 00:06:49.408 #define SPDK_CONFIG_ISAL_CRYPTO 1 00:06:49.408 #define SPDK_CONFIG_ISCSI_INITIATOR 1 00:06:49.408 #define SPDK_CONFIG_LIBDIR 00:06:49.408 #undef SPDK_CONFIG_LTO 00:06:49.408 #define SPDK_CONFIG_MAX_LCORES 00:06:49.408 #define SPDK_CONFIG_NVME_CUSE 1 00:06:49.408 #undef SPDK_CONFIG_OCF 00:06:49.408 #define SPDK_CONFIG_OCF_PATH 00:06:49.408 #define SPDK_CONFIG_OPENSSL_PATH 00:06:49.408 #undef SPDK_CONFIG_PGO_CAPTURE 00:06:49.408 #undef SPDK_CONFIG_PGO_USE 00:06:49.408 #define SPDK_CONFIG_PREFIX /usr/local 00:06:49.408 #undef SPDK_CONFIG_RAID5F 00:06:49.408 #undef SPDK_CONFIG_RBD 00:06:49.408 #define SPDK_CONFIG_RDMA 1 00:06:49.408 #define SPDK_CONFIG_RDMA_PROV verbs 00:06:49.408 #define SPDK_CONFIG_RDMA_SEND_WITH_INVAL 1 00:06:49.408 #define SPDK_CONFIG_RDMA_SET_ACK_TIMEOUT 1 00:06:49.408 #define SPDK_CONFIG_RDMA_SET_TOS 1 00:06:49.408 #define SPDK_CONFIG_SHARED 1 00:06:49.408 #undef SPDK_CONFIG_SMA 00:06:49.408 #define SPDK_CONFIG_TESTS 1 00:06:49.408 #undef SPDK_CONFIG_TSAN 00:06:49.408 #define SPDK_CONFIG_UBLK 1 00:06:49.408 #define SPDK_CONFIG_UBSAN 1 00:06:49.408 #undef SPDK_CONFIG_UNIT_TESTS 00:06:49.408 #undef SPDK_CONFIG_URING 00:06:49.408 #define SPDK_CONFIG_URING_PATH 00:06:49.408 #undef SPDK_CONFIG_URING_ZNS 00:06:49.408 #undef SPDK_CONFIG_USDT 00:06:49.408 #undef SPDK_CONFIG_VBDEV_COMPRESS 00:06:49.408 #undef SPDK_CONFIG_VBDEV_COMPRESS_MLX5 00:06:49.408 #undef SPDK_CONFIG_VFIO_USER 00:06:49.408 #define SPDK_CONFIG_VFIO_USER_DIR 00:06:49.408 #define SPDK_CONFIG_VHOST 1 00:06:49.408 #define SPDK_CONFIG_VIRTIO 1 00:06:49.408 #undef SPDK_CONFIG_VTUNE 00:06:49.408 #define SPDK_CONFIG_VTUNE_DIR 00:06:49.408 #define SPDK_CONFIG_WERROR 1 00:06:49.408 #define SPDK_CONFIG_WPDK_DIR 00:06:49.408 #undef SPDK_CONFIG_XNVME 00:06:49.408 #endif /* SPDK_CONFIG_H */ == *\#\d\e\f\i\n\e\ \S\P\D\K\_\C\O\N\F\I\G\_\D\E\B\U\G* ]] 00:06:49.408 03:23:29 -- common/applications.sh@24 -- # (( SPDK_AUTOTEST_DEBUG_APPS )) 00:06:49.408 03:23:29 -- common/autotest_common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:49.408 03:23:29 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:49.408 03:23:29 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:49.408 03:23:29 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:49.409 03:23:29 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:49.409 03:23:29 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:49.409 03:23:29 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:49.409 03:23:29 -- paths/export.sh@5 -- # export PATH 00:06:49.409 03:23:29 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:49.409 03:23:29 -- common/autotest_common.sh@50 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:06:49.409 03:23:29 -- pm/common@6 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:06:49.409 03:23:29 -- pm/common@6 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:06:49.409 03:23:29 -- pm/common@6 -- # _pmdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:06:49.409 03:23:29 -- pm/common@7 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/../../../ 00:06:49.409 03:23:29 -- pm/common@7 -- # _pmrootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:06:49.409 03:23:29 -- pm/common@16 -- # TEST_TAG=N/A 00:06:49.409 03:23:29 -- pm/common@17 -- # TEST_TAG_FILE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/.run_test_name 00:06:49.409 03:23:29 -- common/autotest_common.sh@52 -- # : 1 00:06:49.409 03:23:29 -- common/autotest_common.sh@53 -- # export RUN_NIGHTLY 00:06:49.409 03:23:29 -- common/autotest_common.sh@56 -- # : 0 00:06:49.409 03:23:29 -- common/autotest_common.sh@57 -- # export SPDK_AUTOTEST_DEBUG_APPS 00:06:49.409 03:23:29 -- common/autotest_common.sh@58 -- # : 0 00:06:49.409 03:23:29 -- common/autotest_common.sh@59 -- # export SPDK_RUN_VALGRIND 00:06:49.409 03:23:29 -- common/autotest_common.sh@60 -- # : 1 00:06:49.409 03:23:29 -- common/autotest_common.sh@61 -- # export SPDK_RUN_FUNCTIONAL_TEST 00:06:49.409 03:23:29 -- common/autotest_common.sh@62 -- # : 0 00:06:49.409 03:23:29 -- common/autotest_common.sh@63 -- # export SPDK_TEST_UNITTEST 00:06:49.409 03:23:29 -- common/autotest_common.sh@64 -- # : 00:06:49.409 03:23:29 -- common/autotest_common.sh@65 -- # export SPDK_TEST_AUTOBUILD 00:06:49.409 03:23:29 -- common/autotest_common.sh@66 -- # : 0 00:06:49.409 03:23:29 -- common/autotest_common.sh@67 -- # export SPDK_TEST_RELEASE_BUILD 00:06:49.409 03:23:29 -- common/autotest_common.sh@68 -- # : 0 00:06:49.409 03:23:29 -- common/autotest_common.sh@69 -- # export SPDK_TEST_ISAL 00:06:49.409 03:23:29 -- common/autotest_common.sh@70 -- # : 0 00:06:49.409 03:23:29 -- common/autotest_common.sh@71 -- # export SPDK_TEST_ISCSI 00:06:49.409 03:23:29 -- common/autotest_common.sh@72 -- # : 0 00:06:49.409 03:23:29 -- common/autotest_common.sh@73 -- # export SPDK_TEST_ISCSI_INITIATOR 00:06:49.409 03:23:29 -- common/autotest_common.sh@74 -- # : 0 00:06:49.409 03:23:29 -- common/autotest_common.sh@75 -- # export SPDK_TEST_NVME 00:06:49.409 03:23:29 -- common/autotest_common.sh@76 -- # : 0 00:06:49.409 03:23:29 -- common/autotest_common.sh@77 -- # export SPDK_TEST_NVME_PMR 00:06:49.409 03:23:29 -- common/autotest_common.sh@78 -- # : 0 00:06:49.409 03:23:29 -- common/autotest_common.sh@79 -- # export SPDK_TEST_NVME_BP 00:06:49.409 03:23:29 -- common/autotest_common.sh@80 -- # : 1 00:06:49.409 03:23:29 -- common/autotest_common.sh@81 -- # export SPDK_TEST_NVME_CLI 00:06:49.409 03:23:29 -- common/autotest_common.sh@82 -- # : 0 00:06:49.409 03:23:29 -- common/autotest_common.sh@83 -- # export SPDK_TEST_NVME_CUSE 00:06:49.409 03:23:29 -- common/autotest_common.sh@84 -- # : 0 00:06:49.409 03:23:29 -- common/autotest_common.sh@85 -- # export SPDK_TEST_NVME_FDP 00:06:49.409 03:23:29 -- common/autotest_common.sh@86 -- # : 1 00:06:49.409 03:23:29 -- common/autotest_common.sh@87 -- # export SPDK_TEST_NVMF 00:06:49.409 03:23:29 -- common/autotest_common.sh@88 -- # : 0 00:06:49.409 03:23:29 -- common/autotest_common.sh@89 -- # export SPDK_TEST_VFIOUSER 00:06:49.409 03:23:29 -- common/autotest_common.sh@90 -- # : 0 00:06:49.409 03:23:29 -- common/autotest_common.sh@91 -- # export SPDK_TEST_VFIOUSER_QEMU 00:06:49.409 03:23:29 -- common/autotest_common.sh@92 -- # : 0 00:06:49.409 03:23:29 -- common/autotest_common.sh@93 -- # export SPDK_TEST_FUZZER 00:06:49.409 03:23:29 -- common/autotest_common.sh@94 -- # : 0 00:06:49.409 03:23:29 -- common/autotest_common.sh@95 -- # export SPDK_TEST_FUZZER_SHORT 00:06:49.409 03:23:29 -- common/autotest_common.sh@96 -- # : tcp 00:06:49.409 03:23:29 -- common/autotest_common.sh@97 -- # export SPDK_TEST_NVMF_TRANSPORT 00:06:49.409 03:23:29 -- common/autotest_common.sh@98 -- # : 0 00:06:49.409 03:23:29 -- common/autotest_common.sh@99 -- # export SPDK_TEST_RBD 00:06:49.409 03:23:29 -- common/autotest_common.sh@100 -- # : 0 00:06:49.409 03:23:29 -- common/autotest_common.sh@101 -- # export SPDK_TEST_VHOST 00:06:49.409 03:23:29 -- common/autotest_common.sh@102 -- # : 0 00:06:49.409 03:23:29 -- common/autotest_common.sh@103 -- # export SPDK_TEST_BLOCKDEV 00:06:49.409 03:23:29 -- common/autotest_common.sh@104 -- # : 0 00:06:49.409 03:23:29 -- common/autotest_common.sh@105 -- # export SPDK_TEST_IOAT 00:06:49.409 03:23:29 -- common/autotest_common.sh@106 -- # : 0 00:06:49.409 03:23:29 -- common/autotest_common.sh@107 -- # export SPDK_TEST_BLOBFS 00:06:49.409 03:23:29 -- common/autotest_common.sh@108 -- # : 0 00:06:49.409 03:23:29 -- common/autotest_common.sh@109 -- # export SPDK_TEST_VHOST_INIT 00:06:49.409 03:23:29 -- common/autotest_common.sh@110 -- # : 0 00:06:49.409 03:23:29 -- common/autotest_common.sh@111 -- # export SPDK_TEST_LVOL 00:06:49.409 03:23:29 -- common/autotest_common.sh@112 -- # : 0 00:06:49.409 03:23:29 -- common/autotest_common.sh@113 -- # export SPDK_TEST_VBDEV_COMPRESS 00:06:49.409 03:23:29 -- common/autotest_common.sh@114 -- # : 0 00:06:49.409 03:23:29 -- common/autotest_common.sh@115 -- # export SPDK_RUN_ASAN 00:06:49.409 03:23:29 -- common/autotest_common.sh@116 -- # : 1 00:06:49.409 03:23:29 -- common/autotest_common.sh@117 -- # export SPDK_RUN_UBSAN 00:06:49.409 03:23:29 -- common/autotest_common.sh@118 -- # : 00:06:49.409 03:23:29 -- common/autotest_common.sh@119 -- # export SPDK_RUN_EXTERNAL_DPDK 00:06:49.409 03:23:29 -- common/autotest_common.sh@120 -- # : 0 00:06:49.409 03:23:29 -- common/autotest_common.sh@121 -- # export SPDK_RUN_NON_ROOT 00:06:49.409 03:23:29 -- common/autotest_common.sh@122 -- # : 0 00:06:49.409 03:23:29 -- common/autotest_common.sh@123 -- # export SPDK_TEST_CRYPTO 00:06:49.409 03:23:29 -- common/autotest_common.sh@124 -- # : 0 00:06:49.409 03:23:29 -- common/autotest_common.sh@125 -- # export SPDK_TEST_FTL 00:06:49.409 03:23:29 -- common/autotest_common.sh@126 -- # : 0 00:06:49.409 03:23:29 -- common/autotest_common.sh@127 -- # export SPDK_TEST_OCF 00:06:49.409 03:23:29 -- common/autotest_common.sh@128 -- # : 0 00:06:49.409 03:23:29 -- common/autotest_common.sh@129 -- # export SPDK_TEST_VMD 00:06:49.409 03:23:29 -- common/autotest_common.sh@130 -- # : 0 00:06:49.409 03:23:29 -- common/autotest_common.sh@131 -- # export SPDK_TEST_OPAL 00:06:49.409 03:23:29 -- common/autotest_common.sh@132 -- # : 00:06:49.409 03:23:29 -- common/autotest_common.sh@133 -- # export SPDK_TEST_NATIVE_DPDK 00:06:49.409 03:23:29 -- common/autotest_common.sh@134 -- # : true 00:06:49.409 03:23:29 -- common/autotest_common.sh@135 -- # export SPDK_AUTOTEST_X 00:06:49.409 03:23:29 -- common/autotest_common.sh@136 -- # : 0 00:06:49.409 03:23:29 -- common/autotest_common.sh@137 -- # export SPDK_TEST_RAID5 00:06:49.409 03:23:29 -- common/autotest_common.sh@138 -- # : 0 00:06:49.409 03:23:29 -- common/autotest_common.sh@139 -- # export SPDK_TEST_URING 00:06:49.409 03:23:29 -- common/autotest_common.sh@140 -- # : 0 00:06:49.409 03:23:29 -- common/autotest_common.sh@141 -- # export SPDK_TEST_USDT 00:06:49.409 03:23:29 -- common/autotest_common.sh@142 -- # : 0 00:06:49.409 03:23:29 -- common/autotest_common.sh@143 -- # export SPDK_TEST_USE_IGB_UIO 00:06:49.409 03:23:29 -- common/autotest_common.sh@144 -- # : 0 00:06:49.409 03:23:29 -- common/autotest_common.sh@145 -- # export SPDK_TEST_SCHEDULER 00:06:49.409 03:23:29 -- common/autotest_common.sh@146 -- # : 0 00:06:49.409 03:23:29 -- common/autotest_common.sh@147 -- # export SPDK_TEST_SCANBUILD 00:06:49.409 03:23:29 -- common/autotest_common.sh@148 -- # : e810 00:06:49.409 03:23:29 -- common/autotest_common.sh@149 -- # export SPDK_TEST_NVMF_NICS 00:06:49.409 03:23:29 -- common/autotest_common.sh@150 -- # : 0 00:06:49.409 03:23:29 -- common/autotest_common.sh@151 -- # export SPDK_TEST_SMA 00:06:49.409 03:23:29 -- common/autotest_common.sh@152 -- # : 0 00:06:49.409 03:23:29 -- common/autotest_common.sh@153 -- # export SPDK_TEST_DAOS 00:06:49.409 03:23:29 -- common/autotest_common.sh@154 -- # : 0 00:06:49.409 03:23:29 -- common/autotest_common.sh@155 -- # export SPDK_TEST_XNVME 00:06:49.409 03:23:29 -- common/autotest_common.sh@156 -- # : 0 00:06:49.409 03:23:29 -- common/autotest_common.sh@157 -- # export SPDK_TEST_ACCEL_DSA 00:06:49.409 03:23:29 -- common/autotest_common.sh@158 -- # : 0 00:06:49.409 03:23:29 -- common/autotest_common.sh@159 -- # export SPDK_TEST_ACCEL_IAA 00:06:49.409 03:23:29 -- common/autotest_common.sh@160 -- # : 0 00:06:49.409 03:23:29 -- common/autotest_common.sh@161 -- # export SPDK_TEST_ACCEL_IOAT 00:06:49.409 03:23:29 -- common/autotest_common.sh@163 -- # : 00:06:49.410 03:23:29 -- common/autotest_common.sh@164 -- # export SPDK_TEST_FUZZER_TARGET 00:06:49.410 03:23:29 -- common/autotest_common.sh@165 -- # : 0 00:06:49.410 03:23:29 -- common/autotest_common.sh@166 -- # export SPDK_TEST_NVMF_MDNS 00:06:49.410 03:23:29 -- common/autotest_common.sh@167 -- # : 0 00:06:49.410 03:23:29 -- common/autotest_common.sh@168 -- # export SPDK_JSONRPC_GO_CLIENT 00:06:49.410 03:23:29 -- common/autotest_common.sh@171 -- # export SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:06:49.410 03:23:29 -- common/autotest_common.sh@171 -- # SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:06:49.410 03:23:29 -- common/autotest_common.sh@172 -- # export DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib 00:06:49.410 03:23:29 -- common/autotest_common.sh@172 -- # DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib 00:06:49.410 03:23:29 -- common/autotest_common.sh@173 -- # export VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:49.410 03:23:29 -- common/autotest_common.sh@173 -- # VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:49.410 03:23:29 -- common/autotest_common.sh@174 -- # export LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:49.410 03:23:29 -- common/autotest_common.sh@174 -- # LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:49.410 03:23:29 -- common/autotest_common.sh@177 -- # export PCI_BLOCK_SYNC_ON_RESET=yes 00:06:49.410 03:23:29 -- common/autotest_common.sh@177 -- # PCI_BLOCK_SYNC_ON_RESET=yes 00:06:49.410 03:23:29 -- common/autotest_common.sh@181 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:06:49.410 03:23:29 -- common/autotest_common.sh@181 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:06:49.410 03:23:29 -- common/autotest_common.sh@185 -- # export PYTHONDONTWRITEBYTECODE=1 00:06:49.410 03:23:29 -- common/autotest_common.sh@185 -- # PYTHONDONTWRITEBYTECODE=1 00:06:49.410 03:23:29 -- common/autotest_common.sh@189 -- # export ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:06:49.410 03:23:29 -- common/autotest_common.sh@189 -- # ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:06:49.410 03:23:29 -- common/autotest_common.sh@190 -- # export UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:06:49.410 03:23:29 -- common/autotest_common.sh@190 -- # UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:06:49.410 03:23:29 -- common/autotest_common.sh@194 -- # asan_suppression_file=/var/tmp/asan_suppression_file 00:06:49.410 03:23:29 -- common/autotest_common.sh@195 -- # rm -rf /var/tmp/asan_suppression_file 00:06:49.410 03:23:29 -- common/autotest_common.sh@196 -- # cat 00:06:49.410 03:23:29 -- common/autotest_common.sh@222 -- # echo leak:libfuse3.so 00:06:49.410 03:23:29 -- common/autotest_common.sh@224 -- # export LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:06:49.410 03:23:29 -- common/autotest_common.sh@224 -- # LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:06:49.410 03:23:29 -- common/autotest_common.sh@226 -- # export DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:06:49.410 03:23:29 -- common/autotest_common.sh@226 -- # DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:06:49.410 03:23:29 -- common/autotest_common.sh@228 -- # '[' -z /var/spdk/dependencies ']' 00:06:49.410 03:23:29 -- common/autotest_common.sh@231 -- # export DEPENDENCY_DIR 00:06:49.410 03:23:29 -- common/autotest_common.sh@235 -- # export SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:06:49.410 03:23:29 -- common/autotest_common.sh@235 -- # SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:06:49.410 03:23:29 -- common/autotest_common.sh@236 -- # export SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:06:49.410 03:23:29 -- common/autotest_common.sh@236 -- # SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:06:49.410 03:23:29 -- common/autotest_common.sh@239 -- # export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:06:49.410 03:23:29 -- common/autotest_common.sh@239 -- # QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:06:49.410 03:23:29 -- common/autotest_common.sh@240 -- # export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:06:49.410 03:23:29 -- common/autotest_common.sh@240 -- # VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:06:49.410 03:23:29 -- common/autotest_common.sh@242 -- # export AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:06:49.410 03:23:29 -- common/autotest_common.sh@242 -- # AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:06:49.410 03:23:29 -- common/autotest_common.sh@245 -- # export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:06:49.410 03:23:29 -- common/autotest_common.sh@245 -- # UNBIND_ENTIRE_IOMMU_GROUP=yes 00:06:49.410 03:23:29 -- common/autotest_common.sh@247 -- # _LCOV_MAIN=0 00:06:49.410 03:23:29 -- common/autotest_common.sh@248 -- # _LCOV_LLVM=1 00:06:49.410 03:23:29 -- common/autotest_common.sh@249 -- # _LCOV= 00:06:49.410 03:23:29 -- common/autotest_common.sh@250 -- # [[ '' == *clang* ]] 00:06:49.410 03:23:29 -- common/autotest_common.sh@250 -- # [[ 0 -eq 1 ]] 00:06:49.410 03:23:29 -- common/autotest_common.sh@252 -- # _lcov_opt[_LCOV_LLVM]='--gcov-tool /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/fuzz/llvm/llvm-gcov.sh' 00:06:49.410 03:23:29 -- common/autotest_common.sh@253 -- # _lcov_opt[_LCOV_MAIN]= 00:06:49.410 03:23:29 -- common/autotest_common.sh@255 -- # lcov_opt= 00:06:49.410 03:23:29 -- common/autotest_common.sh@258 -- # '[' 0 -eq 0 ']' 00:06:49.410 03:23:29 -- common/autotest_common.sh@259 -- # export valgrind= 00:06:49.410 03:23:29 -- common/autotest_common.sh@259 -- # valgrind= 00:06:49.410 03:23:29 -- common/autotest_common.sh@265 -- # uname -s 00:06:49.410 03:23:29 -- common/autotest_common.sh@265 -- # '[' Linux = Linux ']' 00:06:49.410 03:23:29 -- common/autotest_common.sh@266 -- # HUGEMEM=4096 00:06:49.410 03:23:29 -- common/autotest_common.sh@267 -- # export CLEAR_HUGE=yes 00:06:49.410 03:23:29 -- common/autotest_common.sh@267 -- # CLEAR_HUGE=yes 00:06:49.410 03:23:29 -- common/autotest_common.sh@268 -- # [[ 0 -eq 1 ]] 00:06:49.410 03:23:29 -- common/autotest_common.sh@268 -- # [[ 0 -eq 1 ]] 00:06:49.410 03:23:29 -- common/autotest_common.sh@275 -- # MAKE=make 00:06:49.410 03:23:29 -- common/autotest_common.sh@276 -- # MAKEFLAGS=-j48 00:06:49.410 03:23:29 -- common/autotest_common.sh@292 -- # export HUGEMEM=4096 00:06:49.410 03:23:29 -- common/autotest_common.sh@292 -- # HUGEMEM=4096 00:06:49.410 03:23:29 -- common/autotest_common.sh@294 -- # '[' -z /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output ']' 00:06:49.410 03:23:29 -- common/autotest_common.sh@299 -- # NO_HUGE=() 00:06:49.410 03:23:29 -- common/autotest_common.sh@300 -- # TEST_MODE= 00:06:49.410 03:23:29 -- common/autotest_common.sh@301 -- # for i in "$@" 00:06:49.410 03:23:29 -- common/autotest_common.sh@302 -- # case "$i" in 00:06:49.410 03:23:29 -- common/autotest_common.sh@307 -- # TEST_TRANSPORT=tcp 00:06:49.410 03:23:29 -- common/autotest_common.sh@319 -- # [[ -z 2951072 ]] 00:06:49.410 03:23:29 -- common/autotest_common.sh@319 -- # kill -0 2951072 00:06:49.410 03:23:29 -- common/autotest_common.sh@1675 -- # set_test_storage 2147483648 00:06:49.410 03:23:29 -- common/autotest_common.sh@329 -- # [[ -v testdir ]] 00:06:49.410 03:23:29 -- common/autotest_common.sh@331 -- # local requested_size=2147483648 00:06:49.410 03:23:29 -- common/autotest_common.sh@332 -- # local mount target_dir 00:06:49.410 03:23:29 -- common/autotest_common.sh@334 -- # local -A mounts fss sizes avails uses 00:06:49.410 03:23:29 -- common/autotest_common.sh@335 -- # local source fs size avail mount use 00:06:49.410 03:23:29 -- common/autotest_common.sh@337 -- # local storage_fallback storage_candidates 00:06:49.410 03:23:29 -- common/autotest_common.sh@339 -- # mktemp -udt spdk.XXXXXX 00:06:49.410 03:23:29 -- common/autotest_common.sh@339 -- # storage_fallback=/tmp/spdk.znDXa4 00:06:49.410 03:23:29 -- common/autotest_common.sh@344 -- # storage_candidates=("$testdir" "$storage_fallback/tests/${testdir##*/}" "$storage_fallback") 00:06:49.410 03:23:29 -- common/autotest_common.sh@346 -- # [[ -n '' ]] 00:06:49.410 03:23:29 -- common/autotest_common.sh@351 -- # [[ -n '' ]] 00:06:49.410 03:23:29 -- common/autotest_common.sh@356 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target /tmp/spdk.znDXa4/tests/target /tmp/spdk.znDXa4 00:06:49.410 03:23:29 -- common/autotest_common.sh@359 -- # requested_size=2214592512 00:06:49.410 03:23:29 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:49.410 03:23:29 -- common/autotest_common.sh@328 -- # df -T 00:06:49.410 03:23:29 -- common/autotest_common.sh@328 -- # grep -v Filesystem 00:06:49.410 03:23:29 -- common/autotest_common.sh@362 -- # mounts["$mount"]=spdk_devtmpfs 00:06:49.411 03:23:29 -- common/autotest_common.sh@362 -- # fss["$mount"]=devtmpfs 00:06:49.411 03:23:29 -- common/autotest_common.sh@363 -- # avails["$mount"]=67108864 00:06:49.411 03:23:29 -- common/autotest_common.sh@363 -- # sizes["$mount"]=67108864 00:06:49.411 03:23:29 -- common/autotest_common.sh@364 -- # uses["$mount"]=0 00:06:49.411 03:23:29 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:49.411 03:23:29 -- common/autotest_common.sh@362 -- # mounts["$mount"]=/dev/pmem0 00:06:49.411 03:23:29 -- common/autotest_common.sh@362 -- # fss["$mount"]=ext2 00:06:49.411 03:23:29 -- common/autotest_common.sh@363 -- # avails["$mount"]=4096 00:06:49.411 03:23:29 -- common/autotest_common.sh@363 -- # sizes["$mount"]=5284429824 00:06:49.411 03:23:29 -- common/autotest_common.sh@364 -- # uses["$mount"]=5284425728 00:06:49.411 03:23:29 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:49.411 03:23:29 -- common/autotest_common.sh@362 -- # mounts["$mount"]=spdk_root 00:06:49.411 03:23:29 -- common/autotest_common.sh@362 -- # fss["$mount"]=overlay 00:06:49.411 03:23:29 -- common/autotest_common.sh@363 -- # avails["$mount"]=55251898368 00:06:49.411 03:23:29 -- common/autotest_common.sh@363 -- # sizes["$mount"]=61988528128 00:06:49.411 03:23:29 -- common/autotest_common.sh@364 -- # uses["$mount"]=6736629760 00:06:49.411 03:23:29 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:49.411 03:23:29 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:06:49.411 03:23:29 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:06:49.411 03:23:29 -- common/autotest_common.sh@363 -- # avails["$mount"]=30991671296 00:06:49.411 03:23:29 -- common/autotest_common.sh@363 -- # sizes["$mount"]=30994264064 00:06:49.411 03:23:29 -- common/autotest_common.sh@364 -- # uses["$mount"]=2592768 00:06:49.411 03:23:29 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:49.411 03:23:29 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:06:49.411 03:23:29 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:06:49.411 03:23:29 -- common/autotest_common.sh@363 -- # avails["$mount"]=12388917248 00:06:49.411 03:23:29 -- common/autotest_common.sh@363 -- # sizes["$mount"]=12397707264 00:06:49.411 03:23:29 -- common/autotest_common.sh@364 -- # uses["$mount"]=8790016 00:06:49.411 03:23:29 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:49.411 03:23:29 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:06:49.411 03:23:29 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:06:49.411 03:23:29 -- common/autotest_common.sh@363 -- # avails["$mount"]=30993125376 00:06:49.411 03:23:29 -- common/autotest_common.sh@363 -- # sizes["$mount"]=30994264064 00:06:49.411 03:23:29 -- common/autotest_common.sh@364 -- # uses["$mount"]=1138688 00:06:49.411 03:23:29 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:49.411 03:23:29 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:06:49.411 03:23:29 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:06:49.411 03:23:29 -- common/autotest_common.sh@363 -- # avails["$mount"]=6198837248 00:06:49.411 03:23:29 -- common/autotest_common.sh@363 -- # sizes["$mount"]=6198849536 00:06:49.411 03:23:29 -- common/autotest_common.sh@364 -- # uses["$mount"]=12288 00:06:49.411 03:23:29 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:49.411 03:23:29 -- common/autotest_common.sh@367 -- # printf '* Looking for test storage...\n' 00:06:49.411 * Looking for test storage... 00:06:49.411 03:23:29 -- common/autotest_common.sh@369 -- # local target_space new_size 00:06:49.411 03:23:29 -- common/autotest_common.sh@370 -- # for target_dir in "${storage_candidates[@]}" 00:06:49.411 03:23:29 -- common/autotest_common.sh@373 -- # df /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:49.411 03:23:29 -- common/autotest_common.sh@373 -- # awk '$1 !~ /Filesystem/{print $6}' 00:06:49.411 03:23:29 -- common/autotest_common.sh@373 -- # mount=/ 00:06:49.411 03:23:29 -- common/autotest_common.sh@375 -- # target_space=55251898368 00:06:49.411 03:23:29 -- common/autotest_common.sh@376 -- # (( target_space == 0 || target_space < requested_size )) 00:06:49.411 03:23:29 -- common/autotest_common.sh@379 -- # (( target_space >= requested_size )) 00:06:49.411 03:23:29 -- common/autotest_common.sh@381 -- # [[ overlay == tmpfs ]] 00:06:49.411 03:23:29 -- common/autotest_common.sh@381 -- # [[ overlay == ramfs ]] 00:06:49.411 03:23:29 -- common/autotest_common.sh@381 -- # [[ / == / ]] 00:06:49.411 03:23:29 -- common/autotest_common.sh@382 -- # new_size=8951222272 00:06:49.411 03:23:29 -- common/autotest_common.sh@383 -- # (( new_size * 100 / sizes[/] > 95 )) 00:06:49.411 03:23:29 -- common/autotest_common.sh@388 -- # export SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:49.411 03:23:29 -- common/autotest_common.sh@388 -- # SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:49.411 03:23:29 -- common/autotest_common.sh@389 -- # printf '* Found test storage at %s\n' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:49.411 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:49.411 03:23:29 -- common/autotest_common.sh@390 -- # return 0 00:06:49.411 03:23:29 -- common/autotest_common.sh@1677 -- # set -o errtrace 00:06:49.411 03:23:29 -- common/autotest_common.sh@1678 -- # shopt -s extdebug 00:06:49.411 03:23:29 -- common/autotest_common.sh@1679 -- # trap 'trap - ERR; print_backtrace >&2' ERR 00:06:49.411 03:23:29 -- common/autotest_common.sh@1681 -- # PS4=' \t -- ${BASH_SOURCE#${BASH_SOURCE%/*/*}/}@${LINENO} -- \$ ' 00:06:49.411 03:23:29 -- common/autotest_common.sh@1682 -- # true 00:06:49.411 03:23:29 -- common/autotest_common.sh@1684 -- # xtrace_fd 00:06:49.411 03:23:29 -- common/autotest_common.sh@25 -- # [[ -n 14 ]] 00:06:49.411 03:23:29 -- common/autotest_common.sh@25 -- # [[ -e /proc/self/fd/14 ]] 00:06:49.411 03:23:29 -- common/autotest_common.sh@27 -- # exec 00:06:49.411 03:23:29 -- common/autotest_common.sh@29 -- # exec 00:06:49.411 03:23:29 -- common/autotest_common.sh@31 -- # xtrace_restore 00:06:49.411 03:23:29 -- common/autotest_common.sh@16 -- # unset -v 'X_STACK[0 - 1 < 0 ? 0 : 0 - 1]' 00:06:49.411 03:23:29 -- common/autotest_common.sh@17 -- # (( 0 == 0 )) 00:06:49.411 03:23:29 -- common/autotest_common.sh@18 -- # set -x 00:06:49.411 03:23:29 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:49.411 03:23:29 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:49.411 03:23:29 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:49.411 03:23:29 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:49.411 03:23:29 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:49.411 03:23:29 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:49.411 03:23:29 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:49.411 03:23:29 -- scripts/common.sh@335 -- # IFS=.-: 00:06:49.411 03:23:29 -- scripts/common.sh@335 -- # read -ra ver1 00:06:49.411 03:23:29 -- scripts/common.sh@336 -- # IFS=.-: 00:06:49.411 03:23:29 -- scripts/common.sh@336 -- # read -ra ver2 00:06:49.411 03:23:29 -- scripts/common.sh@337 -- # local 'op=<' 00:06:49.411 03:23:29 -- scripts/common.sh@339 -- # ver1_l=2 00:06:49.411 03:23:29 -- scripts/common.sh@340 -- # ver2_l=1 00:06:49.411 03:23:29 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:49.411 03:23:29 -- scripts/common.sh@343 -- # case "$op" in 00:06:49.411 03:23:29 -- scripts/common.sh@344 -- # : 1 00:06:49.411 03:23:29 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:49.411 03:23:29 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:49.411 03:23:29 -- scripts/common.sh@364 -- # decimal 1 00:06:49.411 03:23:29 -- scripts/common.sh@352 -- # local d=1 00:06:49.411 03:23:29 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:49.411 03:23:29 -- scripts/common.sh@354 -- # echo 1 00:06:49.411 03:23:29 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:49.411 03:23:29 -- scripts/common.sh@365 -- # decimal 2 00:06:49.411 03:23:29 -- scripts/common.sh@352 -- # local d=2 00:06:49.411 03:23:29 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:49.411 03:23:29 -- scripts/common.sh@354 -- # echo 2 00:06:49.411 03:23:29 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:49.411 03:23:29 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:49.411 03:23:29 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:49.411 03:23:29 -- scripts/common.sh@367 -- # return 0 00:06:49.411 03:23:29 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:49.411 03:23:29 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:49.411 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:49.411 --rc genhtml_branch_coverage=1 00:06:49.411 --rc genhtml_function_coverage=1 00:06:49.411 --rc genhtml_legend=1 00:06:49.411 --rc geninfo_all_blocks=1 00:06:49.411 --rc geninfo_unexecuted_blocks=1 00:06:49.411 00:06:49.411 ' 00:06:49.411 03:23:29 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:49.411 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:49.411 --rc genhtml_branch_coverage=1 00:06:49.411 --rc genhtml_function_coverage=1 00:06:49.411 --rc genhtml_legend=1 00:06:49.411 --rc geninfo_all_blocks=1 00:06:49.411 --rc geninfo_unexecuted_blocks=1 00:06:49.411 00:06:49.411 ' 00:06:49.411 03:23:29 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:49.411 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:49.411 --rc genhtml_branch_coverage=1 00:06:49.411 --rc genhtml_function_coverage=1 00:06:49.411 --rc genhtml_legend=1 00:06:49.411 --rc geninfo_all_blocks=1 00:06:49.411 --rc geninfo_unexecuted_blocks=1 00:06:49.411 00:06:49.411 ' 00:06:49.411 03:23:29 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:49.411 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:49.411 --rc genhtml_branch_coverage=1 00:06:49.411 --rc genhtml_function_coverage=1 00:06:49.411 --rc genhtml_legend=1 00:06:49.411 --rc geninfo_all_blocks=1 00:06:49.411 --rc geninfo_unexecuted_blocks=1 00:06:49.411 00:06:49.411 ' 00:06:49.411 03:23:29 -- target/filesystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:06:49.411 03:23:29 -- nvmf/common.sh@7 -- # uname -s 00:06:49.412 03:23:29 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:49.412 03:23:29 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:49.412 03:23:29 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:49.412 03:23:29 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:49.412 03:23:29 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:49.412 03:23:29 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:49.412 03:23:29 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:49.412 03:23:29 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:49.412 03:23:29 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:49.412 03:23:29 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:49.412 03:23:29 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:06:49.412 03:23:29 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:06:49.412 03:23:29 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:49.412 03:23:29 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:49.412 03:23:29 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:06:49.412 03:23:29 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:49.412 03:23:29 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:49.412 03:23:29 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:49.412 03:23:29 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:49.412 03:23:29 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:49.412 03:23:29 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:49.412 03:23:29 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:49.412 03:23:29 -- paths/export.sh@5 -- # export PATH 00:06:49.412 03:23:29 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:49.412 03:23:29 -- nvmf/common.sh@46 -- # : 0 00:06:49.412 03:23:29 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:06:49.412 03:23:29 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:06:49.412 03:23:29 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:06:49.412 03:23:29 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:49.412 03:23:29 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:49.412 03:23:29 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:06:49.412 03:23:29 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:06:49.412 03:23:29 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:06:49.412 03:23:29 -- target/filesystem.sh@12 -- # MALLOC_BDEV_SIZE=512 00:06:49.412 03:23:29 -- target/filesystem.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:06:49.412 03:23:29 -- target/filesystem.sh@15 -- # nvmftestinit 00:06:49.412 03:23:29 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:06:49.412 03:23:29 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:06:49.412 03:23:29 -- nvmf/common.sh@436 -- # prepare_net_devs 00:06:49.412 03:23:29 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:06:49.412 03:23:29 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:06:49.412 03:23:29 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:49.412 03:23:29 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:49.412 03:23:29 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:49.412 03:23:29 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:06:49.412 03:23:29 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:06:49.412 03:23:29 -- nvmf/common.sh@284 -- # xtrace_disable 00:06:49.412 03:23:29 -- common/autotest_common.sh@10 -- # set +x 00:06:51.335 03:23:31 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:06:51.335 03:23:31 -- nvmf/common.sh@290 -- # pci_devs=() 00:06:51.335 03:23:31 -- nvmf/common.sh@290 -- # local -a pci_devs 00:06:51.335 03:23:31 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:06:51.335 03:23:31 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:06:51.335 03:23:31 -- nvmf/common.sh@292 -- # pci_drivers=() 00:06:51.335 03:23:31 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:06:51.335 03:23:31 -- nvmf/common.sh@294 -- # net_devs=() 00:06:51.335 03:23:31 -- nvmf/common.sh@294 -- # local -ga net_devs 00:06:51.335 03:23:31 -- nvmf/common.sh@295 -- # e810=() 00:06:51.335 03:23:31 -- nvmf/common.sh@295 -- # local -ga e810 00:06:51.335 03:23:31 -- nvmf/common.sh@296 -- # x722=() 00:06:51.335 03:23:31 -- nvmf/common.sh@296 -- # local -ga x722 00:06:51.335 03:23:31 -- nvmf/common.sh@297 -- # mlx=() 00:06:51.335 03:23:31 -- nvmf/common.sh@297 -- # local -ga mlx 00:06:51.335 03:23:31 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:06:51.335 03:23:31 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:06:51.335 03:23:31 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:06:51.335 03:23:31 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:06:51.335 03:23:31 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:06:51.335 03:23:31 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:06:51.335 03:23:31 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:06:51.335 03:23:31 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:06:51.335 03:23:31 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:06:51.335 03:23:31 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:06:51.335 03:23:31 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:06:51.336 03:23:31 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:06:51.336 03:23:31 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:06:51.336 03:23:31 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:06:51.336 03:23:31 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:06:51.336 03:23:31 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:06:51.336 03:23:31 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:06:51.336 03:23:31 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:51.336 03:23:31 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:06:51.336 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:06:51.336 03:23:31 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:51.336 03:23:31 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:51.336 03:23:31 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:51.336 03:23:31 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:51.336 03:23:31 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:51.336 03:23:31 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:51.336 03:23:31 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:06:51.336 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:06:51.336 03:23:31 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:51.336 03:23:31 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:51.336 03:23:31 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:51.336 03:23:31 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:51.336 03:23:31 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:51.336 03:23:31 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:06:51.336 03:23:31 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:06:51.336 03:23:31 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:06:51.336 03:23:31 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:51.336 03:23:31 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:51.336 03:23:31 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:51.336 03:23:31 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:51.336 03:23:31 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:06:51.336 Found net devices under 0000:0a:00.0: cvl_0_0 00:06:51.336 03:23:31 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:51.336 03:23:31 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:51.336 03:23:31 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:51.336 03:23:31 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:51.336 03:23:31 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:51.336 03:23:31 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:06:51.336 Found net devices under 0000:0a:00.1: cvl_0_1 00:06:51.336 03:23:31 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:51.336 03:23:31 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:06:51.336 03:23:31 -- nvmf/common.sh@402 -- # is_hw=yes 00:06:51.336 03:23:31 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:06:51.336 03:23:31 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:06:51.336 03:23:31 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:06:51.336 03:23:31 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:06:51.336 03:23:31 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:06:51.336 03:23:31 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:06:51.336 03:23:31 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:06:51.336 03:23:31 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:06:51.336 03:23:31 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:06:51.336 03:23:31 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:06:51.336 03:23:31 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:06:51.336 03:23:31 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:06:51.336 03:23:31 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:06:51.336 03:23:31 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:06:51.336 03:23:31 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:06:51.336 03:23:31 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:06:51.595 03:23:32 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:06:51.595 03:23:32 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:06:51.595 03:23:32 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:06:51.595 03:23:32 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:06:51.595 03:23:32 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:06:51.595 03:23:32 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:06:51.595 03:23:32 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:06:51.595 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:06:51.595 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.346 ms 00:06:51.595 00:06:51.595 --- 10.0.0.2 ping statistics --- 00:06:51.595 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:51.595 rtt min/avg/max/mdev = 0.346/0.346/0.346/0.000 ms 00:06:51.595 03:23:32 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:06:51.595 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:06:51.595 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.183 ms 00:06:51.595 00:06:51.595 --- 10.0.0.1 ping statistics --- 00:06:51.595 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:51.595 rtt min/avg/max/mdev = 0.183/0.183/0.183/0.000 ms 00:06:51.595 03:23:32 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:06:51.595 03:23:32 -- nvmf/common.sh@410 -- # return 0 00:06:51.595 03:23:32 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:06:51.595 03:23:32 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:06:51.595 03:23:32 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:06:51.595 03:23:32 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:06:51.595 03:23:32 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:06:51.595 03:23:32 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:06:51.595 03:23:32 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:06:51.595 03:23:32 -- target/filesystem.sh@105 -- # run_test nvmf_filesystem_no_in_capsule nvmf_filesystem_part 0 00:06:51.595 03:23:32 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:51.595 03:23:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:51.595 03:23:32 -- common/autotest_common.sh@10 -- # set +x 00:06:51.595 ************************************ 00:06:51.595 START TEST nvmf_filesystem_no_in_capsule 00:06:51.595 ************************************ 00:06:51.595 03:23:32 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_part 0 00:06:51.595 03:23:32 -- target/filesystem.sh@47 -- # in_capsule=0 00:06:51.595 03:23:32 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:06:51.595 03:23:32 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:06:51.595 03:23:32 -- common/autotest_common.sh@722 -- # xtrace_disable 00:06:51.595 03:23:32 -- common/autotest_common.sh@10 -- # set +x 00:06:51.595 03:23:32 -- nvmf/common.sh@469 -- # nvmfpid=2952720 00:06:51.595 03:23:32 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:06:51.595 03:23:32 -- nvmf/common.sh@470 -- # waitforlisten 2952720 00:06:51.595 03:23:32 -- common/autotest_common.sh@829 -- # '[' -z 2952720 ']' 00:06:51.595 03:23:32 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:51.596 03:23:32 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:51.596 03:23:32 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:51.596 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:51.596 03:23:32 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:51.596 03:23:32 -- common/autotest_common.sh@10 -- # set +x 00:06:51.596 [2024-11-21 03:23:32.153494] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:51.596 [2024-11-21 03:23:32.153574] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:06:51.596 EAL: No free 2048 kB hugepages reported on node 1 00:06:51.596 [2024-11-21 03:23:32.220222] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:51.856 [2024-11-21 03:23:32.338898] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:51.856 [2024-11-21 03:23:32.339060] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:06:51.856 [2024-11-21 03:23:32.339088] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:06:51.856 [2024-11-21 03:23:32.339103] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:06:51.856 [2024-11-21 03:23:32.339165] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:51.856 [2024-11-21 03:23:32.339222] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:51.856 [2024-11-21 03:23:32.339245] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:51.856 [2024-11-21 03:23:32.339248] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:52.793 03:23:33 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:52.793 03:23:33 -- common/autotest_common.sh@862 -- # return 0 00:06:52.793 03:23:33 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:06:52.793 03:23:33 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:52.793 03:23:33 -- common/autotest_common.sh@10 -- # set +x 00:06:52.793 03:23:33 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:06:52.793 03:23:33 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:06:52.793 03:23:33 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:06:52.793 03:23:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:52.793 03:23:33 -- common/autotest_common.sh@10 -- # set +x 00:06:52.793 [2024-11-21 03:23:33.151879] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:06:52.793 03:23:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:52.793 03:23:33 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:06:52.793 03:23:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:52.793 03:23:33 -- common/autotest_common.sh@10 -- # set +x 00:06:52.793 Malloc1 00:06:52.793 03:23:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:52.793 03:23:33 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:06:52.793 03:23:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:52.793 03:23:33 -- common/autotest_common.sh@10 -- # set +x 00:06:52.793 03:23:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:52.793 03:23:33 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:06:52.793 03:23:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:52.793 03:23:33 -- common/autotest_common.sh@10 -- # set +x 00:06:52.793 03:23:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:52.793 03:23:33 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:06:52.793 03:23:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:52.793 03:23:33 -- common/autotest_common.sh@10 -- # set +x 00:06:52.793 [2024-11-21 03:23:33.321557] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:06:52.793 03:23:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:52.793 03:23:33 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:06:52.793 03:23:33 -- common/autotest_common.sh@1367 -- # local bdev_name=Malloc1 00:06:52.793 03:23:33 -- common/autotest_common.sh@1368 -- # local bdev_info 00:06:52.793 03:23:33 -- common/autotest_common.sh@1369 -- # local bs 00:06:52.793 03:23:33 -- common/autotest_common.sh@1370 -- # local nb 00:06:52.793 03:23:33 -- common/autotest_common.sh@1371 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:06:52.793 03:23:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:52.793 03:23:33 -- common/autotest_common.sh@10 -- # set +x 00:06:52.793 03:23:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:52.793 03:23:33 -- common/autotest_common.sh@1371 -- # bdev_info='[ 00:06:52.793 { 00:06:52.793 "name": "Malloc1", 00:06:52.793 "aliases": [ 00:06:52.793 "c2975d05-1174-43e6-9465-405fda58de72" 00:06:52.793 ], 00:06:52.793 "product_name": "Malloc disk", 00:06:52.793 "block_size": 512, 00:06:52.793 "num_blocks": 1048576, 00:06:52.793 "uuid": "c2975d05-1174-43e6-9465-405fda58de72", 00:06:52.793 "assigned_rate_limits": { 00:06:52.793 "rw_ios_per_sec": 0, 00:06:52.793 "rw_mbytes_per_sec": 0, 00:06:52.793 "r_mbytes_per_sec": 0, 00:06:52.793 "w_mbytes_per_sec": 0 00:06:52.793 }, 00:06:52.793 "claimed": true, 00:06:52.793 "claim_type": "exclusive_write", 00:06:52.793 "zoned": false, 00:06:52.793 "supported_io_types": { 00:06:52.793 "read": true, 00:06:52.793 "write": true, 00:06:52.793 "unmap": true, 00:06:52.793 "write_zeroes": true, 00:06:52.793 "flush": true, 00:06:52.793 "reset": true, 00:06:52.793 "compare": false, 00:06:52.793 "compare_and_write": false, 00:06:52.793 "abort": true, 00:06:52.793 "nvme_admin": false, 00:06:52.793 "nvme_io": false 00:06:52.793 }, 00:06:52.793 "memory_domains": [ 00:06:52.793 { 00:06:52.793 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:06:52.793 "dma_device_type": 2 00:06:52.793 } 00:06:52.793 ], 00:06:52.793 "driver_specific": {} 00:06:52.793 } 00:06:52.793 ]' 00:06:52.793 03:23:33 -- common/autotest_common.sh@1372 -- # jq '.[] .block_size' 00:06:52.793 03:23:33 -- common/autotest_common.sh@1372 -- # bs=512 00:06:52.793 03:23:33 -- common/autotest_common.sh@1373 -- # jq '.[] .num_blocks' 00:06:52.793 03:23:33 -- common/autotest_common.sh@1373 -- # nb=1048576 00:06:52.793 03:23:33 -- common/autotest_common.sh@1376 -- # bdev_size=512 00:06:52.793 03:23:33 -- common/autotest_common.sh@1377 -- # echo 512 00:06:52.793 03:23:33 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:06:52.793 03:23:33 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:06:53.731 03:23:34 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:06:53.731 03:23:34 -- common/autotest_common.sh@1187 -- # local i=0 00:06:53.731 03:23:34 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:06:53.731 03:23:34 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:06:53.731 03:23:34 -- common/autotest_common.sh@1194 -- # sleep 2 00:06:55.640 03:23:36 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:06:55.640 03:23:36 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:06:55.640 03:23:36 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:06:55.640 03:23:36 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:06:55.640 03:23:36 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:06:55.640 03:23:36 -- common/autotest_common.sh@1197 -- # return 0 00:06:55.640 03:23:36 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:06:55.640 03:23:36 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:06:55.640 03:23:36 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:06:55.640 03:23:36 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:06:55.640 03:23:36 -- setup/common.sh@76 -- # local dev=nvme0n1 00:06:55.640 03:23:36 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:06:55.640 03:23:36 -- setup/common.sh@80 -- # echo 536870912 00:06:55.640 03:23:36 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:06:55.640 03:23:36 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:06:55.640 03:23:36 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:06:55.640 03:23:36 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:06:55.900 03:23:36 -- target/filesystem.sh@69 -- # partprobe 00:06:56.468 03:23:37 -- target/filesystem.sh@70 -- # sleep 1 00:06:57.403 03:23:38 -- target/filesystem.sh@76 -- # '[' 0 -eq 0 ']' 00:06:57.403 03:23:38 -- target/filesystem.sh@77 -- # run_test filesystem_ext4 nvmf_filesystem_create ext4 nvme0n1 00:06:57.403 03:23:38 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:06:57.662 03:23:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:57.662 03:23:38 -- common/autotest_common.sh@10 -- # set +x 00:06:57.662 ************************************ 00:06:57.662 START TEST filesystem_ext4 00:06:57.662 ************************************ 00:06:57.662 03:23:38 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create ext4 nvme0n1 00:06:57.662 03:23:38 -- target/filesystem.sh@18 -- # fstype=ext4 00:06:57.662 03:23:38 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:06:57.662 03:23:38 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:06:57.662 03:23:38 -- common/autotest_common.sh@912 -- # local fstype=ext4 00:06:57.662 03:23:38 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:06:57.662 03:23:38 -- common/autotest_common.sh@914 -- # local i=0 00:06:57.662 03:23:38 -- common/autotest_common.sh@915 -- # local force 00:06:57.662 03:23:38 -- common/autotest_common.sh@917 -- # '[' ext4 = ext4 ']' 00:06:57.662 03:23:38 -- common/autotest_common.sh@918 -- # force=-F 00:06:57.662 03:23:38 -- common/autotest_common.sh@923 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:06:57.662 mke2fs 1.47.0 (5-Feb-2023) 00:06:57.662 Discarding device blocks: 0/522240 done 00:06:57.662 Creating filesystem with 522240 1k blocks and 130560 inodes 00:06:57.662 Filesystem UUID: 9725e30a-5081-42f1-8308-a419bb30f1c6 00:06:57.662 Superblock backups stored on blocks: 00:06:57.662 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:06:57.662 00:06:57.662 Allocating group tables: 0/64 done 00:06:57.662 Writing inode tables: 0/64 done 00:06:57.662 Creating journal (8192 blocks): done 00:06:57.662 Writing superblocks and filesystem accounting information: 0/64 done 00:06:57.662 00:06:57.662 03:23:38 -- common/autotest_common.sh@931 -- # return 0 00:06:57.662 03:23:38 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:02.935 03:23:43 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:03.194 03:23:43 -- target/filesystem.sh@25 -- # sync 00:07:03.194 03:23:43 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:03.194 03:23:43 -- target/filesystem.sh@27 -- # sync 00:07:03.194 03:23:43 -- target/filesystem.sh@29 -- # i=0 00:07:03.194 03:23:43 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:03.194 03:23:43 -- target/filesystem.sh@37 -- # kill -0 2952720 00:07:03.194 03:23:43 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:03.194 03:23:43 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:03.194 03:23:43 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:03.194 03:23:43 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:03.194 00:07:03.194 real 0m5.632s 00:07:03.194 user 0m0.028s 00:07:03.194 sys 0m0.056s 00:07:03.195 03:23:43 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:03.195 03:23:43 -- common/autotest_common.sh@10 -- # set +x 00:07:03.195 ************************************ 00:07:03.195 END TEST filesystem_ext4 00:07:03.195 ************************************ 00:07:03.195 03:23:43 -- target/filesystem.sh@78 -- # run_test filesystem_btrfs nvmf_filesystem_create btrfs nvme0n1 00:07:03.195 03:23:43 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:03.195 03:23:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:03.195 03:23:43 -- common/autotest_common.sh@10 -- # set +x 00:07:03.195 ************************************ 00:07:03.195 START TEST filesystem_btrfs 00:07:03.195 ************************************ 00:07:03.195 03:23:43 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create btrfs nvme0n1 00:07:03.195 03:23:43 -- target/filesystem.sh@18 -- # fstype=btrfs 00:07:03.195 03:23:43 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:03.195 03:23:43 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:07:03.195 03:23:43 -- common/autotest_common.sh@912 -- # local fstype=btrfs 00:07:03.195 03:23:43 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:03.195 03:23:43 -- common/autotest_common.sh@914 -- # local i=0 00:07:03.195 03:23:43 -- common/autotest_common.sh@915 -- # local force 00:07:03.195 03:23:43 -- common/autotest_common.sh@917 -- # '[' btrfs = ext4 ']' 00:07:03.195 03:23:43 -- common/autotest_common.sh@920 -- # force=-f 00:07:03.195 03:23:43 -- common/autotest_common.sh@923 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:07:03.453 btrfs-progs v6.8.1 00:07:03.453 See https://btrfs.readthedocs.io for more information. 00:07:03.453 00:07:03.453 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:07:03.453 NOTE: several default settings have changed in version 5.15, please make sure 00:07:03.453 this does not affect your deployments: 00:07:03.453 - DUP for metadata (-m dup) 00:07:03.453 - enabled no-holes (-O no-holes) 00:07:03.453 - enabled free-space-tree (-R free-space-tree) 00:07:03.453 00:07:03.453 Label: (null) 00:07:03.453 UUID: 7ec8b04c-0b8e-4c02-8efa-f63d1e5e3516 00:07:03.453 Node size: 16384 00:07:03.453 Sector size: 4096 (CPU page size: 4096) 00:07:03.453 Filesystem size: 510.00MiB 00:07:03.453 Block group profiles: 00:07:03.453 Data: single 8.00MiB 00:07:03.453 Metadata: DUP 32.00MiB 00:07:03.453 System: DUP 8.00MiB 00:07:03.453 SSD detected: yes 00:07:03.453 Zoned device: no 00:07:03.453 Features: extref, skinny-metadata, no-holes, free-space-tree 00:07:03.453 Checksum: crc32c 00:07:03.453 Number of devices: 1 00:07:03.453 Devices: 00:07:03.453 ID SIZE PATH 00:07:03.453 1 510.00MiB /dev/nvme0n1p1 00:07:03.453 00:07:03.453 03:23:43 -- common/autotest_common.sh@931 -- # return 0 00:07:03.453 03:23:43 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:04.391 03:23:44 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:04.391 03:23:44 -- target/filesystem.sh@25 -- # sync 00:07:04.391 03:23:44 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:04.391 03:23:44 -- target/filesystem.sh@27 -- # sync 00:07:04.391 03:23:44 -- target/filesystem.sh@29 -- # i=0 00:07:04.391 03:23:44 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:04.391 03:23:44 -- target/filesystem.sh@37 -- # kill -0 2952720 00:07:04.391 03:23:44 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:04.391 03:23:44 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:04.391 03:23:44 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:04.391 03:23:44 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:04.391 00:07:04.391 real 0m1.096s 00:07:04.391 user 0m0.028s 00:07:04.391 sys 0m0.097s 00:07:04.391 03:23:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:04.391 03:23:44 -- common/autotest_common.sh@10 -- # set +x 00:07:04.391 ************************************ 00:07:04.391 END TEST filesystem_btrfs 00:07:04.391 ************************************ 00:07:04.391 03:23:44 -- target/filesystem.sh@79 -- # run_test filesystem_xfs nvmf_filesystem_create xfs nvme0n1 00:07:04.391 03:23:44 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:04.392 03:23:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:04.392 03:23:44 -- common/autotest_common.sh@10 -- # set +x 00:07:04.392 ************************************ 00:07:04.392 START TEST filesystem_xfs 00:07:04.392 ************************************ 00:07:04.392 03:23:44 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create xfs nvme0n1 00:07:04.392 03:23:44 -- target/filesystem.sh@18 -- # fstype=xfs 00:07:04.392 03:23:44 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:04.392 03:23:44 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:07:04.392 03:23:44 -- common/autotest_common.sh@912 -- # local fstype=xfs 00:07:04.392 03:23:44 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:04.392 03:23:44 -- common/autotest_common.sh@914 -- # local i=0 00:07:04.392 03:23:44 -- common/autotest_common.sh@915 -- # local force 00:07:04.392 03:23:44 -- common/autotest_common.sh@917 -- # '[' xfs = ext4 ']' 00:07:04.392 03:23:44 -- common/autotest_common.sh@920 -- # force=-f 00:07:04.392 03:23:44 -- common/autotest_common.sh@923 -- # mkfs.xfs -f /dev/nvme0n1p1 00:07:04.392 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:07:04.392 = sectsz=512 attr=2, projid32bit=1 00:07:04.392 = crc=1 finobt=1, sparse=1, rmapbt=0 00:07:04.392 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:07:04.392 data = bsize=4096 blocks=130560, imaxpct=25 00:07:04.392 = sunit=0 swidth=0 blks 00:07:04.392 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:07:04.392 log =internal log bsize=4096 blocks=16384, version=2 00:07:04.392 = sectsz=512 sunit=0 blks, lazy-count=1 00:07:04.392 realtime =none extsz=4096 blocks=0, rtextents=0 00:07:05.329 Discarding blocks...Done. 00:07:05.329 03:23:45 -- common/autotest_common.sh@931 -- # return 0 00:07:05.330 03:23:45 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:07.237 03:23:47 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:07.237 03:23:47 -- target/filesystem.sh@25 -- # sync 00:07:07.237 03:23:47 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:07.237 03:23:47 -- target/filesystem.sh@27 -- # sync 00:07:07.237 03:23:47 -- target/filesystem.sh@29 -- # i=0 00:07:07.237 03:23:47 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:07.237 03:23:47 -- target/filesystem.sh@37 -- # kill -0 2952720 00:07:07.237 03:23:47 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:07.237 03:23:47 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:07.237 03:23:47 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:07.237 03:23:47 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:07.237 00:07:07.237 real 0m2.912s 00:07:07.237 user 0m0.023s 00:07:07.237 sys 0m0.053s 00:07:07.237 03:23:47 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:07.237 03:23:47 -- common/autotest_common.sh@10 -- # set +x 00:07:07.237 ************************************ 00:07:07.237 END TEST filesystem_xfs 00:07:07.237 ************************************ 00:07:07.237 03:23:47 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:07:07.237 03:23:47 -- target/filesystem.sh@93 -- # sync 00:07:07.237 03:23:47 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:07:07.497 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:07.497 03:23:47 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:07:07.497 03:23:47 -- common/autotest_common.sh@1208 -- # local i=0 00:07:07.497 03:23:47 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:07:07.497 03:23:47 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:07.497 03:23:47 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:07:07.497 03:23:47 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:07.497 03:23:47 -- common/autotest_common.sh@1220 -- # return 0 00:07:07.497 03:23:47 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:07:07.497 03:23:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:07.497 03:23:47 -- common/autotest_common.sh@10 -- # set +x 00:07:07.497 03:23:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:07.497 03:23:47 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:07:07.497 03:23:47 -- target/filesystem.sh@101 -- # killprocess 2952720 00:07:07.497 03:23:47 -- common/autotest_common.sh@936 -- # '[' -z 2952720 ']' 00:07:07.497 03:23:47 -- common/autotest_common.sh@940 -- # kill -0 2952720 00:07:07.497 03:23:47 -- common/autotest_common.sh@941 -- # uname 00:07:07.497 03:23:47 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:07.497 03:23:47 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2952720 00:07:07.497 03:23:47 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:07.497 03:23:47 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:07.497 03:23:47 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2952720' 00:07:07.497 killing process with pid 2952720 00:07:07.497 03:23:47 -- common/autotest_common.sh@955 -- # kill 2952720 00:07:07.497 03:23:47 -- common/autotest_common.sh@960 -- # wait 2952720 00:07:08.067 03:23:48 -- target/filesystem.sh@102 -- # nvmfpid= 00:07:08.067 00:07:08.067 real 0m16.342s 00:07:08.067 user 1m3.107s 00:07:08.067 sys 0m2.087s 00:07:08.067 03:23:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:08.067 03:23:48 -- common/autotest_common.sh@10 -- # set +x 00:07:08.067 ************************************ 00:07:08.067 END TEST nvmf_filesystem_no_in_capsule 00:07:08.067 ************************************ 00:07:08.067 03:23:48 -- target/filesystem.sh@106 -- # run_test nvmf_filesystem_in_capsule nvmf_filesystem_part 4096 00:07:08.067 03:23:48 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:08.067 03:23:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:08.067 03:23:48 -- common/autotest_common.sh@10 -- # set +x 00:07:08.067 ************************************ 00:07:08.067 START TEST nvmf_filesystem_in_capsule 00:07:08.067 ************************************ 00:07:08.067 03:23:48 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_part 4096 00:07:08.067 03:23:48 -- target/filesystem.sh@47 -- # in_capsule=4096 00:07:08.067 03:23:48 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:07:08.067 03:23:48 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:08.067 03:23:48 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:08.067 03:23:48 -- common/autotest_common.sh@10 -- # set +x 00:07:08.067 03:23:48 -- nvmf/common.sh@469 -- # nvmfpid=2954886 00:07:08.067 03:23:48 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:08.067 03:23:48 -- nvmf/common.sh@470 -- # waitforlisten 2954886 00:07:08.067 03:23:48 -- common/autotest_common.sh@829 -- # '[' -z 2954886 ']' 00:07:08.067 03:23:48 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:08.067 03:23:48 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:08.067 03:23:48 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:08.067 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:08.067 03:23:48 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:08.067 03:23:48 -- common/autotest_common.sh@10 -- # set +x 00:07:08.067 [2024-11-21 03:23:48.534162] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:08.067 [2024-11-21 03:23:48.534252] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:08.067 EAL: No free 2048 kB hugepages reported on node 1 00:07:08.067 [2024-11-21 03:23:48.598861] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:08.067 [2024-11-21 03:23:48.709357] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:08.067 [2024-11-21 03:23:48.709505] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:08.067 [2024-11-21 03:23:48.709522] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:08.067 [2024-11-21 03:23:48.709535] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:08.067 [2024-11-21 03:23:48.709596] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:08.067 [2024-11-21 03:23:48.709661] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:08.067 [2024-11-21 03:23:48.709707] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:08.067 [2024-11-21 03:23:48.709710] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:09.005 03:23:49 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:09.005 03:23:49 -- common/autotest_common.sh@862 -- # return 0 00:07:09.005 03:23:49 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:09.005 03:23:49 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:09.005 03:23:49 -- common/autotest_common.sh@10 -- # set +x 00:07:09.005 03:23:49 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:09.005 03:23:49 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:07:09.005 03:23:49 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 4096 00:07:09.005 03:23:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:09.005 03:23:49 -- common/autotest_common.sh@10 -- # set +x 00:07:09.005 [2024-11-21 03:23:49.584832] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:09.005 03:23:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:09.005 03:23:49 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:07:09.005 03:23:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:09.005 03:23:49 -- common/autotest_common.sh@10 -- # set +x 00:07:09.264 Malloc1 00:07:09.264 03:23:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:09.264 03:23:49 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:07:09.264 03:23:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:09.264 03:23:49 -- common/autotest_common.sh@10 -- # set +x 00:07:09.264 03:23:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:09.264 03:23:49 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:07:09.264 03:23:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:09.264 03:23:49 -- common/autotest_common.sh@10 -- # set +x 00:07:09.264 03:23:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:09.264 03:23:49 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:09.264 03:23:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:09.264 03:23:49 -- common/autotest_common.sh@10 -- # set +x 00:07:09.264 [2024-11-21 03:23:49.769615] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:07:09.264 03:23:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:09.264 03:23:49 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:07:09.264 03:23:49 -- common/autotest_common.sh@1367 -- # local bdev_name=Malloc1 00:07:09.264 03:23:49 -- common/autotest_common.sh@1368 -- # local bdev_info 00:07:09.264 03:23:49 -- common/autotest_common.sh@1369 -- # local bs 00:07:09.264 03:23:49 -- common/autotest_common.sh@1370 -- # local nb 00:07:09.265 03:23:49 -- common/autotest_common.sh@1371 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:07:09.265 03:23:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:09.265 03:23:49 -- common/autotest_common.sh@10 -- # set +x 00:07:09.265 03:23:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:09.265 03:23:49 -- common/autotest_common.sh@1371 -- # bdev_info='[ 00:07:09.265 { 00:07:09.265 "name": "Malloc1", 00:07:09.265 "aliases": [ 00:07:09.265 "cebf4f05-ffde-41fe-94ed-37ce3c311415" 00:07:09.265 ], 00:07:09.265 "product_name": "Malloc disk", 00:07:09.265 "block_size": 512, 00:07:09.265 "num_blocks": 1048576, 00:07:09.265 "uuid": "cebf4f05-ffde-41fe-94ed-37ce3c311415", 00:07:09.265 "assigned_rate_limits": { 00:07:09.265 "rw_ios_per_sec": 0, 00:07:09.265 "rw_mbytes_per_sec": 0, 00:07:09.265 "r_mbytes_per_sec": 0, 00:07:09.265 "w_mbytes_per_sec": 0 00:07:09.265 }, 00:07:09.265 "claimed": true, 00:07:09.265 "claim_type": "exclusive_write", 00:07:09.265 "zoned": false, 00:07:09.265 "supported_io_types": { 00:07:09.265 "read": true, 00:07:09.265 "write": true, 00:07:09.265 "unmap": true, 00:07:09.265 "write_zeroes": true, 00:07:09.265 "flush": true, 00:07:09.265 "reset": true, 00:07:09.265 "compare": false, 00:07:09.265 "compare_and_write": false, 00:07:09.265 "abort": true, 00:07:09.265 "nvme_admin": false, 00:07:09.265 "nvme_io": false 00:07:09.265 }, 00:07:09.265 "memory_domains": [ 00:07:09.265 { 00:07:09.265 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:07:09.265 "dma_device_type": 2 00:07:09.265 } 00:07:09.265 ], 00:07:09.265 "driver_specific": {} 00:07:09.265 } 00:07:09.265 ]' 00:07:09.265 03:23:49 -- common/autotest_common.sh@1372 -- # jq '.[] .block_size' 00:07:09.265 03:23:49 -- common/autotest_common.sh@1372 -- # bs=512 00:07:09.265 03:23:49 -- common/autotest_common.sh@1373 -- # jq '.[] .num_blocks' 00:07:09.265 03:23:49 -- common/autotest_common.sh@1373 -- # nb=1048576 00:07:09.265 03:23:49 -- common/autotest_common.sh@1376 -- # bdev_size=512 00:07:09.265 03:23:49 -- common/autotest_common.sh@1377 -- # echo 512 00:07:09.265 03:23:49 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:07:09.265 03:23:49 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:07:10.202 03:23:50 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:07:10.202 03:23:50 -- common/autotest_common.sh@1187 -- # local i=0 00:07:10.202 03:23:50 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:07:10.202 03:23:50 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:07:10.202 03:23:50 -- common/autotest_common.sh@1194 -- # sleep 2 00:07:12.110 03:23:52 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:07:12.111 03:23:52 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:07:12.111 03:23:52 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:07:12.111 03:23:52 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:07:12.111 03:23:52 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:07:12.111 03:23:52 -- common/autotest_common.sh@1197 -- # return 0 00:07:12.111 03:23:52 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:07:12.111 03:23:52 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:07:12.111 03:23:52 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:07:12.111 03:23:52 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:07:12.111 03:23:52 -- setup/common.sh@76 -- # local dev=nvme0n1 00:07:12.111 03:23:52 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:07:12.111 03:23:52 -- setup/common.sh@80 -- # echo 536870912 00:07:12.111 03:23:52 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:07:12.111 03:23:52 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:07:12.111 03:23:52 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:07:12.111 03:23:52 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:07:12.111 03:23:52 -- target/filesystem.sh@69 -- # partprobe 00:07:12.679 03:23:53 -- target/filesystem.sh@70 -- # sleep 1 00:07:13.621 03:23:54 -- target/filesystem.sh@76 -- # '[' 4096 -eq 0 ']' 00:07:13.621 03:23:54 -- target/filesystem.sh@81 -- # run_test filesystem_in_capsule_ext4 nvmf_filesystem_create ext4 nvme0n1 00:07:13.621 03:23:54 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:13.621 03:23:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:13.621 03:23:54 -- common/autotest_common.sh@10 -- # set +x 00:07:13.621 ************************************ 00:07:13.621 START TEST filesystem_in_capsule_ext4 00:07:13.621 ************************************ 00:07:13.621 03:23:54 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create ext4 nvme0n1 00:07:13.621 03:23:54 -- target/filesystem.sh@18 -- # fstype=ext4 00:07:13.621 03:23:54 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:13.621 03:23:54 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:07:13.621 03:23:54 -- common/autotest_common.sh@912 -- # local fstype=ext4 00:07:13.621 03:23:54 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:13.621 03:23:54 -- common/autotest_common.sh@914 -- # local i=0 00:07:13.621 03:23:54 -- common/autotest_common.sh@915 -- # local force 00:07:13.621 03:23:54 -- common/autotest_common.sh@917 -- # '[' ext4 = ext4 ']' 00:07:13.621 03:23:54 -- common/autotest_common.sh@918 -- # force=-F 00:07:13.621 03:23:54 -- common/autotest_common.sh@923 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:07:13.621 mke2fs 1.47.0 (5-Feb-2023) 00:07:13.621 Discarding device blocks: 0/522240 done 00:07:13.621 Creating filesystem with 522240 1k blocks and 130560 inodes 00:07:13.621 Filesystem UUID: 8d14bffb-47fb-4e1d-9656-0f635a518c43 00:07:13.621 Superblock backups stored on blocks: 00:07:13.621 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:07:13.621 00:07:13.621 Allocating group tables: 0/64 done 00:07:13.621 Writing inode tables: 0/64 done 00:07:13.880 Creating journal (8192 blocks): done 00:07:13.880 Writing superblocks and filesystem accounting information: 0/64 done 00:07:13.880 00:07:13.880 03:23:54 -- common/autotest_common.sh@931 -- # return 0 00:07:13.880 03:23:54 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:20.460 03:24:00 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:20.460 03:24:00 -- target/filesystem.sh@25 -- # sync 00:07:20.460 03:24:00 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:20.460 03:24:00 -- target/filesystem.sh@27 -- # sync 00:07:20.460 03:24:00 -- target/filesystem.sh@29 -- # i=0 00:07:20.460 03:24:00 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:20.460 03:24:00 -- target/filesystem.sh@37 -- # kill -0 2954886 00:07:20.460 03:24:00 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:20.460 03:24:00 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:20.460 03:24:00 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:20.460 03:24:00 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:20.460 00:07:20.460 real 0m6.267s 00:07:20.460 user 0m0.015s 00:07:20.460 sys 0m0.065s 00:07:20.460 03:24:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:20.460 03:24:00 -- common/autotest_common.sh@10 -- # set +x 00:07:20.460 ************************************ 00:07:20.460 END TEST filesystem_in_capsule_ext4 00:07:20.460 ************************************ 00:07:20.460 03:24:00 -- target/filesystem.sh@82 -- # run_test filesystem_in_capsule_btrfs nvmf_filesystem_create btrfs nvme0n1 00:07:20.460 03:24:00 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:20.460 03:24:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:20.460 03:24:00 -- common/autotest_common.sh@10 -- # set +x 00:07:20.460 ************************************ 00:07:20.460 START TEST filesystem_in_capsule_btrfs 00:07:20.460 ************************************ 00:07:20.460 03:24:00 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create btrfs nvme0n1 00:07:20.460 03:24:00 -- target/filesystem.sh@18 -- # fstype=btrfs 00:07:20.460 03:24:00 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:20.460 03:24:00 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:07:20.460 03:24:00 -- common/autotest_common.sh@912 -- # local fstype=btrfs 00:07:20.460 03:24:00 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:20.460 03:24:00 -- common/autotest_common.sh@914 -- # local i=0 00:07:20.460 03:24:00 -- common/autotest_common.sh@915 -- # local force 00:07:20.460 03:24:00 -- common/autotest_common.sh@917 -- # '[' btrfs = ext4 ']' 00:07:20.460 03:24:00 -- common/autotest_common.sh@920 -- # force=-f 00:07:20.460 03:24:00 -- common/autotest_common.sh@923 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:07:20.460 btrfs-progs v6.8.1 00:07:20.460 See https://btrfs.readthedocs.io for more information. 00:07:20.460 00:07:20.460 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:07:20.460 NOTE: several default settings have changed in version 5.15, please make sure 00:07:20.460 this does not affect your deployments: 00:07:20.460 - DUP for metadata (-m dup) 00:07:20.460 - enabled no-holes (-O no-holes) 00:07:20.460 - enabled free-space-tree (-R free-space-tree) 00:07:20.460 00:07:20.460 Label: (null) 00:07:20.460 UUID: 593d5a39-67f0-41e5-829e-ea9866ffc5a1 00:07:20.460 Node size: 16384 00:07:20.460 Sector size: 4096 (CPU page size: 4096) 00:07:20.460 Filesystem size: 510.00MiB 00:07:20.460 Block group profiles: 00:07:20.460 Data: single 8.00MiB 00:07:20.460 Metadata: DUP 32.00MiB 00:07:20.460 System: DUP 8.00MiB 00:07:20.460 SSD detected: yes 00:07:20.460 Zoned device: no 00:07:20.460 Features: extref, skinny-metadata, no-holes, free-space-tree 00:07:20.460 Checksum: crc32c 00:07:20.460 Number of devices: 1 00:07:20.460 Devices: 00:07:20.460 ID SIZE PATH 00:07:20.460 1 510.00MiB /dev/nvme0n1p1 00:07:20.460 00:07:20.460 03:24:00 -- common/autotest_common.sh@931 -- # return 0 00:07:20.460 03:24:00 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:20.460 03:24:00 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:20.460 03:24:00 -- target/filesystem.sh@25 -- # sync 00:07:20.460 03:24:00 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:20.460 03:24:00 -- target/filesystem.sh@27 -- # sync 00:07:20.460 03:24:00 -- target/filesystem.sh@29 -- # i=0 00:07:20.460 03:24:00 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:20.460 03:24:00 -- target/filesystem.sh@37 -- # kill -0 2954886 00:07:20.460 03:24:00 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:20.460 03:24:00 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:20.460 03:24:00 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:20.460 03:24:00 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:20.460 00:07:20.460 real 0m0.478s 00:07:20.460 user 0m0.016s 00:07:20.460 sys 0m0.093s 00:07:20.460 03:24:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:20.460 03:24:00 -- common/autotest_common.sh@10 -- # set +x 00:07:20.460 ************************************ 00:07:20.460 END TEST filesystem_in_capsule_btrfs 00:07:20.460 ************************************ 00:07:20.460 03:24:00 -- target/filesystem.sh@83 -- # run_test filesystem_in_capsule_xfs nvmf_filesystem_create xfs nvme0n1 00:07:20.460 03:24:00 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:20.460 03:24:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:20.460 03:24:00 -- common/autotest_common.sh@10 -- # set +x 00:07:20.460 ************************************ 00:07:20.460 START TEST filesystem_in_capsule_xfs 00:07:20.460 ************************************ 00:07:20.460 03:24:00 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create xfs nvme0n1 00:07:20.460 03:24:00 -- target/filesystem.sh@18 -- # fstype=xfs 00:07:20.460 03:24:00 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:20.460 03:24:00 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:07:20.460 03:24:00 -- common/autotest_common.sh@912 -- # local fstype=xfs 00:07:20.460 03:24:00 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:20.460 03:24:00 -- common/autotest_common.sh@914 -- # local i=0 00:07:20.460 03:24:00 -- common/autotest_common.sh@915 -- # local force 00:07:20.460 03:24:00 -- common/autotest_common.sh@917 -- # '[' xfs = ext4 ']' 00:07:20.460 03:24:00 -- common/autotest_common.sh@920 -- # force=-f 00:07:20.461 03:24:00 -- common/autotest_common.sh@923 -- # mkfs.xfs -f /dev/nvme0n1p1 00:07:20.461 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:07:20.461 = sectsz=512 attr=2, projid32bit=1 00:07:20.461 = crc=1 finobt=1, sparse=1, rmapbt=0 00:07:20.461 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:07:20.461 data = bsize=4096 blocks=130560, imaxpct=25 00:07:20.461 = sunit=0 swidth=0 blks 00:07:20.461 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:07:20.461 log =internal log bsize=4096 blocks=16384, version=2 00:07:20.461 = sectsz=512 sunit=0 blks, lazy-count=1 00:07:20.461 realtime =none extsz=4096 blocks=0, rtextents=0 00:07:21.398 Discarding blocks...Done. 00:07:21.398 03:24:01 -- common/autotest_common.sh@931 -- # return 0 00:07:21.398 03:24:01 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:23.934 03:24:04 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:23.934 03:24:04 -- target/filesystem.sh@25 -- # sync 00:07:23.934 03:24:04 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:23.934 03:24:04 -- target/filesystem.sh@27 -- # sync 00:07:23.934 03:24:04 -- target/filesystem.sh@29 -- # i=0 00:07:23.934 03:24:04 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:23.934 03:24:04 -- target/filesystem.sh@37 -- # kill -0 2954886 00:07:23.934 03:24:04 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:23.934 03:24:04 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:23.934 03:24:04 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:23.934 03:24:04 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:23.934 00:07:23.934 real 0m3.282s 00:07:23.934 user 0m0.020s 00:07:23.934 sys 0m0.056s 00:07:23.934 03:24:04 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:23.934 03:24:04 -- common/autotest_common.sh@10 -- # set +x 00:07:23.934 ************************************ 00:07:23.934 END TEST filesystem_in_capsule_xfs 00:07:23.934 ************************************ 00:07:23.934 03:24:04 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:07:23.934 03:24:04 -- target/filesystem.sh@93 -- # sync 00:07:23.934 03:24:04 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:07:23.934 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:23.934 03:24:04 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:07:23.934 03:24:04 -- common/autotest_common.sh@1208 -- # local i=0 00:07:23.934 03:24:04 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:07:23.934 03:24:04 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:23.934 03:24:04 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:07:23.934 03:24:04 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:23.934 03:24:04 -- common/autotest_common.sh@1220 -- # return 0 00:07:23.934 03:24:04 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:07:23.934 03:24:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:23.934 03:24:04 -- common/autotest_common.sh@10 -- # set +x 00:07:23.934 03:24:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:23.934 03:24:04 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:07:23.934 03:24:04 -- target/filesystem.sh@101 -- # killprocess 2954886 00:07:23.934 03:24:04 -- common/autotest_common.sh@936 -- # '[' -z 2954886 ']' 00:07:23.934 03:24:04 -- common/autotest_common.sh@940 -- # kill -0 2954886 00:07:23.934 03:24:04 -- common/autotest_common.sh@941 -- # uname 00:07:23.934 03:24:04 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:23.934 03:24:04 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2954886 00:07:23.934 03:24:04 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:23.934 03:24:04 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:23.934 03:24:04 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2954886' 00:07:23.934 killing process with pid 2954886 00:07:24.197 03:24:04 -- common/autotest_common.sh@955 -- # kill 2954886 00:07:24.197 03:24:04 -- common/autotest_common.sh@960 -- # wait 2954886 00:07:24.504 03:24:05 -- target/filesystem.sh@102 -- # nvmfpid= 00:07:24.504 00:07:24.504 real 0m16.584s 00:07:24.504 user 1m4.107s 00:07:24.504 sys 0m2.097s 00:07:24.504 03:24:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:24.504 03:24:05 -- common/autotest_common.sh@10 -- # set +x 00:07:24.504 ************************************ 00:07:24.504 END TEST nvmf_filesystem_in_capsule 00:07:24.504 ************************************ 00:07:24.504 03:24:05 -- target/filesystem.sh@108 -- # nvmftestfini 00:07:24.504 03:24:05 -- nvmf/common.sh@476 -- # nvmfcleanup 00:07:24.504 03:24:05 -- nvmf/common.sh@116 -- # sync 00:07:24.504 03:24:05 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:07:24.504 03:24:05 -- nvmf/common.sh@119 -- # set +e 00:07:24.504 03:24:05 -- nvmf/common.sh@120 -- # for i in {1..20} 00:07:24.504 03:24:05 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:07:24.504 rmmod nvme_tcp 00:07:24.504 rmmod nvme_fabrics 00:07:24.504 rmmod nvme_keyring 00:07:24.788 03:24:05 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:07:24.788 03:24:05 -- nvmf/common.sh@123 -- # set -e 00:07:24.789 03:24:05 -- nvmf/common.sh@124 -- # return 0 00:07:24.789 03:24:05 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:07:24.789 03:24:05 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:07:24.789 03:24:05 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:07:24.789 03:24:05 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:07:24.789 03:24:05 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:07:24.789 03:24:05 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:07:24.789 03:24:05 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:24.789 03:24:05 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:24.789 03:24:05 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:26.697 03:24:07 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:07:26.697 00:07:26.697 real 0m37.578s 00:07:26.697 user 2m8.235s 00:07:26.697 sys 0m5.824s 00:07:26.697 03:24:07 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:26.697 03:24:07 -- common/autotest_common.sh@10 -- # set +x 00:07:26.697 ************************************ 00:07:26.697 END TEST nvmf_filesystem 00:07:26.697 ************************************ 00:07:26.697 03:24:07 -- nvmf/nvmf.sh@25 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:07:26.697 03:24:07 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:26.697 03:24:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:26.697 03:24:07 -- common/autotest_common.sh@10 -- # set +x 00:07:26.697 ************************************ 00:07:26.697 START TEST nvmf_discovery 00:07:26.697 ************************************ 00:07:26.697 03:24:07 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:07:26.697 * Looking for test storage... 00:07:26.697 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:26.697 03:24:07 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:26.697 03:24:07 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:26.697 03:24:07 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:26.956 03:24:07 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:26.956 03:24:07 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:26.956 03:24:07 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:26.956 03:24:07 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:26.956 03:24:07 -- scripts/common.sh@335 -- # IFS=.-: 00:07:26.956 03:24:07 -- scripts/common.sh@335 -- # read -ra ver1 00:07:26.956 03:24:07 -- scripts/common.sh@336 -- # IFS=.-: 00:07:26.956 03:24:07 -- scripts/common.sh@336 -- # read -ra ver2 00:07:26.956 03:24:07 -- scripts/common.sh@337 -- # local 'op=<' 00:07:26.956 03:24:07 -- scripts/common.sh@339 -- # ver1_l=2 00:07:26.956 03:24:07 -- scripts/common.sh@340 -- # ver2_l=1 00:07:26.956 03:24:07 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:26.956 03:24:07 -- scripts/common.sh@343 -- # case "$op" in 00:07:26.956 03:24:07 -- scripts/common.sh@344 -- # : 1 00:07:26.956 03:24:07 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:26.956 03:24:07 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:26.956 03:24:07 -- scripts/common.sh@364 -- # decimal 1 00:07:26.956 03:24:07 -- scripts/common.sh@352 -- # local d=1 00:07:26.956 03:24:07 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:26.956 03:24:07 -- scripts/common.sh@354 -- # echo 1 00:07:26.956 03:24:07 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:26.956 03:24:07 -- scripts/common.sh@365 -- # decimal 2 00:07:26.956 03:24:07 -- scripts/common.sh@352 -- # local d=2 00:07:26.956 03:24:07 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:26.956 03:24:07 -- scripts/common.sh@354 -- # echo 2 00:07:26.956 03:24:07 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:26.956 03:24:07 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:26.956 03:24:07 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:26.956 03:24:07 -- scripts/common.sh@367 -- # return 0 00:07:26.956 03:24:07 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:26.956 03:24:07 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:26.956 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:26.956 --rc genhtml_branch_coverage=1 00:07:26.956 --rc genhtml_function_coverage=1 00:07:26.956 --rc genhtml_legend=1 00:07:26.956 --rc geninfo_all_blocks=1 00:07:26.956 --rc geninfo_unexecuted_blocks=1 00:07:26.956 00:07:26.956 ' 00:07:26.956 03:24:07 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:26.956 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:26.956 --rc genhtml_branch_coverage=1 00:07:26.956 --rc genhtml_function_coverage=1 00:07:26.956 --rc genhtml_legend=1 00:07:26.956 --rc geninfo_all_blocks=1 00:07:26.956 --rc geninfo_unexecuted_blocks=1 00:07:26.956 00:07:26.956 ' 00:07:26.956 03:24:07 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:26.956 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:26.956 --rc genhtml_branch_coverage=1 00:07:26.956 --rc genhtml_function_coverage=1 00:07:26.956 --rc genhtml_legend=1 00:07:26.956 --rc geninfo_all_blocks=1 00:07:26.956 --rc geninfo_unexecuted_blocks=1 00:07:26.956 00:07:26.956 ' 00:07:26.956 03:24:07 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:26.956 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:26.956 --rc genhtml_branch_coverage=1 00:07:26.956 --rc genhtml_function_coverage=1 00:07:26.956 --rc genhtml_legend=1 00:07:26.956 --rc geninfo_all_blocks=1 00:07:26.956 --rc geninfo_unexecuted_blocks=1 00:07:26.956 00:07:26.956 ' 00:07:26.956 03:24:07 -- target/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:26.956 03:24:07 -- nvmf/common.sh@7 -- # uname -s 00:07:26.956 03:24:07 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:26.956 03:24:07 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:26.956 03:24:07 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:26.956 03:24:07 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:26.956 03:24:07 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:26.956 03:24:07 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:26.956 03:24:07 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:26.956 03:24:07 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:26.956 03:24:07 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:26.956 03:24:07 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:26.956 03:24:07 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:26.956 03:24:07 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:26.956 03:24:07 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:26.956 03:24:07 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:26.956 03:24:07 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:26.956 03:24:07 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:26.956 03:24:07 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:26.956 03:24:07 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:26.956 03:24:07 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:26.956 03:24:07 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:26.956 03:24:07 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:26.956 03:24:07 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:26.956 03:24:07 -- paths/export.sh@5 -- # export PATH 00:07:26.956 03:24:07 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:26.956 03:24:07 -- nvmf/common.sh@46 -- # : 0 00:07:26.956 03:24:07 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:26.956 03:24:07 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:26.956 03:24:07 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:26.956 03:24:07 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:26.957 03:24:07 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:26.957 03:24:07 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:26.957 03:24:07 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:26.957 03:24:07 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:26.957 03:24:07 -- target/discovery.sh@11 -- # NULL_BDEV_SIZE=102400 00:07:26.957 03:24:07 -- target/discovery.sh@12 -- # NULL_BLOCK_SIZE=512 00:07:26.957 03:24:07 -- target/discovery.sh@13 -- # NVMF_PORT_REFERRAL=4430 00:07:26.957 03:24:07 -- target/discovery.sh@15 -- # hash nvme 00:07:26.957 03:24:07 -- target/discovery.sh@20 -- # nvmftestinit 00:07:26.957 03:24:07 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:07:26.957 03:24:07 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:26.957 03:24:07 -- nvmf/common.sh@436 -- # prepare_net_devs 00:07:26.957 03:24:07 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:07:26.957 03:24:07 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:07:26.957 03:24:07 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:26.957 03:24:07 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:26.957 03:24:07 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:26.957 03:24:07 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:07:26.957 03:24:07 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:07:26.957 03:24:07 -- nvmf/common.sh@284 -- # xtrace_disable 00:07:26.957 03:24:07 -- common/autotest_common.sh@10 -- # set +x 00:07:28.864 03:24:09 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:28.864 03:24:09 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:28.864 03:24:09 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:28.864 03:24:09 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:28.864 03:24:09 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:28.864 03:24:09 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:28.864 03:24:09 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:28.864 03:24:09 -- nvmf/common.sh@294 -- # net_devs=() 00:07:28.864 03:24:09 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:28.864 03:24:09 -- nvmf/common.sh@295 -- # e810=() 00:07:28.864 03:24:09 -- nvmf/common.sh@295 -- # local -ga e810 00:07:28.864 03:24:09 -- nvmf/common.sh@296 -- # x722=() 00:07:28.864 03:24:09 -- nvmf/common.sh@296 -- # local -ga x722 00:07:28.864 03:24:09 -- nvmf/common.sh@297 -- # mlx=() 00:07:28.864 03:24:09 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:28.864 03:24:09 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:28.864 03:24:09 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:28.864 03:24:09 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:28.864 03:24:09 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:28.864 03:24:09 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:28.864 03:24:09 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:28.864 03:24:09 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:28.864 03:24:09 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:28.864 03:24:09 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:28.864 03:24:09 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:28.864 03:24:09 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:28.864 03:24:09 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:28.864 03:24:09 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:28.864 03:24:09 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:28.864 03:24:09 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:28.864 03:24:09 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:28.864 03:24:09 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:28.864 03:24:09 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:28.864 03:24:09 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:07:28.864 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:07:28.864 03:24:09 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:28.864 03:24:09 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:28.864 03:24:09 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:28.864 03:24:09 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:28.864 03:24:09 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:28.864 03:24:09 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:28.864 03:24:09 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:07:28.864 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:07:28.864 03:24:09 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:28.864 03:24:09 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:28.864 03:24:09 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:28.864 03:24:09 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:28.864 03:24:09 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:28.864 03:24:09 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:28.864 03:24:09 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:28.864 03:24:09 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:28.864 03:24:09 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:28.864 03:24:09 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:28.864 03:24:09 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:28.864 03:24:09 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:28.864 03:24:09 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:07:28.864 Found net devices under 0000:0a:00.0: cvl_0_0 00:07:28.864 03:24:09 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:28.864 03:24:09 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:28.864 03:24:09 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:28.864 03:24:09 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:28.864 03:24:09 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:28.864 03:24:09 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:07:28.864 Found net devices under 0000:0a:00.1: cvl_0_1 00:07:28.864 03:24:09 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:28.864 03:24:09 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:28.864 03:24:09 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:28.864 03:24:09 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:28.864 03:24:09 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:28.864 03:24:09 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:28.864 03:24:09 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:28.864 03:24:09 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:28.864 03:24:09 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:28.864 03:24:09 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:28.864 03:24:09 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:28.864 03:24:09 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:28.864 03:24:09 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:28.864 03:24:09 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:28.864 03:24:09 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:28.864 03:24:09 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:28.864 03:24:09 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:28.864 03:24:09 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:28.864 03:24:09 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:29.123 03:24:09 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:29.123 03:24:09 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:29.123 03:24:09 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:29.123 03:24:09 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:29.123 03:24:09 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:29.123 03:24:09 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:29.123 03:24:09 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:29.123 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:29.123 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.218 ms 00:07:29.123 00:07:29.123 --- 10.0.0.2 ping statistics --- 00:07:29.123 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:29.123 rtt min/avg/max/mdev = 0.218/0.218/0.218/0.000 ms 00:07:29.123 03:24:09 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:29.123 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:29.123 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.075 ms 00:07:29.123 00:07:29.123 --- 10.0.0.1 ping statistics --- 00:07:29.123 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:29.123 rtt min/avg/max/mdev = 0.075/0.075/0.075/0.000 ms 00:07:29.123 03:24:09 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:29.123 03:24:09 -- nvmf/common.sh@410 -- # return 0 00:07:29.123 03:24:09 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:29.123 03:24:09 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:29.123 03:24:09 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:29.123 03:24:09 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:29.123 03:24:09 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:29.123 03:24:09 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:29.123 03:24:09 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:29.123 03:24:09 -- target/discovery.sh@21 -- # nvmfappstart -m 0xF 00:07:29.123 03:24:09 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:29.123 03:24:09 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:29.123 03:24:09 -- common/autotest_common.sh@10 -- # set +x 00:07:29.123 03:24:09 -- nvmf/common.sh@469 -- # nvmfpid=2959727 00:07:29.123 03:24:09 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:29.123 03:24:09 -- nvmf/common.sh@470 -- # waitforlisten 2959727 00:07:29.123 03:24:09 -- common/autotest_common.sh@829 -- # '[' -z 2959727 ']' 00:07:29.123 03:24:09 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:29.123 03:24:09 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:29.123 03:24:09 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:29.123 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:29.123 03:24:09 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:29.123 03:24:09 -- common/autotest_common.sh@10 -- # set +x 00:07:29.123 [2024-11-21 03:24:09.664416] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:29.123 [2024-11-21 03:24:09.664496] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:29.123 EAL: No free 2048 kB hugepages reported on node 1 00:07:29.123 [2024-11-21 03:24:09.733766] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:29.382 [2024-11-21 03:24:09.852199] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:29.383 [2024-11-21 03:24:09.852362] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:29.383 [2024-11-21 03:24:09.852388] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:29.383 [2024-11-21 03:24:09.852402] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:29.383 [2024-11-21 03:24:09.852500] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:29.383 [2024-11-21 03:24:09.852559] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:29.383 [2024-11-21 03:24:09.852594] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:29.383 [2024-11-21 03:24:09.852596] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:30.319 03:24:10 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:30.319 03:24:10 -- common/autotest_common.sh@862 -- # return 0 00:07:30.319 03:24:10 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:30.320 03:24:10 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:30.320 03:24:10 -- common/autotest_common.sh@10 -- # set +x 00:07:30.320 03:24:10 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:30.320 03:24:10 -- target/discovery.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:07:30.320 03:24:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:30.320 03:24:10 -- common/autotest_common.sh@10 -- # set +x 00:07:30.320 [2024-11-21 03:24:10.664644] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:30.320 03:24:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:30.320 03:24:10 -- target/discovery.sh@26 -- # seq 1 4 00:07:30.320 03:24:10 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:30.320 03:24:10 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null1 102400 512 00:07:30.320 03:24:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:30.320 03:24:10 -- common/autotest_common.sh@10 -- # set +x 00:07:30.320 Null1 00:07:30.320 03:24:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:30.320 03:24:10 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:07:30.320 03:24:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:30.320 03:24:10 -- common/autotest_common.sh@10 -- # set +x 00:07:30.320 03:24:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:30.320 03:24:10 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Null1 00:07:30.320 03:24:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:30.320 03:24:10 -- common/autotest_common.sh@10 -- # set +x 00:07:30.320 03:24:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:30.320 03:24:10 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:30.320 03:24:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:30.320 03:24:10 -- common/autotest_common.sh@10 -- # set +x 00:07:30.320 [2024-11-21 03:24:10.704924] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:07:30.320 03:24:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:30.320 03:24:10 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:30.320 03:24:10 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null2 102400 512 00:07:30.320 03:24:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:30.320 03:24:10 -- common/autotest_common.sh@10 -- # set +x 00:07:30.320 Null2 00:07:30.320 03:24:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:30.320 03:24:10 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:07:30.320 03:24:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:30.320 03:24:10 -- common/autotest_common.sh@10 -- # set +x 00:07:30.320 03:24:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:30.320 03:24:10 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Null2 00:07:30.320 03:24:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:30.320 03:24:10 -- common/autotest_common.sh@10 -- # set +x 00:07:30.320 03:24:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:30.320 03:24:10 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:07:30.320 03:24:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:30.320 03:24:10 -- common/autotest_common.sh@10 -- # set +x 00:07:30.320 03:24:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:30.320 03:24:10 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:30.320 03:24:10 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null3 102400 512 00:07:30.320 03:24:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:30.320 03:24:10 -- common/autotest_common.sh@10 -- # set +x 00:07:30.320 Null3 00:07:30.320 03:24:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:30.320 03:24:10 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000003 00:07:30.320 03:24:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:30.320 03:24:10 -- common/autotest_common.sh@10 -- # set +x 00:07:30.320 03:24:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:30.320 03:24:10 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Null3 00:07:30.320 03:24:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:30.320 03:24:10 -- common/autotest_common.sh@10 -- # set +x 00:07:30.320 03:24:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:30.320 03:24:10 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:07:30.320 03:24:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:30.320 03:24:10 -- common/autotest_common.sh@10 -- # set +x 00:07:30.320 03:24:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:30.320 03:24:10 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:30.320 03:24:10 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null4 102400 512 00:07:30.320 03:24:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:30.320 03:24:10 -- common/autotest_common.sh@10 -- # set +x 00:07:30.320 Null4 00:07:30.320 03:24:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:30.320 03:24:10 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK00000000000004 00:07:30.320 03:24:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:30.320 03:24:10 -- common/autotest_common.sh@10 -- # set +x 00:07:30.320 03:24:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:30.320 03:24:10 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Null4 00:07:30.320 03:24:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:30.320 03:24:10 -- common/autotest_common.sh@10 -- # set +x 00:07:30.320 03:24:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:30.320 03:24:10 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:07:30.320 03:24:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:30.320 03:24:10 -- common/autotest_common.sh@10 -- # set +x 00:07:30.320 03:24:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:30.320 03:24:10 -- target/discovery.sh@32 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:07:30.320 03:24:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:30.320 03:24:10 -- common/autotest_common.sh@10 -- # set +x 00:07:30.320 03:24:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:30.320 03:24:10 -- target/discovery.sh@35 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 10.0.0.2 -s 4430 00:07:30.320 03:24:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:30.320 03:24:10 -- common/autotest_common.sh@10 -- # set +x 00:07:30.320 03:24:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:30.320 03:24:10 -- target/discovery.sh@37 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 4420 00:07:30.579 00:07:30.579 Discovery Log Number of Records 6, Generation counter 6 00:07:30.579 =====Discovery Log Entry 0====== 00:07:30.579 trtype: tcp 00:07:30.579 adrfam: ipv4 00:07:30.579 subtype: current discovery subsystem 00:07:30.579 treq: not required 00:07:30.579 portid: 0 00:07:30.579 trsvcid: 4420 00:07:30.579 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:07:30.579 traddr: 10.0.0.2 00:07:30.579 eflags: explicit discovery connections, duplicate discovery information 00:07:30.579 sectype: none 00:07:30.579 =====Discovery Log Entry 1====== 00:07:30.579 trtype: tcp 00:07:30.579 adrfam: ipv4 00:07:30.579 subtype: nvme subsystem 00:07:30.579 treq: not required 00:07:30.579 portid: 0 00:07:30.579 trsvcid: 4420 00:07:30.579 subnqn: nqn.2016-06.io.spdk:cnode1 00:07:30.579 traddr: 10.0.0.2 00:07:30.579 eflags: none 00:07:30.579 sectype: none 00:07:30.579 =====Discovery Log Entry 2====== 00:07:30.579 trtype: tcp 00:07:30.579 adrfam: ipv4 00:07:30.579 subtype: nvme subsystem 00:07:30.579 treq: not required 00:07:30.579 portid: 0 00:07:30.579 trsvcid: 4420 00:07:30.579 subnqn: nqn.2016-06.io.spdk:cnode2 00:07:30.579 traddr: 10.0.0.2 00:07:30.579 eflags: none 00:07:30.579 sectype: none 00:07:30.579 =====Discovery Log Entry 3====== 00:07:30.579 trtype: tcp 00:07:30.579 adrfam: ipv4 00:07:30.579 subtype: nvme subsystem 00:07:30.579 treq: not required 00:07:30.579 portid: 0 00:07:30.579 trsvcid: 4420 00:07:30.579 subnqn: nqn.2016-06.io.spdk:cnode3 00:07:30.579 traddr: 10.0.0.2 00:07:30.579 eflags: none 00:07:30.579 sectype: none 00:07:30.579 =====Discovery Log Entry 4====== 00:07:30.579 trtype: tcp 00:07:30.579 adrfam: ipv4 00:07:30.579 subtype: nvme subsystem 00:07:30.579 treq: not required 00:07:30.579 portid: 0 00:07:30.579 trsvcid: 4420 00:07:30.579 subnqn: nqn.2016-06.io.spdk:cnode4 00:07:30.579 traddr: 10.0.0.2 00:07:30.579 eflags: none 00:07:30.579 sectype: none 00:07:30.579 =====Discovery Log Entry 5====== 00:07:30.579 trtype: tcp 00:07:30.579 adrfam: ipv4 00:07:30.579 subtype: discovery subsystem referral 00:07:30.579 treq: not required 00:07:30.579 portid: 0 00:07:30.579 trsvcid: 4430 00:07:30.579 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:07:30.579 traddr: 10.0.0.2 00:07:30.579 eflags: none 00:07:30.579 sectype: none 00:07:30.579 03:24:10 -- target/discovery.sh@39 -- # echo 'Perform nvmf subsystem discovery via RPC' 00:07:30.579 Perform nvmf subsystem discovery via RPC 00:07:30.579 03:24:10 -- target/discovery.sh@40 -- # rpc_cmd nvmf_get_subsystems 00:07:30.579 03:24:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:30.579 03:24:10 -- common/autotest_common.sh@10 -- # set +x 00:07:30.579 [2024-11-21 03:24:10.977653] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:07:30.579 [ 00:07:30.579 { 00:07:30.579 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:07:30.579 "subtype": "Discovery", 00:07:30.579 "listen_addresses": [ 00:07:30.579 { 00:07:30.579 "transport": "TCP", 00:07:30.579 "trtype": "TCP", 00:07:30.579 "adrfam": "IPv4", 00:07:30.579 "traddr": "10.0.0.2", 00:07:30.579 "trsvcid": "4420" 00:07:30.579 } 00:07:30.579 ], 00:07:30.579 "allow_any_host": true, 00:07:30.579 "hosts": [] 00:07:30.579 }, 00:07:30.579 { 00:07:30.579 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:07:30.579 "subtype": "NVMe", 00:07:30.579 "listen_addresses": [ 00:07:30.579 { 00:07:30.579 "transport": "TCP", 00:07:30.579 "trtype": "TCP", 00:07:30.579 "adrfam": "IPv4", 00:07:30.579 "traddr": "10.0.0.2", 00:07:30.579 "trsvcid": "4420" 00:07:30.579 } 00:07:30.579 ], 00:07:30.579 "allow_any_host": true, 00:07:30.579 "hosts": [], 00:07:30.579 "serial_number": "SPDK00000000000001", 00:07:30.579 "model_number": "SPDK bdev Controller", 00:07:30.579 "max_namespaces": 32, 00:07:30.579 "min_cntlid": 1, 00:07:30.579 "max_cntlid": 65519, 00:07:30.579 "namespaces": [ 00:07:30.579 { 00:07:30.579 "nsid": 1, 00:07:30.579 "bdev_name": "Null1", 00:07:30.579 "name": "Null1", 00:07:30.579 "nguid": "920508FD7CA8450FB38086E7422E7D35", 00:07:30.579 "uuid": "920508fd-7ca8-450f-b380-86e7422e7d35" 00:07:30.579 } 00:07:30.579 ] 00:07:30.579 }, 00:07:30.579 { 00:07:30.579 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:07:30.579 "subtype": "NVMe", 00:07:30.579 "listen_addresses": [ 00:07:30.579 { 00:07:30.579 "transport": "TCP", 00:07:30.579 "trtype": "TCP", 00:07:30.579 "adrfam": "IPv4", 00:07:30.579 "traddr": "10.0.0.2", 00:07:30.579 "trsvcid": "4420" 00:07:30.579 } 00:07:30.579 ], 00:07:30.579 "allow_any_host": true, 00:07:30.579 "hosts": [], 00:07:30.579 "serial_number": "SPDK00000000000002", 00:07:30.579 "model_number": "SPDK bdev Controller", 00:07:30.579 "max_namespaces": 32, 00:07:30.579 "min_cntlid": 1, 00:07:30.579 "max_cntlid": 65519, 00:07:30.579 "namespaces": [ 00:07:30.579 { 00:07:30.579 "nsid": 1, 00:07:30.579 "bdev_name": "Null2", 00:07:30.579 "name": "Null2", 00:07:30.579 "nguid": "238955E47A0040BDAE71D39F2A81F471", 00:07:30.579 "uuid": "238955e4-7a00-40bd-ae71-d39f2a81f471" 00:07:30.579 } 00:07:30.579 ] 00:07:30.579 }, 00:07:30.579 { 00:07:30.579 "nqn": "nqn.2016-06.io.spdk:cnode3", 00:07:30.579 "subtype": "NVMe", 00:07:30.579 "listen_addresses": [ 00:07:30.579 { 00:07:30.579 "transport": "TCP", 00:07:30.579 "trtype": "TCP", 00:07:30.579 "adrfam": "IPv4", 00:07:30.579 "traddr": "10.0.0.2", 00:07:30.579 "trsvcid": "4420" 00:07:30.579 } 00:07:30.579 ], 00:07:30.579 "allow_any_host": true, 00:07:30.579 "hosts": [], 00:07:30.579 "serial_number": "SPDK00000000000003", 00:07:30.579 "model_number": "SPDK bdev Controller", 00:07:30.579 "max_namespaces": 32, 00:07:30.579 "min_cntlid": 1, 00:07:30.580 "max_cntlid": 65519, 00:07:30.580 "namespaces": [ 00:07:30.580 { 00:07:30.580 "nsid": 1, 00:07:30.580 "bdev_name": "Null3", 00:07:30.580 "name": "Null3", 00:07:30.580 "nguid": "9E9DF3A415AB483EA280F983E690461F", 00:07:30.580 "uuid": "9e9df3a4-15ab-483e-a280-f983e690461f" 00:07:30.580 } 00:07:30.580 ] 00:07:30.580 }, 00:07:30.580 { 00:07:30.580 "nqn": "nqn.2016-06.io.spdk:cnode4", 00:07:30.580 "subtype": "NVMe", 00:07:30.580 "listen_addresses": [ 00:07:30.580 { 00:07:30.580 "transport": "TCP", 00:07:30.580 "trtype": "TCP", 00:07:30.580 "adrfam": "IPv4", 00:07:30.580 "traddr": "10.0.0.2", 00:07:30.580 "trsvcid": "4420" 00:07:30.580 } 00:07:30.580 ], 00:07:30.580 "allow_any_host": true, 00:07:30.580 "hosts": [], 00:07:30.580 "serial_number": "SPDK00000000000004", 00:07:30.580 "model_number": "SPDK bdev Controller", 00:07:30.580 "max_namespaces": 32, 00:07:30.580 "min_cntlid": 1, 00:07:30.580 "max_cntlid": 65519, 00:07:30.580 "namespaces": [ 00:07:30.580 { 00:07:30.580 "nsid": 1, 00:07:30.580 "bdev_name": "Null4", 00:07:30.580 "name": "Null4", 00:07:30.580 "nguid": "4BD1344160B34D67A90C0215302DA385", 00:07:30.580 "uuid": "4bd13441-60b3-4d67-a90c-0215302da385" 00:07:30.580 } 00:07:30.580 ] 00:07:30.580 } 00:07:30.580 ] 00:07:30.580 03:24:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:30.580 03:24:10 -- target/discovery.sh@42 -- # seq 1 4 00:07:30.580 03:24:10 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:30.580 03:24:10 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:07:30.580 03:24:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:30.580 03:24:10 -- common/autotest_common.sh@10 -- # set +x 00:07:30.580 03:24:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:30.580 03:24:11 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null1 00:07:30.580 03:24:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:30.580 03:24:11 -- common/autotest_common.sh@10 -- # set +x 00:07:30.580 03:24:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:30.580 03:24:11 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:30.580 03:24:11 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:07:30.580 03:24:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:30.580 03:24:11 -- common/autotest_common.sh@10 -- # set +x 00:07:30.580 03:24:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:30.580 03:24:11 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null2 00:07:30.580 03:24:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:30.580 03:24:11 -- common/autotest_common.sh@10 -- # set +x 00:07:30.580 03:24:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:30.580 03:24:11 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:30.580 03:24:11 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:07:30.580 03:24:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:30.580 03:24:11 -- common/autotest_common.sh@10 -- # set +x 00:07:30.580 03:24:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:30.580 03:24:11 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null3 00:07:30.580 03:24:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:30.580 03:24:11 -- common/autotest_common.sh@10 -- # set +x 00:07:30.580 03:24:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:30.580 03:24:11 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:30.580 03:24:11 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:07:30.580 03:24:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:30.580 03:24:11 -- common/autotest_common.sh@10 -- # set +x 00:07:30.580 03:24:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:30.580 03:24:11 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null4 00:07:30.580 03:24:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:30.580 03:24:11 -- common/autotest_common.sh@10 -- # set +x 00:07:30.580 03:24:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:30.580 03:24:11 -- target/discovery.sh@47 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 10.0.0.2 -s 4430 00:07:30.580 03:24:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:30.580 03:24:11 -- common/autotest_common.sh@10 -- # set +x 00:07:30.580 03:24:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:30.580 03:24:11 -- target/discovery.sh@49 -- # rpc_cmd bdev_get_bdevs 00:07:30.580 03:24:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:30.580 03:24:11 -- target/discovery.sh@49 -- # jq -r '.[].name' 00:07:30.580 03:24:11 -- common/autotest_common.sh@10 -- # set +x 00:07:30.580 03:24:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:30.580 03:24:11 -- target/discovery.sh@49 -- # check_bdevs= 00:07:30.580 03:24:11 -- target/discovery.sh@50 -- # '[' -n '' ']' 00:07:30.580 03:24:11 -- target/discovery.sh@55 -- # trap - SIGINT SIGTERM EXIT 00:07:30.580 03:24:11 -- target/discovery.sh@57 -- # nvmftestfini 00:07:30.580 03:24:11 -- nvmf/common.sh@476 -- # nvmfcleanup 00:07:30.580 03:24:11 -- nvmf/common.sh@116 -- # sync 00:07:30.580 03:24:11 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:07:30.580 03:24:11 -- nvmf/common.sh@119 -- # set +e 00:07:30.580 03:24:11 -- nvmf/common.sh@120 -- # for i in {1..20} 00:07:30.580 03:24:11 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:07:30.580 rmmod nvme_tcp 00:07:30.580 rmmod nvme_fabrics 00:07:30.580 rmmod nvme_keyring 00:07:30.580 03:24:11 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:07:30.580 03:24:11 -- nvmf/common.sh@123 -- # set -e 00:07:30.580 03:24:11 -- nvmf/common.sh@124 -- # return 0 00:07:30.580 03:24:11 -- nvmf/common.sh@477 -- # '[' -n 2959727 ']' 00:07:30.580 03:24:11 -- nvmf/common.sh@478 -- # killprocess 2959727 00:07:30.580 03:24:11 -- common/autotest_common.sh@936 -- # '[' -z 2959727 ']' 00:07:30.580 03:24:11 -- common/autotest_common.sh@940 -- # kill -0 2959727 00:07:30.580 03:24:11 -- common/autotest_common.sh@941 -- # uname 00:07:30.580 03:24:11 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:30.580 03:24:11 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2959727 00:07:30.580 03:24:11 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:30.580 03:24:11 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:30.580 03:24:11 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2959727' 00:07:30.580 killing process with pid 2959727 00:07:30.580 03:24:11 -- common/autotest_common.sh@955 -- # kill 2959727 00:07:30.580 [2024-11-21 03:24:11.203792] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:07:30.580 03:24:11 -- common/autotest_common.sh@960 -- # wait 2959727 00:07:30.840 03:24:11 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:07:30.840 03:24:11 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:07:30.840 03:24:11 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:07:30.840 03:24:11 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:07:30.840 03:24:11 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:07:30.840 03:24:11 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:30.840 03:24:11 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:30.840 03:24:11 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:33.378 03:24:13 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:07:33.378 00:07:33.378 real 0m6.311s 00:07:33.378 user 0m7.457s 00:07:33.378 sys 0m1.959s 00:07:33.378 03:24:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:33.378 03:24:13 -- common/autotest_common.sh@10 -- # set +x 00:07:33.378 ************************************ 00:07:33.378 END TEST nvmf_discovery 00:07:33.378 ************************************ 00:07:33.378 03:24:13 -- nvmf/nvmf.sh@26 -- # run_test nvmf_referrals /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:07:33.378 03:24:13 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:33.378 03:24:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:33.378 03:24:13 -- common/autotest_common.sh@10 -- # set +x 00:07:33.378 ************************************ 00:07:33.378 START TEST nvmf_referrals 00:07:33.378 ************************************ 00:07:33.378 03:24:13 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:07:33.378 * Looking for test storage... 00:07:33.378 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:33.378 03:24:13 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:33.378 03:24:13 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:33.378 03:24:13 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:33.378 03:24:13 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:33.378 03:24:13 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:33.378 03:24:13 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:33.378 03:24:13 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:33.378 03:24:13 -- scripts/common.sh@335 -- # IFS=.-: 00:07:33.378 03:24:13 -- scripts/common.sh@335 -- # read -ra ver1 00:07:33.378 03:24:13 -- scripts/common.sh@336 -- # IFS=.-: 00:07:33.378 03:24:13 -- scripts/common.sh@336 -- # read -ra ver2 00:07:33.378 03:24:13 -- scripts/common.sh@337 -- # local 'op=<' 00:07:33.378 03:24:13 -- scripts/common.sh@339 -- # ver1_l=2 00:07:33.378 03:24:13 -- scripts/common.sh@340 -- # ver2_l=1 00:07:33.378 03:24:13 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:33.378 03:24:13 -- scripts/common.sh@343 -- # case "$op" in 00:07:33.378 03:24:13 -- scripts/common.sh@344 -- # : 1 00:07:33.378 03:24:13 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:33.378 03:24:13 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:33.378 03:24:13 -- scripts/common.sh@364 -- # decimal 1 00:07:33.378 03:24:13 -- scripts/common.sh@352 -- # local d=1 00:07:33.378 03:24:13 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:33.378 03:24:13 -- scripts/common.sh@354 -- # echo 1 00:07:33.378 03:24:13 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:33.378 03:24:13 -- scripts/common.sh@365 -- # decimal 2 00:07:33.378 03:24:13 -- scripts/common.sh@352 -- # local d=2 00:07:33.378 03:24:13 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:33.378 03:24:13 -- scripts/common.sh@354 -- # echo 2 00:07:33.378 03:24:13 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:33.378 03:24:13 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:33.378 03:24:13 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:33.378 03:24:13 -- scripts/common.sh@367 -- # return 0 00:07:33.378 03:24:13 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:33.378 03:24:13 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:33.378 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:33.378 --rc genhtml_branch_coverage=1 00:07:33.378 --rc genhtml_function_coverage=1 00:07:33.378 --rc genhtml_legend=1 00:07:33.378 --rc geninfo_all_blocks=1 00:07:33.378 --rc geninfo_unexecuted_blocks=1 00:07:33.378 00:07:33.378 ' 00:07:33.378 03:24:13 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:33.378 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:33.378 --rc genhtml_branch_coverage=1 00:07:33.378 --rc genhtml_function_coverage=1 00:07:33.378 --rc genhtml_legend=1 00:07:33.378 --rc geninfo_all_blocks=1 00:07:33.378 --rc geninfo_unexecuted_blocks=1 00:07:33.378 00:07:33.378 ' 00:07:33.378 03:24:13 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:33.378 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:33.378 --rc genhtml_branch_coverage=1 00:07:33.378 --rc genhtml_function_coverage=1 00:07:33.378 --rc genhtml_legend=1 00:07:33.378 --rc geninfo_all_blocks=1 00:07:33.378 --rc geninfo_unexecuted_blocks=1 00:07:33.378 00:07:33.378 ' 00:07:33.378 03:24:13 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:33.378 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:33.378 --rc genhtml_branch_coverage=1 00:07:33.378 --rc genhtml_function_coverage=1 00:07:33.378 --rc genhtml_legend=1 00:07:33.378 --rc geninfo_all_blocks=1 00:07:33.378 --rc geninfo_unexecuted_blocks=1 00:07:33.378 00:07:33.378 ' 00:07:33.378 03:24:13 -- target/referrals.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:33.378 03:24:13 -- nvmf/common.sh@7 -- # uname -s 00:07:33.378 03:24:13 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:33.378 03:24:13 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:33.378 03:24:13 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:33.378 03:24:13 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:33.378 03:24:13 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:33.378 03:24:13 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:33.378 03:24:13 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:33.378 03:24:13 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:33.378 03:24:13 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:33.378 03:24:13 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:33.378 03:24:13 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:33.378 03:24:13 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:33.378 03:24:13 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:33.378 03:24:13 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:33.378 03:24:13 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:33.378 03:24:13 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:33.378 03:24:13 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:33.378 03:24:13 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:33.378 03:24:13 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:33.379 03:24:13 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:33.379 03:24:13 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:33.379 03:24:13 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:33.379 03:24:13 -- paths/export.sh@5 -- # export PATH 00:07:33.379 03:24:13 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:33.379 03:24:13 -- nvmf/common.sh@46 -- # : 0 00:07:33.379 03:24:13 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:33.379 03:24:13 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:33.379 03:24:13 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:33.379 03:24:13 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:33.379 03:24:13 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:33.379 03:24:13 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:33.379 03:24:13 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:33.379 03:24:13 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:33.379 03:24:13 -- target/referrals.sh@11 -- # NVMF_REFERRAL_IP_1=127.0.0.2 00:07:33.379 03:24:13 -- target/referrals.sh@12 -- # NVMF_REFERRAL_IP_2=127.0.0.3 00:07:33.379 03:24:13 -- target/referrals.sh@13 -- # NVMF_REFERRAL_IP_3=127.0.0.4 00:07:33.379 03:24:13 -- target/referrals.sh@14 -- # NVMF_PORT_REFERRAL=4430 00:07:33.379 03:24:13 -- target/referrals.sh@15 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:07:33.379 03:24:13 -- target/referrals.sh@16 -- # NQN=nqn.2016-06.io.spdk:cnode1 00:07:33.379 03:24:13 -- target/referrals.sh@37 -- # nvmftestinit 00:07:33.379 03:24:13 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:07:33.379 03:24:13 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:33.379 03:24:13 -- nvmf/common.sh@436 -- # prepare_net_devs 00:07:33.379 03:24:13 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:07:33.379 03:24:13 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:07:33.379 03:24:13 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:33.379 03:24:13 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:33.379 03:24:13 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:33.379 03:24:13 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:07:33.379 03:24:13 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:07:33.379 03:24:13 -- nvmf/common.sh@284 -- # xtrace_disable 00:07:33.379 03:24:13 -- common/autotest_common.sh@10 -- # set +x 00:07:35.363 03:24:15 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:35.363 03:24:15 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:35.363 03:24:15 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:35.363 03:24:15 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:35.363 03:24:15 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:35.363 03:24:15 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:35.363 03:24:15 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:35.363 03:24:15 -- nvmf/common.sh@294 -- # net_devs=() 00:07:35.363 03:24:15 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:35.363 03:24:15 -- nvmf/common.sh@295 -- # e810=() 00:07:35.363 03:24:15 -- nvmf/common.sh@295 -- # local -ga e810 00:07:35.363 03:24:15 -- nvmf/common.sh@296 -- # x722=() 00:07:35.363 03:24:15 -- nvmf/common.sh@296 -- # local -ga x722 00:07:35.363 03:24:15 -- nvmf/common.sh@297 -- # mlx=() 00:07:35.363 03:24:15 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:35.363 03:24:15 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:35.363 03:24:15 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:35.364 03:24:15 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:35.364 03:24:15 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:35.364 03:24:15 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:35.364 03:24:15 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:35.364 03:24:15 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:35.364 03:24:15 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:35.364 03:24:15 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:35.364 03:24:15 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:35.364 03:24:15 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:35.364 03:24:15 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:35.364 03:24:15 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:35.364 03:24:15 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:35.364 03:24:15 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:35.364 03:24:15 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:35.364 03:24:15 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:35.364 03:24:15 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:35.364 03:24:15 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:07:35.364 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:07:35.364 03:24:15 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:35.364 03:24:15 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:35.364 03:24:15 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:35.364 03:24:15 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:35.364 03:24:15 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:35.364 03:24:15 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:35.364 03:24:15 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:07:35.364 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:07:35.364 03:24:15 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:35.364 03:24:15 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:35.364 03:24:15 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:35.364 03:24:15 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:35.364 03:24:15 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:35.364 03:24:15 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:35.364 03:24:15 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:35.364 03:24:15 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:35.364 03:24:15 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:35.364 03:24:15 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:35.364 03:24:15 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:35.364 03:24:15 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:35.364 03:24:15 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:07:35.364 Found net devices under 0000:0a:00.0: cvl_0_0 00:07:35.364 03:24:15 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:35.364 03:24:15 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:35.364 03:24:15 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:35.364 03:24:15 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:35.364 03:24:15 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:35.364 03:24:15 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:07:35.364 Found net devices under 0000:0a:00.1: cvl_0_1 00:07:35.364 03:24:15 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:35.364 03:24:15 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:35.364 03:24:15 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:35.364 03:24:15 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:35.364 03:24:15 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:35.364 03:24:15 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:35.364 03:24:15 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:35.364 03:24:15 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:35.364 03:24:15 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:35.364 03:24:15 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:35.364 03:24:15 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:35.364 03:24:15 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:35.364 03:24:15 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:35.364 03:24:15 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:35.364 03:24:15 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:35.364 03:24:15 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:35.364 03:24:15 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:35.364 03:24:15 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:35.364 03:24:15 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:35.364 03:24:15 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:35.364 03:24:15 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:35.364 03:24:15 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:35.364 03:24:15 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:35.364 03:24:15 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:35.364 03:24:15 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:35.364 03:24:15 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:35.364 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:35.364 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.316 ms 00:07:35.364 00:07:35.364 --- 10.0.0.2 ping statistics --- 00:07:35.364 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:35.364 rtt min/avg/max/mdev = 0.316/0.316/0.316/0.000 ms 00:07:35.364 03:24:15 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:35.364 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:35.364 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.162 ms 00:07:35.364 00:07:35.364 --- 10.0.0.1 ping statistics --- 00:07:35.364 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:35.364 rtt min/avg/max/mdev = 0.162/0.162/0.162/0.000 ms 00:07:35.364 03:24:15 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:35.364 03:24:15 -- nvmf/common.sh@410 -- # return 0 00:07:35.364 03:24:15 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:35.364 03:24:15 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:35.364 03:24:15 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:35.364 03:24:15 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:35.364 03:24:15 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:35.364 03:24:15 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:35.364 03:24:15 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:35.364 03:24:15 -- target/referrals.sh@38 -- # nvmfappstart -m 0xF 00:07:35.364 03:24:15 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:35.364 03:24:15 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:35.364 03:24:15 -- common/autotest_common.sh@10 -- # set +x 00:07:35.364 03:24:15 -- nvmf/common.sh@469 -- # nvmfpid=2961854 00:07:35.364 03:24:15 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:35.364 03:24:15 -- nvmf/common.sh@470 -- # waitforlisten 2961854 00:07:35.364 03:24:15 -- common/autotest_common.sh@829 -- # '[' -z 2961854 ']' 00:07:35.364 03:24:15 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:35.364 03:24:15 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:35.364 03:24:15 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:35.364 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:35.364 03:24:15 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:35.364 03:24:15 -- common/autotest_common.sh@10 -- # set +x 00:07:35.364 [2024-11-21 03:24:15.995875] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:35.364 [2024-11-21 03:24:15.995967] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:35.623 EAL: No free 2048 kB hugepages reported on node 1 00:07:35.623 [2024-11-21 03:24:16.067453] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:35.623 [2024-11-21 03:24:16.177553] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:35.623 [2024-11-21 03:24:16.177705] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:35.623 [2024-11-21 03:24:16.177737] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:35.623 [2024-11-21 03:24:16.177749] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:35.623 [2024-11-21 03:24:16.177812] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:35.623 [2024-11-21 03:24:16.177885] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:35.623 [2024-11-21 03:24:16.177938] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:35.623 [2024-11-21 03:24:16.177941] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:36.557 03:24:16 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:36.557 03:24:16 -- common/autotest_common.sh@862 -- # return 0 00:07:36.557 03:24:16 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:36.557 03:24:17 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:36.557 03:24:17 -- common/autotest_common.sh@10 -- # set +x 00:07:36.557 03:24:17 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:36.557 03:24:17 -- target/referrals.sh@40 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:07:36.557 03:24:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:36.557 03:24:17 -- common/autotest_common.sh@10 -- # set +x 00:07:36.558 [2024-11-21 03:24:17.030766] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:36.558 03:24:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:36.558 03:24:17 -- target/referrals.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener -t tcp -a 10.0.0.2 -s 8009 discovery 00:07:36.558 03:24:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:36.558 03:24:17 -- common/autotest_common.sh@10 -- # set +x 00:07:36.558 [2024-11-21 03:24:17.042977] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:07:36.558 03:24:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:36.558 03:24:17 -- target/referrals.sh@44 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 00:07:36.558 03:24:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:36.558 03:24:17 -- common/autotest_common.sh@10 -- # set +x 00:07:36.558 03:24:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:36.558 03:24:17 -- target/referrals.sh@45 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.3 -s 4430 00:07:36.558 03:24:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:36.558 03:24:17 -- common/autotest_common.sh@10 -- # set +x 00:07:36.558 03:24:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:36.558 03:24:17 -- target/referrals.sh@46 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.4 -s 4430 00:07:36.558 03:24:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:36.558 03:24:17 -- common/autotest_common.sh@10 -- # set +x 00:07:36.558 03:24:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:36.558 03:24:17 -- target/referrals.sh@48 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:36.558 03:24:17 -- target/referrals.sh@48 -- # jq length 00:07:36.558 03:24:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:36.558 03:24:17 -- common/autotest_common.sh@10 -- # set +x 00:07:36.558 03:24:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:36.558 03:24:17 -- target/referrals.sh@48 -- # (( 3 == 3 )) 00:07:36.558 03:24:17 -- target/referrals.sh@49 -- # get_referral_ips rpc 00:07:36.558 03:24:17 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:07:36.558 03:24:17 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:36.558 03:24:17 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:07:36.558 03:24:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:36.558 03:24:17 -- common/autotest_common.sh@10 -- # set +x 00:07:36.558 03:24:17 -- target/referrals.sh@21 -- # sort 00:07:36.558 03:24:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:36.558 03:24:17 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:07:36.558 03:24:17 -- target/referrals.sh@49 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:07:36.558 03:24:17 -- target/referrals.sh@50 -- # get_referral_ips nvme 00:07:36.558 03:24:17 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:36.558 03:24:17 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:36.558 03:24:17 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:36.558 03:24:17 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:36.558 03:24:17 -- target/referrals.sh@26 -- # sort 00:07:36.816 03:24:17 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:07:36.816 03:24:17 -- target/referrals.sh@50 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:07:36.816 03:24:17 -- target/referrals.sh@52 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 00:07:36.816 03:24:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:36.816 03:24:17 -- common/autotest_common.sh@10 -- # set +x 00:07:36.816 03:24:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:36.816 03:24:17 -- target/referrals.sh@53 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.3 -s 4430 00:07:36.816 03:24:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:36.816 03:24:17 -- common/autotest_common.sh@10 -- # set +x 00:07:36.816 03:24:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:36.816 03:24:17 -- target/referrals.sh@54 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.4 -s 4430 00:07:36.816 03:24:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:36.816 03:24:17 -- common/autotest_common.sh@10 -- # set +x 00:07:36.816 03:24:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:36.816 03:24:17 -- target/referrals.sh@56 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:36.816 03:24:17 -- target/referrals.sh@56 -- # jq length 00:07:36.816 03:24:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:36.816 03:24:17 -- common/autotest_common.sh@10 -- # set +x 00:07:36.816 03:24:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:36.816 03:24:17 -- target/referrals.sh@56 -- # (( 0 == 0 )) 00:07:36.816 03:24:17 -- target/referrals.sh@57 -- # get_referral_ips nvme 00:07:36.816 03:24:17 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:36.816 03:24:17 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:36.816 03:24:17 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:36.817 03:24:17 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:36.817 03:24:17 -- target/referrals.sh@26 -- # sort 00:07:37.075 03:24:17 -- target/referrals.sh@26 -- # echo 00:07:37.075 03:24:17 -- target/referrals.sh@57 -- # [[ '' == '' ]] 00:07:37.075 03:24:17 -- target/referrals.sh@60 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n discovery 00:07:37.075 03:24:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:37.075 03:24:17 -- common/autotest_common.sh@10 -- # set +x 00:07:37.075 03:24:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:37.075 03:24:17 -- target/referrals.sh@62 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:07:37.075 03:24:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:37.075 03:24:17 -- common/autotest_common.sh@10 -- # set +x 00:07:37.075 03:24:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:37.075 03:24:17 -- target/referrals.sh@65 -- # get_referral_ips rpc 00:07:37.075 03:24:17 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:07:37.075 03:24:17 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:37.075 03:24:17 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:07:37.075 03:24:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:37.075 03:24:17 -- target/referrals.sh@21 -- # sort 00:07:37.075 03:24:17 -- common/autotest_common.sh@10 -- # set +x 00:07:37.075 03:24:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:37.075 03:24:17 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.2 00:07:37.075 03:24:17 -- target/referrals.sh@65 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:07:37.075 03:24:17 -- target/referrals.sh@66 -- # get_referral_ips nvme 00:07:37.075 03:24:17 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:37.075 03:24:17 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:37.075 03:24:17 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:37.075 03:24:17 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:37.075 03:24:17 -- target/referrals.sh@26 -- # sort 00:07:37.334 03:24:17 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.2 00:07:37.334 03:24:17 -- target/referrals.sh@66 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:07:37.334 03:24:17 -- target/referrals.sh@67 -- # get_discovery_entries 'nvme subsystem' 00:07:37.334 03:24:17 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:07:37.334 03:24:17 -- target/referrals.sh@67 -- # jq -r .subnqn 00:07:37.334 03:24:17 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:37.334 03:24:17 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:07:37.593 03:24:18 -- target/referrals.sh@67 -- # [[ nqn.2016-06.io.spdk:cnode1 == \n\q\n\.\2\0\1\6\-\0\6\.\i\o\.\s\p\d\k\:\c\n\o\d\e\1 ]] 00:07:37.593 03:24:18 -- target/referrals.sh@68 -- # get_discovery_entries 'discovery subsystem referral' 00:07:37.593 03:24:18 -- target/referrals.sh@68 -- # jq -r .subnqn 00:07:37.593 03:24:18 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:07:37.593 03:24:18 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:37.593 03:24:18 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:07:37.851 03:24:18 -- target/referrals.sh@68 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:07:37.851 03:24:18 -- target/referrals.sh@71 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:07:37.851 03:24:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:37.851 03:24:18 -- common/autotest_common.sh@10 -- # set +x 00:07:37.851 03:24:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:37.851 03:24:18 -- target/referrals.sh@73 -- # get_referral_ips rpc 00:07:37.851 03:24:18 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:07:37.851 03:24:18 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:37.851 03:24:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:37.851 03:24:18 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:07:37.851 03:24:18 -- common/autotest_common.sh@10 -- # set +x 00:07:37.851 03:24:18 -- target/referrals.sh@21 -- # sort 00:07:37.851 03:24:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:37.851 03:24:18 -- target/referrals.sh@21 -- # echo 127.0.0.2 00:07:37.851 03:24:18 -- target/referrals.sh@73 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:07:37.851 03:24:18 -- target/referrals.sh@74 -- # get_referral_ips nvme 00:07:37.851 03:24:18 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:37.851 03:24:18 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:37.851 03:24:18 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:37.851 03:24:18 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:37.851 03:24:18 -- target/referrals.sh@26 -- # sort 00:07:37.851 03:24:18 -- target/referrals.sh@26 -- # echo 127.0.0.2 00:07:37.851 03:24:18 -- target/referrals.sh@74 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:07:37.851 03:24:18 -- target/referrals.sh@75 -- # get_discovery_entries 'nvme subsystem' 00:07:37.851 03:24:18 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:07:37.851 03:24:18 -- target/referrals.sh@75 -- # jq -r .subnqn 00:07:37.851 03:24:18 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:37.851 03:24:18 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:07:38.111 03:24:18 -- target/referrals.sh@75 -- # [[ '' == '' ]] 00:07:38.111 03:24:18 -- target/referrals.sh@76 -- # get_discovery_entries 'discovery subsystem referral' 00:07:38.111 03:24:18 -- target/referrals.sh@76 -- # jq -r .subnqn 00:07:38.111 03:24:18 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:07:38.111 03:24:18 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:38.111 03:24:18 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:07:38.370 03:24:18 -- target/referrals.sh@76 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:07:38.370 03:24:18 -- target/referrals.sh@79 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2014-08.org.nvmexpress.discovery 00:07:38.370 03:24:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:38.370 03:24:18 -- common/autotest_common.sh@10 -- # set +x 00:07:38.370 03:24:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:38.370 03:24:18 -- target/referrals.sh@82 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:38.370 03:24:18 -- target/referrals.sh@82 -- # jq length 00:07:38.370 03:24:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:38.370 03:24:18 -- common/autotest_common.sh@10 -- # set +x 00:07:38.370 03:24:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:38.370 03:24:18 -- target/referrals.sh@82 -- # (( 0 == 0 )) 00:07:38.370 03:24:18 -- target/referrals.sh@83 -- # get_referral_ips nvme 00:07:38.370 03:24:18 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:38.370 03:24:18 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:38.370 03:24:18 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:38.370 03:24:18 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:38.370 03:24:18 -- target/referrals.sh@26 -- # sort 00:07:38.628 03:24:19 -- target/referrals.sh@26 -- # echo 00:07:38.628 03:24:19 -- target/referrals.sh@83 -- # [[ '' == '' ]] 00:07:38.628 03:24:19 -- target/referrals.sh@85 -- # trap - SIGINT SIGTERM EXIT 00:07:38.628 03:24:19 -- target/referrals.sh@86 -- # nvmftestfini 00:07:38.628 03:24:19 -- nvmf/common.sh@476 -- # nvmfcleanup 00:07:38.628 03:24:19 -- nvmf/common.sh@116 -- # sync 00:07:38.628 03:24:19 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:07:38.628 03:24:19 -- nvmf/common.sh@119 -- # set +e 00:07:38.628 03:24:19 -- nvmf/common.sh@120 -- # for i in {1..20} 00:07:38.628 03:24:19 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:07:38.628 rmmod nvme_tcp 00:07:38.628 rmmod nvme_fabrics 00:07:38.628 rmmod nvme_keyring 00:07:38.628 03:24:19 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:07:38.628 03:24:19 -- nvmf/common.sh@123 -- # set -e 00:07:38.628 03:24:19 -- nvmf/common.sh@124 -- # return 0 00:07:38.628 03:24:19 -- nvmf/common.sh@477 -- # '[' -n 2961854 ']' 00:07:38.628 03:24:19 -- nvmf/common.sh@478 -- # killprocess 2961854 00:07:38.628 03:24:19 -- common/autotest_common.sh@936 -- # '[' -z 2961854 ']' 00:07:38.628 03:24:19 -- common/autotest_common.sh@940 -- # kill -0 2961854 00:07:38.628 03:24:19 -- common/autotest_common.sh@941 -- # uname 00:07:38.628 03:24:19 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:38.628 03:24:19 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2961854 00:07:38.628 03:24:19 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:38.628 03:24:19 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:38.628 03:24:19 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2961854' 00:07:38.628 killing process with pid 2961854 00:07:38.628 03:24:19 -- common/autotest_common.sh@955 -- # kill 2961854 00:07:38.628 03:24:19 -- common/autotest_common.sh@960 -- # wait 2961854 00:07:38.886 03:24:19 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:07:38.886 03:24:19 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:07:38.886 03:24:19 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:07:38.886 03:24:19 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:07:38.886 03:24:19 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:07:38.886 03:24:19 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:38.886 03:24:19 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:38.886 03:24:19 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:41.425 03:24:21 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:07:41.425 00:07:41.425 real 0m7.957s 00:07:41.425 user 0m14.739s 00:07:41.425 sys 0m2.276s 00:07:41.425 03:24:21 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:41.425 03:24:21 -- common/autotest_common.sh@10 -- # set +x 00:07:41.425 ************************************ 00:07:41.425 END TEST nvmf_referrals 00:07:41.425 ************************************ 00:07:41.425 03:24:21 -- nvmf/nvmf.sh@27 -- # run_test nvmf_connect_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:07:41.425 03:24:21 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:41.425 03:24:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:41.425 03:24:21 -- common/autotest_common.sh@10 -- # set +x 00:07:41.425 ************************************ 00:07:41.425 START TEST nvmf_connect_disconnect 00:07:41.425 ************************************ 00:07:41.425 03:24:21 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:07:41.425 * Looking for test storage... 00:07:41.425 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:41.426 03:24:21 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:41.426 03:24:21 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:41.426 03:24:21 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:41.426 03:24:21 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:41.426 03:24:21 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:41.426 03:24:21 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:41.426 03:24:21 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:41.426 03:24:21 -- scripts/common.sh@335 -- # IFS=.-: 00:07:41.426 03:24:21 -- scripts/common.sh@335 -- # read -ra ver1 00:07:41.426 03:24:21 -- scripts/common.sh@336 -- # IFS=.-: 00:07:41.426 03:24:21 -- scripts/common.sh@336 -- # read -ra ver2 00:07:41.426 03:24:21 -- scripts/common.sh@337 -- # local 'op=<' 00:07:41.426 03:24:21 -- scripts/common.sh@339 -- # ver1_l=2 00:07:41.426 03:24:21 -- scripts/common.sh@340 -- # ver2_l=1 00:07:41.426 03:24:21 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:41.426 03:24:21 -- scripts/common.sh@343 -- # case "$op" in 00:07:41.426 03:24:21 -- scripts/common.sh@344 -- # : 1 00:07:41.426 03:24:21 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:41.426 03:24:21 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:41.426 03:24:21 -- scripts/common.sh@364 -- # decimal 1 00:07:41.426 03:24:21 -- scripts/common.sh@352 -- # local d=1 00:07:41.426 03:24:21 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:41.426 03:24:21 -- scripts/common.sh@354 -- # echo 1 00:07:41.426 03:24:21 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:41.426 03:24:21 -- scripts/common.sh@365 -- # decimal 2 00:07:41.426 03:24:21 -- scripts/common.sh@352 -- # local d=2 00:07:41.426 03:24:21 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:41.426 03:24:21 -- scripts/common.sh@354 -- # echo 2 00:07:41.426 03:24:21 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:41.426 03:24:21 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:41.426 03:24:21 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:41.426 03:24:21 -- scripts/common.sh@367 -- # return 0 00:07:41.426 03:24:21 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:41.426 03:24:21 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:41.426 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:41.426 --rc genhtml_branch_coverage=1 00:07:41.426 --rc genhtml_function_coverage=1 00:07:41.426 --rc genhtml_legend=1 00:07:41.426 --rc geninfo_all_blocks=1 00:07:41.426 --rc geninfo_unexecuted_blocks=1 00:07:41.426 00:07:41.426 ' 00:07:41.426 03:24:21 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:41.426 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:41.426 --rc genhtml_branch_coverage=1 00:07:41.426 --rc genhtml_function_coverage=1 00:07:41.426 --rc genhtml_legend=1 00:07:41.426 --rc geninfo_all_blocks=1 00:07:41.426 --rc geninfo_unexecuted_blocks=1 00:07:41.426 00:07:41.426 ' 00:07:41.426 03:24:21 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:41.426 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:41.426 --rc genhtml_branch_coverage=1 00:07:41.426 --rc genhtml_function_coverage=1 00:07:41.426 --rc genhtml_legend=1 00:07:41.426 --rc geninfo_all_blocks=1 00:07:41.426 --rc geninfo_unexecuted_blocks=1 00:07:41.426 00:07:41.426 ' 00:07:41.426 03:24:21 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:41.426 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:41.426 --rc genhtml_branch_coverage=1 00:07:41.426 --rc genhtml_function_coverage=1 00:07:41.426 --rc genhtml_legend=1 00:07:41.426 --rc geninfo_all_blocks=1 00:07:41.426 --rc geninfo_unexecuted_blocks=1 00:07:41.426 00:07:41.426 ' 00:07:41.426 03:24:21 -- target/connect_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:41.426 03:24:21 -- nvmf/common.sh@7 -- # uname -s 00:07:41.426 03:24:21 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:41.426 03:24:21 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:41.426 03:24:21 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:41.426 03:24:21 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:41.426 03:24:21 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:41.426 03:24:21 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:41.426 03:24:21 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:41.426 03:24:21 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:41.426 03:24:21 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:41.426 03:24:21 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:41.426 03:24:21 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:41.426 03:24:21 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:41.426 03:24:21 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:41.426 03:24:21 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:41.426 03:24:21 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:41.426 03:24:21 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:41.426 03:24:21 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:41.426 03:24:21 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:41.426 03:24:21 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:41.426 03:24:21 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:41.426 03:24:21 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:41.426 03:24:21 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:41.426 03:24:21 -- paths/export.sh@5 -- # export PATH 00:07:41.427 03:24:21 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:41.427 03:24:21 -- nvmf/common.sh@46 -- # : 0 00:07:41.427 03:24:21 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:41.427 03:24:21 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:41.427 03:24:21 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:41.427 03:24:21 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:41.427 03:24:21 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:41.427 03:24:21 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:41.427 03:24:21 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:41.427 03:24:21 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:41.427 03:24:21 -- target/connect_disconnect.sh@11 -- # MALLOC_BDEV_SIZE=64 00:07:41.427 03:24:21 -- target/connect_disconnect.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:07:41.427 03:24:21 -- target/connect_disconnect.sh@15 -- # nvmftestinit 00:07:41.427 03:24:21 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:07:41.427 03:24:21 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:41.427 03:24:21 -- nvmf/common.sh@436 -- # prepare_net_devs 00:07:41.427 03:24:21 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:07:41.427 03:24:21 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:07:41.427 03:24:21 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:41.427 03:24:21 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:41.427 03:24:21 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:41.427 03:24:21 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:07:41.427 03:24:21 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:07:41.427 03:24:21 -- nvmf/common.sh@284 -- # xtrace_disable 00:07:41.427 03:24:21 -- common/autotest_common.sh@10 -- # set +x 00:07:43.330 03:24:23 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:43.330 03:24:23 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:43.330 03:24:23 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:43.330 03:24:23 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:43.330 03:24:23 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:43.330 03:24:23 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:43.330 03:24:23 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:43.330 03:24:23 -- nvmf/common.sh@294 -- # net_devs=() 00:07:43.330 03:24:23 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:43.330 03:24:23 -- nvmf/common.sh@295 -- # e810=() 00:07:43.330 03:24:23 -- nvmf/common.sh@295 -- # local -ga e810 00:07:43.330 03:24:23 -- nvmf/common.sh@296 -- # x722=() 00:07:43.330 03:24:23 -- nvmf/common.sh@296 -- # local -ga x722 00:07:43.330 03:24:23 -- nvmf/common.sh@297 -- # mlx=() 00:07:43.330 03:24:23 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:43.330 03:24:23 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:43.330 03:24:23 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:43.330 03:24:23 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:43.330 03:24:23 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:43.330 03:24:23 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:43.330 03:24:23 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:43.330 03:24:23 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:43.330 03:24:23 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:43.330 03:24:23 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:43.330 03:24:23 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:43.330 03:24:23 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:43.330 03:24:23 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:43.330 03:24:23 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:43.330 03:24:23 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:43.330 03:24:23 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:43.330 03:24:23 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:43.330 03:24:23 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:43.330 03:24:23 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:43.330 03:24:23 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:07:43.330 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:07:43.330 03:24:23 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:43.330 03:24:23 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:43.330 03:24:23 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:43.330 03:24:23 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:43.330 03:24:23 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:43.330 03:24:23 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:43.330 03:24:23 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:07:43.330 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:07:43.330 03:24:23 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:43.330 03:24:23 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:43.330 03:24:23 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:43.330 03:24:23 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:43.330 03:24:23 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:43.330 03:24:23 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:43.330 03:24:23 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:43.331 03:24:23 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:43.331 03:24:23 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:43.331 03:24:23 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:43.331 03:24:23 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:43.331 03:24:23 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:43.331 03:24:23 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:07:43.331 Found net devices under 0000:0a:00.0: cvl_0_0 00:07:43.331 03:24:23 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:43.331 03:24:23 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:43.331 03:24:23 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:43.331 03:24:23 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:43.331 03:24:23 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:43.331 03:24:23 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:07:43.331 Found net devices under 0000:0a:00.1: cvl_0_1 00:07:43.331 03:24:23 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:43.331 03:24:23 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:43.331 03:24:23 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:43.331 03:24:23 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:43.331 03:24:23 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:43.331 03:24:23 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:43.331 03:24:23 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:43.331 03:24:23 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:43.331 03:24:23 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:43.331 03:24:23 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:43.331 03:24:23 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:43.331 03:24:23 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:43.331 03:24:23 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:43.331 03:24:23 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:43.331 03:24:23 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:43.331 03:24:23 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:43.331 03:24:23 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:43.331 03:24:23 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:43.331 03:24:23 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:43.331 03:24:23 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:43.331 03:24:23 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:43.331 03:24:23 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:43.331 03:24:23 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:43.331 03:24:23 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:43.331 03:24:23 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:43.331 03:24:23 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:43.331 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:43.331 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.218 ms 00:07:43.331 00:07:43.331 --- 10.0.0.2 ping statistics --- 00:07:43.331 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:43.331 rtt min/avg/max/mdev = 0.218/0.218/0.218/0.000 ms 00:07:43.331 03:24:23 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:43.331 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:43.331 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.115 ms 00:07:43.331 00:07:43.331 --- 10.0.0.1 ping statistics --- 00:07:43.331 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:43.331 rtt min/avg/max/mdev = 0.115/0.115/0.115/0.000 ms 00:07:43.331 03:24:23 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:43.331 03:24:23 -- nvmf/common.sh@410 -- # return 0 00:07:43.331 03:24:23 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:43.331 03:24:23 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:43.331 03:24:23 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:43.331 03:24:23 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:43.331 03:24:23 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:43.331 03:24:23 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:43.331 03:24:23 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:43.331 03:24:23 -- target/connect_disconnect.sh@16 -- # nvmfappstart -m 0xF 00:07:43.331 03:24:23 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:43.331 03:24:23 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:43.331 03:24:23 -- common/autotest_common.sh@10 -- # set +x 00:07:43.331 03:24:23 -- nvmf/common.sh@469 -- # nvmfpid=2964315 00:07:43.331 03:24:23 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:43.331 03:24:23 -- nvmf/common.sh@470 -- # waitforlisten 2964315 00:07:43.331 03:24:23 -- common/autotest_common.sh@829 -- # '[' -z 2964315 ']' 00:07:43.331 03:24:23 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:43.331 03:24:23 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:43.331 03:24:23 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:43.331 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:43.331 03:24:23 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:43.331 03:24:23 -- common/autotest_common.sh@10 -- # set +x 00:07:43.331 [2024-11-21 03:24:23.867884] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:43.331 [2024-11-21 03:24:23.867951] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:43.331 EAL: No free 2048 kB hugepages reported on node 1 00:07:43.331 [2024-11-21 03:24:23.932930] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:43.590 [2024-11-21 03:24:24.050494] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:43.590 [2024-11-21 03:24:24.050663] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:43.590 [2024-11-21 03:24:24.050682] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:43.590 [2024-11-21 03:24:24.050697] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:43.590 [2024-11-21 03:24:24.050754] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:43.590 [2024-11-21 03:24:24.050812] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:43.590 [2024-11-21 03:24:24.050835] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:43.590 [2024-11-21 03:24:24.050838] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:44.528 03:24:24 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:44.528 03:24:24 -- common/autotest_common.sh@862 -- # return 0 00:07:44.528 03:24:24 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:44.528 03:24:24 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:44.528 03:24:24 -- common/autotest_common.sh@10 -- # set +x 00:07:44.528 03:24:24 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:44.528 03:24:24 -- target/connect_disconnect.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:07:44.528 03:24:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:44.528 03:24:24 -- common/autotest_common.sh@10 -- # set +x 00:07:44.528 [2024-11-21 03:24:24.897769] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:44.528 03:24:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:44.528 03:24:24 -- target/connect_disconnect.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 00:07:44.528 03:24:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:44.528 03:24:24 -- common/autotest_common.sh@10 -- # set +x 00:07:44.528 03:24:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:44.528 03:24:24 -- target/connect_disconnect.sh@20 -- # bdev=Malloc0 00:07:44.528 03:24:24 -- target/connect_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:07:44.528 03:24:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:44.528 03:24:24 -- common/autotest_common.sh@10 -- # set +x 00:07:44.528 03:24:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:44.528 03:24:24 -- target/connect_disconnect.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:07:44.528 03:24:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:44.528 03:24:24 -- common/autotest_common.sh@10 -- # set +x 00:07:44.528 03:24:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:44.528 03:24:24 -- target/connect_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:44.528 03:24:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:44.528 03:24:24 -- common/autotest_common.sh@10 -- # set +x 00:07:44.528 [2024-11-21 03:24:24.950260] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:07:44.528 03:24:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:44.528 03:24:24 -- target/connect_disconnect.sh@26 -- # '[' 1 -eq 1 ']' 00:07:44.528 03:24:24 -- target/connect_disconnect.sh@27 -- # num_iterations=100 00:07:44.528 03:24:24 -- target/connect_disconnect.sh@29 -- # NVME_CONNECT='nvme connect -i 8' 00:07:44.528 03:24:24 -- target/connect_disconnect.sh@34 -- # set +x 00:07:47.058 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:48.967 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:51.511 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:53.417 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:55.958 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:58.490 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:00.401 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:02.944 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:04.850 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:07.389 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:09.925 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:11.834 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:14.373 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:16.908 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:18.810 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:21.350 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:23.260 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:25.802 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:28.342 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:30.251 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:32.794 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:34.702 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:37.249 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:39.786 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:41.835 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:44.369 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:46.274 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:48.813 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:51.345 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:53.250 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:55.786 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:57.693 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:00.232 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:02.765 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:04.670 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:07.209 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:09.749 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:11.657 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:14.242 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:16.172 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:18.719 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:21.261 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:23.170 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:25.706 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:28.238 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:30.144 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:32.679 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:34.587 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:37.126 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:39.662 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:42.203 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:44.107 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:46.642 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:49.179 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:51.083 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:53.620 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:56.157 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:58.695 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:00.602 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:03.211 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:05.145 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:07.683 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:10.224 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:12.129 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:14.667 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:17.206 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:19.113 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:21.643 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:24.174 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:26.076 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:28.614 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:30.519 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:33.056 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:35.589 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:37.495 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:40.029 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:42.555 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:44.495 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:47.052 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:48.948 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:51.475 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:54.003 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:55.902 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:58.429 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:00.954 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:02.853 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:05.378 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:07.273 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:09.798 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:12.334 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:14.240 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:16.796 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:19.337 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:21.244 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:23.778 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:26.313 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:28.217 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:30.815 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:32.721 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:35.257 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:35.257 03:28:15 -- target/connect_disconnect.sh@43 -- # trap - SIGINT SIGTERM EXIT 00:11:35.257 03:28:15 -- target/connect_disconnect.sh@45 -- # nvmftestfini 00:11:35.257 03:28:15 -- nvmf/common.sh@476 -- # nvmfcleanup 00:11:35.257 03:28:15 -- nvmf/common.sh@116 -- # sync 00:11:35.257 03:28:15 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:11:35.257 03:28:15 -- nvmf/common.sh@119 -- # set +e 00:11:35.257 03:28:15 -- nvmf/common.sh@120 -- # for i in {1..20} 00:11:35.257 03:28:15 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:11:35.257 rmmod nvme_tcp 00:11:35.257 rmmod nvme_fabrics 00:11:35.257 rmmod nvme_keyring 00:11:35.257 03:28:15 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:11:35.257 03:28:15 -- nvmf/common.sh@123 -- # set -e 00:11:35.257 03:28:15 -- nvmf/common.sh@124 -- # return 0 00:11:35.257 03:28:15 -- nvmf/common.sh@477 -- # '[' -n 2964315 ']' 00:11:35.257 03:28:15 -- nvmf/common.sh@478 -- # killprocess 2964315 00:11:35.257 03:28:15 -- common/autotest_common.sh@936 -- # '[' -z 2964315 ']' 00:11:35.257 03:28:15 -- common/autotest_common.sh@940 -- # kill -0 2964315 00:11:35.257 03:28:15 -- common/autotest_common.sh@941 -- # uname 00:11:35.257 03:28:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:11:35.257 03:28:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2964315 00:11:35.257 03:28:15 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:11:35.257 03:28:15 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:11:35.257 03:28:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2964315' 00:11:35.257 killing process with pid 2964315 00:11:35.257 03:28:15 -- common/autotest_common.sh@955 -- # kill 2964315 00:11:35.257 03:28:15 -- common/autotest_common.sh@960 -- # wait 2964315 00:11:35.515 03:28:15 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:11:35.515 03:28:15 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:11:35.515 03:28:15 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:11:35.515 03:28:15 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:11:35.515 03:28:15 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:11:35.515 03:28:15 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:35.515 03:28:15 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:35.515 03:28:15 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:37.421 03:28:18 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:11:37.421 00:11:37.421 real 3m56.462s 00:11:37.421 user 15m2.323s 00:11:37.421 sys 0m34.012s 00:11:37.421 03:28:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:11:37.421 03:28:18 -- common/autotest_common.sh@10 -- # set +x 00:11:37.421 ************************************ 00:11:37.421 END TEST nvmf_connect_disconnect 00:11:37.421 ************************************ 00:11:37.421 03:28:18 -- nvmf/nvmf.sh@28 -- # run_test nvmf_multitarget /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:11:37.421 03:28:18 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:11:37.421 03:28:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:11:37.421 03:28:18 -- common/autotest_common.sh@10 -- # set +x 00:11:37.421 ************************************ 00:11:37.421 START TEST nvmf_multitarget 00:11:37.421 ************************************ 00:11:37.421 03:28:18 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:11:37.680 * Looking for test storage... 00:11:37.680 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:11:37.680 03:28:18 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:11:37.680 03:28:18 -- common/autotest_common.sh@1690 -- # lcov --version 00:11:37.680 03:28:18 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:11:37.680 03:28:18 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:11:37.680 03:28:18 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:11:37.680 03:28:18 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:11:37.680 03:28:18 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:11:37.680 03:28:18 -- scripts/common.sh@335 -- # IFS=.-: 00:11:37.680 03:28:18 -- scripts/common.sh@335 -- # read -ra ver1 00:11:37.680 03:28:18 -- scripts/common.sh@336 -- # IFS=.-: 00:11:37.680 03:28:18 -- scripts/common.sh@336 -- # read -ra ver2 00:11:37.680 03:28:18 -- scripts/common.sh@337 -- # local 'op=<' 00:11:37.680 03:28:18 -- scripts/common.sh@339 -- # ver1_l=2 00:11:37.680 03:28:18 -- scripts/common.sh@340 -- # ver2_l=1 00:11:37.680 03:28:18 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:11:37.680 03:28:18 -- scripts/common.sh@343 -- # case "$op" in 00:11:37.680 03:28:18 -- scripts/common.sh@344 -- # : 1 00:11:37.680 03:28:18 -- scripts/common.sh@363 -- # (( v = 0 )) 00:11:37.680 03:28:18 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:11:37.680 03:28:18 -- scripts/common.sh@364 -- # decimal 1 00:11:37.680 03:28:18 -- scripts/common.sh@352 -- # local d=1 00:11:37.680 03:28:18 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:11:37.680 03:28:18 -- scripts/common.sh@354 -- # echo 1 00:11:37.680 03:28:18 -- scripts/common.sh@364 -- # ver1[v]=1 00:11:37.680 03:28:18 -- scripts/common.sh@365 -- # decimal 2 00:11:37.680 03:28:18 -- scripts/common.sh@352 -- # local d=2 00:11:37.680 03:28:18 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:11:37.680 03:28:18 -- scripts/common.sh@354 -- # echo 2 00:11:37.680 03:28:18 -- scripts/common.sh@365 -- # ver2[v]=2 00:11:37.680 03:28:18 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:11:37.680 03:28:18 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:11:37.680 03:28:18 -- scripts/common.sh@367 -- # return 0 00:11:37.681 03:28:18 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:11:37.681 03:28:18 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:11:37.681 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:37.681 --rc genhtml_branch_coverage=1 00:11:37.681 --rc genhtml_function_coverage=1 00:11:37.681 --rc genhtml_legend=1 00:11:37.681 --rc geninfo_all_blocks=1 00:11:37.681 --rc geninfo_unexecuted_blocks=1 00:11:37.681 00:11:37.681 ' 00:11:37.681 03:28:18 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:11:37.681 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:37.681 --rc genhtml_branch_coverage=1 00:11:37.681 --rc genhtml_function_coverage=1 00:11:37.681 --rc genhtml_legend=1 00:11:37.681 --rc geninfo_all_blocks=1 00:11:37.681 --rc geninfo_unexecuted_blocks=1 00:11:37.681 00:11:37.681 ' 00:11:37.681 03:28:18 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:11:37.681 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:37.681 --rc genhtml_branch_coverage=1 00:11:37.681 --rc genhtml_function_coverage=1 00:11:37.681 --rc genhtml_legend=1 00:11:37.681 --rc geninfo_all_blocks=1 00:11:37.681 --rc geninfo_unexecuted_blocks=1 00:11:37.681 00:11:37.681 ' 00:11:37.681 03:28:18 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:11:37.681 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:37.681 --rc genhtml_branch_coverage=1 00:11:37.681 --rc genhtml_function_coverage=1 00:11:37.681 --rc genhtml_legend=1 00:11:37.681 --rc geninfo_all_blocks=1 00:11:37.681 --rc geninfo_unexecuted_blocks=1 00:11:37.681 00:11:37.681 ' 00:11:37.681 03:28:18 -- target/multitarget.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:11:37.681 03:28:18 -- nvmf/common.sh@7 -- # uname -s 00:11:37.681 03:28:18 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:11:37.681 03:28:18 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:11:37.681 03:28:18 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:11:37.681 03:28:18 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:11:37.681 03:28:18 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:11:37.681 03:28:18 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:11:37.681 03:28:18 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:11:37.681 03:28:18 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:11:37.681 03:28:18 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:11:37.681 03:28:18 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:11:37.681 03:28:18 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:11:37.681 03:28:18 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:11:37.681 03:28:18 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:11:37.681 03:28:18 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:11:37.681 03:28:18 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:11:37.681 03:28:18 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:11:37.681 03:28:18 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:37.681 03:28:18 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:37.681 03:28:18 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:37.681 03:28:18 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:37.681 03:28:18 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:37.681 03:28:18 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:37.681 03:28:18 -- paths/export.sh@5 -- # export PATH 00:11:37.681 03:28:18 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:37.681 03:28:18 -- nvmf/common.sh@46 -- # : 0 00:11:37.681 03:28:18 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:11:37.681 03:28:18 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:11:37.681 03:28:18 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:11:37.681 03:28:18 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:11:37.681 03:28:18 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:11:37.681 03:28:18 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:11:37.681 03:28:18 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:11:37.681 03:28:18 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:11:37.681 03:28:18 -- target/multitarget.sh@13 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:11:37.681 03:28:18 -- target/multitarget.sh@15 -- # nvmftestinit 00:11:37.681 03:28:18 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:11:37.681 03:28:18 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:11:37.681 03:28:18 -- nvmf/common.sh@436 -- # prepare_net_devs 00:11:37.681 03:28:18 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:11:37.681 03:28:18 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:11:37.681 03:28:18 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:37.681 03:28:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:37.681 03:28:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:37.681 03:28:18 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:11:37.681 03:28:18 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:11:37.681 03:28:18 -- nvmf/common.sh@284 -- # xtrace_disable 00:11:37.681 03:28:18 -- common/autotest_common.sh@10 -- # set +x 00:11:40.218 03:28:20 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:11:40.218 03:28:20 -- nvmf/common.sh@290 -- # pci_devs=() 00:11:40.218 03:28:20 -- nvmf/common.sh@290 -- # local -a pci_devs 00:11:40.218 03:28:20 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:11:40.219 03:28:20 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:11:40.219 03:28:20 -- nvmf/common.sh@292 -- # pci_drivers=() 00:11:40.219 03:28:20 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:11:40.219 03:28:20 -- nvmf/common.sh@294 -- # net_devs=() 00:11:40.219 03:28:20 -- nvmf/common.sh@294 -- # local -ga net_devs 00:11:40.219 03:28:20 -- nvmf/common.sh@295 -- # e810=() 00:11:40.219 03:28:20 -- nvmf/common.sh@295 -- # local -ga e810 00:11:40.219 03:28:20 -- nvmf/common.sh@296 -- # x722=() 00:11:40.219 03:28:20 -- nvmf/common.sh@296 -- # local -ga x722 00:11:40.219 03:28:20 -- nvmf/common.sh@297 -- # mlx=() 00:11:40.219 03:28:20 -- nvmf/common.sh@297 -- # local -ga mlx 00:11:40.219 03:28:20 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:11:40.219 03:28:20 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:11:40.219 03:28:20 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:11:40.219 03:28:20 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:11:40.219 03:28:20 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:11:40.219 03:28:20 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:11:40.219 03:28:20 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:11:40.219 03:28:20 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:11:40.219 03:28:20 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:11:40.219 03:28:20 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:11:40.219 03:28:20 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:11:40.219 03:28:20 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:11:40.219 03:28:20 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:11:40.219 03:28:20 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:11:40.219 03:28:20 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:11:40.219 03:28:20 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:11:40.219 03:28:20 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:11:40.219 03:28:20 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:40.219 03:28:20 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:11:40.219 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:11:40.219 03:28:20 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:40.219 03:28:20 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:40.219 03:28:20 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:40.219 03:28:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:40.219 03:28:20 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:40.219 03:28:20 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:40.219 03:28:20 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:11:40.219 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:11:40.219 03:28:20 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:40.219 03:28:20 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:40.219 03:28:20 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:40.219 03:28:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:40.219 03:28:20 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:40.219 03:28:20 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:11:40.219 03:28:20 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:11:40.219 03:28:20 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:11:40.219 03:28:20 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:40.219 03:28:20 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:40.219 03:28:20 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:40.219 03:28:20 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:40.219 03:28:20 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:11:40.219 Found net devices under 0000:0a:00.0: cvl_0_0 00:11:40.219 03:28:20 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:40.219 03:28:20 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:40.219 03:28:20 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:40.219 03:28:20 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:40.219 03:28:20 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:40.219 03:28:20 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:11:40.219 Found net devices under 0000:0a:00.1: cvl_0_1 00:11:40.219 03:28:20 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:40.219 03:28:20 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:11:40.219 03:28:20 -- nvmf/common.sh@402 -- # is_hw=yes 00:11:40.219 03:28:20 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:11:40.219 03:28:20 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:11:40.219 03:28:20 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:11:40.219 03:28:20 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:11:40.219 03:28:20 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:11:40.219 03:28:20 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:11:40.219 03:28:20 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:11:40.219 03:28:20 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:11:40.219 03:28:20 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:11:40.219 03:28:20 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:11:40.219 03:28:20 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:11:40.219 03:28:20 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:11:40.219 03:28:20 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:11:40.219 03:28:20 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:11:40.219 03:28:20 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:11:40.219 03:28:20 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:11:40.219 03:28:20 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:11:40.219 03:28:20 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:11:40.219 03:28:20 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:11:40.219 03:28:20 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:11:40.219 03:28:20 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:11:40.219 03:28:20 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:11:40.219 03:28:20 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:11:40.219 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:11:40.219 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.171 ms 00:11:40.219 00:11:40.219 --- 10.0.0.2 ping statistics --- 00:11:40.219 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:40.219 rtt min/avg/max/mdev = 0.171/0.171/0.171/0.000 ms 00:11:40.219 03:28:20 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:11:40.219 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:11:40.219 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.077 ms 00:11:40.219 00:11:40.219 --- 10.0.0.1 ping statistics --- 00:11:40.219 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:40.219 rtt min/avg/max/mdev = 0.077/0.077/0.077/0.000 ms 00:11:40.219 03:28:20 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:11:40.219 03:28:20 -- nvmf/common.sh@410 -- # return 0 00:11:40.219 03:28:20 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:11:40.219 03:28:20 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:11:40.219 03:28:20 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:11:40.219 03:28:20 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:11:40.219 03:28:20 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:11:40.219 03:28:20 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:11:40.219 03:28:20 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:11:40.219 03:28:20 -- target/multitarget.sh@16 -- # nvmfappstart -m 0xF 00:11:40.219 03:28:20 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:11:40.219 03:28:20 -- common/autotest_common.sh@722 -- # xtrace_disable 00:11:40.219 03:28:20 -- common/autotest_common.sh@10 -- # set +x 00:11:40.219 03:28:20 -- nvmf/common.sh@469 -- # nvmfpid=2996314 00:11:40.219 03:28:20 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:11:40.219 03:28:20 -- nvmf/common.sh@470 -- # waitforlisten 2996314 00:11:40.219 03:28:20 -- common/autotest_common.sh@829 -- # '[' -z 2996314 ']' 00:11:40.219 03:28:20 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:11:40.219 03:28:20 -- common/autotest_common.sh@834 -- # local max_retries=100 00:11:40.219 03:28:20 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:11:40.219 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:11:40.219 03:28:20 -- common/autotest_common.sh@838 -- # xtrace_disable 00:11:40.219 03:28:20 -- common/autotest_common.sh@10 -- # set +x 00:11:40.219 [2024-11-21 03:28:20.490728] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:11:40.219 [2024-11-21 03:28:20.490801] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:11:40.219 EAL: No free 2048 kB hugepages reported on node 1 00:11:40.219 [2024-11-21 03:28:20.559300] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:11:40.219 [2024-11-21 03:28:20.677487] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:11:40.219 [2024-11-21 03:28:20.677647] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:11:40.219 [2024-11-21 03:28:20.677665] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:11:40.219 [2024-11-21 03:28:20.677678] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:11:40.219 [2024-11-21 03:28:20.677736] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:11:40.219 [2024-11-21 03:28:20.677793] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:11:40.219 [2024-11-21 03:28:20.677845] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:11:40.220 [2024-11-21 03:28:20.677848] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:11:41.156 03:28:21 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:11:41.156 03:28:21 -- common/autotest_common.sh@862 -- # return 0 00:11:41.156 03:28:21 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:11:41.156 03:28:21 -- common/autotest_common.sh@728 -- # xtrace_disable 00:11:41.156 03:28:21 -- common/autotest_common.sh@10 -- # set +x 00:11:41.156 03:28:21 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:11:41.156 03:28:21 -- target/multitarget.sh@18 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:11:41.156 03:28:21 -- target/multitarget.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:11:41.156 03:28:21 -- target/multitarget.sh@21 -- # jq length 00:11:41.156 03:28:21 -- target/multitarget.sh@21 -- # '[' 1 '!=' 1 ']' 00:11:41.156 03:28:21 -- target/multitarget.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_1 -s 32 00:11:41.156 "nvmf_tgt_1" 00:11:41.156 03:28:21 -- target/multitarget.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_2 -s 32 00:11:41.413 "nvmf_tgt_2" 00:11:41.413 03:28:21 -- target/multitarget.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:11:41.413 03:28:21 -- target/multitarget.sh@28 -- # jq length 00:11:41.413 03:28:21 -- target/multitarget.sh@28 -- # '[' 3 '!=' 3 ']' 00:11:41.413 03:28:21 -- target/multitarget.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_1 00:11:41.672 true 00:11:41.672 03:28:22 -- target/multitarget.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_2 00:11:41.672 true 00:11:41.672 03:28:22 -- target/multitarget.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:11:41.672 03:28:22 -- target/multitarget.sh@35 -- # jq length 00:11:41.672 03:28:22 -- target/multitarget.sh@35 -- # '[' 1 '!=' 1 ']' 00:11:41.672 03:28:22 -- target/multitarget.sh@39 -- # trap - SIGINT SIGTERM EXIT 00:11:41.672 03:28:22 -- target/multitarget.sh@41 -- # nvmftestfini 00:11:41.672 03:28:22 -- nvmf/common.sh@476 -- # nvmfcleanup 00:11:41.672 03:28:22 -- nvmf/common.sh@116 -- # sync 00:11:41.672 03:28:22 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:11:41.672 03:28:22 -- nvmf/common.sh@119 -- # set +e 00:11:41.672 03:28:22 -- nvmf/common.sh@120 -- # for i in {1..20} 00:11:41.672 03:28:22 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:11:41.672 rmmod nvme_tcp 00:11:41.931 rmmod nvme_fabrics 00:11:41.931 rmmod nvme_keyring 00:11:41.931 03:28:22 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:11:41.931 03:28:22 -- nvmf/common.sh@123 -- # set -e 00:11:41.931 03:28:22 -- nvmf/common.sh@124 -- # return 0 00:11:41.931 03:28:22 -- nvmf/common.sh@477 -- # '[' -n 2996314 ']' 00:11:41.931 03:28:22 -- nvmf/common.sh@478 -- # killprocess 2996314 00:11:41.931 03:28:22 -- common/autotest_common.sh@936 -- # '[' -z 2996314 ']' 00:11:41.931 03:28:22 -- common/autotest_common.sh@940 -- # kill -0 2996314 00:11:41.931 03:28:22 -- common/autotest_common.sh@941 -- # uname 00:11:41.931 03:28:22 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:11:41.931 03:28:22 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2996314 00:11:41.931 03:28:22 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:11:41.931 03:28:22 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:11:41.931 03:28:22 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2996314' 00:11:41.931 killing process with pid 2996314 00:11:41.931 03:28:22 -- common/autotest_common.sh@955 -- # kill 2996314 00:11:41.931 03:28:22 -- common/autotest_common.sh@960 -- # wait 2996314 00:11:42.189 03:28:22 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:11:42.189 03:28:22 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:11:42.189 03:28:22 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:11:42.189 03:28:22 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:11:42.189 03:28:22 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:11:42.189 03:28:22 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:42.189 03:28:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:42.189 03:28:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:44.094 03:28:24 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:11:44.094 00:11:44.094 real 0m6.676s 00:11:44.094 user 0m9.690s 00:11:44.094 sys 0m1.994s 00:11:44.094 03:28:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:11:44.094 03:28:24 -- common/autotest_common.sh@10 -- # set +x 00:11:44.094 ************************************ 00:11:44.094 END TEST nvmf_multitarget 00:11:44.094 ************************************ 00:11:44.094 03:28:24 -- nvmf/nvmf.sh@29 -- # run_test nvmf_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:11:44.094 03:28:24 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:11:44.094 03:28:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:11:44.094 03:28:24 -- common/autotest_common.sh@10 -- # set +x 00:11:44.354 ************************************ 00:11:44.354 START TEST nvmf_rpc 00:11:44.354 ************************************ 00:11:44.354 03:28:24 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:11:44.354 * Looking for test storage... 00:11:44.354 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:11:44.354 03:28:24 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:11:44.354 03:28:24 -- common/autotest_common.sh@1690 -- # lcov --version 00:11:44.354 03:28:24 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:11:44.354 03:28:24 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:11:44.354 03:28:24 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:11:44.354 03:28:24 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:11:44.354 03:28:24 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:11:44.354 03:28:24 -- scripts/common.sh@335 -- # IFS=.-: 00:11:44.354 03:28:24 -- scripts/common.sh@335 -- # read -ra ver1 00:11:44.354 03:28:24 -- scripts/common.sh@336 -- # IFS=.-: 00:11:44.354 03:28:24 -- scripts/common.sh@336 -- # read -ra ver2 00:11:44.354 03:28:24 -- scripts/common.sh@337 -- # local 'op=<' 00:11:44.354 03:28:24 -- scripts/common.sh@339 -- # ver1_l=2 00:11:44.354 03:28:24 -- scripts/common.sh@340 -- # ver2_l=1 00:11:44.354 03:28:24 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:11:44.354 03:28:24 -- scripts/common.sh@343 -- # case "$op" in 00:11:44.354 03:28:24 -- scripts/common.sh@344 -- # : 1 00:11:44.354 03:28:24 -- scripts/common.sh@363 -- # (( v = 0 )) 00:11:44.354 03:28:24 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:11:44.354 03:28:24 -- scripts/common.sh@364 -- # decimal 1 00:11:44.354 03:28:24 -- scripts/common.sh@352 -- # local d=1 00:11:44.354 03:28:24 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:11:44.354 03:28:24 -- scripts/common.sh@354 -- # echo 1 00:11:44.354 03:28:24 -- scripts/common.sh@364 -- # ver1[v]=1 00:11:44.354 03:28:24 -- scripts/common.sh@365 -- # decimal 2 00:11:44.354 03:28:24 -- scripts/common.sh@352 -- # local d=2 00:11:44.354 03:28:24 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:11:44.354 03:28:24 -- scripts/common.sh@354 -- # echo 2 00:11:44.354 03:28:24 -- scripts/common.sh@365 -- # ver2[v]=2 00:11:44.354 03:28:24 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:11:44.354 03:28:24 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:11:44.354 03:28:24 -- scripts/common.sh@367 -- # return 0 00:11:44.354 03:28:24 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:11:44.354 03:28:24 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:11:44.354 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:44.354 --rc genhtml_branch_coverage=1 00:11:44.354 --rc genhtml_function_coverage=1 00:11:44.354 --rc genhtml_legend=1 00:11:44.354 --rc geninfo_all_blocks=1 00:11:44.354 --rc geninfo_unexecuted_blocks=1 00:11:44.354 00:11:44.354 ' 00:11:44.354 03:28:24 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:11:44.354 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:44.354 --rc genhtml_branch_coverage=1 00:11:44.354 --rc genhtml_function_coverage=1 00:11:44.354 --rc genhtml_legend=1 00:11:44.354 --rc geninfo_all_blocks=1 00:11:44.354 --rc geninfo_unexecuted_blocks=1 00:11:44.354 00:11:44.354 ' 00:11:44.354 03:28:24 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:11:44.354 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:44.354 --rc genhtml_branch_coverage=1 00:11:44.354 --rc genhtml_function_coverage=1 00:11:44.354 --rc genhtml_legend=1 00:11:44.354 --rc geninfo_all_blocks=1 00:11:44.354 --rc geninfo_unexecuted_blocks=1 00:11:44.354 00:11:44.354 ' 00:11:44.354 03:28:24 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:11:44.354 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:44.354 --rc genhtml_branch_coverage=1 00:11:44.354 --rc genhtml_function_coverage=1 00:11:44.354 --rc genhtml_legend=1 00:11:44.354 --rc geninfo_all_blocks=1 00:11:44.354 --rc geninfo_unexecuted_blocks=1 00:11:44.354 00:11:44.354 ' 00:11:44.354 03:28:24 -- target/rpc.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:11:44.354 03:28:24 -- nvmf/common.sh@7 -- # uname -s 00:11:44.354 03:28:24 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:11:44.354 03:28:24 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:11:44.354 03:28:24 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:11:44.354 03:28:24 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:11:44.354 03:28:24 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:11:44.354 03:28:24 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:11:44.354 03:28:24 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:11:44.354 03:28:24 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:11:44.354 03:28:24 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:11:44.354 03:28:24 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:11:44.354 03:28:24 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:11:44.354 03:28:24 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:11:44.354 03:28:24 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:11:44.354 03:28:24 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:11:44.355 03:28:24 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:11:44.355 03:28:24 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:11:44.355 03:28:24 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:44.355 03:28:24 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:44.355 03:28:24 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:44.355 03:28:24 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:44.355 03:28:24 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:44.355 03:28:24 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:44.355 03:28:24 -- paths/export.sh@5 -- # export PATH 00:11:44.355 03:28:24 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:44.355 03:28:24 -- nvmf/common.sh@46 -- # : 0 00:11:44.355 03:28:24 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:11:44.355 03:28:24 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:11:44.355 03:28:24 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:11:44.355 03:28:24 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:11:44.355 03:28:24 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:11:44.355 03:28:24 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:11:44.355 03:28:24 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:11:44.355 03:28:24 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:11:44.355 03:28:24 -- target/rpc.sh@11 -- # loops=5 00:11:44.355 03:28:24 -- target/rpc.sh@23 -- # nvmftestinit 00:11:44.355 03:28:24 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:11:44.355 03:28:24 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:11:44.355 03:28:24 -- nvmf/common.sh@436 -- # prepare_net_devs 00:11:44.355 03:28:24 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:11:44.355 03:28:24 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:11:44.355 03:28:24 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:44.355 03:28:24 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:44.355 03:28:24 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:44.355 03:28:24 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:11:44.355 03:28:24 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:11:44.355 03:28:24 -- nvmf/common.sh@284 -- # xtrace_disable 00:11:44.355 03:28:24 -- common/autotest_common.sh@10 -- # set +x 00:11:46.885 03:28:27 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:11:46.885 03:28:27 -- nvmf/common.sh@290 -- # pci_devs=() 00:11:46.885 03:28:27 -- nvmf/common.sh@290 -- # local -a pci_devs 00:11:46.885 03:28:27 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:11:46.885 03:28:27 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:11:46.885 03:28:27 -- nvmf/common.sh@292 -- # pci_drivers=() 00:11:46.885 03:28:27 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:11:46.885 03:28:27 -- nvmf/common.sh@294 -- # net_devs=() 00:11:46.885 03:28:27 -- nvmf/common.sh@294 -- # local -ga net_devs 00:11:46.885 03:28:27 -- nvmf/common.sh@295 -- # e810=() 00:11:46.885 03:28:27 -- nvmf/common.sh@295 -- # local -ga e810 00:11:46.885 03:28:27 -- nvmf/common.sh@296 -- # x722=() 00:11:46.885 03:28:27 -- nvmf/common.sh@296 -- # local -ga x722 00:11:46.885 03:28:27 -- nvmf/common.sh@297 -- # mlx=() 00:11:46.885 03:28:27 -- nvmf/common.sh@297 -- # local -ga mlx 00:11:46.885 03:28:27 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:11:46.885 03:28:27 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:11:46.885 03:28:27 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:11:46.885 03:28:27 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:11:46.885 03:28:27 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:11:46.885 03:28:27 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:11:46.885 03:28:27 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:11:46.885 03:28:27 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:11:46.885 03:28:27 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:11:46.885 03:28:27 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:11:46.885 03:28:27 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:11:46.885 03:28:27 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:11:46.885 03:28:27 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:11:46.885 03:28:27 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:11:46.885 03:28:27 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:11:46.885 03:28:27 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:11:46.886 03:28:27 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:11:46.886 03:28:27 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:46.886 03:28:27 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:11:46.886 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:11:46.886 03:28:27 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:46.886 03:28:27 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:46.886 03:28:27 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:46.886 03:28:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:46.886 03:28:27 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:46.886 03:28:27 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:46.886 03:28:27 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:11:46.886 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:11:46.886 03:28:27 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:46.886 03:28:27 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:46.886 03:28:27 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:46.886 03:28:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:46.886 03:28:27 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:46.886 03:28:27 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:11:46.886 03:28:27 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:11:46.886 03:28:27 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:11:46.886 03:28:27 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:46.886 03:28:27 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:46.886 03:28:27 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:46.886 03:28:27 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:46.886 03:28:27 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:11:46.886 Found net devices under 0000:0a:00.0: cvl_0_0 00:11:46.886 03:28:27 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:46.886 03:28:27 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:46.886 03:28:27 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:46.886 03:28:27 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:46.886 03:28:27 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:46.886 03:28:27 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:11:46.886 Found net devices under 0000:0a:00.1: cvl_0_1 00:11:46.886 03:28:27 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:46.886 03:28:27 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:11:46.886 03:28:27 -- nvmf/common.sh@402 -- # is_hw=yes 00:11:46.886 03:28:27 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:11:46.886 03:28:27 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:11:46.886 03:28:27 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:11:46.886 03:28:27 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:11:46.886 03:28:27 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:11:46.886 03:28:27 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:11:46.886 03:28:27 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:11:46.886 03:28:27 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:11:46.886 03:28:27 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:11:46.886 03:28:27 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:11:46.886 03:28:27 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:11:46.886 03:28:27 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:11:46.886 03:28:27 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:11:46.886 03:28:27 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:11:46.886 03:28:27 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:11:46.886 03:28:27 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:11:46.886 03:28:27 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:11:46.886 03:28:27 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:11:46.886 03:28:27 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:11:46.886 03:28:27 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:11:46.886 03:28:27 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:11:46.886 03:28:27 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:11:46.886 03:28:27 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:11:46.886 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:11:46.886 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.249 ms 00:11:46.886 00:11:46.886 --- 10.0.0.2 ping statistics --- 00:11:46.886 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:46.886 rtt min/avg/max/mdev = 0.249/0.249/0.249/0.000 ms 00:11:46.886 03:28:27 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:11:46.886 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:11:46.886 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.117 ms 00:11:46.886 00:11:46.886 --- 10.0.0.1 ping statistics --- 00:11:46.886 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:46.886 rtt min/avg/max/mdev = 0.117/0.117/0.117/0.000 ms 00:11:46.886 03:28:27 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:11:46.886 03:28:27 -- nvmf/common.sh@410 -- # return 0 00:11:46.886 03:28:27 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:11:46.886 03:28:27 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:11:46.886 03:28:27 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:11:46.886 03:28:27 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:11:46.886 03:28:27 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:11:46.886 03:28:27 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:11:46.886 03:28:27 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:11:46.886 03:28:27 -- target/rpc.sh@24 -- # nvmfappstart -m 0xF 00:11:46.886 03:28:27 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:11:46.886 03:28:27 -- common/autotest_common.sh@722 -- # xtrace_disable 00:11:46.886 03:28:27 -- common/autotest_common.sh@10 -- # set +x 00:11:46.886 03:28:27 -- nvmf/common.sh@469 -- # nvmfpid=2998592 00:11:46.886 03:28:27 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:11:46.886 03:28:27 -- nvmf/common.sh@470 -- # waitforlisten 2998592 00:11:46.886 03:28:27 -- common/autotest_common.sh@829 -- # '[' -z 2998592 ']' 00:11:46.886 03:28:27 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:11:46.886 03:28:27 -- common/autotest_common.sh@834 -- # local max_retries=100 00:11:46.886 03:28:27 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:11:46.886 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:11:46.886 03:28:27 -- common/autotest_common.sh@838 -- # xtrace_disable 00:11:46.886 03:28:27 -- common/autotest_common.sh@10 -- # set +x 00:11:46.886 [2024-11-21 03:28:27.402455] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:11:46.886 [2024-11-21 03:28:27.402548] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:11:46.886 EAL: No free 2048 kB hugepages reported on node 1 00:11:46.886 [2024-11-21 03:28:27.471914] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:11:47.146 [2024-11-21 03:28:27.591371] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:11:47.146 [2024-11-21 03:28:27.591533] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:11:47.146 [2024-11-21 03:28:27.591552] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:11:47.146 [2024-11-21 03:28:27.591567] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:11:47.146 [2024-11-21 03:28:27.591636] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:11:47.146 [2024-11-21 03:28:27.591676] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:11:47.146 [2024-11-21 03:28:27.591704] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:11:47.146 [2024-11-21 03:28:27.591707] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:11:48.083 03:28:28 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:11:48.083 03:28:28 -- common/autotest_common.sh@862 -- # return 0 00:11:48.083 03:28:28 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:11:48.083 03:28:28 -- common/autotest_common.sh@728 -- # xtrace_disable 00:11:48.083 03:28:28 -- common/autotest_common.sh@10 -- # set +x 00:11:48.083 03:28:28 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:11:48.083 03:28:28 -- target/rpc.sh@26 -- # rpc_cmd nvmf_get_stats 00:11:48.083 03:28:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:48.083 03:28:28 -- common/autotest_common.sh@10 -- # set +x 00:11:48.083 03:28:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:48.083 03:28:28 -- target/rpc.sh@26 -- # stats='{ 00:11:48.083 "tick_rate": 2700000000, 00:11:48.083 "poll_groups": [ 00:11:48.083 { 00:11:48.083 "name": "nvmf_tgt_poll_group_0", 00:11:48.083 "admin_qpairs": 0, 00:11:48.083 "io_qpairs": 0, 00:11:48.083 "current_admin_qpairs": 0, 00:11:48.083 "current_io_qpairs": 0, 00:11:48.083 "pending_bdev_io": 0, 00:11:48.083 "completed_nvme_io": 0, 00:11:48.083 "transports": [] 00:11:48.083 }, 00:11:48.083 { 00:11:48.083 "name": "nvmf_tgt_poll_group_1", 00:11:48.083 "admin_qpairs": 0, 00:11:48.083 "io_qpairs": 0, 00:11:48.083 "current_admin_qpairs": 0, 00:11:48.083 "current_io_qpairs": 0, 00:11:48.083 "pending_bdev_io": 0, 00:11:48.083 "completed_nvme_io": 0, 00:11:48.083 "transports": [] 00:11:48.083 }, 00:11:48.083 { 00:11:48.083 "name": "nvmf_tgt_poll_group_2", 00:11:48.083 "admin_qpairs": 0, 00:11:48.083 "io_qpairs": 0, 00:11:48.083 "current_admin_qpairs": 0, 00:11:48.083 "current_io_qpairs": 0, 00:11:48.083 "pending_bdev_io": 0, 00:11:48.083 "completed_nvme_io": 0, 00:11:48.083 "transports": [] 00:11:48.083 }, 00:11:48.083 { 00:11:48.083 "name": "nvmf_tgt_poll_group_3", 00:11:48.083 "admin_qpairs": 0, 00:11:48.083 "io_qpairs": 0, 00:11:48.083 "current_admin_qpairs": 0, 00:11:48.083 "current_io_qpairs": 0, 00:11:48.083 "pending_bdev_io": 0, 00:11:48.083 "completed_nvme_io": 0, 00:11:48.083 "transports": [] 00:11:48.083 } 00:11:48.083 ] 00:11:48.083 }' 00:11:48.083 03:28:28 -- target/rpc.sh@28 -- # jcount '.poll_groups[].name' 00:11:48.083 03:28:28 -- target/rpc.sh@14 -- # local 'filter=.poll_groups[].name' 00:11:48.083 03:28:28 -- target/rpc.sh@15 -- # jq '.poll_groups[].name' 00:11:48.083 03:28:28 -- target/rpc.sh@15 -- # wc -l 00:11:48.083 03:28:28 -- target/rpc.sh@28 -- # (( 4 == 4 )) 00:11:48.083 03:28:28 -- target/rpc.sh@29 -- # jq '.poll_groups[0].transports[0]' 00:11:48.083 03:28:28 -- target/rpc.sh@29 -- # [[ null == null ]] 00:11:48.083 03:28:28 -- target/rpc.sh@31 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:11:48.083 03:28:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:48.083 03:28:28 -- common/autotest_common.sh@10 -- # set +x 00:11:48.083 [2024-11-21 03:28:28.513011] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:11:48.083 03:28:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:48.083 03:28:28 -- target/rpc.sh@33 -- # rpc_cmd nvmf_get_stats 00:11:48.083 03:28:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:48.083 03:28:28 -- common/autotest_common.sh@10 -- # set +x 00:11:48.083 03:28:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:48.083 03:28:28 -- target/rpc.sh@33 -- # stats='{ 00:11:48.083 "tick_rate": 2700000000, 00:11:48.083 "poll_groups": [ 00:11:48.083 { 00:11:48.083 "name": "nvmf_tgt_poll_group_0", 00:11:48.083 "admin_qpairs": 0, 00:11:48.083 "io_qpairs": 0, 00:11:48.083 "current_admin_qpairs": 0, 00:11:48.083 "current_io_qpairs": 0, 00:11:48.083 "pending_bdev_io": 0, 00:11:48.083 "completed_nvme_io": 0, 00:11:48.083 "transports": [ 00:11:48.083 { 00:11:48.083 "trtype": "TCP" 00:11:48.083 } 00:11:48.083 ] 00:11:48.083 }, 00:11:48.083 { 00:11:48.083 "name": "nvmf_tgt_poll_group_1", 00:11:48.083 "admin_qpairs": 0, 00:11:48.083 "io_qpairs": 0, 00:11:48.083 "current_admin_qpairs": 0, 00:11:48.083 "current_io_qpairs": 0, 00:11:48.083 "pending_bdev_io": 0, 00:11:48.083 "completed_nvme_io": 0, 00:11:48.083 "transports": [ 00:11:48.083 { 00:11:48.083 "trtype": "TCP" 00:11:48.083 } 00:11:48.083 ] 00:11:48.083 }, 00:11:48.083 { 00:11:48.083 "name": "nvmf_tgt_poll_group_2", 00:11:48.083 "admin_qpairs": 0, 00:11:48.083 "io_qpairs": 0, 00:11:48.083 "current_admin_qpairs": 0, 00:11:48.083 "current_io_qpairs": 0, 00:11:48.083 "pending_bdev_io": 0, 00:11:48.083 "completed_nvme_io": 0, 00:11:48.083 "transports": [ 00:11:48.083 { 00:11:48.083 "trtype": "TCP" 00:11:48.083 } 00:11:48.083 ] 00:11:48.083 }, 00:11:48.083 { 00:11:48.083 "name": "nvmf_tgt_poll_group_3", 00:11:48.083 "admin_qpairs": 0, 00:11:48.083 "io_qpairs": 0, 00:11:48.083 "current_admin_qpairs": 0, 00:11:48.083 "current_io_qpairs": 0, 00:11:48.083 "pending_bdev_io": 0, 00:11:48.083 "completed_nvme_io": 0, 00:11:48.083 "transports": [ 00:11:48.083 { 00:11:48.083 "trtype": "TCP" 00:11:48.083 } 00:11:48.083 ] 00:11:48.083 } 00:11:48.083 ] 00:11:48.083 }' 00:11:48.083 03:28:28 -- target/rpc.sh@35 -- # jsum '.poll_groups[].admin_qpairs' 00:11:48.083 03:28:28 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:11:48.083 03:28:28 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:11:48.083 03:28:28 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:11:48.083 03:28:28 -- target/rpc.sh@35 -- # (( 0 == 0 )) 00:11:48.083 03:28:28 -- target/rpc.sh@36 -- # jsum '.poll_groups[].io_qpairs' 00:11:48.083 03:28:28 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:11:48.083 03:28:28 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:11:48.083 03:28:28 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:11:48.083 03:28:28 -- target/rpc.sh@36 -- # (( 0 == 0 )) 00:11:48.083 03:28:28 -- target/rpc.sh@38 -- # '[' rdma == tcp ']' 00:11:48.083 03:28:28 -- target/rpc.sh@46 -- # MALLOC_BDEV_SIZE=64 00:11:48.083 03:28:28 -- target/rpc.sh@47 -- # MALLOC_BLOCK_SIZE=512 00:11:48.083 03:28:28 -- target/rpc.sh@49 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:11:48.083 03:28:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:48.083 03:28:28 -- common/autotest_common.sh@10 -- # set +x 00:11:48.083 Malloc1 00:11:48.083 03:28:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:48.083 03:28:28 -- target/rpc.sh@52 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:11:48.083 03:28:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:48.083 03:28:28 -- common/autotest_common.sh@10 -- # set +x 00:11:48.083 03:28:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:48.083 03:28:28 -- target/rpc.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:11:48.083 03:28:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:48.083 03:28:28 -- common/autotest_common.sh@10 -- # set +x 00:11:48.083 03:28:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:48.083 03:28:28 -- target/rpc.sh@54 -- # rpc_cmd nvmf_subsystem_allow_any_host -d nqn.2016-06.io.spdk:cnode1 00:11:48.083 03:28:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:48.083 03:28:28 -- common/autotest_common.sh@10 -- # set +x 00:11:48.083 03:28:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:48.083 03:28:28 -- target/rpc.sh@55 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:48.083 03:28:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:48.083 03:28:28 -- common/autotest_common.sh@10 -- # set +x 00:11:48.083 [2024-11-21 03:28:28.662854] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:48.083 03:28:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:48.083 03:28:28 -- target/rpc.sh@58 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:11:48.083 03:28:28 -- common/autotest_common.sh@650 -- # local es=0 00:11:48.083 03:28:28 -- common/autotest_common.sh@652 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:11:48.083 03:28:28 -- common/autotest_common.sh@638 -- # local arg=nvme 00:11:48.083 03:28:28 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:11:48.083 03:28:28 -- common/autotest_common.sh@642 -- # type -t nvme 00:11:48.083 03:28:28 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:11:48.083 03:28:28 -- common/autotest_common.sh@644 -- # type -P nvme 00:11:48.084 03:28:28 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:11:48.084 03:28:28 -- common/autotest_common.sh@644 -- # arg=/usr/sbin/nvme 00:11:48.084 03:28:28 -- common/autotest_common.sh@644 -- # [[ -x /usr/sbin/nvme ]] 00:11:48.084 03:28:28 -- common/autotest_common.sh@653 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:11:48.084 [2024-11-21 03:28:28.685374] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55' 00:11:48.084 Failed to write to /dev/nvme-fabrics: Input/output error 00:11:48.084 could not add new controller: failed to write to nvme-fabrics device 00:11:48.084 03:28:28 -- common/autotest_common.sh@653 -- # es=1 00:11:48.084 03:28:28 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:11:48.084 03:28:28 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:11:48.084 03:28:28 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:11:48.084 03:28:28 -- target/rpc.sh@61 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:11:48.084 03:28:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:48.084 03:28:28 -- common/autotest_common.sh@10 -- # set +x 00:11:48.084 03:28:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:48.084 03:28:28 -- target/rpc.sh@62 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:49.021 03:28:29 -- target/rpc.sh@63 -- # waitforserial SPDKISFASTANDAWESOME 00:11:49.021 03:28:29 -- common/autotest_common.sh@1187 -- # local i=0 00:11:49.021 03:28:29 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:11:49.021 03:28:29 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:11:49.021 03:28:29 -- common/autotest_common.sh@1194 -- # sleep 2 00:11:50.925 03:28:31 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:11:50.925 03:28:31 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:11:50.925 03:28:31 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:11:50.925 03:28:31 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:11:50.925 03:28:31 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:11:50.925 03:28:31 -- common/autotest_common.sh@1197 -- # return 0 00:11:50.925 03:28:31 -- target/rpc.sh@64 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:50.925 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:50.925 03:28:31 -- target/rpc.sh@65 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:11:50.925 03:28:31 -- common/autotest_common.sh@1208 -- # local i=0 00:11:50.925 03:28:31 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:11:50.925 03:28:31 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:50.925 03:28:31 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:11:50.925 03:28:31 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:50.925 03:28:31 -- common/autotest_common.sh@1220 -- # return 0 00:11:50.925 03:28:31 -- target/rpc.sh@68 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:11:50.925 03:28:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:50.925 03:28:31 -- common/autotest_common.sh@10 -- # set +x 00:11:50.925 03:28:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:50.925 03:28:31 -- target/rpc.sh@69 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:50.925 03:28:31 -- common/autotest_common.sh@650 -- # local es=0 00:11:50.925 03:28:31 -- common/autotest_common.sh@652 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:50.925 03:28:31 -- common/autotest_common.sh@638 -- # local arg=nvme 00:11:50.925 03:28:31 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:11:50.925 03:28:31 -- common/autotest_common.sh@642 -- # type -t nvme 00:11:50.925 03:28:31 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:11:50.925 03:28:31 -- common/autotest_common.sh@644 -- # type -P nvme 00:11:50.925 03:28:31 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:11:50.925 03:28:31 -- common/autotest_common.sh@644 -- # arg=/usr/sbin/nvme 00:11:50.925 03:28:31 -- common/autotest_common.sh@644 -- # [[ -x /usr/sbin/nvme ]] 00:11:50.925 03:28:31 -- common/autotest_common.sh@653 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:50.925 [2024-11-21 03:28:31.531349] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55' 00:11:50.925 Failed to write to /dev/nvme-fabrics: Input/output error 00:11:50.925 could not add new controller: failed to write to nvme-fabrics device 00:11:50.925 03:28:31 -- common/autotest_common.sh@653 -- # es=1 00:11:50.925 03:28:31 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:11:50.925 03:28:31 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:11:50.925 03:28:31 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:11:50.925 03:28:31 -- target/rpc.sh@72 -- # rpc_cmd nvmf_subsystem_allow_any_host -e nqn.2016-06.io.spdk:cnode1 00:11:50.925 03:28:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:50.925 03:28:31 -- common/autotest_common.sh@10 -- # set +x 00:11:50.925 03:28:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:50.925 03:28:31 -- target/rpc.sh@73 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:51.858 03:28:32 -- target/rpc.sh@74 -- # waitforserial SPDKISFASTANDAWESOME 00:11:51.858 03:28:32 -- common/autotest_common.sh@1187 -- # local i=0 00:11:51.858 03:28:32 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:11:51.858 03:28:32 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:11:51.858 03:28:32 -- common/autotest_common.sh@1194 -- # sleep 2 00:11:53.757 03:28:34 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:11:53.757 03:28:34 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:11:53.757 03:28:34 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:11:53.757 03:28:34 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:11:53.757 03:28:34 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:11:53.757 03:28:34 -- common/autotest_common.sh@1197 -- # return 0 00:11:53.757 03:28:34 -- target/rpc.sh@75 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:53.757 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:53.757 03:28:34 -- target/rpc.sh@76 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:11:53.757 03:28:34 -- common/autotest_common.sh@1208 -- # local i=0 00:11:53.757 03:28:34 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:11:53.757 03:28:34 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:53.757 03:28:34 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:11:53.757 03:28:34 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:53.757 03:28:34 -- common/autotest_common.sh@1220 -- # return 0 00:11:53.757 03:28:34 -- target/rpc.sh@78 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:53.757 03:28:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:53.757 03:28:34 -- common/autotest_common.sh@10 -- # set +x 00:11:53.757 03:28:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:53.757 03:28:34 -- target/rpc.sh@81 -- # seq 1 5 00:11:53.757 03:28:34 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:11:53.757 03:28:34 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:53.757 03:28:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:53.757 03:28:34 -- common/autotest_common.sh@10 -- # set +x 00:11:53.757 03:28:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:53.757 03:28:34 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:53.757 03:28:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:53.757 03:28:34 -- common/autotest_common.sh@10 -- # set +x 00:11:53.757 [2024-11-21 03:28:34.285477] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:53.757 03:28:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:53.757 03:28:34 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:11:53.757 03:28:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:53.757 03:28:34 -- common/autotest_common.sh@10 -- # set +x 00:11:53.757 03:28:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:53.757 03:28:34 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:53.757 03:28:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:53.757 03:28:34 -- common/autotest_common.sh@10 -- # set +x 00:11:53.757 03:28:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:53.757 03:28:34 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:54.323 03:28:34 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:11:54.323 03:28:34 -- common/autotest_common.sh@1187 -- # local i=0 00:11:54.323 03:28:34 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:11:54.323 03:28:34 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:11:54.323 03:28:34 -- common/autotest_common.sh@1194 -- # sleep 2 00:11:56.851 03:28:36 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:11:56.851 03:28:36 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:11:56.851 03:28:36 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:11:56.851 03:28:36 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:11:56.851 03:28:36 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:11:56.851 03:28:36 -- common/autotest_common.sh@1197 -- # return 0 00:11:56.851 03:28:36 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:56.851 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:56.851 03:28:37 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:11:56.851 03:28:37 -- common/autotest_common.sh@1208 -- # local i=0 00:11:56.851 03:28:37 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:11:56.851 03:28:37 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:56.851 03:28:37 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:11:56.851 03:28:37 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:56.851 03:28:37 -- common/autotest_common.sh@1220 -- # return 0 00:11:56.851 03:28:37 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:11:56.851 03:28:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:56.851 03:28:37 -- common/autotest_common.sh@10 -- # set +x 00:11:56.851 03:28:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:56.851 03:28:37 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:56.851 03:28:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:56.851 03:28:37 -- common/autotest_common.sh@10 -- # set +x 00:11:56.851 03:28:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:56.851 03:28:37 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:11:56.851 03:28:37 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:56.851 03:28:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:56.851 03:28:37 -- common/autotest_common.sh@10 -- # set +x 00:11:56.851 03:28:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:56.851 03:28:37 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:56.851 03:28:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:56.851 03:28:37 -- common/autotest_common.sh@10 -- # set +x 00:11:56.851 [2024-11-21 03:28:37.077844] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:56.851 03:28:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:56.851 03:28:37 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:11:56.851 03:28:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:56.851 03:28:37 -- common/autotest_common.sh@10 -- # set +x 00:11:56.851 03:28:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:56.851 03:28:37 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:56.851 03:28:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:56.851 03:28:37 -- common/autotest_common.sh@10 -- # set +x 00:11:56.851 03:28:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:56.851 03:28:37 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:57.417 03:28:37 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:11:57.417 03:28:37 -- common/autotest_common.sh@1187 -- # local i=0 00:11:57.417 03:28:37 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:11:57.417 03:28:37 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:11:57.417 03:28:37 -- common/autotest_common.sh@1194 -- # sleep 2 00:11:59.314 03:28:39 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:11:59.314 03:28:39 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:11:59.314 03:28:39 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:11:59.314 03:28:39 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:11:59.314 03:28:39 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:11:59.314 03:28:39 -- common/autotest_common.sh@1197 -- # return 0 00:11:59.314 03:28:39 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:59.314 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:59.314 03:28:39 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:11:59.314 03:28:39 -- common/autotest_common.sh@1208 -- # local i=0 00:11:59.314 03:28:39 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:11:59.314 03:28:39 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:59.314 03:28:39 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:11:59.314 03:28:39 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:59.314 03:28:39 -- common/autotest_common.sh@1220 -- # return 0 00:11:59.314 03:28:39 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:11:59.314 03:28:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:59.314 03:28:39 -- common/autotest_common.sh@10 -- # set +x 00:11:59.314 03:28:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:59.314 03:28:39 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:59.314 03:28:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:59.314 03:28:39 -- common/autotest_common.sh@10 -- # set +x 00:11:59.314 03:28:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:59.314 03:28:39 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:11:59.314 03:28:39 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:59.314 03:28:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:59.314 03:28:39 -- common/autotest_common.sh@10 -- # set +x 00:11:59.314 03:28:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:59.314 03:28:39 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:59.314 03:28:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:59.314 03:28:39 -- common/autotest_common.sh@10 -- # set +x 00:11:59.314 [2024-11-21 03:28:39.941519] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:59.314 03:28:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:59.314 03:28:39 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:11:59.314 03:28:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:59.314 03:28:39 -- common/autotest_common.sh@10 -- # set +x 00:11:59.314 03:28:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:59.314 03:28:39 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:59.314 03:28:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:59.314 03:28:39 -- common/autotest_common.sh@10 -- # set +x 00:11:59.574 03:28:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:59.574 03:28:39 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:00.142 03:28:40 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:12:00.142 03:28:40 -- common/autotest_common.sh@1187 -- # local i=0 00:12:00.142 03:28:40 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:12:00.142 03:28:40 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:12:00.142 03:28:40 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:02.058 03:28:42 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:02.058 03:28:42 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:02.058 03:28:42 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:02.058 03:28:42 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:02.058 03:28:42 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:02.058 03:28:42 -- common/autotest_common.sh@1197 -- # return 0 00:12:02.058 03:28:42 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:02.058 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:02.058 03:28:42 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:02.058 03:28:42 -- common/autotest_common.sh@1208 -- # local i=0 00:12:02.058 03:28:42 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:02.058 03:28:42 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:02.058 03:28:42 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:02.058 03:28:42 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:02.317 03:28:42 -- common/autotest_common.sh@1220 -- # return 0 00:12:02.317 03:28:42 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:02.317 03:28:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:02.317 03:28:42 -- common/autotest_common.sh@10 -- # set +x 00:12:02.317 03:28:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:02.317 03:28:42 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:02.317 03:28:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:02.317 03:28:42 -- common/autotest_common.sh@10 -- # set +x 00:12:02.317 03:28:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:02.317 03:28:42 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:12:02.317 03:28:42 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:02.317 03:28:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:02.317 03:28:42 -- common/autotest_common.sh@10 -- # set +x 00:12:02.317 03:28:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:02.317 03:28:42 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:02.317 03:28:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:02.317 03:28:42 -- common/autotest_common.sh@10 -- # set +x 00:12:02.317 [2024-11-21 03:28:42.739585] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:02.317 03:28:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:02.317 03:28:42 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:12:02.317 03:28:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:02.317 03:28:42 -- common/autotest_common.sh@10 -- # set +x 00:12:02.317 03:28:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:02.317 03:28:42 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:02.317 03:28:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:02.317 03:28:42 -- common/autotest_common.sh@10 -- # set +x 00:12:02.317 03:28:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:02.317 03:28:42 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:02.885 03:28:43 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:12:02.885 03:28:43 -- common/autotest_common.sh@1187 -- # local i=0 00:12:02.885 03:28:43 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:12:02.885 03:28:43 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:12:02.885 03:28:43 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:05.420 03:28:45 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:05.420 03:28:45 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:05.420 03:28:45 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:05.420 03:28:45 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:05.420 03:28:45 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:05.420 03:28:45 -- common/autotest_common.sh@1197 -- # return 0 00:12:05.420 03:28:45 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:05.420 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:05.420 03:28:45 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:05.420 03:28:45 -- common/autotest_common.sh@1208 -- # local i=0 00:12:05.420 03:28:45 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:05.420 03:28:45 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:05.420 03:28:45 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:05.420 03:28:45 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:05.420 03:28:45 -- common/autotest_common.sh@1220 -- # return 0 00:12:05.420 03:28:45 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:05.420 03:28:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:05.420 03:28:45 -- common/autotest_common.sh@10 -- # set +x 00:12:05.420 03:28:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:05.420 03:28:45 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:05.420 03:28:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:05.420 03:28:45 -- common/autotest_common.sh@10 -- # set +x 00:12:05.420 03:28:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:05.420 03:28:45 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:12:05.420 03:28:45 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:05.420 03:28:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:05.420 03:28:45 -- common/autotest_common.sh@10 -- # set +x 00:12:05.420 03:28:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:05.420 03:28:45 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:05.420 03:28:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:05.420 03:28:45 -- common/autotest_common.sh@10 -- # set +x 00:12:05.420 [2024-11-21 03:28:45.608442] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:05.420 03:28:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:05.420 03:28:45 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:12:05.420 03:28:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:05.420 03:28:45 -- common/autotest_common.sh@10 -- # set +x 00:12:05.420 03:28:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:05.420 03:28:45 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:05.420 03:28:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:05.420 03:28:45 -- common/autotest_common.sh@10 -- # set +x 00:12:05.420 03:28:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:05.420 03:28:45 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:05.679 03:28:46 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:12:05.679 03:28:46 -- common/autotest_common.sh@1187 -- # local i=0 00:12:05.679 03:28:46 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:12:05.679 03:28:46 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:12:05.679 03:28:46 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:08.251 03:28:48 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:08.251 03:28:48 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:08.251 03:28:48 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:08.251 03:28:48 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:08.251 03:28:48 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:08.251 03:28:48 -- common/autotest_common.sh@1197 -- # return 0 00:12:08.251 03:28:48 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:08.251 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:08.251 03:28:48 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:08.251 03:28:48 -- common/autotest_common.sh@1208 -- # local i=0 00:12:08.251 03:28:48 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:08.251 03:28:48 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:08.251 03:28:48 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:08.251 03:28:48 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:08.251 03:28:48 -- common/autotest_common.sh@1220 -- # return 0 00:12:08.251 03:28:48 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:08.251 03:28:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:08.251 03:28:48 -- common/autotest_common.sh@10 -- # set +x 00:12:08.251 03:28:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:08.251 03:28:48 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:08.251 03:28:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:08.251 03:28:48 -- common/autotest_common.sh@10 -- # set +x 00:12:08.251 03:28:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:08.251 03:28:48 -- target/rpc.sh@99 -- # seq 1 5 00:12:08.251 03:28:48 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:08.251 03:28:48 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:08.251 03:28:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:08.251 03:28:48 -- common/autotest_common.sh@10 -- # set +x 00:12:08.251 03:28:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:08.251 03:28:48 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:08.251 03:28:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:08.251 03:28:48 -- common/autotest_common.sh@10 -- # set +x 00:12:08.251 [2024-11-21 03:28:48.417194] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:08.251 03:28:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:08.251 03:28:48 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:08.251 03:28:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:08.251 03:28:48 -- common/autotest_common.sh@10 -- # set +x 00:12:08.251 03:28:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:08.251 03:28:48 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:08.251 03:28:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:08.251 03:28:48 -- common/autotest_common.sh@10 -- # set +x 00:12:08.251 03:28:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:08.251 03:28:48 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:08.251 03:28:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:08.251 03:28:48 -- common/autotest_common.sh@10 -- # set +x 00:12:08.251 03:28:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:08.251 03:28:48 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:08.251 03:28:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:08.251 03:28:48 -- common/autotest_common.sh@10 -- # set +x 00:12:08.251 03:28:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:08.251 03:28:48 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:08.251 03:28:48 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:08.251 03:28:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:08.251 03:28:48 -- common/autotest_common.sh@10 -- # set +x 00:12:08.251 03:28:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:08.251 03:28:48 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:08.251 03:28:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:08.251 03:28:48 -- common/autotest_common.sh@10 -- # set +x 00:12:08.251 [2024-11-21 03:28:48.465216] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:08.251 03:28:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:08.251 03:28:48 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:08.251 03:28:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:08.251 03:28:48 -- common/autotest_common.sh@10 -- # set +x 00:12:08.251 03:28:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:08.251 03:28:48 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:08.251 03:28:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:08.251 03:28:48 -- common/autotest_common.sh@10 -- # set +x 00:12:08.251 03:28:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:08.251 03:28:48 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:08.251 03:28:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:08.251 03:28:48 -- common/autotest_common.sh@10 -- # set +x 00:12:08.251 03:28:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:08.251 03:28:48 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:08.251 03:28:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:08.251 03:28:48 -- common/autotest_common.sh@10 -- # set +x 00:12:08.251 03:28:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:08.251 03:28:48 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:08.251 03:28:48 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:08.251 03:28:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:08.251 03:28:48 -- common/autotest_common.sh@10 -- # set +x 00:12:08.251 03:28:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:08.251 03:28:48 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:08.251 03:28:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:08.251 03:28:48 -- common/autotest_common.sh@10 -- # set +x 00:12:08.251 [2024-11-21 03:28:48.513400] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:08.251 03:28:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:08.251 03:28:48 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:08.251 03:28:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:08.251 03:28:48 -- common/autotest_common.sh@10 -- # set +x 00:12:08.251 03:28:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:08.251 03:28:48 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:08.251 03:28:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:08.251 03:28:48 -- common/autotest_common.sh@10 -- # set +x 00:12:08.251 03:28:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:08.251 03:28:48 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:08.251 03:28:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:08.251 03:28:48 -- common/autotest_common.sh@10 -- # set +x 00:12:08.251 03:28:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:08.251 03:28:48 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:08.251 03:28:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:08.251 03:28:48 -- common/autotest_common.sh@10 -- # set +x 00:12:08.251 03:28:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:08.251 03:28:48 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:08.251 03:28:48 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:08.251 03:28:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:08.251 03:28:48 -- common/autotest_common.sh@10 -- # set +x 00:12:08.251 03:28:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:08.251 03:28:48 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:08.251 03:28:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:08.251 03:28:48 -- common/autotest_common.sh@10 -- # set +x 00:12:08.251 [2024-11-21 03:28:48.561566] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:08.251 03:28:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:08.251 03:28:48 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:08.251 03:28:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:08.251 03:28:48 -- common/autotest_common.sh@10 -- # set +x 00:12:08.251 03:28:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:08.251 03:28:48 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:08.251 03:28:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:08.251 03:28:48 -- common/autotest_common.sh@10 -- # set +x 00:12:08.251 03:28:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:08.251 03:28:48 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:08.251 03:28:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:08.251 03:28:48 -- common/autotest_common.sh@10 -- # set +x 00:12:08.251 03:28:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:08.251 03:28:48 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:08.251 03:28:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:08.251 03:28:48 -- common/autotest_common.sh@10 -- # set +x 00:12:08.251 03:28:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:08.251 03:28:48 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:08.251 03:28:48 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:08.251 03:28:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:08.251 03:28:48 -- common/autotest_common.sh@10 -- # set +x 00:12:08.251 03:28:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:08.251 03:28:48 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:08.251 03:28:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:08.251 03:28:48 -- common/autotest_common.sh@10 -- # set +x 00:12:08.251 [2024-11-21 03:28:48.609718] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:08.251 03:28:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:08.251 03:28:48 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:08.251 03:28:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:08.251 03:28:48 -- common/autotest_common.sh@10 -- # set +x 00:12:08.251 03:28:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:08.251 03:28:48 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:08.251 03:28:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:08.251 03:28:48 -- common/autotest_common.sh@10 -- # set +x 00:12:08.251 03:28:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:08.251 03:28:48 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:08.251 03:28:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:08.251 03:28:48 -- common/autotest_common.sh@10 -- # set +x 00:12:08.251 03:28:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:08.251 03:28:48 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:08.251 03:28:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:08.251 03:28:48 -- common/autotest_common.sh@10 -- # set +x 00:12:08.251 03:28:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:08.251 03:28:48 -- target/rpc.sh@110 -- # rpc_cmd nvmf_get_stats 00:12:08.251 03:28:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:08.251 03:28:48 -- common/autotest_common.sh@10 -- # set +x 00:12:08.251 03:28:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:08.251 03:28:48 -- target/rpc.sh@110 -- # stats='{ 00:12:08.251 "tick_rate": 2700000000, 00:12:08.251 "poll_groups": [ 00:12:08.251 { 00:12:08.251 "name": "nvmf_tgt_poll_group_0", 00:12:08.251 "admin_qpairs": 2, 00:12:08.251 "io_qpairs": 84, 00:12:08.251 "current_admin_qpairs": 0, 00:12:08.251 "current_io_qpairs": 0, 00:12:08.251 "pending_bdev_io": 0, 00:12:08.251 "completed_nvme_io": 177, 00:12:08.251 "transports": [ 00:12:08.251 { 00:12:08.251 "trtype": "TCP" 00:12:08.251 } 00:12:08.251 ] 00:12:08.251 }, 00:12:08.251 { 00:12:08.251 "name": "nvmf_tgt_poll_group_1", 00:12:08.251 "admin_qpairs": 2, 00:12:08.251 "io_qpairs": 84, 00:12:08.251 "current_admin_qpairs": 0, 00:12:08.251 "current_io_qpairs": 0, 00:12:08.251 "pending_bdev_io": 0, 00:12:08.251 "completed_nvme_io": 137, 00:12:08.251 "transports": [ 00:12:08.251 { 00:12:08.251 "trtype": "TCP" 00:12:08.251 } 00:12:08.251 ] 00:12:08.251 }, 00:12:08.251 { 00:12:08.251 "name": "nvmf_tgt_poll_group_2", 00:12:08.251 "admin_qpairs": 1, 00:12:08.251 "io_qpairs": 84, 00:12:08.251 "current_admin_qpairs": 0, 00:12:08.251 "current_io_qpairs": 0, 00:12:08.251 "pending_bdev_io": 0, 00:12:08.251 "completed_nvme_io": 174, 00:12:08.251 "transports": [ 00:12:08.251 { 00:12:08.251 "trtype": "TCP" 00:12:08.251 } 00:12:08.251 ] 00:12:08.251 }, 00:12:08.251 { 00:12:08.251 "name": "nvmf_tgt_poll_group_3", 00:12:08.251 "admin_qpairs": 2, 00:12:08.251 "io_qpairs": 84, 00:12:08.251 "current_admin_qpairs": 0, 00:12:08.251 "current_io_qpairs": 0, 00:12:08.251 "pending_bdev_io": 0, 00:12:08.251 "completed_nvme_io": 198, 00:12:08.251 "transports": [ 00:12:08.251 { 00:12:08.251 "trtype": "TCP" 00:12:08.251 } 00:12:08.251 ] 00:12:08.251 } 00:12:08.251 ] 00:12:08.251 }' 00:12:08.251 03:28:48 -- target/rpc.sh@112 -- # jsum '.poll_groups[].admin_qpairs' 00:12:08.251 03:28:48 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:12:08.251 03:28:48 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:12:08.251 03:28:48 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:12:08.251 03:28:48 -- target/rpc.sh@112 -- # (( 7 > 0 )) 00:12:08.251 03:28:48 -- target/rpc.sh@113 -- # jsum '.poll_groups[].io_qpairs' 00:12:08.251 03:28:48 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:12:08.251 03:28:48 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:12:08.251 03:28:48 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:12:08.251 03:28:48 -- target/rpc.sh@113 -- # (( 336 > 0 )) 00:12:08.251 03:28:48 -- target/rpc.sh@115 -- # '[' rdma == tcp ']' 00:12:08.251 03:28:48 -- target/rpc.sh@121 -- # trap - SIGINT SIGTERM EXIT 00:12:08.251 03:28:48 -- target/rpc.sh@123 -- # nvmftestfini 00:12:08.251 03:28:48 -- nvmf/common.sh@476 -- # nvmfcleanup 00:12:08.251 03:28:48 -- nvmf/common.sh@116 -- # sync 00:12:08.251 03:28:48 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:12:08.251 03:28:48 -- nvmf/common.sh@119 -- # set +e 00:12:08.251 03:28:48 -- nvmf/common.sh@120 -- # for i in {1..20} 00:12:08.251 03:28:48 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:12:08.251 rmmod nvme_tcp 00:12:08.251 rmmod nvme_fabrics 00:12:08.251 rmmod nvme_keyring 00:12:08.251 03:28:48 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:12:08.251 03:28:48 -- nvmf/common.sh@123 -- # set -e 00:12:08.251 03:28:48 -- nvmf/common.sh@124 -- # return 0 00:12:08.251 03:28:48 -- nvmf/common.sh@477 -- # '[' -n 2998592 ']' 00:12:08.251 03:28:48 -- nvmf/common.sh@478 -- # killprocess 2998592 00:12:08.251 03:28:48 -- common/autotest_common.sh@936 -- # '[' -z 2998592 ']' 00:12:08.251 03:28:48 -- common/autotest_common.sh@940 -- # kill -0 2998592 00:12:08.251 03:28:48 -- common/autotest_common.sh@941 -- # uname 00:12:08.251 03:28:48 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:12:08.251 03:28:48 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2998592 00:12:08.251 03:28:48 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:12:08.251 03:28:48 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:12:08.251 03:28:48 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2998592' 00:12:08.251 killing process with pid 2998592 00:12:08.251 03:28:48 -- common/autotest_common.sh@955 -- # kill 2998592 00:12:08.252 03:28:48 -- common/autotest_common.sh@960 -- # wait 2998592 00:12:08.815 03:28:49 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:12:08.815 03:28:49 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:12:08.815 03:28:49 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:12:08.816 03:28:49 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:08.816 03:28:49 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:12:08.816 03:28:49 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:08.816 03:28:49 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:08.816 03:28:49 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:10.722 03:28:51 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:12:10.722 00:12:10.722 real 0m26.454s 00:12:10.722 user 1m25.599s 00:12:10.722 sys 0m4.437s 00:12:10.722 03:28:51 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:12:10.722 03:28:51 -- common/autotest_common.sh@10 -- # set +x 00:12:10.722 ************************************ 00:12:10.722 END TEST nvmf_rpc 00:12:10.722 ************************************ 00:12:10.722 03:28:51 -- nvmf/nvmf.sh@30 -- # run_test nvmf_invalid /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:12:10.722 03:28:51 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:12:10.722 03:28:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:12:10.722 03:28:51 -- common/autotest_common.sh@10 -- # set +x 00:12:10.722 ************************************ 00:12:10.722 START TEST nvmf_invalid 00:12:10.722 ************************************ 00:12:10.722 03:28:51 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:12:10.722 * Looking for test storage... 00:12:10.722 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:10.722 03:28:51 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:12:10.722 03:28:51 -- common/autotest_common.sh@1690 -- # lcov --version 00:12:10.722 03:28:51 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:12:10.722 03:28:51 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:12:10.723 03:28:51 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:12:10.723 03:28:51 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:12:10.723 03:28:51 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:12:10.723 03:28:51 -- scripts/common.sh@335 -- # IFS=.-: 00:12:10.723 03:28:51 -- scripts/common.sh@335 -- # read -ra ver1 00:12:10.723 03:28:51 -- scripts/common.sh@336 -- # IFS=.-: 00:12:10.723 03:28:51 -- scripts/common.sh@336 -- # read -ra ver2 00:12:10.983 03:28:51 -- scripts/common.sh@337 -- # local 'op=<' 00:12:10.983 03:28:51 -- scripts/common.sh@339 -- # ver1_l=2 00:12:10.983 03:28:51 -- scripts/common.sh@340 -- # ver2_l=1 00:12:10.983 03:28:51 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:12:10.983 03:28:51 -- scripts/common.sh@343 -- # case "$op" in 00:12:10.983 03:28:51 -- scripts/common.sh@344 -- # : 1 00:12:10.983 03:28:51 -- scripts/common.sh@363 -- # (( v = 0 )) 00:12:10.983 03:28:51 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:12:10.983 03:28:51 -- scripts/common.sh@364 -- # decimal 1 00:12:10.983 03:28:51 -- scripts/common.sh@352 -- # local d=1 00:12:10.983 03:28:51 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:12:10.983 03:28:51 -- scripts/common.sh@354 -- # echo 1 00:12:10.983 03:28:51 -- scripts/common.sh@364 -- # ver1[v]=1 00:12:10.983 03:28:51 -- scripts/common.sh@365 -- # decimal 2 00:12:10.983 03:28:51 -- scripts/common.sh@352 -- # local d=2 00:12:10.983 03:28:51 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:12:10.983 03:28:51 -- scripts/common.sh@354 -- # echo 2 00:12:10.983 03:28:51 -- scripts/common.sh@365 -- # ver2[v]=2 00:12:10.983 03:28:51 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:12:10.983 03:28:51 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:12:10.983 03:28:51 -- scripts/common.sh@367 -- # return 0 00:12:10.983 03:28:51 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:12:10.983 03:28:51 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:12:10.983 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:10.983 --rc genhtml_branch_coverage=1 00:12:10.983 --rc genhtml_function_coverage=1 00:12:10.983 --rc genhtml_legend=1 00:12:10.983 --rc geninfo_all_blocks=1 00:12:10.983 --rc geninfo_unexecuted_blocks=1 00:12:10.983 00:12:10.983 ' 00:12:10.983 03:28:51 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:12:10.983 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:10.983 --rc genhtml_branch_coverage=1 00:12:10.983 --rc genhtml_function_coverage=1 00:12:10.983 --rc genhtml_legend=1 00:12:10.983 --rc geninfo_all_blocks=1 00:12:10.983 --rc geninfo_unexecuted_blocks=1 00:12:10.983 00:12:10.983 ' 00:12:10.983 03:28:51 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:12:10.983 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:10.983 --rc genhtml_branch_coverage=1 00:12:10.983 --rc genhtml_function_coverage=1 00:12:10.983 --rc genhtml_legend=1 00:12:10.983 --rc geninfo_all_blocks=1 00:12:10.983 --rc geninfo_unexecuted_blocks=1 00:12:10.983 00:12:10.983 ' 00:12:10.983 03:28:51 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:12:10.983 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:10.983 --rc genhtml_branch_coverage=1 00:12:10.983 --rc genhtml_function_coverage=1 00:12:10.983 --rc genhtml_legend=1 00:12:10.983 --rc geninfo_all_blocks=1 00:12:10.983 --rc geninfo_unexecuted_blocks=1 00:12:10.983 00:12:10.983 ' 00:12:10.983 03:28:51 -- target/invalid.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:10.983 03:28:51 -- nvmf/common.sh@7 -- # uname -s 00:12:10.983 03:28:51 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:10.983 03:28:51 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:10.983 03:28:51 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:10.983 03:28:51 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:10.983 03:28:51 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:10.983 03:28:51 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:10.983 03:28:51 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:10.983 03:28:51 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:10.983 03:28:51 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:10.983 03:28:51 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:10.983 03:28:51 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:10.983 03:28:51 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:12:10.983 03:28:51 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:10.983 03:28:51 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:10.983 03:28:51 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:10.983 03:28:51 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:10.983 03:28:51 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:10.983 03:28:51 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:10.983 03:28:51 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:10.983 03:28:51 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:10.983 03:28:51 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:10.983 03:28:51 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:10.983 03:28:51 -- paths/export.sh@5 -- # export PATH 00:12:10.983 03:28:51 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:10.983 03:28:51 -- nvmf/common.sh@46 -- # : 0 00:12:10.983 03:28:51 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:12:10.983 03:28:51 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:12:10.983 03:28:51 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:12:10.983 03:28:51 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:10.983 03:28:51 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:10.983 03:28:51 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:12:10.983 03:28:51 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:12:10.983 03:28:51 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:12:10.983 03:28:51 -- target/invalid.sh@11 -- # multi_target_rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:12:10.983 03:28:51 -- target/invalid.sh@12 -- # rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:12:10.983 03:28:51 -- target/invalid.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode 00:12:10.983 03:28:51 -- target/invalid.sh@14 -- # target=foobar 00:12:10.983 03:28:51 -- target/invalid.sh@16 -- # RANDOM=0 00:12:10.983 03:28:51 -- target/invalid.sh@34 -- # nvmftestinit 00:12:10.983 03:28:51 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:12:10.983 03:28:51 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:10.983 03:28:51 -- nvmf/common.sh@436 -- # prepare_net_devs 00:12:10.983 03:28:51 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:12:10.983 03:28:51 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:12:10.983 03:28:51 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:10.983 03:28:51 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:10.983 03:28:51 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:10.983 03:28:51 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:12:10.983 03:28:51 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:12:10.983 03:28:51 -- nvmf/common.sh@284 -- # xtrace_disable 00:12:10.983 03:28:51 -- common/autotest_common.sh@10 -- # set +x 00:12:12.893 03:28:53 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:12.893 03:28:53 -- nvmf/common.sh@290 -- # pci_devs=() 00:12:12.893 03:28:53 -- nvmf/common.sh@290 -- # local -a pci_devs 00:12:12.893 03:28:53 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:12:12.893 03:28:53 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:12:12.893 03:28:53 -- nvmf/common.sh@292 -- # pci_drivers=() 00:12:12.893 03:28:53 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:12:12.893 03:28:53 -- nvmf/common.sh@294 -- # net_devs=() 00:12:12.893 03:28:53 -- nvmf/common.sh@294 -- # local -ga net_devs 00:12:12.893 03:28:53 -- nvmf/common.sh@295 -- # e810=() 00:12:12.893 03:28:53 -- nvmf/common.sh@295 -- # local -ga e810 00:12:12.893 03:28:53 -- nvmf/common.sh@296 -- # x722=() 00:12:12.893 03:28:53 -- nvmf/common.sh@296 -- # local -ga x722 00:12:12.893 03:28:53 -- nvmf/common.sh@297 -- # mlx=() 00:12:12.893 03:28:53 -- nvmf/common.sh@297 -- # local -ga mlx 00:12:12.894 03:28:53 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:12.894 03:28:53 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:12.894 03:28:53 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:12.894 03:28:53 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:12.894 03:28:53 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:12.894 03:28:53 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:12.894 03:28:53 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:12.894 03:28:53 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:12.894 03:28:53 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:12.894 03:28:53 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:12.894 03:28:53 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:12.894 03:28:53 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:12:12.894 03:28:53 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:12:12.894 03:28:53 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:12:12.894 03:28:53 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:12:12.894 03:28:53 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:12:12.894 03:28:53 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:12:12.894 03:28:53 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:12.894 03:28:53 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:12:12.894 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:12:12.894 03:28:53 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:12.894 03:28:53 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:12.894 03:28:53 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:12.894 03:28:53 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:12.894 03:28:53 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:12.894 03:28:53 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:12.894 03:28:53 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:12:12.894 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:12:12.894 03:28:53 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:12.894 03:28:53 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:12.894 03:28:53 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:12.894 03:28:53 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:12.894 03:28:53 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:12.894 03:28:53 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:12:12.894 03:28:53 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:12:12.894 03:28:53 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:12:12.894 03:28:53 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:12.894 03:28:53 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:12.894 03:28:53 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:12.894 03:28:53 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:12.894 03:28:53 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:12:12.894 Found net devices under 0000:0a:00.0: cvl_0_0 00:12:12.894 03:28:53 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:12.894 03:28:53 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:12.894 03:28:53 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:12.894 03:28:53 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:12.894 03:28:53 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:12.894 03:28:53 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:12:12.894 Found net devices under 0000:0a:00.1: cvl_0_1 00:12:12.894 03:28:53 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:12.894 03:28:53 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:12:12.894 03:28:53 -- nvmf/common.sh@402 -- # is_hw=yes 00:12:12.894 03:28:53 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:12:12.894 03:28:53 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:12:12.894 03:28:53 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:12:12.894 03:28:53 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:12.894 03:28:53 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:12.894 03:28:53 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:12.894 03:28:53 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:12:12.894 03:28:53 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:12.894 03:28:53 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:12.894 03:28:53 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:12:12.894 03:28:53 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:12.894 03:28:53 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:12.894 03:28:53 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:12:12.894 03:28:53 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:12:12.894 03:28:53 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:12:12.894 03:28:53 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:12.894 03:28:53 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:12.894 03:28:53 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:12.894 03:28:53 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:12:12.894 03:28:53 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:12.894 03:28:53 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:12.894 03:28:53 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:12.894 03:28:53 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:12:12.894 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:12.894 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.248 ms 00:12:12.894 00:12:12.894 --- 10.0.0.2 ping statistics --- 00:12:12.894 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:12.894 rtt min/avg/max/mdev = 0.248/0.248/0.248/0.000 ms 00:12:12.894 03:28:53 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:12.894 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:12.894 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.118 ms 00:12:12.894 00:12:12.894 --- 10.0.0.1 ping statistics --- 00:12:12.894 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:12.894 rtt min/avg/max/mdev = 0.118/0.118/0.118/0.000 ms 00:12:12.894 03:28:53 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:12.894 03:28:53 -- nvmf/common.sh@410 -- # return 0 00:12:12.894 03:28:53 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:12:12.894 03:28:53 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:12.894 03:28:53 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:12:12.894 03:28:53 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:12:12.894 03:28:53 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:12.894 03:28:53 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:12:12.894 03:28:53 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:12:13.153 03:28:53 -- target/invalid.sh@35 -- # nvmfappstart -m 0xF 00:12:13.153 03:28:53 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:12:13.153 03:28:53 -- common/autotest_common.sh@722 -- # xtrace_disable 00:12:13.153 03:28:53 -- common/autotest_common.sh@10 -- # set +x 00:12:13.153 03:28:53 -- nvmf/common.sh@469 -- # nvmfpid=3003325 00:12:13.153 03:28:53 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:12:13.153 03:28:53 -- nvmf/common.sh@470 -- # waitforlisten 3003325 00:12:13.153 03:28:53 -- common/autotest_common.sh@829 -- # '[' -z 3003325 ']' 00:12:13.153 03:28:53 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:13.153 03:28:53 -- common/autotest_common.sh@834 -- # local max_retries=100 00:12:13.153 03:28:53 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:13.153 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:13.153 03:28:53 -- common/autotest_common.sh@838 -- # xtrace_disable 00:12:13.153 03:28:53 -- common/autotest_common.sh@10 -- # set +x 00:12:13.153 [2024-11-21 03:28:53.589281] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:12:13.153 [2024-11-21 03:28:53.589386] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:13.153 EAL: No free 2048 kB hugepages reported on node 1 00:12:13.153 [2024-11-21 03:28:53.656831] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:12:13.153 [2024-11-21 03:28:53.775536] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:13.153 [2024-11-21 03:28:53.775700] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:13.153 [2024-11-21 03:28:53.775719] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:13.153 [2024-11-21 03:28:53.775733] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:13.153 [2024-11-21 03:28:53.775816] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:13.153 [2024-11-21 03:28:53.775873] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:13.153 [2024-11-21 03:28:53.775923] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:13.153 [2024-11-21 03:28:53.775926] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:12:14.092 03:28:54 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:12:14.092 03:28:54 -- common/autotest_common.sh@862 -- # return 0 00:12:14.092 03:28:54 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:14.092 03:28:54 -- common/autotest_common.sh@728 -- # xtrace_disable 00:12:14.092 03:28:54 -- common/autotest_common.sh@10 -- # set +x 00:12:14.092 03:28:54 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:14.092 03:28:54 -- target/invalid.sh@37 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:12:14.092 03:28:54 -- target/invalid.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -t foobar nqn.2016-06.io.spdk:cnode13591 00:12:14.351 [2024-11-21 03:28:54.867587] nvmf_rpc.c: 401:rpc_nvmf_create_subsystem: *ERROR*: Unable to find target foobar 00:12:14.351 03:28:54 -- target/invalid.sh@40 -- # out='request: 00:12:14.351 { 00:12:14.351 "nqn": "nqn.2016-06.io.spdk:cnode13591", 00:12:14.351 "tgt_name": "foobar", 00:12:14.351 "method": "nvmf_create_subsystem", 00:12:14.351 "req_id": 1 00:12:14.351 } 00:12:14.351 Got JSON-RPC error response 00:12:14.351 response: 00:12:14.351 { 00:12:14.351 "code": -32603, 00:12:14.351 "message": "Unable to find target foobar" 00:12:14.351 }' 00:12:14.351 03:28:54 -- target/invalid.sh@41 -- # [[ request: 00:12:14.351 { 00:12:14.351 "nqn": "nqn.2016-06.io.spdk:cnode13591", 00:12:14.351 "tgt_name": "foobar", 00:12:14.351 "method": "nvmf_create_subsystem", 00:12:14.351 "req_id": 1 00:12:14.351 } 00:12:14.351 Got JSON-RPC error response 00:12:14.351 response: 00:12:14.351 { 00:12:14.351 "code": -32603, 00:12:14.351 "message": "Unable to find target foobar" 00:12:14.351 } == *\U\n\a\b\l\e\ \t\o\ \f\i\n\d\ \t\a\r\g\e\t* ]] 00:12:14.351 03:28:54 -- target/invalid.sh@45 -- # echo -e '\x1f' 00:12:14.351 03:28:54 -- target/invalid.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s $'SPDKISFASTANDAWESOME\037' nqn.2016-06.io.spdk:cnode25423 00:12:14.610 [2024-11-21 03:28:55.124466] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode25423: invalid serial number 'SPDKISFASTANDAWESOME' 00:12:14.610 03:28:55 -- target/invalid.sh@45 -- # out='request: 00:12:14.610 { 00:12:14.610 "nqn": "nqn.2016-06.io.spdk:cnode25423", 00:12:14.610 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:12:14.610 "method": "nvmf_create_subsystem", 00:12:14.610 "req_id": 1 00:12:14.610 } 00:12:14.610 Got JSON-RPC error response 00:12:14.610 response: 00:12:14.610 { 00:12:14.610 "code": -32602, 00:12:14.610 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:12:14.610 }' 00:12:14.610 03:28:55 -- target/invalid.sh@46 -- # [[ request: 00:12:14.610 { 00:12:14.610 "nqn": "nqn.2016-06.io.spdk:cnode25423", 00:12:14.610 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:12:14.610 "method": "nvmf_create_subsystem", 00:12:14.610 "req_id": 1 00:12:14.610 } 00:12:14.610 Got JSON-RPC error response 00:12:14.610 response: 00:12:14.610 { 00:12:14.610 "code": -32602, 00:12:14.610 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:12:14.610 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:12:14.610 03:28:55 -- target/invalid.sh@50 -- # echo -e '\x1f' 00:12:14.610 03:28:55 -- target/invalid.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d $'SPDK_Controller\037' nqn.2016-06.io.spdk:cnode2696 00:12:14.869 [2024-11-21 03:28:55.377270] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode2696: invalid model number 'SPDK_Controller' 00:12:14.869 03:28:55 -- target/invalid.sh@50 -- # out='request: 00:12:14.869 { 00:12:14.869 "nqn": "nqn.2016-06.io.spdk:cnode2696", 00:12:14.869 "model_number": "SPDK_Controller\u001f", 00:12:14.869 "method": "nvmf_create_subsystem", 00:12:14.869 "req_id": 1 00:12:14.869 } 00:12:14.869 Got JSON-RPC error response 00:12:14.869 response: 00:12:14.869 { 00:12:14.869 "code": -32602, 00:12:14.869 "message": "Invalid MN SPDK_Controller\u001f" 00:12:14.869 }' 00:12:14.869 03:28:55 -- target/invalid.sh@51 -- # [[ request: 00:12:14.869 { 00:12:14.869 "nqn": "nqn.2016-06.io.spdk:cnode2696", 00:12:14.869 "model_number": "SPDK_Controller\u001f", 00:12:14.869 "method": "nvmf_create_subsystem", 00:12:14.869 "req_id": 1 00:12:14.869 } 00:12:14.869 Got JSON-RPC error response 00:12:14.869 response: 00:12:14.869 { 00:12:14.869 "code": -32602, 00:12:14.869 "message": "Invalid MN SPDK_Controller\u001f" 00:12:14.869 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:12:14.869 03:28:55 -- target/invalid.sh@54 -- # gen_random_s 21 00:12:14.869 03:28:55 -- target/invalid.sh@19 -- # local length=21 ll 00:12:14.869 03:28:55 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:12:14.869 03:28:55 -- target/invalid.sh@21 -- # local chars 00:12:14.869 03:28:55 -- target/invalid.sh@22 -- # local string 00:12:14.869 03:28:55 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:12:14.869 03:28:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:14.869 03:28:55 -- target/invalid.sh@25 -- # printf %x 105 00:12:14.869 03:28:55 -- target/invalid.sh@25 -- # echo -e '\x69' 00:12:14.869 03:28:55 -- target/invalid.sh@25 -- # string+=i 00:12:14.869 03:28:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:14.869 03:28:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:14.869 03:28:55 -- target/invalid.sh@25 -- # printf %x 57 00:12:14.869 03:28:55 -- target/invalid.sh@25 -- # echo -e '\x39' 00:12:14.869 03:28:55 -- target/invalid.sh@25 -- # string+=9 00:12:14.869 03:28:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:14.869 03:28:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:14.869 03:28:55 -- target/invalid.sh@25 -- # printf %x 115 00:12:14.869 03:28:55 -- target/invalid.sh@25 -- # echo -e '\x73' 00:12:14.869 03:28:55 -- target/invalid.sh@25 -- # string+=s 00:12:14.870 03:28:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:14.870 03:28:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:14.870 03:28:55 -- target/invalid.sh@25 -- # printf %x 38 00:12:14.870 03:28:55 -- target/invalid.sh@25 -- # echo -e '\x26' 00:12:14.870 03:28:55 -- target/invalid.sh@25 -- # string+='&' 00:12:14.870 03:28:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:14.870 03:28:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:14.870 03:28:55 -- target/invalid.sh@25 -- # printf %x 40 00:12:14.870 03:28:55 -- target/invalid.sh@25 -- # echo -e '\x28' 00:12:14.870 03:28:55 -- target/invalid.sh@25 -- # string+='(' 00:12:14.870 03:28:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:14.870 03:28:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:14.870 03:28:55 -- target/invalid.sh@25 -- # printf %x 126 00:12:14.870 03:28:55 -- target/invalid.sh@25 -- # echo -e '\x7e' 00:12:14.870 03:28:55 -- target/invalid.sh@25 -- # string+='~' 00:12:14.870 03:28:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:14.870 03:28:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:14.870 03:28:55 -- target/invalid.sh@25 -- # printf %x 65 00:12:14.870 03:28:55 -- target/invalid.sh@25 -- # echo -e '\x41' 00:12:14.870 03:28:55 -- target/invalid.sh@25 -- # string+=A 00:12:14.870 03:28:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:14.870 03:28:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:14.870 03:28:55 -- target/invalid.sh@25 -- # printf %x 124 00:12:14.870 03:28:55 -- target/invalid.sh@25 -- # echo -e '\x7c' 00:12:14.870 03:28:55 -- target/invalid.sh@25 -- # string+='|' 00:12:14.870 03:28:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:14.870 03:28:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:14.870 03:28:55 -- target/invalid.sh@25 -- # printf %x 98 00:12:14.870 03:28:55 -- target/invalid.sh@25 -- # echo -e '\x62' 00:12:14.870 03:28:55 -- target/invalid.sh@25 -- # string+=b 00:12:14.870 03:28:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:14.870 03:28:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:14.870 03:28:55 -- target/invalid.sh@25 -- # printf %x 89 00:12:14.870 03:28:55 -- target/invalid.sh@25 -- # echo -e '\x59' 00:12:14.870 03:28:55 -- target/invalid.sh@25 -- # string+=Y 00:12:14.870 03:28:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:14.870 03:28:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:14.870 03:28:55 -- target/invalid.sh@25 -- # printf %x 63 00:12:14.870 03:28:55 -- target/invalid.sh@25 -- # echo -e '\x3f' 00:12:14.870 03:28:55 -- target/invalid.sh@25 -- # string+='?' 00:12:14.870 03:28:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:14.870 03:28:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:14.870 03:28:55 -- target/invalid.sh@25 -- # printf %x 46 00:12:14.870 03:28:55 -- target/invalid.sh@25 -- # echo -e '\x2e' 00:12:14.870 03:28:55 -- target/invalid.sh@25 -- # string+=. 00:12:14.870 03:28:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:14.870 03:28:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:14.870 03:28:55 -- target/invalid.sh@25 -- # printf %x 96 00:12:14.870 03:28:55 -- target/invalid.sh@25 -- # echo -e '\x60' 00:12:14.870 03:28:55 -- target/invalid.sh@25 -- # string+='`' 00:12:14.870 03:28:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:14.870 03:28:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:14.870 03:28:55 -- target/invalid.sh@25 -- # printf %x 77 00:12:14.870 03:28:55 -- target/invalid.sh@25 -- # echo -e '\x4d' 00:12:14.870 03:28:55 -- target/invalid.sh@25 -- # string+=M 00:12:14.870 03:28:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:14.870 03:28:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:14.870 03:28:55 -- target/invalid.sh@25 -- # printf %x 120 00:12:14.870 03:28:55 -- target/invalid.sh@25 -- # echo -e '\x78' 00:12:14.870 03:28:55 -- target/invalid.sh@25 -- # string+=x 00:12:14.870 03:28:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:14.870 03:28:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:14.870 03:28:55 -- target/invalid.sh@25 -- # printf %x 92 00:12:14.870 03:28:55 -- target/invalid.sh@25 -- # echo -e '\x5c' 00:12:14.870 03:28:55 -- target/invalid.sh@25 -- # string+='\' 00:12:14.870 03:28:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:14.870 03:28:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:14.870 03:28:55 -- target/invalid.sh@25 -- # printf %x 58 00:12:14.870 03:28:55 -- target/invalid.sh@25 -- # echo -e '\x3a' 00:12:14.870 03:28:55 -- target/invalid.sh@25 -- # string+=: 00:12:14.870 03:28:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:14.870 03:28:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:14.870 03:28:55 -- target/invalid.sh@25 -- # printf %x 126 00:12:14.870 03:28:55 -- target/invalid.sh@25 -- # echo -e '\x7e' 00:12:14.870 03:28:55 -- target/invalid.sh@25 -- # string+='~' 00:12:14.870 03:28:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:14.870 03:28:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:14.870 03:28:55 -- target/invalid.sh@25 -- # printf %x 98 00:12:14.870 03:28:55 -- target/invalid.sh@25 -- # echo -e '\x62' 00:12:14.870 03:28:55 -- target/invalid.sh@25 -- # string+=b 00:12:14.870 03:28:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:14.870 03:28:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:14.870 03:28:55 -- target/invalid.sh@25 -- # printf %x 67 00:12:14.870 03:28:55 -- target/invalid.sh@25 -- # echo -e '\x43' 00:12:14.870 03:28:55 -- target/invalid.sh@25 -- # string+=C 00:12:14.870 03:28:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:14.870 03:28:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:14.870 03:28:55 -- target/invalid.sh@25 -- # printf %x 90 00:12:14.870 03:28:55 -- target/invalid.sh@25 -- # echo -e '\x5a' 00:12:14.870 03:28:55 -- target/invalid.sh@25 -- # string+=Z 00:12:14.870 03:28:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:14.870 03:28:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:14.870 03:28:55 -- target/invalid.sh@28 -- # [[ i == \- ]] 00:12:14.870 03:28:55 -- target/invalid.sh@31 -- # echo 'i9s&(~A|bY?.`Mx\:~bCZ' 00:12:14.870 03:28:55 -- target/invalid.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s 'i9s&(~A|bY?.`Mx\:~bCZ' nqn.2016-06.io.spdk:cnode27048 00:12:15.129 [2024-11-21 03:28:55.726418] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode27048: invalid serial number 'i9s&(~A|bY?.`Mx\:~bCZ' 00:12:15.129 03:28:55 -- target/invalid.sh@54 -- # out='request: 00:12:15.129 { 00:12:15.129 "nqn": "nqn.2016-06.io.spdk:cnode27048", 00:12:15.129 "serial_number": "i9s&(~A|bY?.`Mx\\:~bCZ", 00:12:15.129 "method": "nvmf_create_subsystem", 00:12:15.129 "req_id": 1 00:12:15.129 } 00:12:15.129 Got JSON-RPC error response 00:12:15.129 response: 00:12:15.129 { 00:12:15.129 "code": -32602, 00:12:15.129 "message": "Invalid SN i9s&(~A|bY?.`Mx\\:~bCZ" 00:12:15.129 }' 00:12:15.129 03:28:55 -- target/invalid.sh@55 -- # [[ request: 00:12:15.129 { 00:12:15.129 "nqn": "nqn.2016-06.io.spdk:cnode27048", 00:12:15.129 "serial_number": "i9s&(~A|bY?.`Mx\\:~bCZ", 00:12:15.129 "method": "nvmf_create_subsystem", 00:12:15.129 "req_id": 1 00:12:15.129 } 00:12:15.129 Got JSON-RPC error response 00:12:15.129 response: 00:12:15.129 { 00:12:15.129 "code": -32602, 00:12:15.129 "message": "Invalid SN i9s&(~A|bY?.`Mx\\:~bCZ" 00:12:15.129 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:12:15.129 03:28:55 -- target/invalid.sh@58 -- # gen_random_s 41 00:12:15.130 03:28:55 -- target/invalid.sh@19 -- # local length=41 ll 00:12:15.130 03:28:55 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:12:15.130 03:28:55 -- target/invalid.sh@21 -- # local chars 00:12:15.130 03:28:55 -- target/invalid.sh@22 -- # local string 00:12:15.130 03:28:55 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:12:15.130 03:28:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:15.130 03:28:55 -- target/invalid.sh@25 -- # printf %x 91 00:12:15.130 03:28:55 -- target/invalid.sh@25 -- # echo -e '\x5b' 00:12:15.130 03:28:55 -- target/invalid.sh@25 -- # string+='[' 00:12:15.130 03:28:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:15.130 03:28:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:15.130 03:28:55 -- target/invalid.sh@25 -- # printf %x 110 00:12:15.130 03:28:55 -- target/invalid.sh@25 -- # echo -e '\x6e' 00:12:15.130 03:28:55 -- target/invalid.sh@25 -- # string+=n 00:12:15.130 03:28:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:15.130 03:28:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:15.130 03:28:55 -- target/invalid.sh@25 -- # printf %x 69 00:12:15.130 03:28:55 -- target/invalid.sh@25 -- # echo -e '\x45' 00:12:15.130 03:28:55 -- target/invalid.sh@25 -- # string+=E 00:12:15.130 03:28:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:15.130 03:28:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:15.130 03:28:55 -- target/invalid.sh@25 -- # printf %x 33 00:12:15.130 03:28:55 -- target/invalid.sh@25 -- # echo -e '\x21' 00:12:15.130 03:28:55 -- target/invalid.sh@25 -- # string+='!' 00:12:15.130 03:28:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:15.130 03:28:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:15.130 03:28:55 -- target/invalid.sh@25 -- # printf %x 86 00:12:15.130 03:28:55 -- target/invalid.sh@25 -- # echo -e '\x56' 00:12:15.130 03:28:55 -- target/invalid.sh@25 -- # string+=V 00:12:15.130 03:28:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:15.130 03:28:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:15.130 03:28:55 -- target/invalid.sh@25 -- # printf %x 54 00:12:15.130 03:28:55 -- target/invalid.sh@25 -- # echo -e '\x36' 00:12:15.130 03:28:55 -- target/invalid.sh@25 -- # string+=6 00:12:15.130 03:28:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:15.130 03:28:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:15.389 03:28:55 -- target/invalid.sh@25 -- # printf %x 33 00:12:15.389 03:28:55 -- target/invalid.sh@25 -- # echo -e '\x21' 00:12:15.389 03:28:55 -- target/invalid.sh@25 -- # string+='!' 00:12:15.389 03:28:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:15.389 03:28:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:15.389 03:28:55 -- target/invalid.sh@25 -- # printf %x 119 00:12:15.389 03:28:55 -- target/invalid.sh@25 -- # echo -e '\x77' 00:12:15.389 03:28:55 -- target/invalid.sh@25 -- # string+=w 00:12:15.389 03:28:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:15.389 03:28:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:15.389 03:28:55 -- target/invalid.sh@25 -- # printf %x 82 00:12:15.389 03:28:55 -- target/invalid.sh@25 -- # echo -e '\x52' 00:12:15.389 03:28:55 -- target/invalid.sh@25 -- # string+=R 00:12:15.389 03:28:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:15.389 03:28:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:15.389 03:28:55 -- target/invalid.sh@25 -- # printf %x 118 00:12:15.389 03:28:55 -- target/invalid.sh@25 -- # echo -e '\x76' 00:12:15.389 03:28:55 -- target/invalid.sh@25 -- # string+=v 00:12:15.389 03:28:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:15.389 03:28:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:15.389 03:28:55 -- target/invalid.sh@25 -- # printf %x 61 00:12:15.389 03:28:55 -- target/invalid.sh@25 -- # echo -e '\x3d' 00:12:15.389 03:28:55 -- target/invalid.sh@25 -- # string+== 00:12:15.389 03:28:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:15.389 03:28:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:15.389 03:28:55 -- target/invalid.sh@25 -- # printf %x 77 00:12:15.389 03:28:55 -- target/invalid.sh@25 -- # echo -e '\x4d' 00:12:15.389 03:28:55 -- target/invalid.sh@25 -- # string+=M 00:12:15.389 03:28:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:15.389 03:28:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:15.389 03:28:55 -- target/invalid.sh@25 -- # printf %x 68 00:12:15.389 03:28:55 -- target/invalid.sh@25 -- # echo -e '\x44' 00:12:15.389 03:28:55 -- target/invalid.sh@25 -- # string+=D 00:12:15.389 03:28:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:15.389 03:28:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:15.389 03:28:55 -- target/invalid.sh@25 -- # printf %x 86 00:12:15.389 03:28:55 -- target/invalid.sh@25 -- # echo -e '\x56' 00:12:15.389 03:28:55 -- target/invalid.sh@25 -- # string+=V 00:12:15.389 03:28:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:15.389 03:28:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:15.389 03:28:55 -- target/invalid.sh@25 -- # printf %x 91 00:12:15.389 03:28:55 -- target/invalid.sh@25 -- # echo -e '\x5b' 00:12:15.389 03:28:55 -- target/invalid.sh@25 -- # string+='[' 00:12:15.389 03:28:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:15.389 03:28:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:15.389 03:28:55 -- target/invalid.sh@25 -- # printf %x 107 00:12:15.389 03:28:55 -- target/invalid.sh@25 -- # echo -e '\x6b' 00:12:15.389 03:28:55 -- target/invalid.sh@25 -- # string+=k 00:12:15.389 03:28:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:15.389 03:28:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:15.389 03:28:55 -- target/invalid.sh@25 -- # printf %x 110 00:12:15.389 03:28:55 -- target/invalid.sh@25 -- # echo -e '\x6e' 00:12:15.389 03:28:55 -- target/invalid.sh@25 -- # string+=n 00:12:15.389 03:28:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:15.389 03:28:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:15.389 03:28:55 -- target/invalid.sh@25 -- # printf %x 87 00:12:15.389 03:28:55 -- target/invalid.sh@25 -- # echo -e '\x57' 00:12:15.389 03:28:55 -- target/invalid.sh@25 -- # string+=W 00:12:15.389 03:28:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:15.389 03:28:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:15.389 03:28:55 -- target/invalid.sh@25 -- # printf %x 57 00:12:15.389 03:28:55 -- target/invalid.sh@25 -- # echo -e '\x39' 00:12:15.389 03:28:55 -- target/invalid.sh@25 -- # string+=9 00:12:15.389 03:28:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:15.389 03:28:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:15.389 03:28:55 -- target/invalid.sh@25 -- # printf %x 56 00:12:15.389 03:28:55 -- target/invalid.sh@25 -- # echo -e '\x38' 00:12:15.389 03:28:55 -- target/invalid.sh@25 -- # string+=8 00:12:15.389 03:28:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:15.389 03:28:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:15.389 03:28:55 -- target/invalid.sh@25 -- # printf %x 65 00:12:15.389 03:28:55 -- target/invalid.sh@25 -- # echo -e '\x41' 00:12:15.389 03:28:55 -- target/invalid.sh@25 -- # string+=A 00:12:15.389 03:28:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:15.389 03:28:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:15.389 03:28:55 -- target/invalid.sh@25 -- # printf %x 73 00:12:15.389 03:28:55 -- target/invalid.sh@25 -- # echo -e '\x49' 00:12:15.389 03:28:55 -- target/invalid.sh@25 -- # string+=I 00:12:15.389 03:28:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:15.389 03:28:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:15.389 03:28:55 -- target/invalid.sh@25 -- # printf %x 41 00:12:15.389 03:28:55 -- target/invalid.sh@25 -- # echo -e '\x29' 00:12:15.389 03:28:55 -- target/invalid.sh@25 -- # string+=')' 00:12:15.389 03:28:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:15.389 03:28:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:15.389 03:28:55 -- target/invalid.sh@25 -- # printf %x 54 00:12:15.389 03:28:55 -- target/invalid.sh@25 -- # echo -e '\x36' 00:12:15.389 03:28:55 -- target/invalid.sh@25 -- # string+=6 00:12:15.389 03:28:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:15.389 03:28:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:15.389 03:28:55 -- target/invalid.sh@25 -- # printf %x 58 00:12:15.389 03:28:55 -- target/invalid.sh@25 -- # echo -e '\x3a' 00:12:15.389 03:28:55 -- target/invalid.sh@25 -- # string+=: 00:12:15.389 03:28:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:15.389 03:28:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:15.389 03:28:55 -- target/invalid.sh@25 -- # printf %x 122 00:12:15.389 03:28:55 -- target/invalid.sh@25 -- # echo -e '\x7a' 00:12:15.389 03:28:55 -- target/invalid.sh@25 -- # string+=z 00:12:15.389 03:28:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:15.389 03:28:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:15.389 03:28:55 -- target/invalid.sh@25 -- # printf %x 122 00:12:15.389 03:28:55 -- target/invalid.sh@25 -- # echo -e '\x7a' 00:12:15.389 03:28:55 -- target/invalid.sh@25 -- # string+=z 00:12:15.389 03:28:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:15.389 03:28:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:15.389 03:28:55 -- target/invalid.sh@25 -- # printf %x 115 00:12:15.390 03:28:55 -- target/invalid.sh@25 -- # echo -e '\x73' 00:12:15.390 03:28:55 -- target/invalid.sh@25 -- # string+=s 00:12:15.390 03:28:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:15.390 03:28:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:15.390 03:28:55 -- target/invalid.sh@25 -- # printf %x 54 00:12:15.390 03:28:55 -- target/invalid.sh@25 -- # echo -e '\x36' 00:12:15.390 03:28:55 -- target/invalid.sh@25 -- # string+=6 00:12:15.390 03:28:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:15.390 03:28:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:15.390 03:28:55 -- target/invalid.sh@25 -- # printf %x 67 00:12:15.390 03:28:55 -- target/invalid.sh@25 -- # echo -e '\x43' 00:12:15.390 03:28:55 -- target/invalid.sh@25 -- # string+=C 00:12:15.390 03:28:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:15.390 03:28:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:15.390 03:28:55 -- target/invalid.sh@25 -- # printf %x 110 00:12:15.390 03:28:55 -- target/invalid.sh@25 -- # echo -e '\x6e' 00:12:15.390 03:28:55 -- target/invalid.sh@25 -- # string+=n 00:12:15.390 03:28:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:15.390 03:28:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:15.390 03:28:55 -- target/invalid.sh@25 -- # printf %x 61 00:12:15.390 03:28:55 -- target/invalid.sh@25 -- # echo -e '\x3d' 00:12:15.390 03:28:55 -- target/invalid.sh@25 -- # string+== 00:12:15.390 03:28:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:15.390 03:28:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:15.390 03:28:55 -- target/invalid.sh@25 -- # printf %x 32 00:12:15.390 03:28:55 -- target/invalid.sh@25 -- # echo -e '\x20' 00:12:15.390 03:28:55 -- target/invalid.sh@25 -- # string+=' ' 00:12:15.390 03:28:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:15.390 03:28:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:15.390 03:28:55 -- target/invalid.sh@25 -- # printf %x 120 00:12:15.390 03:28:55 -- target/invalid.sh@25 -- # echo -e '\x78' 00:12:15.390 03:28:55 -- target/invalid.sh@25 -- # string+=x 00:12:15.390 03:28:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:15.390 03:28:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:15.390 03:28:55 -- target/invalid.sh@25 -- # printf %x 60 00:12:15.390 03:28:55 -- target/invalid.sh@25 -- # echo -e '\x3c' 00:12:15.390 03:28:55 -- target/invalid.sh@25 -- # string+='<' 00:12:15.390 03:28:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:15.390 03:28:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:15.390 03:28:55 -- target/invalid.sh@25 -- # printf %x 74 00:12:15.390 03:28:55 -- target/invalid.sh@25 -- # echo -e '\x4a' 00:12:15.390 03:28:55 -- target/invalid.sh@25 -- # string+=J 00:12:15.390 03:28:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:15.390 03:28:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:15.390 03:28:55 -- target/invalid.sh@25 -- # printf %x 105 00:12:15.390 03:28:55 -- target/invalid.sh@25 -- # echo -e '\x69' 00:12:15.390 03:28:55 -- target/invalid.sh@25 -- # string+=i 00:12:15.390 03:28:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:15.390 03:28:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:15.390 03:28:55 -- target/invalid.sh@25 -- # printf %x 103 00:12:15.390 03:28:55 -- target/invalid.sh@25 -- # echo -e '\x67' 00:12:15.390 03:28:55 -- target/invalid.sh@25 -- # string+=g 00:12:15.390 03:28:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:15.390 03:28:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:15.390 03:28:55 -- target/invalid.sh@25 -- # printf %x 102 00:12:15.390 03:28:55 -- target/invalid.sh@25 -- # echo -e '\x66' 00:12:15.390 03:28:55 -- target/invalid.sh@25 -- # string+=f 00:12:15.390 03:28:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:15.390 03:28:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:15.390 03:28:55 -- target/invalid.sh@25 -- # printf %x 72 00:12:15.390 03:28:55 -- target/invalid.sh@25 -- # echo -e '\x48' 00:12:15.390 03:28:55 -- target/invalid.sh@25 -- # string+=H 00:12:15.390 03:28:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:15.390 03:28:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:15.390 03:28:55 -- target/invalid.sh@25 -- # printf %x 52 00:12:15.390 03:28:55 -- target/invalid.sh@25 -- # echo -e '\x34' 00:12:15.390 03:28:55 -- target/invalid.sh@25 -- # string+=4 00:12:15.390 03:28:55 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:15.390 03:28:55 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:15.390 03:28:55 -- target/invalid.sh@28 -- # [[ [ == \- ]] 00:12:15.390 03:28:55 -- target/invalid.sh@31 -- # echo '[nE!V6!wRv=MDV[knW98AI)6:zzs6Cn= x /dev/null' 00:12:18.234 03:28:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:20.144 03:29:00 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:12:20.144 00:12:20.144 real 0m9.489s 00:12:20.144 user 0m23.400s 00:12:20.144 sys 0m2.456s 00:12:20.144 03:29:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:12:20.144 03:29:00 -- common/autotest_common.sh@10 -- # set +x 00:12:20.144 ************************************ 00:12:20.144 END TEST nvmf_invalid 00:12:20.144 ************************************ 00:12:20.144 03:29:00 -- nvmf/nvmf.sh@31 -- # run_test nvmf_abort /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:12:20.144 03:29:00 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:12:20.144 03:29:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:12:20.144 03:29:00 -- common/autotest_common.sh@10 -- # set +x 00:12:20.144 ************************************ 00:12:20.144 START TEST nvmf_abort 00:12:20.144 ************************************ 00:12:20.144 03:29:00 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:12:20.403 * Looking for test storage... 00:12:20.403 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:20.403 03:29:00 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:12:20.403 03:29:00 -- common/autotest_common.sh@1690 -- # lcov --version 00:12:20.403 03:29:00 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:12:20.403 03:29:00 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:12:20.403 03:29:00 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:12:20.403 03:29:00 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:12:20.403 03:29:00 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:12:20.403 03:29:00 -- scripts/common.sh@335 -- # IFS=.-: 00:12:20.403 03:29:00 -- scripts/common.sh@335 -- # read -ra ver1 00:12:20.403 03:29:00 -- scripts/common.sh@336 -- # IFS=.-: 00:12:20.403 03:29:00 -- scripts/common.sh@336 -- # read -ra ver2 00:12:20.404 03:29:00 -- scripts/common.sh@337 -- # local 'op=<' 00:12:20.404 03:29:00 -- scripts/common.sh@339 -- # ver1_l=2 00:12:20.404 03:29:00 -- scripts/common.sh@340 -- # ver2_l=1 00:12:20.404 03:29:00 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:12:20.404 03:29:00 -- scripts/common.sh@343 -- # case "$op" in 00:12:20.404 03:29:00 -- scripts/common.sh@344 -- # : 1 00:12:20.404 03:29:00 -- scripts/common.sh@363 -- # (( v = 0 )) 00:12:20.404 03:29:00 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:12:20.404 03:29:00 -- scripts/common.sh@364 -- # decimal 1 00:12:20.404 03:29:00 -- scripts/common.sh@352 -- # local d=1 00:12:20.404 03:29:00 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:12:20.404 03:29:00 -- scripts/common.sh@354 -- # echo 1 00:12:20.404 03:29:00 -- scripts/common.sh@364 -- # ver1[v]=1 00:12:20.404 03:29:00 -- scripts/common.sh@365 -- # decimal 2 00:12:20.404 03:29:00 -- scripts/common.sh@352 -- # local d=2 00:12:20.404 03:29:00 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:12:20.404 03:29:00 -- scripts/common.sh@354 -- # echo 2 00:12:20.404 03:29:00 -- scripts/common.sh@365 -- # ver2[v]=2 00:12:20.404 03:29:00 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:12:20.404 03:29:00 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:12:20.404 03:29:00 -- scripts/common.sh@367 -- # return 0 00:12:20.404 03:29:00 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:12:20.404 03:29:00 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:12:20.404 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:20.404 --rc genhtml_branch_coverage=1 00:12:20.404 --rc genhtml_function_coverage=1 00:12:20.404 --rc genhtml_legend=1 00:12:20.404 --rc geninfo_all_blocks=1 00:12:20.404 --rc geninfo_unexecuted_blocks=1 00:12:20.404 00:12:20.404 ' 00:12:20.404 03:29:00 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:12:20.404 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:20.404 --rc genhtml_branch_coverage=1 00:12:20.404 --rc genhtml_function_coverage=1 00:12:20.404 --rc genhtml_legend=1 00:12:20.404 --rc geninfo_all_blocks=1 00:12:20.404 --rc geninfo_unexecuted_blocks=1 00:12:20.404 00:12:20.404 ' 00:12:20.404 03:29:00 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:12:20.404 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:20.404 --rc genhtml_branch_coverage=1 00:12:20.404 --rc genhtml_function_coverage=1 00:12:20.404 --rc genhtml_legend=1 00:12:20.404 --rc geninfo_all_blocks=1 00:12:20.404 --rc geninfo_unexecuted_blocks=1 00:12:20.404 00:12:20.404 ' 00:12:20.404 03:29:00 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:12:20.404 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:20.404 --rc genhtml_branch_coverage=1 00:12:20.404 --rc genhtml_function_coverage=1 00:12:20.404 --rc genhtml_legend=1 00:12:20.404 --rc geninfo_all_blocks=1 00:12:20.404 --rc geninfo_unexecuted_blocks=1 00:12:20.404 00:12:20.404 ' 00:12:20.404 03:29:00 -- target/abort.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:20.404 03:29:00 -- nvmf/common.sh@7 -- # uname -s 00:12:20.404 03:29:00 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:20.404 03:29:00 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:20.404 03:29:00 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:20.404 03:29:00 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:20.404 03:29:00 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:20.404 03:29:00 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:20.404 03:29:00 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:20.404 03:29:00 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:20.404 03:29:00 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:20.404 03:29:00 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:20.404 03:29:00 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:20.404 03:29:00 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:12:20.404 03:29:00 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:20.404 03:29:00 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:20.404 03:29:00 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:20.404 03:29:00 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:20.404 03:29:00 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:20.404 03:29:00 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:20.404 03:29:00 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:20.404 03:29:00 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:20.404 03:29:00 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:20.404 03:29:00 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:20.404 03:29:00 -- paths/export.sh@5 -- # export PATH 00:12:20.404 03:29:00 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:20.404 03:29:00 -- nvmf/common.sh@46 -- # : 0 00:12:20.404 03:29:00 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:12:20.404 03:29:00 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:12:20.404 03:29:00 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:12:20.404 03:29:00 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:20.404 03:29:00 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:20.404 03:29:00 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:12:20.404 03:29:00 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:12:20.404 03:29:00 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:12:20.404 03:29:00 -- target/abort.sh@11 -- # MALLOC_BDEV_SIZE=64 00:12:20.404 03:29:00 -- target/abort.sh@12 -- # MALLOC_BLOCK_SIZE=4096 00:12:20.404 03:29:00 -- target/abort.sh@14 -- # nvmftestinit 00:12:20.404 03:29:00 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:12:20.404 03:29:00 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:20.404 03:29:00 -- nvmf/common.sh@436 -- # prepare_net_devs 00:12:20.404 03:29:00 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:12:20.404 03:29:00 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:12:20.404 03:29:00 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:20.404 03:29:00 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:20.404 03:29:00 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:20.404 03:29:00 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:12:20.404 03:29:00 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:12:20.404 03:29:00 -- nvmf/common.sh@284 -- # xtrace_disable 00:12:20.404 03:29:00 -- common/autotest_common.sh@10 -- # set +x 00:12:22.943 03:29:03 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:22.943 03:29:03 -- nvmf/common.sh@290 -- # pci_devs=() 00:12:22.943 03:29:03 -- nvmf/common.sh@290 -- # local -a pci_devs 00:12:22.943 03:29:03 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:12:22.943 03:29:03 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:12:22.943 03:29:03 -- nvmf/common.sh@292 -- # pci_drivers=() 00:12:22.943 03:29:03 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:12:22.943 03:29:03 -- nvmf/common.sh@294 -- # net_devs=() 00:12:22.943 03:29:03 -- nvmf/common.sh@294 -- # local -ga net_devs 00:12:22.943 03:29:03 -- nvmf/common.sh@295 -- # e810=() 00:12:22.943 03:29:03 -- nvmf/common.sh@295 -- # local -ga e810 00:12:22.943 03:29:03 -- nvmf/common.sh@296 -- # x722=() 00:12:22.943 03:29:03 -- nvmf/common.sh@296 -- # local -ga x722 00:12:22.943 03:29:03 -- nvmf/common.sh@297 -- # mlx=() 00:12:22.943 03:29:03 -- nvmf/common.sh@297 -- # local -ga mlx 00:12:22.943 03:29:03 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:22.943 03:29:03 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:22.943 03:29:03 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:22.943 03:29:03 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:22.943 03:29:03 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:22.943 03:29:03 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:22.943 03:29:03 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:22.943 03:29:03 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:22.943 03:29:03 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:22.943 03:29:03 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:22.943 03:29:03 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:22.944 03:29:03 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:12:22.944 03:29:03 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:12:22.944 03:29:03 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:12:22.944 03:29:03 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:12:22.944 03:29:03 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:12:22.944 03:29:03 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:12:22.944 03:29:03 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:22.944 03:29:03 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:12:22.944 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:12:22.944 03:29:03 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:22.944 03:29:03 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:22.944 03:29:03 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:22.944 03:29:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:22.944 03:29:03 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:22.944 03:29:03 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:22.944 03:29:03 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:12:22.944 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:12:22.944 03:29:03 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:22.944 03:29:03 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:22.944 03:29:03 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:22.944 03:29:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:22.944 03:29:03 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:22.944 03:29:03 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:12:22.944 03:29:03 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:12:22.944 03:29:03 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:12:22.944 03:29:03 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:22.944 03:29:03 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:22.944 03:29:03 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:22.944 03:29:03 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:22.944 03:29:03 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:12:22.944 Found net devices under 0000:0a:00.0: cvl_0_0 00:12:22.944 03:29:03 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:22.944 03:29:03 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:22.944 03:29:03 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:22.944 03:29:03 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:22.944 03:29:03 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:22.944 03:29:03 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:12:22.944 Found net devices under 0000:0a:00.1: cvl_0_1 00:12:22.944 03:29:03 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:22.944 03:29:03 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:12:22.944 03:29:03 -- nvmf/common.sh@402 -- # is_hw=yes 00:12:22.944 03:29:03 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:12:22.944 03:29:03 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:12:22.944 03:29:03 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:12:22.944 03:29:03 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:22.944 03:29:03 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:22.944 03:29:03 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:22.944 03:29:03 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:12:22.944 03:29:03 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:22.944 03:29:03 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:22.944 03:29:03 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:12:22.944 03:29:03 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:22.944 03:29:03 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:22.944 03:29:03 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:12:22.944 03:29:03 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:12:22.944 03:29:03 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:12:22.944 03:29:03 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:22.944 03:29:03 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:22.944 03:29:03 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:22.944 03:29:03 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:12:22.944 03:29:03 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:22.944 03:29:03 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:22.944 03:29:03 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:22.944 03:29:03 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:12:22.944 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:22.944 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.218 ms 00:12:22.944 00:12:22.944 --- 10.0.0.2 ping statistics --- 00:12:22.944 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:22.944 rtt min/avg/max/mdev = 0.218/0.218/0.218/0.000 ms 00:12:22.944 03:29:03 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:22.944 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:22.944 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.114 ms 00:12:22.944 00:12:22.944 --- 10.0.0.1 ping statistics --- 00:12:22.944 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:22.944 rtt min/avg/max/mdev = 0.114/0.114/0.114/0.000 ms 00:12:22.944 03:29:03 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:22.944 03:29:03 -- nvmf/common.sh@410 -- # return 0 00:12:22.944 03:29:03 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:12:22.944 03:29:03 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:22.944 03:29:03 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:12:22.944 03:29:03 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:12:22.944 03:29:03 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:22.944 03:29:03 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:12:22.944 03:29:03 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:12:22.944 03:29:03 -- target/abort.sh@15 -- # nvmfappstart -m 0xE 00:12:22.944 03:29:03 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:12:22.944 03:29:03 -- common/autotest_common.sh@722 -- # xtrace_disable 00:12:22.944 03:29:03 -- common/autotest_common.sh@10 -- # set +x 00:12:22.944 03:29:03 -- nvmf/common.sh@469 -- # nvmfpid=3006010 00:12:22.944 03:29:03 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:12:22.944 03:29:03 -- nvmf/common.sh@470 -- # waitforlisten 3006010 00:12:22.944 03:29:03 -- common/autotest_common.sh@829 -- # '[' -z 3006010 ']' 00:12:22.944 03:29:03 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:22.944 03:29:03 -- common/autotest_common.sh@834 -- # local max_retries=100 00:12:22.944 03:29:03 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:22.944 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:22.944 03:29:03 -- common/autotest_common.sh@838 -- # xtrace_disable 00:12:22.944 03:29:03 -- common/autotest_common.sh@10 -- # set +x 00:12:22.944 [2024-11-21 03:29:03.341335] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:12:22.944 [2024-11-21 03:29:03.341415] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:22.944 EAL: No free 2048 kB hugepages reported on node 1 00:12:22.944 [2024-11-21 03:29:03.414681] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:12:22.944 [2024-11-21 03:29:03.534936] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:22.944 [2024-11-21 03:29:03.535102] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:22.944 [2024-11-21 03:29:03.535133] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:22.944 [2024-11-21 03:29:03.535148] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:22.944 [2024-11-21 03:29:03.535245] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:22.944 [2024-11-21 03:29:03.535310] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:22.944 [2024-11-21 03:29:03.535313] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:23.881 03:29:04 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:12:23.881 03:29:04 -- common/autotest_common.sh@862 -- # return 0 00:12:23.881 03:29:04 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:23.881 03:29:04 -- common/autotest_common.sh@728 -- # xtrace_disable 00:12:23.881 03:29:04 -- common/autotest_common.sh@10 -- # set +x 00:12:23.881 03:29:04 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:23.881 03:29:04 -- target/abort.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -a 256 00:12:23.881 03:29:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:23.881 03:29:04 -- common/autotest_common.sh@10 -- # set +x 00:12:23.881 [2024-11-21 03:29:04.373271] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:23.881 03:29:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:23.881 03:29:04 -- target/abort.sh@20 -- # rpc_cmd bdev_malloc_create 64 4096 -b Malloc0 00:12:23.881 03:29:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:23.881 03:29:04 -- common/autotest_common.sh@10 -- # set +x 00:12:23.881 Malloc0 00:12:23.881 03:29:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:23.881 03:29:04 -- target/abort.sh@21 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:12:23.881 03:29:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:23.881 03:29:04 -- common/autotest_common.sh@10 -- # set +x 00:12:23.881 Delay0 00:12:23.881 03:29:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:23.881 03:29:04 -- target/abort.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:12:23.881 03:29:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:23.881 03:29:04 -- common/autotest_common.sh@10 -- # set +x 00:12:23.881 03:29:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:23.881 03:29:04 -- target/abort.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 Delay0 00:12:23.881 03:29:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:23.881 03:29:04 -- common/autotest_common.sh@10 -- # set +x 00:12:23.881 03:29:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:23.881 03:29:04 -- target/abort.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:12:23.881 03:29:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:23.881 03:29:04 -- common/autotest_common.sh@10 -- # set +x 00:12:23.881 [2024-11-21 03:29:04.448452] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:23.881 03:29:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:23.881 03:29:04 -- target/abort.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:12:23.881 03:29:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:23.881 03:29:04 -- common/autotest_common.sh@10 -- # set +x 00:12:23.881 03:29:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:23.881 03:29:04 -- target/abort.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0x1 -t 1 -l warning -q 128 00:12:23.881 EAL: No free 2048 kB hugepages reported on node 1 00:12:23.881 [2024-11-21 03:29:04.513410] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:12:26.418 Initializing NVMe Controllers 00:12:26.418 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:12:26.418 controller IO queue size 128 less than required 00:12:26.418 Consider using lower queue depth or small IO size because IO requests may be queued at the NVMe driver. 00:12:26.418 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 0 00:12:26.418 Initialization complete. Launching workers. 00:12:26.418 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 I/O completed: 126, failed: 33123 00:12:26.418 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) abort submitted 33187, failed to submit 62 00:12:26.418 success 33123, unsuccess 64, failed 0 00:12:26.418 03:29:06 -- target/abort.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:12:26.418 03:29:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:26.418 03:29:06 -- common/autotest_common.sh@10 -- # set +x 00:12:26.418 03:29:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:26.418 03:29:06 -- target/abort.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:12:26.418 03:29:06 -- target/abort.sh@38 -- # nvmftestfini 00:12:26.418 03:29:06 -- nvmf/common.sh@476 -- # nvmfcleanup 00:12:26.418 03:29:06 -- nvmf/common.sh@116 -- # sync 00:12:26.418 03:29:06 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:12:26.418 03:29:06 -- nvmf/common.sh@119 -- # set +e 00:12:26.418 03:29:06 -- nvmf/common.sh@120 -- # for i in {1..20} 00:12:26.418 03:29:06 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:12:26.418 rmmod nvme_tcp 00:12:26.418 rmmod nvme_fabrics 00:12:26.418 rmmod nvme_keyring 00:12:26.418 03:29:06 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:12:26.418 03:29:06 -- nvmf/common.sh@123 -- # set -e 00:12:26.418 03:29:06 -- nvmf/common.sh@124 -- # return 0 00:12:26.418 03:29:06 -- nvmf/common.sh@477 -- # '[' -n 3006010 ']' 00:12:26.418 03:29:06 -- nvmf/common.sh@478 -- # killprocess 3006010 00:12:26.418 03:29:06 -- common/autotest_common.sh@936 -- # '[' -z 3006010 ']' 00:12:26.419 03:29:06 -- common/autotest_common.sh@940 -- # kill -0 3006010 00:12:26.419 03:29:06 -- common/autotest_common.sh@941 -- # uname 00:12:26.419 03:29:06 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:12:26.419 03:29:06 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3006010 00:12:26.419 03:29:06 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:12:26.419 03:29:06 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:12:26.419 03:29:06 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3006010' 00:12:26.419 killing process with pid 3006010 00:12:26.419 03:29:06 -- common/autotest_common.sh@955 -- # kill 3006010 00:12:26.419 03:29:06 -- common/autotest_common.sh@960 -- # wait 3006010 00:12:26.419 03:29:07 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:12:26.419 03:29:07 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:12:26.419 03:29:07 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:12:26.419 03:29:07 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:26.419 03:29:07 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:12:26.419 03:29:07 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:26.419 03:29:07 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:26.419 03:29:07 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:28.961 03:29:09 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:12:28.961 00:12:28.961 real 0m8.357s 00:12:28.961 user 0m13.148s 00:12:28.961 sys 0m2.610s 00:12:28.961 03:29:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:12:28.961 03:29:09 -- common/autotest_common.sh@10 -- # set +x 00:12:28.961 ************************************ 00:12:28.961 END TEST nvmf_abort 00:12:28.961 ************************************ 00:12:28.961 03:29:09 -- nvmf/nvmf.sh@32 -- # run_test nvmf_ns_hotplug_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:12:28.961 03:29:09 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:12:28.961 03:29:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:12:28.961 03:29:09 -- common/autotest_common.sh@10 -- # set +x 00:12:28.961 ************************************ 00:12:28.961 START TEST nvmf_ns_hotplug_stress 00:12:28.961 ************************************ 00:12:28.961 03:29:09 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:12:28.961 * Looking for test storage... 00:12:28.961 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:28.961 03:29:09 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:12:28.961 03:29:09 -- common/autotest_common.sh@1690 -- # lcov --version 00:12:28.961 03:29:09 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:12:28.961 03:29:09 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:12:28.961 03:29:09 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:12:28.961 03:29:09 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:12:28.961 03:29:09 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:12:28.961 03:29:09 -- scripts/common.sh@335 -- # IFS=.-: 00:12:28.961 03:29:09 -- scripts/common.sh@335 -- # read -ra ver1 00:12:28.961 03:29:09 -- scripts/common.sh@336 -- # IFS=.-: 00:12:28.961 03:29:09 -- scripts/common.sh@336 -- # read -ra ver2 00:12:28.961 03:29:09 -- scripts/common.sh@337 -- # local 'op=<' 00:12:28.961 03:29:09 -- scripts/common.sh@339 -- # ver1_l=2 00:12:28.961 03:29:09 -- scripts/common.sh@340 -- # ver2_l=1 00:12:28.961 03:29:09 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:12:28.961 03:29:09 -- scripts/common.sh@343 -- # case "$op" in 00:12:28.961 03:29:09 -- scripts/common.sh@344 -- # : 1 00:12:28.961 03:29:09 -- scripts/common.sh@363 -- # (( v = 0 )) 00:12:28.961 03:29:09 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:12:28.961 03:29:09 -- scripts/common.sh@364 -- # decimal 1 00:12:28.961 03:29:09 -- scripts/common.sh@352 -- # local d=1 00:12:28.961 03:29:09 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:12:28.961 03:29:09 -- scripts/common.sh@354 -- # echo 1 00:12:28.961 03:29:09 -- scripts/common.sh@364 -- # ver1[v]=1 00:12:28.961 03:29:09 -- scripts/common.sh@365 -- # decimal 2 00:12:28.961 03:29:09 -- scripts/common.sh@352 -- # local d=2 00:12:28.961 03:29:09 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:12:28.961 03:29:09 -- scripts/common.sh@354 -- # echo 2 00:12:28.961 03:29:09 -- scripts/common.sh@365 -- # ver2[v]=2 00:12:28.961 03:29:09 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:12:28.961 03:29:09 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:12:28.961 03:29:09 -- scripts/common.sh@367 -- # return 0 00:12:28.961 03:29:09 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:12:28.961 03:29:09 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:12:28.961 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:28.961 --rc genhtml_branch_coverage=1 00:12:28.961 --rc genhtml_function_coverage=1 00:12:28.961 --rc genhtml_legend=1 00:12:28.961 --rc geninfo_all_blocks=1 00:12:28.961 --rc geninfo_unexecuted_blocks=1 00:12:28.961 00:12:28.961 ' 00:12:28.961 03:29:09 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:12:28.961 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:28.961 --rc genhtml_branch_coverage=1 00:12:28.961 --rc genhtml_function_coverage=1 00:12:28.961 --rc genhtml_legend=1 00:12:28.961 --rc geninfo_all_blocks=1 00:12:28.961 --rc geninfo_unexecuted_blocks=1 00:12:28.961 00:12:28.961 ' 00:12:28.961 03:29:09 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:12:28.961 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:28.961 --rc genhtml_branch_coverage=1 00:12:28.961 --rc genhtml_function_coverage=1 00:12:28.961 --rc genhtml_legend=1 00:12:28.961 --rc geninfo_all_blocks=1 00:12:28.961 --rc geninfo_unexecuted_blocks=1 00:12:28.961 00:12:28.961 ' 00:12:28.961 03:29:09 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:12:28.961 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:28.961 --rc genhtml_branch_coverage=1 00:12:28.961 --rc genhtml_function_coverage=1 00:12:28.961 --rc genhtml_legend=1 00:12:28.961 --rc geninfo_all_blocks=1 00:12:28.961 --rc geninfo_unexecuted_blocks=1 00:12:28.961 00:12:28.961 ' 00:12:28.961 03:29:09 -- target/ns_hotplug_stress.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:28.961 03:29:09 -- nvmf/common.sh@7 -- # uname -s 00:12:28.961 03:29:09 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:28.961 03:29:09 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:28.961 03:29:09 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:28.961 03:29:09 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:28.961 03:29:09 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:28.961 03:29:09 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:28.961 03:29:09 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:28.961 03:29:09 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:28.961 03:29:09 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:28.962 03:29:09 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:28.962 03:29:09 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:28.962 03:29:09 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:12:28.962 03:29:09 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:28.962 03:29:09 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:28.962 03:29:09 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:28.962 03:29:09 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:28.962 03:29:09 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:28.962 03:29:09 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:28.962 03:29:09 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:28.962 03:29:09 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:28.962 03:29:09 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:28.962 03:29:09 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:28.962 03:29:09 -- paths/export.sh@5 -- # export PATH 00:12:28.962 03:29:09 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:28.962 03:29:09 -- nvmf/common.sh@46 -- # : 0 00:12:28.962 03:29:09 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:12:28.962 03:29:09 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:12:28.962 03:29:09 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:12:28.962 03:29:09 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:28.962 03:29:09 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:28.962 03:29:09 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:12:28.962 03:29:09 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:12:28.962 03:29:09 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:12:28.962 03:29:09 -- target/ns_hotplug_stress.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:12:28.962 03:29:09 -- target/ns_hotplug_stress.sh@22 -- # nvmftestinit 00:12:28.962 03:29:09 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:12:28.962 03:29:09 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:28.962 03:29:09 -- nvmf/common.sh@436 -- # prepare_net_devs 00:12:28.962 03:29:09 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:12:28.962 03:29:09 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:12:28.962 03:29:09 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:28.962 03:29:09 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:28.962 03:29:09 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:28.962 03:29:09 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:12:28.962 03:29:09 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:12:28.962 03:29:09 -- nvmf/common.sh@284 -- # xtrace_disable 00:12:28.962 03:29:09 -- common/autotest_common.sh@10 -- # set +x 00:12:30.874 03:29:11 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:30.874 03:29:11 -- nvmf/common.sh@290 -- # pci_devs=() 00:12:30.874 03:29:11 -- nvmf/common.sh@290 -- # local -a pci_devs 00:12:30.874 03:29:11 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:12:30.874 03:29:11 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:12:30.874 03:29:11 -- nvmf/common.sh@292 -- # pci_drivers=() 00:12:30.874 03:29:11 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:12:30.874 03:29:11 -- nvmf/common.sh@294 -- # net_devs=() 00:12:30.874 03:29:11 -- nvmf/common.sh@294 -- # local -ga net_devs 00:12:30.874 03:29:11 -- nvmf/common.sh@295 -- # e810=() 00:12:30.874 03:29:11 -- nvmf/common.sh@295 -- # local -ga e810 00:12:30.874 03:29:11 -- nvmf/common.sh@296 -- # x722=() 00:12:30.874 03:29:11 -- nvmf/common.sh@296 -- # local -ga x722 00:12:30.874 03:29:11 -- nvmf/common.sh@297 -- # mlx=() 00:12:30.874 03:29:11 -- nvmf/common.sh@297 -- # local -ga mlx 00:12:30.874 03:29:11 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:30.874 03:29:11 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:30.874 03:29:11 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:30.874 03:29:11 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:30.874 03:29:11 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:30.874 03:29:11 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:30.874 03:29:11 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:30.874 03:29:11 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:30.874 03:29:11 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:30.874 03:29:11 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:30.874 03:29:11 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:30.874 03:29:11 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:12:30.874 03:29:11 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:12:30.874 03:29:11 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:12:30.874 03:29:11 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:12:30.874 03:29:11 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:12:30.874 03:29:11 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:12:30.874 03:29:11 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:30.874 03:29:11 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:12:30.874 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:12:30.874 03:29:11 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:30.874 03:29:11 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:30.874 03:29:11 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:30.874 03:29:11 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:30.874 03:29:11 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:30.874 03:29:11 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:30.874 03:29:11 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:12:30.874 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:12:30.874 03:29:11 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:30.875 03:29:11 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:30.875 03:29:11 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:30.875 03:29:11 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:30.875 03:29:11 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:30.875 03:29:11 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:12:30.875 03:29:11 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:12:30.875 03:29:11 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:12:30.875 03:29:11 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:30.875 03:29:11 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:30.875 03:29:11 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:30.875 03:29:11 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:30.875 03:29:11 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:12:30.875 Found net devices under 0000:0a:00.0: cvl_0_0 00:12:30.875 03:29:11 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:30.875 03:29:11 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:30.875 03:29:11 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:30.875 03:29:11 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:30.875 03:29:11 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:30.875 03:29:11 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:12:30.875 Found net devices under 0000:0a:00.1: cvl_0_1 00:12:30.875 03:29:11 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:30.875 03:29:11 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:12:30.875 03:29:11 -- nvmf/common.sh@402 -- # is_hw=yes 00:12:30.875 03:29:11 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:12:30.875 03:29:11 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:12:30.875 03:29:11 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:12:30.875 03:29:11 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:30.875 03:29:11 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:30.875 03:29:11 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:30.875 03:29:11 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:12:30.875 03:29:11 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:30.875 03:29:11 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:30.875 03:29:11 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:12:30.875 03:29:11 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:30.875 03:29:11 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:30.875 03:29:11 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:12:30.875 03:29:11 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:12:30.875 03:29:11 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:12:30.875 03:29:11 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:30.875 03:29:11 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:30.875 03:29:11 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:30.875 03:29:11 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:12:30.875 03:29:11 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:30.875 03:29:11 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:30.875 03:29:11 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:30.875 03:29:11 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:12:30.875 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:30.875 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.195 ms 00:12:30.875 00:12:30.875 --- 10.0.0.2 ping statistics --- 00:12:30.875 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:30.875 rtt min/avg/max/mdev = 0.195/0.195/0.195/0.000 ms 00:12:30.875 03:29:11 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:30.875 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:30.875 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.090 ms 00:12:30.875 00:12:30.875 --- 10.0.0.1 ping statistics --- 00:12:30.875 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:30.875 rtt min/avg/max/mdev = 0.090/0.090/0.090/0.000 ms 00:12:30.875 03:29:11 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:30.875 03:29:11 -- nvmf/common.sh@410 -- # return 0 00:12:30.875 03:29:11 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:12:30.875 03:29:11 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:30.875 03:29:11 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:12:30.875 03:29:11 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:12:30.875 03:29:11 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:30.875 03:29:11 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:12:30.875 03:29:11 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:12:31.135 03:29:11 -- target/ns_hotplug_stress.sh@23 -- # nvmfappstart -m 0xE 00:12:31.135 03:29:11 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:12:31.135 03:29:11 -- common/autotest_common.sh@722 -- # xtrace_disable 00:12:31.135 03:29:11 -- common/autotest_common.sh@10 -- # set +x 00:12:31.135 03:29:11 -- nvmf/common.sh@469 -- # nvmfpid=3008511 00:12:31.135 03:29:11 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:12:31.135 03:29:11 -- nvmf/common.sh@470 -- # waitforlisten 3008511 00:12:31.135 03:29:11 -- common/autotest_common.sh@829 -- # '[' -z 3008511 ']' 00:12:31.135 03:29:11 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:31.135 03:29:11 -- common/autotest_common.sh@834 -- # local max_retries=100 00:12:31.135 03:29:11 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:31.135 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:31.135 03:29:11 -- common/autotest_common.sh@838 -- # xtrace_disable 00:12:31.135 03:29:11 -- common/autotest_common.sh@10 -- # set +x 00:12:31.135 [2024-11-21 03:29:11.588995] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:12:31.135 [2024-11-21 03:29:11.589104] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:31.135 EAL: No free 2048 kB hugepages reported on node 1 00:12:31.135 [2024-11-21 03:29:11.666330] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:12:31.395 [2024-11-21 03:29:11.784398] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:31.395 [2024-11-21 03:29:11.784590] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:31.395 [2024-11-21 03:29:11.784609] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:31.395 [2024-11-21 03:29:11.784623] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:31.395 [2024-11-21 03:29:11.784716] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:31.395 [2024-11-21 03:29:11.784773] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:31.395 [2024-11-21 03:29:11.784776] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:31.962 03:29:12 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:12:31.962 03:29:12 -- common/autotest_common.sh@862 -- # return 0 00:12:31.962 03:29:12 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:31.962 03:29:12 -- common/autotest_common.sh@728 -- # xtrace_disable 00:12:31.962 03:29:12 -- common/autotest_common.sh@10 -- # set +x 00:12:32.221 03:29:12 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:32.221 03:29:12 -- target/ns_hotplug_stress.sh@25 -- # null_size=1000 00:12:32.221 03:29:12 -- target/ns_hotplug_stress.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:12:32.479 [2024-11-21 03:29:12.898447] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:32.479 03:29:12 -- target/ns_hotplug_stress.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:12:32.738 03:29:13 -- target/ns_hotplug_stress.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:32.997 [2024-11-21 03:29:13.405261] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:32.997 03:29:13 -- target/ns_hotplug_stress.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:12:33.256 03:29:13 -- target/ns_hotplug_stress.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 512 -b Malloc0 00:12:33.514 Malloc0 00:12:33.514 03:29:13 -- target/ns_hotplug_stress.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:12:33.772 Delay0 00:12:33.772 03:29:14 -- target/ns_hotplug_stress.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:34.030 03:29:14 -- target/ns_hotplug_stress.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create NULL1 1000 512 00:12:34.288 NULL1 00:12:34.288 03:29:14 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:12:34.546 03:29:14 -- target/ns_hotplug_stress.sh@42 -- # PERF_PID=3008947 00:12:34.546 03:29:14 -- target/ns_hotplug_stress.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 30 -q 128 -w randread -o 512 -Q 1000 00:12:34.546 03:29:14 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3008947 00:12:34.546 03:29:14 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:34.546 EAL: No free 2048 kB hugepages reported on node 1 00:12:35.927 Read completed with error (sct=0, sc=11) 00:12:35.927 03:29:16 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:35.927 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:35.927 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:35.927 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:35.927 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:35.927 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:35.927 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:35.927 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:35.927 03:29:16 -- target/ns_hotplug_stress.sh@49 -- # null_size=1001 00:12:35.927 03:29:16 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1001 00:12:36.186 true 00:12:36.186 03:29:16 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3008947 00:12:36.186 03:29:16 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:37.123 03:29:17 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:37.123 03:29:17 -- target/ns_hotplug_stress.sh@49 -- # null_size=1002 00:12:37.123 03:29:17 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1002 00:12:37.381 true 00:12:37.381 03:29:17 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3008947 00:12:37.381 03:29:17 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:37.639 03:29:18 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:37.898 03:29:18 -- target/ns_hotplug_stress.sh@49 -- # null_size=1003 00:12:37.898 03:29:18 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1003 00:12:38.156 true 00:12:38.156 03:29:18 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3008947 00:12:38.156 03:29:18 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:38.414 03:29:19 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:38.677 03:29:19 -- target/ns_hotplug_stress.sh@49 -- # null_size=1004 00:12:38.677 03:29:19 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1004 00:12:38.935 true 00:12:38.935 03:29:19 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3008947 00:12:38.935 03:29:19 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:40.315 03:29:20 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:40.315 03:29:20 -- target/ns_hotplug_stress.sh@49 -- # null_size=1005 00:12:40.315 03:29:20 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1005 00:12:40.573 true 00:12:40.573 03:29:21 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3008947 00:12:40.573 03:29:21 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:40.831 03:29:21 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:41.089 03:29:21 -- target/ns_hotplug_stress.sh@49 -- # null_size=1006 00:12:41.089 03:29:21 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1006 00:12:41.347 true 00:12:41.347 03:29:21 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3008947 00:12:41.347 03:29:21 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:41.606 03:29:22 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:41.865 03:29:22 -- target/ns_hotplug_stress.sh@49 -- # null_size=1007 00:12:41.865 03:29:22 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1007 00:12:42.160 true 00:12:42.160 03:29:22 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3008947 00:12:42.160 03:29:22 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:43.124 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:43.124 03:29:23 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:43.124 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:43.382 03:29:23 -- target/ns_hotplug_stress.sh@49 -- # null_size=1008 00:12:43.382 03:29:23 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1008 00:12:43.640 true 00:12:43.640 03:29:24 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3008947 00:12:43.640 03:29:24 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:43.899 03:29:24 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:44.157 03:29:24 -- target/ns_hotplug_stress.sh@49 -- # null_size=1009 00:12:44.157 03:29:24 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1009 00:12:44.415 true 00:12:44.415 03:29:24 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3008947 00:12:44.415 03:29:24 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:45.352 03:29:25 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:45.352 03:29:25 -- target/ns_hotplug_stress.sh@49 -- # null_size=1010 00:12:45.352 03:29:25 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1010 00:12:45.610 true 00:12:45.610 03:29:26 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3008947 00:12:45.610 03:29:26 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:45.868 03:29:26 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:46.127 03:29:26 -- target/ns_hotplug_stress.sh@49 -- # null_size=1011 00:12:46.127 03:29:26 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1011 00:12:46.386 true 00:12:46.386 03:29:27 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3008947 00:12:46.386 03:29:27 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:47.324 03:29:27 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:47.583 03:29:28 -- target/ns_hotplug_stress.sh@49 -- # null_size=1012 00:12:47.583 03:29:28 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1012 00:12:47.841 true 00:12:47.841 03:29:28 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3008947 00:12:47.841 03:29:28 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:48.099 03:29:28 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:48.357 03:29:28 -- target/ns_hotplug_stress.sh@49 -- # null_size=1013 00:12:48.357 03:29:28 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1013 00:12:48.615 true 00:12:48.615 03:29:29 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3008947 00:12:48.615 03:29:29 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:48.873 03:29:29 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:49.130 03:29:29 -- target/ns_hotplug_stress.sh@49 -- # null_size=1014 00:12:49.131 03:29:29 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1014 00:12:49.388 true 00:12:49.388 03:29:29 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3008947 00:12:49.388 03:29:29 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:50.765 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:50.765 03:29:30 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:50.765 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:50.765 03:29:31 -- target/ns_hotplug_stress.sh@49 -- # null_size=1015 00:12:50.765 03:29:31 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1015 00:12:51.024 true 00:12:51.024 03:29:31 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3008947 00:12:51.024 03:29:31 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:51.281 03:29:31 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:51.539 03:29:32 -- target/ns_hotplug_stress.sh@49 -- # null_size=1016 00:12:51.539 03:29:32 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1016 00:12:51.797 true 00:12:51.797 03:29:32 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3008947 00:12:51.797 03:29:32 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:52.734 03:29:33 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:52.734 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:52.734 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:52.734 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:52.734 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:52.993 03:29:33 -- target/ns_hotplug_stress.sh@49 -- # null_size=1017 00:12:52.993 03:29:33 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1017 00:12:53.251 true 00:12:53.251 03:29:33 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3008947 00:12:53.251 03:29:33 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:53.511 03:29:33 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:53.770 03:29:34 -- target/ns_hotplug_stress.sh@49 -- # null_size=1018 00:12:53.770 03:29:34 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1018 00:12:53.770 true 00:12:53.770 03:29:34 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3008947 00:12:53.770 03:29:34 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:54.704 03:29:35 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:54.962 03:29:35 -- target/ns_hotplug_stress.sh@49 -- # null_size=1019 00:12:54.962 03:29:35 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1019 00:12:55.221 true 00:12:55.221 03:29:35 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3008947 00:12:55.221 03:29:35 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:55.478 03:29:36 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:55.737 03:29:36 -- target/ns_hotplug_stress.sh@49 -- # null_size=1020 00:12:55.737 03:29:36 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1020 00:12:55.995 true 00:12:55.995 03:29:36 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3008947 00:12:55.995 03:29:36 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:56.253 03:29:36 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:56.511 03:29:37 -- target/ns_hotplug_stress.sh@49 -- # null_size=1021 00:12:56.511 03:29:37 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1021 00:12:56.769 true 00:12:56.769 03:29:37 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3008947 00:12:56.769 03:29:37 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:57.702 03:29:38 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:57.960 03:29:38 -- target/ns_hotplug_stress.sh@49 -- # null_size=1022 00:12:57.960 03:29:38 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1022 00:12:58.218 true 00:12:58.218 03:29:38 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3008947 00:12:58.218 03:29:38 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:58.476 03:29:39 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:58.734 03:29:39 -- target/ns_hotplug_stress.sh@49 -- # null_size=1023 00:12:58.734 03:29:39 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1023 00:12:58.992 true 00:12:58.992 03:29:39 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3008947 00:12:58.992 03:29:39 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:59.250 03:29:39 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:59.508 03:29:40 -- target/ns_hotplug_stress.sh@49 -- # null_size=1024 00:12:59.508 03:29:40 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1024 00:12:59.766 true 00:12:59.766 03:29:40 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3008947 00:12:59.766 03:29:40 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:00.704 03:29:41 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:00.963 03:29:41 -- target/ns_hotplug_stress.sh@49 -- # null_size=1025 00:13:00.963 03:29:41 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1025 00:13:01.222 true 00:13:01.222 03:29:41 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3008947 00:13:01.222 03:29:41 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:01.480 03:29:42 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:01.738 03:29:42 -- target/ns_hotplug_stress.sh@49 -- # null_size=1026 00:13:01.738 03:29:42 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1026 00:13:01.996 true 00:13:01.996 03:29:42 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3008947 00:13:01.996 03:29:42 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:02.254 03:29:42 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:02.514 03:29:43 -- target/ns_hotplug_stress.sh@49 -- # null_size=1027 00:13:02.514 03:29:43 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1027 00:13:02.772 true 00:13:02.772 03:29:43 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3008947 00:13:02.772 03:29:43 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:03.708 03:29:44 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:03.966 03:29:44 -- target/ns_hotplug_stress.sh@49 -- # null_size=1028 00:13:03.966 03:29:44 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1028 00:13:04.225 true 00:13:04.225 03:29:44 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3008947 00:13:04.225 03:29:44 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:04.483 03:29:45 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:04.741 Initializing NVMe Controllers 00:13:04.741 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:13:04.741 Controller IO queue size 128, less than required. 00:13:04.741 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:13:04.741 Controller IO queue size 128, less than required. 00:13:04.741 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:13:04.741 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:13:04.741 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:13:04.741 Initialization complete. Launching workers. 00:13:04.741 ======================================================== 00:13:04.741 Latency(us) 00:13:04.741 Device Information : IOPS MiB/s Average min max 00:13:04.741 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 584.98 0.29 97393.16 2973.82 1034402.90 00:13:04.741 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 10372.70 5.06 12341.01 1663.23 386316.33 00:13:04.741 ======================================================== 00:13:04.741 Total : 10957.68 5.35 16881.57 1663.23 1034402.90 00:13:04.741 00:13:04.741 03:29:45 -- target/ns_hotplug_stress.sh@49 -- # null_size=1029 00:13:04.741 03:29:45 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1029 00:13:05.000 true 00:13:05.000 03:29:45 -- target/ns_hotplug_stress.sh@44 -- # kill -0 3008947 00:13:05.000 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh: line 44: kill: (3008947) - No such process 00:13:05.000 03:29:45 -- target/ns_hotplug_stress.sh@53 -- # wait 3008947 00:13:05.000 03:29:45 -- target/ns_hotplug_stress.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:05.258 03:29:45 -- target/ns_hotplug_stress.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:05.516 03:29:46 -- target/ns_hotplug_stress.sh@58 -- # nthreads=8 00:13:05.516 03:29:46 -- target/ns_hotplug_stress.sh@58 -- # pids=() 00:13:05.516 03:29:46 -- target/ns_hotplug_stress.sh@59 -- # (( i = 0 )) 00:13:05.516 03:29:46 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:05.516 03:29:46 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null0 100 4096 00:13:05.774 null0 00:13:05.774 03:29:46 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:05.774 03:29:46 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:05.774 03:29:46 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null1 100 4096 00:13:06.032 null1 00:13:06.032 03:29:46 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:06.032 03:29:46 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:06.032 03:29:46 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null2 100 4096 00:13:06.290 null2 00:13:06.290 03:29:46 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:06.290 03:29:46 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:06.290 03:29:46 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null3 100 4096 00:13:06.548 null3 00:13:06.548 03:29:47 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:06.548 03:29:47 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:06.548 03:29:47 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null4 100 4096 00:13:06.806 null4 00:13:06.806 03:29:47 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:06.806 03:29:47 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:06.806 03:29:47 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null5 100 4096 00:13:07.064 null5 00:13:07.064 03:29:47 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:07.064 03:29:47 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:07.064 03:29:47 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null6 100 4096 00:13:07.323 null6 00:13:07.323 03:29:47 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:07.323 03:29:47 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:07.323 03:29:47 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null7 100 4096 00:13:07.581 null7 00:13:07.581 03:29:48 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:07.581 03:29:48 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:07.581 03:29:48 -- target/ns_hotplug_stress.sh@62 -- # (( i = 0 )) 00:13:07.581 03:29:48 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:07.581 03:29:48 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:07.581 03:29:48 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:07.581 03:29:48 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:07.581 03:29:48 -- target/ns_hotplug_stress.sh@63 -- # add_remove 1 null0 00:13:07.581 03:29:48 -- target/ns_hotplug_stress.sh@14 -- # local nsid=1 bdev=null0 00:13:07.581 03:29:48 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:07.581 03:29:48 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:07.581 03:29:48 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:07.581 03:29:48 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:07.581 03:29:48 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:07.581 03:29:48 -- target/ns_hotplug_stress.sh@63 -- # add_remove 2 null1 00:13:07.581 03:29:48 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:07.581 03:29:48 -- target/ns_hotplug_stress.sh@14 -- # local nsid=2 bdev=null1 00:13:07.581 03:29:48 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:07.581 03:29:48 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:07.581 03:29:48 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:07.581 03:29:48 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:07.581 03:29:48 -- target/ns_hotplug_stress.sh@63 -- # add_remove 3 null2 00:13:07.581 03:29:48 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:07.581 03:29:48 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:07.581 03:29:48 -- target/ns_hotplug_stress.sh@14 -- # local nsid=3 bdev=null2 00:13:07.581 03:29:48 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:07.581 03:29:48 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:07.581 03:29:48 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:07.581 03:29:48 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:07.582 03:29:48 -- target/ns_hotplug_stress.sh@63 -- # add_remove 4 null3 00:13:07.582 03:29:48 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:07.582 03:29:48 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:07.582 03:29:48 -- target/ns_hotplug_stress.sh@14 -- # local nsid=4 bdev=null3 00:13:07.582 03:29:48 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:07.582 03:29:48 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:07.582 03:29:48 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:07.582 03:29:48 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:07.582 03:29:48 -- target/ns_hotplug_stress.sh@63 -- # add_remove 5 null4 00:13:07.582 03:29:48 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:07.582 03:29:48 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:07.582 03:29:48 -- target/ns_hotplug_stress.sh@14 -- # local nsid=5 bdev=null4 00:13:07.582 03:29:48 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:07.582 03:29:48 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:07.582 03:29:48 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:07.582 03:29:48 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:07.582 03:29:48 -- target/ns_hotplug_stress.sh@63 -- # add_remove 6 null5 00:13:07.582 03:29:48 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:07.582 03:29:48 -- target/ns_hotplug_stress.sh@14 -- # local nsid=6 bdev=null5 00:13:07.582 03:29:48 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:07.582 03:29:48 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:07.582 03:29:48 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:07.582 03:29:48 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:07.582 03:29:48 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:07.582 03:29:48 -- target/ns_hotplug_stress.sh@63 -- # add_remove 7 null6 00:13:07.582 03:29:48 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:07.582 03:29:48 -- target/ns_hotplug_stress.sh@14 -- # local nsid=7 bdev=null6 00:13:07.582 03:29:48 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:07.582 03:29:48 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:07.582 03:29:48 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:07.582 03:29:48 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:07.582 03:29:48 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:07.582 03:29:48 -- target/ns_hotplug_stress.sh@63 -- # add_remove 8 null7 00:13:07.582 03:29:48 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:07.582 03:29:48 -- target/ns_hotplug_stress.sh@14 -- # local nsid=8 bdev=null7 00:13:07.582 03:29:48 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:07.582 03:29:48 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:07.582 03:29:48 -- target/ns_hotplug_stress.sh@66 -- # wait 3012988 3012989 3012991 3012993 3012995 3012997 3012999 3013001 00:13:07.582 03:29:48 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:07.582 03:29:48 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:07.841 03:29:48 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:07.841 03:29:48 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:07.841 03:29:48 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:07.841 03:29:48 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:07.841 03:29:48 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:07.841 03:29:48 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:07.841 03:29:48 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:07.841 03:29:48 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:08.099 03:29:48 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:08.099 03:29:48 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:08.099 03:29:48 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:08.099 03:29:48 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:08.099 03:29:48 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:08.099 03:29:48 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:08.099 03:29:48 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:08.099 03:29:48 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:08.099 03:29:48 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:08.099 03:29:48 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:08.099 03:29:48 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:08.099 03:29:48 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:08.099 03:29:48 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:08.099 03:29:48 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:08.099 03:29:48 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:08.099 03:29:48 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:08.099 03:29:48 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:08.099 03:29:48 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:08.099 03:29:48 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:08.099 03:29:48 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:08.099 03:29:48 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:08.099 03:29:48 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:08.099 03:29:48 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:08.099 03:29:48 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:08.358 03:29:48 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:08.359 03:29:48 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:08.359 03:29:48 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:08.359 03:29:48 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:08.359 03:29:48 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:08.359 03:29:48 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:08.359 03:29:48 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:08.359 03:29:48 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:08.617 03:29:49 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:08.617 03:29:49 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:08.617 03:29:49 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:08.617 03:29:49 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:08.617 03:29:49 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:08.617 03:29:49 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:08.617 03:29:49 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:08.617 03:29:49 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:08.617 03:29:49 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:08.617 03:29:49 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:08.617 03:29:49 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:08.617 03:29:49 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:08.617 03:29:49 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:08.617 03:29:49 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:08.617 03:29:49 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:08.617 03:29:49 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:08.617 03:29:49 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:08.617 03:29:49 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:08.617 03:29:49 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:08.617 03:29:49 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:08.617 03:29:49 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:08.617 03:29:49 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:08.617 03:29:49 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:08.617 03:29:49 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:08.874 03:29:49 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:08.874 03:29:49 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:08.874 03:29:49 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:08.874 03:29:49 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:08.874 03:29:49 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:09.132 03:29:49 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:09.132 03:29:49 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:09.132 03:29:49 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:09.392 03:29:49 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:09.392 03:29:49 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:09.392 03:29:49 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:09.392 03:29:49 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:09.392 03:29:49 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:09.392 03:29:49 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:09.392 03:29:49 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:09.392 03:29:49 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:09.392 03:29:49 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:09.392 03:29:49 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:09.392 03:29:49 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:09.392 03:29:49 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:09.392 03:29:49 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:09.392 03:29:49 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:09.392 03:29:49 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:09.392 03:29:49 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:09.392 03:29:49 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:09.392 03:29:49 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:09.392 03:29:49 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:09.392 03:29:49 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:09.392 03:29:49 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:09.392 03:29:49 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:09.392 03:29:49 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:09.392 03:29:49 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:09.651 03:29:50 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:09.651 03:29:50 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:09.651 03:29:50 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:09.651 03:29:50 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:09.651 03:29:50 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:09.651 03:29:50 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:09.651 03:29:50 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:09.651 03:29:50 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:09.910 03:29:50 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:09.910 03:29:50 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:09.910 03:29:50 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:09.910 03:29:50 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:09.910 03:29:50 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:09.910 03:29:50 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:09.910 03:29:50 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:09.910 03:29:50 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:09.910 03:29:50 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:09.910 03:29:50 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:09.910 03:29:50 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:09.910 03:29:50 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:09.910 03:29:50 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:09.910 03:29:50 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:09.910 03:29:50 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:09.910 03:29:50 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:09.910 03:29:50 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:09.910 03:29:50 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:09.910 03:29:50 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:09.910 03:29:50 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:09.910 03:29:50 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:09.910 03:29:50 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:09.910 03:29:50 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:09.910 03:29:50 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:10.168 03:29:50 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:10.168 03:29:50 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:10.168 03:29:50 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:10.168 03:29:50 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:10.168 03:29:50 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:10.168 03:29:50 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:10.168 03:29:50 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:10.168 03:29:50 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:10.426 03:29:50 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.426 03:29:50 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.426 03:29:50 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:10.426 03:29:50 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.426 03:29:50 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.426 03:29:50 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:10.426 03:29:50 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.426 03:29:50 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.426 03:29:50 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:10.426 03:29:50 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.426 03:29:50 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.426 03:29:50 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:10.426 03:29:50 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.426 03:29:50 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.427 03:29:50 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:10.427 03:29:50 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.427 03:29:50 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.427 03:29:50 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:10.427 03:29:50 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.427 03:29:50 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.427 03:29:50 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:10.427 03:29:50 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.427 03:29:50 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.427 03:29:50 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:10.685 03:29:51 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:10.685 03:29:51 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:10.685 03:29:51 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:10.685 03:29:51 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:10.685 03:29:51 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:10.685 03:29:51 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:10.685 03:29:51 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:10.685 03:29:51 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:10.989 03:29:51 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.989 03:29:51 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.989 03:29:51 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:10.989 03:29:51 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.989 03:29:51 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.989 03:29:51 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:10.989 03:29:51 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.989 03:29:51 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.989 03:29:51 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:10.989 03:29:51 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.989 03:29:51 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.989 03:29:51 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:10.989 03:29:51 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.989 03:29:51 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.989 03:29:51 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.989 03:29:51 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:10.989 03:29:51 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.989 03:29:51 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:10.989 03:29:51 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.989 03:29:51 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.989 03:29:51 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:10.989 03:29:51 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:10.989 03:29:51 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:10.989 03:29:51 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:11.276 03:29:51 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:11.276 03:29:51 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:11.276 03:29:51 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:11.276 03:29:51 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:11.276 03:29:51 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:11.276 03:29:51 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:11.276 03:29:51 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:11.276 03:29:51 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:11.535 03:29:52 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:11.535 03:29:52 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:11.535 03:29:52 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:11.535 03:29:52 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:11.535 03:29:52 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:11.535 03:29:52 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:11.535 03:29:52 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:11.535 03:29:52 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:11.535 03:29:52 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:11.535 03:29:52 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:11.535 03:29:52 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:11.535 03:29:52 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:11.535 03:29:52 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:11.535 03:29:52 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:11.535 03:29:52 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:11.535 03:29:52 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:11.535 03:29:52 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:11.535 03:29:52 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:11.535 03:29:52 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:11.535 03:29:52 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:11.535 03:29:52 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:11.535 03:29:52 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:11.535 03:29:52 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:11.535 03:29:52 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:11.794 03:29:52 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:11.794 03:29:52 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:11.794 03:29:52 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:11.794 03:29:52 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:11.794 03:29:52 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:11.794 03:29:52 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:11.794 03:29:52 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:11.794 03:29:52 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:12.053 03:29:52 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:12.053 03:29:52 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:12.053 03:29:52 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:12.053 03:29:52 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:12.053 03:29:52 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:12.053 03:29:52 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:12.053 03:29:52 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:12.053 03:29:52 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:12.053 03:29:52 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:12.053 03:29:52 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:12.053 03:29:52 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:12.053 03:29:52 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:12.053 03:29:52 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:12.053 03:29:52 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:12.053 03:29:52 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:12.053 03:29:52 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:12.053 03:29:52 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:12.053 03:29:52 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:12.053 03:29:52 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:12.053 03:29:52 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:12.053 03:29:52 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:12.053 03:29:52 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:12.053 03:29:52 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:12.053 03:29:52 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:12.312 03:29:52 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:12.312 03:29:52 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:12.312 03:29:52 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:12.312 03:29:52 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:12.312 03:29:52 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:12.312 03:29:52 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:12.312 03:29:52 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:12.312 03:29:52 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:12.571 03:29:53 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:12.571 03:29:53 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:12.571 03:29:53 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:12.571 03:29:53 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:12.571 03:29:53 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:12.571 03:29:53 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:12.571 03:29:53 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:12.571 03:29:53 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:12.571 03:29:53 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:12.571 03:29:53 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:12.571 03:29:53 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:12.571 03:29:53 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:12.571 03:29:53 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:12.571 03:29:53 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:12.571 03:29:53 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:12.571 03:29:53 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:12.571 03:29:53 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:12.571 03:29:53 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:12.571 03:29:53 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:12.571 03:29:53 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:12.571 03:29:53 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:12.571 03:29:53 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:12.571 03:29:53 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:12.571 03:29:53 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:12.829 03:29:53 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:12.829 03:29:53 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:12.829 03:29:53 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:12.829 03:29:53 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:12.829 03:29:53 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:12.829 03:29:53 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:12.829 03:29:53 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:12.829 03:29:53 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:13.087 03:29:53 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:13.087 03:29:53 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:13.088 03:29:53 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:13.088 03:29:53 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:13.372 03:29:53 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:13.372 03:29:53 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:13.372 03:29:53 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:13.372 03:29:53 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:13.372 03:29:53 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:13.372 03:29:53 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:13.372 03:29:53 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:13.372 03:29:53 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:13.372 03:29:53 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:13.372 03:29:53 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:13.372 03:29:53 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:13.372 03:29:53 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:13.372 03:29:53 -- target/ns_hotplug_stress.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:13:13.372 03:29:53 -- target/ns_hotplug_stress.sh@70 -- # nvmftestfini 00:13:13.372 03:29:53 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:13.372 03:29:53 -- nvmf/common.sh@116 -- # sync 00:13:13.372 03:29:53 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:13.372 03:29:53 -- nvmf/common.sh@119 -- # set +e 00:13:13.372 03:29:53 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:13.372 03:29:53 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:13.372 rmmod nvme_tcp 00:13:13.372 rmmod nvme_fabrics 00:13:13.372 rmmod nvme_keyring 00:13:13.372 03:29:53 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:13.372 03:29:53 -- nvmf/common.sh@123 -- # set -e 00:13:13.372 03:29:53 -- nvmf/common.sh@124 -- # return 0 00:13:13.372 03:29:53 -- nvmf/common.sh@477 -- # '[' -n 3008511 ']' 00:13:13.372 03:29:53 -- nvmf/common.sh@478 -- # killprocess 3008511 00:13:13.372 03:29:53 -- common/autotest_common.sh@936 -- # '[' -z 3008511 ']' 00:13:13.372 03:29:53 -- common/autotest_common.sh@940 -- # kill -0 3008511 00:13:13.372 03:29:53 -- common/autotest_common.sh@941 -- # uname 00:13:13.372 03:29:53 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:13.372 03:29:53 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3008511 00:13:13.372 03:29:53 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:13:13.372 03:29:53 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:13:13.372 03:29:53 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3008511' 00:13:13.372 killing process with pid 3008511 00:13:13.372 03:29:53 -- common/autotest_common.sh@955 -- # kill 3008511 00:13:13.372 03:29:53 -- common/autotest_common.sh@960 -- # wait 3008511 00:13:13.632 03:29:54 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:13.632 03:29:54 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:13.632 03:29:54 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:13.632 03:29:54 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:13.632 03:29:54 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:13.632 03:29:54 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:13.632 03:29:54 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:13.632 03:29:54 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:15.537 03:29:56 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:15.537 00:13:15.537 real 0m47.029s 00:13:15.537 user 3m34.845s 00:13:15.537 sys 0m15.117s 00:13:15.537 03:29:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:15.537 03:29:56 -- common/autotest_common.sh@10 -- # set +x 00:13:15.537 ************************************ 00:13:15.537 END TEST nvmf_ns_hotplug_stress 00:13:15.537 ************************************ 00:13:15.537 03:29:56 -- nvmf/nvmf.sh@33 -- # run_test nvmf_connect_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:13:15.537 03:29:56 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:15.537 03:29:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:15.537 03:29:56 -- common/autotest_common.sh@10 -- # set +x 00:13:15.796 ************************************ 00:13:15.796 START TEST nvmf_connect_stress 00:13:15.796 ************************************ 00:13:15.796 03:29:56 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:13:15.796 * Looking for test storage... 00:13:15.796 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:15.796 03:29:56 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:15.796 03:29:56 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:15.796 03:29:56 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:15.796 03:29:56 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:15.796 03:29:56 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:15.796 03:29:56 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:15.796 03:29:56 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:15.796 03:29:56 -- scripts/common.sh@335 -- # IFS=.-: 00:13:15.796 03:29:56 -- scripts/common.sh@335 -- # read -ra ver1 00:13:15.796 03:29:56 -- scripts/common.sh@336 -- # IFS=.-: 00:13:15.796 03:29:56 -- scripts/common.sh@336 -- # read -ra ver2 00:13:15.796 03:29:56 -- scripts/common.sh@337 -- # local 'op=<' 00:13:15.796 03:29:56 -- scripts/common.sh@339 -- # ver1_l=2 00:13:15.796 03:29:56 -- scripts/common.sh@340 -- # ver2_l=1 00:13:15.796 03:29:56 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:15.796 03:29:56 -- scripts/common.sh@343 -- # case "$op" in 00:13:15.796 03:29:56 -- scripts/common.sh@344 -- # : 1 00:13:15.796 03:29:56 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:15.796 03:29:56 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:15.796 03:29:56 -- scripts/common.sh@364 -- # decimal 1 00:13:15.796 03:29:56 -- scripts/common.sh@352 -- # local d=1 00:13:15.796 03:29:56 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:15.796 03:29:56 -- scripts/common.sh@354 -- # echo 1 00:13:15.796 03:29:56 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:15.796 03:29:56 -- scripts/common.sh@365 -- # decimal 2 00:13:15.796 03:29:56 -- scripts/common.sh@352 -- # local d=2 00:13:15.796 03:29:56 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:15.796 03:29:56 -- scripts/common.sh@354 -- # echo 2 00:13:15.796 03:29:56 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:15.796 03:29:56 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:15.796 03:29:56 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:15.796 03:29:56 -- scripts/common.sh@367 -- # return 0 00:13:15.796 03:29:56 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:15.796 03:29:56 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:15.796 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:15.796 --rc genhtml_branch_coverage=1 00:13:15.796 --rc genhtml_function_coverage=1 00:13:15.796 --rc genhtml_legend=1 00:13:15.796 --rc geninfo_all_blocks=1 00:13:15.797 --rc geninfo_unexecuted_blocks=1 00:13:15.797 00:13:15.797 ' 00:13:15.797 03:29:56 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:15.797 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:15.797 --rc genhtml_branch_coverage=1 00:13:15.797 --rc genhtml_function_coverage=1 00:13:15.797 --rc genhtml_legend=1 00:13:15.797 --rc geninfo_all_blocks=1 00:13:15.797 --rc geninfo_unexecuted_blocks=1 00:13:15.797 00:13:15.797 ' 00:13:15.797 03:29:56 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:15.797 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:15.797 --rc genhtml_branch_coverage=1 00:13:15.797 --rc genhtml_function_coverage=1 00:13:15.797 --rc genhtml_legend=1 00:13:15.797 --rc geninfo_all_blocks=1 00:13:15.797 --rc geninfo_unexecuted_blocks=1 00:13:15.797 00:13:15.797 ' 00:13:15.797 03:29:56 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:15.797 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:15.797 --rc genhtml_branch_coverage=1 00:13:15.797 --rc genhtml_function_coverage=1 00:13:15.797 --rc genhtml_legend=1 00:13:15.797 --rc geninfo_all_blocks=1 00:13:15.797 --rc geninfo_unexecuted_blocks=1 00:13:15.797 00:13:15.797 ' 00:13:15.797 03:29:56 -- target/connect_stress.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:15.797 03:29:56 -- nvmf/common.sh@7 -- # uname -s 00:13:15.797 03:29:56 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:15.797 03:29:56 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:15.797 03:29:56 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:15.797 03:29:56 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:15.797 03:29:56 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:15.797 03:29:56 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:15.797 03:29:56 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:15.797 03:29:56 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:15.797 03:29:56 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:15.797 03:29:56 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:15.797 03:29:56 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:15.797 03:29:56 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:15.797 03:29:56 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:15.797 03:29:56 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:15.797 03:29:56 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:15.797 03:29:56 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:15.797 03:29:56 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:15.797 03:29:56 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:15.797 03:29:56 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:15.797 03:29:56 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:15.797 03:29:56 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:15.797 03:29:56 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:15.797 03:29:56 -- paths/export.sh@5 -- # export PATH 00:13:15.797 03:29:56 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:15.797 03:29:56 -- nvmf/common.sh@46 -- # : 0 00:13:15.797 03:29:56 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:15.797 03:29:56 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:15.797 03:29:56 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:15.797 03:29:56 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:15.797 03:29:56 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:15.797 03:29:56 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:15.797 03:29:56 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:15.797 03:29:56 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:15.797 03:29:56 -- target/connect_stress.sh@12 -- # nvmftestinit 00:13:15.797 03:29:56 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:15.797 03:29:56 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:15.797 03:29:56 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:15.797 03:29:56 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:15.797 03:29:56 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:15.797 03:29:56 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:15.797 03:29:56 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:15.797 03:29:56 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:15.797 03:29:56 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:15.797 03:29:56 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:15.797 03:29:56 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:15.797 03:29:56 -- common/autotest_common.sh@10 -- # set +x 00:13:17.701 03:29:58 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:17.701 03:29:58 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:17.701 03:29:58 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:17.701 03:29:58 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:17.701 03:29:58 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:17.701 03:29:58 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:17.701 03:29:58 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:17.701 03:29:58 -- nvmf/common.sh@294 -- # net_devs=() 00:13:17.701 03:29:58 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:17.701 03:29:58 -- nvmf/common.sh@295 -- # e810=() 00:13:17.701 03:29:58 -- nvmf/common.sh@295 -- # local -ga e810 00:13:17.701 03:29:58 -- nvmf/common.sh@296 -- # x722=() 00:13:17.701 03:29:58 -- nvmf/common.sh@296 -- # local -ga x722 00:13:17.701 03:29:58 -- nvmf/common.sh@297 -- # mlx=() 00:13:17.701 03:29:58 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:17.701 03:29:58 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:17.701 03:29:58 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:17.701 03:29:58 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:17.701 03:29:58 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:17.701 03:29:58 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:17.701 03:29:58 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:17.701 03:29:58 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:17.701 03:29:58 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:17.701 03:29:58 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:17.701 03:29:58 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:17.701 03:29:58 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:17.701 03:29:58 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:17.701 03:29:58 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:17.701 03:29:58 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:17.701 03:29:58 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:17.701 03:29:58 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:17.701 03:29:58 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:17.701 03:29:58 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:17.701 03:29:58 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:17.701 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:17.701 03:29:58 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:17.701 03:29:58 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:17.701 03:29:58 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:17.701 03:29:58 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:17.701 03:29:58 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:17.701 03:29:58 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:17.701 03:29:58 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:17.701 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:17.701 03:29:58 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:17.701 03:29:58 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:17.701 03:29:58 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:17.701 03:29:58 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:17.701 03:29:58 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:17.701 03:29:58 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:17.701 03:29:58 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:17.701 03:29:58 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:17.701 03:29:58 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:17.701 03:29:58 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:17.701 03:29:58 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:17.701 03:29:58 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:17.701 03:29:58 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:17.701 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:17.701 03:29:58 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:17.701 03:29:58 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:17.701 03:29:58 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:17.701 03:29:58 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:17.701 03:29:58 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:17.701 03:29:58 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:17.701 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:17.701 03:29:58 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:17.701 03:29:58 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:17.701 03:29:58 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:17.701 03:29:58 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:17.702 03:29:58 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:17.702 03:29:58 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:17.702 03:29:58 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:17.702 03:29:58 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:17.702 03:29:58 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:17.702 03:29:58 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:17.702 03:29:58 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:17.702 03:29:58 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:17.702 03:29:58 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:17.702 03:29:58 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:17.702 03:29:58 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:17.702 03:29:58 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:17.702 03:29:58 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:17.702 03:29:58 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:17.702 03:29:58 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:17.961 03:29:58 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:17.961 03:29:58 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:17.961 03:29:58 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:17.961 03:29:58 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:17.961 03:29:58 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:17.961 03:29:58 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:17.961 03:29:58 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:17.961 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:17.961 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.337 ms 00:13:17.961 00:13:17.961 --- 10.0.0.2 ping statistics --- 00:13:17.961 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:17.961 rtt min/avg/max/mdev = 0.337/0.337/0.337/0.000 ms 00:13:17.961 03:29:58 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:17.961 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:17.961 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.116 ms 00:13:17.961 00:13:17.961 --- 10.0.0.1 ping statistics --- 00:13:17.961 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:17.961 rtt min/avg/max/mdev = 0.116/0.116/0.116/0.000 ms 00:13:17.961 03:29:58 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:17.961 03:29:58 -- nvmf/common.sh@410 -- # return 0 00:13:17.961 03:29:58 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:17.961 03:29:58 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:17.961 03:29:58 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:17.961 03:29:58 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:17.961 03:29:58 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:17.961 03:29:58 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:17.961 03:29:58 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:17.961 03:29:58 -- target/connect_stress.sh@13 -- # nvmfappstart -m 0xE 00:13:17.961 03:29:58 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:17.961 03:29:58 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:17.961 03:29:58 -- common/autotest_common.sh@10 -- # set +x 00:13:17.961 03:29:58 -- nvmf/common.sh@469 -- # nvmfpid=3015909 00:13:17.961 03:29:58 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:13:17.961 03:29:58 -- nvmf/common.sh@470 -- # waitforlisten 3015909 00:13:17.961 03:29:58 -- common/autotest_common.sh@829 -- # '[' -z 3015909 ']' 00:13:17.961 03:29:58 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:17.961 03:29:58 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:17.961 03:29:58 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:17.961 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:17.961 03:29:58 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:17.961 03:29:58 -- common/autotest_common.sh@10 -- # set +x 00:13:17.961 [2024-11-21 03:29:58.473530] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:17.961 [2024-11-21 03:29:58.473618] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:17.961 EAL: No free 2048 kB hugepages reported on node 1 00:13:17.961 [2024-11-21 03:29:58.537919] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:13:18.220 [2024-11-21 03:29:58.645027] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:18.220 [2024-11-21 03:29:58.645204] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:18.220 [2024-11-21 03:29:58.645224] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:18.220 [2024-11-21 03:29:58.645236] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:18.220 [2024-11-21 03:29:58.645328] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:18.220 [2024-11-21 03:29:58.645380] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:18.220 [2024-11-21 03:29:58.645383] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:18.785 03:29:59 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:18.785 03:29:59 -- common/autotest_common.sh@862 -- # return 0 00:13:18.785 03:29:59 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:18.785 03:29:59 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:18.785 03:29:59 -- common/autotest_common.sh@10 -- # set +x 00:13:19.043 03:29:59 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:19.043 03:29:59 -- target/connect_stress.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:19.043 03:29:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:19.043 03:29:59 -- common/autotest_common.sh@10 -- # set +x 00:13:19.043 [2024-11-21 03:29:59.451106] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:19.043 03:29:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:19.043 03:29:59 -- target/connect_stress.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:19.043 03:29:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:19.043 03:29:59 -- common/autotest_common.sh@10 -- # set +x 00:13:19.043 03:29:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:19.043 03:29:59 -- target/connect_stress.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:19.043 03:29:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:19.043 03:29:59 -- common/autotest_common.sh@10 -- # set +x 00:13:19.043 [2024-11-21 03:29:59.481255] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:19.043 03:29:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:19.043 03:29:59 -- target/connect_stress.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:13:19.043 03:29:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:19.043 03:29:59 -- common/autotest_common.sh@10 -- # set +x 00:13:19.043 NULL1 00:13:19.043 03:29:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:19.043 03:29:59 -- target/connect_stress.sh@21 -- # PERF_PID=3016066 00:13:19.043 03:29:59 -- target/connect_stress.sh@23 -- # rpcs=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:13:19.043 03:29:59 -- target/connect_stress.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/connect_stress/connect_stress -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -t 10 00:13:19.043 03:29:59 -- target/connect_stress.sh@25 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:13:19.043 03:29:59 -- target/connect_stress.sh@27 -- # seq 1 20 00:13:19.043 03:29:59 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:19.043 03:29:59 -- target/connect_stress.sh@28 -- # cat 00:13:19.043 03:29:59 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:19.043 03:29:59 -- target/connect_stress.sh@28 -- # cat 00:13:19.043 03:29:59 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:19.043 03:29:59 -- target/connect_stress.sh@28 -- # cat 00:13:19.043 03:29:59 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:19.043 03:29:59 -- target/connect_stress.sh@28 -- # cat 00:13:19.043 03:29:59 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:19.043 03:29:59 -- target/connect_stress.sh@28 -- # cat 00:13:19.043 03:29:59 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:19.043 03:29:59 -- target/connect_stress.sh@28 -- # cat 00:13:19.043 03:29:59 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:19.043 03:29:59 -- target/connect_stress.sh@28 -- # cat 00:13:19.043 03:29:59 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:19.043 03:29:59 -- target/connect_stress.sh@28 -- # cat 00:13:19.043 03:29:59 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:19.043 03:29:59 -- target/connect_stress.sh@28 -- # cat 00:13:19.043 03:29:59 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:19.043 03:29:59 -- target/connect_stress.sh@28 -- # cat 00:13:19.043 03:29:59 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:19.043 03:29:59 -- target/connect_stress.sh@28 -- # cat 00:13:19.043 EAL: No free 2048 kB hugepages reported on node 1 00:13:19.043 03:29:59 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:19.043 03:29:59 -- target/connect_stress.sh@28 -- # cat 00:13:19.043 03:29:59 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:19.043 03:29:59 -- target/connect_stress.sh@28 -- # cat 00:13:19.043 03:29:59 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:19.043 03:29:59 -- target/connect_stress.sh@28 -- # cat 00:13:19.043 03:29:59 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:19.044 03:29:59 -- target/connect_stress.sh@28 -- # cat 00:13:19.044 03:29:59 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:19.044 03:29:59 -- target/connect_stress.sh@28 -- # cat 00:13:19.044 03:29:59 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:19.044 03:29:59 -- target/connect_stress.sh@28 -- # cat 00:13:19.044 03:29:59 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:19.044 03:29:59 -- target/connect_stress.sh@28 -- # cat 00:13:19.044 03:29:59 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:19.044 03:29:59 -- target/connect_stress.sh@28 -- # cat 00:13:19.044 03:29:59 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:19.044 03:29:59 -- target/connect_stress.sh@28 -- # cat 00:13:19.044 03:29:59 -- target/connect_stress.sh@34 -- # kill -0 3016066 00:13:19.044 03:29:59 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:19.044 03:29:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:19.044 03:29:59 -- common/autotest_common.sh@10 -- # set +x 00:13:19.301 03:29:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:19.301 03:29:59 -- target/connect_stress.sh@34 -- # kill -0 3016066 00:13:19.301 03:29:59 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:19.301 03:29:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:19.301 03:29:59 -- common/autotest_common.sh@10 -- # set +x 00:13:19.559 03:30:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:19.559 03:30:00 -- target/connect_stress.sh@34 -- # kill -0 3016066 00:13:19.559 03:30:00 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:19.559 03:30:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:19.559 03:30:00 -- common/autotest_common.sh@10 -- # set +x 00:13:20.124 03:30:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:20.124 03:30:00 -- target/connect_stress.sh@34 -- # kill -0 3016066 00:13:20.124 03:30:00 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:20.124 03:30:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:20.124 03:30:00 -- common/autotest_common.sh@10 -- # set +x 00:13:20.380 03:30:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:20.380 03:30:00 -- target/connect_stress.sh@34 -- # kill -0 3016066 00:13:20.380 03:30:00 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:20.380 03:30:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:20.380 03:30:00 -- common/autotest_common.sh@10 -- # set +x 00:13:20.637 03:30:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:20.637 03:30:01 -- target/connect_stress.sh@34 -- # kill -0 3016066 00:13:20.637 03:30:01 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:20.637 03:30:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:20.637 03:30:01 -- common/autotest_common.sh@10 -- # set +x 00:13:20.895 03:30:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:20.895 03:30:01 -- target/connect_stress.sh@34 -- # kill -0 3016066 00:13:20.895 03:30:01 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:20.895 03:30:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:20.895 03:30:01 -- common/autotest_common.sh@10 -- # set +x 00:13:21.152 03:30:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:21.152 03:30:01 -- target/connect_stress.sh@34 -- # kill -0 3016066 00:13:21.152 03:30:01 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:21.152 03:30:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:21.152 03:30:01 -- common/autotest_common.sh@10 -- # set +x 00:13:21.716 03:30:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:21.716 03:30:02 -- target/connect_stress.sh@34 -- # kill -0 3016066 00:13:21.716 03:30:02 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:21.716 03:30:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:21.716 03:30:02 -- common/autotest_common.sh@10 -- # set +x 00:13:21.973 03:30:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:21.974 03:30:02 -- target/connect_stress.sh@34 -- # kill -0 3016066 00:13:21.974 03:30:02 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:21.974 03:30:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:21.974 03:30:02 -- common/autotest_common.sh@10 -- # set +x 00:13:22.231 03:30:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:22.231 03:30:02 -- target/connect_stress.sh@34 -- # kill -0 3016066 00:13:22.231 03:30:02 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:22.231 03:30:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:22.231 03:30:02 -- common/autotest_common.sh@10 -- # set +x 00:13:22.489 03:30:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:22.489 03:30:03 -- target/connect_stress.sh@34 -- # kill -0 3016066 00:13:22.489 03:30:03 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:22.489 03:30:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:22.489 03:30:03 -- common/autotest_common.sh@10 -- # set +x 00:13:23.054 03:30:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:23.054 03:30:03 -- target/connect_stress.sh@34 -- # kill -0 3016066 00:13:23.054 03:30:03 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:23.054 03:30:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:23.054 03:30:03 -- common/autotest_common.sh@10 -- # set +x 00:13:23.312 03:30:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:23.312 03:30:03 -- target/connect_stress.sh@34 -- # kill -0 3016066 00:13:23.312 03:30:03 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:23.312 03:30:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:23.312 03:30:03 -- common/autotest_common.sh@10 -- # set +x 00:13:23.570 03:30:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:23.570 03:30:04 -- target/connect_stress.sh@34 -- # kill -0 3016066 00:13:23.570 03:30:04 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:23.570 03:30:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:23.570 03:30:04 -- common/autotest_common.sh@10 -- # set +x 00:13:23.828 03:30:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:23.828 03:30:04 -- target/connect_stress.sh@34 -- # kill -0 3016066 00:13:23.828 03:30:04 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:23.828 03:30:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:23.828 03:30:04 -- common/autotest_common.sh@10 -- # set +x 00:13:24.086 03:30:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:24.086 03:30:04 -- target/connect_stress.sh@34 -- # kill -0 3016066 00:13:24.086 03:30:04 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:24.086 03:30:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:24.086 03:30:04 -- common/autotest_common.sh@10 -- # set +x 00:13:24.652 03:30:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:24.652 03:30:04 -- target/connect_stress.sh@34 -- # kill -0 3016066 00:13:24.652 03:30:04 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:24.652 03:30:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:24.652 03:30:04 -- common/autotest_common.sh@10 -- # set +x 00:13:24.910 03:30:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:24.910 03:30:05 -- target/connect_stress.sh@34 -- # kill -0 3016066 00:13:24.910 03:30:05 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:24.910 03:30:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:24.910 03:30:05 -- common/autotest_common.sh@10 -- # set +x 00:13:25.167 03:30:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:25.167 03:30:05 -- target/connect_stress.sh@34 -- # kill -0 3016066 00:13:25.167 03:30:05 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:25.167 03:30:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:25.167 03:30:05 -- common/autotest_common.sh@10 -- # set +x 00:13:25.425 03:30:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:25.425 03:30:05 -- target/connect_stress.sh@34 -- # kill -0 3016066 00:13:25.425 03:30:05 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:25.425 03:30:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:25.425 03:30:05 -- common/autotest_common.sh@10 -- # set +x 00:13:25.682 03:30:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:25.682 03:30:06 -- target/connect_stress.sh@34 -- # kill -0 3016066 00:13:25.682 03:30:06 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:25.682 03:30:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:25.682 03:30:06 -- common/autotest_common.sh@10 -- # set +x 00:13:26.248 03:30:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:26.248 03:30:06 -- target/connect_stress.sh@34 -- # kill -0 3016066 00:13:26.248 03:30:06 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:26.248 03:30:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:26.248 03:30:06 -- common/autotest_common.sh@10 -- # set +x 00:13:26.505 03:30:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:26.505 03:30:06 -- target/connect_stress.sh@34 -- # kill -0 3016066 00:13:26.505 03:30:06 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:26.506 03:30:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:26.506 03:30:06 -- common/autotest_common.sh@10 -- # set +x 00:13:26.763 03:30:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:26.763 03:30:07 -- target/connect_stress.sh@34 -- # kill -0 3016066 00:13:26.763 03:30:07 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:26.763 03:30:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:26.763 03:30:07 -- common/autotest_common.sh@10 -- # set +x 00:13:27.020 03:30:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:27.020 03:30:07 -- target/connect_stress.sh@34 -- # kill -0 3016066 00:13:27.020 03:30:07 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:27.020 03:30:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:27.020 03:30:07 -- common/autotest_common.sh@10 -- # set +x 00:13:27.277 03:30:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:27.277 03:30:07 -- target/connect_stress.sh@34 -- # kill -0 3016066 00:13:27.277 03:30:07 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:27.277 03:30:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:27.277 03:30:07 -- common/autotest_common.sh@10 -- # set +x 00:13:27.843 03:30:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:27.843 03:30:08 -- target/connect_stress.sh@34 -- # kill -0 3016066 00:13:27.843 03:30:08 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:27.843 03:30:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:27.843 03:30:08 -- common/autotest_common.sh@10 -- # set +x 00:13:28.099 03:30:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:28.099 03:30:08 -- target/connect_stress.sh@34 -- # kill -0 3016066 00:13:28.099 03:30:08 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:28.099 03:30:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:28.099 03:30:08 -- common/autotest_common.sh@10 -- # set +x 00:13:28.357 03:30:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:28.357 03:30:08 -- target/connect_stress.sh@34 -- # kill -0 3016066 00:13:28.357 03:30:08 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:28.357 03:30:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:28.357 03:30:08 -- common/autotest_common.sh@10 -- # set +x 00:13:28.617 03:30:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:28.617 03:30:09 -- target/connect_stress.sh@34 -- # kill -0 3016066 00:13:28.617 03:30:09 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:28.617 03:30:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:28.617 03:30:09 -- common/autotest_common.sh@10 -- # set +x 00:13:28.878 03:30:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:28.878 03:30:09 -- target/connect_stress.sh@34 -- # kill -0 3016066 00:13:28.878 03:30:09 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:28.878 03:30:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:28.878 03:30:09 -- common/autotest_common.sh@10 -- # set +x 00:13:29.135 Testing NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:13:29.392 03:30:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:29.392 03:30:09 -- target/connect_stress.sh@34 -- # kill -0 3016066 00:13:29.392 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh: line 34: kill: (3016066) - No such process 00:13:29.392 03:30:09 -- target/connect_stress.sh@38 -- # wait 3016066 00:13:29.392 03:30:09 -- target/connect_stress.sh@39 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:13:29.392 03:30:09 -- target/connect_stress.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:13:29.392 03:30:09 -- target/connect_stress.sh@43 -- # nvmftestfini 00:13:29.392 03:30:09 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:29.392 03:30:09 -- nvmf/common.sh@116 -- # sync 00:13:29.392 03:30:09 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:29.392 03:30:09 -- nvmf/common.sh@119 -- # set +e 00:13:29.392 03:30:09 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:29.392 03:30:09 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:29.392 rmmod nvme_tcp 00:13:29.392 rmmod nvme_fabrics 00:13:29.392 rmmod nvme_keyring 00:13:29.392 03:30:09 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:29.392 03:30:09 -- nvmf/common.sh@123 -- # set -e 00:13:29.392 03:30:09 -- nvmf/common.sh@124 -- # return 0 00:13:29.392 03:30:09 -- nvmf/common.sh@477 -- # '[' -n 3015909 ']' 00:13:29.392 03:30:09 -- nvmf/common.sh@478 -- # killprocess 3015909 00:13:29.392 03:30:09 -- common/autotest_common.sh@936 -- # '[' -z 3015909 ']' 00:13:29.393 03:30:09 -- common/autotest_common.sh@940 -- # kill -0 3015909 00:13:29.393 03:30:09 -- common/autotest_common.sh@941 -- # uname 00:13:29.393 03:30:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:29.393 03:30:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3015909 00:13:29.393 03:30:09 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:13:29.393 03:30:09 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:13:29.393 03:30:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3015909' 00:13:29.393 killing process with pid 3015909 00:13:29.393 03:30:09 -- common/autotest_common.sh@955 -- # kill 3015909 00:13:29.393 03:30:09 -- common/autotest_common.sh@960 -- # wait 3015909 00:13:29.652 03:30:10 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:29.652 03:30:10 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:29.652 03:30:10 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:29.652 03:30:10 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:29.652 03:30:10 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:29.652 03:30:10 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:29.652 03:30:10 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:29.652 03:30:10 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:32.189 03:30:12 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:32.189 00:13:32.189 real 0m16.064s 00:13:32.189 user 0m40.925s 00:13:32.189 sys 0m5.777s 00:13:32.189 03:30:12 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:32.189 03:30:12 -- common/autotest_common.sh@10 -- # set +x 00:13:32.189 ************************************ 00:13:32.189 END TEST nvmf_connect_stress 00:13:32.189 ************************************ 00:13:32.189 03:30:12 -- nvmf/nvmf.sh@34 -- # run_test nvmf_fused_ordering /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:13:32.189 03:30:12 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:32.189 03:30:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:32.189 03:30:12 -- common/autotest_common.sh@10 -- # set +x 00:13:32.189 ************************************ 00:13:32.189 START TEST nvmf_fused_ordering 00:13:32.189 ************************************ 00:13:32.189 03:30:12 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:13:32.189 * Looking for test storage... 00:13:32.189 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:32.189 03:30:12 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:32.189 03:30:12 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:32.189 03:30:12 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:32.189 03:30:12 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:32.189 03:30:12 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:32.189 03:30:12 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:32.189 03:30:12 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:32.189 03:30:12 -- scripts/common.sh@335 -- # IFS=.-: 00:13:32.189 03:30:12 -- scripts/common.sh@335 -- # read -ra ver1 00:13:32.189 03:30:12 -- scripts/common.sh@336 -- # IFS=.-: 00:13:32.189 03:30:12 -- scripts/common.sh@336 -- # read -ra ver2 00:13:32.189 03:30:12 -- scripts/common.sh@337 -- # local 'op=<' 00:13:32.189 03:30:12 -- scripts/common.sh@339 -- # ver1_l=2 00:13:32.189 03:30:12 -- scripts/common.sh@340 -- # ver2_l=1 00:13:32.189 03:30:12 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:32.189 03:30:12 -- scripts/common.sh@343 -- # case "$op" in 00:13:32.189 03:30:12 -- scripts/common.sh@344 -- # : 1 00:13:32.189 03:30:12 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:32.189 03:30:12 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:32.189 03:30:12 -- scripts/common.sh@364 -- # decimal 1 00:13:32.189 03:30:12 -- scripts/common.sh@352 -- # local d=1 00:13:32.189 03:30:12 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:32.189 03:30:12 -- scripts/common.sh@354 -- # echo 1 00:13:32.189 03:30:12 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:32.189 03:30:12 -- scripts/common.sh@365 -- # decimal 2 00:13:32.189 03:30:12 -- scripts/common.sh@352 -- # local d=2 00:13:32.189 03:30:12 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:32.189 03:30:12 -- scripts/common.sh@354 -- # echo 2 00:13:32.189 03:30:12 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:32.189 03:30:12 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:32.189 03:30:12 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:32.189 03:30:12 -- scripts/common.sh@367 -- # return 0 00:13:32.189 03:30:12 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:32.189 03:30:12 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:32.189 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:32.189 --rc genhtml_branch_coverage=1 00:13:32.189 --rc genhtml_function_coverage=1 00:13:32.189 --rc genhtml_legend=1 00:13:32.189 --rc geninfo_all_blocks=1 00:13:32.189 --rc geninfo_unexecuted_blocks=1 00:13:32.189 00:13:32.189 ' 00:13:32.189 03:30:12 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:32.189 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:32.189 --rc genhtml_branch_coverage=1 00:13:32.189 --rc genhtml_function_coverage=1 00:13:32.189 --rc genhtml_legend=1 00:13:32.189 --rc geninfo_all_blocks=1 00:13:32.189 --rc geninfo_unexecuted_blocks=1 00:13:32.189 00:13:32.189 ' 00:13:32.189 03:30:12 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:32.189 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:32.189 --rc genhtml_branch_coverage=1 00:13:32.189 --rc genhtml_function_coverage=1 00:13:32.189 --rc genhtml_legend=1 00:13:32.189 --rc geninfo_all_blocks=1 00:13:32.189 --rc geninfo_unexecuted_blocks=1 00:13:32.189 00:13:32.189 ' 00:13:32.189 03:30:12 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:32.189 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:32.189 --rc genhtml_branch_coverage=1 00:13:32.189 --rc genhtml_function_coverage=1 00:13:32.189 --rc genhtml_legend=1 00:13:32.189 --rc geninfo_all_blocks=1 00:13:32.189 --rc geninfo_unexecuted_blocks=1 00:13:32.189 00:13:32.189 ' 00:13:32.189 03:30:12 -- target/fused_ordering.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:32.189 03:30:12 -- nvmf/common.sh@7 -- # uname -s 00:13:32.189 03:30:12 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:32.189 03:30:12 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:32.189 03:30:12 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:32.189 03:30:12 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:32.189 03:30:12 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:32.189 03:30:12 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:32.189 03:30:12 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:32.189 03:30:12 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:32.189 03:30:12 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:32.189 03:30:12 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:32.189 03:30:12 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:32.189 03:30:12 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:32.189 03:30:12 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:32.189 03:30:12 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:32.189 03:30:12 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:32.189 03:30:12 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:32.189 03:30:12 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:32.189 03:30:12 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:32.189 03:30:12 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:32.189 03:30:12 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:32.189 03:30:12 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:32.189 03:30:12 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:32.189 03:30:12 -- paths/export.sh@5 -- # export PATH 00:13:32.189 03:30:12 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:32.189 03:30:12 -- nvmf/common.sh@46 -- # : 0 00:13:32.189 03:30:12 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:32.189 03:30:12 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:32.189 03:30:12 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:32.189 03:30:12 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:32.189 03:30:12 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:32.189 03:30:12 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:32.189 03:30:12 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:32.189 03:30:12 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:32.189 03:30:12 -- target/fused_ordering.sh@12 -- # nvmftestinit 00:13:32.189 03:30:12 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:32.189 03:30:12 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:32.189 03:30:12 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:32.189 03:30:12 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:32.189 03:30:12 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:32.189 03:30:12 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:32.189 03:30:12 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:32.189 03:30:12 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:32.189 03:30:12 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:32.189 03:30:12 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:32.189 03:30:12 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:32.189 03:30:12 -- common/autotest_common.sh@10 -- # set +x 00:13:34.092 03:30:14 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:34.092 03:30:14 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:34.092 03:30:14 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:34.092 03:30:14 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:34.092 03:30:14 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:34.092 03:30:14 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:34.092 03:30:14 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:34.092 03:30:14 -- nvmf/common.sh@294 -- # net_devs=() 00:13:34.092 03:30:14 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:34.092 03:30:14 -- nvmf/common.sh@295 -- # e810=() 00:13:34.092 03:30:14 -- nvmf/common.sh@295 -- # local -ga e810 00:13:34.092 03:30:14 -- nvmf/common.sh@296 -- # x722=() 00:13:34.092 03:30:14 -- nvmf/common.sh@296 -- # local -ga x722 00:13:34.092 03:30:14 -- nvmf/common.sh@297 -- # mlx=() 00:13:34.092 03:30:14 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:34.092 03:30:14 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:34.092 03:30:14 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:34.092 03:30:14 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:34.092 03:30:14 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:34.092 03:30:14 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:34.092 03:30:14 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:34.092 03:30:14 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:34.092 03:30:14 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:34.092 03:30:14 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:34.092 03:30:14 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:34.092 03:30:14 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:34.092 03:30:14 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:34.092 03:30:14 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:34.092 03:30:14 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:34.092 03:30:14 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:34.092 03:30:14 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:34.092 03:30:14 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:34.092 03:30:14 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:34.092 03:30:14 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:34.092 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:34.092 03:30:14 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:34.092 03:30:14 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:34.092 03:30:14 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:34.092 03:30:14 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:34.092 03:30:14 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:34.092 03:30:14 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:34.092 03:30:14 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:34.092 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:34.092 03:30:14 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:34.092 03:30:14 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:34.092 03:30:14 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:34.092 03:30:14 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:34.092 03:30:14 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:34.092 03:30:14 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:34.092 03:30:14 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:34.092 03:30:14 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:34.092 03:30:14 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:34.092 03:30:14 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:34.092 03:30:14 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:34.092 03:30:14 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:34.092 03:30:14 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:34.092 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:34.092 03:30:14 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:34.092 03:30:14 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:34.092 03:30:14 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:34.092 03:30:14 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:34.092 03:30:14 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:34.092 03:30:14 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:34.092 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:34.092 03:30:14 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:34.092 03:30:14 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:34.092 03:30:14 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:34.092 03:30:14 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:34.092 03:30:14 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:34.092 03:30:14 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:34.092 03:30:14 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:34.092 03:30:14 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:34.092 03:30:14 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:34.092 03:30:14 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:34.092 03:30:14 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:34.092 03:30:14 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:34.092 03:30:14 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:34.092 03:30:14 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:34.092 03:30:14 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:34.092 03:30:14 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:34.092 03:30:14 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:34.092 03:30:14 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:34.092 03:30:14 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:34.092 03:30:14 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:34.092 03:30:14 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:34.092 03:30:14 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:34.092 03:30:14 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:34.092 03:30:14 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:34.092 03:30:14 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:34.092 03:30:14 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:34.092 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:34.092 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.237 ms 00:13:34.092 00:13:34.092 --- 10.0.0.2 ping statistics --- 00:13:34.092 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:34.092 rtt min/avg/max/mdev = 0.237/0.237/0.237/0.000 ms 00:13:34.092 03:30:14 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:34.092 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:34.092 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.129 ms 00:13:34.092 00:13:34.092 --- 10.0.0.1 ping statistics --- 00:13:34.092 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:34.092 rtt min/avg/max/mdev = 0.129/0.129/0.129/0.000 ms 00:13:34.092 03:30:14 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:34.092 03:30:14 -- nvmf/common.sh@410 -- # return 0 00:13:34.092 03:30:14 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:34.092 03:30:14 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:34.092 03:30:14 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:34.092 03:30:14 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:34.092 03:30:14 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:34.092 03:30:14 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:34.092 03:30:14 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:34.092 03:30:14 -- target/fused_ordering.sh@13 -- # nvmfappstart -m 0x2 00:13:34.092 03:30:14 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:34.092 03:30:14 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:34.092 03:30:14 -- common/autotest_common.sh@10 -- # set +x 00:13:34.092 03:30:14 -- nvmf/common.sh@469 -- # nvmfpid=3019885 00:13:34.092 03:30:14 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:13:34.092 03:30:14 -- nvmf/common.sh@470 -- # waitforlisten 3019885 00:13:34.092 03:30:14 -- common/autotest_common.sh@829 -- # '[' -z 3019885 ']' 00:13:34.092 03:30:14 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:34.092 03:30:14 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:34.092 03:30:14 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:34.092 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:34.092 03:30:14 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:34.092 03:30:14 -- common/autotest_common.sh@10 -- # set +x 00:13:34.093 [2024-11-21 03:30:14.557523] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:34.093 [2024-11-21 03:30:14.557617] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:34.093 EAL: No free 2048 kB hugepages reported on node 1 00:13:34.093 [2024-11-21 03:30:14.626146] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:13:34.351 [2024-11-21 03:30:14.739613] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:34.351 [2024-11-21 03:30:14.739787] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:34.351 [2024-11-21 03:30:14.739808] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:34.351 [2024-11-21 03:30:14.739823] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:34.351 [2024-11-21 03:30:14.739855] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:34.918 03:30:15 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:34.918 03:30:15 -- common/autotest_common.sh@862 -- # return 0 00:13:34.918 03:30:15 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:34.918 03:30:15 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:34.918 03:30:15 -- common/autotest_common.sh@10 -- # set +x 00:13:34.918 03:30:15 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:34.918 03:30:15 -- target/fused_ordering.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:34.918 03:30:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.918 03:30:15 -- common/autotest_common.sh@10 -- # set +x 00:13:34.918 [2024-11-21 03:30:15.541891] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:34.918 03:30:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.918 03:30:15 -- target/fused_ordering.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:34.918 03:30:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.918 03:30:15 -- common/autotest_common.sh@10 -- # set +x 00:13:34.918 03:30:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.918 03:30:15 -- target/fused_ordering.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:34.918 03:30:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.918 03:30:15 -- common/autotest_common.sh@10 -- # set +x 00:13:34.918 [2024-11-21 03:30:15.558085] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:34.918 03:30:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.918 03:30:15 -- target/fused_ordering.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:13:34.918 03:30:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.918 03:30:15 -- common/autotest_common.sh@10 -- # set +x 00:13:35.177 NULL1 00:13:35.177 03:30:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:35.177 03:30:15 -- target/fused_ordering.sh@19 -- # rpc_cmd bdev_wait_for_examine 00:13:35.177 03:30:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:35.177 03:30:15 -- common/autotest_common.sh@10 -- # set +x 00:13:35.177 03:30:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:35.177 03:30:15 -- target/fused_ordering.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:13:35.177 03:30:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:35.177 03:30:15 -- common/autotest_common.sh@10 -- # set +x 00:13:35.177 03:30:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:35.177 03:30:15 -- target/fused_ordering.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/fused_ordering/fused_ordering -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:13:35.177 [2024-11-21 03:30:15.602578] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:35.177 [2024-11-21 03:30:15.602617] [ DPDK EAL parameters: fused_ordering --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3020042 ] 00:13:35.177 EAL: No free 2048 kB hugepages reported on node 1 00:13:35.740 Attached to nqn.2016-06.io.spdk:cnode1 00:13:35.740 Namespace ID: 1 size: 1GB 00:13:35.740 fused_ordering(0) 00:13:35.740 fused_ordering(1) 00:13:35.740 fused_ordering(2) 00:13:35.740 fused_ordering(3) 00:13:35.740 fused_ordering(4) 00:13:35.740 fused_ordering(5) 00:13:35.741 fused_ordering(6) 00:13:35.741 fused_ordering(7) 00:13:35.741 fused_ordering(8) 00:13:35.741 fused_ordering(9) 00:13:35.741 fused_ordering(10) 00:13:35.741 fused_ordering(11) 00:13:35.741 fused_ordering(12) 00:13:35.741 fused_ordering(13) 00:13:35.741 fused_ordering(14) 00:13:35.741 fused_ordering(15) 00:13:35.741 fused_ordering(16) 00:13:35.741 fused_ordering(17) 00:13:35.741 fused_ordering(18) 00:13:35.741 fused_ordering(19) 00:13:35.741 fused_ordering(20) 00:13:35.741 fused_ordering(21) 00:13:35.741 fused_ordering(22) 00:13:35.741 fused_ordering(23) 00:13:35.741 fused_ordering(24) 00:13:35.741 fused_ordering(25) 00:13:35.741 fused_ordering(26) 00:13:35.741 fused_ordering(27) 00:13:35.741 fused_ordering(28) 00:13:35.741 fused_ordering(29) 00:13:35.741 fused_ordering(30) 00:13:35.741 fused_ordering(31) 00:13:35.741 fused_ordering(32) 00:13:35.741 fused_ordering(33) 00:13:35.741 fused_ordering(34) 00:13:35.741 fused_ordering(35) 00:13:35.741 fused_ordering(36) 00:13:35.741 fused_ordering(37) 00:13:35.741 fused_ordering(38) 00:13:35.741 fused_ordering(39) 00:13:35.741 fused_ordering(40) 00:13:35.741 fused_ordering(41) 00:13:35.741 fused_ordering(42) 00:13:35.741 fused_ordering(43) 00:13:35.741 fused_ordering(44) 00:13:35.741 fused_ordering(45) 00:13:35.741 fused_ordering(46) 00:13:35.741 fused_ordering(47) 00:13:35.741 fused_ordering(48) 00:13:35.741 fused_ordering(49) 00:13:35.741 fused_ordering(50) 00:13:35.741 fused_ordering(51) 00:13:35.741 fused_ordering(52) 00:13:35.741 fused_ordering(53) 00:13:35.741 fused_ordering(54) 00:13:35.741 fused_ordering(55) 00:13:35.741 fused_ordering(56) 00:13:35.741 fused_ordering(57) 00:13:35.741 fused_ordering(58) 00:13:35.741 fused_ordering(59) 00:13:35.741 fused_ordering(60) 00:13:35.741 fused_ordering(61) 00:13:35.741 fused_ordering(62) 00:13:35.741 fused_ordering(63) 00:13:35.741 fused_ordering(64) 00:13:35.741 fused_ordering(65) 00:13:35.741 fused_ordering(66) 00:13:35.741 fused_ordering(67) 00:13:35.741 fused_ordering(68) 00:13:35.741 fused_ordering(69) 00:13:35.741 fused_ordering(70) 00:13:35.741 fused_ordering(71) 00:13:35.741 fused_ordering(72) 00:13:35.741 fused_ordering(73) 00:13:35.741 fused_ordering(74) 00:13:35.741 fused_ordering(75) 00:13:35.741 fused_ordering(76) 00:13:35.741 fused_ordering(77) 00:13:35.741 fused_ordering(78) 00:13:35.741 fused_ordering(79) 00:13:35.741 fused_ordering(80) 00:13:35.741 fused_ordering(81) 00:13:35.741 fused_ordering(82) 00:13:35.741 fused_ordering(83) 00:13:35.741 fused_ordering(84) 00:13:35.741 fused_ordering(85) 00:13:35.741 fused_ordering(86) 00:13:35.741 fused_ordering(87) 00:13:35.741 fused_ordering(88) 00:13:35.741 fused_ordering(89) 00:13:35.741 fused_ordering(90) 00:13:35.741 fused_ordering(91) 00:13:35.741 fused_ordering(92) 00:13:35.741 fused_ordering(93) 00:13:35.741 fused_ordering(94) 00:13:35.741 fused_ordering(95) 00:13:35.741 fused_ordering(96) 00:13:35.741 fused_ordering(97) 00:13:35.741 fused_ordering(98) 00:13:35.741 fused_ordering(99) 00:13:35.741 fused_ordering(100) 00:13:35.741 fused_ordering(101) 00:13:35.741 fused_ordering(102) 00:13:35.741 fused_ordering(103) 00:13:35.741 fused_ordering(104) 00:13:35.741 fused_ordering(105) 00:13:35.741 fused_ordering(106) 00:13:35.741 fused_ordering(107) 00:13:35.741 fused_ordering(108) 00:13:35.741 fused_ordering(109) 00:13:35.741 fused_ordering(110) 00:13:35.741 fused_ordering(111) 00:13:35.741 fused_ordering(112) 00:13:35.741 fused_ordering(113) 00:13:35.741 fused_ordering(114) 00:13:35.741 fused_ordering(115) 00:13:35.741 fused_ordering(116) 00:13:35.741 fused_ordering(117) 00:13:35.741 fused_ordering(118) 00:13:35.741 fused_ordering(119) 00:13:35.741 fused_ordering(120) 00:13:35.741 fused_ordering(121) 00:13:35.741 fused_ordering(122) 00:13:35.741 fused_ordering(123) 00:13:35.741 fused_ordering(124) 00:13:35.741 fused_ordering(125) 00:13:35.741 fused_ordering(126) 00:13:35.741 fused_ordering(127) 00:13:35.741 fused_ordering(128) 00:13:35.741 fused_ordering(129) 00:13:35.741 fused_ordering(130) 00:13:35.741 fused_ordering(131) 00:13:35.741 fused_ordering(132) 00:13:35.741 fused_ordering(133) 00:13:35.741 fused_ordering(134) 00:13:35.741 fused_ordering(135) 00:13:35.741 fused_ordering(136) 00:13:35.741 fused_ordering(137) 00:13:35.741 fused_ordering(138) 00:13:35.741 fused_ordering(139) 00:13:35.741 fused_ordering(140) 00:13:35.741 fused_ordering(141) 00:13:35.741 fused_ordering(142) 00:13:35.741 fused_ordering(143) 00:13:35.741 fused_ordering(144) 00:13:35.741 fused_ordering(145) 00:13:35.741 fused_ordering(146) 00:13:35.741 fused_ordering(147) 00:13:35.741 fused_ordering(148) 00:13:35.741 fused_ordering(149) 00:13:35.741 fused_ordering(150) 00:13:35.741 fused_ordering(151) 00:13:35.741 fused_ordering(152) 00:13:35.741 fused_ordering(153) 00:13:35.741 fused_ordering(154) 00:13:35.741 fused_ordering(155) 00:13:35.741 fused_ordering(156) 00:13:35.741 fused_ordering(157) 00:13:35.741 fused_ordering(158) 00:13:35.741 fused_ordering(159) 00:13:35.741 fused_ordering(160) 00:13:35.741 fused_ordering(161) 00:13:35.741 fused_ordering(162) 00:13:35.741 fused_ordering(163) 00:13:35.741 fused_ordering(164) 00:13:35.741 fused_ordering(165) 00:13:35.741 fused_ordering(166) 00:13:35.741 fused_ordering(167) 00:13:35.741 fused_ordering(168) 00:13:35.741 fused_ordering(169) 00:13:35.741 fused_ordering(170) 00:13:35.741 fused_ordering(171) 00:13:35.741 fused_ordering(172) 00:13:35.741 fused_ordering(173) 00:13:35.741 fused_ordering(174) 00:13:35.741 fused_ordering(175) 00:13:35.741 fused_ordering(176) 00:13:35.741 fused_ordering(177) 00:13:35.741 fused_ordering(178) 00:13:35.741 fused_ordering(179) 00:13:35.741 fused_ordering(180) 00:13:35.741 fused_ordering(181) 00:13:35.741 fused_ordering(182) 00:13:35.741 fused_ordering(183) 00:13:35.741 fused_ordering(184) 00:13:35.741 fused_ordering(185) 00:13:35.741 fused_ordering(186) 00:13:35.741 fused_ordering(187) 00:13:35.741 fused_ordering(188) 00:13:35.741 fused_ordering(189) 00:13:35.741 fused_ordering(190) 00:13:35.741 fused_ordering(191) 00:13:35.741 fused_ordering(192) 00:13:35.741 fused_ordering(193) 00:13:35.741 fused_ordering(194) 00:13:35.741 fused_ordering(195) 00:13:35.741 fused_ordering(196) 00:13:35.741 fused_ordering(197) 00:13:35.741 fused_ordering(198) 00:13:35.741 fused_ordering(199) 00:13:35.741 fused_ordering(200) 00:13:35.741 fused_ordering(201) 00:13:35.741 fused_ordering(202) 00:13:35.741 fused_ordering(203) 00:13:35.741 fused_ordering(204) 00:13:35.741 fused_ordering(205) 00:13:35.999 fused_ordering(206) 00:13:35.999 fused_ordering(207) 00:13:35.999 fused_ordering(208) 00:13:35.999 fused_ordering(209) 00:13:35.999 fused_ordering(210) 00:13:35.999 fused_ordering(211) 00:13:35.999 fused_ordering(212) 00:13:35.999 fused_ordering(213) 00:13:35.999 fused_ordering(214) 00:13:35.999 fused_ordering(215) 00:13:35.999 fused_ordering(216) 00:13:35.999 fused_ordering(217) 00:13:35.999 fused_ordering(218) 00:13:35.999 fused_ordering(219) 00:13:35.999 fused_ordering(220) 00:13:35.999 fused_ordering(221) 00:13:35.999 fused_ordering(222) 00:13:35.999 fused_ordering(223) 00:13:35.999 fused_ordering(224) 00:13:35.999 fused_ordering(225) 00:13:35.999 fused_ordering(226) 00:13:35.999 fused_ordering(227) 00:13:35.999 fused_ordering(228) 00:13:35.999 fused_ordering(229) 00:13:35.999 fused_ordering(230) 00:13:35.999 fused_ordering(231) 00:13:35.999 fused_ordering(232) 00:13:35.999 fused_ordering(233) 00:13:35.999 fused_ordering(234) 00:13:35.999 fused_ordering(235) 00:13:35.999 fused_ordering(236) 00:13:35.999 fused_ordering(237) 00:13:35.999 fused_ordering(238) 00:13:35.999 fused_ordering(239) 00:13:35.999 fused_ordering(240) 00:13:35.999 fused_ordering(241) 00:13:35.999 fused_ordering(242) 00:13:35.999 fused_ordering(243) 00:13:35.999 fused_ordering(244) 00:13:35.999 fused_ordering(245) 00:13:35.999 fused_ordering(246) 00:13:35.999 fused_ordering(247) 00:13:35.999 fused_ordering(248) 00:13:35.999 fused_ordering(249) 00:13:35.999 fused_ordering(250) 00:13:35.999 fused_ordering(251) 00:13:35.999 fused_ordering(252) 00:13:35.999 fused_ordering(253) 00:13:35.999 fused_ordering(254) 00:13:35.999 fused_ordering(255) 00:13:35.999 fused_ordering(256) 00:13:35.999 fused_ordering(257) 00:13:35.999 fused_ordering(258) 00:13:35.999 fused_ordering(259) 00:13:35.999 fused_ordering(260) 00:13:35.999 fused_ordering(261) 00:13:35.999 fused_ordering(262) 00:13:35.999 fused_ordering(263) 00:13:35.999 fused_ordering(264) 00:13:35.999 fused_ordering(265) 00:13:35.999 fused_ordering(266) 00:13:35.999 fused_ordering(267) 00:13:35.999 fused_ordering(268) 00:13:35.999 fused_ordering(269) 00:13:35.999 fused_ordering(270) 00:13:35.999 fused_ordering(271) 00:13:35.999 fused_ordering(272) 00:13:35.999 fused_ordering(273) 00:13:35.999 fused_ordering(274) 00:13:35.999 fused_ordering(275) 00:13:35.999 fused_ordering(276) 00:13:35.999 fused_ordering(277) 00:13:35.999 fused_ordering(278) 00:13:35.999 fused_ordering(279) 00:13:35.999 fused_ordering(280) 00:13:35.999 fused_ordering(281) 00:13:35.999 fused_ordering(282) 00:13:35.999 fused_ordering(283) 00:13:35.999 fused_ordering(284) 00:13:35.999 fused_ordering(285) 00:13:35.999 fused_ordering(286) 00:13:35.999 fused_ordering(287) 00:13:35.999 fused_ordering(288) 00:13:35.999 fused_ordering(289) 00:13:35.999 fused_ordering(290) 00:13:35.999 fused_ordering(291) 00:13:35.999 fused_ordering(292) 00:13:35.999 fused_ordering(293) 00:13:35.999 fused_ordering(294) 00:13:35.999 fused_ordering(295) 00:13:35.999 fused_ordering(296) 00:13:35.999 fused_ordering(297) 00:13:35.999 fused_ordering(298) 00:13:35.999 fused_ordering(299) 00:13:35.999 fused_ordering(300) 00:13:35.999 fused_ordering(301) 00:13:35.999 fused_ordering(302) 00:13:36.000 fused_ordering(303) 00:13:36.000 fused_ordering(304) 00:13:36.000 fused_ordering(305) 00:13:36.000 fused_ordering(306) 00:13:36.000 fused_ordering(307) 00:13:36.000 fused_ordering(308) 00:13:36.000 fused_ordering(309) 00:13:36.000 fused_ordering(310) 00:13:36.000 fused_ordering(311) 00:13:36.000 fused_ordering(312) 00:13:36.000 fused_ordering(313) 00:13:36.000 fused_ordering(314) 00:13:36.000 fused_ordering(315) 00:13:36.000 fused_ordering(316) 00:13:36.000 fused_ordering(317) 00:13:36.000 fused_ordering(318) 00:13:36.000 fused_ordering(319) 00:13:36.000 fused_ordering(320) 00:13:36.000 fused_ordering(321) 00:13:36.000 fused_ordering(322) 00:13:36.000 fused_ordering(323) 00:13:36.000 fused_ordering(324) 00:13:36.000 fused_ordering(325) 00:13:36.000 fused_ordering(326) 00:13:36.000 fused_ordering(327) 00:13:36.000 fused_ordering(328) 00:13:36.000 fused_ordering(329) 00:13:36.000 fused_ordering(330) 00:13:36.000 fused_ordering(331) 00:13:36.000 fused_ordering(332) 00:13:36.000 fused_ordering(333) 00:13:36.000 fused_ordering(334) 00:13:36.000 fused_ordering(335) 00:13:36.000 fused_ordering(336) 00:13:36.000 fused_ordering(337) 00:13:36.000 fused_ordering(338) 00:13:36.000 fused_ordering(339) 00:13:36.000 fused_ordering(340) 00:13:36.000 fused_ordering(341) 00:13:36.000 fused_ordering(342) 00:13:36.000 fused_ordering(343) 00:13:36.000 fused_ordering(344) 00:13:36.000 fused_ordering(345) 00:13:36.000 fused_ordering(346) 00:13:36.000 fused_ordering(347) 00:13:36.000 fused_ordering(348) 00:13:36.000 fused_ordering(349) 00:13:36.000 fused_ordering(350) 00:13:36.000 fused_ordering(351) 00:13:36.000 fused_ordering(352) 00:13:36.000 fused_ordering(353) 00:13:36.000 fused_ordering(354) 00:13:36.000 fused_ordering(355) 00:13:36.000 fused_ordering(356) 00:13:36.000 fused_ordering(357) 00:13:36.000 fused_ordering(358) 00:13:36.000 fused_ordering(359) 00:13:36.000 fused_ordering(360) 00:13:36.000 fused_ordering(361) 00:13:36.000 fused_ordering(362) 00:13:36.000 fused_ordering(363) 00:13:36.000 fused_ordering(364) 00:13:36.000 fused_ordering(365) 00:13:36.000 fused_ordering(366) 00:13:36.000 fused_ordering(367) 00:13:36.000 fused_ordering(368) 00:13:36.000 fused_ordering(369) 00:13:36.000 fused_ordering(370) 00:13:36.000 fused_ordering(371) 00:13:36.000 fused_ordering(372) 00:13:36.000 fused_ordering(373) 00:13:36.000 fused_ordering(374) 00:13:36.000 fused_ordering(375) 00:13:36.000 fused_ordering(376) 00:13:36.000 fused_ordering(377) 00:13:36.000 fused_ordering(378) 00:13:36.000 fused_ordering(379) 00:13:36.000 fused_ordering(380) 00:13:36.000 fused_ordering(381) 00:13:36.000 fused_ordering(382) 00:13:36.000 fused_ordering(383) 00:13:36.000 fused_ordering(384) 00:13:36.000 fused_ordering(385) 00:13:36.000 fused_ordering(386) 00:13:36.000 fused_ordering(387) 00:13:36.000 fused_ordering(388) 00:13:36.000 fused_ordering(389) 00:13:36.000 fused_ordering(390) 00:13:36.000 fused_ordering(391) 00:13:36.000 fused_ordering(392) 00:13:36.000 fused_ordering(393) 00:13:36.000 fused_ordering(394) 00:13:36.000 fused_ordering(395) 00:13:36.000 fused_ordering(396) 00:13:36.000 fused_ordering(397) 00:13:36.000 fused_ordering(398) 00:13:36.000 fused_ordering(399) 00:13:36.000 fused_ordering(400) 00:13:36.000 fused_ordering(401) 00:13:36.000 fused_ordering(402) 00:13:36.000 fused_ordering(403) 00:13:36.000 fused_ordering(404) 00:13:36.000 fused_ordering(405) 00:13:36.000 fused_ordering(406) 00:13:36.000 fused_ordering(407) 00:13:36.000 fused_ordering(408) 00:13:36.000 fused_ordering(409) 00:13:36.000 fused_ordering(410) 00:13:36.566 fused_ordering(411) 00:13:36.566 fused_ordering(412) 00:13:36.566 fused_ordering(413) 00:13:36.566 fused_ordering(414) 00:13:36.566 fused_ordering(415) 00:13:36.566 fused_ordering(416) 00:13:36.566 fused_ordering(417) 00:13:36.566 fused_ordering(418) 00:13:36.566 fused_ordering(419) 00:13:36.566 fused_ordering(420) 00:13:36.566 fused_ordering(421) 00:13:36.566 fused_ordering(422) 00:13:36.566 fused_ordering(423) 00:13:36.566 fused_ordering(424) 00:13:36.566 fused_ordering(425) 00:13:36.566 fused_ordering(426) 00:13:36.566 fused_ordering(427) 00:13:36.566 fused_ordering(428) 00:13:36.566 fused_ordering(429) 00:13:36.566 fused_ordering(430) 00:13:36.566 fused_ordering(431) 00:13:36.566 fused_ordering(432) 00:13:36.566 fused_ordering(433) 00:13:36.566 fused_ordering(434) 00:13:36.566 fused_ordering(435) 00:13:36.566 fused_ordering(436) 00:13:36.566 fused_ordering(437) 00:13:36.566 fused_ordering(438) 00:13:36.566 fused_ordering(439) 00:13:36.566 fused_ordering(440) 00:13:36.566 fused_ordering(441) 00:13:36.566 fused_ordering(442) 00:13:36.566 fused_ordering(443) 00:13:36.566 fused_ordering(444) 00:13:36.566 fused_ordering(445) 00:13:36.566 fused_ordering(446) 00:13:36.566 fused_ordering(447) 00:13:36.566 fused_ordering(448) 00:13:36.566 fused_ordering(449) 00:13:36.566 fused_ordering(450) 00:13:36.566 fused_ordering(451) 00:13:36.566 fused_ordering(452) 00:13:36.566 fused_ordering(453) 00:13:36.566 fused_ordering(454) 00:13:36.566 fused_ordering(455) 00:13:36.566 fused_ordering(456) 00:13:36.566 fused_ordering(457) 00:13:36.566 fused_ordering(458) 00:13:36.566 fused_ordering(459) 00:13:36.566 fused_ordering(460) 00:13:36.566 fused_ordering(461) 00:13:36.566 fused_ordering(462) 00:13:36.566 fused_ordering(463) 00:13:36.566 fused_ordering(464) 00:13:36.566 fused_ordering(465) 00:13:36.566 fused_ordering(466) 00:13:36.566 fused_ordering(467) 00:13:36.566 fused_ordering(468) 00:13:36.566 fused_ordering(469) 00:13:36.566 fused_ordering(470) 00:13:36.566 fused_ordering(471) 00:13:36.566 fused_ordering(472) 00:13:36.566 fused_ordering(473) 00:13:36.566 fused_ordering(474) 00:13:36.566 fused_ordering(475) 00:13:36.566 fused_ordering(476) 00:13:36.566 fused_ordering(477) 00:13:36.566 fused_ordering(478) 00:13:36.566 fused_ordering(479) 00:13:36.566 fused_ordering(480) 00:13:36.566 fused_ordering(481) 00:13:36.566 fused_ordering(482) 00:13:36.566 fused_ordering(483) 00:13:36.566 fused_ordering(484) 00:13:36.566 fused_ordering(485) 00:13:36.566 fused_ordering(486) 00:13:36.566 fused_ordering(487) 00:13:36.566 fused_ordering(488) 00:13:36.566 fused_ordering(489) 00:13:36.566 fused_ordering(490) 00:13:36.566 fused_ordering(491) 00:13:36.566 fused_ordering(492) 00:13:36.566 fused_ordering(493) 00:13:36.566 fused_ordering(494) 00:13:36.566 fused_ordering(495) 00:13:36.566 fused_ordering(496) 00:13:36.566 fused_ordering(497) 00:13:36.566 fused_ordering(498) 00:13:36.566 fused_ordering(499) 00:13:36.566 fused_ordering(500) 00:13:36.566 fused_ordering(501) 00:13:36.566 fused_ordering(502) 00:13:36.566 fused_ordering(503) 00:13:36.566 fused_ordering(504) 00:13:36.566 fused_ordering(505) 00:13:36.566 fused_ordering(506) 00:13:36.566 fused_ordering(507) 00:13:36.566 fused_ordering(508) 00:13:36.566 fused_ordering(509) 00:13:36.566 fused_ordering(510) 00:13:36.566 fused_ordering(511) 00:13:36.566 fused_ordering(512) 00:13:36.566 fused_ordering(513) 00:13:36.566 fused_ordering(514) 00:13:36.566 fused_ordering(515) 00:13:36.566 fused_ordering(516) 00:13:36.566 fused_ordering(517) 00:13:36.566 fused_ordering(518) 00:13:36.566 fused_ordering(519) 00:13:36.566 fused_ordering(520) 00:13:36.566 fused_ordering(521) 00:13:36.566 fused_ordering(522) 00:13:36.566 fused_ordering(523) 00:13:36.566 fused_ordering(524) 00:13:36.566 fused_ordering(525) 00:13:36.566 fused_ordering(526) 00:13:36.566 fused_ordering(527) 00:13:36.566 fused_ordering(528) 00:13:36.566 fused_ordering(529) 00:13:36.566 fused_ordering(530) 00:13:36.566 fused_ordering(531) 00:13:36.566 fused_ordering(532) 00:13:36.566 fused_ordering(533) 00:13:36.566 fused_ordering(534) 00:13:36.566 fused_ordering(535) 00:13:36.566 fused_ordering(536) 00:13:36.566 fused_ordering(537) 00:13:36.566 fused_ordering(538) 00:13:36.566 fused_ordering(539) 00:13:36.566 fused_ordering(540) 00:13:36.566 fused_ordering(541) 00:13:36.566 fused_ordering(542) 00:13:36.566 fused_ordering(543) 00:13:36.566 fused_ordering(544) 00:13:36.566 fused_ordering(545) 00:13:36.566 fused_ordering(546) 00:13:36.566 fused_ordering(547) 00:13:36.566 fused_ordering(548) 00:13:36.566 fused_ordering(549) 00:13:36.566 fused_ordering(550) 00:13:36.566 fused_ordering(551) 00:13:36.566 fused_ordering(552) 00:13:36.566 fused_ordering(553) 00:13:36.566 fused_ordering(554) 00:13:36.566 fused_ordering(555) 00:13:36.566 fused_ordering(556) 00:13:36.566 fused_ordering(557) 00:13:36.566 fused_ordering(558) 00:13:36.566 fused_ordering(559) 00:13:36.566 fused_ordering(560) 00:13:36.566 fused_ordering(561) 00:13:36.566 fused_ordering(562) 00:13:36.566 fused_ordering(563) 00:13:36.566 fused_ordering(564) 00:13:36.566 fused_ordering(565) 00:13:36.566 fused_ordering(566) 00:13:36.566 fused_ordering(567) 00:13:36.566 fused_ordering(568) 00:13:36.566 fused_ordering(569) 00:13:36.566 fused_ordering(570) 00:13:36.566 fused_ordering(571) 00:13:36.566 fused_ordering(572) 00:13:36.566 fused_ordering(573) 00:13:36.566 fused_ordering(574) 00:13:36.566 fused_ordering(575) 00:13:36.566 fused_ordering(576) 00:13:36.566 fused_ordering(577) 00:13:36.566 fused_ordering(578) 00:13:36.566 fused_ordering(579) 00:13:36.566 fused_ordering(580) 00:13:36.566 fused_ordering(581) 00:13:36.566 fused_ordering(582) 00:13:36.566 fused_ordering(583) 00:13:36.566 fused_ordering(584) 00:13:36.566 fused_ordering(585) 00:13:36.566 fused_ordering(586) 00:13:36.566 fused_ordering(587) 00:13:36.566 fused_ordering(588) 00:13:36.566 fused_ordering(589) 00:13:36.566 fused_ordering(590) 00:13:36.566 fused_ordering(591) 00:13:36.566 fused_ordering(592) 00:13:36.566 fused_ordering(593) 00:13:36.566 fused_ordering(594) 00:13:36.566 fused_ordering(595) 00:13:36.566 fused_ordering(596) 00:13:36.566 fused_ordering(597) 00:13:36.566 fused_ordering(598) 00:13:36.566 fused_ordering(599) 00:13:36.566 fused_ordering(600) 00:13:36.566 fused_ordering(601) 00:13:36.566 fused_ordering(602) 00:13:36.566 fused_ordering(603) 00:13:36.566 fused_ordering(604) 00:13:36.566 fused_ordering(605) 00:13:36.566 fused_ordering(606) 00:13:36.566 fused_ordering(607) 00:13:36.566 fused_ordering(608) 00:13:36.566 fused_ordering(609) 00:13:36.566 fused_ordering(610) 00:13:36.566 fused_ordering(611) 00:13:36.566 fused_ordering(612) 00:13:36.566 fused_ordering(613) 00:13:36.566 fused_ordering(614) 00:13:36.566 fused_ordering(615) 00:13:37.133 fused_ordering(616) 00:13:37.133 fused_ordering(617) 00:13:37.133 fused_ordering(618) 00:13:37.133 fused_ordering(619) 00:13:37.133 fused_ordering(620) 00:13:37.133 fused_ordering(621) 00:13:37.133 fused_ordering(622) 00:13:37.133 fused_ordering(623) 00:13:37.133 fused_ordering(624) 00:13:37.133 fused_ordering(625) 00:13:37.133 fused_ordering(626) 00:13:37.133 fused_ordering(627) 00:13:37.133 fused_ordering(628) 00:13:37.133 fused_ordering(629) 00:13:37.133 fused_ordering(630) 00:13:37.133 fused_ordering(631) 00:13:37.133 fused_ordering(632) 00:13:37.133 fused_ordering(633) 00:13:37.133 fused_ordering(634) 00:13:37.133 fused_ordering(635) 00:13:37.133 fused_ordering(636) 00:13:37.133 fused_ordering(637) 00:13:37.133 fused_ordering(638) 00:13:37.133 fused_ordering(639) 00:13:37.133 fused_ordering(640) 00:13:37.133 fused_ordering(641) 00:13:37.133 fused_ordering(642) 00:13:37.133 fused_ordering(643) 00:13:37.133 fused_ordering(644) 00:13:37.133 fused_ordering(645) 00:13:37.133 fused_ordering(646) 00:13:37.133 fused_ordering(647) 00:13:37.133 fused_ordering(648) 00:13:37.133 fused_ordering(649) 00:13:37.133 fused_ordering(650) 00:13:37.133 fused_ordering(651) 00:13:37.133 fused_ordering(652) 00:13:37.133 fused_ordering(653) 00:13:37.133 fused_ordering(654) 00:13:37.133 fused_ordering(655) 00:13:37.133 fused_ordering(656) 00:13:37.133 fused_ordering(657) 00:13:37.133 fused_ordering(658) 00:13:37.133 fused_ordering(659) 00:13:37.133 fused_ordering(660) 00:13:37.133 fused_ordering(661) 00:13:37.133 fused_ordering(662) 00:13:37.133 fused_ordering(663) 00:13:37.133 fused_ordering(664) 00:13:37.133 fused_ordering(665) 00:13:37.133 fused_ordering(666) 00:13:37.133 fused_ordering(667) 00:13:37.133 fused_ordering(668) 00:13:37.133 fused_ordering(669) 00:13:37.133 fused_ordering(670) 00:13:37.133 fused_ordering(671) 00:13:37.133 fused_ordering(672) 00:13:37.133 fused_ordering(673) 00:13:37.133 fused_ordering(674) 00:13:37.133 fused_ordering(675) 00:13:37.133 fused_ordering(676) 00:13:37.133 fused_ordering(677) 00:13:37.133 fused_ordering(678) 00:13:37.133 fused_ordering(679) 00:13:37.133 fused_ordering(680) 00:13:37.133 fused_ordering(681) 00:13:37.133 fused_ordering(682) 00:13:37.133 fused_ordering(683) 00:13:37.133 fused_ordering(684) 00:13:37.133 fused_ordering(685) 00:13:37.133 fused_ordering(686) 00:13:37.133 fused_ordering(687) 00:13:37.133 fused_ordering(688) 00:13:37.133 fused_ordering(689) 00:13:37.133 fused_ordering(690) 00:13:37.133 fused_ordering(691) 00:13:37.133 fused_ordering(692) 00:13:37.133 fused_ordering(693) 00:13:37.133 fused_ordering(694) 00:13:37.133 fused_ordering(695) 00:13:37.133 fused_ordering(696) 00:13:37.133 fused_ordering(697) 00:13:37.133 fused_ordering(698) 00:13:37.133 fused_ordering(699) 00:13:37.133 fused_ordering(700) 00:13:37.133 fused_ordering(701) 00:13:37.133 fused_ordering(702) 00:13:37.133 fused_ordering(703) 00:13:37.133 fused_ordering(704) 00:13:37.133 fused_ordering(705) 00:13:37.133 fused_ordering(706) 00:13:37.133 fused_ordering(707) 00:13:37.133 fused_ordering(708) 00:13:37.133 fused_ordering(709) 00:13:37.133 fused_ordering(710) 00:13:37.133 fused_ordering(711) 00:13:37.133 fused_ordering(712) 00:13:37.133 fused_ordering(713) 00:13:37.133 fused_ordering(714) 00:13:37.133 fused_ordering(715) 00:13:37.133 fused_ordering(716) 00:13:37.133 fused_ordering(717) 00:13:37.133 fused_ordering(718) 00:13:37.133 fused_ordering(719) 00:13:37.133 fused_ordering(720) 00:13:37.133 fused_ordering(721) 00:13:37.133 fused_ordering(722) 00:13:37.133 fused_ordering(723) 00:13:37.133 fused_ordering(724) 00:13:37.133 fused_ordering(725) 00:13:37.133 fused_ordering(726) 00:13:37.133 fused_ordering(727) 00:13:37.133 fused_ordering(728) 00:13:37.133 fused_ordering(729) 00:13:37.133 fused_ordering(730) 00:13:37.133 fused_ordering(731) 00:13:37.133 fused_ordering(732) 00:13:37.133 fused_ordering(733) 00:13:37.133 fused_ordering(734) 00:13:37.133 fused_ordering(735) 00:13:37.133 fused_ordering(736) 00:13:37.133 fused_ordering(737) 00:13:37.133 fused_ordering(738) 00:13:37.133 fused_ordering(739) 00:13:37.133 fused_ordering(740) 00:13:37.133 fused_ordering(741) 00:13:37.133 fused_ordering(742) 00:13:37.133 fused_ordering(743) 00:13:37.133 fused_ordering(744) 00:13:37.133 fused_ordering(745) 00:13:37.133 fused_ordering(746) 00:13:37.133 fused_ordering(747) 00:13:37.133 fused_ordering(748) 00:13:37.133 fused_ordering(749) 00:13:37.133 fused_ordering(750) 00:13:37.133 fused_ordering(751) 00:13:37.133 fused_ordering(752) 00:13:37.133 fused_ordering(753) 00:13:37.133 fused_ordering(754) 00:13:37.133 fused_ordering(755) 00:13:37.133 fused_ordering(756) 00:13:37.133 fused_ordering(757) 00:13:37.133 fused_ordering(758) 00:13:37.133 fused_ordering(759) 00:13:37.133 fused_ordering(760) 00:13:37.133 fused_ordering(761) 00:13:37.134 fused_ordering(762) 00:13:37.134 fused_ordering(763) 00:13:37.134 fused_ordering(764) 00:13:37.134 fused_ordering(765) 00:13:37.134 fused_ordering(766) 00:13:37.134 fused_ordering(767) 00:13:37.134 fused_ordering(768) 00:13:37.134 fused_ordering(769) 00:13:37.134 fused_ordering(770) 00:13:37.134 fused_ordering(771) 00:13:37.134 fused_ordering(772) 00:13:37.134 fused_ordering(773) 00:13:37.134 fused_ordering(774) 00:13:37.134 fused_ordering(775) 00:13:37.134 fused_ordering(776) 00:13:37.134 fused_ordering(777) 00:13:37.134 fused_ordering(778) 00:13:37.134 fused_ordering(779) 00:13:37.134 fused_ordering(780) 00:13:37.134 fused_ordering(781) 00:13:37.134 fused_ordering(782) 00:13:37.134 fused_ordering(783) 00:13:37.134 fused_ordering(784) 00:13:37.134 fused_ordering(785) 00:13:37.134 fused_ordering(786) 00:13:37.134 fused_ordering(787) 00:13:37.134 fused_ordering(788) 00:13:37.134 fused_ordering(789) 00:13:37.134 fused_ordering(790) 00:13:37.134 fused_ordering(791) 00:13:37.134 fused_ordering(792) 00:13:37.134 fused_ordering(793) 00:13:37.134 fused_ordering(794) 00:13:37.134 fused_ordering(795) 00:13:37.134 fused_ordering(796) 00:13:37.134 fused_ordering(797) 00:13:37.134 fused_ordering(798) 00:13:37.134 fused_ordering(799) 00:13:37.134 fused_ordering(800) 00:13:37.134 fused_ordering(801) 00:13:37.134 fused_ordering(802) 00:13:37.134 fused_ordering(803) 00:13:37.134 fused_ordering(804) 00:13:37.134 fused_ordering(805) 00:13:37.134 fused_ordering(806) 00:13:37.134 fused_ordering(807) 00:13:37.134 fused_ordering(808) 00:13:37.134 fused_ordering(809) 00:13:37.134 fused_ordering(810) 00:13:37.134 fused_ordering(811) 00:13:37.134 fused_ordering(812) 00:13:37.134 fused_ordering(813) 00:13:37.134 fused_ordering(814) 00:13:37.134 fused_ordering(815) 00:13:37.134 fused_ordering(816) 00:13:37.134 fused_ordering(817) 00:13:37.134 fused_ordering(818) 00:13:37.134 fused_ordering(819) 00:13:37.134 fused_ordering(820) 00:13:38.068 fused_ordering(821) 00:13:38.068 fused_ordering(822) 00:13:38.068 fused_ordering(823) 00:13:38.068 fused_ordering(824) 00:13:38.068 fused_ordering(825) 00:13:38.068 fused_ordering(826) 00:13:38.068 fused_ordering(827) 00:13:38.068 fused_ordering(828) 00:13:38.068 fused_ordering(829) 00:13:38.068 fused_ordering(830) 00:13:38.068 fused_ordering(831) 00:13:38.068 fused_ordering(832) 00:13:38.068 fused_ordering(833) 00:13:38.068 fused_ordering(834) 00:13:38.068 fused_ordering(835) 00:13:38.068 fused_ordering(836) 00:13:38.068 fused_ordering(837) 00:13:38.068 fused_ordering(838) 00:13:38.068 fused_ordering(839) 00:13:38.068 fused_ordering(840) 00:13:38.068 fused_ordering(841) 00:13:38.068 fused_ordering(842) 00:13:38.068 fused_ordering(843) 00:13:38.068 fused_ordering(844) 00:13:38.068 fused_ordering(845) 00:13:38.068 fused_ordering(846) 00:13:38.068 fused_ordering(847) 00:13:38.068 fused_ordering(848) 00:13:38.068 fused_ordering(849) 00:13:38.068 fused_ordering(850) 00:13:38.068 fused_ordering(851) 00:13:38.068 fused_ordering(852) 00:13:38.068 fused_ordering(853) 00:13:38.068 fused_ordering(854) 00:13:38.068 fused_ordering(855) 00:13:38.068 fused_ordering(856) 00:13:38.068 fused_ordering(857) 00:13:38.068 fused_ordering(858) 00:13:38.068 fused_ordering(859) 00:13:38.068 fused_ordering(860) 00:13:38.068 fused_ordering(861) 00:13:38.068 fused_ordering(862) 00:13:38.068 fused_ordering(863) 00:13:38.068 fused_ordering(864) 00:13:38.068 fused_ordering(865) 00:13:38.068 fused_ordering(866) 00:13:38.068 fused_ordering(867) 00:13:38.068 fused_ordering(868) 00:13:38.068 fused_ordering(869) 00:13:38.068 fused_ordering(870) 00:13:38.068 fused_ordering(871) 00:13:38.068 fused_ordering(872) 00:13:38.068 fused_ordering(873) 00:13:38.068 fused_ordering(874) 00:13:38.068 fused_ordering(875) 00:13:38.068 fused_ordering(876) 00:13:38.068 fused_ordering(877) 00:13:38.068 fused_ordering(878) 00:13:38.068 fused_ordering(879) 00:13:38.068 fused_ordering(880) 00:13:38.068 fused_ordering(881) 00:13:38.068 fused_ordering(882) 00:13:38.068 fused_ordering(883) 00:13:38.068 fused_ordering(884) 00:13:38.068 fused_ordering(885) 00:13:38.068 fused_ordering(886) 00:13:38.068 fused_ordering(887) 00:13:38.068 fused_ordering(888) 00:13:38.068 fused_ordering(889) 00:13:38.068 fused_ordering(890) 00:13:38.068 fused_ordering(891) 00:13:38.068 fused_ordering(892) 00:13:38.068 fused_ordering(893) 00:13:38.068 fused_ordering(894) 00:13:38.068 fused_ordering(895) 00:13:38.068 fused_ordering(896) 00:13:38.068 fused_ordering(897) 00:13:38.068 fused_ordering(898) 00:13:38.068 fused_ordering(899) 00:13:38.068 fused_ordering(900) 00:13:38.068 fused_ordering(901) 00:13:38.068 fused_ordering(902) 00:13:38.068 fused_ordering(903) 00:13:38.068 fused_ordering(904) 00:13:38.068 fused_ordering(905) 00:13:38.068 fused_ordering(906) 00:13:38.068 fused_ordering(907) 00:13:38.068 fused_ordering(908) 00:13:38.068 fused_ordering(909) 00:13:38.068 fused_ordering(910) 00:13:38.068 fused_ordering(911) 00:13:38.068 fused_ordering(912) 00:13:38.068 fused_ordering(913) 00:13:38.068 fused_ordering(914) 00:13:38.068 fused_ordering(915) 00:13:38.068 fused_ordering(916) 00:13:38.068 fused_ordering(917) 00:13:38.068 fused_ordering(918) 00:13:38.068 fused_ordering(919) 00:13:38.068 fused_ordering(920) 00:13:38.068 fused_ordering(921) 00:13:38.068 fused_ordering(922) 00:13:38.068 fused_ordering(923) 00:13:38.068 fused_ordering(924) 00:13:38.068 fused_ordering(925) 00:13:38.068 fused_ordering(926) 00:13:38.068 fused_ordering(927) 00:13:38.068 fused_ordering(928) 00:13:38.068 fused_ordering(929) 00:13:38.068 fused_ordering(930) 00:13:38.068 fused_ordering(931) 00:13:38.068 fused_ordering(932) 00:13:38.068 fused_ordering(933) 00:13:38.068 fused_ordering(934) 00:13:38.068 fused_ordering(935) 00:13:38.068 fused_ordering(936) 00:13:38.068 fused_ordering(937) 00:13:38.068 fused_ordering(938) 00:13:38.068 fused_ordering(939) 00:13:38.068 fused_ordering(940) 00:13:38.068 fused_ordering(941) 00:13:38.068 fused_ordering(942) 00:13:38.068 fused_ordering(943) 00:13:38.068 fused_ordering(944) 00:13:38.068 fused_ordering(945) 00:13:38.068 fused_ordering(946) 00:13:38.068 fused_ordering(947) 00:13:38.068 fused_ordering(948) 00:13:38.068 fused_ordering(949) 00:13:38.068 fused_ordering(950) 00:13:38.068 fused_ordering(951) 00:13:38.068 fused_ordering(952) 00:13:38.068 fused_ordering(953) 00:13:38.068 fused_ordering(954) 00:13:38.068 fused_ordering(955) 00:13:38.068 fused_ordering(956) 00:13:38.068 fused_ordering(957) 00:13:38.068 fused_ordering(958) 00:13:38.068 fused_ordering(959) 00:13:38.068 fused_ordering(960) 00:13:38.068 fused_ordering(961) 00:13:38.068 fused_ordering(962) 00:13:38.068 fused_ordering(963) 00:13:38.068 fused_ordering(964) 00:13:38.068 fused_ordering(965) 00:13:38.068 fused_ordering(966) 00:13:38.068 fused_ordering(967) 00:13:38.068 fused_ordering(968) 00:13:38.068 fused_ordering(969) 00:13:38.068 fused_ordering(970) 00:13:38.068 fused_ordering(971) 00:13:38.068 fused_ordering(972) 00:13:38.068 fused_ordering(973) 00:13:38.068 fused_ordering(974) 00:13:38.068 fused_ordering(975) 00:13:38.068 fused_ordering(976) 00:13:38.068 fused_ordering(977) 00:13:38.068 fused_ordering(978) 00:13:38.068 fused_ordering(979) 00:13:38.068 fused_ordering(980) 00:13:38.068 fused_ordering(981) 00:13:38.068 fused_ordering(982) 00:13:38.068 fused_ordering(983) 00:13:38.068 fused_ordering(984) 00:13:38.068 fused_ordering(985) 00:13:38.068 fused_ordering(986) 00:13:38.068 fused_ordering(987) 00:13:38.068 fused_ordering(988) 00:13:38.068 fused_ordering(989) 00:13:38.068 fused_ordering(990) 00:13:38.068 fused_ordering(991) 00:13:38.068 fused_ordering(992) 00:13:38.068 fused_ordering(993) 00:13:38.068 fused_ordering(994) 00:13:38.068 fused_ordering(995) 00:13:38.068 fused_ordering(996) 00:13:38.068 fused_ordering(997) 00:13:38.068 fused_ordering(998) 00:13:38.068 fused_ordering(999) 00:13:38.068 fused_ordering(1000) 00:13:38.068 fused_ordering(1001) 00:13:38.069 fused_ordering(1002) 00:13:38.069 fused_ordering(1003) 00:13:38.069 fused_ordering(1004) 00:13:38.069 fused_ordering(1005) 00:13:38.069 fused_ordering(1006) 00:13:38.069 fused_ordering(1007) 00:13:38.069 fused_ordering(1008) 00:13:38.069 fused_ordering(1009) 00:13:38.069 fused_ordering(1010) 00:13:38.069 fused_ordering(1011) 00:13:38.069 fused_ordering(1012) 00:13:38.069 fused_ordering(1013) 00:13:38.069 fused_ordering(1014) 00:13:38.069 fused_ordering(1015) 00:13:38.069 fused_ordering(1016) 00:13:38.069 fused_ordering(1017) 00:13:38.069 fused_ordering(1018) 00:13:38.069 fused_ordering(1019) 00:13:38.069 fused_ordering(1020) 00:13:38.069 fused_ordering(1021) 00:13:38.069 fused_ordering(1022) 00:13:38.069 fused_ordering(1023) 00:13:38.069 03:30:18 -- target/fused_ordering.sh@23 -- # trap - SIGINT SIGTERM EXIT 00:13:38.069 03:30:18 -- target/fused_ordering.sh@25 -- # nvmftestfini 00:13:38.069 03:30:18 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:38.069 03:30:18 -- nvmf/common.sh@116 -- # sync 00:13:38.069 03:30:18 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:38.069 03:30:18 -- nvmf/common.sh@119 -- # set +e 00:13:38.069 03:30:18 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:38.069 03:30:18 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:38.069 rmmod nvme_tcp 00:13:38.069 rmmod nvme_fabrics 00:13:38.069 rmmod nvme_keyring 00:13:38.069 03:30:18 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:38.069 03:30:18 -- nvmf/common.sh@123 -- # set -e 00:13:38.069 03:30:18 -- nvmf/common.sh@124 -- # return 0 00:13:38.069 03:30:18 -- nvmf/common.sh@477 -- # '[' -n 3019885 ']' 00:13:38.069 03:30:18 -- nvmf/common.sh@478 -- # killprocess 3019885 00:13:38.069 03:30:18 -- common/autotest_common.sh@936 -- # '[' -z 3019885 ']' 00:13:38.069 03:30:18 -- common/autotest_common.sh@940 -- # kill -0 3019885 00:13:38.069 03:30:18 -- common/autotest_common.sh@941 -- # uname 00:13:38.069 03:30:18 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:38.069 03:30:18 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3019885 00:13:38.069 03:30:18 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:13:38.069 03:30:18 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:13:38.069 03:30:18 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3019885' 00:13:38.069 killing process with pid 3019885 00:13:38.069 03:30:18 -- common/autotest_common.sh@955 -- # kill 3019885 00:13:38.069 03:30:18 -- common/autotest_common.sh@960 -- # wait 3019885 00:13:38.328 03:30:18 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:38.328 03:30:18 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:38.328 03:30:18 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:38.328 03:30:18 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:38.328 03:30:18 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:38.328 03:30:18 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:38.328 03:30:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:38.328 03:30:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:40.232 03:30:20 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:40.232 00:13:40.232 real 0m8.496s 00:13:40.232 user 0m6.384s 00:13:40.232 sys 0m3.412s 00:13:40.232 03:30:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:40.232 03:30:20 -- common/autotest_common.sh@10 -- # set +x 00:13:40.232 ************************************ 00:13:40.232 END TEST nvmf_fused_ordering 00:13:40.232 ************************************ 00:13:40.232 03:30:20 -- nvmf/nvmf.sh@35 -- # run_test nvmf_delete_subsystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:13:40.232 03:30:20 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:40.232 03:30:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:40.232 03:30:20 -- common/autotest_common.sh@10 -- # set +x 00:13:40.232 ************************************ 00:13:40.232 START TEST nvmf_delete_subsystem 00:13:40.232 ************************************ 00:13:40.232 03:30:20 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:13:40.232 * Looking for test storage... 00:13:40.232 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:40.232 03:30:20 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:40.232 03:30:20 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:40.232 03:30:20 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:40.491 03:30:20 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:40.491 03:30:20 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:40.491 03:30:20 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:40.491 03:30:20 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:40.491 03:30:20 -- scripts/common.sh@335 -- # IFS=.-: 00:13:40.491 03:30:20 -- scripts/common.sh@335 -- # read -ra ver1 00:13:40.491 03:30:20 -- scripts/common.sh@336 -- # IFS=.-: 00:13:40.491 03:30:20 -- scripts/common.sh@336 -- # read -ra ver2 00:13:40.491 03:30:20 -- scripts/common.sh@337 -- # local 'op=<' 00:13:40.491 03:30:20 -- scripts/common.sh@339 -- # ver1_l=2 00:13:40.491 03:30:20 -- scripts/common.sh@340 -- # ver2_l=1 00:13:40.491 03:30:20 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:40.491 03:30:20 -- scripts/common.sh@343 -- # case "$op" in 00:13:40.491 03:30:20 -- scripts/common.sh@344 -- # : 1 00:13:40.491 03:30:20 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:40.491 03:30:20 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:40.491 03:30:20 -- scripts/common.sh@364 -- # decimal 1 00:13:40.491 03:30:20 -- scripts/common.sh@352 -- # local d=1 00:13:40.491 03:30:20 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:40.491 03:30:20 -- scripts/common.sh@354 -- # echo 1 00:13:40.491 03:30:20 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:40.491 03:30:20 -- scripts/common.sh@365 -- # decimal 2 00:13:40.491 03:30:20 -- scripts/common.sh@352 -- # local d=2 00:13:40.491 03:30:20 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:40.491 03:30:20 -- scripts/common.sh@354 -- # echo 2 00:13:40.491 03:30:20 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:40.491 03:30:20 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:40.491 03:30:20 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:40.491 03:30:20 -- scripts/common.sh@367 -- # return 0 00:13:40.491 03:30:20 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:40.491 03:30:20 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:40.491 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:40.491 --rc genhtml_branch_coverage=1 00:13:40.491 --rc genhtml_function_coverage=1 00:13:40.491 --rc genhtml_legend=1 00:13:40.491 --rc geninfo_all_blocks=1 00:13:40.491 --rc geninfo_unexecuted_blocks=1 00:13:40.491 00:13:40.491 ' 00:13:40.491 03:30:20 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:40.491 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:40.491 --rc genhtml_branch_coverage=1 00:13:40.491 --rc genhtml_function_coverage=1 00:13:40.491 --rc genhtml_legend=1 00:13:40.491 --rc geninfo_all_blocks=1 00:13:40.491 --rc geninfo_unexecuted_blocks=1 00:13:40.491 00:13:40.491 ' 00:13:40.491 03:30:20 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:40.491 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:40.491 --rc genhtml_branch_coverage=1 00:13:40.491 --rc genhtml_function_coverage=1 00:13:40.491 --rc genhtml_legend=1 00:13:40.491 --rc geninfo_all_blocks=1 00:13:40.491 --rc geninfo_unexecuted_blocks=1 00:13:40.491 00:13:40.491 ' 00:13:40.491 03:30:20 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:40.491 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:40.491 --rc genhtml_branch_coverage=1 00:13:40.491 --rc genhtml_function_coverage=1 00:13:40.491 --rc genhtml_legend=1 00:13:40.491 --rc geninfo_all_blocks=1 00:13:40.491 --rc geninfo_unexecuted_blocks=1 00:13:40.491 00:13:40.491 ' 00:13:40.491 03:30:20 -- target/delete_subsystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:40.491 03:30:20 -- nvmf/common.sh@7 -- # uname -s 00:13:40.491 03:30:20 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:40.491 03:30:20 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:40.491 03:30:20 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:40.491 03:30:20 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:40.491 03:30:20 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:40.491 03:30:20 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:40.491 03:30:20 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:40.491 03:30:20 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:40.491 03:30:20 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:40.491 03:30:20 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:40.491 03:30:20 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:40.491 03:30:20 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:40.491 03:30:20 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:40.491 03:30:20 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:40.491 03:30:20 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:40.491 03:30:20 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:40.491 03:30:20 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:40.491 03:30:20 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:40.491 03:30:20 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:40.491 03:30:20 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:40.491 03:30:20 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:40.491 03:30:20 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:40.491 03:30:20 -- paths/export.sh@5 -- # export PATH 00:13:40.492 03:30:20 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:40.492 03:30:20 -- nvmf/common.sh@46 -- # : 0 00:13:40.492 03:30:20 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:40.492 03:30:20 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:40.492 03:30:20 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:40.492 03:30:20 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:40.492 03:30:20 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:40.492 03:30:20 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:40.492 03:30:20 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:40.492 03:30:20 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:40.492 03:30:20 -- target/delete_subsystem.sh@12 -- # nvmftestinit 00:13:40.492 03:30:20 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:40.492 03:30:20 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:40.492 03:30:20 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:40.492 03:30:20 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:40.492 03:30:20 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:40.492 03:30:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:40.492 03:30:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:40.492 03:30:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:40.492 03:30:20 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:40.492 03:30:20 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:40.492 03:30:20 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:40.492 03:30:20 -- common/autotest_common.sh@10 -- # set +x 00:13:42.394 03:30:22 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:42.394 03:30:22 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:42.394 03:30:22 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:42.394 03:30:22 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:42.394 03:30:22 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:42.394 03:30:22 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:42.394 03:30:22 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:42.394 03:30:22 -- nvmf/common.sh@294 -- # net_devs=() 00:13:42.394 03:30:22 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:42.394 03:30:22 -- nvmf/common.sh@295 -- # e810=() 00:13:42.394 03:30:22 -- nvmf/common.sh@295 -- # local -ga e810 00:13:42.394 03:30:22 -- nvmf/common.sh@296 -- # x722=() 00:13:42.394 03:30:22 -- nvmf/common.sh@296 -- # local -ga x722 00:13:42.394 03:30:22 -- nvmf/common.sh@297 -- # mlx=() 00:13:42.394 03:30:22 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:42.394 03:30:22 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:42.394 03:30:22 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:42.394 03:30:22 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:42.394 03:30:22 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:42.394 03:30:22 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:42.394 03:30:22 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:42.394 03:30:22 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:42.394 03:30:22 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:42.394 03:30:22 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:42.394 03:30:22 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:42.394 03:30:22 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:42.394 03:30:22 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:42.394 03:30:22 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:42.394 03:30:22 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:42.394 03:30:22 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:42.394 03:30:22 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:42.394 03:30:22 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:42.394 03:30:22 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:42.394 03:30:22 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:42.394 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:42.394 03:30:22 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:42.394 03:30:22 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:42.394 03:30:22 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:42.394 03:30:22 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:42.394 03:30:22 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:42.394 03:30:22 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:42.394 03:30:22 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:42.394 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:42.394 03:30:22 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:42.394 03:30:22 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:42.394 03:30:22 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:42.394 03:30:22 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:42.394 03:30:22 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:42.394 03:30:22 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:42.394 03:30:22 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:42.394 03:30:22 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:42.394 03:30:22 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:42.394 03:30:22 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:42.394 03:30:22 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:42.394 03:30:22 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:42.394 03:30:22 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:42.394 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:42.394 03:30:22 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:42.394 03:30:22 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:42.394 03:30:22 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:42.394 03:30:22 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:42.394 03:30:22 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:42.394 03:30:22 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:42.394 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:42.394 03:30:22 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:42.394 03:30:22 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:42.394 03:30:22 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:42.394 03:30:22 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:42.394 03:30:22 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:42.394 03:30:22 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:42.394 03:30:22 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:42.394 03:30:22 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:42.394 03:30:22 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:42.394 03:30:22 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:42.394 03:30:22 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:42.394 03:30:22 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:42.395 03:30:22 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:42.395 03:30:22 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:42.395 03:30:22 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:42.395 03:30:22 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:42.395 03:30:22 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:42.395 03:30:22 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:42.395 03:30:22 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:42.395 03:30:22 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:42.395 03:30:22 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:42.395 03:30:23 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:42.395 03:30:23 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:42.654 03:30:23 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:42.654 03:30:23 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:42.654 03:30:23 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:42.654 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:42.654 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.214 ms 00:13:42.654 00:13:42.654 --- 10.0.0.2 ping statistics --- 00:13:42.654 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:42.654 rtt min/avg/max/mdev = 0.214/0.214/0.214/0.000 ms 00:13:42.654 03:30:23 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:42.654 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:42.654 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.172 ms 00:13:42.654 00:13:42.654 --- 10.0.0.1 ping statistics --- 00:13:42.654 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:42.654 rtt min/avg/max/mdev = 0.172/0.172/0.172/0.000 ms 00:13:42.654 03:30:23 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:42.654 03:30:23 -- nvmf/common.sh@410 -- # return 0 00:13:42.654 03:30:23 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:42.654 03:30:23 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:42.654 03:30:23 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:42.654 03:30:23 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:42.654 03:30:23 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:42.654 03:30:23 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:42.654 03:30:23 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:42.654 03:30:23 -- target/delete_subsystem.sh@13 -- # nvmfappstart -m 0x3 00:13:42.654 03:30:23 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:42.654 03:30:23 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:42.654 03:30:23 -- common/autotest_common.sh@10 -- # set +x 00:13:42.654 03:30:23 -- nvmf/common.sh@469 -- # nvmfpid=3022279 00:13:42.654 03:30:23 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x3 00:13:42.654 03:30:23 -- nvmf/common.sh@470 -- # waitforlisten 3022279 00:13:42.654 03:30:23 -- common/autotest_common.sh@829 -- # '[' -z 3022279 ']' 00:13:42.654 03:30:23 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:42.654 03:30:23 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:42.654 03:30:23 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:42.654 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:42.654 03:30:23 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:42.654 03:30:23 -- common/autotest_common.sh@10 -- # set +x 00:13:42.654 [2024-11-21 03:30:23.129344] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:42.654 [2024-11-21 03:30:23.129442] [ DPDK EAL parameters: nvmf -c 0x3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:42.654 EAL: No free 2048 kB hugepages reported on node 1 00:13:42.654 [2024-11-21 03:30:23.197774] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:13:42.953 [2024-11-21 03:30:23.314378] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:42.953 [2024-11-21 03:30:23.314561] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:42.953 [2024-11-21 03:30:23.314580] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:42.953 [2024-11-21 03:30:23.314595] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:42.953 [2024-11-21 03:30:23.314653] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:42.953 [2024-11-21 03:30:23.314660] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:43.544 03:30:24 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:43.544 03:30:24 -- common/autotest_common.sh@862 -- # return 0 00:13:43.544 03:30:24 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:43.544 03:30:24 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:43.544 03:30:24 -- common/autotest_common.sh@10 -- # set +x 00:13:43.544 03:30:24 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:43.544 03:30:24 -- target/delete_subsystem.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:43.544 03:30:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:43.544 03:30:24 -- common/autotest_common.sh@10 -- # set +x 00:13:43.544 [2024-11-21 03:30:24.128551] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:43.544 03:30:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:43.544 03:30:24 -- target/delete_subsystem.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:43.544 03:30:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:43.544 03:30:24 -- common/autotest_common.sh@10 -- # set +x 00:13:43.544 03:30:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:43.544 03:30:24 -- target/delete_subsystem.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:43.544 03:30:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:43.544 03:30:24 -- common/autotest_common.sh@10 -- # set +x 00:13:43.544 [2024-11-21 03:30:24.144739] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:43.544 03:30:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:43.544 03:30:24 -- target/delete_subsystem.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:13:43.544 03:30:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:43.544 03:30:24 -- common/autotest_common.sh@10 -- # set +x 00:13:43.544 NULL1 00:13:43.544 03:30:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:43.544 03:30:24 -- target/delete_subsystem.sh@23 -- # rpc_cmd bdev_delay_create -b NULL1 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:13:43.544 03:30:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:43.544 03:30:24 -- common/autotest_common.sh@10 -- # set +x 00:13:43.544 Delay0 00:13:43.544 03:30:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:43.544 03:30:24 -- target/delete_subsystem.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:43.544 03:30:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:43.544 03:30:24 -- common/autotest_common.sh@10 -- # set +x 00:13:43.544 03:30:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:43.544 03:30:24 -- target/delete_subsystem.sh@28 -- # perf_pid=3022440 00:13:43.544 03:30:24 -- target/delete_subsystem.sh@30 -- # sleep 2 00:13:43.544 03:30:24 -- target/delete_subsystem.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 5 -q 128 -w randrw -M 70 -o 512 -P 4 00:13:43.802 EAL: No free 2048 kB hugepages reported on node 1 00:13:43.802 [2024-11-21 03:30:24.219418] subsystem.c:1344:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:13:45.701 03:30:26 -- target/delete_subsystem.sh@32 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:45.701 03:30:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:45.701 03:30:26 -- common/autotest_common.sh@10 -- # set +x 00:13:45.701 Read completed with error (sct=0, sc=8) 00:13:45.701 starting I/O failed: -6 00:13:45.701 Read completed with error (sct=0, sc=8) 00:13:45.701 Read completed with error (sct=0, sc=8) 00:13:45.701 Read completed with error (sct=0, sc=8) 00:13:45.701 Read completed with error (sct=0, sc=8) 00:13:45.701 starting I/O failed: -6 00:13:45.701 Read completed with error (sct=0, sc=8) 00:13:45.701 Read completed with error (sct=0, sc=8) 00:13:45.701 Read completed with error (sct=0, sc=8) 00:13:45.701 Read completed with error (sct=0, sc=8) 00:13:45.701 starting I/O failed: -6 00:13:45.701 Write completed with error (sct=0, sc=8) 00:13:45.701 Write completed with error (sct=0, sc=8) 00:13:45.701 Write completed with error (sct=0, sc=8) 00:13:45.701 Write completed with error (sct=0, sc=8) 00:13:45.701 starting I/O failed: -6 00:13:45.701 Read completed with error (sct=0, sc=8) 00:13:45.701 Read completed with error (sct=0, sc=8) 00:13:45.701 Write completed with error (sct=0, sc=8) 00:13:45.701 Write completed with error (sct=0, sc=8) 00:13:45.701 starting I/O failed: -6 00:13:45.701 Read completed with error (sct=0, sc=8) 00:13:45.701 Read completed with error (sct=0, sc=8) 00:13:45.701 Read completed with error (sct=0, sc=8) 00:13:45.701 Write completed with error (sct=0, sc=8) 00:13:45.701 starting I/O failed: -6 00:13:45.701 Read completed with error (sct=0, sc=8) 00:13:45.701 Read completed with error (sct=0, sc=8) 00:13:45.701 Write completed with error (sct=0, sc=8) 00:13:45.701 Read completed with error (sct=0, sc=8) 00:13:45.701 starting I/O failed: -6 00:13:45.701 Read completed with error (sct=0, sc=8) 00:13:45.701 Read completed with error (sct=0, sc=8) 00:13:45.701 Read completed with error (sct=0, sc=8) 00:13:45.701 Write completed with error (sct=0, sc=8) 00:13:45.701 starting I/O failed: -6 00:13:45.701 Read completed with error (sct=0, sc=8) 00:13:45.701 Write completed with error (sct=0, sc=8) 00:13:45.701 Read completed with error (sct=0, sc=8) 00:13:45.701 Read completed with error (sct=0, sc=8) 00:13:45.701 starting I/O failed: -6 00:13:45.701 Read completed with error (sct=0, sc=8) 00:13:45.701 Read completed with error (sct=0, sc=8) 00:13:45.701 [2024-11-21 03:30:26.299474] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f7178000c00 is same with the state(5) to be set 00:13:45.701 Read completed with error (sct=0, sc=8) 00:13:45.701 Write completed with error (sct=0, sc=8) 00:13:45.701 starting I/O failed: -6 00:13:45.701 Read completed with error (sct=0, sc=8) 00:13:45.701 Read completed with error (sct=0, sc=8) 00:13:45.701 Read completed with error (sct=0, sc=8) 00:13:45.701 Read completed with error (sct=0, sc=8) 00:13:45.701 starting I/O failed: -6 00:13:45.701 Read completed with error (sct=0, sc=8) 00:13:45.701 Read completed with error (sct=0, sc=8) 00:13:45.701 Read completed with error (sct=0, sc=8) 00:13:45.701 Write completed with error (sct=0, sc=8) 00:13:45.701 starting I/O failed: -6 00:13:45.701 Write completed with error (sct=0, sc=8) 00:13:45.701 Read completed with error (sct=0, sc=8) 00:13:45.701 Read completed with error (sct=0, sc=8) 00:13:45.701 Read completed with error (sct=0, sc=8) 00:13:45.701 starting I/O failed: -6 00:13:45.701 Read completed with error (sct=0, sc=8) 00:13:45.701 Read completed with error (sct=0, sc=8) 00:13:45.701 Read completed with error (sct=0, sc=8) 00:13:45.701 Read completed with error (sct=0, sc=8) 00:13:45.701 starting I/O failed: -6 00:13:45.701 Read completed with error (sct=0, sc=8) 00:13:45.701 Read completed with error (sct=0, sc=8) 00:13:45.701 Read completed with error (sct=0, sc=8) 00:13:45.701 Write completed with error (sct=0, sc=8) 00:13:45.701 starting I/O failed: -6 00:13:45.701 Write completed with error (sct=0, sc=8) 00:13:45.701 Write completed with error (sct=0, sc=8) 00:13:45.701 Read completed with error (sct=0, sc=8) 00:13:45.701 Read completed with error (sct=0, sc=8) 00:13:45.701 starting I/O failed: -6 00:13:45.701 Read completed with error (sct=0, sc=8) 00:13:45.701 Read completed with error (sct=0, sc=8) 00:13:45.701 Read completed with error (sct=0, sc=8) 00:13:45.701 Read completed with error (sct=0, sc=8) 00:13:45.701 starting I/O failed: -6 00:13:45.701 Read completed with error (sct=0, sc=8) 00:13:45.701 Read completed with error (sct=0, sc=8) 00:13:45.701 Read completed with error (sct=0, sc=8) 00:13:45.701 Read completed with error (sct=0, sc=8) 00:13:45.701 starting I/O failed: -6 00:13:45.701 Read completed with error (sct=0, sc=8) 00:13:45.701 Write completed with error (sct=0, sc=8) 00:13:45.701 Read completed with error (sct=0, sc=8) 00:13:45.701 Read completed with error (sct=0, sc=8) 00:13:45.701 starting I/O failed: -6 00:13:45.701 Read completed with error (sct=0, sc=8) 00:13:45.701 Read completed with error (sct=0, sc=8) 00:13:45.701 Write completed with error (sct=0, sc=8) 00:13:45.701 Read completed with error (sct=0, sc=8) 00:13:45.701 starting I/O failed: -6 00:13:45.701 Read completed with error (sct=0, sc=8) 00:13:45.701 Write completed with error (sct=0, sc=8) 00:13:45.701 Write completed with error (sct=0, sc=8) 00:13:45.701 Read completed with error (sct=0, sc=8) 00:13:45.701 starting I/O failed: -6 00:13:45.702 [2024-11-21 03:30:26.301635] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5a2770 is same with the state(5) to be set 00:13:45.702 Read completed with error (sct=0, sc=8) 00:13:45.702 Write completed with error (sct=0, sc=8) 00:13:45.702 Read completed with error (sct=0, sc=8) 00:13:45.702 Read completed with error (sct=0, sc=8) 00:13:45.702 Read completed with error (sct=0, sc=8) 00:13:45.702 Write completed with error (sct=0, sc=8) 00:13:45.702 Write completed with error (sct=0, sc=8) 00:13:45.702 Read completed with error (sct=0, sc=8) 00:13:45.702 Read completed with error (sct=0, sc=8) 00:13:45.702 Read completed with error (sct=0, sc=8) 00:13:45.702 Write completed with error (sct=0, sc=8) 00:13:45.702 Write completed with error (sct=0, sc=8) 00:13:45.702 Write completed with error (sct=0, sc=8) 00:13:45.702 Read completed with error (sct=0, sc=8) 00:13:45.702 Read completed with error (sct=0, sc=8) 00:13:45.702 Read completed with error (sct=0, sc=8) 00:13:45.702 Read completed with error (sct=0, sc=8) 00:13:45.702 Write completed with error (sct=0, sc=8) 00:13:45.702 Read completed with error (sct=0, sc=8) 00:13:45.702 Read completed with error (sct=0, sc=8) 00:13:45.702 Read completed with error (sct=0, sc=8) 00:13:45.702 Read completed with error (sct=0, sc=8) 00:13:45.702 Write completed with error (sct=0, sc=8) 00:13:45.702 Read completed with error (sct=0, sc=8) 00:13:45.702 Read completed with error (sct=0, sc=8) 00:13:45.702 Write completed with error (sct=0, sc=8) 00:13:45.702 Write completed with error (sct=0, sc=8) 00:13:45.702 Read completed with error (sct=0, sc=8) 00:13:45.702 Write completed with error (sct=0, sc=8) 00:13:45.702 Read completed with error (sct=0, sc=8) 00:13:45.702 Read completed with error (sct=0, sc=8) 00:13:45.702 Read completed with error (sct=0, sc=8) 00:13:45.702 Read completed with error (sct=0, sc=8) 00:13:45.702 Read completed with error (sct=0, sc=8) 00:13:45.702 Write completed with error (sct=0, sc=8) 00:13:45.702 Read completed with error (sct=0, sc=8) 00:13:45.702 Read completed with error (sct=0, sc=8) 00:13:45.702 Read completed with error (sct=0, sc=8) 00:13:45.702 Write completed with error (sct=0, sc=8) 00:13:45.702 Read completed with error (sct=0, sc=8) 00:13:45.702 Read completed with error (sct=0, sc=8) 00:13:45.702 Read completed with error (sct=0, sc=8) 00:13:45.702 Read completed with error (sct=0, sc=8) 00:13:45.702 Read completed with error (sct=0, sc=8) 00:13:45.702 [2024-11-21 03:30:26.301964] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f717800bf20 is same with the state(5) to be set 00:13:45.702 Read completed with error (sct=0, sc=8) 00:13:45.702 Read completed with error (sct=0, sc=8) 00:13:45.702 Write completed with error (sct=0, sc=8) 00:13:45.702 Read completed with error (sct=0, sc=8) 00:13:45.702 Read completed with error (sct=0, sc=8) 00:13:45.702 Write completed with error (sct=0, sc=8) 00:13:45.702 Write completed with error (sct=0, sc=8) 00:13:45.702 Write completed with error (sct=0, sc=8) 00:13:45.702 Read completed with error (sct=0, sc=8) 00:13:45.702 Write completed with error (sct=0, sc=8) 00:13:45.702 Read completed with error (sct=0, sc=8) 00:13:45.702 Write completed with error (sct=0, sc=8) 00:13:45.702 Read completed with error (sct=0, sc=8) 00:13:45.702 Write completed with error (sct=0, sc=8) 00:13:45.702 Read completed with error (sct=0, sc=8) 00:13:45.702 Read completed with error (sct=0, sc=8) 00:13:45.702 Write completed with error (sct=0, sc=8) 00:13:45.702 Read completed with error (sct=0, sc=8) 00:13:45.702 Read completed with error (sct=0, sc=8) 00:13:45.702 Read completed with error (sct=0, sc=8) 00:13:45.702 Write completed with error (sct=0, sc=8) 00:13:45.702 Read completed with error (sct=0, sc=8) 00:13:45.702 Read completed with error (sct=0, sc=8) 00:13:45.702 Read completed with error (sct=0, sc=8) 00:13:45.702 Write completed with error (sct=0, sc=8) 00:13:45.702 Write completed with error (sct=0, sc=8) 00:13:45.702 Read completed with error (sct=0, sc=8) 00:13:45.702 Read completed with error (sct=0, sc=8) 00:13:45.702 Read completed with error (sct=0, sc=8) 00:13:45.702 Read completed with error (sct=0, sc=8) 00:13:45.702 Read completed with error (sct=0, sc=8) 00:13:45.702 Read completed with error (sct=0, sc=8) 00:13:45.702 Read completed with error (sct=0, sc=8) 00:13:45.702 Write completed with error (sct=0, sc=8) 00:13:45.702 Read completed with error (sct=0, sc=8) 00:13:45.702 Read completed with error (sct=0, sc=8) 00:13:45.702 Read completed with error (sct=0, sc=8) 00:13:45.702 Read completed with error (sct=0, sc=8) 00:13:45.702 Read completed with error (sct=0, sc=8) 00:13:45.702 Read completed with error (sct=0, sc=8) 00:13:45.702 Write completed with error (sct=0, sc=8) 00:13:45.702 Read completed with error (sct=0, sc=8) 00:13:45.702 Read completed with error (sct=0, sc=8) 00:13:45.702 [2024-11-21 03:30:26.302277] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f717800c480 is same with the state(5) to be set 00:13:46.635 [2024-11-21 03:30:27.274613] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5bb960 is same with the state(5) to be set 00:13:46.894 Read completed with error (sct=0, sc=8) 00:13:46.894 Read completed with error (sct=0, sc=8) 00:13:46.894 Read completed with error (sct=0, sc=8) 00:13:46.894 Write completed with error (sct=0, sc=8) 00:13:46.894 Read completed with error (sct=0, sc=8) 00:13:46.894 Read completed with error (sct=0, sc=8) 00:13:46.894 Read completed with error (sct=0, sc=8) 00:13:46.894 Read completed with error (sct=0, sc=8) 00:13:46.894 Read completed with error (sct=0, sc=8) 00:13:46.894 Write completed with error (sct=0, sc=8) 00:13:46.894 Write completed with error (sct=0, sc=8) 00:13:46.894 Read completed with error (sct=0, sc=8) 00:13:46.894 [2024-11-21 03:30:27.302865] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f717800c1d0 is same with the state(5) to be set 00:13:46.894 Read completed with error (sct=0, sc=8) 00:13:46.894 Read completed with error (sct=0, sc=8) 00:13:46.894 Read completed with error (sct=0, sc=8) 00:13:46.894 Write completed with error (sct=0, sc=8) 00:13:46.894 Read completed with error (sct=0, sc=8) 00:13:46.894 Read completed with error (sct=0, sc=8) 00:13:46.894 Write completed with error (sct=0, sc=8) 00:13:46.894 Write completed with error (sct=0, sc=8) 00:13:46.894 Write completed with error (sct=0, sc=8) 00:13:46.894 Read completed with error (sct=0, sc=8) 00:13:46.894 Write completed with error (sct=0, sc=8) 00:13:46.894 Write completed with error (sct=0, sc=8) 00:13:46.894 Read completed with error (sct=0, sc=8) 00:13:46.894 Write completed with error (sct=0, sc=8) 00:13:46.894 Read completed with error (sct=0, sc=8) 00:13:46.894 Read completed with error (sct=0, sc=8) 00:13:46.894 Read completed with error (sct=0, sc=8) 00:13:46.894 Read completed with error (sct=0, sc=8) 00:13:46.894 Write completed with error (sct=0, sc=8) 00:13:46.894 Read completed with error (sct=0, sc=8) 00:13:46.894 Read completed with error (sct=0, sc=8) 00:13:46.894 Write completed with error (sct=0, sc=8) 00:13:46.894 Read completed with error (sct=0, sc=8) 00:13:46.894 Read completed with error (sct=0, sc=8) 00:13:46.894 Read completed with error (sct=0, sc=8) 00:13:46.894 Write completed with error (sct=0, sc=8) 00:13:46.894 [2024-11-21 03:30:27.303376] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5a24c0 is same with the state(5) to be set 00:13:46.894 Read completed with error (sct=0, sc=8) 00:13:46.894 Read completed with error (sct=0, sc=8) 00:13:46.894 Read completed with error (sct=0, sc=8) 00:13:46.894 Read completed with error (sct=0, sc=8) 00:13:46.894 Read completed with error (sct=0, sc=8) 00:13:46.894 Read completed with error (sct=0, sc=8) 00:13:46.894 Read completed with error (sct=0, sc=8) 00:13:46.894 Read completed with error (sct=0, sc=8) 00:13:46.894 Write completed with error (sct=0, sc=8) 00:13:46.894 Read completed with error (sct=0, sc=8) 00:13:46.894 Write completed with error (sct=0, sc=8) 00:13:46.894 Write completed with error (sct=0, sc=8) 00:13:46.894 Read completed with error (sct=0, sc=8) 00:13:46.894 Write completed with error (sct=0, sc=8) 00:13:46.894 Read completed with error (sct=0, sc=8) 00:13:46.894 Read completed with error (sct=0, sc=8) 00:13:46.894 Read completed with error (sct=0, sc=8) 00:13:46.894 Read completed with error (sct=0, sc=8) 00:13:46.894 Write completed with error (sct=0, sc=8) 00:13:46.894 Read completed with error (sct=0, sc=8) 00:13:46.894 Read completed with error (sct=0, sc=8) 00:13:46.894 Write completed with error (sct=0, sc=8) 00:13:46.894 Read completed with error (sct=0, sc=8) 00:13:46.894 Read completed with error (sct=0, sc=8) 00:13:46.894 Read completed with error (sct=0, sc=8) 00:13:46.894 Read completed with error (sct=0, sc=8) 00:13:46.894 [2024-11-21 03:30:27.304157] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5c23d0 is same with the state(5) to be set 00:13:46.894 Read completed with error (sct=0, sc=8) 00:13:46.894 Write completed with error (sct=0, sc=8) 00:13:46.894 Write completed with error (sct=0, sc=8) 00:13:46.894 Write completed with error (sct=0, sc=8) 00:13:46.894 Write completed with error (sct=0, sc=8) 00:13:46.894 Read completed with error (sct=0, sc=8) 00:13:46.894 Read completed with error (sct=0, sc=8) 00:13:46.894 Write completed with error (sct=0, sc=8) 00:13:46.894 Read completed with error (sct=0, sc=8) 00:13:46.894 Read completed with error (sct=0, sc=8) 00:13:46.894 Write completed with error (sct=0, sc=8) 00:13:46.894 Write completed with error (sct=0, sc=8) 00:13:46.894 Read completed with error (sct=0, sc=8) 00:13:46.894 Read completed with error (sct=0, sc=8) 00:13:46.894 Read completed with error (sct=0, sc=8) 00:13:46.894 Read completed with error (sct=0, sc=8) 00:13:46.894 Read completed with error (sct=0, sc=8) 00:13:46.894 Read completed with error (sct=0, sc=8) 00:13:46.894 Read completed with error (sct=0, sc=8) 00:13:46.894 Read completed with error (sct=0, sc=8) 00:13:46.894 Read completed with error (sct=0, sc=8) 00:13:46.894 Read completed with error (sct=0, sc=8) 00:13:46.894 Read completed with error (sct=0, sc=8) 00:13:46.894 Write completed with error (sct=0, sc=8) 00:13:46.894 Read completed with error (sct=0, sc=8) 00:13:46.894 [2024-11-21 03:30:27.304333] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5a2a20 is same with the state(5) to be set 00:13:46.894 [2024-11-21 03:30:27.305126] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x5bb960 (9): Bad file descriptor 00:13:46.894 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf: errors occurred 00:13:46.894 03:30:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:46.894 03:30:27 -- target/delete_subsystem.sh@34 -- # delay=0 00:13:46.894 03:30:27 -- target/delete_subsystem.sh@35 -- # kill -0 3022440 00:13:46.894 03:30:27 -- target/delete_subsystem.sh@36 -- # sleep 0.5 00:13:46.894 Initializing NVMe Controllers 00:13:46.894 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:13:46.894 Controller IO queue size 128, less than required. 00:13:46.894 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:13:46.894 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:13:46.894 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:13:46.894 Initialization complete. Launching workers. 00:13:46.894 ======================================================== 00:13:46.894 Latency(us) 00:13:46.894 Device Information : IOPS MiB/s Average min max 00:13:46.894 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 172.17 0.08 965299.21 1270.68 1012254.95 00:13:46.894 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 145.87 0.07 919443.30 2497.12 1046093.82 00:13:46.894 ======================================================== 00:13:46.894 Total : 318.04 0.16 944267.01 1270.68 1046093.82 00:13:46.894 00:13:47.484 03:30:27 -- target/delete_subsystem.sh@38 -- # (( delay++ > 30 )) 00:13:47.484 03:30:27 -- target/delete_subsystem.sh@35 -- # kill -0 3022440 00:13:47.484 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 35: kill: (3022440) - No such process 00:13:47.484 03:30:27 -- target/delete_subsystem.sh@45 -- # NOT wait 3022440 00:13:47.484 03:30:27 -- common/autotest_common.sh@650 -- # local es=0 00:13:47.484 03:30:27 -- common/autotest_common.sh@652 -- # valid_exec_arg wait 3022440 00:13:47.484 03:30:27 -- common/autotest_common.sh@638 -- # local arg=wait 00:13:47.484 03:30:27 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:47.484 03:30:27 -- common/autotest_common.sh@642 -- # type -t wait 00:13:47.484 03:30:27 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:47.484 03:30:27 -- common/autotest_common.sh@653 -- # wait 3022440 00:13:47.484 03:30:27 -- common/autotest_common.sh@653 -- # es=1 00:13:47.484 03:30:27 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:13:47.484 03:30:27 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:13:47.484 03:30:27 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:13:47.484 03:30:27 -- target/delete_subsystem.sh@48 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:47.484 03:30:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:47.484 03:30:27 -- common/autotest_common.sh@10 -- # set +x 00:13:47.484 03:30:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:47.484 03:30:27 -- target/delete_subsystem.sh@49 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:47.484 03:30:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:47.484 03:30:27 -- common/autotest_common.sh@10 -- # set +x 00:13:47.484 [2024-11-21 03:30:27.828972] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:47.484 03:30:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:47.484 03:30:27 -- target/delete_subsystem.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:47.484 03:30:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:47.484 03:30:27 -- common/autotest_common.sh@10 -- # set +x 00:13:47.484 03:30:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:47.484 03:30:27 -- target/delete_subsystem.sh@54 -- # perf_pid=3022973 00:13:47.484 03:30:27 -- target/delete_subsystem.sh@56 -- # delay=0 00:13:47.484 03:30:27 -- target/delete_subsystem.sh@57 -- # kill -0 3022973 00:13:47.484 03:30:27 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:47.484 03:30:27 -- target/delete_subsystem.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 3 -q 128 -w randrw -M 70 -o 512 -P 4 00:13:47.484 EAL: No free 2048 kB hugepages reported on node 1 00:13:47.484 [2024-11-21 03:30:27.891450] subsystem.c:1344:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:13:47.742 03:30:28 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:47.742 03:30:28 -- target/delete_subsystem.sh@57 -- # kill -0 3022973 00:13:47.742 03:30:28 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:48.306 03:30:28 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:48.306 03:30:28 -- target/delete_subsystem.sh@57 -- # kill -0 3022973 00:13:48.306 03:30:28 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:48.869 03:30:29 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:48.869 03:30:29 -- target/delete_subsystem.sh@57 -- # kill -0 3022973 00:13:48.869 03:30:29 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:49.435 03:30:29 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:49.435 03:30:29 -- target/delete_subsystem.sh@57 -- # kill -0 3022973 00:13:49.435 03:30:29 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:49.999 03:30:30 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:49.999 03:30:30 -- target/delete_subsystem.sh@57 -- # kill -0 3022973 00:13:49.999 03:30:30 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:50.257 03:30:30 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:50.257 03:30:30 -- target/delete_subsystem.sh@57 -- # kill -0 3022973 00:13:50.257 03:30:30 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:50.516 Initializing NVMe Controllers 00:13:50.516 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:13:50.516 Controller IO queue size 128, less than required. 00:13:50.516 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:13:50.516 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:13:50.516 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:13:50.516 Initialization complete. Launching workers. 00:13:50.516 ======================================================== 00:13:50.516 Latency(us) 00:13:50.516 Device Information : IOPS MiB/s Average min max 00:13:50.516 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 128.00 0.06 1003036.22 1000224.69 1011247.37 00:13:50.516 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 128.00 0.06 1005638.58 1000190.21 1011565.19 00:13:50.516 ======================================================== 00:13:50.516 Total : 256.00 0.12 1004337.40 1000190.21 1011565.19 00:13:50.516 00:13:50.774 03:30:31 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:50.774 03:30:31 -- target/delete_subsystem.sh@57 -- # kill -0 3022973 00:13:50.774 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 57: kill: (3022973) - No such process 00:13:50.774 03:30:31 -- target/delete_subsystem.sh@67 -- # wait 3022973 00:13:50.774 03:30:31 -- target/delete_subsystem.sh@69 -- # trap - SIGINT SIGTERM EXIT 00:13:50.774 03:30:31 -- target/delete_subsystem.sh@71 -- # nvmftestfini 00:13:50.774 03:30:31 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:50.774 03:30:31 -- nvmf/common.sh@116 -- # sync 00:13:50.774 03:30:31 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:50.774 03:30:31 -- nvmf/common.sh@119 -- # set +e 00:13:50.774 03:30:31 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:50.774 03:30:31 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:50.774 rmmod nvme_tcp 00:13:50.774 rmmod nvme_fabrics 00:13:50.774 rmmod nvme_keyring 00:13:51.033 03:30:31 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:51.033 03:30:31 -- nvmf/common.sh@123 -- # set -e 00:13:51.033 03:30:31 -- nvmf/common.sh@124 -- # return 0 00:13:51.033 03:30:31 -- nvmf/common.sh@477 -- # '[' -n 3022279 ']' 00:13:51.033 03:30:31 -- nvmf/common.sh@478 -- # killprocess 3022279 00:13:51.033 03:30:31 -- common/autotest_common.sh@936 -- # '[' -z 3022279 ']' 00:13:51.033 03:30:31 -- common/autotest_common.sh@940 -- # kill -0 3022279 00:13:51.033 03:30:31 -- common/autotest_common.sh@941 -- # uname 00:13:51.033 03:30:31 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:51.033 03:30:31 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3022279 00:13:51.033 03:30:31 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:13:51.033 03:30:31 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:13:51.034 03:30:31 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3022279' 00:13:51.034 killing process with pid 3022279 00:13:51.034 03:30:31 -- common/autotest_common.sh@955 -- # kill 3022279 00:13:51.034 03:30:31 -- common/autotest_common.sh@960 -- # wait 3022279 00:13:51.294 03:30:31 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:51.294 03:30:31 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:51.294 03:30:31 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:51.294 03:30:31 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:51.294 03:30:31 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:51.294 03:30:31 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:51.294 03:30:31 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:51.294 03:30:31 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:53.201 03:30:33 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:53.201 00:13:53.201 real 0m12.981s 00:13:53.201 user 0m29.380s 00:13:53.201 sys 0m2.925s 00:13:53.201 03:30:33 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:53.201 03:30:33 -- common/autotest_common.sh@10 -- # set +x 00:13:53.201 ************************************ 00:13:53.201 END TEST nvmf_delete_subsystem 00:13:53.201 ************************************ 00:13:53.201 03:30:33 -- nvmf/nvmf.sh@36 -- # [[ 1 -eq 1 ]] 00:13:53.201 03:30:33 -- nvmf/nvmf.sh@37 -- # run_test nvmf_nvme_cli /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:13:53.201 03:30:33 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:53.201 03:30:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:53.201 03:30:33 -- common/autotest_common.sh@10 -- # set +x 00:13:53.201 ************************************ 00:13:53.201 START TEST nvmf_nvme_cli 00:13:53.201 ************************************ 00:13:53.201 03:30:33 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:13:53.460 * Looking for test storage... 00:13:53.460 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:53.460 03:30:33 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:53.460 03:30:33 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:53.460 03:30:33 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:53.460 03:30:33 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:53.460 03:30:33 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:53.460 03:30:33 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:53.460 03:30:33 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:53.460 03:30:33 -- scripts/common.sh@335 -- # IFS=.-: 00:13:53.460 03:30:33 -- scripts/common.sh@335 -- # read -ra ver1 00:13:53.460 03:30:33 -- scripts/common.sh@336 -- # IFS=.-: 00:13:53.460 03:30:33 -- scripts/common.sh@336 -- # read -ra ver2 00:13:53.460 03:30:33 -- scripts/common.sh@337 -- # local 'op=<' 00:13:53.460 03:30:33 -- scripts/common.sh@339 -- # ver1_l=2 00:13:53.460 03:30:33 -- scripts/common.sh@340 -- # ver2_l=1 00:13:53.460 03:30:33 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:53.460 03:30:33 -- scripts/common.sh@343 -- # case "$op" in 00:13:53.460 03:30:33 -- scripts/common.sh@344 -- # : 1 00:13:53.460 03:30:33 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:53.460 03:30:33 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:53.460 03:30:33 -- scripts/common.sh@364 -- # decimal 1 00:13:53.460 03:30:33 -- scripts/common.sh@352 -- # local d=1 00:13:53.460 03:30:33 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:53.460 03:30:33 -- scripts/common.sh@354 -- # echo 1 00:13:53.460 03:30:33 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:53.460 03:30:33 -- scripts/common.sh@365 -- # decimal 2 00:13:53.460 03:30:33 -- scripts/common.sh@352 -- # local d=2 00:13:53.460 03:30:33 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:53.460 03:30:33 -- scripts/common.sh@354 -- # echo 2 00:13:53.460 03:30:33 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:53.460 03:30:33 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:53.460 03:30:33 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:53.460 03:30:33 -- scripts/common.sh@367 -- # return 0 00:13:53.460 03:30:33 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:53.460 03:30:33 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:53.460 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:53.460 --rc genhtml_branch_coverage=1 00:13:53.460 --rc genhtml_function_coverage=1 00:13:53.460 --rc genhtml_legend=1 00:13:53.460 --rc geninfo_all_blocks=1 00:13:53.460 --rc geninfo_unexecuted_blocks=1 00:13:53.460 00:13:53.460 ' 00:13:53.460 03:30:33 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:53.460 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:53.460 --rc genhtml_branch_coverage=1 00:13:53.460 --rc genhtml_function_coverage=1 00:13:53.460 --rc genhtml_legend=1 00:13:53.460 --rc geninfo_all_blocks=1 00:13:53.460 --rc geninfo_unexecuted_blocks=1 00:13:53.460 00:13:53.460 ' 00:13:53.460 03:30:33 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:53.460 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:53.460 --rc genhtml_branch_coverage=1 00:13:53.460 --rc genhtml_function_coverage=1 00:13:53.460 --rc genhtml_legend=1 00:13:53.460 --rc geninfo_all_blocks=1 00:13:53.460 --rc geninfo_unexecuted_blocks=1 00:13:53.460 00:13:53.460 ' 00:13:53.460 03:30:33 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:53.460 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:53.460 --rc genhtml_branch_coverage=1 00:13:53.460 --rc genhtml_function_coverage=1 00:13:53.460 --rc genhtml_legend=1 00:13:53.460 --rc geninfo_all_blocks=1 00:13:53.460 --rc geninfo_unexecuted_blocks=1 00:13:53.460 00:13:53.460 ' 00:13:53.460 03:30:33 -- target/nvme_cli.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:53.460 03:30:33 -- nvmf/common.sh@7 -- # uname -s 00:13:53.460 03:30:33 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:53.461 03:30:33 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:53.461 03:30:33 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:53.461 03:30:33 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:53.461 03:30:33 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:53.461 03:30:33 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:53.461 03:30:33 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:53.461 03:30:33 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:53.461 03:30:33 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:53.461 03:30:33 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:53.461 03:30:33 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:53.461 03:30:33 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:53.461 03:30:33 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:53.461 03:30:33 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:53.461 03:30:33 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:53.461 03:30:33 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:53.461 03:30:33 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:53.461 03:30:33 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:53.461 03:30:33 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:53.461 03:30:33 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:53.461 03:30:33 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:53.461 03:30:33 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:53.461 03:30:33 -- paths/export.sh@5 -- # export PATH 00:13:53.461 03:30:33 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:53.461 03:30:33 -- nvmf/common.sh@46 -- # : 0 00:13:53.461 03:30:33 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:53.461 03:30:33 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:53.461 03:30:33 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:53.461 03:30:33 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:53.461 03:30:33 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:53.461 03:30:33 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:53.461 03:30:33 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:53.461 03:30:33 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:53.461 03:30:33 -- target/nvme_cli.sh@11 -- # MALLOC_BDEV_SIZE=64 00:13:53.461 03:30:33 -- target/nvme_cli.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:13:53.461 03:30:33 -- target/nvme_cli.sh@14 -- # devs=() 00:13:53.461 03:30:33 -- target/nvme_cli.sh@16 -- # nvmftestinit 00:13:53.461 03:30:33 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:53.461 03:30:33 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:53.461 03:30:33 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:53.461 03:30:33 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:53.461 03:30:33 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:53.461 03:30:33 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:53.461 03:30:33 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:53.461 03:30:33 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:53.461 03:30:33 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:53.461 03:30:33 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:53.461 03:30:33 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:53.461 03:30:33 -- common/autotest_common.sh@10 -- # set +x 00:13:55.362 03:30:35 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:55.362 03:30:35 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:55.362 03:30:35 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:55.363 03:30:35 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:55.363 03:30:35 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:55.363 03:30:35 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:55.363 03:30:35 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:55.363 03:30:35 -- nvmf/common.sh@294 -- # net_devs=() 00:13:55.363 03:30:35 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:55.363 03:30:35 -- nvmf/common.sh@295 -- # e810=() 00:13:55.363 03:30:35 -- nvmf/common.sh@295 -- # local -ga e810 00:13:55.363 03:30:35 -- nvmf/common.sh@296 -- # x722=() 00:13:55.363 03:30:35 -- nvmf/common.sh@296 -- # local -ga x722 00:13:55.363 03:30:35 -- nvmf/common.sh@297 -- # mlx=() 00:13:55.363 03:30:35 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:55.363 03:30:35 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:55.363 03:30:35 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:55.363 03:30:35 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:55.363 03:30:35 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:55.363 03:30:35 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:55.363 03:30:35 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:55.363 03:30:35 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:55.363 03:30:35 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:55.363 03:30:35 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:55.363 03:30:35 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:55.363 03:30:35 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:55.363 03:30:35 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:55.363 03:30:35 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:55.363 03:30:35 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:55.363 03:30:35 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:55.363 03:30:35 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:55.363 03:30:35 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:55.363 03:30:35 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:55.363 03:30:35 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:55.363 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:55.363 03:30:35 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:55.363 03:30:35 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:55.363 03:30:35 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:55.363 03:30:35 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:55.363 03:30:35 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:55.363 03:30:35 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:55.363 03:30:35 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:55.363 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:55.363 03:30:35 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:55.363 03:30:35 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:55.363 03:30:35 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:55.363 03:30:35 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:55.363 03:30:35 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:55.363 03:30:35 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:55.363 03:30:35 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:55.363 03:30:35 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:55.363 03:30:35 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:55.363 03:30:35 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:55.363 03:30:35 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:55.363 03:30:35 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:55.363 03:30:35 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:55.363 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:55.363 03:30:35 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:55.363 03:30:35 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:55.363 03:30:35 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:55.363 03:30:35 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:55.363 03:30:35 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:55.363 03:30:35 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:55.363 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:55.363 03:30:35 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:55.363 03:30:35 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:55.363 03:30:35 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:55.363 03:30:35 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:55.363 03:30:35 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:55.363 03:30:35 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:55.363 03:30:35 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:55.363 03:30:35 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:55.363 03:30:35 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:55.363 03:30:35 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:55.363 03:30:35 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:55.363 03:30:35 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:55.363 03:30:35 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:55.363 03:30:35 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:55.363 03:30:35 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:55.363 03:30:35 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:55.363 03:30:35 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:55.363 03:30:35 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:55.363 03:30:35 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:55.622 03:30:36 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:55.622 03:30:36 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:55.622 03:30:36 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:55.622 03:30:36 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:55.622 03:30:36 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:55.622 03:30:36 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:55.622 03:30:36 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:55.622 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:55.622 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.210 ms 00:13:55.622 00:13:55.622 --- 10.0.0.2 ping statistics --- 00:13:55.622 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:55.622 rtt min/avg/max/mdev = 0.210/0.210/0.210/0.000 ms 00:13:55.622 03:30:36 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:55.622 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:55.622 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.156 ms 00:13:55.622 00:13:55.622 --- 10.0.0.1 ping statistics --- 00:13:55.622 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:55.622 rtt min/avg/max/mdev = 0.156/0.156/0.156/0.000 ms 00:13:55.622 03:30:36 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:55.622 03:30:36 -- nvmf/common.sh@410 -- # return 0 00:13:55.622 03:30:36 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:55.622 03:30:36 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:55.622 03:30:36 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:55.622 03:30:36 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:55.622 03:30:36 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:55.622 03:30:36 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:55.622 03:30:36 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:55.622 03:30:36 -- target/nvme_cli.sh@17 -- # nvmfappstart -m 0xF 00:13:55.622 03:30:36 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:55.622 03:30:36 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:55.622 03:30:36 -- common/autotest_common.sh@10 -- # set +x 00:13:55.622 03:30:36 -- nvmf/common.sh@469 -- # nvmfpid=3025339 00:13:55.622 03:30:36 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:13:55.622 03:30:36 -- nvmf/common.sh@470 -- # waitforlisten 3025339 00:13:55.622 03:30:36 -- common/autotest_common.sh@829 -- # '[' -z 3025339 ']' 00:13:55.622 03:30:36 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:55.622 03:30:36 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:55.622 03:30:36 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:55.623 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:55.623 03:30:36 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:55.623 03:30:36 -- common/autotest_common.sh@10 -- # set +x 00:13:55.623 [2024-11-21 03:30:36.159760] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:55.623 [2024-11-21 03:30:36.159840] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:55.623 EAL: No free 2048 kB hugepages reported on node 1 00:13:55.623 [2024-11-21 03:30:36.231062] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:13:55.881 [2024-11-21 03:30:36.349550] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:55.881 [2024-11-21 03:30:36.349702] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:55.881 [2024-11-21 03:30:36.349719] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:55.881 [2024-11-21 03:30:36.349731] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:55.881 [2024-11-21 03:30:36.349785] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:55.881 [2024-11-21 03:30:36.349823] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:55.881 [2024-11-21 03:30:36.349890] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:55.881 [2024-11-21 03:30:36.349893] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:56.815 03:30:37 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:56.815 03:30:37 -- common/autotest_common.sh@862 -- # return 0 00:13:56.815 03:30:37 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:56.815 03:30:37 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:56.815 03:30:37 -- common/autotest_common.sh@10 -- # set +x 00:13:56.815 03:30:37 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:56.815 03:30:37 -- target/nvme_cli.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:56.815 03:30:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:56.815 03:30:37 -- common/autotest_common.sh@10 -- # set +x 00:13:56.815 [2024-11-21 03:30:37.241903] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:56.815 03:30:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:56.815 03:30:37 -- target/nvme_cli.sh@21 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:13:56.815 03:30:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:56.815 03:30:37 -- common/autotest_common.sh@10 -- # set +x 00:13:56.815 Malloc0 00:13:56.815 03:30:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:56.815 03:30:37 -- target/nvme_cli.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:13:56.815 03:30:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:56.815 03:30:37 -- common/autotest_common.sh@10 -- # set +x 00:13:56.815 Malloc1 00:13:56.815 03:30:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:56.815 03:30:37 -- target/nvme_cli.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME -d SPDK_Controller1 -i 291 00:13:56.815 03:30:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:56.815 03:30:37 -- common/autotest_common.sh@10 -- # set +x 00:13:56.815 03:30:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:56.815 03:30:37 -- target/nvme_cli.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:13:56.815 03:30:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:56.815 03:30:37 -- common/autotest_common.sh@10 -- # set +x 00:13:56.815 03:30:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:56.815 03:30:37 -- target/nvme_cli.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:56.815 03:30:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:56.815 03:30:37 -- common/autotest_common.sh@10 -- # set +x 00:13:56.815 03:30:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:56.815 03:30:37 -- target/nvme_cli.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:56.815 03:30:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:56.815 03:30:37 -- common/autotest_common.sh@10 -- # set +x 00:13:56.815 [2024-11-21 03:30:37.328938] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:56.815 03:30:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:56.815 03:30:37 -- target/nvme_cli.sh@28 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:13:56.815 03:30:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:56.815 03:30:37 -- common/autotest_common.sh@10 -- # set +x 00:13:56.815 03:30:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:56.815 03:30:37 -- target/nvme_cli.sh@30 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 4420 00:13:57.073 00:13:57.073 Discovery Log Number of Records 2, Generation counter 2 00:13:57.073 =====Discovery Log Entry 0====== 00:13:57.073 trtype: tcp 00:13:57.073 adrfam: ipv4 00:13:57.073 subtype: current discovery subsystem 00:13:57.073 treq: not required 00:13:57.073 portid: 0 00:13:57.073 trsvcid: 4420 00:13:57.073 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:13:57.073 traddr: 10.0.0.2 00:13:57.073 eflags: explicit discovery connections, duplicate discovery information 00:13:57.073 sectype: none 00:13:57.073 =====Discovery Log Entry 1====== 00:13:57.073 trtype: tcp 00:13:57.073 adrfam: ipv4 00:13:57.073 subtype: nvme subsystem 00:13:57.073 treq: not required 00:13:57.073 portid: 0 00:13:57.073 trsvcid: 4420 00:13:57.073 subnqn: nqn.2016-06.io.spdk:cnode1 00:13:57.073 traddr: 10.0.0.2 00:13:57.073 eflags: none 00:13:57.073 sectype: none 00:13:57.073 03:30:37 -- target/nvme_cli.sh@31 -- # devs=($(get_nvme_devs)) 00:13:57.073 03:30:37 -- target/nvme_cli.sh@31 -- # get_nvme_devs 00:13:57.073 03:30:37 -- nvmf/common.sh@510 -- # local dev _ 00:13:57.073 03:30:37 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:57.073 03:30:37 -- nvmf/common.sh@509 -- # nvme list 00:13:57.073 03:30:37 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:13:57.073 03:30:37 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:57.073 03:30:37 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:13:57.073 03:30:37 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:57.073 03:30:37 -- target/nvme_cli.sh@31 -- # nvme_num_before_connection=0 00:13:57.073 03:30:37 -- target/nvme_cli.sh@32 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:57.639 03:30:38 -- target/nvme_cli.sh@34 -- # waitforserial SPDKISFASTANDAWESOME 2 00:13:57.639 03:30:38 -- common/autotest_common.sh@1187 -- # local i=0 00:13:57.639 03:30:38 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:57.639 03:30:38 -- common/autotest_common.sh@1189 -- # [[ -n 2 ]] 00:13:57.639 03:30:38 -- common/autotest_common.sh@1190 -- # nvme_device_counter=2 00:13:57.639 03:30:38 -- common/autotest_common.sh@1194 -- # sleep 2 00:14:00.167 03:30:40 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:14:00.167 03:30:40 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:14:00.167 03:30:40 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:14:00.167 03:30:40 -- common/autotest_common.sh@1196 -- # nvme_devices=2 00:14:00.167 03:30:40 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:14:00.167 03:30:40 -- common/autotest_common.sh@1197 -- # return 0 00:14:00.167 03:30:40 -- target/nvme_cli.sh@35 -- # get_nvme_devs 00:14:00.167 03:30:40 -- nvmf/common.sh@510 -- # local dev _ 00:14:00.167 03:30:40 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:00.167 03:30:40 -- nvmf/common.sh@509 -- # nvme list 00:14:00.167 03:30:40 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:14:00.167 03:30:40 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:00.167 03:30:40 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:14:00.167 03:30:40 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:00.167 03:30:40 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:14:00.167 03:30:40 -- nvmf/common.sh@514 -- # echo /dev/nvme0n1 00:14:00.167 03:30:40 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:00.167 03:30:40 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:14:00.167 03:30:40 -- nvmf/common.sh@514 -- # echo /dev/nvme0n2 00:14:00.167 03:30:40 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:00.167 03:30:40 -- target/nvme_cli.sh@35 -- # [[ -z /dev/nvme0n1 00:14:00.167 /dev/nvme0n2 ]] 00:14:00.167 03:30:40 -- target/nvme_cli.sh@59 -- # devs=($(get_nvme_devs)) 00:14:00.167 03:30:40 -- target/nvme_cli.sh@59 -- # get_nvme_devs 00:14:00.167 03:30:40 -- nvmf/common.sh@510 -- # local dev _ 00:14:00.167 03:30:40 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:00.167 03:30:40 -- nvmf/common.sh@509 -- # nvme list 00:14:00.167 03:30:40 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:14:00.167 03:30:40 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:00.167 03:30:40 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:14:00.167 03:30:40 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:00.167 03:30:40 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:14:00.167 03:30:40 -- nvmf/common.sh@514 -- # echo /dev/nvme0n1 00:14:00.167 03:30:40 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:00.167 03:30:40 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:14:00.167 03:30:40 -- nvmf/common.sh@514 -- # echo /dev/nvme0n2 00:14:00.167 03:30:40 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:00.167 03:30:40 -- target/nvme_cli.sh@59 -- # nvme_num=2 00:14:00.167 03:30:40 -- target/nvme_cli.sh@60 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:14:00.167 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:14:00.167 03:30:40 -- target/nvme_cli.sh@61 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:14:00.167 03:30:40 -- common/autotest_common.sh@1208 -- # local i=0 00:14:00.167 03:30:40 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:14:00.167 03:30:40 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:00.168 03:30:40 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:14:00.168 03:30:40 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:00.168 03:30:40 -- common/autotest_common.sh@1220 -- # return 0 00:14:00.168 03:30:40 -- target/nvme_cli.sh@62 -- # (( nvme_num <= nvme_num_before_connection )) 00:14:00.168 03:30:40 -- target/nvme_cli.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:14:00.168 03:30:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:00.168 03:30:40 -- common/autotest_common.sh@10 -- # set +x 00:14:00.168 03:30:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:00.168 03:30:40 -- target/nvme_cli.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:14:00.168 03:30:40 -- target/nvme_cli.sh@70 -- # nvmftestfini 00:14:00.168 03:30:40 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:00.168 03:30:40 -- nvmf/common.sh@116 -- # sync 00:14:00.168 03:30:40 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:00.168 03:30:40 -- nvmf/common.sh@119 -- # set +e 00:14:00.168 03:30:40 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:00.168 03:30:40 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:00.425 rmmod nvme_tcp 00:14:00.425 rmmod nvme_fabrics 00:14:00.425 rmmod nvme_keyring 00:14:00.425 03:30:40 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:00.425 03:30:40 -- nvmf/common.sh@123 -- # set -e 00:14:00.425 03:30:40 -- nvmf/common.sh@124 -- # return 0 00:14:00.425 03:30:40 -- nvmf/common.sh@477 -- # '[' -n 3025339 ']' 00:14:00.425 03:30:40 -- nvmf/common.sh@478 -- # killprocess 3025339 00:14:00.425 03:30:40 -- common/autotest_common.sh@936 -- # '[' -z 3025339 ']' 00:14:00.425 03:30:40 -- common/autotest_common.sh@940 -- # kill -0 3025339 00:14:00.425 03:30:40 -- common/autotest_common.sh@941 -- # uname 00:14:00.425 03:30:40 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:00.425 03:30:40 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3025339 00:14:00.425 03:30:40 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:14:00.425 03:30:40 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:14:00.426 03:30:40 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3025339' 00:14:00.426 killing process with pid 3025339 00:14:00.426 03:30:40 -- common/autotest_common.sh@955 -- # kill 3025339 00:14:00.426 03:30:40 -- common/autotest_common.sh@960 -- # wait 3025339 00:14:00.684 03:30:41 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:00.684 03:30:41 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:00.684 03:30:41 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:00.684 03:30:41 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:00.684 03:30:41 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:00.684 03:30:41 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:00.684 03:30:41 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:00.684 03:30:41 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:03.221 03:30:43 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:03.221 00:14:03.221 real 0m9.483s 00:14:03.221 user 0m20.233s 00:14:03.221 sys 0m2.262s 00:14:03.221 03:30:43 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:03.221 03:30:43 -- common/autotest_common.sh@10 -- # set +x 00:14:03.221 ************************************ 00:14:03.221 END TEST nvmf_nvme_cli 00:14:03.221 ************************************ 00:14:03.221 03:30:43 -- nvmf/nvmf.sh@39 -- # [[ 0 -eq 1 ]] 00:14:03.221 03:30:43 -- nvmf/nvmf.sh@46 -- # run_test nvmf_host_management /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:14:03.221 03:30:43 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:03.221 03:30:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:03.221 03:30:43 -- common/autotest_common.sh@10 -- # set +x 00:14:03.221 ************************************ 00:14:03.221 START TEST nvmf_host_management 00:14:03.221 ************************************ 00:14:03.221 03:30:43 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:14:03.221 * Looking for test storage... 00:14:03.221 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:03.221 03:30:43 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:03.221 03:30:43 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:03.221 03:30:43 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:03.221 03:30:43 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:03.221 03:30:43 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:03.221 03:30:43 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:03.221 03:30:43 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:03.221 03:30:43 -- scripts/common.sh@335 -- # IFS=.-: 00:14:03.221 03:30:43 -- scripts/common.sh@335 -- # read -ra ver1 00:14:03.221 03:30:43 -- scripts/common.sh@336 -- # IFS=.-: 00:14:03.221 03:30:43 -- scripts/common.sh@336 -- # read -ra ver2 00:14:03.221 03:30:43 -- scripts/common.sh@337 -- # local 'op=<' 00:14:03.221 03:30:43 -- scripts/common.sh@339 -- # ver1_l=2 00:14:03.221 03:30:43 -- scripts/common.sh@340 -- # ver2_l=1 00:14:03.221 03:30:43 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:03.221 03:30:43 -- scripts/common.sh@343 -- # case "$op" in 00:14:03.221 03:30:43 -- scripts/common.sh@344 -- # : 1 00:14:03.221 03:30:43 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:03.221 03:30:43 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:03.221 03:30:43 -- scripts/common.sh@364 -- # decimal 1 00:14:03.221 03:30:43 -- scripts/common.sh@352 -- # local d=1 00:14:03.221 03:30:43 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:03.221 03:30:43 -- scripts/common.sh@354 -- # echo 1 00:14:03.221 03:30:43 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:03.221 03:30:43 -- scripts/common.sh@365 -- # decimal 2 00:14:03.221 03:30:43 -- scripts/common.sh@352 -- # local d=2 00:14:03.221 03:30:43 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:03.221 03:30:43 -- scripts/common.sh@354 -- # echo 2 00:14:03.221 03:30:43 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:03.221 03:30:43 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:03.221 03:30:43 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:03.221 03:30:43 -- scripts/common.sh@367 -- # return 0 00:14:03.221 03:30:43 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:03.221 03:30:43 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:03.221 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:03.221 --rc genhtml_branch_coverage=1 00:14:03.221 --rc genhtml_function_coverage=1 00:14:03.221 --rc genhtml_legend=1 00:14:03.221 --rc geninfo_all_blocks=1 00:14:03.221 --rc geninfo_unexecuted_blocks=1 00:14:03.221 00:14:03.221 ' 00:14:03.221 03:30:43 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:03.221 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:03.221 --rc genhtml_branch_coverage=1 00:14:03.221 --rc genhtml_function_coverage=1 00:14:03.221 --rc genhtml_legend=1 00:14:03.221 --rc geninfo_all_blocks=1 00:14:03.221 --rc geninfo_unexecuted_blocks=1 00:14:03.221 00:14:03.221 ' 00:14:03.221 03:30:43 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:03.221 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:03.221 --rc genhtml_branch_coverage=1 00:14:03.221 --rc genhtml_function_coverage=1 00:14:03.221 --rc genhtml_legend=1 00:14:03.221 --rc geninfo_all_blocks=1 00:14:03.221 --rc geninfo_unexecuted_blocks=1 00:14:03.221 00:14:03.221 ' 00:14:03.221 03:30:43 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:03.221 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:03.221 --rc genhtml_branch_coverage=1 00:14:03.221 --rc genhtml_function_coverage=1 00:14:03.221 --rc genhtml_legend=1 00:14:03.221 --rc geninfo_all_blocks=1 00:14:03.221 --rc geninfo_unexecuted_blocks=1 00:14:03.221 00:14:03.221 ' 00:14:03.221 03:30:43 -- target/host_management.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:03.221 03:30:43 -- nvmf/common.sh@7 -- # uname -s 00:14:03.221 03:30:43 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:03.221 03:30:43 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:03.221 03:30:43 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:03.221 03:30:43 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:03.221 03:30:43 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:03.221 03:30:43 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:03.221 03:30:43 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:03.221 03:30:43 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:03.221 03:30:43 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:03.221 03:30:43 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:03.222 03:30:43 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:03.222 03:30:43 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:03.222 03:30:43 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:03.222 03:30:43 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:03.222 03:30:43 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:03.222 03:30:43 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:03.222 03:30:43 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:03.222 03:30:43 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:03.222 03:30:43 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:03.222 03:30:43 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:03.222 03:30:43 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:03.222 03:30:43 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:03.222 03:30:43 -- paths/export.sh@5 -- # export PATH 00:14:03.222 03:30:43 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:03.222 03:30:43 -- nvmf/common.sh@46 -- # : 0 00:14:03.222 03:30:43 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:03.222 03:30:43 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:03.222 03:30:43 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:03.222 03:30:43 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:03.222 03:30:43 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:03.222 03:30:43 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:03.222 03:30:43 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:03.222 03:30:43 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:03.222 03:30:43 -- target/host_management.sh@11 -- # MALLOC_BDEV_SIZE=64 00:14:03.222 03:30:43 -- target/host_management.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:14:03.222 03:30:43 -- target/host_management.sh@104 -- # nvmftestinit 00:14:03.222 03:30:43 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:03.222 03:30:43 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:03.222 03:30:43 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:03.222 03:30:43 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:03.222 03:30:43 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:03.222 03:30:43 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:03.222 03:30:43 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:03.222 03:30:43 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:03.222 03:30:43 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:03.222 03:30:43 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:03.222 03:30:43 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:03.222 03:30:43 -- common/autotest_common.sh@10 -- # set +x 00:14:05.127 03:30:45 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:05.127 03:30:45 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:05.127 03:30:45 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:05.127 03:30:45 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:05.127 03:30:45 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:05.127 03:30:45 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:05.127 03:30:45 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:05.127 03:30:45 -- nvmf/common.sh@294 -- # net_devs=() 00:14:05.127 03:30:45 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:05.127 03:30:45 -- nvmf/common.sh@295 -- # e810=() 00:14:05.127 03:30:45 -- nvmf/common.sh@295 -- # local -ga e810 00:14:05.127 03:30:45 -- nvmf/common.sh@296 -- # x722=() 00:14:05.127 03:30:45 -- nvmf/common.sh@296 -- # local -ga x722 00:14:05.127 03:30:45 -- nvmf/common.sh@297 -- # mlx=() 00:14:05.127 03:30:45 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:05.127 03:30:45 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:05.127 03:30:45 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:05.127 03:30:45 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:05.127 03:30:45 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:05.127 03:30:45 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:05.127 03:30:45 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:05.127 03:30:45 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:05.127 03:30:45 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:05.127 03:30:45 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:05.127 03:30:45 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:05.127 03:30:45 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:05.127 03:30:45 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:05.127 03:30:45 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:05.127 03:30:45 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:05.127 03:30:45 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:05.127 03:30:45 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:05.127 03:30:45 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:05.127 03:30:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:05.127 03:30:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:05.127 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:05.127 03:30:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:05.127 03:30:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:05.127 03:30:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:05.127 03:30:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:05.127 03:30:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:05.127 03:30:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:05.127 03:30:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:05.127 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:05.127 03:30:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:05.127 03:30:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:05.127 03:30:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:05.127 03:30:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:05.127 03:30:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:05.127 03:30:45 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:05.127 03:30:45 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:05.127 03:30:45 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:05.127 03:30:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:05.127 03:30:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:05.127 03:30:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:05.127 03:30:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:05.127 03:30:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:05.127 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:05.127 03:30:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:05.127 03:30:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:05.127 03:30:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:05.127 03:30:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:05.127 03:30:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:05.127 03:30:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:05.127 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:05.127 03:30:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:05.127 03:30:45 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:05.127 03:30:45 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:05.127 03:30:45 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:05.127 03:30:45 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:05.127 03:30:45 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:05.127 03:30:45 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:05.127 03:30:45 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:05.127 03:30:45 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:05.127 03:30:45 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:05.127 03:30:45 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:05.127 03:30:45 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:05.127 03:30:45 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:05.127 03:30:45 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:05.127 03:30:45 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:05.127 03:30:45 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:05.127 03:30:45 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:05.127 03:30:45 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:05.127 03:30:45 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:05.127 03:30:45 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:05.128 03:30:45 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:05.128 03:30:45 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:05.128 03:30:45 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:05.128 03:30:45 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:05.128 03:30:45 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:05.128 03:30:45 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:05.128 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:05.128 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.235 ms 00:14:05.128 00:14:05.128 --- 10.0.0.2 ping statistics --- 00:14:05.128 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:05.128 rtt min/avg/max/mdev = 0.235/0.235/0.235/0.000 ms 00:14:05.128 03:30:45 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:05.128 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:05.128 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.127 ms 00:14:05.128 00:14:05.128 --- 10.0.0.1 ping statistics --- 00:14:05.128 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:05.128 rtt min/avg/max/mdev = 0.127/0.127/0.127/0.000 ms 00:14:05.128 03:30:45 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:05.128 03:30:45 -- nvmf/common.sh@410 -- # return 0 00:14:05.128 03:30:45 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:05.128 03:30:45 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:05.128 03:30:45 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:05.128 03:30:45 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:05.128 03:30:45 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:05.128 03:30:45 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:05.128 03:30:45 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:05.128 03:30:45 -- target/host_management.sh@106 -- # run_test nvmf_host_management nvmf_host_management 00:14:05.128 03:30:45 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:14:05.128 03:30:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:05.128 03:30:45 -- common/autotest_common.sh@10 -- # set +x 00:14:05.128 ************************************ 00:14:05.128 START TEST nvmf_host_management 00:14:05.128 ************************************ 00:14:05.128 03:30:45 -- common/autotest_common.sh@1114 -- # nvmf_host_management 00:14:05.128 03:30:45 -- target/host_management.sh@69 -- # starttarget 00:14:05.128 03:30:45 -- target/host_management.sh@16 -- # nvmfappstart -m 0x1E 00:14:05.128 03:30:45 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:05.128 03:30:45 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:05.128 03:30:45 -- common/autotest_common.sh@10 -- # set +x 00:14:05.128 03:30:45 -- nvmf/common.sh@469 -- # nvmfpid=3027891 00:14:05.128 03:30:45 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:14:05.128 03:30:45 -- nvmf/common.sh@470 -- # waitforlisten 3027891 00:14:05.128 03:30:45 -- common/autotest_common.sh@829 -- # '[' -z 3027891 ']' 00:14:05.128 03:30:45 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:05.128 03:30:45 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:05.128 03:30:45 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:05.128 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:05.128 03:30:45 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:05.128 03:30:45 -- common/autotest_common.sh@10 -- # set +x 00:14:05.128 [2024-11-21 03:30:45.699639] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:05.128 [2024-11-21 03:30:45.699731] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:05.128 EAL: No free 2048 kB hugepages reported on node 1 00:14:05.128 [2024-11-21 03:30:45.768542] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:14:05.386 [2024-11-21 03:30:45.890085] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:05.386 [2024-11-21 03:30:45.890250] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:05.386 [2024-11-21 03:30:45.890268] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:05.386 [2024-11-21 03:30:45.890281] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:05.386 [2024-11-21 03:30:45.890414] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:05.386 [2024-11-21 03:30:45.890510] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:14:05.386 [2024-11-21 03:30:45.890579] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:14:05.386 [2024-11-21 03:30:45.890582] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:06.319 03:30:46 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:06.319 03:30:46 -- common/autotest_common.sh@862 -- # return 0 00:14:06.319 03:30:46 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:06.319 03:30:46 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:06.319 03:30:46 -- common/autotest_common.sh@10 -- # set +x 00:14:06.319 03:30:46 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:06.319 03:30:46 -- target/host_management.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:14:06.319 03:30:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:06.319 03:30:46 -- common/autotest_common.sh@10 -- # set +x 00:14:06.319 [2024-11-21 03:30:46.742749] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:06.319 03:30:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:06.319 03:30:46 -- target/host_management.sh@20 -- # timing_enter create_subsystem 00:14:06.319 03:30:46 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:06.319 03:30:46 -- common/autotest_common.sh@10 -- # set +x 00:14:06.319 03:30:46 -- target/host_management.sh@22 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:14:06.319 03:30:46 -- target/host_management.sh@23 -- # cat 00:14:06.319 03:30:46 -- target/host_management.sh@30 -- # rpc_cmd 00:14:06.319 03:30:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:06.319 03:30:46 -- common/autotest_common.sh@10 -- # set +x 00:14:06.319 Malloc0 00:14:06.319 [2024-11-21 03:30:46.804132] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:06.319 03:30:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:06.319 03:30:46 -- target/host_management.sh@31 -- # timing_exit create_subsystems 00:14:06.319 03:30:46 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:06.319 03:30:46 -- common/autotest_common.sh@10 -- # set +x 00:14:06.319 03:30:46 -- target/host_management.sh@73 -- # perfpid=3028072 00:14:06.319 03:30:46 -- target/host_management.sh@74 -- # waitforlisten 3028072 /var/tmp/bdevperf.sock 00:14:06.319 03:30:46 -- common/autotest_common.sh@829 -- # '[' -z 3028072 ']' 00:14:06.319 03:30:46 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:14:06.319 03:30:46 -- target/host_management.sh@72 -- # gen_nvmf_target_json 0 00:14:06.320 03:30:46 -- target/host_management.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:14:06.320 03:30:46 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:06.320 03:30:46 -- nvmf/common.sh@520 -- # config=() 00:14:06.320 03:30:46 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:14:06.320 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:14:06.320 03:30:46 -- nvmf/common.sh@520 -- # local subsystem config 00:14:06.320 03:30:46 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:06.320 03:30:46 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:14:06.320 03:30:46 -- common/autotest_common.sh@10 -- # set +x 00:14:06.320 03:30:46 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:14:06.320 { 00:14:06.320 "params": { 00:14:06.320 "name": "Nvme$subsystem", 00:14:06.320 "trtype": "$TEST_TRANSPORT", 00:14:06.320 "traddr": "$NVMF_FIRST_TARGET_IP", 00:14:06.320 "adrfam": "ipv4", 00:14:06.320 "trsvcid": "$NVMF_PORT", 00:14:06.320 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:14:06.320 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:14:06.320 "hdgst": ${hdgst:-false}, 00:14:06.320 "ddgst": ${ddgst:-false} 00:14:06.320 }, 00:14:06.320 "method": "bdev_nvme_attach_controller" 00:14:06.320 } 00:14:06.320 EOF 00:14:06.320 )") 00:14:06.320 03:30:46 -- nvmf/common.sh@542 -- # cat 00:14:06.320 03:30:46 -- nvmf/common.sh@544 -- # jq . 00:14:06.320 03:30:46 -- nvmf/common.sh@545 -- # IFS=, 00:14:06.320 03:30:46 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:14:06.320 "params": { 00:14:06.320 "name": "Nvme0", 00:14:06.320 "trtype": "tcp", 00:14:06.320 "traddr": "10.0.0.2", 00:14:06.320 "adrfam": "ipv4", 00:14:06.320 "trsvcid": "4420", 00:14:06.320 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:14:06.320 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:14:06.320 "hdgst": false, 00:14:06.320 "ddgst": false 00:14:06.320 }, 00:14:06.320 "method": "bdev_nvme_attach_controller" 00:14:06.320 }' 00:14:06.320 [2024-11-21 03:30:46.881395] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:06.320 [2024-11-21 03:30:46.881497] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3028072 ] 00:14:06.320 EAL: No free 2048 kB hugepages reported on node 1 00:14:06.320 [2024-11-21 03:30:46.945305] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:06.582 [2024-11-21 03:30:47.055041] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:06.840 Running I/O for 10 seconds... 00:14:07.408 03:30:47 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:07.408 03:30:47 -- common/autotest_common.sh@862 -- # return 0 00:14:07.408 03:30:47 -- target/host_management.sh@75 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:14:07.408 03:30:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:07.408 03:30:47 -- common/autotest_common.sh@10 -- # set +x 00:14:07.408 03:30:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:07.408 03:30:47 -- target/host_management.sh@78 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:14:07.408 03:30:47 -- target/host_management.sh@80 -- # waitforio /var/tmp/bdevperf.sock Nvme0n1 00:14:07.408 03:30:47 -- target/host_management.sh@45 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:14:07.408 03:30:47 -- target/host_management.sh@49 -- # '[' -z Nvme0n1 ']' 00:14:07.408 03:30:47 -- target/host_management.sh@52 -- # local ret=1 00:14:07.408 03:30:47 -- target/host_management.sh@53 -- # local i 00:14:07.408 03:30:47 -- target/host_management.sh@54 -- # (( i = 10 )) 00:14:07.408 03:30:47 -- target/host_management.sh@54 -- # (( i != 0 )) 00:14:07.408 03:30:47 -- target/host_management.sh@55 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme0n1 00:14:07.408 03:30:47 -- target/host_management.sh@55 -- # jq -r '.bdevs[0].num_read_ops' 00:14:07.408 03:30:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:07.408 03:30:47 -- common/autotest_common.sh@10 -- # set +x 00:14:07.408 03:30:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:07.408 03:30:47 -- target/host_management.sh@55 -- # read_io_count=2427 00:14:07.408 03:30:47 -- target/host_management.sh@58 -- # '[' 2427 -ge 100 ']' 00:14:07.408 03:30:47 -- target/host_management.sh@59 -- # ret=0 00:14:07.408 03:30:47 -- target/host_management.sh@60 -- # break 00:14:07.409 03:30:47 -- target/host_management.sh@64 -- # return 0 00:14:07.409 03:30:47 -- target/host_management.sh@84 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:14:07.409 03:30:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:07.409 03:30:47 -- common/autotest_common.sh@10 -- # set +x 00:14:07.409 [2024-11-21 03:30:47.916163] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14ace60 is same with the state(5) to be set 00:14:07.409 [2024-11-21 03:30:47.916261] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14ace60 is same with the state(5) to be set 00:14:07.409 [2024-11-21 03:30:47.916286] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14ace60 is same with the state(5) to be set 00:14:07.409 [2024-11-21 03:30:47.916298] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14ace60 is same with the state(5) to be set 00:14:07.409 [2024-11-21 03:30:47.916311] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14ace60 is same with the state(5) to be set 00:14:07.409 [2024-11-21 03:30:47.916322] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14ace60 is same with the state(5) to be set 00:14:07.409 [2024-11-21 03:30:47.916334] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14ace60 is same with the state(5) to be set 00:14:07.409 [2024-11-21 03:30:47.916346] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14ace60 is same with the state(5) to be set 00:14:07.409 [2024-11-21 03:30:47.916357] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14ace60 is same with the state(5) to be set 00:14:07.409 [2024-11-21 03:30:47.916379] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14ace60 is same with the state(5) to be set 00:14:07.409 [2024-11-21 03:30:47.916392] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14ace60 is same with the state(5) to be set 00:14:07.409 [2024-11-21 03:30:47.916404] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14ace60 is same with the state(5) to be set 00:14:07.409 [2024-11-21 03:30:47.916416] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14ace60 is same with the state(5) to be set 00:14:07.409 [2024-11-21 03:30:47.916427] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14ace60 is same with the state(5) to be set 00:14:07.409 [2024-11-21 03:30:47.916449] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14ace60 is same with the state(5) to be set 00:14:07.409 [2024-11-21 03:30:47.916461] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14ace60 is same with the state(5) to be set 00:14:07.409 [2024-11-21 03:30:47.916473] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14ace60 is same with the state(5) to be set 00:14:07.409 [2024-11-21 03:30:47.916500] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14ace60 is same with the state(5) to be set 00:14:07.409 [2024-11-21 03:30:47.916513] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14ace60 is same with the state(5) to be set 00:14:07.409 [2024-11-21 03:30:47.916525] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14ace60 is same with the state(5) to be set 00:14:07.409 [2024-11-21 03:30:47.916547] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14ace60 is same with the state(5) to be set 00:14:07.409 [2024-11-21 03:30:47.916559] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14ace60 is same with the state(5) to be set 00:14:07.409 [2024-11-21 03:30:47.916571] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14ace60 is same with the state(5) to be set 00:14:07.409 [2024-11-21 03:30:47.916582] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14ace60 is same with the state(5) to be set 00:14:07.409 [2024-11-21 03:30:47.916594] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14ace60 is same with the state(5) to be set 00:14:07.409 [2024-11-21 03:30:47.916606] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14ace60 is same with the state(5) to be set 00:14:07.409 [2024-11-21 03:30:47.916617] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14ace60 is same with the state(5) to be set 00:14:07.409 [2024-11-21 03:30:47.916629] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14ace60 is same with the state(5) to be set 00:14:07.409 [2024-11-21 03:30:47.916640] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14ace60 is same with the state(5) to be set 00:14:07.409 [2024-11-21 03:30:47.916652] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14ace60 is same with the state(5) to be set 00:14:07.409 [2024-11-21 03:30:47.916665] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14ace60 is same with the state(5) to be set 00:14:07.409 [2024-11-21 03:30:47.916676] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14ace60 is same with the state(5) to be set 00:14:07.409 [2024-11-21 03:30:47.916688] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14ace60 is same with the state(5) to be set 00:14:07.409 [2024-11-21 03:30:47.916700] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14ace60 is same with the state(5) to be set 00:14:07.409 [2024-11-21 03:30:47.916711] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14ace60 is same with the state(5) to be set 00:14:07.409 [2024-11-21 03:30:47.916722] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14ace60 is same with the state(5) to be set 00:14:07.409 [2024-11-21 03:30:47.916734] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14ace60 is same with the state(5) to be set 00:14:07.409 [2024-11-21 03:30:47.916746] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14ace60 is same with the state(5) to be set 00:14:07.409 [2024-11-21 03:30:47.916757] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14ace60 is same with the state(5) to be set 00:14:07.409 [2024-11-21 03:30:47.916769] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14ace60 is same with the state(5) to be set 00:14:07.409 [2024-11-21 03:30:47.916781] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14ace60 is same with the state(5) to be set 00:14:07.409 [2024-11-21 03:30:47.916792] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14ace60 is same with the state(5) to be set 00:14:07.409 [2024-11-21 03:30:47.916804] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14ace60 is same with the state(5) to be set 00:14:07.409 [2024-11-21 03:30:47.916816] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14ace60 is same with the state(5) to be set 00:14:07.409 [2024-11-21 03:30:47.916836] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14ace60 is same with the state(5) to be set 00:14:07.409 [2024-11-21 03:30:47.918319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:71936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:07.409 [2024-11-21 03:30:47.918369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:07.409 [2024-11-21 03:30:47.918397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:72064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:07.409 [2024-11-21 03:30:47.918412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:07.409 [2024-11-21 03:30:47.918437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:72320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:07.409 [2024-11-21 03:30:47.918452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:07.409 [2024-11-21 03:30:47.918467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:72448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:07.409 [2024-11-21 03:30:47.918481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:07.409 [2024-11-21 03:30:47.918496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:72576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:07.409 [2024-11-21 03:30:47.918510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:07.409 [2024-11-21 03:30:47.918525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:72704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:07.409 [2024-11-21 03:30:47.918538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:07.409 [2024-11-21 03:30:47.918554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:72832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:07.409 [2024-11-21 03:30:47.918567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:07.409 [2024-11-21 03:30:47.918582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:72960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:07.409 [2024-11-21 03:30:47.918596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:07.409 [2024-11-21 03:30:47.918611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:73088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:07.409 [2024-11-21 03:30:47.918624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:07.409 [2024-11-21 03:30:47.918638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:73216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:07.409 [2024-11-21 03:30:47.918651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:07.409 [2024-11-21 03:30:47.918666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:73344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:07.409 [2024-11-21 03:30:47.918680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:07.409 [2024-11-21 03:30:47.918696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:66432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:07.409 [2024-11-21 03:30:47.918709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:07.409 [2024-11-21 03:30:47.918730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:66560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:07.409 [2024-11-21 03:30:47.918747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:07.409 [2024-11-21 03:30:47.918763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:66816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:07.409 [2024-11-21 03:30:47.918776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:07.409 [2024-11-21 03:30:47.918791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:73472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:07.409 [2024-11-21 03:30:47.918804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:07.409 [2024-11-21 03:30:47.918819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:73600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:07.409 [2024-11-21 03:30:47.918833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:07.409 [2024-11-21 03:30:47.918848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:73728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:07.409 [2024-11-21 03:30:47.918861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:07.410 [2024-11-21 03:30:47.918876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:73856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:07.410 [2024-11-21 03:30:47.918890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:07.410 [2024-11-21 03:30:47.918905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:73984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:07.410 [2024-11-21 03:30:47.918918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:07.410 [2024-11-21 03:30:47.918933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:67072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:07.410 [2024-11-21 03:30:47.918946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:07.410 [2024-11-21 03:30:47.918962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:74112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:07.410 [2024-11-21 03:30:47.918975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:07.410 [2024-11-21 03:30:47.918991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:74240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:07.410 [2024-11-21 03:30:47.919005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:07.410 [2024-11-21 03:30:47.919020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:74368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:07.410 [2024-11-21 03:30:47.919034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:07.410 [2024-11-21 03:30:47.919050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:74496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:07.410 [2024-11-21 03:30:47.919064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:07.410 [2024-11-21 03:30:47.919089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:74624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:07.410 [2024-11-21 03:30:47.919107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:07.410 [2024-11-21 03:30:47.919129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:74752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:07.410 [2024-11-21 03:30:47.919144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:07.410 [2024-11-21 03:30:47.919160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:74880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:07.410 [2024-11-21 03:30:47.919174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:07.410 [2024-11-21 03:30:47.919190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:75008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:07.410 [2024-11-21 03:30:47.919204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:07.410 [2024-11-21 03:30:47.919219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:75136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:07.410 [2024-11-21 03:30:47.919232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:07.410 [2024-11-21 03:30:47.919247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:68096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:07.410 [2024-11-21 03:30:47.919260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:07.410 [2024-11-21 03:30:47.919275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:75264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:07.410 [2024-11-21 03:30:47.919288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:07.410 [2024-11-21 03:30:47.919303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:75392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:07.410 [2024-11-21 03:30:47.919317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:07.410 [2024-11-21 03:30:47.919332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:75520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:07.410 [2024-11-21 03:30:47.919346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:07.410 [2024-11-21 03:30:47.919371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:75648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:07.410 [2024-11-21 03:30:47.919385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:07.410 [2024-11-21 03:30:47.919400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:75776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:07.410 [2024-11-21 03:30:47.919414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:07.410 [2024-11-21 03:30:47.919436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:75904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:07.410 [2024-11-21 03:30:47.919449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:07.410 [2024-11-21 03:30:47.919465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:76032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:07.410 [2024-11-21 03:30:47.919479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:07.410 [2024-11-21 03:30:47.919494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:76160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:07.410 [2024-11-21 03:30:47.919512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:07.410 [2024-11-21 03:30:47.919528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:76288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:07.410 [2024-11-21 03:30:47.919542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:07.410 [2024-11-21 03:30:47.919557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:68224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:07.410 [2024-11-21 03:30:47.919571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:07.410 [2024-11-21 03:30:47.919600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:76416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:07.410 [2024-11-21 03:30:47.919614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:07.410 [2024-11-21 03:30:47.919628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:68352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:07.410 [2024-11-21 03:30:47.919642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:07.410 [2024-11-21 03:30:47.919673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:68480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:07.410 [2024-11-21 03:30:47.919686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:07.410 [2024-11-21 03:30:47.919701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:68608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:07.410 [2024-11-21 03:30:47.919715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:07.410 [2024-11-21 03:30:47.919730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:68736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:07.410 [2024-11-21 03:30:47.919744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:07.410 [2024-11-21 03:30:47.919759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:68992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:07.410 [2024-11-21 03:30:47.919772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:07.410 [2024-11-21 03:30:47.919787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:69120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:07.410 [2024-11-21 03:30:47.919801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:07.410 [2024-11-21 03:30:47.919816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:69248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:07.410 [2024-11-21 03:30:47.919830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:07.410 [2024-11-21 03:30:47.919845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:69504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:07.410 [2024-11-21 03:30:47.919865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:07.410 [2024-11-21 03:30:47.919881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:69760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:07.410 [2024-11-21 03:30:47.919896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:07.410 [2024-11-21 03:30:47.919916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:76544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:07.410 [2024-11-21 03:30:47.919930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:07.410 [2024-11-21 03:30:47.919945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:76672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:07.410 [2024-11-21 03:30:47.919959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:07.410 [2024-11-21 03:30:47.919974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:76800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:07.410 [2024-11-21 03:30:47.919988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:07.410 [2024-11-21 03:30:47.920003] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:76928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:07.410 [2024-11-21 03:30:47.920016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:07.410 [2024-11-21 03:30:47.920031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:70912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:07.410 [2024-11-21 03:30:47.920046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:07.410 [2024-11-21 03:30:47.920061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:77056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:07.410 [2024-11-21 03:30:47.920083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:07.410 [2024-11-21 03:30:47.920101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:77184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:07.411 [2024-11-21 03:30:47.920123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:07.411 [2024-11-21 03:30:47.920137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:77312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:07.411 [2024-11-21 03:30:47.920151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:07.411 [2024-11-21 03:30:47.920166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:71424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:07.411 [2024-11-21 03:30:47.920180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:07.411 [2024-11-21 03:30:47.920195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:77440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:07.411 [2024-11-21 03:30:47.920208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:07.411 [2024-11-21 03:30:47.920223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:77568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:07.411 [2024-11-21 03:30:47.920237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:07.411 [2024-11-21 03:30:47.920252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:77696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:07.411 [2024-11-21 03:30:47.920265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:07.411 [2024-11-21 03:30:47.920280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:77824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:07.411 [2024-11-21 03:30:47.920298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:07.411 [2024-11-21 03:30:47.920315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:71808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:07.411 [2024-11-21 03:30:47.920329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:07.411 03:30:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:07.411 [2024-11-21 03:30:47.920437] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0xf46030 was disconnected and freed. reset controller. 00:14:07.411 03:30:47 -- target/host_management.sh@85 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:14:07.411 [2024-11-21 03:30:47.920512] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:14:07.411 [2024-11-21 03:30:47.920536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:07.411 [2024-11-21 03:30:47.920551] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:14:07.411 [2024-11-21 03:30:47.920565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:07.411 [2024-11-21 03:30:47.920579] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:14:07.411 [2024-11-21 03:30:47.920592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:07.411 [2024-11-21 03:30:47.920606] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:14:07.411 [2024-11-21 03:30:47.920620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:07.411 03:30:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:07.411 [2024-11-21 03:30:47.920632] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf48160 is same with the state(5) to be set 00:14:07.411 03:30:47 -- common/autotest_common.sh@10 -- # set +x 00:14:07.411 [2024-11-21 03:30:47.921750] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:14:07.411 task offset: 71936 on job bdev=Nvme0n1 fails 00:14:07.411 00:14:07.411 Latency(us) 00:14:07.411 [2024-11-21T02:30:48.059Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:07.411 [2024-11-21T02:30:48.059Z] Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:14:07.411 [2024-11-21T02:30:48.059Z] Job: Nvme0n1 ended in about 0.65 seconds with error 00:14:07.411 Verification LBA range: start 0x0 length 0x400 00:14:07.411 Nvme0n1 : 0.65 3982.36 248.90 98.29 0.00 15445.93 2669.99 21942.42 00:14:07.411 [2024-11-21T02:30:48.059Z] =================================================================================================================== 00:14:07.411 [2024-11-21T02:30:48.059Z] Total : 3982.36 248.90 98.29 0.00 15445.93 2669.99 21942.42 00:14:07.411 [2024-11-21 03:30:47.923639] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:14:07.411 [2024-11-21 03:30:47.923668] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xf48160 (9): Bad file descriptor 00:14:07.411 03:30:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:07.411 03:30:47 -- target/host_management.sh@87 -- # sleep 1 00:14:07.411 [2024-11-21 03:30:47.930277] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:14:08.350 03:30:48 -- target/host_management.sh@91 -- # kill -9 3028072 00:14:08.350 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh: line 91: kill: (3028072) - No such process 00:14:08.350 03:30:48 -- target/host_management.sh@91 -- # true 00:14:08.351 03:30:48 -- target/host_management.sh@97 -- # rm -f /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 /var/tmp/spdk_cpu_lock_003 /var/tmp/spdk_cpu_lock_004 00:14:08.351 03:30:48 -- target/host_management.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:14:08.351 03:30:48 -- target/host_management.sh@100 -- # gen_nvmf_target_json 0 00:14:08.351 03:30:48 -- nvmf/common.sh@520 -- # config=() 00:14:08.351 03:30:48 -- nvmf/common.sh@520 -- # local subsystem config 00:14:08.351 03:30:48 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:14:08.351 03:30:48 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:14:08.351 { 00:14:08.351 "params": { 00:14:08.351 "name": "Nvme$subsystem", 00:14:08.351 "trtype": "$TEST_TRANSPORT", 00:14:08.351 "traddr": "$NVMF_FIRST_TARGET_IP", 00:14:08.351 "adrfam": "ipv4", 00:14:08.351 "trsvcid": "$NVMF_PORT", 00:14:08.351 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:14:08.351 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:14:08.351 "hdgst": ${hdgst:-false}, 00:14:08.351 "ddgst": ${ddgst:-false} 00:14:08.351 }, 00:14:08.351 "method": "bdev_nvme_attach_controller" 00:14:08.351 } 00:14:08.351 EOF 00:14:08.351 )") 00:14:08.351 03:30:48 -- nvmf/common.sh@542 -- # cat 00:14:08.351 03:30:48 -- nvmf/common.sh@544 -- # jq . 00:14:08.351 03:30:48 -- nvmf/common.sh@545 -- # IFS=, 00:14:08.351 03:30:48 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:14:08.351 "params": { 00:14:08.351 "name": "Nvme0", 00:14:08.351 "trtype": "tcp", 00:14:08.351 "traddr": "10.0.0.2", 00:14:08.351 "adrfam": "ipv4", 00:14:08.351 "trsvcid": "4420", 00:14:08.351 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:14:08.351 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:14:08.351 "hdgst": false, 00:14:08.351 "ddgst": false 00:14:08.351 }, 00:14:08.351 "method": "bdev_nvme_attach_controller" 00:14:08.351 }' 00:14:08.351 [2024-11-21 03:30:48.971896] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:08.351 [2024-11-21 03:30:48.971983] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3028358 ] 00:14:08.609 EAL: No free 2048 kB hugepages reported on node 1 00:14:08.609 [2024-11-21 03:30:49.033018] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:08.609 [2024-11-21 03:30:49.138543] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:08.868 Running I/O for 1 seconds... 00:14:09.807 00:14:09.807 Latency(us) 00:14:09.807 [2024-11-21T02:30:50.455Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:09.807 [2024-11-21T02:30:50.455Z] Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:14:09.807 Verification LBA range: start 0x0 length 0x400 00:14:09.807 Nvme0n1 : 1.01 3924.21 245.26 0.00 0.00 16039.14 1650.54 23010.42 00:14:09.807 [2024-11-21T02:30:50.455Z] =================================================================================================================== 00:14:09.807 [2024-11-21T02:30:50.455Z] Total : 3924.21 245.26 0.00 0.00 16039.14 1650.54 23010.42 00:14:10.065 03:30:50 -- target/host_management.sh@101 -- # stoptarget 00:14:10.065 03:30:50 -- target/host_management.sh@36 -- # rm -f ./local-job0-0-verify.state 00:14:10.065 03:30:50 -- target/host_management.sh@37 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:14:10.065 03:30:50 -- target/host_management.sh@38 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:14:10.065 03:30:50 -- target/host_management.sh@40 -- # nvmftestfini 00:14:10.065 03:30:50 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:10.065 03:30:50 -- nvmf/common.sh@116 -- # sync 00:14:10.065 03:30:50 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:10.065 03:30:50 -- nvmf/common.sh@119 -- # set +e 00:14:10.065 03:30:50 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:10.065 03:30:50 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:10.065 rmmod nvme_tcp 00:14:10.065 rmmod nvme_fabrics 00:14:10.065 rmmod nvme_keyring 00:14:10.065 03:30:50 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:10.065 03:30:50 -- nvmf/common.sh@123 -- # set -e 00:14:10.065 03:30:50 -- nvmf/common.sh@124 -- # return 0 00:14:10.065 03:30:50 -- nvmf/common.sh@477 -- # '[' -n 3027891 ']' 00:14:10.065 03:30:50 -- nvmf/common.sh@478 -- # killprocess 3027891 00:14:10.065 03:30:50 -- common/autotest_common.sh@936 -- # '[' -z 3027891 ']' 00:14:10.065 03:30:50 -- common/autotest_common.sh@940 -- # kill -0 3027891 00:14:10.065 03:30:50 -- common/autotest_common.sh@941 -- # uname 00:14:10.065 03:30:50 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:10.065 03:30:50 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3027891 00:14:10.324 03:30:50 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:14:10.324 03:30:50 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:14:10.324 03:30:50 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3027891' 00:14:10.324 killing process with pid 3027891 00:14:10.324 03:30:50 -- common/autotest_common.sh@955 -- # kill 3027891 00:14:10.324 03:30:50 -- common/autotest_common.sh@960 -- # wait 3027891 00:14:10.583 [2024-11-21 03:30:50.995321] app.c: 605:unclaim_cpu_cores: *ERROR*: Failed to unlink lock fd for core 1, errno: 2 00:14:10.583 03:30:51 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:10.583 03:30:51 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:10.583 03:30:51 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:10.583 03:30:51 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:10.583 03:30:51 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:10.583 03:30:51 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:10.583 03:30:51 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:10.583 03:30:51 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:12.487 03:30:53 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:12.487 00:14:12.487 real 0m7.420s 00:14:12.487 user 0m22.571s 00:14:12.487 sys 0m1.540s 00:14:12.487 03:30:53 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:12.487 03:30:53 -- common/autotest_common.sh@10 -- # set +x 00:14:12.487 ************************************ 00:14:12.487 END TEST nvmf_host_management 00:14:12.487 ************************************ 00:14:12.487 03:30:53 -- target/host_management.sh@108 -- # trap - SIGINT SIGTERM EXIT 00:14:12.487 00:14:12.487 real 0m9.779s 00:14:12.487 user 0m23.443s 00:14:12.487 sys 0m3.059s 00:14:12.487 03:30:53 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:12.487 03:30:53 -- common/autotest_common.sh@10 -- # set +x 00:14:12.487 ************************************ 00:14:12.487 END TEST nvmf_host_management 00:14:12.487 ************************************ 00:14:12.487 03:30:53 -- nvmf/nvmf.sh@47 -- # run_test nvmf_lvol /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:14:12.487 03:30:53 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:12.487 03:30:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:12.487 03:30:53 -- common/autotest_common.sh@10 -- # set +x 00:14:12.487 ************************************ 00:14:12.487 START TEST nvmf_lvol 00:14:12.487 ************************************ 00:14:12.487 03:30:53 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:14:12.747 * Looking for test storage... 00:14:12.747 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:12.747 03:30:53 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:12.747 03:30:53 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:12.747 03:30:53 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:12.747 03:30:53 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:12.747 03:30:53 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:12.747 03:30:53 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:12.747 03:30:53 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:12.747 03:30:53 -- scripts/common.sh@335 -- # IFS=.-: 00:14:12.747 03:30:53 -- scripts/common.sh@335 -- # read -ra ver1 00:14:12.747 03:30:53 -- scripts/common.sh@336 -- # IFS=.-: 00:14:12.747 03:30:53 -- scripts/common.sh@336 -- # read -ra ver2 00:14:12.747 03:30:53 -- scripts/common.sh@337 -- # local 'op=<' 00:14:12.747 03:30:53 -- scripts/common.sh@339 -- # ver1_l=2 00:14:12.747 03:30:53 -- scripts/common.sh@340 -- # ver2_l=1 00:14:12.747 03:30:53 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:12.747 03:30:53 -- scripts/common.sh@343 -- # case "$op" in 00:14:12.747 03:30:53 -- scripts/common.sh@344 -- # : 1 00:14:12.747 03:30:53 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:12.747 03:30:53 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:12.747 03:30:53 -- scripts/common.sh@364 -- # decimal 1 00:14:12.747 03:30:53 -- scripts/common.sh@352 -- # local d=1 00:14:12.747 03:30:53 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:12.747 03:30:53 -- scripts/common.sh@354 -- # echo 1 00:14:12.747 03:30:53 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:12.747 03:30:53 -- scripts/common.sh@365 -- # decimal 2 00:14:12.747 03:30:53 -- scripts/common.sh@352 -- # local d=2 00:14:12.747 03:30:53 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:12.747 03:30:53 -- scripts/common.sh@354 -- # echo 2 00:14:12.747 03:30:53 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:12.747 03:30:53 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:12.747 03:30:53 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:12.747 03:30:53 -- scripts/common.sh@367 -- # return 0 00:14:12.747 03:30:53 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:12.747 03:30:53 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:12.747 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:12.747 --rc genhtml_branch_coverage=1 00:14:12.747 --rc genhtml_function_coverage=1 00:14:12.747 --rc genhtml_legend=1 00:14:12.747 --rc geninfo_all_blocks=1 00:14:12.747 --rc geninfo_unexecuted_blocks=1 00:14:12.747 00:14:12.747 ' 00:14:12.747 03:30:53 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:12.747 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:12.747 --rc genhtml_branch_coverage=1 00:14:12.747 --rc genhtml_function_coverage=1 00:14:12.747 --rc genhtml_legend=1 00:14:12.747 --rc geninfo_all_blocks=1 00:14:12.747 --rc geninfo_unexecuted_blocks=1 00:14:12.747 00:14:12.747 ' 00:14:12.747 03:30:53 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:12.747 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:12.747 --rc genhtml_branch_coverage=1 00:14:12.747 --rc genhtml_function_coverage=1 00:14:12.747 --rc genhtml_legend=1 00:14:12.747 --rc geninfo_all_blocks=1 00:14:12.747 --rc geninfo_unexecuted_blocks=1 00:14:12.747 00:14:12.747 ' 00:14:12.747 03:30:53 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:12.747 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:12.747 --rc genhtml_branch_coverage=1 00:14:12.747 --rc genhtml_function_coverage=1 00:14:12.747 --rc genhtml_legend=1 00:14:12.747 --rc geninfo_all_blocks=1 00:14:12.747 --rc geninfo_unexecuted_blocks=1 00:14:12.747 00:14:12.747 ' 00:14:12.747 03:30:53 -- target/nvmf_lvol.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:12.747 03:30:53 -- nvmf/common.sh@7 -- # uname -s 00:14:12.747 03:30:53 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:12.747 03:30:53 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:12.747 03:30:53 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:12.747 03:30:53 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:12.747 03:30:53 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:12.747 03:30:53 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:12.747 03:30:53 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:12.747 03:30:53 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:12.747 03:30:53 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:12.747 03:30:53 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:12.747 03:30:53 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:12.747 03:30:53 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:12.747 03:30:53 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:12.747 03:30:53 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:12.747 03:30:53 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:12.747 03:30:53 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:12.747 03:30:53 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:12.747 03:30:53 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:12.747 03:30:53 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:12.747 03:30:53 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:12.747 03:30:53 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:12.747 03:30:53 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:12.747 03:30:53 -- paths/export.sh@5 -- # export PATH 00:14:12.747 03:30:53 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:12.747 03:30:53 -- nvmf/common.sh@46 -- # : 0 00:14:12.747 03:30:53 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:12.747 03:30:53 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:12.747 03:30:53 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:12.747 03:30:53 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:12.747 03:30:53 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:12.747 03:30:53 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:12.747 03:30:53 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:12.747 03:30:53 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:12.747 03:30:53 -- target/nvmf_lvol.sh@11 -- # MALLOC_BDEV_SIZE=64 00:14:12.747 03:30:53 -- target/nvmf_lvol.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:14:12.747 03:30:53 -- target/nvmf_lvol.sh@13 -- # LVOL_BDEV_INIT_SIZE=20 00:14:12.747 03:30:53 -- target/nvmf_lvol.sh@14 -- # LVOL_BDEV_FINAL_SIZE=30 00:14:12.747 03:30:53 -- target/nvmf_lvol.sh@16 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:12.747 03:30:53 -- target/nvmf_lvol.sh@18 -- # nvmftestinit 00:14:12.747 03:30:53 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:12.747 03:30:53 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:12.747 03:30:53 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:12.747 03:30:53 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:12.747 03:30:53 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:12.747 03:30:53 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:12.747 03:30:53 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:12.747 03:30:53 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:12.747 03:30:53 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:12.747 03:30:53 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:12.747 03:30:53 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:12.747 03:30:53 -- common/autotest_common.sh@10 -- # set +x 00:14:14.653 03:30:55 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:14.653 03:30:55 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:14.653 03:30:55 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:14.653 03:30:55 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:14.653 03:30:55 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:14.653 03:30:55 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:14.653 03:30:55 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:14.653 03:30:55 -- nvmf/common.sh@294 -- # net_devs=() 00:14:14.653 03:30:55 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:14.653 03:30:55 -- nvmf/common.sh@295 -- # e810=() 00:14:14.653 03:30:55 -- nvmf/common.sh@295 -- # local -ga e810 00:14:14.653 03:30:55 -- nvmf/common.sh@296 -- # x722=() 00:14:14.653 03:30:55 -- nvmf/common.sh@296 -- # local -ga x722 00:14:14.653 03:30:55 -- nvmf/common.sh@297 -- # mlx=() 00:14:14.653 03:30:55 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:14.653 03:30:55 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:14.653 03:30:55 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:14.653 03:30:55 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:14.653 03:30:55 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:14.653 03:30:55 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:14.653 03:30:55 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:14.653 03:30:55 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:14.653 03:30:55 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:14.653 03:30:55 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:14.653 03:30:55 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:14.653 03:30:55 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:14.653 03:30:55 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:14.653 03:30:55 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:14.653 03:30:55 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:14.653 03:30:55 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:14.653 03:30:55 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:14.653 03:30:55 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:14.653 03:30:55 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:14.653 03:30:55 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:14.653 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:14.653 03:30:55 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:14.653 03:30:55 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:14.653 03:30:55 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:14.653 03:30:55 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:14.653 03:30:55 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:14.653 03:30:55 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:14.653 03:30:55 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:14.653 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:14.653 03:30:55 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:14.653 03:30:55 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:14.653 03:30:55 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:14.653 03:30:55 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:14.653 03:30:55 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:14.653 03:30:55 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:14.653 03:30:55 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:14.653 03:30:55 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:14.653 03:30:55 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:14.653 03:30:55 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:14.653 03:30:55 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:14.653 03:30:55 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:14.653 03:30:55 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:14.653 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:14.653 03:30:55 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:14.653 03:30:55 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:14.653 03:30:55 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:14.653 03:30:55 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:14.653 03:30:55 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:14.653 03:30:55 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:14.653 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:14.653 03:30:55 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:14.653 03:30:55 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:14.653 03:30:55 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:14.653 03:30:55 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:14.653 03:30:55 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:14.653 03:30:55 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:14.653 03:30:55 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:14.653 03:30:55 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:14.653 03:30:55 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:14.653 03:30:55 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:14.653 03:30:55 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:14.653 03:30:55 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:14.653 03:30:55 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:14.653 03:30:55 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:14.653 03:30:55 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:14.653 03:30:55 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:14.653 03:30:55 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:14.653 03:30:55 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:14.653 03:30:55 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:14.914 03:30:55 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:14.914 03:30:55 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:14.914 03:30:55 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:14.914 03:30:55 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:14.914 03:30:55 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:14.914 03:30:55 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:14.914 03:30:55 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:14.914 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:14.914 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.231 ms 00:14:14.914 00:14:14.914 --- 10.0.0.2 ping statistics --- 00:14:14.914 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:14.914 rtt min/avg/max/mdev = 0.231/0.231/0.231/0.000 ms 00:14:14.914 03:30:55 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:14.914 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:14.914 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.167 ms 00:14:14.914 00:14:14.914 --- 10.0.0.1 ping statistics --- 00:14:14.914 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:14.914 rtt min/avg/max/mdev = 0.167/0.167/0.167/0.000 ms 00:14:14.914 03:30:55 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:14.914 03:30:55 -- nvmf/common.sh@410 -- # return 0 00:14:14.914 03:30:55 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:14.914 03:30:55 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:14.914 03:30:55 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:14.914 03:30:55 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:14.914 03:30:55 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:14.914 03:30:55 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:14.914 03:30:55 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:14.914 03:30:55 -- target/nvmf_lvol.sh@19 -- # nvmfappstart -m 0x7 00:14:14.914 03:30:55 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:14.914 03:30:55 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:14.914 03:30:55 -- common/autotest_common.sh@10 -- # set +x 00:14:14.914 03:30:55 -- nvmf/common.sh@469 -- # nvmfpid=3030592 00:14:14.914 03:30:55 -- nvmf/common.sh@470 -- # waitforlisten 3030592 00:14:14.914 03:30:55 -- common/autotest_common.sh@829 -- # '[' -z 3030592 ']' 00:14:14.914 03:30:55 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:14.914 03:30:55 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:14.914 03:30:55 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:14.914 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:14.914 03:30:55 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x7 00:14:14.914 03:30:55 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:14.914 03:30:55 -- common/autotest_common.sh@10 -- # set +x 00:14:14.914 [2024-11-21 03:30:55.465771] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:14.914 [2024-11-21 03:30:55.465849] [ DPDK EAL parameters: nvmf -c 0x7 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:14.914 EAL: No free 2048 kB hugepages reported on node 1 00:14:14.914 [2024-11-21 03:30:55.555293] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:14:15.175 [2024-11-21 03:30:55.689650] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:15.175 [2024-11-21 03:30:55.689836] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:15.175 [2024-11-21 03:30:55.689868] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:15.175 [2024-11-21 03:30:55.689894] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:15.175 [2024-11-21 03:30:55.689992] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:15.175 [2024-11-21 03:30:55.690056] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:15.175 [2024-11-21 03:30:55.690065] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:16.110 03:30:56 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:16.110 03:30:56 -- common/autotest_common.sh@862 -- # return 0 00:14:16.110 03:30:56 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:16.110 03:30:56 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:16.110 03:30:56 -- common/autotest_common.sh@10 -- # set +x 00:14:16.110 03:30:56 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:16.110 03:30:56 -- target/nvmf_lvol.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:14:16.368 [2024-11-21 03:30:56.819019] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:16.368 03:30:56 -- target/nvmf_lvol.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:14:16.626 03:30:57 -- target/nvmf_lvol.sh@24 -- # base_bdevs='Malloc0 ' 00:14:16.626 03:30:57 -- target/nvmf_lvol.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:14:16.885 03:30:57 -- target/nvmf_lvol.sh@25 -- # base_bdevs+=Malloc1 00:14:16.885 03:30:57 -- target/nvmf_lvol.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc0 Malloc1' 00:14:17.145 03:30:57 -- target/nvmf_lvol.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore raid0 lvs 00:14:17.441 03:30:57 -- target/nvmf_lvol.sh@29 -- # lvs=8abc77b7-4538-4535-8b6e-aa231fdb46b7 00:14:17.441 03:30:57 -- target/nvmf_lvol.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 8abc77b7-4538-4535-8b6e-aa231fdb46b7 lvol 20 00:14:17.724 03:30:58 -- target/nvmf_lvol.sh@32 -- # lvol=b4953538-5304-4058-9546-1b9c49ab72d4 00:14:17.724 03:30:58 -- target/nvmf_lvol.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:14:17.982 03:30:58 -- target/nvmf_lvol.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 b4953538-5304-4058-9546-1b9c49ab72d4 00:14:18.240 03:30:58 -- target/nvmf_lvol.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:14:18.498 [2024-11-21 03:30:58.922209] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:18.498 03:30:58 -- target/nvmf_lvol.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:14:18.756 03:30:59 -- target/nvmf_lvol.sh@42 -- # perf_pid=3031048 00:14:18.756 03:30:59 -- target/nvmf_lvol.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -o 4096 -q 128 -s 512 -w randwrite -t 10 -c 0x18 00:14:18.756 03:30:59 -- target/nvmf_lvol.sh@44 -- # sleep 1 00:14:18.756 EAL: No free 2048 kB hugepages reported on node 1 00:14:19.695 03:31:00 -- target/nvmf_lvol.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_snapshot b4953538-5304-4058-9546-1b9c49ab72d4 MY_SNAPSHOT 00:14:19.953 03:31:00 -- target/nvmf_lvol.sh@47 -- # snapshot=20f2e70f-5f38-4c4d-9b82-cb4e02a253f4 00:14:19.953 03:31:00 -- target/nvmf_lvol.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_resize b4953538-5304-4058-9546-1b9c49ab72d4 30 00:14:20.211 03:31:00 -- target/nvmf_lvol.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_clone 20f2e70f-5f38-4c4d-9b82-cb4e02a253f4 MY_CLONE 00:14:20.782 03:31:01 -- target/nvmf_lvol.sh@49 -- # clone=52417021-b59d-4341-a70e-fbb66480176f 00:14:20.782 03:31:01 -- target/nvmf_lvol.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_inflate 52417021-b59d-4341-a70e-fbb66480176f 00:14:21.350 03:31:01 -- target/nvmf_lvol.sh@53 -- # wait 3031048 00:14:29.491 Initializing NVMe Controllers 00:14:29.491 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:14:29.491 Controller IO queue size 128, less than required. 00:14:29.491 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:14:29.491 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 3 00:14:29.491 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 4 00:14:29.491 Initialization complete. Launching workers. 00:14:29.491 ======================================================== 00:14:29.491 Latency(us) 00:14:29.491 Device Information : IOPS MiB/s Average min max 00:14:29.491 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 3: 10826.20 42.29 11823.05 2265.93 87475.11 00:14:29.491 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 4: 10597.40 41.40 12081.75 1757.44 54415.14 00:14:29.491 ======================================================== 00:14:29.491 Total : 21423.60 83.69 11951.02 1757.44 87475.11 00:14:29.491 00:14:29.491 03:31:09 -- target/nvmf_lvol.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:14:29.491 03:31:10 -- target/nvmf_lvol.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete b4953538-5304-4058-9546-1b9c49ab72d4 00:14:29.749 03:31:10 -- target/nvmf_lvol.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 8abc77b7-4538-4535-8b6e-aa231fdb46b7 00:14:30.008 03:31:10 -- target/nvmf_lvol.sh@60 -- # rm -f 00:14:30.008 03:31:10 -- target/nvmf_lvol.sh@62 -- # trap - SIGINT SIGTERM EXIT 00:14:30.008 03:31:10 -- target/nvmf_lvol.sh@64 -- # nvmftestfini 00:14:30.008 03:31:10 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:30.008 03:31:10 -- nvmf/common.sh@116 -- # sync 00:14:30.008 03:31:10 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:30.008 03:31:10 -- nvmf/common.sh@119 -- # set +e 00:14:30.008 03:31:10 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:30.008 03:31:10 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:30.008 rmmod nvme_tcp 00:14:30.008 rmmod nvme_fabrics 00:14:30.008 rmmod nvme_keyring 00:14:30.008 03:31:10 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:30.008 03:31:10 -- nvmf/common.sh@123 -- # set -e 00:14:30.008 03:31:10 -- nvmf/common.sh@124 -- # return 0 00:14:30.008 03:31:10 -- nvmf/common.sh@477 -- # '[' -n 3030592 ']' 00:14:30.008 03:31:10 -- nvmf/common.sh@478 -- # killprocess 3030592 00:14:30.008 03:31:10 -- common/autotest_common.sh@936 -- # '[' -z 3030592 ']' 00:14:30.008 03:31:10 -- common/autotest_common.sh@940 -- # kill -0 3030592 00:14:30.008 03:31:10 -- common/autotest_common.sh@941 -- # uname 00:14:30.008 03:31:10 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:30.008 03:31:10 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3030592 00:14:30.266 03:31:10 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:14:30.266 03:31:10 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:14:30.266 03:31:10 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3030592' 00:14:30.266 killing process with pid 3030592 00:14:30.266 03:31:10 -- common/autotest_common.sh@955 -- # kill 3030592 00:14:30.266 03:31:10 -- common/autotest_common.sh@960 -- # wait 3030592 00:14:30.524 03:31:10 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:30.524 03:31:10 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:30.524 03:31:10 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:30.524 03:31:10 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:30.524 03:31:10 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:30.524 03:31:10 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:30.524 03:31:10 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:30.524 03:31:10 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:32.432 03:31:13 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:32.432 00:14:32.432 real 0m19.910s 00:14:32.432 user 1m6.716s 00:14:32.432 sys 0m5.917s 00:14:32.432 03:31:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:32.432 03:31:13 -- common/autotest_common.sh@10 -- # set +x 00:14:32.432 ************************************ 00:14:32.432 END TEST nvmf_lvol 00:14:32.432 ************************************ 00:14:32.432 03:31:13 -- nvmf/nvmf.sh@48 -- # run_test nvmf_lvs_grow /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:14:32.432 03:31:13 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:32.432 03:31:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:32.432 03:31:13 -- common/autotest_common.sh@10 -- # set +x 00:14:32.432 ************************************ 00:14:32.432 START TEST nvmf_lvs_grow 00:14:32.432 ************************************ 00:14:32.432 03:31:13 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:14:32.692 * Looking for test storage... 00:14:32.692 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:32.692 03:31:13 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:32.692 03:31:13 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:32.692 03:31:13 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:32.692 03:31:13 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:32.692 03:31:13 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:32.692 03:31:13 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:32.692 03:31:13 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:32.692 03:31:13 -- scripts/common.sh@335 -- # IFS=.-: 00:14:32.692 03:31:13 -- scripts/common.sh@335 -- # read -ra ver1 00:14:32.692 03:31:13 -- scripts/common.sh@336 -- # IFS=.-: 00:14:32.692 03:31:13 -- scripts/common.sh@336 -- # read -ra ver2 00:14:32.692 03:31:13 -- scripts/common.sh@337 -- # local 'op=<' 00:14:32.692 03:31:13 -- scripts/common.sh@339 -- # ver1_l=2 00:14:32.692 03:31:13 -- scripts/common.sh@340 -- # ver2_l=1 00:14:32.692 03:31:13 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:32.692 03:31:13 -- scripts/common.sh@343 -- # case "$op" in 00:14:32.692 03:31:13 -- scripts/common.sh@344 -- # : 1 00:14:32.692 03:31:13 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:32.692 03:31:13 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:32.692 03:31:13 -- scripts/common.sh@364 -- # decimal 1 00:14:32.692 03:31:13 -- scripts/common.sh@352 -- # local d=1 00:14:32.692 03:31:13 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:32.692 03:31:13 -- scripts/common.sh@354 -- # echo 1 00:14:32.692 03:31:13 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:32.692 03:31:13 -- scripts/common.sh@365 -- # decimal 2 00:14:32.692 03:31:13 -- scripts/common.sh@352 -- # local d=2 00:14:32.692 03:31:13 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:32.692 03:31:13 -- scripts/common.sh@354 -- # echo 2 00:14:32.692 03:31:13 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:32.692 03:31:13 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:32.692 03:31:13 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:32.692 03:31:13 -- scripts/common.sh@367 -- # return 0 00:14:32.692 03:31:13 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:32.692 03:31:13 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:32.692 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:32.692 --rc genhtml_branch_coverage=1 00:14:32.692 --rc genhtml_function_coverage=1 00:14:32.692 --rc genhtml_legend=1 00:14:32.692 --rc geninfo_all_blocks=1 00:14:32.692 --rc geninfo_unexecuted_blocks=1 00:14:32.692 00:14:32.692 ' 00:14:32.692 03:31:13 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:32.692 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:32.692 --rc genhtml_branch_coverage=1 00:14:32.692 --rc genhtml_function_coverage=1 00:14:32.692 --rc genhtml_legend=1 00:14:32.692 --rc geninfo_all_blocks=1 00:14:32.692 --rc geninfo_unexecuted_blocks=1 00:14:32.692 00:14:32.692 ' 00:14:32.692 03:31:13 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:32.692 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:32.692 --rc genhtml_branch_coverage=1 00:14:32.692 --rc genhtml_function_coverage=1 00:14:32.692 --rc genhtml_legend=1 00:14:32.692 --rc geninfo_all_blocks=1 00:14:32.692 --rc geninfo_unexecuted_blocks=1 00:14:32.692 00:14:32.692 ' 00:14:32.692 03:31:13 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:32.692 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:32.692 --rc genhtml_branch_coverage=1 00:14:32.692 --rc genhtml_function_coverage=1 00:14:32.692 --rc genhtml_legend=1 00:14:32.692 --rc geninfo_all_blocks=1 00:14:32.692 --rc geninfo_unexecuted_blocks=1 00:14:32.692 00:14:32.692 ' 00:14:32.692 03:31:13 -- target/nvmf_lvs_grow.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:32.692 03:31:13 -- nvmf/common.sh@7 -- # uname -s 00:14:32.692 03:31:13 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:32.692 03:31:13 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:32.692 03:31:13 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:32.692 03:31:13 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:32.692 03:31:13 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:32.692 03:31:13 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:32.692 03:31:13 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:32.692 03:31:13 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:32.692 03:31:13 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:32.692 03:31:13 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:32.692 03:31:13 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:32.692 03:31:13 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:32.692 03:31:13 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:32.692 03:31:13 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:32.692 03:31:13 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:32.692 03:31:13 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:32.692 03:31:13 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:32.692 03:31:13 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:32.692 03:31:13 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:32.692 03:31:13 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:32.692 03:31:13 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:32.692 03:31:13 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:32.692 03:31:13 -- paths/export.sh@5 -- # export PATH 00:14:32.692 03:31:13 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:32.692 03:31:13 -- nvmf/common.sh@46 -- # : 0 00:14:32.692 03:31:13 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:32.692 03:31:13 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:32.692 03:31:13 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:32.692 03:31:13 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:32.692 03:31:13 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:32.692 03:31:13 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:32.692 03:31:13 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:32.692 03:31:13 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:32.692 03:31:13 -- target/nvmf_lvs_grow.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:32.692 03:31:13 -- target/nvmf_lvs_grow.sh@12 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:14:32.692 03:31:13 -- target/nvmf_lvs_grow.sh@97 -- # nvmftestinit 00:14:32.692 03:31:13 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:32.692 03:31:13 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:32.692 03:31:13 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:32.692 03:31:13 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:32.692 03:31:13 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:32.692 03:31:13 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:32.692 03:31:13 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:32.692 03:31:13 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:32.692 03:31:13 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:32.692 03:31:13 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:32.692 03:31:13 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:32.692 03:31:13 -- common/autotest_common.sh@10 -- # set +x 00:14:35.228 03:31:15 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:35.228 03:31:15 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:35.228 03:31:15 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:35.228 03:31:15 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:35.228 03:31:15 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:35.228 03:31:15 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:35.228 03:31:15 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:35.228 03:31:15 -- nvmf/common.sh@294 -- # net_devs=() 00:14:35.228 03:31:15 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:35.228 03:31:15 -- nvmf/common.sh@295 -- # e810=() 00:14:35.228 03:31:15 -- nvmf/common.sh@295 -- # local -ga e810 00:14:35.228 03:31:15 -- nvmf/common.sh@296 -- # x722=() 00:14:35.228 03:31:15 -- nvmf/common.sh@296 -- # local -ga x722 00:14:35.228 03:31:15 -- nvmf/common.sh@297 -- # mlx=() 00:14:35.228 03:31:15 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:35.228 03:31:15 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:35.228 03:31:15 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:35.228 03:31:15 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:35.228 03:31:15 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:35.228 03:31:15 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:35.228 03:31:15 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:35.228 03:31:15 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:35.228 03:31:15 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:35.228 03:31:15 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:35.228 03:31:15 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:35.228 03:31:15 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:35.228 03:31:15 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:35.228 03:31:15 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:35.228 03:31:15 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:35.228 03:31:15 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:35.228 03:31:15 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:35.228 03:31:15 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:35.228 03:31:15 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:35.228 03:31:15 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:35.228 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:35.228 03:31:15 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:35.228 03:31:15 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:35.228 03:31:15 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:35.228 03:31:15 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:35.228 03:31:15 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:35.228 03:31:15 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:35.228 03:31:15 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:35.228 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:35.228 03:31:15 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:35.228 03:31:15 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:35.228 03:31:15 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:35.228 03:31:15 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:35.228 03:31:15 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:35.228 03:31:15 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:35.228 03:31:15 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:35.228 03:31:15 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:35.228 03:31:15 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:35.228 03:31:15 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:35.228 03:31:15 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:35.228 03:31:15 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:35.228 03:31:15 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:35.228 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:35.228 03:31:15 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:35.228 03:31:15 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:35.228 03:31:15 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:35.228 03:31:15 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:35.228 03:31:15 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:35.228 03:31:15 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:35.228 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:35.228 03:31:15 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:35.228 03:31:15 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:35.228 03:31:15 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:35.228 03:31:15 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:35.228 03:31:15 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:35.228 03:31:15 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:35.228 03:31:15 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:35.228 03:31:15 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:35.228 03:31:15 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:35.228 03:31:15 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:35.228 03:31:15 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:35.228 03:31:15 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:35.228 03:31:15 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:35.228 03:31:15 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:35.228 03:31:15 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:35.228 03:31:15 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:35.228 03:31:15 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:35.228 03:31:15 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:35.228 03:31:15 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:35.228 03:31:15 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:35.228 03:31:15 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:35.228 03:31:15 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:35.228 03:31:15 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:35.228 03:31:15 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:35.228 03:31:15 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:35.228 03:31:15 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:35.228 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:35.228 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.294 ms 00:14:35.228 00:14:35.228 --- 10.0.0.2 ping statistics --- 00:14:35.228 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:35.228 rtt min/avg/max/mdev = 0.294/0.294/0.294/0.000 ms 00:14:35.228 03:31:15 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:35.228 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:35.228 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.177 ms 00:14:35.228 00:14:35.229 --- 10.0.0.1 ping statistics --- 00:14:35.229 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:35.229 rtt min/avg/max/mdev = 0.177/0.177/0.177/0.000 ms 00:14:35.229 03:31:15 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:35.229 03:31:15 -- nvmf/common.sh@410 -- # return 0 00:14:35.229 03:31:15 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:35.229 03:31:15 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:35.229 03:31:15 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:35.229 03:31:15 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:35.229 03:31:15 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:35.229 03:31:15 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:35.229 03:31:15 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:35.229 03:31:15 -- target/nvmf_lvs_grow.sh@98 -- # nvmfappstart -m 0x1 00:14:35.229 03:31:15 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:35.229 03:31:15 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:35.229 03:31:15 -- common/autotest_common.sh@10 -- # set +x 00:14:35.229 03:31:15 -- nvmf/common.sh@469 -- # nvmfpid=3034488 00:14:35.229 03:31:15 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:14:35.229 03:31:15 -- nvmf/common.sh@470 -- # waitforlisten 3034488 00:14:35.229 03:31:15 -- common/autotest_common.sh@829 -- # '[' -z 3034488 ']' 00:14:35.229 03:31:15 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:35.229 03:31:15 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:35.229 03:31:15 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:35.229 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:35.229 03:31:15 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:35.229 03:31:15 -- common/autotest_common.sh@10 -- # set +x 00:14:35.229 [2024-11-21 03:31:15.591706] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:35.229 [2024-11-21 03:31:15.591786] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:35.229 EAL: No free 2048 kB hugepages reported on node 1 00:14:35.229 [2024-11-21 03:31:15.657202] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:35.229 [2024-11-21 03:31:15.765650] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:35.229 [2024-11-21 03:31:15.765796] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:35.229 [2024-11-21 03:31:15.765812] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:35.229 [2024-11-21 03:31:15.765824] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:35.229 [2024-11-21 03:31:15.765852] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:36.167 03:31:16 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:36.167 03:31:16 -- common/autotest_common.sh@862 -- # return 0 00:14:36.167 03:31:16 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:36.167 03:31:16 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:36.167 03:31:16 -- common/autotest_common.sh@10 -- # set +x 00:14:36.167 03:31:16 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:36.167 03:31:16 -- target/nvmf_lvs_grow.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:14:36.427 [2024-11-21 03:31:16.828170] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:36.427 03:31:16 -- target/nvmf_lvs_grow.sh@101 -- # run_test lvs_grow_clean lvs_grow 00:14:36.427 03:31:16 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:14:36.427 03:31:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:36.427 03:31:16 -- common/autotest_common.sh@10 -- # set +x 00:14:36.427 ************************************ 00:14:36.427 START TEST lvs_grow_clean 00:14:36.427 ************************************ 00:14:36.427 03:31:16 -- common/autotest_common.sh@1114 -- # lvs_grow 00:14:36.427 03:31:16 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:14:36.427 03:31:16 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:14:36.427 03:31:16 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:14:36.427 03:31:16 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:14:36.427 03:31:16 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:14:36.427 03:31:16 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:14:36.427 03:31:16 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:36.427 03:31:16 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:36.427 03:31:16 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:14:36.686 03:31:17 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:14:36.686 03:31:17 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:14:36.944 03:31:17 -- target/nvmf_lvs_grow.sh@28 -- # lvs=802c5a53-ea07-45b5-b577-f674b1068ed2 00:14:36.944 03:31:17 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 802c5a53-ea07-45b5-b577-f674b1068ed2 00:14:36.944 03:31:17 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:14:37.203 03:31:17 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:14:37.203 03:31:17 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:14:37.203 03:31:17 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 802c5a53-ea07-45b5-b577-f674b1068ed2 lvol 150 00:14:37.462 03:31:17 -- target/nvmf_lvs_grow.sh@33 -- # lvol=eee0199a-591f-4a60-9196-c68f8f8e1eba 00:14:37.462 03:31:17 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:37.462 03:31:17 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:14:37.721 [2024-11-21 03:31:18.170498] bdev_aio.c: 959:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:14:37.721 [2024-11-21 03:31:18.170583] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:14:37.721 true 00:14:37.722 03:31:18 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 802c5a53-ea07-45b5-b577-f674b1068ed2 00:14:37.722 03:31:18 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:14:37.981 03:31:18 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:14:37.981 03:31:18 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:14:38.242 03:31:18 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 eee0199a-591f-4a60-9196-c68f8f8e1eba 00:14:38.502 03:31:18 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:14:38.761 [2024-11-21 03:31:19.185700] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:38.761 03:31:19 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:14:39.020 03:31:19 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=3034950 00:14:39.020 03:31:19 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:14:39.020 03:31:19 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 3034950 /var/tmp/bdevperf.sock 00:14:39.020 03:31:19 -- common/autotest_common.sh@829 -- # '[' -z 3034950 ']' 00:14:39.020 03:31:19 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:14:39.020 03:31:19 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:39.020 03:31:19 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:14:39.020 03:31:19 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:14:39.020 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:14:39.020 03:31:19 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:39.020 03:31:19 -- common/autotest_common.sh@10 -- # set +x 00:14:39.020 [2024-11-21 03:31:19.499526] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:39.020 [2024-11-21 03:31:19.499601] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3034950 ] 00:14:39.020 EAL: No free 2048 kB hugepages reported on node 1 00:14:39.020 [2024-11-21 03:31:19.557641] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:39.020 [2024-11-21 03:31:19.663498] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:39.955 03:31:20 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:39.955 03:31:20 -- common/autotest_common.sh@862 -- # return 0 00:14:39.955 03:31:20 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:14:40.213 Nvme0n1 00:14:40.213 03:31:20 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:14:40.471 [ 00:14:40.471 { 00:14:40.471 "name": "Nvme0n1", 00:14:40.471 "aliases": [ 00:14:40.471 "eee0199a-591f-4a60-9196-c68f8f8e1eba" 00:14:40.471 ], 00:14:40.471 "product_name": "NVMe disk", 00:14:40.471 "block_size": 4096, 00:14:40.471 "num_blocks": 38912, 00:14:40.471 "uuid": "eee0199a-591f-4a60-9196-c68f8f8e1eba", 00:14:40.471 "assigned_rate_limits": { 00:14:40.471 "rw_ios_per_sec": 0, 00:14:40.471 "rw_mbytes_per_sec": 0, 00:14:40.471 "r_mbytes_per_sec": 0, 00:14:40.471 "w_mbytes_per_sec": 0 00:14:40.471 }, 00:14:40.471 "claimed": false, 00:14:40.471 "zoned": false, 00:14:40.471 "supported_io_types": { 00:14:40.471 "read": true, 00:14:40.471 "write": true, 00:14:40.471 "unmap": true, 00:14:40.471 "write_zeroes": true, 00:14:40.471 "flush": true, 00:14:40.471 "reset": true, 00:14:40.471 "compare": true, 00:14:40.471 "compare_and_write": true, 00:14:40.471 "abort": true, 00:14:40.471 "nvme_admin": true, 00:14:40.471 "nvme_io": true 00:14:40.471 }, 00:14:40.471 "driver_specific": { 00:14:40.471 "nvme": [ 00:14:40.471 { 00:14:40.471 "trid": { 00:14:40.471 "trtype": "TCP", 00:14:40.471 "adrfam": "IPv4", 00:14:40.471 "traddr": "10.0.0.2", 00:14:40.471 "trsvcid": "4420", 00:14:40.471 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:14:40.471 }, 00:14:40.471 "ctrlr_data": { 00:14:40.471 "cntlid": 1, 00:14:40.471 "vendor_id": "0x8086", 00:14:40.471 "model_number": "SPDK bdev Controller", 00:14:40.471 "serial_number": "SPDK0", 00:14:40.471 "firmware_revision": "24.01.1", 00:14:40.471 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:14:40.471 "oacs": { 00:14:40.471 "security": 0, 00:14:40.471 "format": 0, 00:14:40.471 "firmware": 0, 00:14:40.471 "ns_manage": 0 00:14:40.471 }, 00:14:40.471 "multi_ctrlr": true, 00:14:40.471 "ana_reporting": false 00:14:40.471 }, 00:14:40.471 "vs": { 00:14:40.471 "nvme_version": "1.3" 00:14:40.471 }, 00:14:40.471 "ns_data": { 00:14:40.471 "id": 1, 00:14:40.471 "can_share": true 00:14:40.471 } 00:14:40.471 } 00:14:40.471 ], 00:14:40.471 "mp_policy": "active_passive" 00:14:40.471 } 00:14:40.471 } 00:14:40.471 ] 00:14:40.471 03:31:21 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=3035219 00:14:40.471 03:31:21 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:14:40.471 03:31:21 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:14:40.729 Running I/O for 10 seconds... 00:14:41.671 Latency(us) 00:14:41.671 [2024-11-21T02:31:22.319Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:41.671 [2024-11-21T02:31:22.319Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:41.671 Nvme0n1 : 1.00 14701.00 57.43 0.00 0.00 0.00 0.00 0.00 00:14:41.671 [2024-11-21T02:31:22.319Z] =================================================================================================================== 00:14:41.671 [2024-11-21T02:31:22.319Z] Total : 14701.00 57.43 0.00 0.00 0.00 0.00 0.00 00:14:41.671 00:14:42.611 03:31:23 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u 802c5a53-ea07-45b5-b577-f674b1068ed2 00:14:42.611 [2024-11-21T02:31:23.259Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:42.611 Nvme0n1 : 2.00 15050.50 58.79 0.00 0.00 0.00 0.00 0.00 00:14:42.611 [2024-11-21T02:31:23.259Z] =================================================================================================================== 00:14:42.611 [2024-11-21T02:31:23.259Z] Total : 15050.50 58.79 0.00 0.00 0.00 0.00 0.00 00:14:42.611 00:14:42.869 true 00:14:42.869 03:31:23 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 802c5a53-ea07-45b5-b577-f674b1068ed2 00:14:42.869 03:31:23 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:14:43.128 03:31:23 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:14:43.128 03:31:23 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:14:43.128 03:31:23 -- target/nvmf_lvs_grow.sh@65 -- # wait 3035219 00:14:43.697 [2024-11-21T02:31:24.345Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:43.697 Nvme0n1 : 3.00 15186.00 59.32 0.00 0.00 0.00 0.00 0.00 00:14:43.697 [2024-11-21T02:31:24.345Z] =================================================================================================================== 00:14:43.697 [2024-11-21T02:31:24.345Z] Total : 15186.00 59.32 0.00 0.00 0.00 0.00 0.00 00:14:43.697 00:14:44.634 [2024-11-21T02:31:25.282Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:44.634 Nvme0n1 : 4.00 15206.50 59.40 0.00 0.00 0.00 0.00 0.00 00:14:44.634 [2024-11-21T02:31:25.282Z] =================================================================================================================== 00:14:44.634 [2024-11-21T02:31:25.282Z] Total : 15206.50 59.40 0.00 0.00 0.00 0.00 0.00 00:14:44.634 00:14:45.574 [2024-11-21T02:31:26.222Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:45.574 Nvme0n1 : 5.00 15319.00 59.84 0.00 0.00 0.00 0.00 0.00 00:14:45.574 [2024-11-21T02:31:26.222Z] =================================================================================================================== 00:14:45.574 [2024-11-21T02:31:26.222Z] Total : 15319.00 59.84 0.00 0.00 0.00 0.00 0.00 00:14:45.574 00:14:46.513 [2024-11-21T02:31:27.161Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:46.513 Nvme0n1 : 6.00 15321.33 59.85 0.00 0.00 0.00 0.00 0.00 00:14:46.513 [2024-11-21T02:31:27.161Z] =================================================================================================================== 00:14:46.513 [2024-11-21T02:31:27.161Z] Total : 15321.33 59.85 0.00 0.00 0.00 0.00 0.00 00:14:46.513 00:14:47.894 [2024-11-21T02:31:28.542Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:47.894 Nvme0n1 : 7.00 15312.29 59.81 0.00 0.00 0.00 0.00 0.00 00:14:47.894 [2024-11-21T02:31:28.542Z] =================================================================================================================== 00:14:47.894 [2024-11-21T02:31:28.542Z] Total : 15312.29 59.81 0.00 0.00 0.00 0.00 0.00 00:14:47.894 00:14:48.832 [2024-11-21T02:31:29.480Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:48.832 Nvme0n1 : 8.00 15316.50 59.83 0.00 0.00 0.00 0.00 0.00 00:14:48.832 [2024-11-21T02:31:29.480Z] =================================================================================================================== 00:14:48.832 [2024-11-21T02:31:29.480Z] Total : 15316.50 59.83 0.00 0.00 0.00 0.00 0.00 00:14:48.832 00:14:49.771 [2024-11-21T02:31:30.419Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:49.771 Nvme0n1 : 9.00 15362.56 60.01 0.00 0.00 0.00 0.00 0.00 00:14:49.771 [2024-11-21T02:31:30.419Z] =================================================================================================================== 00:14:49.771 [2024-11-21T02:31:30.419Z] Total : 15362.56 60.01 0.00 0.00 0.00 0.00 0.00 00:14:49.771 00:14:50.710 [2024-11-21T02:31:31.358Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:50.710 Nvme0n1 : 10.00 15378.00 60.07 0.00 0.00 0.00 0.00 0.00 00:14:50.710 [2024-11-21T02:31:31.358Z] =================================================================================================================== 00:14:50.710 [2024-11-21T02:31:31.358Z] Total : 15378.00 60.07 0.00 0.00 0.00 0.00 0.00 00:14:50.710 00:14:50.710 00:14:50.710 Latency(us) 00:14:50.710 [2024-11-21T02:31:31.358Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:50.710 [2024-11-21T02:31:31.358Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:50.710 Nvme0n1 : 10.01 15377.87 60.07 0.00 0.00 8319.02 3835.07 17087.91 00:14:50.710 [2024-11-21T02:31:31.358Z] =================================================================================================================== 00:14:50.710 [2024-11-21T02:31:31.358Z] Total : 15377.87 60.07 0.00 0.00 8319.02 3835.07 17087.91 00:14:50.710 0 00:14:50.710 03:31:31 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 3034950 00:14:50.710 03:31:31 -- common/autotest_common.sh@936 -- # '[' -z 3034950 ']' 00:14:50.710 03:31:31 -- common/autotest_common.sh@940 -- # kill -0 3034950 00:14:50.710 03:31:31 -- common/autotest_common.sh@941 -- # uname 00:14:50.710 03:31:31 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:50.710 03:31:31 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3034950 00:14:50.710 03:31:31 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:14:50.710 03:31:31 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:14:50.710 03:31:31 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3034950' 00:14:50.710 killing process with pid 3034950 00:14:50.710 03:31:31 -- common/autotest_common.sh@955 -- # kill 3034950 00:14:50.710 Received shutdown signal, test time was about 10.000000 seconds 00:14:50.710 00:14:50.710 Latency(us) 00:14:50.710 [2024-11-21T02:31:31.358Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:50.710 [2024-11-21T02:31:31.358Z] =================================================================================================================== 00:14:50.710 [2024-11-21T02:31:31.358Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:14:50.710 03:31:31 -- common/autotest_common.sh@960 -- # wait 3034950 00:14:50.969 03:31:31 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:14:51.230 03:31:31 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 802c5a53-ea07-45b5-b577-f674b1068ed2 00:14:51.230 03:31:31 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:14:51.490 03:31:31 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:14:51.490 03:31:31 -- target/nvmf_lvs_grow.sh@71 -- # [[ '' == \d\i\r\t\y ]] 00:14:51.490 03:31:31 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:14:51.749 [2024-11-21 03:31:32.231866] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:14:51.749 03:31:32 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 802c5a53-ea07-45b5-b577-f674b1068ed2 00:14:51.749 03:31:32 -- common/autotest_common.sh@650 -- # local es=0 00:14:51.749 03:31:32 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 802c5a53-ea07-45b5-b577-f674b1068ed2 00:14:51.749 03:31:32 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:51.749 03:31:32 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:14:51.749 03:31:32 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:51.749 03:31:32 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:14:51.749 03:31:32 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:51.749 03:31:32 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:14:51.749 03:31:32 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:51.749 03:31:32 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:14:51.749 03:31:32 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 802c5a53-ea07-45b5-b577-f674b1068ed2 00:14:52.007 request: 00:14:52.007 { 00:14:52.007 "uuid": "802c5a53-ea07-45b5-b577-f674b1068ed2", 00:14:52.007 "method": "bdev_lvol_get_lvstores", 00:14:52.007 "req_id": 1 00:14:52.007 } 00:14:52.007 Got JSON-RPC error response 00:14:52.007 response: 00:14:52.007 { 00:14:52.007 "code": -19, 00:14:52.007 "message": "No such device" 00:14:52.007 } 00:14:52.007 03:31:32 -- common/autotest_common.sh@653 -- # es=1 00:14:52.007 03:31:32 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:14:52.007 03:31:32 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:14:52.007 03:31:32 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:14:52.007 03:31:32 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:14:52.266 aio_bdev 00:14:52.266 03:31:32 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev eee0199a-591f-4a60-9196-c68f8f8e1eba 00:14:52.266 03:31:32 -- common/autotest_common.sh@897 -- # local bdev_name=eee0199a-591f-4a60-9196-c68f8f8e1eba 00:14:52.266 03:31:32 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:14:52.266 03:31:32 -- common/autotest_common.sh@899 -- # local i 00:14:52.266 03:31:32 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:14:52.266 03:31:32 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:14:52.266 03:31:32 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:14:52.525 03:31:33 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b eee0199a-591f-4a60-9196-c68f8f8e1eba -t 2000 00:14:52.786 [ 00:14:52.786 { 00:14:52.786 "name": "eee0199a-591f-4a60-9196-c68f8f8e1eba", 00:14:52.786 "aliases": [ 00:14:52.786 "lvs/lvol" 00:14:52.786 ], 00:14:52.786 "product_name": "Logical Volume", 00:14:52.786 "block_size": 4096, 00:14:52.786 "num_blocks": 38912, 00:14:52.786 "uuid": "eee0199a-591f-4a60-9196-c68f8f8e1eba", 00:14:52.786 "assigned_rate_limits": { 00:14:52.786 "rw_ios_per_sec": 0, 00:14:52.786 "rw_mbytes_per_sec": 0, 00:14:52.786 "r_mbytes_per_sec": 0, 00:14:52.786 "w_mbytes_per_sec": 0 00:14:52.786 }, 00:14:52.786 "claimed": false, 00:14:52.786 "zoned": false, 00:14:52.786 "supported_io_types": { 00:14:52.786 "read": true, 00:14:52.786 "write": true, 00:14:52.786 "unmap": true, 00:14:52.786 "write_zeroes": true, 00:14:52.786 "flush": false, 00:14:52.786 "reset": true, 00:14:52.786 "compare": false, 00:14:52.786 "compare_and_write": false, 00:14:52.786 "abort": false, 00:14:52.786 "nvme_admin": false, 00:14:52.786 "nvme_io": false 00:14:52.786 }, 00:14:52.786 "driver_specific": { 00:14:52.786 "lvol": { 00:14:52.786 "lvol_store_uuid": "802c5a53-ea07-45b5-b577-f674b1068ed2", 00:14:52.786 "base_bdev": "aio_bdev", 00:14:52.786 "thin_provision": false, 00:14:52.786 "snapshot": false, 00:14:52.786 "clone": false, 00:14:52.786 "esnap_clone": false 00:14:52.786 } 00:14:52.786 } 00:14:52.786 } 00:14:52.786 ] 00:14:52.786 03:31:33 -- common/autotest_common.sh@905 -- # return 0 00:14:52.786 03:31:33 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 802c5a53-ea07-45b5-b577-f674b1068ed2 00:14:52.786 03:31:33 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:14:53.044 03:31:33 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:14:53.044 03:31:33 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 802c5a53-ea07-45b5-b577-f674b1068ed2 00:14:53.044 03:31:33 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:14:53.302 03:31:33 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:14:53.302 03:31:33 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete eee0199a-591f-4a60-9196-c68f8f8e1eba 00:14:53.560 03:31:34 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 802c5a53-ea07-45b5-b577-f674b1068ed2 00:14:53.818 03:31:34 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:14:54.435 03:31:34 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:54.435 00:14:54.435 real 0m17.910s 00:14:54.435 user 0m17.612s 00:14:54.435 sys 0m1.815s 00:14:54.435 03:31:34 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:54.435 03:31:34 -- common/autotest_common.sh@10 -- # set +x 00:14:54.435 ************************************ 00:14:54.435 END TEST lvs_grow_clean 00:14:54.435 ************************************ 00:14:54.435 03:31:34 -- target/nvmf_lvs_grow.sh@102 -- # run_test lvs_grow_dirty lvs_grow dirty 00:14:54.435 03:31:34 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:54.435 03:31:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:54.435 03:31:34 -- common/autotest_common.sh@10 -- # set +x 00:14:54.436 ************************************ 00:14:54.436 START TEST lvs_grow_dirty 00:14:54.436 ************************************ 00:14:54.436 03:31:34 -- common/autotest_common.sh@1114 -- # lvs_grow dirty 00:14:54.436 03:31:34 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:14:54.436 03:31:34 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:14:54.436 03:31:34 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:14:54.436 03:31:34 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:14:54.436 03:31:34 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:14:54.436 03:31:34 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:14:54.436 03:31:34 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:54.436 03:31:34 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:54.436 03:31:34 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:14:54.721 03:31:35 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:14:54.721 03:31:35 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:14:54.981 03:31:35 -- target/nvmf_lvs_grow.sh@28 -- # lvs=e1695a02-c509-4828-a891-d7b6753e9889 00:14:54.981 03:31:35 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e1695a02-c509-4828-a891-d7b6753e9889 00:14:54.981 03:31:35 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:14:54.981 03:31:35 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:14:54.981 03:31:35 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:14:54.981 03:31:35 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u e1695a02-c509-4828-a891-d7b6753e9889 lvol 150 00:14:55.548 03:31:35 -- target/nvmf_lvs_grow.sh@33 -- # lvol=7514b074-3078-41d1-83aa-28b664cd7609 00:14:55.548 03:31:35 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:55.548 03:31:35 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:14:55.548 [2024-11-21 03:31:36.150505] bdev_aio.c: 959:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:14:55.548 [2024-11-21 03:31:36.150586] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:14:55.548 true 00:14:55.548 03:31:36 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e1695a02-c509-4828-a891-d7b6753e9889 00:14:55.548 03:31:36 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:14:56.118 03:31:36 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:14:56.118 03:31:36 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:14:56.118 03:31:36 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 7514b074-3078-41d1-83aa-28b664cd7609 00:14:56.377 03:31:37 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:14:56.635 03:31:37 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:14:56.894 03:31:37 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=3037192 00:14:56.894 03:31:37 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:14:56.894 03:31:37 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:14:56.894 03:31:37 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 3037192 /var/tmp/bdevperf.sock 00:14:56.894 03:31:37 -- common/autotest_common.sh@829 -- # '[' -z 3037192 ']' 00:14:56.894 03:31:37 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:14:56.894 03:31:37 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:56.894 03:31:37 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:14:56.894 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:14:56.894 03:31:37 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:56.894 03:31:37 -- common/autotest_common.sh@10 -- # set +x 00:14:57.155 [2024-11-21 03:31:37.542795] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:57.155 [2024-11-21 03:31:37.542866] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3037192 ] 00:14:57.155 EAL: No free 2048 kB hugepages reported on node 1 00:14:57.155 [2024-11-21 03:31:37.603990] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:57.155 [2024-11-21 03:31:37.717492] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:58.089 03:31:38 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:58.089 03:31:38 -- common/autotest_common.sh@862 -- # return 0 00:14:58.089 03:31:38 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:14:58.347 Nvme0n1 00:14:58.347 03:31:38 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:14:58.606 [ 00:14:58.606 { 00:14:58.606 "name": "Nvme0n1", 00:14:58.606 "aliases": [ 00:14:58.606 "7514b074-3078-41d1-83aa-28b664cd7609" 00:14:58.606 ], 00:14:58.606 "product_name": "NVMe disk", 00:14:58.606 "block_size": 4096, 00:14:58.606 "num_blocks": 38912, 00:14:58.606 "uuid": "7514b074-3078-41d1-83aa-28b664cd7609", 00:14:58.606 "assigned_rate_limits": { 00:14:58.606 "rw_ios_per_sec": 0, 00:14:58.606 "rw_mbytes_per_sec": 0, 00:14:58.606 "r_mbytes_per_sec": 0, 00:14:58.606 "w_mbytes_per_sec": 0 00:14:58.606 }, 00:14:58.606 "claimed": false, 00:14:58.606 "zoned": false, 00:14:58.606 "supported_io_types": { 00:14:58.606 "read": true, 00:14:58.606 "write": true, 00:14:58.606 "unmap": true, 00:14:58.606 "write_zeroes": true, 00:14:58.606 "flush": true, 00:14:58.606 "reset": true, 00:14:58.606 "compare": true, 00:14:58.606 "compare_and_write": true, 00:14:58.606 "abort": true, 00:14:58.606 "nvme_admin": true, 00:14:58.606 "nvme_io": true 00:14:58.606 }, 00:14:58.606 "driver_specific": { 00:14:58.606 "nvme": [ 00:14:58.606 { 00:14:58.606 "trid": { 00:14:58.606 "trtype": "TCP", 00:14:58.606 "adrfam": "IPv4", 00:14:58.606 "traddr": "10.0.0.2", 00:14:58.606 "trsvcid": "4420", 00:14:58.606 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:14:58.606 }, 00:14:58.606 "ctrlr_data": { 00:14:58.606 "cntlid": 1, 00:14:58.606 "vendor_id": "0x8086", 00:14:58.606 "model_number": "SPDK bdev Controller", 00:14:58.606 "serial_number": "SPDK0", 00:14:58.606 "firmware_revision": "24.01.1", 00:14:58.606 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:14:58.606 "oacs": { 00:14:58.606 "security": 0, 00:14:58.606 "format": 0, 00:14:58.606 "firmware": 0, 00:14:58.606 "ns_manage": 0 00:14:58.606 }, 00:14:58.606 "multi_ctrlr": true, 00:14:58.606 "ana_reporting": false 00:14:58.606 }, 00:14:58.606 "vs": { 00:14:58.606 "nvme_version": "1.3" 00:14:58.606 }, 00:14:58.606 "ns_data": { 00:14:58.606 "id": 1, 00:14:58.606 "can_share": true 00:14:58.606 } 00:14:58.606 } 00:14:58.606 ], 00:14:58.606 "mp_policy": "active_passive" 00:14:58.606 } 00:14:58.606 } 00:14:58.606 ] 00:14:58.606 03:31:39 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=3037464 00:14:58.606 03:31:39 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:14:58.606 03:31:39 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:14:58.865 Running I/O for 10 seconds... 00:14:59.803 Latency(us) 00:14:59.803 [2024-11-21T02:31:40.451Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:59.803 [2024-11-21T02:31:40.451Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:59.803 Nvme0n1 : 1.00 14633.00 57.16 0.00 0.00 0.00 0.00 0.00 00:14:59.803 [2024-11-21T02:31:40.451Z] =================================================================================================================== 00:14:59.803 [2024-11-21T02:31:40.451Z] Total : 14633.00 57.16 0.00 0.00 0.00 0.00 0.00 00:14:59.803 00:15:00.742 03:31:41 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u e1695a02-c509-4828-a891-d7b6753e9889 00:15:00.742 [2024-11-21T02:31:41.390Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:00.742 Nvme0n1 : 2.00 14790.00 57.77 0.00 0.00 0.00 0.00 0.00 00:15:00.742 [2024-11-21T02:31:41.390Z] =================================================================================================================== 00:15:00.742 [2024-11-21T02:31:41.390Z] Total : 14790.00 57.77 0.00 0.00 0.00 0.00 0.00 00:15:00.742 00:15:01.001 true 00:15:01.001 03:31:41 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e1695a02-c509-4828-a891-d7b6753e9889 00:15:01.001 03:31:41 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:15:01.260 03:31:41 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:15:01.260 03:31:41 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:15:01.260 03:31:41 -- target/nvmf_lvs_grow.sh@65 -- # wait 3037464 00:15:01.827 [2024-11-21T02:31:42.475Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:01.827 Nvme0n1 : 3.00 15032.33 58.72 0.00 0.00 0.00 0.00 0.00 00:15:01.827 [2024-11-21T02:31:42.475Z] =================================================================================================================== 00:15:01.827 [2024-11-21T02:31:42.475Z] Total : 15032.33 58.72 0.00 0.00 0.00 0.00 0.00 00:15:01.827 00:15:02.766 [2024-11-21T02:31:43.414Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:02.766 Nvme0n1 : 4.00 15066.25 58.85 0.00 0.00 0.00 0.00 0.00 00:15:02.766 [2024-11-21T02:31:43.414Z] =================================================================================================================== 00:15:02.766 [2024-11-21T02:31:43.414Z] Total : 15066.25 58.85 0.00 0.00 0.00 0.00 0.00 00:15:02.766 00:15:04.146 [2024-11-21T02:31:44.794Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:04.146 Nvme0n1 : 5.00 15108.20 59.02 0.00 0.00 0.00 0.00 0.00 00:15:04.146 [2024-11-21T02:31:44.794Z] =================================================================================================================== 00:15:04.146 [2024-11-21T02:31:44.794Z] Total : 15108.20 59.02 0.00 0.00 0.00 0.00 0.00 00:15:04.146 00:15:05.087 [2024-11-21T02:31:45.735Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:05.087 Nvme0n1 : 6.00 15200.17 59.38 0.00 0.00 0.00 0.00 0.00 00:15:05.087 [2024-11-21T02:31:45.735Z] =================================================================================================================== 00:15:05.087 [2024-11-21T02:31:45.735Z] Total : 15200.17 59.38 0.00 0.00 0.00 0.00 0.00 00:15:05.087 00:15:06.024 [2024-11-21T02:31:46.672Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:06.024 Nvme0n1 : 7.00 15227.57 59.48 0.00 0.00 0.00 0.00 0.00 00:15:06.024 [2024-11-21T02:31:46.672Z] =================================================================================================================== 00:15:06.024 [2024-11-21T02:31:46.672Z] Total : 15227.57 59.48 0.00 0.00 0.00 0.00 0.00 00:15:06.024 00:15:06.964 [2024-11-21T02:31:47.612Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:06.964 Nvme0n1 : 8.00 15249.75 59.57 0.00 0.00 0.00 0.00 0.00 00:15:06.964 [2024-11-21T02:31:47.612Z] =================================================================================================================== 00:15:06.964 [2024-11-21T02:31:47.612Z] Total : 15249.75 59.57 0.00 0.00 0.00 0.00 0.00 00:15:06.964 00:15:07.901 [2024-11-21T02:31:48.549Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:07.901 Nvme0n1 : 9.00 15281.33 59.69 0.00 0.00 0.00 0.00 0.00 00:15:07.901 [2024-11-21T02:31:48.549Z] =================================================================================================================== 00:15:07.901 [2024-11-21T02:31:48.549Z] Total : 15281.33 59.69 0.00 0.00 0.00 0.00 0.00 00:15:07.901 00:15:08.840 [2024-11-21T02:31:49.488Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:08.840 Nvme0n1 : 10.00 15300.70 59.77 0.00 0.00 0.00 0.00 0.00 00:15:08.841 [2024-11-21T02:31:49.489Z] =================================================================================================================== 00:15:08.841 [2024-11-21T02:31:49.489Z] Total : 15300.70 59.77 0.00 0.00 0.00 0.00 0.00 00:15:08.841 00:15:08.841 00:15:08.841 Latency(us) 00:15:08.841 [2024-11-21T02:31:49.489Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:08.841 [2024-11-21T02:31:49.489Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:08.841 Nvme0n1 : 10.01 15303.99 59.78 0.00 0.00 8358.87 2463.67 16117.00 00:15:08.841 [2024-11-21T02:31:49.489Z] =================================================================================================================== 00:15:08.841 [2024-11-21T02:31:49.489Z] Total : 15303.99 59.78 0.00 0.00 8358.87 2463.67 16117.00 00:15:08.841 0 00:15:08.841 03:31:49 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 3037192 00:15:08.841 03:31:49 -- common/autotest_common.sh@936 -- # '[' -z 3037192 ']' 00:15:08.841 03:31:49 -- common/autotest_common.sh@940 -- # kill -0 3037192 00:15:08.841 03:31:49 -- common/autotest_common.sh@941 -- # uname 00:15:08.841 03:31:49 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:08.841 03:31:49 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3037192 00:15:08.841 03:31:49 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:15:08.841 03:31:49 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:15:08.841 03:31:49 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3037192' 00:15:08.841 killing process with pid 3037192 00:15:08.841 03:31:49 -- common/autotest_common.sh@955 -- # kill 3037192 00:15:08.841 Received shutdown signal, test time was about 10.000000 seconds 00:15:08.841 00:15:08.841 Latency(us) 00:15:08.841 [2024-11-21T02:31:49.489Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:08.841 [2024-11-21T02:31:49.489Z] =================================================================================================================== 00:15:08.841 [2024-11-21T02:31:49.489Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:15:08.841 03:31:49 -- common/autotest_common.sh@960 -- # wait 3037192 00:15:09.099 03:31:49 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:15:09.667 03:31:50 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e1695a02-c509-4828-a891-d7b6753e9889 00:15:09.667 03:31:50 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:15:09.667 03:31:50 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:15:09.667 03:31:50 -- target/nvmf_lvs_grow.sh@71 -- # [[ dirty == \d\i\r\t\y ]] 00:15:09.667 03:31:50 -- target/nvmf_lvs_grow.sh@73 -- # kill -9 3034488 00:15:09.667 03:31:50 -- target/nvmf_lvs_grow.sh@74 -- # wait 3034488 00:15:09.924 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh: line 74: 3034488 Killed "${NVMF_APP[@]}" "$@" 00:15:09.924 03:31:50 -- target/nvmf_lvs_grow.sh@74 -- # true 00:15:09.924 03:31:50 -- target/nvmf_lvs_grow.sh@75 -- # nvmfappstart -m 0x1 00:15:09.924 03:31:50 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:09.924 03:31:50 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:09.924 03:31:50 -- common/autotest_common.sh@10 -- # set +x 00:15:09.924 03:31:50 -- nvmf/common.sh@469 -- # nvmfpid=3038714 00:15:09.924 03:31:50 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:15:09.924 03:31:50 -- nvmf/common.sh@470 -- # waitforlisten 3038714 00:15:09.924 03:31:50 -- common/autotest_common.sh@829 -- # '[' -z 3038714 ']' 00:15:09.924 03:31:50 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:09.924 03:31:50 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:09.924 03:31:50 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:09.924 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:09.924 03:31:50 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:09.924 03:31:50 -- common/autotest_common.sh@10 -- # set +x 00:15:09.924 [2024-11-21 03:31:50.374998] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:09.924 [2024-11-21 03:31:50.375117] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:09.924 EAL: No free 2048 kB hugepages reported on node 1 00:15:09.924 [2024-11-21 03:31:50.444482] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:09.924 [2024-11-21 03:31:50.565221] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:09.924 [2024-11-21 03:31:50.565386] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:09.924 [2024-11-21 03:31:50.565407] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:09.924 [2024-11-21 03:31:50.565421] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:09.924 [2024-11-21 03:31:50.565462] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:10.862 03:31:51 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:10.862 03:31:51 -- common/autotest_common.sh@862 -- # return 0 00:15:10.862 03:31:51 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:10.862 03:31:51 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:10.862 03:31:51 -- common/autotest_common.sh@10 -- # set +x 00:15:10.862 03:31:51 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:10.862 03:31:51 -- target/nvmf_lvs_grow.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:15:11.120 [2024-11-21 03:31:51.689312] blobstore.c:4642:bs_recover: *NOTICE*: Performing recovery on blobstore 00:15:11.120 [2024-11-21 03:31:51.689480] blobstore.c:4589:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x0 00:15:11.120 [2024-11-21 03:31:51.689541] blobstore.c:4589:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x1 00:15:11.120 03:31:51 -- target/nvmf_lvs_grow.sh@76 -- # aio_bdev=aio_bdev 00:15:11.120 03:31:51 -- target/nvmf_lvs_grow.sh@77 -- # waitforbdev 7514b074-3078-41d1-83aa-28b664cd7609 00:15:11.120 03:31:51 -- common/autotest_common.sh@897 -- # local bdev_name=7514b074-3078-41d1-83aa-28b664cd7609 00:15:11.120 03:31:51 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:15:11.120 03:31:51 -- common/autotest_common.sh@899 -- # local i 00:15:11.120 03:31:51 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:15:11.120 03:31:51 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:15:11.120 03:31:51 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:15:11.379 03:31:51 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 7514b074-3078-41d1-83aa-28b664cd7609 -t 2000 00:15:11.637 [ 00:15:11.637 { 00:15:11.637 "name": "7514b074-3078-41d1-83aa-28b664cd7609", 00:15:11.637 "aliases": [ 00:15:11.637 "lvs/lvol" 00:15:11.637 ], 00:15:11.637 "product_name": "Logical Volume", 00:15:11.637 "block_size": 4096, 00:15:11.637 "num_blocks": 38912, 00:15:11.637 "uuid": "7514b074-3078-41d1-83aa-28b664cd7609", 00:15:11.637 "assigned_rate_limits": { 00:15:11.637 "rw_ios_per_sec": 0, 00:15:11.637 "rw_mbytes_per_sec": 0, 00:15:11.637 "r_mbytes_per_sec": 0, 00:15:11.637 "w_mbytes_per_sec": 0 00:15:11.638 }, 00:15:11.638 "claimed": false, 00:15:11.638 "zoned": false, 00:15:11.638 "supported_io_types": { 00:15:11.638 "read": true, 00:15:11.638 "write": true, 00:15:11.638 "unmap": true, 00:15:11.638 "write_zeroes": true, 00:15:11.638 "flush": false, 00:15:11.638 "reset": true, 00:15:11.638 "compare": false, 00:15:11.638 "compare_and_write": false, 00:15:11.638 "abort": false, 00:15:11.638 "nvme_admin": false, 00:15:11.638 "nvme_io": false 00:15:11.638 }, 00:15:11.638 "driver_specific": { 00:15:11.638 "lvol": { 00:15:11.638 "lvol_store_uuid": "e1695a02-c509-4828-a891-d7b6753e9889", 00:15:11.638 "base_bdev": "aio_bdev", 00:15:11.638 "thin_provision": false, 00:15:11.638 "snapshot": false, 00:15:11.638 "clone": false, 00:15:11.638 "esnap_clone": false 00:15:11.638 } 00:15:11.638 } 00:15:11.638 } 00:15:11.638 ] 00:15:11.638 03:31:52 -- common/autotest_common.sh@905 -- # return 0 00:15:11.638 03:31:52 -- target/nvmf_lvs_grow.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e1695a02-c509-4828-a891-d7b6753e9889 00:15:11.638 03:31:52 -- target/nvmf_lvs_grow.sh@78 -- # jq -r '.[0].free_clusters' 00:15:11.896 03:31:52 -- target/nvmf_lvs_grow.sh@78 -- # (( free_clusters == 61 )) 00:15:11.896 03:31:52 -- target/nvmf_lvs_grow.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e1695a02-c509-4828-a891-d7b6753e9889 00:15:11.896 03:31:52 -- target/nvmf_lvs_grow.sh@79 -- # jq -r '.[0].total_data_clusters' 00:15:12.154 03:31:52 -- target/nvmf_lvs_grow.sh@79 -- # (( data_clusters == 99 )) 00:15:12.154 03:31:52 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:15:12.415 [2024-11-21 03:31:53.006323] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:15:12.415 03:31:53 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e1695a02-c509-4828-a891-d7b6753e9889 00:15:12.415 03:31:53 -- common/autotest_common.sh@650 -- # local es=0 00:15:12.415 03:31:53 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e1695a02-c509-4828-a891-d7b6753e9889 00:15:12.415 03:31:53 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:12.415 03:31:53 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:12.415 03:31:53 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:12.415 03:31:53 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:12.415 03:31:53 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:12.415 03:31:53 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:12.415 03:31:53 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:12.415 03:31:53 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:15:12.415 03:31:53 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e1695a02-c509-4828-a891-d7b6753e9889 00:15:12.673 request: 00:15:12.673 { 00:15:12.673 "uuid": "e1695a02-c509-4828-a891-d7b6753e9889", 00:15:12.673 "method": "bdev_lvol_get_lvstores", 00:15:12.673 "req_id": 1 00:15:12.673 } 00:15:12.673 Got JSON-RPC error response 00:15:12.673 response: 00:15:12.673 { 00:15:12.673 "code": -19, 00:15:12.673 "message": "No such device" 00:15:12.673 } 00:15:12.931 03:31:53 -- common/autotest_common.sh@653 -- # es=1 00:15:12.931 03:31:53 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:15:12.931 03:31:53 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:15:12.931 03:31:53 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:15:12.931 03:31:53 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:15:12.931 aio_bdev 00:15:13.189 03:31:53 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev 7514b074-3078-41d1-83aa-28b664cd7609 00:15:13.189 03:31:53 -- common/autotest_common.sh@897 -- # local bdev_name=7514b074-3078-41d1-83aa-28b664cd7609 00:15:13.189 03:31:53 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:15:13.189 03:31:53 -- common/autotest_common.sh@899 -- # local i 00:15:13.189 03:31:53 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:15:13.189 03:31:53 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:15:13.189 03:31:53 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:15:13.449 03:31:53 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 7514b074-3078-41d1-83aa-28b664cd7609 -t 2000 00:15:13.709 [ 00:15:13.709 { 00:15:13.709 "name": "7514b074-3078-41d1-83aa-28b664cd7609", 00:15:13.709 "aliases": [ 00:15:13.709 "lvs/lvol" 00:15:13.709 ], 00:15:13.709 "product_name": "Logical Volume", 00:15:13.709 "block_size": 4096, 00:15:13.709 "num_blocks": 38912, 00:15:13.709 "uuid": "7514b074-3078-41d1-83aa-28b664cd7609", 00:15:13.709 "assigned_rate_limits": { 00:15:13.709 "rw_ios_per_sec": 0, 00:15:13.709 "rw_mbytes_per_sec": 0, 00:15:13.709 "r_mbytes_per_sec": 0, 00:15:13.709 "w_mbytes_per_sec": 0 00:15:13.709 }, 00:15:13.709 "claimed": false, 00:15:13.709 "zoned": false, 00:15:13.709 "supported_io_types": { 00:15:13.709 "read": true, 00:15:13.709 "write": true, 00:15:13.709 "unmap": true, 00:15:13.709 "write_zeroes": true, 00:15:13.709 "flush": false, 00:15:13.709 "reset": true, 00:15:13.709 "compare": false, 00:15:13.709 "compare_and_write": false, 00:15:13.709 "abort": false, 00:15:13.709 "nvme_admin": false, 00:15:13.709 "nvme_io": false 00:15:13.709 }, 00:15:13.709 "driver_specific": { 00:15:13.709 "lvol": { 00:15:13.709 "lvol_store_uuid": "e1695a02-c509-4828-a891-d7b6753e9889", 00:15:13.709 "base_bdev": "aio_bdev", 00:15:13.709 "thin_provision": false, 00:15:13.709 "snapshot": false, 00:15:13.709 "clone": false, 00:15:13.709 "esnap_clone": false 00:15:13.709 } 00:15:13.709 } 00:15:13.709 } 00:15:13.709 ] 00:15:13.709 03:31:54 -- common/autotest_common.sh@905 -- # return 0 00:15:13.709 03:31:54 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e1695a02-c509-4828-a891-d7b6753e9889 00:15:13.709 03:31:54 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:15:13.967 03:31:54 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:15:13.967 03:31:54 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e1695a02-c509-4828-a891-d7b6753e9889 00:15:13.967 03:31:54 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:15:14.227 03:31:54 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:15:14.227 03:31:54 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 7514b074-3078-41d1-83aa-28b664cd7609 00:15:14.485 03:31:54 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u e1695a02-c509-4828-a891-d7b6753e9889 00:15:14.744 03:31:55 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:15:15.004 03:31:55 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:15:15.004 00:15:15.004 real 0m20.742s 00:15:15.004 user 0m51.402s 00:15:15.004 sys 0m4.802s 00:15:15.004 03:31:55 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:15.004 03:31:55 -- common/autotest_common.sh@10 -- # set +x 00:15:15.004 ************************************ 00:15:15.004 END TEST lvs_grow_dirty 00:15:15.004 ************************************ 00:15:15.004 03:31:55 -- target/nvmf_lvs_grow.sh@1 -- # process_shm --id 0 00:15:15.005 03:31:55 -- common/autotest_common.sh@806 -- # type=--id 00:15:15.005 03:31:55 -- common/autotest_common.sh@807 -- # id=0 00:15:15.005 03:31:55 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:15:15.005 03:31:55 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:15:15.005 03:31:55 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:15:15.005 03:31:55 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:15:15.005 03:31:55 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:15:15.005 03:31:55 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:15:15.005 nvmf_trace.0 00:15:15.005 03:31:55 -- common/autotest_common.sh@821 -- # return 0 00:15:15.005 03:31:55 -- target/nvmf_lvs_grow.sh@1 -- # nvmftestfini 00:15:15.005 03:31:55 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:15.005 03:31:55 -- nvmf/common.sh@116 -- # sync 00:15:15.005 03:31:55 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:15.005 03:31:55 -- nvmf/common.sh@119 -- # set +e 00:15:15.005 03:31:55 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:15.005 03:31:55 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:15.005 rmmod nvme_tcp 00:15:15.005 rmmod nvme_fabrics 00:15:15.005 rmmod nvme_keyring 00:15:15.005 03:31:55 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:15.005 03:31:55 -- nvmf/common.sh@123 -- # set -e 00:15:15.005 03:31:55 -- nvmf/common.sh@124 -- # return 0 00:15:15.005 03:31:55 -- nvmf/common.sh@477 -- # '[' -n 3038714 ']' 00:15:15.005 03:31:55 -- nvmf/common.sh@478 -- # killprocess 3038714 00:15:15.005 03:31:55 -- common/autotest_common.sh@936 -- # '[' -z 3038714 ']' 00:15:15.005 03:31:55 -- common/autotest_common.sh@940 -- # kill -0 3038714 00:15:15.005 03:31:55 -- common/autotest_common.sh@941 -- # uname 00:15:15.005 03:31:55 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:15.005 03:31:55 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3038714 00:15:15.265 03:31:55 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:15:15.265 03:31:55 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:15:15.265 03:31:55 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3038714' 00:15:15.265 killing process with pid 3038714 00:15:15.265 03:31:55 -- common/autotest_common.sh@955 -- # kill 3038714 00:15:15.265 03:31:55 -- common/autotest_common.sh@960 -- # wait 3038714 00:15:15.525 03:31:55 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:15.525 03:31:55 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:15.525 03:31:55 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:15.525 03:31:55 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:15.525 03:31:55 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:15.525 03:31:55 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:15.525 03:31:55 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:15.525 03:31:55 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:17.433 03:31:57 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:17.433 00:15:17.433 real 0m44.927s 00:15:17.433 user 1m16.078s 00:15:17.433 sys 0m8.610s 00:15:17.433 03:31:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:17.433 03:31:57 -- common/autotest_common.sh@10 -- # set +x 00:15:17.433 ************************************ 00:15:17.433 END TEST nvmf_lvs_grow 00:15:17.433 ************************************ 00:15:17.433 03:31:58 -- nvmf/nvmf.sh@49 -- # run_test nvmf_bdev_io_wait /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:15:17.433 03:31:58 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:17.433 03:31:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:17.433 03:31:58 -- common/autotest_common.sh@10 -- # set +x 00:15:17.433 ************************************ 00:15:17.433 START TEST nvmf_bdev_io_wait 00:15:17.433 ************************************ 00:15:17.433 03:31:58 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:15:17.433 * Looking for test storage... 00:15:17.433 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:17.433 03:31:58 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:17.433 03:31:58 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:17.433 03:31:58 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:17.692 03:31:58 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:17.692 03:31:58 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:17.692 03:31:58 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:17.692 03:31:58 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:17.692 03:31:58 -- scripts/common.sh@335 -- # IFS=.-: 00:15:17.692 03:31:58 -- scripts/common.sh@335 -- # read -ra ver1 00:15:17.692 03:31:58 -- scripts/common.sh@336 -- # IFS=.-: 00:15:17.692 03:31:58 -- scripts/common.sh@336 -- # read -ra ver2 00:15:17.692 03:31:58 -- scripts/common.sh@337 -- # local 'op=<' 00:15:17.692 03:31:58 -- scripts/common.sh@339 -- # ver1_l=2 00:15:17.692 03:31:58 -- scripts/common.sh@340 -- # ver2_l=1 00:15:17.692 03:31:58 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:17.692 03:31:58 -- scripts/common.sh@343 -- # case "$op" in 00:15:17.692 03:31:58 -- scripts/common.sh@344 -- # : 1 00:15:17.692 03:31:58 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:17.692 03:31:58 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:17.692 03:31:58 -- scripts/common.sh@364 -- # decimal 1 00:15:17.692 03:31:58 -- scripts/common.sh@352 -- # local d=1 00:15:17.692 03:31:58 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:17.692 03:31:58 -- scripts/common.sh@354 -- # echo 1 00:15:17.692 03:31:58 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:17.692 03:31:58 -- scripts/common.sh@365 -- # decimal 2 00:15:17.692 03:31:58 -- scripts/common.sh@352 -- # local d=2 00:15:17.692 03:31:58 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:17.692 03:31:58 -- scripts/common.sh@354 -- # echo 2 00:15:17.692 03:31:58 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:17.692 03:31:58 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:17.692 03:31:58 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:17.692 03:31:58 -- scripts/common.sh@367 -- # return 0 00:15:17.692 03:31:58 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:17.692 03:31:58 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:17.692 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:17.692 --rc genhtml_branch_coverage=1 00:15:17.692 --rc genhtml_function_coverage=1 00:15:17.692 --rc genhtml_legend=1 00:15:17.692 --rc geninfo_all_blocks=1 00:15:17.692 --rc geninfo_unexecuted_blocks=1 00:15:17.692 00:15:17.692 ' 00:15:17.692 03:31:58 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:17.692 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:17.692 --rc genhtml_branch_coverage=1 00:15:17.692 --rc genhtml_function_coverage=1 00:15:17.692 --rc genhtml_legend=1 00:15:17.692 --rc geninfo_all_blocks=1 00:15:17.692 --rc geninfo_unexecuted_blocks=1 00:15:17.692 00:15:17.692 ' 00:15:17.693 03:31:58 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:17.693 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:17.693 --rc genhtml_branch_coverage=1 00:15:17.693 --rc genhtml_function_coverage=1 00:15:17.693 --rc genhtml_legend=1 00:15:17.693 --rc geninfo_all_blocks=1 00:15:17.693 --rc geninfo_unexecuted_blocks=1 00:15:17.693 00:15:17.693 ' 00:15:17.693 03:31:58 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:17.693 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:17.693 --rc genhtml_branch_coverage=1 00:15:17.693 --rc genhtml_function_coverage=1 00:15:17.693 --rc genhtml_legend=1 00:15:17.693 --rc geninfo_all_blocks=1 00:15:17.693 --rc geninfo_unexecuted_blocks=1 00:15:17.693 00:15:17.693 ' 00:15:17.693 03:31:58 -- target/bdev_io_wait.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:17.693 03:31:58 -- nvmf/common.sh@7 -- # uname -s 00:15:17.693 03:31:58 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:17.693 03:31:58 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:17.693 03:31:58 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:17.693 03:31:58 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:17.693 03:31:58 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:17.693 03:31:58 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:17.693 03:31:58 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:17.693 03:31:58 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:17.693 03:31:58 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:17.693 03:31:58 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:17.693 03:31:58 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:17.693 03:31:58 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:17.693 03:31:58 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:17.693 03:31:58 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:17.693 03:31:58 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:17.693 03:31:58 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:17.693 03:31:58 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:17.693 03:31:58 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:17.693 03:31:58 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:17.693 03:31:58 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:17.693 03:31:58 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:17.693 03:31:58 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:17.693 03:31:58 -- paths/export.sh@5 -- # export PATH 00:15:17.693 03:31:58 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:17.693 03:31:58 -- nvmf/common.sh@46 -- # : 0 00:15:17.693 03:31:58 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:17.693 03:31:58 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:17.693 03:31:58 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:17.693 03:31:58 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:17.693 03:31:58 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:17.693 03:31:58 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:17.693 03:31:58 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:17.693 03:31:58 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:17.693 03:31:58 -- target/bdev_io_wait.sh@11 -- # MALLOC_BDEV_SIZE=64 00:15:17.693 03:31:58 -- target/bdev_io_wait.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:15:17.693 03:31:58 -- target/bdev_io_wait.sh@14 -- # nvmftestinit 00:15:17.693 03:31:58 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:17.693 03:31:58 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:17.693 03:31:58 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:17.693 03:31:58 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:17.693 03:31:58 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:17.693 03:31:58 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:17.693 03:31:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:17.693 03:31:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:17.693 03:31:58 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:17.693 03:31:58 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:17.693 03:31:58 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:17.693 03:31:58 -- common/autotest_common.sh@10 -- # set +x 00:15:19.602 03:32:00 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:19.602 03:32:00 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:19.602 03:32:00 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:19.602 03:32:00 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:19.602 03:32:00 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:19.602 03:32:00 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:19.602 03:32:00 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:19.602 03:32:00 -- nvmf/common.sh@294 -- # net_devs=() 00:15:19.602 03:32:00 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:19.602 03:32:00 -- nvmf/common.sh@295 -- # e810=() 00:15:19.602 03:32:00 -- nvmf/common.sh@295 -- # local -ga e810 00:15:19.602 03:32:00 -- nvmf/common.sh@296 -- # x722=() 00:15:19.602 03:32:00 -- nvmf/common.sh@296 -- # local -ga x722 00:15:19.602 03:32:00 -- nvmf/common.sh@297 -- # mlx=() 00:15:19.602 03:32:00 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:19.602 03:32:00 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:19.602 03:32:00 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:19.602 03:32:00 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:19.602 03:32:00 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:19.602 03:32:00 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:19.602 03:32:00 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:19.602 03:32:00 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:19.602 03:32:00 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:19.602 03:32:00 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:19.602 03:32:00 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:19.602 03:32:00 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:19.602 03:32:00 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:19.602 03:32:00 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:19.602 03:32:00 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:19.602 03:32:00 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:19.602 03:32:00 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:19.602 03:32:00 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:19.602 03:32:00 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:19.602 03:32:00 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:19.602 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:19.602 03:32:00 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:19.602 03:32:00 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:19.602 03:32:00 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:19.602 03:32:00 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:19.602 03:32:00 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:19.602 03:32:00 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:19.602 03:32:00 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:19.602 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:19.602 03:32:00 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:19.602 03:32:00 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:19.602 03:32:00 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:19.602 03:32:00 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:19.602 03:32:00 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:19.602 03:32:00 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:19.602 03:32:00 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:19.602 03:32:00 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:19.602 03:32:00 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:19.602 03:32:00 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:19.602 03:32:00 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:19.602 03:32:00 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:19.602 03:32:00 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:19.602 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:19.602 03:32:00 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:19.602 03:32:00 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:19.602 03:32:00 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:19.602 03:32:00 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:19.602 03:32:00 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:19.602 03:32:00 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:19.602 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:19.602 03:32:00 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:19.602 03:32:00 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:19.602 03:32:00 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:19.602 03:32:00 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:19.602 03:32:00 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:19.602 03:32:00 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:19.602 03:32:00 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:19.602 03:32:00 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:19.602 03:32:00 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:19.602 03:32:00 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:19.602 03:32:00 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:19.602 03:32:00 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:19.602 03:32:00 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:19.602 03:32:00 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:19.602 03:32:00 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:19.602 03:32:00 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:19.602 03:32:00 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:19.602 03:32:00 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:19.602 03:32:00 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:19.602 03:32:00 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:19.602 03:32:00 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:19.602 03:32:00 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:19.602 03:32:00 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:19.863 03:32:00 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:19.863 03:32:00 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:19.863 03:32:00 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:19.863 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:19.863 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.356 ms 00:15:19.863 00:15:19.863 --- 10.0.0.2 ping statistics --- 00:15:19.863 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:19.863 rtt min/avg/max/mdev = 0.356/0.356/0.356/0.000 ms 00:15:19.863 03:32:00 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:19.863 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:19.863 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.151 ms 00:15:19.863 00:15:19.863 --- 10.0.0.1 ping statistics --- 00:15:19.863 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:19.863 rtt min/avg/max/mdev = 0.151/0.151/0.151/0.000 ms 00:15:19.863 03:32:00 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:19.863 03:32:00 -- nvmf/common.sh@410 -- # return 0 00:15:19.863 03:32:00 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:19.863 03:32:00 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:19.863 03:32:00 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:19.863 03:32:00 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:19.863 03:32:00 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:19.863 03:32:00 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:19.863 03:32:00 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:19.863 03:32:00 -- target/bdev_io_wait.sh@15 -- # nvmfappstart -m 0xF --wait-for-rpc 00:15:19.863 03:32:00 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:19.863 03:32:00 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:19.863 03:32:00 -- common/autotest_common.sh@10 -- # set +x 00:15:19.863 03:32:00 -- nvmf/common.sh@469 -- # nvmfpid=3041394 00:15:19.863 03:32:00 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:15:19.863 03:32:00 -- nvmf/common.sh@470 -- # waitforlisten 3041394 00:15:19.863 03:32:00 -- common/autotest_common.sh@829 -- # '[' -z 3041394 ']' 00:15:19.863 03:32:00 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:19.863 03:32:00 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:19.863 03:32:00 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:19.863 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:19.863 03:32:00 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:19.863 03:32:00 -- common/autotest_common.sh@10 -- # set +x 00:15:19.863 [2024-11-21 03:32:00.357723] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:19.863 [2024-11-21 03:32:00.357806] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:19.863 EAL: No free 2048 kB hugepages reported on node 1 00:15:19.863 [2024-11-21 03:32:00.425587] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:15:20.122 [2024-11-21 03:32:00.542289] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:20.122 [2024-11-21 03:32:00.542428] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:20.122 [2024-11-21 03:32:00.542444] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:20.122 [2024-11-21 03:32:00.542456] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:20.122 [2024-11-21 03:32:00.542506] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:20.122 [2024-11-21 03:32:00.542566] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:20.122 [2024-11-21 03:32:00.542632] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:15:20.122 [2024-11-21 03:32:00.542635] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:20.122 03:32:00 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:20.122 03:32:00 -- common/autotest_common.sh@862 -- # return 0 00:15:20.122 03:32:00 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:20.122 03:32:00 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:20.122 03:32:00 -- common/autotest_common.sh@10 -- # set +x 00:15:20.122 03:32:00 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:20.122 03:32:00 -- target/bdev_io_wait.sh@18 -- # rpc_cmd bdev_set_options -p 5 -c 1 00:15:20.122 03:32:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:20.122 03:32:00 -- common/autotest_common.sh@10 -- # set +x 00:15:20.122 03:32:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:20.122 03:32:00 -- target/bdev_io_wait.sh@19 -- # rpc_cmd framework_start_init 00:15:20.122 03:32:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:20.122 03:32:00 -- common/autotest_common.sh@10 -- # set +x 00:15:20.122 03:32:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:20.122 03:32:00 -- target/bdev_io_wait.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:20.122 03:32:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:20.122 03:32:00 -- common/autotest_common.sh@10 -- # set +x 00:15:20.122 [2024-11-21 03:32:00.689374] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:20.122 03:32:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:20.122 03:32:00 -- target/bdev_io_wait.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:15:20.122 03:32:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:20.122 03:32:00 -- common/autotest_common.sh@10 -- # set +x 00:15:20.122 Malloc0 00:15:20.122 03:32:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:20.122 03:32:00 -- target/bdev_io_wait.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:15:20.122 03:32:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:20.122 03:32:00 -- common/autotest_common.sh@10 -- # set +x 00:15:20.122 03:32:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:20.122 03:32:00 -- target/bdev_io_wait.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:15:20.122 03:32:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:20.122 03:32:00 -- common/autotest_common.sh@10 -- # set +x 00:15:20.122 03:32:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:20.122 03:32:00 -- target/bdev_io_wait.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:20.122 03:32:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:20.123 03:32:00 -- common/autotest_common.sh@10 -- # set +x 00:15:20.123 [2024-11-21 03:32:00.762495] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:20.123 03:32:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:20.123 03:32:00 -- target/bdev_io_wait.sh@28 -- # WRITE_PID=3041545 00:15:20.123 03:32:00 -- target/bdev_io_wait.sh@27 -- # gen_nvmf_target_json 00:15:20.123 03:32:00 -- target/bdev_io_wait.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x10 -i 1 --json /dev/fd/63 -q 128 -o 4096 -w write -t 1 -s 256 00:15:20.123 03:32:00 -- target/bdev_io_wait.sh@30 -- # READ_PID=3041547 00:15:20.123 03:32:00 -- nvmf/common.sh@520 -- # config=() 00:15:20.123 03:32:00 -- nvmf/common.sh@520 -- # local subsystem config 00:15:20.123 03:32:00 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:20.381 03:32:00 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:20.381 { 00:15:20.381 "params": { 00:15:20.381 "name": "Nvme$subsystem", 00:15:20.381 "trtype": "$TEST_TRANSPORT", 00:15:20.381 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:20.381 "adrfam": "ipv4", 00:15:20.381 "trsvcid": "$NVMF_PORT", 00:15:20.381 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:20.381 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:20.381 "hdgst": ${hdgst:-false}, 00:15:20.381 "ddgst": ${ddgst:-false} 00:15:20.381 }, 00:15:20.381 "method": "bdev_nvme_attach_controller" 00:15:20.381 } 00:15:20.381 EOF 00:15:20.381 )") 00:15:20.381 03:32:00 -- target/bdev_io_wait.sh@29 -- # gen_nvmf_target_json 00:15:20.381 03:32:00 -- target/bdev_io_wait.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x20 -i 2 --json /dev/fd/63 -q 128 -o 4096 -w read -t 1 -s 256 00:15:20.381 03:32:00 -- target/bdev_io_wait.sh@32 -- # FLUSH_PID=3041549 00:15:20.381 03:32:00 -- nvmf/common.sh@520 -- # config=() 00:15:20.381 03:32:00 -- nvmf/common.sh@520 -- # local subsystem config 00:15:20.381 03:32:00 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:20.381 03:32:00 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:20.381 { 00:15:20.381 "params": { 00:15:20.381 "name": "Nvme$subsystem", 00:15:20.381 "trtype": "$TEST_TRANSPORT", 00:15:20.381 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:20.381 "adrfam": "ipv4", 00:15:20.381 "trsvcid": "$NVMF_PORT", 00:15:20.381 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:20.381 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:20.381 "hdgst": ${hdgst:-false}, 00:15:20.381 "ddgst": ${ddgst:-false} 00:15:20.381 }, 00:15:20.381 "method": "bdev_nvme_attach_controller" 00:15:20.381 } 00:15:20.381 EOF 00:15:20.381 )") 00:15:20.381 03:32:00 -- nvmf/common.sh@542 -- # cat 00:15:20.381 03:32:00 -- target/bdev_io_wait.sh@31 -- # gen_nvmf_target_json 00:15:20.381 03:32:00 -- target/bdev_io_wait.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x40 -i 3 --json /dev/fd/63 -q 128 -o 4096 -w flush -t 1 -s 256 00:15:20.381 03:32:00 -- target/bdev_io_wait.sh@34 -- # UNMAP_PID=3041552 00:15:20.381 03:32:00 -- target/bdev_io_wait.sh@35 -- # sync 00:15:20.381 03:32:00 -- nvmf/common.sh@520 -- # config=() 00:15:20.381 03:32:00 -- nvmf/common.sh@520 -- # local subsystem config 00:15:20.381 03:32:00 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:20.381 03:32:00 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:20.381 { 00:15:20.381 "params": { 00:15:20.381 "name": "Nvme$subsystem", 00:15:20.381 "trtype": "$TEST_TRANSPORT", 00:15:20.381 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:20.381 "adrfam": "ipv4", 00:15:20.381 "trsvcid": "$NVMF_PORT", 00:15:20.381 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:20.381 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:20.381 "hdgst": ${hdgst:-false}, 00:15:20.381 "ddgst": ${ddgst:-false} 00:15:20.381 }, 00:15:20.381 "method": "bdev_nvme_attach_controller" 00:15:20.381 } 00:15:20.381 EOF 00:15:20.381 )") 00:15:20.381 03:32:00 -- nvmf/common.sh@542 -- # cat 00:15:20.381 03:32:00 -- target/bdev_io_wait.sh@33 -- # gen_nvmf_target_json 00:15:20.381 03:32:00 -- target/bdev_io_wait.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x80 -i 4 --json /dev/fd/63 -q 128 -o 4096 -w unmap -t 1 -s 256 00:15:20.381 03:32:00 -- nvmf/common.sh@520 -- # config=() 00:15:20.381 03:32:00 -- nvmf/common.sh@520 -- # local subsystem config 00:15:20.381 03:32:00 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:20.381 03:32:00 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:20.381 { 00:15:20.381 "params": { 00:15:20.381 "name": "Nvme$subsystem", 00:15:20.381 "trtype": "$TEST_TRANSPORT", 00:15:20.381 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:20.382 "adrfam": "ipv4", 00:15:20.382 "trsvcid": "$NVMF_PORT", 00:15:20.382 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:20.382 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:20.382 "hdgst": ${hdgst:-false}, 00:15:20.382 "ddgst": ${ddgst:-false} 00:15:20.382 }, 00:15:20.382 "method": "bdev_nvme_attach_controller" 00:15:20.382 } 00:15:20.382 EOF 00:15:20.382 )") 00:15:20.382 03:32:00 -- nvmf/common.sh@542 -- # cat 00:15:20.382 03:32:00 -- target/bdev_io_wait.sh@37 -- # wait 3041545 00:15:20.382 03:32:00 -- nvmf/common.sh@544 -- # jq . 00:15:20.382 03:32:00 -- nvmf/common.sh@542 -- # cat 00:15:20.382 03:32:00 -- nvmf/common.sh@544 -- # jq . 00:15:20.382 03:32:00 -- nvmf/common.sh@545 -- # IFS=, 00:15:20.382 03:32:00 -- nvmf/common.sh@544 -- # jq . 00:15:20.382 03:32:00 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:20.382 "params": { 00:15:20.382 "name": "Nvme1", 00:15:20.382 "trtype": "tcp", 00:15:20.382 "traddr": "10.0.0.2", 00:15:20.382 "adrfam": "ipv4", 00:15:20.382 "trsvcid": "4420", 00:15:20.382 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:20.382 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:20.382 "hdgst": false, 00:15:20.382 "ddgst": false 00:15:20.382 }, 00:15:20.382 "method": "bdev_nvme_attach_controller" 00:15:20.382 }' 00:15:20.382 03:32:00 -- nvmf/common.sh@545 -- # IFS=, 00:15:20.382 03:32:00 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:20.382 "params": { 00:15:20.382 "name": "Nvme1", 00:15:20.382 "trtype": "tcp", 00:15:20.382 "traddr": "10.0.0.2", 00:15:20.382 "adrfam": "ipv4", 00:15:20.382 "trsvcid": "4420", 00:15:20.382 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:20.382 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:20.382 "hdgst": false, 00:15:20.382 "ddgst": false 00:15:20.382 }, 00:15:20.382 "method": "bdev_nvme_attach_controller" 00:15:20.382 }' 00:15:20.382 03:32:00 -- nvmf/common.sh@544 -- # jq . 00:15:20.382 03:32:00 -- nvmf/common.sh@545 -- # IFS=, 00:15:20.382 03:32:00 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:20.382 "params": { 00:15:20.382 "name": "Nvme1", 00:15:20.382 "trtype": "tcp", 00:15:20.382 "traddr": "10.0.0.2", 00:15:20.382 "adrfam": "ipv4", 00:15:20.382 "trsvcid": "4420", 00:15:20.382 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:20.382 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:20.382 "hdgst": false, 00:15:20.382 "ddgst": false 00:15:20.382 }, 00:15:20.382 "method": "bdev_nvme_attach_controller" 00:15:20.382 }' 00:15:20.382 03:32:00 -- nvmf/common.sh@545 -- # IFS=, 00:15:20.382 03:32:00 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:20.382 "params": { 00:15:20.382 "name": "Nvme1", 00:15:20.382 "trtype": "tcp", 00:15:20.382 "traddr": "10.0.0.2", 00:15:20.382 "adrfam": "ipv4", 00:15:20.382 "trsvcid": "4420", 00:15:20.382 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:20.382 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:20.382 "hdgst": false, 00:15:20.382 "ddgst": false 00:15:20.382 }, 00:15:20.382 "method": "bdev_nvme_attach_controller" 00:15:20.382 }' 00:15:20.382 [2024-11-21 03:32:00.804566] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:20.382 [2024-11-21 03:32:00.804566] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:20.382 [2024-11-21 03:32:00.804656] [ DPDK EAL parameters: bdevperf -c 0x20 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk2 --proc-type=auto ] 00:15:20.382 [2024-11-21 03:32:00.804658] [ DPDK EAL parameters: bdevperf -c 0x10 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:15:20.382 [2024-11-21 03:32:00.805277] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:20.382 [2024-11-21 03:32:00.805277] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:20.382 [2024-11-21 03:32:00.805353] [ DPDK EAL parameters: bdevperf -c 0x80 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib[2024-11-21 03:32:00.805352] [ DPDK EAL parameters: bdevperf -c 0x40 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk4 --proc-type=auto ] 00:15:20.382 .cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk3 --proc-type=auto ] 00:15:20.382 EAL: No free 2048 kB hugepages reported on node 1 00:15:20.382 EAL: No free 2048 kB hugepages reported on node 1 00:15:20.382 [2024-11-21 03:32:00.978350] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:20.642 EAL: No free 2048 kB hugepages reported on node 1 00:15:20.642 [2024-11-21 03:32:01.073465] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:15:20.642 [2024-11-21 03:32:01.079861] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:20.642 EAL: No free 2048 kB hugepages reported on node 1 00:15:20.642 [2024-11-21 03:32:01.175703] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:20.642 [2024-11-21 03:32:01.179666] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:15:20.642 [2024-11-21 03:32:01.238334] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:20.642 [2024-11-21 03:32:01.274483] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:15:20.903 [2024-11-21 03:32:01.330098] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:15:20.903 Running I/O for 1 seconds... 00:15:20.903 Running I/O for 1 seconds... 00:15:20.903 Running I/O for 1 seconds... 00:15:21.162 Running I/O for 1 seconds... 00:15:22.098 00:15:22.098 Latency(us) 00:15:22.098 [2024-11-21T02:32:02.746Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:22.098 [2024-11-21T02:32:02.746Z] Job: Nvme1n1 (Core Mask 0x40, workload: flush, depth: 128, IO size: 4096) 00:15:22.098 Nvme1n1 : 1.00 137337.41 536.47 0.00 0.00 928.40 409.60 1419.95 00:15:22.098 [2024-11-21T02:32:02.746Z] =================================================================================================================== 00:15:22.098 [2024-11-21T02:32:02.746Z] Total : 137337.41 536.47 0.00 0.00 928.40 409.60 1419.95 00:15:22.098 00:15:22.098 Latency(us) 00:15:22.098 [2024-11-21T02:32:02.746Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:22.098 [2024-11-21T02:32:02.746Z] Job: Nvme1n1 (Core Mask 0x10, workload: write, depth: 128, IO size: 4096) 00:15:22.098 Nvme1n1 : 1.02 7069.87 27.62 0.00 0.00 17880.98 8883.77 27185.30 00:15:22.098 [2024-11-21T02:32:02.746Z] =================================================================================================================== 00:15:22.098 [2024-11-21T02:32:02.746Z] Total : 7069.87 27.62 0.00 0.00 17880.98 8883.77 27185.30 00:15:22.098 00:15:22.098 Latency(us) 00:15:22.098 [2024-11-21T02:32:02.746Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:22.098 [2024-11-21T02:32:02.746Z] Job: Nvme1n1 (Core Mask 0x20, workload: read, depth: 128, IO size: 4096) 00:15:22.098 Nvme1n1 : 1.01 9533.06 37.24 0.00 0.00 13360.98 8980.86 22136.60 00:15:22.098 [2024-11-21T02:32:02.746Z] =================================================================================================================== 00:15:22.098 [2024-11-21T02:32:02.746Z] Total : 9533.06 37.24 0.00 0.00 13360.98 8980.86 22136.60 00:15:22.098 00:15:22.098 Latency(us) 00:15:22.098 [2024-11-21T02:32:02.746Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:22.098 [2024-11-21T02:32:02.746Z] Job: Nvme1n1 (Core Mask 0x80, workload: unmap, depth: 128, IO size: 4096) 00:15:22.098 Nvme1n1 : 1.00 7257.20 28.35 0.00 0.00 17589.19 4417.61 42913.94 00:15:22.098 [2024-11-21T02:32:02.746Z] =================================================================================================================== 00:15:22.099 [2024-11-21T02:32:02.747Z] Total : 7257.20 28.35 0.00 0.00 17589.19 4417.61 42913.94 00:15:22.357 03:32:02 -- target/bdev_io_wait.sh@38 -- # wait 3041547 00:15:22.357 03:32:02 -- target/bdev_io_wait.sh@39 -- # wait 3041549 00:15:22.357 03:32:02 -- target/bdev_io_wait.sh@40 -- # wait 3041552 00:15:22.357 03:32:02 -- target/bdev_io_wait.sh@42 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:15:22.357 03:32:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:22.357 03:32:02 -- common/autotest_common.sh@10 -- # set +x 00:15:22.357 03:32:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:22.357 03:32:02 -- target/bdev_io_wait.sh@44 -- # trap - SIGINT SIGTERM EXIT 00:15:22.357 03:32:02 -- target/bdev_io_wait.sh@46 -- # nvmftestfini 00:15:22.357 03:32:02 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:22.357 03:32:02 -- nvmf/common.sh@116 -- # sync 00:15:22.357 03:32:02 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:22.357 03:32:02 -- nvmf/common.sh@119 -- # set +e 00:15:22.357 03:32:02 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:22.357 03:32:02 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:22.357 rmmod nvme_tcp 00:15:22.357 rmmod nvme_fabrics 00:15:22.357 rmmod nvme_keyring 00:15:22.357 03:32:02 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:22.357 03:32:02 -- nvmf/common.sh@123 -- # set -e 00:15:22.357 03:32:02 -- nvmf/common.sh@124 -- # return 0 00:15:22.357 03:32:02 -- nvmf/common.sh@477 -- # '[' -n 3041394 ']' 00:15:22.357 03:32:02 -- nvmf/common.sh@478 -- # killprocess 3041394 00:15:22.357 03:32:02 -- common/autotest_common.sh@936 -- # '[' -z 3041394 ']' 00:15:22.357 03:32:02 -- common/autotest_common.sh@940 -- # kill -0 3041394 00:15:22.357 03:32:03 -- common/autotest_common.sh@941 -- # uname 00:15:22.617 03:32:03 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:22.617 03:32:03 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3041394 00:15:22.617 03:32:03 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:15:22.617 03:32:03 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:15:22.617 03:32:03 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3041394' 00:15:22.617 killing process with pid 3041394 00:15:22.617 03:32:03 -- common/autotest_common.sh@955 -- # kill 3041394 00:15:22.617 03:32:03 -- common/autotest_common.sh@960 -- # wait 3041394 00:15:22.878 03:32:03 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:22.878 03:32:03 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:22.878 03:32:03 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:22.878 03:32:03 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:22.878 03:32:03 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:22.878 03:32:03 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:22.878 03:32:03 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:22.878 03:32:03 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:24.786 03:32:05 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:24.786 00:15:24.786 real 0m7.345s 00:15:24.786 user 0m16.813s 00:15:24.786 sys 0m3.498s 00:15:24.786 03:32:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:24.786 03:32:05 -- common/autotest_common.sh@10 -- # set +x 00:15:24.786 ************************************ 00:15:24.786 END TEST nvmf_bdev_io_wait 00:15:24.786 ************************************ 00:15:24.786 03:32:05 -- nvmf/nvmf.sh@50 -- # run_test nvmf_queue_depth /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:15:24.786 03:32:05 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:24.786 03:32:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:24.786 03:32:05 -- common/autotest_common.sh@10 -- # set +x 00:15:24.786 ************************************ 00:15:24.786 START TEST nvmf_queue_depth 00:15:24.786 ************************************ 00:15:24.786 03:32:05 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:15:24.786 * Looking for test storage... 00:15:24.786 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:24.786 03:32:05 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:24.786 03:32:05 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:24.786 03:32:05 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:25.045 03:32:05 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:25.045 03:32:05 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:25.045 03:32:05 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:25.045 03:32:05 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:25.045 03:32:05 -- scripts/common.sh@335 -- # IFS=.-: 00:15:25.045 03:32:05 -- scripts/common.sh@335 -- # read -ra ver1 00:15:25.045 03:32:05 -- scripts/common.sh@336 -- # IFS=.-: 00:15:25.045 03:32:05 -- scripts/common.sh@336 -- # read -ra ver2 00:15:25.045 03:32:05 -- scripts/common.sh@337 -- # local 'op=<' 00:15:25.045 03:32:05 -- scripts/common.sh@339 -- # ver1_l=2 00:15:25.045 03:32:05 -- scripts/common.sh@340 -- # ver2_l=1 00:15:25.045 03:32:05 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:25.045 03:32:05 -- scripts/common.sh@343 -- # case "$op" in 00:15:25.045 03:32:05 -- scripts/common.sh@344 -- # : 1 00:15:25.045 03:32:05 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:25.045 03:32:05 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:25.045 03:32:05 -- scripts/common.sh@364 -- # decimal 1 00:15:25.045 03:32:05 -- scripts/common.sh@352 -- # local d=1 00:15:25.045 03:32:05 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:25.045 03:32:05 -- scripts/common.sh@354 -- # echo 1 00:15:25.045 03:32:05 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:25.045 03:32:05 -- scripts/common.sh@365 -- # decimal 2 00:15:25.045 03:32:05 -- scripts/common.sh@352 -- # local d=2 00:15:25.045 03:32:05 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:25.045 03:32:05 -- scripts/common.sh@354 -- # echo 2 00:15:25.045 03:32:05 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:25.045 03:32:05 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:25.045 03:32:05 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:25.045 03:32:05 -- scripts/common.sh@367 -- # return 0 00:15:25.045 03:32:05 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:25.045 03:32:05 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:25.045 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:25.045 --rc genhtml_branch_coverage=1 00:15:25.045 --rc genhtml_function_coverage=1 00:15:25.045 --rc genhtml_legend=1 00:15:25.045 --rc geninfo_all_blocks=1 00:15:25.045 --rc geninfo_unexecuted_blocks=1 00:15:25.045 00:15:25.045 ' 00:15:25.045 03:32:05 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:25.045 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:25.045 --rc genhtml_branch_coverage=1 00:15:25.045 --rc genhtml_function_coverage=1 00:15:25.045 --rc genhtml_legend=1 00:15:25.045 --rc geninfo_all_blocks=1 00:15:25.045 --rc geninfo_unexecuted_blocks=1 00:15:25.045 00:15:25.045 ' 00:15:25.045 03:32:05 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:25.045 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:25.045 --rc genhtml_branch_coverage=1 00:15:25.045 --rc genhtml_function_coverage=1 00:15:25.045 --rc genhtml_legend=1 00:15:25.045 --rc geninfo_all_blocks=1 00:15:25.045 --rc geninfo_unexecuted_blocks=1 00:15:25.045 00:15:25.045 ' 00:15:25.045 03:32:05 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:25.045 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:25.045 --rc genhtml_branch_coverage=1 00:15:25.045 --rc genhtml_function_coverage=1 00:15:25.045 --rc genhtml_legend=1 00:15:25.045 --rc geninfo_all_blocks=1 00:15:25.045 --rc geninfo_unexecuted_blocks=1 00:15:25.045 00:15:25.045 ' 00:15:25.045 03:32:05 -- target/queue_depth.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:25.045 03:32:05 -- nvmf/common.sh@7 -- # uname -s 00:15:25.045 03:32:05 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:25.045 03:32:05 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:25.045 03:32:05 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:25.045 03:32:05 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:25.045 03:32:05 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:25.045 03:32:05 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:25.045 03:32:05 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:25.045 03:32:05 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:25.045 03:32:05 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:25.045 03:32:05 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:25.045 03:32:05 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:25.045 03:32:05 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:25.045 03:32:05 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:25.045 03:32:05 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:25.045 03:32:05 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:25.045 03:32:05 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:25.045 03:32:05 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:25.045 03:32:05 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:25.045 03:32:05 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:25.045 03:32:05 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:25.045 03:32:05 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:25.045 03:32:05 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:25.045 03:32:05 -- paths/export.sh@5 -- # export PATH 00:15:25.045 03:32:05 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:25.045 03:32:05 -- nvmf/common.sh@46 -- # : 0 00:15:25.045 03:32:05 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:25.045 03:32:05 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:25.046 03:32:05 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:25.046 03:32:05 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:25.046 03:32:05 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:25.046 03:32:05 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:25.046 03:32:05 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:25.046 03:32:05 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:25.046 03:32:05 -- target/queue_depth.sh@14 -- # MALLOC_BDEV_SIZE=64 00:15:25.046 03:32:05 -- target/queue_depth.sh@15 -- # MALLOC_BLOCK_SIZE=512 00:15:25.046 03:32:05 -- target/queue_depth.sh@17 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:15:25.046 03:32:05 -- target/queue_depth.sh@19 -- # nvmftestinit 00:15:25.046 03:32:05 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:25.046 03:32:05 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:25.046 03:32:05 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:25.046 03:32:05 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:25.046 03:32:05 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:25.046 03:32:05 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:25.046 03:32:05 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:25.046 03:32:05 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:25.046 03:32:05 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:25.046 03:32:05 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:25.046 03:32:05 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:25.046 03:32:05 -- common/autotest_common.sh@10 -- # set +x 00:15:27.005 03:32:07 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:27.005 03:32:07 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:27.005 03:32:07 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:27.005 03:32:07 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:27.005 03:32:07 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:27.005 03:32:07 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:27.005 03:32:07 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:27.005 03:32:07 -- nvmf/common.sh@294 -- # net_devs=() 00:15:27.005 03:32:07 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:27.005 03:32:07 -- nvmf/common.sh@295 -- # e810=() 00:15:27.005 03:32:07 -- nvmf/common.sh@295 -- # local -ga e810 00:15:27.005 03:32:07 -- nvmf/common.sh@296 -- # x722=() 00:15:27.005 03:32:07 -- nvmf/common.sh@296 -- # local -ga x722 00:15:27.005 03:32:07 -- nvmf/common.sh@297 -- # mlx=() 00:15:27.005 03:32:07 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:27.005 03:32:07 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:27.005 03:32:07 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:27.005 03:32:07 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:27.005 03:32:07 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:27.005 03:32:07 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:27.005 03:32:07 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:27.005 03:32:07 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:27.005 03:32:07 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:27.005 03:32:07 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:27.005 03:32:07 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:27.005 03:32:07 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:27.005 03:32:07 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:27.005 03:32:07 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:27.005 03:32:07 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:27.005 03:32:07 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:27.005 03:32:07 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:27.005 03:32:07 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:27.005 03:32:07 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:27.005 03:32:07 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:27.005 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:27.005 03:32:07 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:27.005 03:32:07 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:27.005 03:32:07 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:27.005 03:32:07 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:27.005 03:32:07 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:27.005 03:32:07 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:27.005 03:32:07 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:27.005 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:27.005 03:32:07 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:27.005 03:32:07 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:27.005 03:32:07 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:27.005 03:32:07 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:27.005 03:32:07 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:27.005 03:32:07 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:27.005 03:32:07 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:27.005 03:32:07 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:27.005 03:32:07 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:27.005 03:32:07 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:27.005 03:32:07 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:27.005 03:32:07 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:27.005 03:32:07 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:27.005 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:27.005 03:32:07 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:27.005 03:32:07 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:27.005 03:32:07 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:27.005 03:32:07 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:27.005 03:32:07 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:27.005 03:32:07 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:27.005 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:27.005 03:32:07 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:27.005 03:32:07 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:27.005 03:32:07 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:27.005 03:32:07 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:27.005 03:32:07 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:27.005 03:32:07 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:27.006 03:32:07 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:27.006 03:32:07 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:27.006 03:32:07 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:27.006 03:32:07 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:27.006 03:32:07 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:27.006 03:32:07 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:27.006 03:32:07 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:27.006 03:32:07 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:27.006 03:32:07 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:27.006 03:32:07 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:27.006 03:32:07 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:27.006 03:32:07 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:27.006 03:32:07 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:27.006 03:32:07 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:27.006 03:32:07 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:27.006 03:32:07 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:27.006 03:32:07 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:27.006 03:32:07 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:27.006 03:32:07 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:27.006 03:32:07 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:27.006 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:27.006 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.336 ms 00:15:27.006 00:15:27.006 --- 10.0.0.2 ping statistics --- 00:15:27.006 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:27.006 rtt min/avg/max/mdev = 0.336/0.336/0.336/0.000 ms 00:15:27.006 03:32:07 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:27.006 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:27.006 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.163 ms 00:15:27.006 00:15:27.006 --- 10.0.0.1 ping statistics --- 00:15:27.006 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:27.006 rtt min/avg/max/mdev = 0.163/0.163/0.163/0.000 ms 00:15:27.006 03:32:07 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:27.006 03:32:07 -- nvmf/common.sh@410 -- # return 0 00:15:27.006 03:32:07 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:27.006 03:32:07 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:27.006 03:32:07 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:27.006 03:32:07 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:27.006 03:32:07 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:27.006 03:32:07 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:27.006 03:32:07 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:27.006 03:32:07 -- target/queue_depth.sh@21 -- # nvmfappstart -m 0x2 00:15:27.006 03:32:07 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:27.006 03:32:07 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:27.006 03:32:07 -- common/autotest_common.sh@10 -- # set +x 00:15:27.265 03:32:07 -- nvmf/common.sh@469 -- # nvmfpid=3043797 00:15:27.265 03:32:07 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:15:27.265 03:32:07 -- nvmf/common.sh@470 -- # waitforlisten 3043797 00:15:27.265 03:32:07 -- common/autotest_common.sh@829 -- # '[' -z 3043797 ']' 00:15:27.265 03:32:07 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:27.265 03:32:07 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:27.265 03:32:07 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:27.265 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:27.265 03:32:07 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:27.265 03:32:07 -- common/autotest_common.sh@10 -- # set +x 00:15:27.265 [2024-11-21 03:32:07.695523] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:27.265 [2024-11-21 03:32:07.695616] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:27.265 EAL: No free 2048 kB hugepages reported on node 1 00:15:27.265 [2024-11-21 03:32:07.759989] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:27.265 [2024-11-21 03:32:07.869387] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:27.265 [2024-11-21 03:32:07.869529] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:27.265 [2024-11-21 03:32:07.869546] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:27.265 [2024-11-21 03:32:07.869558] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:27.265 [2024-11-21 03:32:07.869592] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:28.199 03:32:08 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:28.199 03:32:08 -- common/autotest_common.sh@862 -- # return 0 00:15:28.199 03:32:08 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:28.199 03:32:08 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:28.199 03:32:08 -- common/autotest_common.sh@10 -- # set +x 00:15:28.199 03:32:08 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:28.199 03:32:08 -- target/queue_depth.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:28.199 03:32:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:28.199 03:32:08 -- common/autotest_common.sh@10 -- # set +x 00:15:28.199 [2024-11-21 03:32:08.701992] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:28.199 03:32:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:28.199 03:32:08 -- target/queue_depth.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:15:28.199 03:32:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:28.199 03:32:08 -- common/autotest_common.sh@10 -- # set +x 00:15:28.199 Malloc0 00:15:28.199 03:32:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:28.199 03:32:08 -- target/queue_depth.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:15:28.199 03:32:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:28.199 03:32:08 -- common/autotest_common.sh@10 -- # set +x 00:15:28.199 03:32:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:28.199 03:32:08 -- target/queue_depth.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:15:28.199 03:32:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:28.199 03:32:08 -- common/autotest_common.sh@10 -- # set +x 00:15:28.199 03:32:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:28.199 03:32:08 -- target/queue_depth.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:28.199 03:32:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:28.199 03:32:08 -- common/autotest_common.sh@10 -- # set +x 00:15:28.199 [2024-11-21 03:32:08.765798] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:28.199 03:32:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:28.199 03:32:08 -- target/queue_depth.sh@30 -- # bdevperf_pid=3043955 00:15:28.199 03:32:08 -- target/queue_depth.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 1024 -o 4096 -w verify -t 10 00:15:28.199 03:32:08 -- target/queue_depth.sh@32 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:15:28.199 03:32:08 -- target/queue_depth.sh@33 -- # waitforlisten 3043955 /var/tmp/bdevperf.sock 00:15:28.199 03:32:08 -- common/autotest_common.sh@829 -- # '[' -z 3043955 ']' 00:15:28.199 03:32:08 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:15:28.199 03:32:08 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:28.199 03:32:08 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:15:28.199 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:15:28.199 03:32:08 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:28.199 03:32:08 -- common/autotest_common.sh@10 -- # set +x 00:15:28.199 [2024-11-21 03:32:08.807660] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:28.200 [2024-11-21 03:32:08.807731] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3043955 ] 00:15:28.200 EAL: No free 2048 kB hugepages reported on node 1 00:15:28.459 [2024-11-21 03:32:08.868224] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:28.459 [2024-11-21 03:32:08.981347] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:29.403 03:32:09 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:29.403 03:32:09 -- common/autotest_common.sh@862 -- # return 0 00:15:29.403 03:32:09 -- target/queue_depth.sh@34 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:15:29.403 03:32:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:29.403 03:32:09 -- common/autotest_common.sh@10 -- # set +x 00:15:29.403 NVMe0n1 00:15:29.403 03:32:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:29.403 03:32:09 -- target/queue_depth.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:15:29.403 Running I/O for 10 seconds... 00:15:41.625 00:15:41.625 Latency(us) 00:15:41.625 [2024-11-21T02:32:22.273Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:41.625 [2024-11-21T02:32:22.273Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 1024, IO size: 4096) 00:15:41.625 Verification LBA range: start 0x0 length 0x4000 00:15:41.625 NVMe0n1 : 10.07 12295.97 48.03 0.00 0.00 82942.37 15534.46 62137.84 00:15:41.625 [2024-11-21T02:32:22.273Z] =================================================================================================================== 00:15:41.625 [2024-11-21T02:32:22.273Z] Total : 12295.97 48.03 0.00 0.00 82942.37 15534.46 62137.84 00:15:41.625 0 00:15:41.625 03:32:20 -- target/queue_depth.sh@39 -- # killprocess 3043955 00:15:41.625 03:32:20 -- common/autotest_common.sh@936 -- # '[' -z 3043955 ']' 00:15:41.625 03:32:20 -- common/autotest_common.sh@940 -- # kill -0 3043955 00:15:41.625 03:32:20 -- common/autotest_common.sh@941 -- # uname 00:15:41.625 03:32:20 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:41.625 03:32:20 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3043955 00:15:41.625 03:32:20 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:15:41.625 03:32:20 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:15:41.625 03:32:20 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3043955' 00:15:41.625 killing process with pid 3043955 00:15:41.626 03:32:20 -- common/autotest_common.sh@955 -- # kill 3043955 00:15:41.626 Received shutdown signal, test time was about 10.000000 seconds 00:15:41.626 00:15:41.626 Latency(us) 00:15:41.626 [2024-11-21T02:32:22.274Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:41.626 [2024-11-21T02:32:22.274Z] =================================================================================================================== 00:15:41.626 [2024-11-21T02:32:22.274Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:15:41.626 03:32:20 -- common/autotest_common.sh@960 -- # wait 3043955 00:15:41.626 03:32:20 -- target/queue_depth.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:15:41.626 03:32:20 -- target/queue_depth.sh@43 -- # nvmftestfini 00:15:41.626 03:32:20 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:41.626 03:32:20 -- nvmf/common.sh@116 -- # sync 00:15:41.626 03:32:20 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:41.626 03:32:20 -- nvmf/common.sh@119 -- # set +e 00:15:41.626 03:32:20 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:41.626 03:32:20 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:41.626 rmmod nvme_tcp 00:15:41.626 rmmod nvme_fabrics 00:15:41.626 rmmod nvme_keyring 00:15:41.626 03:32:20 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:41.626 03:32:20 -- nvmf/common.sh@123 -- # set -e 00:15:41.626 03:32:20 -- nvmf/common.sh@124 -- # return 0 00:15:41.626 03:32:20 -- nvmf/common.sh@477 -- # '[' -n 3043797 ']' 00:15:41.626 03:32:20 -- nvmf/common.sh@478 -- # killprocess 3043797 00:15:41.626 03:32:20 -- common/autotest_common.sh@936 -- # '[' -z 3043797 ']' 00:15:41.626 03:32:20 -- common/autotest_common.sh@940 -- # kill -0 3043797 00:15:41.626 03:32:20 -- common/autotest_common.sh@941 -- # uname 00:15:41.626 03:32:20 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:41.626 03:32:20 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3043797 00:15:41.626 03:32:20 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:15:41.626 03:32:20 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:15:41.626 03:32:20 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3043797' 00:15:41.626 killing process with pid 3043797 00:15:41.626 03:32:20 -- common/autotest_common.sh@955 -- # kill 3043797 00:15:41.626 03:32:20 -- common/autotest_common.sh@960 -- # wait 3043797 00:15:41.626 03:32:20 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:41.626 03:32:20 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:41.626 03:32:20 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:41.626 03:32:20 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:41.626 03:32:20 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:41.626 03:32:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:41.626 03:32:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:41.626 03:32:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:42.198 03:32:22 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:42.198 00:15:42.198 real 0m17.461s 00:15:42.198 user 0m25.077s 00:15:42.198 sys 0m3.131s 00:15:42.198 03:32:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:42.198 03:32:22 -- common/autotest_common.sh@10 -- # set +x 00:15:42.198 ************************************ 00:15:42.198 END TEST nvmf_queue_depth 00:15:42.198 ************************************ 00:15:42.458 03:32:22 -- nvmf/nvmf.sh@51 -- # run_test nvmf_multipath /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:15:42.458 03:32:22 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:42.458 03:32:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:42.458 03:32:22 -- common/autotest_common.sh@10 -- # set +x 00:15:42.458 ************************************ 00:15:42.458 START TEST nvmf_multipath 00:15:42.458 ************************************ 00:15:42.458 03:32:22 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:15:42.458 * Looking for test storage... 00:15:42.458 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:42.458 03:32:22 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:42.458 03:32:22 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:42.458 03:32:22 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:42.458 03:32:23 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:42.458 03:32:23 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:42.458 03:32:23 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:42.458 03:32:23 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:42.458 03:32:23 -- scripts/common.sh@335 -- # IFS=.-: 00:15:42.458 03:32:23 -- scripts/common.sh@335 -- # read -ra ver1 00:15:42.458 03:32:23 -- scripts/common.sh@336 -- # IFS=.-: 00:15:42.458 03:32:23 -- scripts/common.sh@336 -- # read -ra ver2 00:15:42.458 03:32:23 -- scripts/common.sh@337 -- # local 'op=<' 00:15:42.458 03:32:23 -- scripts/common.sh@339 -- # ver1_l=2 00:15:42.458 03:32:23 -- scripts/common.sh@340 -- # ver2_l=1 00:15:42.458 03:32:23 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:42.458 03:32:23 -- scripts/common.sh@343 -- # case "$op" in 00:15:42.458 03:32:23 -- scripts/common.sh@344 -- # : 1 00:15:42.458 03:32:23 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:42.458 03:32:23 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:42.458 03:32:23 -- scripts/common.sh@364 -- # decimal 1 00:15:42.458 03:32:23 -- scripts/common.sh@352 -- # local d=1 00:15:42.458 03:32:23 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:42.458 03:32:23 -- scripts/common.sh@354 -- # echo 1 00:15:42.458 03:32:23 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:42.458 03:32:23 -- scripts/common.sh@365 -- # decimal 2 00:15:42.458 03:32:23 -- scripts/common.sh@352 -- # local d=2 00:15:42.458 03:32:23 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:42.458 03:32:23 -- scripts/common.sh@354 -- # echo 2 00:15:42.458 03:32:23 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:42.458 03:32:23 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:42.458 03:32:23 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:42.458 03:32:23 -- scripts/common.sh@367 -- # return 0 00:15:42.458 03:32:23 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:42.458 03:32:23 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:42.458 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:42.458 --rc genhtml_branch_coverage=1 00:15:42.458 --rc genhtml_function_coverage=1 00:15:42.458 --rc genhtml_legend=1 00:15:42.458 --rc geninfo_all_blocks=1 00:15:42.458 --rc geninfo_unexecuted_blocks=1 00:15:42.458 00:15:42.458 ' 00:15:42.458 03:32:23 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:42.458 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:42.458 --rc genhtml_branch_coverage=1 00:15:42.458 --rc genhtml_function_coverage=1 00:15:42.458 --rc genhtml_legend=1 00:15:42.458 --rc geninfo_all_blocks=1 00:15:42.458 --rc geninfo_unexecuted_blocks=1 00:15:42.458 00:15:42.458 ' 00:15:42.458 03:32:23 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:42.458 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:42.458 --rc genhtml_branch_coverage=1 00:15:42.459 --rc genhtml_function_coverage=1 00:15:42.459 --rc genhtml_legend=1 00:15:42.459 --rc geninfo_all_blocks=1 00:15:42.459 --rc geninfo_unexecuted_blocks=1 00:15:42.459 00:15:42.459 ' 00:15:42.459 03:32:23 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:42.459 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:42.459 --rc genhtml_branch_coverage=1 00:15:42.459 --rc genhtml_function_coverage=1 00:15:42.459 --rc genhtml_legend=1 00:15:42.459 --rc geninfo_all_blocks=1 00:15:42.459 --rc geninfo_unexecuted_blocks=1 00:15:42.459 00:15:42.459 ' 00:15:42.459 03:32:23 -- target/multipath.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:42.459 03:32:23 -- nvmf/common.sh@7 -- # uname -s 00:15:42.459 03:32:23 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:42.459 03:32:23 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:42.459 03:32:23 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:42.459 03:32:23 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:42.459 03:32:23 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:42.459 03:32:23 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:42.459 03:32:23 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:42.459 03:32:23 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:42.459 03:32:23 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:42.459 03:32:23 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:42.459 03:32:23 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:42.459 03:32:23 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:42.459 03:32:23 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:42.459 03:32:23 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:42.459 03:32:23 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:42.459 03:32:23 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:42.459 03:32:23 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:42.459 03:32:23 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:42.459 03:32:23 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:42.459 03:32:23 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:42.459 03:32:23 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:42.459 03:32:23 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:42.459 03:32:23 -- paths/export.sh@5 -- # export PATH 00:15:42.459 03:32:23 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:42.459 03:32:23 -- nvmf/common.sh@46 -- # : 0 00:15:42.459 03:32:23 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:42.459 03:32:23 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:42.459 03:32:23 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:42.459 03:32:23 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:42.459 03:32:23 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:42.459 03:32:23 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:42.459 03:32:23 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:42.459 03:32:23 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:42.459 03:32:23 -- target/multipath.sh@11 -- # MALLOC_BDEV_SIZE=64 00:15:42.459 03:32:23 -- target/multipath.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:15:42.459 03:32:23 -- target/multipath.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:15:42.459 03:32:23 -- target/multipath.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:42.459 03:32:23 -- target/multipath.sh@43 -- # nvmftestinit 00:15:42.459 03:32:23 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:42.459 03:32:23 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:42.459 03:32:23 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:42.459 03:32:23 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:42.459 03:32:23 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:42.459 03:32:23 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:42.459 03:32:23 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:42.459 03:32:23 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:42.459 03:32:23 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:42.459 03:32:23 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:42.459 03:32:23 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:42.459 03:32:23 -- common/autotest_common.sh@10 -- # set +x 00:15:44.999 03:32:25 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:44.999 03:32:25 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:44.999 03:32:25 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:44.999 03:32:25 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:44.999 03:32:25 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:44.999 03:32:25 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:44.999 03:32:25 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:44.999 03:32:25 -- nvmf/common.sh@294 -- # net_devs=() 00:15:44.999 03:32:25 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:44.999 03:32:25 -- nvmf/common.sh@295 -- # e810=() 00:15:44.999 03:32:25 -- nvmf/common.sh@295 -- # local -ga e810 00:15:44.999 03:32:25 -- nvmf/common.sh@296 -- # x722=() 00:15:44.999 03:32:25 -- nvmf/common.sh@296 -- # local -ga x722 00:15:44.999 03:32:25 -- nvmf/common.sh@297 -- # mlx=() 00:15:44.999 03:32:25 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:44.999 03:32:25 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:44.999 03:32:25 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:44.999 03:32:25 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:44.999 03:32:25 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:44.999 03:32:25 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:44.999 03:32:25 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:44.999 03:32:25 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:44.999 03:32:25 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:44.999 03:32:25 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:44.999 03:32:25 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:44.999 03:32:25 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:44.999 03:32:25 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:44.999 03:32:25 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:44.999 03:32:25 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:44.999 03:32:25 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:44.999 03:32:25 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:44.999 03:32:25 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:44.999 03:32:25 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:44.999 03:32:25 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:44.999 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:44.999 03:32:25 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:44.999 03:32:25 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:44.999 03:32:25 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:44.999 03:32:25 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:44.999 03:32:25 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:44.999 03:32:25 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:44.999 03:32:25 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:44.999 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:44.999 03:32:25 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:44.999 03:32:25 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:44.999 03:32:25 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:44.999 03:32:25 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:44.999 03:32:25 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:44.999 03:32:25 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:44.999 03:32:25 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:44.999 03:32:25 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:44.999 03:32:25 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:44.999 03:32:25 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:44.999 03:32:25 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:44.999 03:32:25 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:44.999 03:32:25 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:44.999 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:44.999 03:32:25 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:44.999 03:32:25 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:44.999 03:32:25 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:44.999 03:32:25 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:44.999 03:32:25 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:44.999 03:32:25 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:44.999 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:44.999 03:32:25 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:44.999 03:32:25 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:44.999 03:32:25 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:44.999 03:32:25 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:44.999 03:32:25 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:44.999 03:32:25 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:44.999 03:32:25 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:44.999 03:32:25 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:44.999 03:32:25 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:44.999 03:32:25 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:44.999 03:32:25 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:44.999 03:32:25 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:44.999 03:32:25 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:44.999 03:32:25 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:44.999 03:32:25 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:44.999 03:32:25 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:44.999 03:32:25 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:44.999 03:32:25 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:44.999 03:32:25 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:44.999 03:32:25 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:44.999 03:32:25 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:44.999 03:32:25 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:44.999 03:32:25 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:44.999 03:32:25 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:44.999 03:32:25 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:44.999 03:32:25 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:44.999 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:44.999 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.278 ms 00:15:44.999 00:15:44.999 --- 10.0.0.2 ping statistics --- 00:15:45.000 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:45.000 rtt min/avg/max/mdev = 0.278/0.278/0.278/0.000 ms 00:15:45.000 03:32:25 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:45.000 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:45.000 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.205 ms 00:15:45.000 00:15:45.000 --- 10.0.0.1 ping statistics --- 00:15:45.000 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:45.000 rtt min/avg/max/mdev = 0.205/0.205/0.205/0.000 ms 00:15:45.000 03:32:25 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:45.000 03:32:25 -- nvmf/common.sh@410 -- # return 0 00:15:45.000 03:32:25 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:45.000 03:32:25 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:45.000 03:32:25 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:45.000 03:32:25 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:45.000 03:32:25 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:45.000 03:32:25 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:45.000 03:32:25 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:45.000 03:32:25 -- target/multipath.sh@45 -- # '[' -z ']' 00:15:45.000 03:32:25 -- target/multipath.sh@46 -- # echo 'only one NIC for nvmf test' 00:15:45.000 only one NIC for nvmf test 00:15:45.000 03:32:25 -- target/multipath.sh@47 -- # nvmftestfini 00:15:45.000 03:32:25 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:45.000 03:32:25 -- nvmf/common.sh@116 -- # sync 00:15:45.000 03:32:25 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:45.000 03:32:25 -- nvmf/common.sh@119 -- # set +e 00:15:45.000 03:32:25 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:45.000 03:32:25 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:45.000 rmmod nvme_tcp 00:15:45.000 rmmod nvme_fabrics 00:15:45.000 rmmod nvme_keyring 00:15:45.000 03:32:25 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:45.000 03:32:25 -- nvmf/common.sh@123 -- # set -e 00:15:45.000 03:32:25 -- nvmf/common.sh@124 -- # return 0 00:15:45.000 03:32:25 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:15:45.000 03:32:25 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:45.000 03:32:25 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:45.000 03:32:25 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:45.000 03:32:25 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:45.000 03:32:25 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:45.000 03:32:25 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:45.000 03:32:25 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:45.000 03:32:25 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:46.913 03:32:27 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:46.913 03:32:27 -- target/multipath.sh@48 -- # exit 0 00:15:46.913 03:32:27 -- target/multipath.sh@1 -- # nvmftestfini 00:15:46.913 03:32:27 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:46.913 03:32:27 -- nvmf/common.sh@116 -- # sync 00:15:46.913 03:32:27 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:46.913 03:32:27 -- nvmf/common.sh@119 -- # set +e 00:15:46.913 03:32:27 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:46.913 03:32:27 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:46.913 03:32:27 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:46.913 03:32:27 -- nvmf/common.sh@123 -- # set -e 00:15:46.913 03:32:27 -- nvmf/common.sh@124 -- # return 0 00:15:46.913 03:32:27 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:15:46.913 03:32:27 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:46.913 03:32:27 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:46.913 03:32:27 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:46.913 03:32:27 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:46.913 03:32:27 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:46.913 03:32:27 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:46.913 03:32:27 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:46.913 03:32:27 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:46.913 03:32:27 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:46.913 00:15:46.913 real 0m4.605s 00:15:46.913 user 0m0.934s 00:15:46.913 sys 0m1.676s 00:15:46.913 03:32:27 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:46.913 03:32:27 -- common/autotest_common.sh@10 -- # set +x 00:15:46.913 ************************************ 00:15:46.913 END TEST nvmf_multipath 00:15:46.913 ************************************ 00:15:46.913 03:32:27 -- nvmf/nvmf.sh@52 -- # run_test nvmf_zcopy /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:15:46.913 03:32:27 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:46.913 03:32:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:46.913 03:32:27 -- common/autotest_common.sh@10 -- # set +x 00:15:46.913 ************************************ 00:15:46.913 START TEST nvmf_zcopy 00:15:46.913 ************************************ 00:15:46.913 03:32:27 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:15:46.913 * Looking for test storage... 00:15:47.173 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:47.173 03:32:27 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:47.173 03:32:27 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:47.173 03:32:27 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:47.173 03:32:27 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:47.173 03:32:27 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:47.173 03:32:27 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:47.173 03:32:27 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:47.173 03:32:27 -- scripts/common.sh@335 -- # IFS=.-: 00:15:47.173 03:32:27 -- scripts/common.sh@335 -- # read -ra ver1 00:15:47.173 03:32:27 -- scripts/common.sh@336 -- # IFS=.-: 00:15:47.173 03:32:27 -- scripts/common.sh@336 -- # read -ra ver2 00:15:47.173 03:32:27 -- scripts/common.sh@337 -- # local 'op=<' 00:15:47.173 03:32:27 -- scripts/common.sh@339 -- # ver1_l=2 00:15:47.173 03:32:27 -- scripts/common.sh@340 -- # ver2_l=1 00:15:47.173 03:32:27 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:47.173 03:32:27 -- scripts/common.sh@343 -- # case "$op" in 00:15:47.173 03:32:27 -- scripts/common.sh@344 -- # : 1 00:15:47.173 03:32:27 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:47.173 03:32:27 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:47.173 03:32:27 -- scripts/common.sh@364 -- # decimal 1 00:15:47.173 03:32:27 -- scripts/common.sh@352 -- # local d=1 00:15:47.173 03:32:27 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:47.173 03:32:27 -- scripts/common.sh@354 -- # echo 1 00:15:47.173 03:32:27 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:47.173 03:32:27 -- scripts/common.sh@365 -- # decimal 2 00:15:47.173 03:32:27 -- scripts/common.sh@352 -- # local d=2 00:15:47.173 03:32:27 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:47.173 03:32:27 -- scripts/common.sh@354 -- # echo 2 00:15:47.173 03:32:27 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:47.173 03:32:27 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:47.173 03:32:27 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:47.173 03:32:27 -- scripts/common.sh@367 -- # return 0 00:15:47.173 03:32:27 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:47.173 03:32:27 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:47.173 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:47.173 --rc genhtml_branch_coverage=1 00:15:47.173 --rc genhtml_function_coverage=1 00:15:47.173 --rc genhtml_legend=1 00:15:47.173 --rc geninfo_all_blocks=1 00:15:47.173 --rc geninfo_unexecuted_blocks=1 00:15:47.173 00:15:47.173 ' 00:15:47.173 03:32:27 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:47.173 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:47.173 --rc genhtml_branch_coverage=1 00:15:47.173 --rc genhtml_function_coverage=1 00:15:47.173 --rc genhtml_legend=1 00:15:47.173 --rc geninfo_all_blocks=1 00:15:47.173 --rc geninfo_unexecuted_blocks=1 00:15:47.173 00:15:47.173 ' 00:15:47.173 03:32:27 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:47.173 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:47.173 --rc genhtml_branch_coverage=1 00:15:47.173 --rc genhtml_function_coverage=1 00:15:47.173 --rc genhtml_legend=1 00:15:47.173 --rc geninfo_all_blocks=1 00:15:47.173 --rc geninfo_unexecuted_blocks=1 00:15:47.173 00:15:47.173 ' 00:15:47.173 03:32:27 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:47.173 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:47.173 --rc genhtml_branch_coverage=1 00:15:47.173 --rc genhtml_function_coverage=1 00:15:47.173 --rc genhtml_legend=1 00:15:47.173 --rc geninfo_all_blocks=1 00:15:47.173 --rc geninfo_unexecuted_blocks=1 00:15:47.173 00:15:47.173 ' 00:15:47.173 03:32:27 -- target/zcopy.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:47.173 03:32:27 -- nvmf/common.sh@7 -- # uname -s 00:15:47.173 03:32:27 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:47.173 03:32:27 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:47.173 03:32:27 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:47.173 03:32:27 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:47.173 03:32:27 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:47.173 03:32:27 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:47.173 03:32:27 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:47.173 03:32:27 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:47.173 03:32:27 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:47.173 03:32:27 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:47.173 03:32:27 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:47.173 03:32:27 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:47.173 03:32:27 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:47.173 03:32:27 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:47.173 03:32:27 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:47.173 03:32:27 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:47.173 03:32:27 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:47.173 03:32:27 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:47.173 03:32:27 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:47.174 03:32:27 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:47.174 03:32:27 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:47.174 03:32:27 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:47.174 03:32:27 -- paths/export.sh@5 -- # export PATH 00:15:47.174 03:32:27 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:47.174 03:32:27 -- nvmf/common.sh@46 -- # : 0 00:15:47.174 03:32:27 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:47.174 03:32:27 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:47.174 03:32:27 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:47.174 03:32:27 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:47.174 03:32:27 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:47.174 03:32:27 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:47.174 03:32:27 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:47.174 03:32:27 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:47.174 03:32:27 -- target/zcopy.sh@12 -- # nvmftestinit 00:15:47.174 03:32:27 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:47.174 03:32:27 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:47.174 03:32:27 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:47.174 03:32:27 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:47.174 03:32:27 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:47.174 03:32:27 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:47.174 03:32:27 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:47.174 03:32:27 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:47.174 03:32:27 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:47.174 03:32:27 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:47.174 03:32:27 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:47.174 03:32:27 -- common/autotest_common.sh@10 -- # set +x 00:15:49.077 03:32:29 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:49.077 03:32:29 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:49.077 03:32:29 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:49.077 03:32:29 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:49.077 03:32:29 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:49.077 03:32:29 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:49.077 03:32:29 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:49.077 03:32:29 -- nvmf/common.sh@294 -- # net_devs=() 00:15:49.077 03:32:29 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:49.077 03:32:29 -- nvmf/common.sh@295 -- # e810=() 00:15:49.077 03:32:29 -- nvmf/common.sh@295 -- # local -ga e810 00:15:49.077 03:32:29 -- nvmf/common.sh@296 -- # x722=() 00:15:49.077 03:32:29 -- nvmf/common.sh@296 -- # local -ga x722 00:15:49.077 03:32:29 -- nvmf/common.sh@297 -- # mlx=() 00:15:49.077 03:32:29 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:49.077 03:32:29 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:49.077 03:32:29 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:49.077 03:32:29 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:49.077 03:32:29 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:49.077 03:32:29 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:49.077 03:32:29 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:49.077 03:32:29 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:49.077 03:32:29 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:49.077 03:32:29 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:49.077 03:32:29 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:49.077 03:32:29 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:49.077 03:32:29 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:49.077 03:32:29 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:49.077 03:32:29 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:49.077 03:32:29 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:49.077 03:32:29 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:49.077 03:32:29 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:49.077 03:32:29 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:49.077 03:32:29 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:49.077 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:49.077 03:32:29 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:49.077 03:32:29 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:49.077 03:32:29 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:49.077 03:32:29 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:49.077 03:32:29 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:49.077 03:32:29 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:49.077 03:32:29 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:49.077 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:49.077 03:32:29 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:49.077 03:32:29 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:49.077 03:32:29 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:49.077 03:32:29 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:49.077 03:32:29 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:49.077 03:32:29 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:49.077 03:32:29 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:49.077 03:32:29 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:49.077 03:32:29 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:49.077 03:32:29 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:49.077 03:32:29 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:49.077 03:32:29 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:49.077 03:32:29 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:49.077 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:49.077 03:32:29 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:49.077 03:32:29 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:49.077 03:32:29 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:49.077 03:32:29 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:49.077 03:32:29 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:49.077 03:32:29 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:49.077 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:49.077 03:32:29 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:49.077 03:32:29 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:49.077 03:32:29 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:49.077 03:32:29 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:49.077 03:32:29 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:49.077 03:32:29 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:49.077 03:32:29 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:49.077 03:32:29 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:49.077 03:32:29 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:49.077 03:32:29 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:49.077 03:32:29 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:49.077 03:32:29 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:49.077 03:32:29 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:49.077 03:32:29 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:49.077 03:32:29 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:49.077 03:32:29 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:49.077 03:32:29 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:49.335 03:32:29 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:49.335 03:32:29 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:49.335 03:32:29 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:49.335 03:32:29 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:49.335 03:32:29 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:49.335 03:32:29 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:49.335 03:32:29 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:49.335 03:32:29 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:49.335 03:32:29 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:49.335 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:49.335 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.268 ms 00:15:49.335 00:15:49.335 --- 10.0.0.2 ping statistics --- 00:15:49.335 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:49.335 rtt min/avg/max/mdev = 0.268/0.268/0.268/0.000 ms 00:15:49.335 03:32:29 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:49.335 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:49.335 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.084 ms 00:15:49.335 00:15:49.335 --- 10.0.0.1 ping statistics --- 00:15:49.335 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:49.335 rtt min/avg/max/mdev = 0.084/0.084/0.084/0.000 ms 00:15:49.335 03:32:29 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:49.335 03:32:29 -- nvmf/common.sh@410 -- # return 0 00:15:49.335 03:32:29 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:49.335 03:32:29 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:49.335 03:32:29 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:49.335 03:32:29 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:49.335 03:32:29 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:49.335 03:32:29 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:49.335 03:32:29 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:49.335 03:32:29 -- target/zcopy.sh@13 -- # nvmfappstart -m 0x2 00:15:49.335 03:32:29 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:49.335 03:32:29 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:49.335 03:32:29 -- common/autotest_common.sh@10 -- # set +x 00:15:49.335 03:32:29 -- nvmf/common.sh@469 -- # nvmfpid=3049216 00:15:49.335 03:32:29 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:15:49.335 03:32:29 -- nvmf/common.sh@470 -- # waitforlisten 3049216 00:15:49.335 03:32:29 -- common/autotest_common.sh@829 -- # '[' -z 3049216 ']' 00:15:49.335 03:32:29 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:49.335 03:32:29 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:49.335 03:32:29 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:49.335 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:49.335 03:32:29 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:49.335 03:32:29 -- common/autotest_common.sh@10 -- # set +x 00:15:49.335 [2024-11-21 03:32:29.928945] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:49.335 [2024-11-21 03:32:29.929025] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:49.335 EAL: No free 2048 kB hugepages reported on node 1 00:15:49.595 [2024-11-21 03:32:30.001122] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:49.595 [2024-11-21 03:32:30.125615] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:49.595 [2024-11-21 03:32:30.125768] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:49.595 [2024-11-21 03:32:30.125788] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:49.595 [2024-11-21 03:32:30.125803] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:49.595 [2024-11-21 03:32:30.125831] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:50.533 03:32:30 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:50.533 03:32:30 -- common/autotest_common.sh@862 -- # return 0 00:15:50.533 03:32:30 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:50.533 03:32:30 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:50.533 03:32:30 -- common/autotest_common.sh@10 -- # set +x 00:15:50.533 03:32:30 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:50.533 03:32:30 -- target/zcopy.sh@15 -- # '[' tcp '!=' tcp ']' 00:15:50.533 03:32:30 -- target/zcopy.sh@22 -- # rpc_cmd nvmf_create_transport -t tcp -o -c 0 --zcopy 00:15:50.533 03:32:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:50.533 03:32:30 -- common/autotest_common.sh@10 -- # set +x 00:15:50.533 [2024-11-21 03:32:30.966523] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:50.533 03:32:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:50.533 03:32:30 -- target/zcopy.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:15:50.533 03:32:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:50.533 03:32:30 -- common/autotest_common.sh@10 -- # set +x 00:15:50.533 03:32:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:50.533 03:32:30 -- target/zcopy.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:50.533 03:32:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:50.533 03:32:30 -- common/autotest_common.sh@10 -- # set +x 00:15:50.533 [2024-11-21 03:32:30.982735] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:50.533 03:32:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:50.533 03:32:30 -- target/zcopy.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:15:50.533 03:32:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:50.533 03:32:30 -- common/autotest_common.sh@10 -- # set +x 00:15:50.533 03:32:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:50.533 03:32:30 -- target/zcopy.sh@29 -- # rpc_cmd bdev_malloc_create 32 4096 -b malloc0 00:15:50.533 03:32:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:50.533 03:32:30 -- common/autotest_common.sh@10 -- # set +x 00:15:50.533 malloc0 00:15:50.533 03:32:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:50.533 03:32:31 -- target/zcopy.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:15:50.533 03:32:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:50.533 03:32:31 -- common/autotest_common.sh@10 -- # set +x 00:15:50.533 03:32:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:50.533 03:32:31 -- target/zcopy.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -t 10 -q 128 -w verify -o 8192 00:15:50.533 03:32:31 -- target/zcopy.sh@33 -- # gen_nvmf_target_json 00:15:50.533 03:32:31 -- nvmf/common.sh@520 -- # config=() 00:15:50.533 03:32:31 -- nvmf/common.sh@520 -- # local subsystem config 00:15:50.533 03:32:31 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:50.533 03:32:31 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:50.533 { 00:15:50.533 "params": { 00:15:50.533 "name": "Nvme$subsystem", 00:15:50.533 "trtype": "$TEST_TRANSPORT", 00:15:50.533 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:50.533 "adrfam": "ipv4", 00:15:50.533 "trsvcid": "$NVMF_PORT", 00:15:50.533 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:50.533 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:50.533 "hdgst": ${hdgst:-false}, 00:15:50.533 "ddgst": ${ddgst:-false} 00:15:50.533 }, 00:15:50.533 "method": "bdev_nvme_attach_controller" 00:15:50.533 } 00:15:50.533 EOF 00:15:50.533 )") 00:15:50.533 03:32:31 -- nvmf/common.sh@542 -- # cat 00:15:50.533 03:32:31 -- nvmf/common.sh@544 -- # jq . 00:15:50.533 03:32:31 -- nvmf/common.sh@545 -- # IFS=, 00:15:50.533 03:32:31 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:50.533 "params": { 00:15:50.533 "name": "Nvme1", 00:15:50.533 "trtype": "tcp", 00:15:50.533 "traddr": "10.0.0.2", 00:15:50.533 "adrfam": "ipv4", 00:15:50.533 "trsvcid": "4420", 00:15:50.533 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:50.533 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:50.533 "hdgst": false, 00:15:50.533 "ddgst": false 00:15:50.533 }, 00:15:50.533 "method": "bdev_nvme_attach_controller" 00:15:50.533 }' 00:15:50.533 [2024-11-21 03:32:31.059651] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:50.533 [2024-11-21 03:32:31.059718] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3049373 ] 00:15:50.533 EAL: No free 2048 kB hugepages reported on node 1 00:15:50.533 [2024-11-21 03:32:31.118699] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:50.794 [2024-11-21 03:32:31.229018] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:51.053 Running I/O for 10 seconds... 00:16:01.046 00:16:01.046 Latency(us) 00:16:01.046 [2024-11-21T02:32:41.694Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:01.046 [2024-11-21T02:32:41.694Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 8192) 00:16:01.046 Verification LBA range: start 0x0 length 0x1000 00:16:01.046 Nvme1n1 : 10.01 8691.32 67.90 0.00 0.00 14692.42 1013.38 23301.69 00:16:01.046 [2024-11-21T02:32:41.694Z] =================================================================================================================== 00:16:01.046 [2024-11-21T02:32:41.694Z] Total : 8691.32 67.90 0.00 0.00 14692.42 1013.38 23301.69 00:16:01.305 03:32:41 -- target/zcopy.sh@39 -- # perfpid=3050717 00:16:01.305 03:32:41 -- target/zcopy.sh@41 -- # xtrace_disable 00:16:01.305 03:32:41 -- common/autotest_common.sh@10 -- # set +x 00:16:01.305 03:32:41 -- target/zcopy.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -t 5 -q 128 -w randrw -M 50 -o 8192 00:16:01.305 03:32:41 -- target/zcopy.sh@37 -- # gen_nvmf_target_json 00:16:01.305 03:32:41 -- nvmf/common.sh@520 -- # config=() 00:16:01.305 03:32:41 -- nvmf/common.sh@520 -- # local subsystem config 00:16:01.305 03:32:41 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:16:01.305 03:32:41 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:16:01.305 { 00:16:01.305 "params": { 00:16:01.305 "name": "Nvme$subsystem", 00:16:01.305 "trtype": "$TEST_TRANSPORT", 00:16:01.305 "traddr": "$NVMF_FIRST_TARGET_IP", 00:16:01.305 "adrfam": "ipv4", 00:16:01.305 "trsvcid": "$NVMF_PORT", 00:16:01.305 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:16:01.305 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:16:01.305 "hdgst": ${hdgst:-false}, 00:16:01.305 "ddgst": ${ddgst:-false} 00:16:01.305 }, 00:16:01.305 "method": "bdev_nvme_attach_controller" 00:16:01.305 } 00:16:01.305 EOF 00:16:01.305 )") 00:16:01.305 03:32:41 -- nvmf/common.sh@542 -- # cat 00:16:01.305 [2024-11-21 03:32:41.797641] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.305 [2024-11-21 03:32:41.797695] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.305 03:32:41 -- nvmf/common.sh@544 -- # jq . 00:16:01.305 03:32:41 -- nvmf/common.sh@545 -- # IFS=, 00:16:01.305 03:32:41 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:16:01.305 "params": { 00:16:01.305 "name": "Nvme1", 00:16:01.305 "trtype": "tcp", 00:16:01.305 "traddr": "10.0.0.2", 00:16:01.305 "adrfam": "ipv4", 00:16:01.305 "trsvcid": "4420", 00:16:01.305 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:16:01.305 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:16:01.305 "hdgst": false, 00:16:01.305 "ddgst": false 00:16:01.305 }, 00:16:01.305 "method": "bdev_nvme_attach_controller" 00:16:01.305 }' 00:16:01.305 [2024-11-21 03:32:41.805606] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.305 [2024-11-21 03:32:41.805634] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.305 [2024-11-21 03:32:41.813624] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.305 [2024-11-21 03:32:41.813649] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.305 [2024-11-21 03:32:41.821635] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.305 [2024-11-21 03:32:41.821658] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.305 [2024-11-21 03:32:41.829654] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.306 [2024-11-21 03:32:41.829674] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.306 [2024-11-21 03:32:41.832200] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:01.306 [2024-11-21 03:32:41.832273] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3050717 ] 00:16:01.306 [2024-11-21 03:32:41.837674] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.306 [2024-11-21 03:32:41.837694] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.306 [2024-11-21 03:32:41.845696] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.306 [2024-11-21 03:32:41.845716] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.306 [2024-11-21 03:32:41.853718] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.306 [2024-11-21 03:32:41.853738] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.306 EAL: No free 2048 kB hugepages reported on node 1 00:16:01.306 [2024-11-21 03:32:41.861749] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.306 [2024-11-21 03:32:41.861769] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.306 [2024-11-21 03:32:41.869778] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.306 [2024-11-21 03:32:41.869804] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.306 [2024-11-21 03:32:41.877799] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.306 [2024-11-21 03:32:41.877823] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.306 [2024-11-21 03:32:41.885820] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.306 [2024-11-21 03:32:41.885845] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.306 [2024-11-21 03:32:41.893845] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.306 [2024-11-21 03:32:41.893869] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.306 [2024-11-21 03:32:41.894637] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:01.306 [2024-11-21 03:32:41.901894] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.306 [2024-11-21 03:32:41.901928] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.306 [2024-11-21 03:32:41.909914] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.306 [2024-11-21 03:32:41.909961] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.306 [2024-11-21 03:32:41.917914] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.306 [2024-11-21 03:32:41.917939] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.306 [2024-11-21 03:32:41.925935] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.306 [2024-11-21 03:32:41.925959] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.306 [2024-11-21 03:32:41.933958] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.306 [2024-11-21 03:32:41.933983] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.306 [2024-11-21 03:32:41.941980] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.306 [2024-11-21 03:32:41.942011] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.306 [2024-11-21 03:32:41.950002] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.306 [2024-11-21 03:32:41.950027] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.567 [2024-11-21 03:32:41.958038] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.567 [2024-11-21 03:32:41.958087] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.567 [2024-11-21 03:32:41.966091] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.567 [2024-11-21 03:32:41.966141] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.567 [2024-11-21 03:32:41.974067] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.567 [2024-11-21 03:32:41.974101] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.567 [2024-11-21 03:32:41.982096] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.567 [2024-11-21 03:32:41.982120] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.567 [2024-11-21 03:32:41.990132] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.567 [2024-11-21 03:32:41.990154] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.567 [2024-11-21 03:32:41.998150] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.567 [2024-11-21 03:32:41.998171] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.567 [2024-11-21 03:32:42.006167] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.567 [2024-11-21 03:32:42.006189] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.567 [2024-11-21 03:32:42.009898] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:01.567 [2024-11-21 03:32:42.014187] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.567 [2024-11-21 03:32:42.014208] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.567 [2024-11-21 03:32:42.022206] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.567 [2024-11-21 03:32:42.022227] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.567 [2024-11-21 03:32:42.030255] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.567 [2024-11-21 03:32:42.030290] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.567 [2024-11-21 03:32:42.038273] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.567 [2024-11-21 03:32:42.038307] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.567 [2024-11-21 03:32:42.046299] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.567 [2024-11-21 03:32:42.046336] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.567 [2024-11-21 03:32:42.054319] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.567 [2024-11-21 03:32:42.054370] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.567 [2024-11-21 03:32:42.062339] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.567 [2024-11-21 03:32:42.062405] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.567 [2024-11-21 03:32:42.070392] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.567 [2024-11-21 03:32:42.070431] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.567 [2024-11-21 03:32:42.078384] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.567 [2024-11-21 03:32:42.078409] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.567 [2024-11-21 03:32:42.086441] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.567 [2024-11-21 03:32:42.086477] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.567 [2024-11-21 03:32:42.094457] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.567 [2024-11-21 03:32:42.094496] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.567 [2024-11-21 03:32:42.102458] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.567 [2024-11-21 03:32:42.102486] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.567 [2024-11-21 03:32:42.110471] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.567 [2024-11-21 03:32:42.110496] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.567 [2024-11-21 03:32:42.118492] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.567 [2024-11-21 03:32:42.118516] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.567 [2024-11-21 03:32:42.126526] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.567 [2024-11-21 03:32:42.126556] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.567 [2024-11-21 03:32:42.134546] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.567 [2024-11-21 03:32:42.134573] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.567 [2024-11-21 03:32:42.142571] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.567 [2024-11-21 03:32:42.142599] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.567 [2024-11-21 03:32:42.150592] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.567 [2024-11-21 03:32:42.150619] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.567 [2024-11-21 03:32:42.158614] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.567 [2024-11-21 03:32:42.158639] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.567 [2024-11-21 03:32:42.166637] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.567 [2024-11-21 03:32:42.166661] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.567 [2024-11-21 03:32:42.174662] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.567 [2024-11-21 03:32:42.174688] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.567 [2024-11-21 03:32:42.182686] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.567 [2024-11-21 03:32:42.182711] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.567 [2024-11-21 03:32:42.190712] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.567 [2024-11-21 03:32:42.190739] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.567 [2024-11-21 03:32:42.198738] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.567 [2024-11-21 03:32:42.198766] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.567 [2024-11-21 03:32:42.206761] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.567 [2024-11-21 03:32:42.206788] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.829 [2024-11-21 03:32:42.214771] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.829 [2024-11-21 03:32:42.214794] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.829 [2024-11-21 03:32:42.222812] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.829 [2024-11-21 03:32:42.222841] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.829 [2024-11-21 03:32:42.230826] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.829 [2024-11-21 03:32:42.230853] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.829 Running I/O for 5 seconds... 00:16:01.829 [2024-11-21 03:32:42.238847] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.829 [2024-11-21 03:32:42.238872] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.829 [2024-11-21 03:32:42.252549] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.829 [2024-11-21 03:32:42.252578] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.829 [2024-11-21 03:32:42.265407] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.829 [2024-11-21 03:32:42.265435] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.829 [2024-11-21 03:32:42.275592] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.829 [2024-11-21 03:32:42.275620] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.829 [2024-11-21 03:32:42.285753] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.829 [2024-11-21 03:32:42.285780] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.829 [2024-11-21 03:32:42.297247] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.829 [2024-11-21 03:32:42.297278] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.829 [2024-11-21 03:32:42.308261] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.829 [2024-11-21 03:32:42.308289] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.829 [2024-11-21 03:32:42.319031] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.829 [2024-11-21 03:32:42.319062] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.829 [2024-11-21 03:32:42.329809] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.829 [2024-11-21 03:32:42.329839] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.829 [2024-11-21 03:32:42.340918] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.829 [2024-11-21 03:32:42.340949] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.829 [2024-11-21 03:32:42.353581] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.829 [2024-11-21 03:32:42.353611] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.829 [2024-11-21 03:32:42.365410] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.829 [2024-11-21 03:32:42.365438] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.829 [2024-11-21 03:32:42.374219] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.829 [2024-11-21 03:32:42.374246] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.829 [2024-11-21 03:32:42.385618] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.829 [2024-11-21 03:32:42.385649] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.829 [2024-11-21 03:32:42.396196] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.829 [2024-11-21 03:32:42.396224] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.829 [2024-11-21 03:32:42.407061] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.829 [2024-11-21 03:32:42.407096] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.829 [2024-11-21 03:32:42.419677] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.829 [2024-11-21 03:32:42.419707] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.829 [2024-11-21 03:32:42.429573] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.829 [2024-11-21 03:32:42.429603] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.829 [2024-11-21 03:32:42.440348] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.829 [2024-11-21 03:32:42.440375] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.829 [2024-11-21 03:32:42.451180] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.829 [2024-11-21 03:32:42.451208] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.829 [2024-11-21 03:32:42.463935] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.829 [2024-11-21 03:32:42.463965] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:01.829 [2024-11-21 03:32:42.473775] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:01.829 [2024-11-21 03:32:42.473804] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.090 [2024-11-21 03:32:42.484425] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.090 [2024-11-21 03:32:42.484453] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.090 [2024-11-21 03:32:42.497292] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.090 [2024-11-21 03:32:42.497321] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.090 [2024-11-21 03:32:42.507370] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.090 [2024-11-21 03:32:42.507397] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.090 [2024-11-21 03:32:42.517971] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.090 [2024-11-21 03:32:42.518001] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.090 [2024-11-21 03:32:42.528360] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.090 [2024-11-21 03:32:42.528387] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.090 [2024-11-21 03:32:42.539525] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.090 [2024-11-21 03:32:42.539555] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.090 [2024-11-21 03:32:42.550591] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.090 [2024-11-21 03:32:42.550620] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.090 [2024-11-21 03:32:42.563521] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.090 [2024-11-21 03:32:42.563551] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.090 [2024-11-21 03:32:42.573843] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.090 [2024-11-21 03:32:42.573874] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.090 [2024-11-21 03:32:42.584675] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.090 [2024-11-21 03:32:42.584706] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.090 [2024-11-21 03:32:42.597261] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.090 [2024-11-21 03:32:42.597292] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.090 [2024-11-21 03:32:42.606950] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.090 [2024-11-21 03:32:42.606980] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.090 [2024-11-21 03:32:42.618657] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.090 [2024-11-21 03:32:42.618697] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.090 [2024-11-21 03:32:42.629135] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.091 [2024-11-21 03:32:42.629165] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.091 [2024-11-21 03:32:42.639870] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.091 [2024-11-21 03:32:42.639901] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.091 [2024-11-21 03:32:42.652561] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.091 [2024-11-21 03:32:42.652591] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.091 [2024-11-21 03:32:42.662855] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.091 [2024-11-21 03:32:42.662885] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.091 [2024-11-21 03:32:42.674118] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.091 [2024-11-21 03:32:42.674148] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.091 [2024-11-21 03:32:42.686755] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.091 [2024-11-21 03:32:42.686785] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.091 [2024-11-21 03:32:42.696401] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.091 [2024-11-21 03:32:42.696432] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.091 [2024-11-21 03:32:42.707975] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.091 [2024-11-21 03:32:42.708005] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.091 [2024-11-21 03:32:42.721019] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.091 [2024-11-21 03:32:42.721049] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.091 [2024-11-21 03:32:42.731309] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.091 [2024-11-21 03:32:42.731344] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.352 [2024-11-21 03:32:42.742455] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.352 [2024-11-21 03:32:42.742485] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.352 [2024-11-21 03:32:42.755591] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.352 [2024-11-21 03:32:42.755622] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.352 [2024-11-21 03:32:42.765932] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.352 [2024-11-21 03:32:42.765962] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.352 [2024-11-21 03:32:42.776854] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.352 [2024-11-21 03:32:42.776884] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.352 [2024-11-21 03:32:42.790095] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.352 [2024-11-21 03:32:42.790125] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.352 [2024-11-21 03:32:42.800761] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.352 [2024-11-21 03:32:42.800791] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.352 [2024-11-21 03:32:42.811547] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.352 [2024-11-21 03:32:42.811577] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.352 [2024-11-21 03:32:42.824209] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.352 [2024-11-21 03:32:42.824240] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.352 [2024-11-21 03:32:42.834334] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.352 [2024-11-21 03:32:42.834372] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.352 [2024-11-21 03:32:42.845616] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.352 [2024-11-21 03:32:42.845646] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.352 [2024-11-21 03:32:42.858319] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.352 [2024-11-21 03:32:42.858349] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.352 [2024-11-21 03:32:42.868229] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.352 [2024-11-21 03:32:42.868259] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.352 [2024-11-21 03:32:42.879780] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.352 [2024-11-21 03:32:42.879812] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.352 [2024-11-21 03:32:42.890286] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.352 [2024-11-21 03:32:42.890316] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.352 [2024-11-21 03:32:42.901156] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.352 [2024-11-21 03:32:42.901186] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.352 [2024-11-21 03:32:42.912062] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.352 [2024-11-21 03:32:42.912101] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.352 [2024-11-21 03:32:42.923013] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.352 [2024-11-21 03:32:42.923043] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.352 [2024-11-21 03:32:42.935789] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.352 [2024-11-21 03:32:42.935818] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.352 [2024-11-21 03:32:42.946064] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.352 [2024-11-21 03:32:42.946102] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.352 [2024-11-21 03:32:42.956678] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.352 [2024-11-21 03:32:42.956708] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.352 [2024-11-21 03:32:42.967447] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.352 [2024-11-21 03:32:42.967477] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.352 [2024-11-21 03:32:42.978364] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.352 [2024-11-21 03:32:42.978395] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.352 [2024-11-21 03:32:42.991164] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.352 [2024-11-21 03:32:42.991194] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.613 [2024-11-21 03:32:43.001949] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.613 [2024-11-21 03:32:43.001981] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.613 [2024-11-21 03:32:43.012965] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.613 [2024-11-21 03:32:43.012995] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.613 [2024-11-21 03:32:43.025695] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.613 [2024-11-21 03:32:43.025725] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.613 [2024-11-21 03:32:43.035865] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.613 [2024-11-21 03:32:43.035896] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.613 [2024-11-21 03:32:43.046187] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.613 [2024-11-21 03:32:43.046226] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.613 [2024-11-21 03:32:43.057140] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.613 [2024-11-21 03:32:43.057170] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.613 [2024-11-21 03:32:43.068270] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.613 [2024-11-21 03:32:43.068300] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.613 [2024-11-21 03:32:43.081062] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.613 [2024-11-21 03:32:43.081103] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.613 [2024-11-21 03:32:43.091492] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.613 [2024-11-21 03:32:43.091523] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.613 [2024-11-21 03:32:43.102102] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.613 [2024-11-21 03:32:43.102143] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.613 [2024-11-21 03:32:43.113182] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.613 [2024-11-21 03:32:43.113212] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.613 [2024-11-21 03:32:43.124001] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.613 [2024-11-21 03:32:43.124031] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.613 [2024-11-21 03:32:43.137023] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.613 [2024-11-21 03:32:43.137052] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.613 [2024-11-21 03:32:43.147507] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.613 [2024-11-21 03:32:43.147537] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.613 [2024-11-21 03:32:43.158531] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.613 [2024-11-21 03:32:43.158562] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.613 [2024-11-21 03:32:43.169451] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.613 [2024-11-21 03:32:43.169482] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.613 [2024-11-21 03:32:43.179739] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.613 [2024-11-21 03:32:43.179766] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.613 [2024-11-21 03:32:43.190121] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.613 [2024-11-21 03:32:43.190149] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.613 [2024-11-21 03:32:43.200134] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.613 [2024-11-21 03:32:43.200161] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.613 [2024-11-21 03:32:43.209828] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.613 [2024-11-21 03:32:43.209855] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.613 [2024-11-21 03:32:43.221842] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.613 [2024-11-21 03:32:43.221876] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.613 [2024-11-21 03:32:43.230315] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.613 [2024-11-21 03:32:43.230342] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.613 [2024-11-21 03:32:43.242937] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.613 [2024-11-21 03:32:43.242964] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.613 [2024-11-21 03:32:43.254297] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.613 [2024-11-21 03:32:43.254336] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.874 [2024-11-21 03:32:43.263087] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.874 [2024-11-21 03:32:43.263126] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.874 [2024-11-21 03:32:43.273976] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.874 [2024-11-21 03:32:43.274003] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.874 [2024-11-21 03:32:43.286274] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.874 [2024-11-21 03:32:43.286301] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.874 [2024-11-21 03:32:43.295156] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.874 [2024-11-21 03:32:43.295184] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.874 [2024-11-21 03:32:43.307663] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.874 [2024-11-21 03:32:43.307690] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.874 [2024-11-21 03:32:43.319146] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.874 [2024-11-21 03:32:43.319172] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.874 [2024-11-21 03:32:43.327544] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.874 [2024-11-21 03:32:43.327571] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.874 [2024-11-21 03:32:43.339828] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.874 [2024-11-21 03:32:43.339855] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.874 [2024-11-21 03:32:43.349244] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.874 [2024-11-21 03:32:43.349272] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.874 [2024-11-21 03:32:43.359388] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.874 [2024-11-21 03:32:43.359415] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.874 [2024-11-21 03:32:43.369394] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.874 [2024-11-21 03:32:43.369421] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.874 [2024-11-21 03:32:43.379536] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.874 [2024-11-21 03:32:43.379563] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.875 [2024-11-21 03:32:43.389449] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.875 [2024-11-21 03:32:43.389477] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.875 [2024-11-21 03:32:43.399608] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.875 [2024-11-21 03:32:43.399635] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.875 [2024-11-21 03:32:43.409566] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.875 [2024-11-21 03:32:43.409593] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.875 [2024-11-21 03:32:43.419624] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.875 [2024-11-21 03:32:43.419651] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.875 [2024-11-21 03:32:43.429474] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.875 [2024-11-21 03:32:43.429501] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.875 [2024-11-21 03:32:43.439656] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.875 [2024-11-21 03:32:43.439683] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.875 [2024-11-21 03:32:43.451352] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.875 [2024-11-21 03:32:43.451379] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.875 [2024-11-21 03:32:43.460900] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.875 [2024-11-21 03:32:43.460927] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.875 [2024-11-21 03:32:43.471199] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.875 [2024-11-21 03:32:43.471226] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.875 [2024-11-21 03:32:43.484860] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.875 [2024-11-21 03:32:43.484887] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.875 [2024-11-21 03:32:43.495999] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.875 [2024-11-21 03:32:43.496026] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.875 [2024-11-21 03:32:43.504671] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.875 [2024-11-21 03:32:43.504699] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:02.875 [2024-11-21 03:32:43.515609] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:02.875 [2024-11-21 03:32:43.515636] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.134 [2024-11-21 03:32:43.528781] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.134 [2024-11-21 03:32:43.528809] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.134 [2024-11-21 03:32:43.538176] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.134 [2024-11-21 03:32:43.538203] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.134 [2024-11-21 03:32:43.548115] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.134 [2024-11-21 03:32:43.548142] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.134 [2024-11-21 03:32:43.558409] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.134 [2024-11-21 03:32:43.558436] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.134 [2024-11-21 03:32:43.570973] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.134 [2024-11-21 03:32:43.571000] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.134 [2024-11-21 03:32:43.580227] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.134 [2024-11-21 03:32:43.580253] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.134 [2024-11-21 03:32:43.592756] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.134 [2024-11-21 03:32:43.592783] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.134 [2024-11-21 03:32:43.604634] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.134 [2024-11-21 03:32:43.604662] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.134 [2024-11-21 03:32:43.613908] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.134 [2024-11-21 03:32:43.613935] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.135 [2024-11-21 03:32:43.624005] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.135 [2024-11-21 03:32:43.624033] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.135 [2024-11-21 03:32:43.634247] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.135 [2024-11-21 03:32:43.634274] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.135 [2024-11-21 03:32:43.644773] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.135 [2024-11-21 03:32:43.644800] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.135 [2024-11-21 03:32:43.657427] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.135 [2024-11-21 03:32:43.657454] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.135 [2024-11-21 03:32:43.667447] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.135 [2024-11-21 03:32:43.667477] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.135 [2024-11-21 03:32:43.678393] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.135 [2024-11-21 03:32:43.678420] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.135 [2024-11-21 03:32:43.688908] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.135 [2024-11-21 03:32:43.688935] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.135 [2024-11-21 03:32:43.699834] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.135 [2024-11-21 03:32:43.699861] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.135 [2024-11-21 03:32:43.710896] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.135 [2024-11-21 03:32:43.710924] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.135 [2024-11-21 03:32:43.721806] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.135 [2024-11-21 03:32:43.721834] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.135 [2024-11-21 03:32:43.731926] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.135 [2024-11-21 03:32:43.731955] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.135 [2024-11-21 03:32:43.742478] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.135 [2024-11-21 03:32:43.742506] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.135 [2024-11-21 03:32:43.753263] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.135 [2024-11-21 03:32:43.753291] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.135 [2024-11-21 03:32:43.763458] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.135 [2024-11-21 03:32:43.763486] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.135 [2024-11-21 03:32:43.773469] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.135 [2024-11-21 03:32:43.773496] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.395 [2024-11-21 03:32:43.784484] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.395 [2024-11-21 03:32:43.784515] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.395 [2024-11-21 03:32:43.795202] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.395 [2024-11-21 03:32:43.795229] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.395 [2024-11-21 03:32:43.805763] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.395 [2024-11-21 03:32:43.805795] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.395 [2024-11-21 03:32:43.816435] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.395 [2024-11-21 03:32:43.816467] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.395 [2024-11-21 03:32:43.827114] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.395 [2024-11-21 03:32:43.827143] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.395 [2024-11-21 03:32:43.837677] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.395 [2024-11-21 03:32:43.837708] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.395 [2024-11-21 03:32:43.848183] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.395 [2024-11-21 03:32:43.848211] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.395 [2024-11-21 03:32:43.858869] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.395 [2024-11-21 03:32:43.858901] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.395 [2024-11-21 03:32:43.869519] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.395 [2024-11-21 03:32:43.869549] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.395 [2024-11-21 03:32:43.880033] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.395 [2024-11-21 03:32:43.880060] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.395 [2024-11-21 03:32:43.892679] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.395 [2024-11-21 03:32:43.892710] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.395 [2024-11-21 03:32:43.902760] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.395 [2024-11-21 03:32:43.902791] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.395 [2024-11-21 03:32:43.913528] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.395 [2024-11-21 03:32:43.913556] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.395 [2024-11-21 03:32:43.926472] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.395 [2024-11-21 03:32:43.926503] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.395 [2024-11-21 03:32:43.936692] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.395 [2024-11-21 03:32:43.936723] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.395 [2024-11-21 03:32:43.947286] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.395 [2024-11-21 03:32:43.947314] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.396 [2024-11-21 03:32:43.958201] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.396 [2024-11-21 03:32:43.958228] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.396 [2024-11-21 03:32:43.969006] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.396 [2024-11-21 03:32:43.969050] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.396 [2024-11-21 03:32:43.982008] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.396 [2024-11-21 03:32:43.982038] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.396 [2024-11-21 03:32:43.992185] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.396 [2024-11-21 03:32:43.992211] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.396 [2024-11-21 03:32:44.002591] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.396 [2024-11-21 03:32:44.002621] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.396 [2024-11-21 03:32:44.013351] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.396 [2024-11-21 03:32:44.013378] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.396 [2024-11-21 03:32:44.025823] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.396 [2024-11-21 03:32:44.025853] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.396 [2024-11-21 03:32:44.035586] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.396 [2024-11-21 03:32:44.035616] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.683 [2024-11-21 03:32:44.047355] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.683 [2024-11-21 03:32:44.047383] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.683 [2024-11-21 03:32:44.060037] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.683 [2024-11-21 03:32:44.060064] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.683 [2024-11-21 03:32:44.070016] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.683 [2024-11-21 03:32:44.070044] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.683 [2024-11-21 03:32:44.081170] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.683 [2024-11-21 03:32:44.081198] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.683 [2024-11-21 03:32:44.093333] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.683 [2024-11-21 03:32:44.093360] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.683 [2024-11-21 03:32:44.103311] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.683 [2024-11-21 03:32:44.103339] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.683 [2024-11-21 03:32:44.114280] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.683 [2024-11-21 03:32:44.114307] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.683 [2024-11-21 03:32:44.125159] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.683 [2024-11-21 03:32:44.125200] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.683 [2024-11-21 03:32:44.135716] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.683 [2024-11-21 03:32:44.135747] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.683 [2024-11-21 03:32:44.146649] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.683 [2024-11-21 03:32:44.146679] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.683 [2024-11-21 03:32:44.157896] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.683 [2024-11-21 03:32:44.157927] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.683 [2024-11-21 03:32:44.169224] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.683 [2024-11-21 03:32:44.169251] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.683 [2024-11-21 03:32:44.180647] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.683 [2024-11-21 03:32:44.180677] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.683 [2024-11-21 03:32:44.193039] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.683 [2024-11-21 03:32:44.193077] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.683 [2024-11-21 03:32:44.202453] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.683 [2024-11-21 03:32:44.202483] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.683 [2024-11-21 03:32:44.214362] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.683 [2024-11-21 03:32:44.214388] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.683 [2024-11-21 03:32:44.225045] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.683 [2024-11-21 03:32:44.225080] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.683 [2024-11-21 03:32:44.236021] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.683 [2024-11-21 03:32:44.236051] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.683 [2024-11-21 03:32:44.248529] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.683 [2024-11-21 03:32:44.248559] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.683 [2024-11-21 03:32:44.258815] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.683 [2024-11-21 03:32:44.258845] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.683 [2024-11-21 03:32:44.269218] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.683 [2024-11-21 03:32:44.269253] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.683 [2024-11-21 03:32:44.280429] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.683 [2024-11-21 03:32:44.280459] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.683 [2024-11-21 03:32:44.291541] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.683 [2024-11-21 03:32:44.291571] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.683 [2024-11-21 03:32:44.302533] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.683 [2024-11-21 03:32:44.302559] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.683 [2024-11-21 03:32:44.313316] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.683 [2024-11-21 03:32:44.313344] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.683 [2024-11-21 03:32:44.326534] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.683 [2024-11-21 03:32:44.326577] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.944 [2024-11-21 03:32:44.337213] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.944 [2024-11-21 03:32:44.337240] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.944 [2024-11-21 03:32:44.348392] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.944 [2024-11-21 03:32:44.348419] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.944 [2024-11-21 03:32:44.361670] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.944 [2024-11-21 03:32:44.361700] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.944 [2024-11-21 03:32:44.371947] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.944 [2024-11-21 03:32:44.371974] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.944 [2024-11-21 03:32:44.382490] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.944 [2024-11-21 03:32:44.382517] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.944 [2024-11-21 03:32:44.392819] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.944 [2024-11-21 03:32:44.392846] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.944 [2024-11-21 03:32:44.403708] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.944 [2024-11-21 03:32:44.403735] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.944 [2024-11-21 03:32:44.414041] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.944 [2024-11-21 03:32:44.414079] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.944 [2024-11-21 03:32:44.424734] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.944 [2024-11-21 03:32:44.424765] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.944 [2024-11-21 03:32:44.435843] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.944 [2024-11-21 03:32:44.435871] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.944 [2024-11-21 03:32:44.446817] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.944 [2024-11-21 03:32:44.446844] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.944 [2024-11-21 03:32:44.459396] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.944 [2024-11-21 03:32:44.459423] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.944 [2024-11-21 03:32:44.469196] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.944 [2024-11-21 03:32:44.469223] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.945 [2024-11-21 03:32:44.479953] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.945 [2024-11-21 03:32:44.479989] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.945 [2024-11-21 03:32:44.492657] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.945 [2024-11-21 03:32:44.492687] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.945 [2024-11-21 03:32:44.502965] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.945 [2024-11-21 03:32:44.502994] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.945 [2024-11-21 03:32:44.513554] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.945 [2024-11-21 03:32:44.513581] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.945 [2024-11-21 03:32:44.523748] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.945 [2024-11-21 03:32:44.523778] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.945 [2024-11-21 03:32:44.534420] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.945 [2024-11-21 03:32:44.534447] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.945 [2024-11-21 03:32:44.545434] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.945 [2024-11-21 03:32:44.545461] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.945 [2024-11-21 03:32:44.556314] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.945 [2024-11-21 03:32:44.556341] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.945 [2024-11-21 03:32:44.568723] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.945 [2024-11-21 03:32:44.568750] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.945 [2024-11-21 03:32:44.578545] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.945 [2024-11-21 03:32:44.578574] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:03.945 [2024-11-21 03:32:44.589349] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:03.945 [2024-11-21 03:32:44.589376] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.205 [2024-11-21 03:32:44.601905] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.205 [2024-11-21 03:32:44.601933] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.205 [2024-11-21 03:32:44.611518] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.205 [2024-11-21 03:32:44.611549] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.205 [2024-11-21 03:32:44.624091] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.205 [2024-11-21 03:32:44.624119] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.205 [2024-11-21 03:32:44.634660] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.205 [2024-11-21 03:32:44.634690] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.205 [2024-11-21 03:32:44.644741] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.205 [2024-11-21 03:32:44.644769] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.205 [2024-11-21 03:32:44.655241] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.205 [2024-11-21 03:32:44.655269] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.205 [2024-11-21 03:32:44.665371] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.205 [2024-11-21 03:32:44.665398] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.205 [2024-11-21 03:32:44.676166] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.205 [2024-11-21 03:32:44.676193] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.205 [2024-11-21 03:32:44.688253] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.205 [2024-11-21 03:32:44.688289] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.205 [2024-11-21 03:32:44.697940] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.205 [2024-11-21 03:32:44.697968] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.205 [2024-11-21 03:32:44.709058] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.205 [2024-11-21 03:32:44.709092] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.205 [2024-11-21 03:32:44.719360] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.205 [2024-11-21 03:32:44.719387] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.205 [2024-11-21 03:32:44.729919] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.205 [2024-11-21 03:32:44.729946] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.205 [2024-11-21 03:32:44.740333] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.205 [2024-11-21 03:32:44.740363] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.205 [2024-11-21 03:32:44.750735] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.205 [2024-11-21 03:32:44.750762] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.205 [2024-11-21 03:32:44.761420] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.205 [2024-11-21 03:32:44.761451] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.205 [2024-11-21 03:32:44.771872] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.205 [2024-11-21 03:32:44.771899] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.205 [2024-11-21 03:32:44.782148] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.205 [2024-11-21 03:32:44.782174] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.205 [2024-11-21 03:32:44.792745] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.205 [2024-11-21 03:32:44.792776] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.205 [2024-11-21 03:32:44.803448] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.205 [2024-11-21 03:32:44.803475] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.205 [2024-11-21 03:32:44.815843] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.205 [2024-11-21 03:32:44.815873] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.205 [2024-11-21 03:32:44.825398] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.205 [2024-11-21 03:32:44.825425] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.205 [2024-11-21 03:32:44.836312] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.205 [2024-11-21 03:32:44.836339] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.205 [2024-11-21 03:32:44.846798] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.205 [2024-11-21 03:32:44.846825] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.464 [2024-11-21 03:32:44.857261] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.464 [2024-11-21 03:32:44.857289] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.464 [2024-11-21 03:32:44.870573] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.464 [2024-11-21 03:32:44.870605] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.464 [2024-11-21 03:32:44.880599] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.464 [2024-11-21 03:32:44.880627] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.464 [2024-11-21 03:32:44.890848] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.464 [2024-11-21 03:32:44.890884] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.464 [2024-11-21 03:32:44.901629] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.464 [2024-11-21 03:32:44.901656] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.464 [2024-11-21 03:32:44.912185] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.464 [2024-11-21 03:32:44.912213] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.464 [2024-11-21 03:32:44.923484] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.464 [2024-11-21 03:32:44.923512] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.464 [2024-11-21 03:32:44.936200] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.464 [2024-11-21 03:32:44.936228] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.464 [2024-11-21 03:32:44.946517] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.464 [2024-11-21 03:32:44.946547] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.464 [2024-11-21 03:32:44.957431] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.464 [2024-11-21 03:32:44.957470] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.464 [2024-11-21 03:32:44.969883] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.464 [2024-11-21 03:32:44.969913] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.464 [2024-11-21 03:32:44.979448] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.464 [2024-11-21 03:32:44.979474] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.464 [2024-11-21 03:32:44.991148] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.464 [2024-11-21 03:32:44.991176] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.464 [2024-11-21 03:32:45.001898] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.464 [2024-11-21 03:32:45.001925] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.464 [2024-11-21 03:32:45.012625] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.464 [2024-11-21 03:32:45.012653] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.464 [2024-11-21 03:32:45.023030] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.464 [2024-11-21 03:32:45.023057] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.464 [2024-11-21 03:32:45.033475] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.464 [2024-11-21 03:32:45.033502] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.464 [2024-11-21 03:32:45.044093] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.464 [2024-11-21 03:32:45.044120] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.464 [2024-11-21 03:32:45.054768] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.464 [2024-11-21 03:32:45.054795] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.464 [2024-11-21 03:32:45.067473] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.464 [2024-11-21 03:32:45.067500] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.465 [2024-11-21 03:32:45.077331] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.465 [2024-11-21 03:32:45.077362] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.465 [2024-11-21 03:32:45.087920] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.465 [2024-11-21 03:32:45.087947] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.465 [2024-11-21 03:32:45.100261] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.465 [2024-11-21 03:32:45.100289] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.465 [2024-11-21 03:32:45.110101] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.465 [2024-11-21 03:32:45.110129] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.725 [2024-11-21 03:32:45.120580] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.725 [2024-11-21 03:32:45.120607] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.725 [2024-11-21 03:32:45.131426] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.725 [2024-11-21 03:32:45.131454] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.725 [2024-11-21 03:32:45.142241] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.725 [2024-11-21 03:32:45.142268] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.725 [2024-11-21 03:32:45.153340] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.725 [2024-11-21 03:32:45.153371] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.725 [2024-11-21 03:32:45.164229] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.725 [2024-11-21 03:32:45.164256] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.725 [2024-11-21 03:32:45.174484] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.725 [2024-11-21 03:32:45.174512] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.725 [2024-11-21 03:32:45.185202] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.725 [2024-11-21 03:32:45.185229] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.725 [2024-11-21 03:32:45.196167] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.725 [2024-11-21 03:32:45.196194] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.725 [2024-11-21 03:32:45.209180] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.725 [2024-11-21 03:32:45.209207] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.725 [2024-11-21 03:32:45.219256] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.725 [2024-11-21 03:32:45.219284] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.725 [2024-11-21 03:32:45.229901] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.725 [2024-11-21 03:32:45.229929] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.725 [2024-11-21 03:32:45.240353] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.725 [2024-11-21 03:32:45.240381] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.725 [2024-11-21 03:32:45.250384] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.725 [2024-11-21 03:32:45.250411] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.725 [2024-11-21 03:32:45.260937] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.725 [2024-11-21 03:32:45.260967] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.725 [2024-11-21 03:32:45.271591] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.725 [2024-11-21 03:32:45.271621] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.725 [2024-11-21 03:32:45.282666] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.725 [2024-11-21 03:32:45.282696] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.725 [2024-11-21 03:32:45.293644] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.725 [2024-11-21 03:32:45.293673] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.725 [2024-11-21 03:32:45.306504] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.725 [2024-11-21 03:32:45.306534] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.725 [2024-11-21 03:32:45.316546] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.725 [2024-11-21 03:32:45.316576] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.725 [2024-11-21 03:32:45.327954] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.725 [2024-11-21 03:32:45.327984] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.725 [2024-11-21 03:32:45.338888] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.725 [2024-11-21 03:32:45.338918] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.725 [2024-11-21 03:32:45.349390] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.725 [2024-11-21 03:32:45.349420] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.725 [2024-11-21 03:32:45.360098] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.725 [2024-11-21 03:32:45.360128] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.725 [2024-11-21 03:32:45.370962] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.725 [2024-11-21 03:32:45.370992] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.987 [2024-11-21 03:32:45.382094] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.987 [2024-11-21 03:32:45.382125] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.987 [2024-11-21 03:32:45.393025] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.987 [2024-11-21 03:32:45.393055] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.987 [2024-11-21 03:32:45.403988] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.987 [2024-11-21 03:32:45.404018] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.987 [2024-11-21 03:32:45.414869] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.987 [2024-11-21 03:32:45.414899] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.987 [2024-11-21 03:32:45.425808] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.987 [2024-11-21 03:32:45.425839] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.987 [2024-11-21 03:32:45.438564] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.987 [2024-11-21 03:32:45.438594] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.987 [2024-11-21 03:32:45.448591] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.988 [2024-11-21 03:32:45.448621] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.988 [2024-11-21 03:32:45.459834] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.988 [2024-11-21 03:32:45.459865] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.988 [2024-11-21 03:32:45.472344] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.988 [2024-11-21 03:32:45.472374] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.988 [2024-11-21 03:32:45.482699] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.988 [2024-11-21 03:32:45.482729] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.988 [2024-11-21 03:32:45.494187] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.988 [2024-11-21 03:32:45.494217] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.988 [2024-11-21 03:32:45.505006] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.988 [2024-11-21 03:32:45.505037] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.988 [2024-11-21 03:32:45.515873] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.988 [2024-11-21 03:32:45.515903] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.988 [2024-11-21 03:32:45.528601] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.988 [2024-11-21 03:32:45.528631] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.988 [2024-11-21 03:32:45.538136] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.988 [2024-11-21 03:32:45.538166] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.988 [2024-11-21 03:32:45.549816] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.988 [2024-11-21 03:32:45.549846] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.988 [2024-11-21 03:32:45.560730] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.988 [2024-11-21 03:32:45.560761] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.988 [2024-11-21 03:32:45.571548] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.988 [2024-11-21 03:32:45.571578] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.988 [2024-11-21 03:32:45.583915] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.988 [2024-11-21 03:32:45.583947] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.988 [2024-11-21 03:32:45.594198] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.988 [2024-11-21 03:32:45.594228] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.988 [2024-11-21 03:32:45.605097] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.988 [2024-11-21 03:32:45.605133] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.988 [2024-11-21 03:32:45.618189] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.988 [2024-11-21 03:32:45.618219] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:04.988 [2024-11-21 03:32:45.628836] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:04.988 [2024-11-21 03:32:45.628867] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.250 [2024-11-21 03:32:45.640058] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.250 [2024-11-21 03:32:45.640097] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.250 [2024-11-21 03:32:45.650943] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.250 [2024-11-21 03:32:45.650974] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.250 [2024-11-21 03:32:45.662381] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.250 [2024-11-21 03:32:45.662410] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.250 [2024-11-21 03:32:45.673701] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.250 [2024-11-21 03:32:45.673731] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.250 [2024-11-21 03:32:45.686939] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.250 [2024-11-21 03:32:45.686969] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.250 [2024-11-21 03:32:45.697578] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.250 [2024-11-21 03:32:45.697608] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.250 [2024-11-21 03:32:45.708079] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.250 [2024-11-21 03:32:45.708109] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.250 [2024-11-21 03:32:45.719212] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.250 [2024-11-21 03:32:45.719243] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.250 [2024-11-21 03:32:45.730149] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.250 [2024-11-21 03:32:45.730178] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.250 [2024-11-21 03:32:45.742644] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.250 [2024-11-21 03:32:45.742673] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.250 [2024-11-21 03:32:45.751563] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.250 [2024-11-21 03:32:45.751593] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.250 [2024-11-21 03:32:45.764608] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.250 [2024-11-21 03:32:45.764638] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.250 [2024-11-21 03:32:45.775411] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.250 [2024-11-21 03:32:45.775441] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.250 [2024-11-21 03:32:45.786294] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.250 [2024-11-21 03:32:45.786324] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.250 [2024-11-21 03:32:45.799181] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.250 [2024-11-21 03:32:45.799212] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.250 [2024-11-21 03:32:45.809433] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.250 [2024-11-21 03:32:45.809463] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.250 [2024-11-21 03:32:45.819990] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.250 [2024-11-21 03:32:45.820020] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.250 [2024-11-21 03:32:45.831129] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.250 [2024-11-21 03:32:45.831159] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.250 [2024-11-21 03:32:45.842148] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.250 [2024-11-21 03:32:45.842179] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.250 [2024-11-21 03:32:45.854608] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.250 [2024-11-21 03:32:45.854638] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.250 [2024-11-21 03:32:45.864512] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.250 [2024-11-21 03:32:45.864542] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.250 [2024-11-21 03:32:45.875955] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.250 [2024-11-21 03:32:45.875985] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.250 [2024-11-21 03:32:45.886869] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.250 [2024-11-21 03:32:45.886900] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.509 [2024-11-21 03:32:45.898224] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.509 [2024-11-21 03:32:45.898255] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.509 [2024-11-21 03:32:45.911366] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.509 [2024-11-21 03:32:45.911396] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.509 [2024-11-21 03:32:45.921793] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.509 [2024-11-21 03:32:45.921824] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.509 [2024-11-21 03:32:45.933379] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.509 [2024-11-21 03:32:45.933420] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.509 [2024-11-21 03:32:45.944723] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.509 [2024-11-21 03:32:45.944753] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.510 [2024-11-21 03:32:45.957982] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.510 [2024-11-21 03:32:45.958012] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.510 [2024-11-21 03:32:45.968869] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.510 [2024-11-21 03:32:45.968899] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.510 [2024-11-21 03:32:45.980351] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.510 [2024-11-21 03:32:45.980382] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.510 [2024-11-21 03:32:45.991317] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.510 [2024-11-21 03:32:45.991347] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.510 [2024-11-21 03:32:46.002371] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.510 [2024-11-21 03:32:46.002401] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.510 [2024-11-21 03:32:46.013586] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.510 [2024-11-21 03:32:46.013616] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.510 [2024-11-21 03:32:46.026620] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.510 [2024-11-21 03:32:46.026650] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.510 [2024-11-21 03:32:46.036819] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.510 [2024-11-21 03:32:46.036850] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.510 [2024-11-21 03:32:46.047824] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.510 [2024-11-21 03:32:46.047855] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.510 [2024-11-21 03:32:46.060571] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.510 [2024-11-21 03:32:46.060602] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.510 [2024-11-21 03:32:46.070927] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.510 [2024-11-21 03:32:46.070969] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.510 [2024-11-21 03:32:46.081683] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.510 [2024-11-21 03:32:46.081714] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.510 [2024-11-21 03:32:46.095038] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.510 [2024-11-21 03:32:46.095080] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.510 [2024-11-21 03:32:46.105440] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.510 [2024-11-21 03:32:46.105470] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.510 [2024-11-21 03:32:46.116550] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.510 [2024-11-21 03:32:46.116580] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.510 [2024-11-21 03:32:46.127875] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.510 [2024-11-21 03:32:46.127905] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.510 [2024-11-21 03:32:46.138546] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.510 [2024-11-21 03:32:46.138576] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.510 [2024-11-21 03:32:46.149483] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.510 [2024-11-21 03:32:46.149533] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.769 [2024-11-21 03:32:46.160117] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.769 [2024-11-21 03:32:46.160148] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.769 [2024-11-21 03:32:46.171334] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.769 [2024-11-21 03:32:46.171364] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.769 [2024-11-21 03:32:46.182386] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.769 [2024-11-21 03:32:46.182416] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.769 [2024-11-21 03:32:46.195801] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.769 [2024-11-21 03:32:46.195831] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.769 [2024-11-21 03:32:46.206094] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.769 [2024-11-21 03:32:46.206124] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.769 [2024-11-21 03:32:46.216781] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.769 [2024-11-21 03:32:46.216812] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.769 [2024-11-21 03:32:46.227786] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.769 [2024-11-21 03:32:46.227815] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.769 [2024-11-21 03:32:46.238618] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.769 [2024-11-21 03:32:46.238648] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.769 [2024-11-21 03:32:46.251546] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.769 [2024-11-21 03:32:46.251576] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.769 [2024-11-21 03:32:46.261972] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.769 [2024-11-21 03:32:46.262001] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.769 [2024-11-21 03:32:46.272743] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.769 [2024-11-21 03:32:46.272773] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.769 [2024-11-21 03:32:46.285865] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.769 [2024-11-21 03:32:46.285895] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.769 [2024-11-21 03:32:46.296261] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.769 [2024-11-21 03:32:46.296291] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.769 [2024-11-21 03:32:46.307365] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.769 [2024-11-21 03:32:46.307394] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.769 [2024-11-21 03:32:46.320530] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.769 [2024-11-21 03:32:46.320560] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.769 [2024-11-21 03:32:46.331005] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.769 [2024-11-21 03:32:46.331035] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.770 [2024-11-21 03:32:46.342166] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.770 [2024-11-21 03:32:46.342195] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.770 [2024-11-21 03:32:46.354772] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.770 [2024-11-21 03:32:46.354803] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.770 [2024-11-21 03:32:46.365020] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.770 [2024-11-21 03:32:46.365059] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.770 [2024-11-21 03:32:46.375877] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.770 [2024-11-21 03:32:46.375906] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.770 [2024-11-21 03:32:46.388874] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.770 [2024-11-21 03:32:46.388904] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.770 [2024-11-21 03:32:46.399225] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.770 [2024-11-21 03:32:46.399255] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:05.770 [2024-11-21 03:32:46.410169] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:05.770 [2024-11-21 03:32:46.410199] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.029 [2024-11-21 03:32:46.422501] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.029 [2024-11-21 03:32:46.422531] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.029 [2024-11-21 03:32:46.432644] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.029 [2024-11-21 03:32:46.432674] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.029 [2024-11-21 03:32:46.443954] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.029 [2024-11-21 03:32:46.443984] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.029 [2024-11-21 03:32:46.457247] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.029 [2024-11-21 03:32:46.457277] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.029 [2024-11-21 03:32:46.467652] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.029 [2024-11-21 03:32:46.467682] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.029 [2024-11-21 03:32:46.478649] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.029 [2024-11-21 03:32:46.478678] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.029 [2024-11-21 03:32:46.490140] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.029 [2024-11-21 03:32:46.490170] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.029 [2024-11-21 03:32:46.500943] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.029 [2024-11-21 03:32:46.500973] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.029 [2024-11-21 03:32:46.513726] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.029 [2024-11-21 03:32:46.513756] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.029 [2024-11-21 03:32:46.524253] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.029 [2024-11-21 03:32:46.524283] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.029 [2024-11-21 03:32:46.535414] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.029 [2024-11-21 03:32:46.535444] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.029 [2024-11-21 03:32:46.546300] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.029 [2024-11-21 03:32:46.546330] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.029 [2024-11-21 03:32:46.557522] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.029 [2024-11-21 03:32:46.557552] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.029 [2024-11-21 03:32:46.569041] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.029 [2024-11-21 03:32:46.569079] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.029 [2024-11-21 03:32:46.580158] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.029 [2024-11-21 03:32:46.580197] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.029 [2024-11-21 03:32:46.593116] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.029 [2024-11-21 03:32:46.593147] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.029 [2024-11-21 03:32:46.603588] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.029 [2024-11-21 03:32:46.603618] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.029 [2024-11-21 03:32:46.614031] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.029 [2024-11-21 03:32:46.614062] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.029 [2024-11-21 03:32:46.624910] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.029 [2024-11-21 03:32:46.624941] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.029 [2024-11-21 03:32:46.635868] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.029 [2024-11-21 03:32:46.635897] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.029 [2024-11-21 03:32:46.646395] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.029 [2024-11-21 03:32:46.646425] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.029 [2024-11-21 03:32:46.657485] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.029 [2024-11-21 03:32:46.657516] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.029 [2024-11-21 03:32:46.668688] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.029 [2024-11-21 03:32:46.668719] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.288 [2024-11-21 03:32:46.681836] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.288 [2024-11-21 03:32:46.681867] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.288 [2024-11-21 03:32:46.692398] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.288 [2024-11-21 03:32:46.692429] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.288 [2024-11-21 03:32:46.704015] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.288 [2024-11-21 03:32:46.704044] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.288 [2024-11-21 03:32:46.714919] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.288 [2024-11-21 03:32:46.714949] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.288 [2024-11-21 03:32:46.726188] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.288 [2024-11-21 03:32:46.726219] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.288 [2024-11-21 03:32:46.737555] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.288 [2024-11-21 03:32:46.737585] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.288 [2024-11-21 03:32:46.748238] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.288 [2024-11-21 03:32:46.748268] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.288 [2024-11-21 03:32:46.759206] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.288 [2024-11-21 03:32:46.759235] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.288 [2024-11-21 03:32:46.770218] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.288 [2024-11-21 03:32:46.770248] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.288 [2024-11-21 03:32:46.781119] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.288 [2024-11-21 03:32:46.781149] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.288 [2024-11-21 03:32:46.793932] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.288 [2024-11-21 03:32:46.793962] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.288 [2024-11-21 03:32:46.804177] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.288 [2024-11-21 03:32:46.804207] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.288 [2024-11-21 03:32:46.815398] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.288 [2024-11-21 03:32:46.815428] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.289 [2024-11-21 03:32:46.826444] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.289 [2024-11-21 03:32:46.826474] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.289 [2024-11-21 03:32:46.837467] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.289 [2024-11-21 03:32:46.837497] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.289 [2024-11-21 03:32:46.848473] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.289 [2024-11-21 03:32:46.848504] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.289 [2024-11-21 03:32:46.859476] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.289 [2024-11-21 03:32:46.859506] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.289 [2024-11-21 03:32:46.870667] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.289 [2024-11-21 03:32:46.870697] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.289 [2024-11-21 03:32:46.881333] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.289 [2024-11-21 03:32:46.881363] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.289 [2024-11-21 03:32:46.892187] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.289 [2024-11-21 03:32:46.892217] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.289 [2024-11-21 03:32:46.903117] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.289 [2024-11-21 03:32:46.903146] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.289 [2024-11-21 03:32:46.914325] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.289 [2024-11-21 03:32:46.914356] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.289 [2024-11-21 03:32:46.926987] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.289 [2024-11-21 03:32:46.927018] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.548 [2024-11-21 03:32:46.937130] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.548 [2024-11-21 03:32:46.937162] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.548 [2024-11-21 03:32:46.948162] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.548 [2024-11-21 03:32:46.948193] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.548 [2024-11-21 03:32:46.959522] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.548 [2024-11-21 03:32:46.959552] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.548 [2024-11-21 03:32:46.970519] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.548 [2024-11-21 03:32:46.970549] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.549 [2024-11-21 03:32:46.983519] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.549 [2024-11-21 03:32:46.983549] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.549 [2024-11-21 03:32:46.993203] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.549 [2024-11-21 03:32:46.993233] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.549 [2024-11-21 03:32:47.005087] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.549 [2024-11-21 03:32:47.005118] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.549 [2024-11-21 03:32:47.016172] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.549 [2024-11-21 03:32:47.016202] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.549 [2024-11-21 03:32:47.027010] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.549 [2024-11-21 03:32:47.027040] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.549 [2024-11-21 03:32:47.038126] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.549 [2024-11-21 03:32:47.038156] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.549 [2024-11-21 03:32:47.051516] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.549 [2024-11-21 03:32:47.051546] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.549 [2024-11-21 03:32:47.061863] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.549 [2024-11-21 03:32:47.061893] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.549 [2024-11-21 03:32:47.072736] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.549 [2024-11-21 03:32:47.072766] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.549 [2024-11-21 03:32:47.085752] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.549 [2024-11-21 03:32:47.085782] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.549 [2024-11-21 03:32:47.095555] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.549 [2024-11-21 03:32:47.095584] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.549 [2024-11-21 03:32:47.106921] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.549 [2024-11-21 03:32:47.106951] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.549 [2024-11-21 03:32:47.117466] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.549 [2024-11-21 03:32:47.117496] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.549 [2024-11-21 03:32:47.128391] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.549 [2024-11-21 03:32:47.128421] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.549 [2024-11-21 03:32:47.141265] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.549 [2024-11-21 03:32:47.141296] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.549 [2024-11-21 03:32:47.158305] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.549 [2024-11-21 03:32:47.158338] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.549 [2024-11-21 03:32:47.167986] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.549 [2024-11-21 03:32:47.168017] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.549 [2024-11-21 03:32:47.179617] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.549 [2024-11-21 03:32:47.179647] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.549 [2024-11-21 03:32:47.190478] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.549 [2024-11-21 03:32:47.190509] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.810 [2024-11-21 03:32:47.201734] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.810 [2024-11-21 03:32:47.201765] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.810 [2024-11-21 03:32:47.214718] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.810 [2024-11-21 03:32:47.214749] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.810 [2024-11-21 03:32:47.225150] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.810 [2024-11-21 03:32:47.225181] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.810 [2024-11-21 03:32:47.236018] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.810 [2024-11-21 03:32:47.236054] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.810 [2024-11-21 03:32:47.248862] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.810 [2024-11-21 03:32:47.248893] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.810 [2024-11-21 03:32:47.256480] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.810 [2024-11-21 03:32:47.256509] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.810 00:16:06.810 Latency(us) 00:16:06.810 [2024-11-21T02:32:47.458Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:06.810 [2024-11-21T02:32:47.458Z] Job: Nvme1n1 (Core Mask 0x1, workload: randrw, percentage: 50, depth: 128, IO size: 8192) 00:16:06.810 Nvme1n1 : 5.01 11794.08 92.14 0.00 0.00 10839.27 4344.79 21456.97 00:16:06.810 [2024-11-21T02:32:47.458Z] =================================================================================================================== 00:16:06.810 [2024-11-21T02:32:47.458Z] Total : 11794.08 92.14 0.00 0.00 10839.27 4344.79 21456.97 00:16:06.810 [2024-11-21 03:32:47.264499] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.810 [2024-11-21 03:32:47.264526] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.810 [2024-11-21 03:32:47.272515] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.810 [2024-11-21 03:32:47.272543] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.810 [2024-11-21 03:32:47.280541] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.810 [2024-11-21 03:32:47.280568] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.810 [2024-11-21 03:32:47.288608] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.810 [2024-11-21 03:32:47.288656] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.810 [2024-11-21 03:32:47.296634] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.810 [2024-11-21 03:32:47.296682] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.810 [2024-11-21 03:32:47.304646] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.810 [2024-11-21 03:32:47.304693] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.810 [2024-11-21 03:32:47.312669] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.810 [2024-11-21 03:32:47.312715] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.810 [2024-11-21 03:32:47.320686] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.810 [2024-11-21 03:32:47.320732] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.810 [2024-11-21 03:32:47.328717] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.810 [2024-11-21 03:32:47.328765] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.810 [2024-11-21 03:32:47.336737] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.810 [2024-11-21 03:32:47.336783] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.810 [2024-11-21 03:32:47.344756] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.810 [2024-11-21 03:32:47.344801] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.810 [2024-11-21 03:32:47.352783] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.810 [2024-11-21 03:32:47.352847] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.810 [2024-11-21 03:32:47.360799] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.810 [2024-11-21 03:32:47.360845] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.810 [2024-11-21 03:32:47.368827] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.810 [2024-11-21 03:32:47.368875] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.810 [2024-11-21 03:32:47.376854] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.810 [2024-11-21 03:32:47.376901] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.810 [2024-11-21 03:32:47.384867] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.810 [2024-11-21 03:32:47.384913] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.810 [2024-11-21 03:32:47.392895] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.810 [2024-11-21 03:32:47.392941] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.810 [2024-11-21 03:32:47.400906] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.810 [2024-11-21 03:32:47.400951] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.810 [2024-11-21 03:32:47.408899] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.810 [2024-11-21 03:32:47.408928] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.810 [2024-11-21 03:32:47.416910] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.810 [2024-11-21 03:32:47.416934] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.810 [2024-11-21 03:32:47.424934] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.810 [2024-11-21 03:32:47.424959] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.810 [2024-11-21 03:32:47.432952] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.810 [2024-11-21 03:32:47.432977] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.810 [2024-11-21 03:32:47.440976] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.810 [2024-11-21 03:32:47.441002] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:06.810 [2024-11-21 03:32:47.449035] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:06.810 [2024-11-21 03:32:47.449086] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.069 [2024-11-21 03:32:47.457078] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.069 [2024-11-21 03:32:47.457122] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.069 [2024-11-21 03:32:47.465097] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.069 [2024-11-21 03:32:47.465138] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.069 [2024-11-21 03:32:47.473077] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.069 [2024-11-21 03:32:47.473101] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.069 [2024-11-21 03:32:47.481096] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.069 [2024-11-21 03:32:47.481120] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.069 [2024-11-21 03:32:47.489127] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.069 [2024-11-21 03:32:47.489153] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.069 [2024-11-21 03:32:47.497149] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.070 [2024-11-21 03:32:47.497175] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.070 [2024-11-21 03:32:47.505172] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.070 [2024-11-21 03:32:47.505215] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.070 [2024-11-21 03:32:47.513241] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.070 [2024-11-21 03:32:47.513289] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.070 [2024-11-21 03:32:47.521251] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.070 [2024-11-21 03:32:47.521295] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.070 [2024-11-21 03:32:47.529231] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.070 [2024-11-21 03:32:47.529255] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.070 [2024-11-21 03:32:47.537253] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.070 [2024-11-21 03:32:47.537277] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.070 [2024-11-21 03:32:47.545274] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:07.070 [2024-11-21 03:32:47.545298] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:07.070 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh: line 42: kill: (3050717) - No such process 00:16:07.070 03:32:47 -- target/zcopy.sh@49 -- # wait 3050717 00:16:07.070 03:32:47 -- target/zcopy.sh@52 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:16:07.070 03:32:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:07.070 03:32:47 -- common/autotest_common.sh@10 -- # set +x 00:16:07.070 03:32:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:07.070 03:32:47 -- target/zcopy.sh@53 -- # rpc_cmd bdev_delay_create -b malloc0 -d delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:16:07.070 03:32:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:07.070 03:32:47 -- common/autotest_common.sh@10 -- # set +x 00:16:07.070 delay0 00:16:07.070 03:32:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:07.070 03:32:47 -- target/zcopy.sh@54 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 delay0 -n 1 00:16:07.070 03:32:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:07.070 03:32:47 -- common/autotest_common.sh@10 -- # set +x 00:16:07.070 03:32:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:07.070 03:32:47 -- target/zcopy.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -c 0x1 -t 5 -q 64 -w randrw -M 50 -l warning -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 ns:1' 00:16:07.070 EAL: No free 2048 kB hugepages reported on node 1 00:16:07.070 [2024-11-21 03:32:47.622566] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:16:15.203 Initializing NVMe Controllers 00:16:15.203 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:16:15.203 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:16:15.203 Initialization complete. Launching workers. 00:16:15.203 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 I/O completed: 242, failed: 21612 00:16:15.203 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) abort submitted 21739, failed to submit 115 00:16:15.203 success 21640, unsuccess 99, failed 0 00:16:15.203 03:32:54 -- target/zcopy.sh@59 -- # trap - SIGINT SIGTERM EXIT 00:16:15.203 03:32:54 -- target/zcopy.sh@60 -- # nvmftestfini 00:16:15.204 03:32:54 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:15.204 03:32:54 -- nvmf/common.sh@116 -- # sync 00:16:15.204 03:32:54 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:15.204 03:32:54 -- nvmf/common.sh@119 -- # set +e 00:16:15.204 03:32:54 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:15.204 03:32:54 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:15.204 rmmod nvme_tcp 00:16:15.204 rmmod nvme_fabrics 00:16:15.204 rmmod nvme_keyring 00:16:15.204 03:32:54 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:15.204 03:32:54 -- nvmf/common.sh@123 -- # set -e 00:16:15.204 03:32:54 -- nvmf/common.sh@124 -- # return 0 00:16:15.204 03:32:54 -- nvmf/common.sh@477 -- # '[' -n 3049216 ']' 00:16:15.204 03:32:54 -- nvmf/common.sh@478 -- # killprocess 3049216 00:16:15.204 03:32:54 -- common/autotest_common.sh@936 -- # '[' -z 3049216 ']' 00:16:15.204 03:32:54 -- common/autotest_common.sh@940 -- # kill -0 3049216 00:16:15.204 03:32:54 -- common/autotest_common.sh@941 -- # uname 00:16:15.204 03:32:54 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:15.204 03:32:54 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3049216 00:16:15.204 03:32:54 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:16:15.204 03:32:54 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:16:15.204 03:32:54 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3049216' 00:16:15.204 killing process with pid 3049216 00:16:15.204 03:32:54 -- common/autotest_common.sh@955 -- # kill 3049216 00:16:15.204 03:32:54 -- common/autotest_common.sh@960 -- # wait 3049216 00:16:15.204 03:32:55 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:15.204 03:32:55 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:15.204 03:32:55 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:15.204 03:32:55 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:15.204 03:32:55 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:15.204 03:32:55 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:15.204 03:32:55 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:15.204 03:32:55 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:16.587 03:32:57 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:16.587 00:16:16.587 real 0m29.656s 00:16:16.587 user 0m43.069s 00:16:16.587 sys 0m9.228s 00:16:16.587 03:32:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:16.587 03:32:57 -- common/autotest_common.sh@10 -- # set +x 00:16:16.587 ************************************ 00:16:16.587 END TEST nvmf_zcopy 00:16:16.587 ************************************ 00:16:16.587 03:32:57 -- nvmf/nvmf.sh@53 -- # run_test nvmf_nmic /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:16:16.587 03:32:57 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:16.587 03:32:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:16.587 03:32:57 -- common/autotest_common.sh@10 -- # set +x 00:16:16.587 ************************************ 00:16:16.587 START TEST nvmf_nmic 00:16:16.587 ************************************ 00:16:16.587 03:32:57 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:16:16.587 * Looking for test storage... 00:16:16.856 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:16.856 03:32:57 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:16.856 03:32:57 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:16.856 03:32:57 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:16.856 03:32:57 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:16.856 03:32:57 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:16.856 03:32:57 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:16.856 03:32:57 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:16.856 03:32:57 -- scripts/common.sh@335 -- # IFS=.-: 00:16:16.856 03:32:57 -- scripts/common.sh@335 -- # read -ra ver1 00:16:16.856 03:32:57 -- scripts/common.sh@336 -- # IFS=.-: 00:16:16.856 03:32:57 -- scripts/common.sh@336 -- # read -ra ver2 00:16:16.856 03:32:57 -- scripts/common.sh@337 -- # local 'op=<' 00:16:16.856 03:32:57 -- scripts/common.sh@339 -- # ver1_l=2 00:16:16.856 03:32:57 -- scripts/common.sh@340 -- # ver2_l=1 00:16:16.856 03:32:57 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:16.856 03:32:57 -- scripts/common.sh@343 -- # case "$op" in 00:16:16.856 03:32:57 -- scripts/common.sh@344 -- # : 1 00:16:16.856 03:32:57 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:16.856 03:32:57 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:16.856 03:32:57 -- scripts/common.sh@364 -- # decimal 1 00:16:16.856 03:32:57 -- scripts/common.sh@352 -- # local d=1 00:16:16.856 03:32:57 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:16.856 03:32:57 -- scripts/common.sh@354 -- # echo 1 00:16:16.856 03:32:57 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:16.856 03:32:57 -- scripts/common.sh@365 -- # decimal 2 00:16:16.856 03:32:57 -- scripts/common.sh@352 -- # local d=2 00:16:16.856 03:32:57 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:16.856 03:32:57 -- scripts/common.sh@354 -- # echo 2 00:16:16.856 03:32:57 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:16.856 03:32:57 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:16.856 03:32:57 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:16.856 03:32:57 -- scripts/common.sh@367 -- # return 0 00:16:16.856 03:32:57 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:16.856 03:32:57 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:16.856 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:16.856 --rc genhtml_branch_coverage=1 00:16:16.856 --rc genhtml_function_coverage=1 00:16:16.856 --rc genhtml_legend=1 00:16:16.856 --rc geninfo_all_blocks=1 00:16:16.856 --rc geninfo_unexecuted_blocks=1 00:16:16.856 00:16:16.856 ' 00:16:16.856 03:32:57 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:16.856 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:16.856 --rc genhtml_branch_coverage=1 00:16:16.856 --rc genhtml_function_coverage=1 00:16:16.856 --rc genhtml_legend=1 00:16:16.856 --rc geninfo_all_blocks=1 00:16:16.856 --rc geninfo_unexecuted_blocks=1 00:16:16.856 00:16:16.856 ' 00:16:16.856 03:32:57 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:16.856 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:16.856 --rc genhtml_branch_coverage=1 00:16:16.856 --rc genhtml_function_coverage=1 00:16:16.856 --rc genhtml_legend=1 00:16:16.856 --rc geninfo_all_blocks=1 00:16:16.856 --rc geninfo_unexecuted_blocks=1 00:16:16.856 00:16:16.856 ' 00:16:16.856 03:32:57 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:16.856 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:16.856 --rc genhtml_branch_coverage=1 00:16:16.856 --rc genhtml_function_coverage=1 00:16:16.856 --rc genhtml_legend=1 00:16:16.856 --rc geninfo_all_blocks=1 00:16:16.856 --rc geninfo_unexecuted_blocks=1 00:16:16.856 00:16:16.856 ' 00:16:16.856 03:32:57 -- target/nmic.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:16.856 03:32:57 -- nvmf/common.sh@7 -- # uname -s 00:16:16.856 03:32:57 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:16.856 03:32:57 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:16.856 03:32:57 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:16.856 03:32:57 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:16.856 03:32:57 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:16.856 03:32:57 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:16.856 03:32:57 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:16.856 03:32:57 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:16.856 03:32:57 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:16.856 03:32:57 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:16.856 03:32:57 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:16.856 03:32:57 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:16.856 03:32:57 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:16.856 03:32:57 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:16.856 03:32:57 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:16.856 03:32:57 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:16.856 03:32:57 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:16.856 03:32:57 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:16.856 03:32:57 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:16.856 03:32:57 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:16.856 03:32:57 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:16.856 03:32:57 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:16.856 03:32:57 -- paths/export.sh@5 -- # export PATH 00:16:16.856 03:32:57 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:16.856 03:32:57 -- nvmf/common.sh@46 -- # : 0 00:16:16.856 03:32:57 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:16.856 03:32:57 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:16.856 03:32:57 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:16.856 03:32:57 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:16.856 03:32:57 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:16.856 03:32:57 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:16.857 03:32:57 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:16.857 03:32:57 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:16.857 03:32:57 -- target/nmic.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:16.857 03:32:57 -- target/nmic.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:16.857 03:32:57 -- target/nmic.sh@14 -- # nvmftestinit 00:16:16.857 03:32:57 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:16.857 03:32:57 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:16.857 03:32:57 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:16.857 03:32:57 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:16.857 03:32:57 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:16.857 03:32:57 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:16.857 03:32:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:16.857 03:32:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:16.857 03:32:57 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:16.857 03:32:57 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:16.857 03:32:57 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:16.857 03:32:57 -- common/autotest_common.sh@10 -- # set +x 00:16:18.855 03:32:59 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:18.855 03:32:59 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:18.855 03:32:59 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:18.855 03:32:59 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:18.855 03:32:59 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:18.855 03:32:59 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:18.855 03:32:59 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:18.855 03:32:59 -- nvmf/common.sh@294 -- # net_devs=() 00:16:18.855 03:32:59 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:18.855 03:32:59 -- nvmf/common.sh@295 -- # e810=() 00:16:18.855 03:32:59 -- nvmf/common.sh@295 -- # local -ga e810 00:16:18.855 03:32:59 -- nvmf/common.sh@296 -- # x722=() 00:16:18.855 03:32:59 -- nvmf/common.sh@296 -- # local -ga x722 00:16:18.855 03:32:59 -- nvmf/common.sh@297 -- # mlx=() 00:16:18.855 03:32:59 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:18.855 03:32:59 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:18.855 03:32:59 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:18.855 03:32:59 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:18.855 03:32:59 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:18.855 03:32:59 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:18.855 03:32:59 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:18.855 03:32:59 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:18.855 03:32:59 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:18.855 03:32:59 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:18.855 03:32:59 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:18.855 03:32:59 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:18.855 03:32:59 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:18.855 03:32:59 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:18.855 03:32:59 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:18.855 03:32:59 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:18.855 03:32:59 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:18.855 03:32:59 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:18.855 03:32:59 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:18.855 03:32:59 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:16:18.855 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:16:18.855 03:32:59 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:18.855 03:32:59 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:18.855 03:32:59 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:18.855 03:32:59 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:18.855 03:32:59 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:18.855 03:32:59 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:18.855 03:32:59 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:16:18.855 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:16:18.855 03:32:59 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:18.855 03:32:59 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:18.855 03:32:59 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:18.855 03:32:59 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:18.855 03:32:59 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:18.855 03:32:59 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:18.855 03:32:59 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:18.855 03:32:59 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:18.855 03:32:59 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:18.855 03:32:59 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:18.855 03:32:59 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:18.856 03:32:59 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:18.856 03:32:59 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:16:18.856 Found net devices under 0000:0a:00.0: cvl_0_0 00:16:18.856 03:32:59 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:18.856 03:32:59 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:18.856 03:32:59 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:18.856 03:32:59 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:18.856 03:32:59 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:18.856 03:32:59 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:16:18.856 Found net devices under 0000:0a:00.1: cvl_0_1 00:16:18.856 03:32:59 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:18.856 03:32:59 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:18.856 03:32:59 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:18.856 03:32:59 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:18.856 03:32:59 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:18.856 03:32:59 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:18.856 03:32:59 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:18.856 03:32:59 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:18.856 03:32:59 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:18.856 03:32:59 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:18.856 03:32:59 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:18.856 03:32:59 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:18.856 03:32:59 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:18.856 03:32:59 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:18.856 03:32:59 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:18.856 03:32:59 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:18.856 03:32:59 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:18.856 03:32:59 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:18.856 03:32:59 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:18.856 03:32:59 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:18.856 03:32:59 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:18.856 03:32:59 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:18.856 03:32:59 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:18.856 03:32:59 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:18.856 03:32:59 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:18.856 03:32:59 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:18.856 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:18.856 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.216 ms 00:16:18.856 00:16:18.856 --- 10.0.0.2 ping statistics --- 00:16:18.856 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:18.856 rtt min/avg/max/mdev = 0.216/0.216/0.216/0.000 ms 00:16:18.856 03:32:59 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:18.856 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:18.856 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.149 ms 00:16:18.856 00:16:18.856 --- 10.0.0.1 ping statistics --- 00:16:18.856 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:18.856 rtt min/avg/max/mdev = 0.149/0.149/0.149/0.000 ms 00:16:18.856 03:32:59 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:18.856 03:32:59 -- nvmf/common.sh@410 -- # return 0 00:16:18.856 03:32:59 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:18.856 03:32:59 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:18.856 03:32:59 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:18.856 03:32:59 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:18.856 03:32:59 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:18.856 03:32:59 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:18.856 03:32:59 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:18.856 03:32:59 -- target/nmic.sh@15 -- # nvmfappstart -m 0xF 00:16:18.856 03:32:59 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:18.856 03:32:59 -- common/autotest_common.sh@722 -- # xtrace_disable 00:16:18.856 03:32:59 -- common/autotest_common.sh@10 -- # set +x 00:16:18.856 03:32:59 -- nvmf/common.sh@469 -- # nvmfpid=3054175 00:16:18.856 03:32:59 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:16:18.856 03:32:59 -- nvmf/common.sh@470 -- # waitforlisten 3054175 00:16:18.856 03:32:59 -- common/autotest_common.sh@829 -- # '[' -z 3054175 ']' 00:16:18.856 03:32:59 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:18.856 03:32:59 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:18.856 03:32:59 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:18.856 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:18.856 03:32:59 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:18.856 03:32:59 -- common/autotest_common.sh@10 -- # set +x 00:16:19.114 [2024-11-21 03:32:59.517407] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:19.114 [2024-11-21 03:32:59.517485] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:19.114 EAL: No free 2048 kB hugepages reported on node 1 00:16:19.114 [2024-11-21 03:32:59.585908] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:19.114 [2024-11-21 03:32:59.707552] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:19.114 [2024-11-21 03:32:59.707724] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:19.114 [2024-11-21 03:32:59.707743] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:19.114 [2024-11-21 03:32:59.707756] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:19.114 [2024-11-21 03:32:59.707840] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:19.114 [2024-11-21 03:32:59.707908] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:19.114 [2024-11-21 03:32:59.707960] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:19.114 [2024-11-21 03:32:59.707963] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:20.049 03:33:00 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:20.049 03:33:00 -- common/autotest_common.sh@862 -- # return 0 00:16:20.049 03:33:00 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:20.049 03:33:00 -- common/autotest_common.sh@728 -- # xtrace_disable 00:16:20.049 03:33:00 -- common/autotest_common.sh@10 -- # set +x 00:16:20.049 03:33:00 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:20.049 03:33:00 -- target/nmic.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:16:20.049 03:33:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:20.049 03:33:00 -- common/autotest_common.sh@10 -- # set +x 00:16:20.049 [2024-11-21 03:33:00.524676] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:20.049 03:33:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:20.049 03:33:00 -- target/nmic.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:16:20.049 03:33:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:20.049 03:33:00 -- common/autotest_common.sh@10 -- # set +x 00:16:20.049 Malloc0 00:16:20.049 03:33:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:20.049 03:33:00 -- target/nmic.sh@21 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:16:20.049 03:33:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:20.049 03:33:00 -- common/autotest_common.sh@10 -- # set +x 00:16:20.049 03:33:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:20.049 03:33:00 -- target/nmic.sh@22 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:16:20.049 03:33:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:20.049 03:33:00 -- common/autotest_common.sh@10 -- # set +x 00:16:20.049 03:33:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:20.049 03:33:00 -- target/nmic.sh@23 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:16:20.049 03:33:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:20.049 03:33:00 -- common/autotest_common.sh@10 -- # set +x 00:16:20.049 [2024-11-21 03:33:00.575954] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:20.049 03:33:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:20.049 03:33:00 -- target/nmic.sh@25 -- # echo 'test case1: single bdev can'\''t be used in multiple subsystems' 00:16:20.049 test case1: single bdev can't be used in multiple subsystems 00:16:20.049 03:33:00 -- target/nmic.sh@26 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:16:20.049 03:33:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:20.049 03:33:00 -- common/autotest_common.sh@10 -- # set +x 00:16:20.049 03:33:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:20.049 03:33:00 -- target/nmic.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:16:20.049 03:33:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:20.049 03:33:00 -- common/autotest_common.sh@10 -- # set +x 00:16:20.049 03:33:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:20.049 03:33:00 -- target/nmic.sh@28 -- # nmic_status=0 00:16:20.049 03:33:00 -- target/nmic.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc0 00:16:20.049 03:33:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:20.049 03:33:00 -- common/autotest_common.sh@10 -- # set +x 00:16:20.049 [2024-11-21 03:33:00.599764] bdev.c:7940:bdev_open: *ERROR*: bdev Malloc0 already claimed: type exclusive_write by module NVMe-oF Target 00:16:20.049 [2024-11-21 03:33:00.599793] subsystem.c:1819:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode2: bdev Malloc0 cannot be opened, error=-1 00:16:20.049 [2024-11-21 03:33:00.599823] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.049 request: 00:16:20.049 { 00:16:20.049 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:16:20.049 "namespace": { 00:16:20.049 "bdev_name": "Malloc0" 00:16:20.049 }, 00:16:20.049 "method": "nvmf_subsystem_add_ns", 00:16:20.049 "req_id": 1 00:16:20.049 } 00:16:20.049 Got JSON-RPC error response 00:16:20.049 response: 00:16:20.049 { 00:16:20.049 "code": -32602, 00:16:20.049 "message": "Invalid parameters" 00:16:20.049 } 00:16:20.049 03:33:00 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:16:20.049 03:33:00 -- target/nmic.sh@29 -- # nmic_status=1 00:16:20.049 03:33:00 -- target/nmic.sh@31 -- # '[' 1 -eq 0 ']' 00:16:20.049 03:33:00 -- target/nmic.sh@36 -- # echo ' Adding namespace failed - expected result.' 00:16:20.049 Adding namespace failed - expected result. 00:16:20.049 03:33:00 -- target/nmic.sh@39 -- # echo 'test case2: host connect to nvmf target in multiple paths' 00:16:20.049 test case2: host connect to nvmf target in multiple paths 00:16:20.049 03:33:00 -- target/nmic.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:16:20.049 03:33:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:20.049 03:33:00 -- common/autotest_common.sh@10 -- # set +x 00:16:20.050 [2024-11-21 03:33:00.607890] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:16:20.050 03:33:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:20.050 03:33:00 -- target/nmic.sh@41 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:16:20.619 03:33:01 -- target/nmic.sh@42 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4421 00:16:21.558 03:33:01 -- target/nmic.sh@44 -- # waitforserial SPDKISFASTANDAWESOME 00:16:21.558 03:33:01 -- common/autotest_common.sh@1187 -- # local i=0 00:16:21.558 03:33:01 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:16:21.558 03:33:01 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:16:21.558 03:33:01 -- common/autotest_common.sh@1194 -- # sleep 2 00:16:23.469 03:33:03 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:16:23.469 03:33:03 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:16:23.469 03:33:03 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:16:23.469 03:33:03 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:16:23.469 03:33:03 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:16:23.469 03:33:03 -- common/autotest_common.sh@1197 -- # return 0 00:16:23.469 03:33:03 -- target/nmic.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:16:23.469 [global] 00:16:23.469 thread=1 00:16:23.469 invalidate=1 00:16:23.469 rw=write 00:16:23.469 time_based=1 00:16:23.469 runtime=1 00:16:23.469 ioengine=libaio 00:16:23.469 direct=1 00:16:23.469 bs=4096 00:16:23.469 iodepth=1 00:16:23.469 norandommap=0 00:16:23.469 numjobs=1 00:16:23.469 00:16:23.469 verify_dump=1 00:16:23.469 verify_backlog=512 00:16:23.469 verify_state_save=0 00:16:23.469 do_verify=1 00:16:23.469 verify=crc32c-intel 00:16:23.469 [job0] 00:16:23.469 filename=/dev/nvme0n1 00:16:23.469 Could not set queue depth (nvme0n1) 00:16:23.727 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:23.727 fio-3.35 00:16:23.727 Starting 1 thread 00:16:24.664 00:16:24.664 job0: (groupid=0, jobs=1): err= 0: pid=3054941: Thu Nov 21 03:33:05 2024 00:16:24.664 read: IOPS=20, BW=83.6KiB/s (85.6kB/s)(84.0KiB/1005msec) 00:16:24.664 slat (nsec): min=6664, max=35444, avg=25751.81, stdev=10653.23 00:16:24.664 clat (usec): min=40725, max=41034, avg=40951.60, stdev=62.30 00:16:24.664 lat (usec): min=40731, max=41052, avg=40977.35, stdev=63.29 00:16:24.664 clat percentiles (usec): 00:16:24.664 | 1.00th=[40633], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:16:24.664 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:16:24.664 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:16:24.664 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:16:24.664 | 99.99th=[41157] 00:16:24.664 write: IOPS=509, BW=2038KiB/s (2087kB/s)(2048KiB/1005msec); 0 zone resets 00:16:24.664 slat (usec): min=6, max=30414, avg=67.89, stdev=1343.77 00:16:24.664 clat (usec): min=143, max=3994, avg=211.81, stdev=171.39 00:16:24.665 lat (usec): min=150, max=30664, avg=279.70, stdev=1356.33 00:16:24.665 clat percentiles (usec): 00:16:24.665 | 1.00th=[ 151], 5.00th=[ 163], 10.00th=[ 169], 20.00th=[ 178], 00:16:24.665 | 30.00th=[ 182], 40.00th=[ 186], 50.00th=[ 190], 60.00th=[ 198], 00:16:24.665 | 70.00th=[ 208], 80.00th=[ 253], 90.00th=[ 265], 95.00th=[ 269], 00:16:24.665 | 99.00th=[ 281], 99.50th=[ 306], 99.90th=[ 3982], 99.95th=[ 3982], 00:16:24.665 | 99.99th=[ 3982] 00:16:24.665 bw ( KiB/s): min= 4096, max= 4096, per=100.00%, avg=4096.00, stdev= 0.00, samples=1 00:16:24.665 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:16:24.665 lat (usec) : 250=74.11%, 500=21.76% 00:16:24.665 lat (msec) : 4=0.19%, 50=3.94% 00:16:24.665 cpu : usr=0.30%, sys=0.50%, ctx=536, majf=0, minf=1 00:16:24.665 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:24.665 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:24.665 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:24.665 issued rwts: total=21,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:24.665 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:24.665 00:16:24.665 Run status group 0 (all jobs): 00:16:24.665 READ: bw=83.6KiB/s (85.6kB/s), 83.6KiB/s-83.6KiB/s (85.6kB/s-85.6kB/s), io=84.0KiB (86.0kB), run=1005-1005msec 00:16:24.665 WRITE: bw=2038KiB/s (2087kB/s), 2038KiB/s-2038KiB/s (2087kB/s-2087kB/s), io=2048KiB (2097kB), run=1005-1005msec 00:16:24.665 00:16:24.665 Disk stats (read/write): 00:16:24.665 nvme0n1: ios=43/512, merge=0/0, ticks=1700/104, in_queue=1804, util=98.90% 00:16:24.665 03:33:05 -- target/nmic.sh@48 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:16:24.926 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 2 controller(s) 00:16:24.926 03:33:05 -- target/nmic.sh@49 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:16:24.926 03:33:05 -- common/autotest_common.sh@1208 -- # local i=0 00:16:24.926 03:33:05 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:16:24.926 03:33:05 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:16:24.926 03:33:05 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:16:24.926 03:33:05 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:16:24.926 03:33:05 -- common/autotest_common.sh@1220 -- # return 0 00:16:24.926 03:33:05 -- target/nmic.sh@51 -- # trap - SIGINT SIGTERM EXIT 00:16:24.926 03:33:05 -- target/nmic.sh@53 -- # nvmftestfini 00:16:24.926 03:33:05 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:24.926 03:33:05 -- nvmf/common.sh@116 -- # sync 00:16:24.926 03:33:05 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:24.926 03:33:05 -- nvmf/common.sh@119 -- # set +e 00:16:24.926 03:33:05 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:24.926 03:33:05 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:24.926 rmmod nvme_tcp 00:16:24.926 rmmod nvme_fabrics 00:16:24.926 rmmod nvme_keyring 00:16:24.926 03:33:05 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:24.926 03:33:05 -- nvmf/common.sh@123 -- # set -e 00:16:24.926 03:33:05 -- nvmf/common.sh@124 -- # return 0 00:16:24.926 03:33:05 -- nvmf/common.sh@477 -- # '[' -n 3054175 ']' 00:16:24.926 03:33:05 -- nvmf/common.sh@478 -- # killprocess 3054175 00:16:24.926 03:33:05 -- common/autotest_common.sh@936 -- # '[' -z 3054175 ']' 00:16:24.926 03:33:05 -- common/autotest_common.sh@940 -- # kill -0 3054175 00:16:24.926 03:33:05 -- common/autotest_common.sh@941 -- # uname 00:16:24.926 03:33:05 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:24.926 03:33:05 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3054175 00:16:24.926 03:33:05 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:24.926 03:33:05 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:24.926 03:33:05 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3054175' 00:16:24.926 killing process with pid 3054175 00:16:24.926 03:33:05 -- common/autotest_common.sh@955 -- # kill 3054175 00:16:24.926 03:33:05 -- common/autotest_common.sh@960 -- # wait 3054175 00:16:25.185 03:33:05 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:25.185 03:33:05 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:25.185 03:33:05 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:25.185 03:33:05 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:25.185 03:33:05 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:25.185 03:33:05 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:25.185 03:33:05 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:25.185 03:33:05 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:27.721 03:33:07 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:27.721 00:16:27.721 real 0m10.674s 00:16:27.721 user 0m25.445s 00:16:27.721 sys 0m2.344s 00:16:27.721 03:33:07 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:27.721 03:33:07 -- common/autotest_common.sh@10 -- # set +x 00:16:27.721 ************************************ 00:16:27.721 END TEST nvmf_nmic 00:16:27.721 ************************************ 00:16:27.721 03:33:07 -- nvmf/nvmf.sh@54 -- # run_test nvmf_fio_target /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:16:27.721 03:33:07 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:27.721 03:33:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:27.721 03:33:07 -- common/autotest_common.sh@10 -- # set +x 00:16:27.721 ************************************ 00:16:27.721 START TEST nvmf_fio_target 00:16:27.721 ************************************ 00:16:27.721 03:33:07 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:16:27.721 * Looking for test storage... 00:16:27.721 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:27.721 03:33:07 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:27.721 03:33:07 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:27.721 03:33:07 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:27.721 03:33:08 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:27.721 03:33:08 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:27.721 03:33:08 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:27.721 03:33:08 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:27.721 03:33:08 -- scripts/common.sh@335 -- # IFS=.-: 00:16:27.721 03:33:08 -- scripts/common.sh@335 -- # read -ra ver1 00:16:27.721 03:33:08 -- scripts/common.sh@336 -- # IFS=.-: 00:16:27.721 03:33:08 -- scripts/common.sh@336 -- # read -ra ver2 00:16:27.721 03:33:08 -- scripts/common.sh@337 -- # local 'op=<' 00:16:27.721 03:33:08 -- scripts/common.sh@339 -- # ver1_l=2 00:16:27.721 03:33:08 -- scripts/common.sh@340 -- # ver2_l=1 00:16:27.721 03:33:08 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:27.721 03:33:08 -- scripts/common.sh@343 -- # case "$op" in 00:16:27.721 03:33:08 -- scripts/common.sh@344 -- # : 1 00:16:27.721 03:33:08 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:27.721 03:33:08 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:27.721 03:33:08 -- scripts/common.sh@364 -- # decimal 1 00:16:27.721 03:33:08 -- scripts/common.sh@352 -- # local d=1 00:16:27.721 03:33:08 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:27.721 03:33:08 -- scripts/common.sh@354 -- # echo 1 00:16:27.721 03:33:08 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:27.721 03:33:08 -- scripts/common.sh@365 -- # decimal 2 00:16:27.721 03:33:08 -- scripts/common.sh@352 -- # local d=2 00:16:27.721 03:33:08 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:27.721 03:33:08 -- scripts/common.sh@354 -- # echo 2 00:16:27.721 03:33:08 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:27.721 03:33:08 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:27.721 03:33:08 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:27.721 03:33:08 -- scripts/common.sh@367 -- # return 0 00:16:27.721 03:33:08 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:27.721 03:33:08 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:27.721 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:27.721 --rc genhtml_branch_coverage=1 00:16:27.721 --rc genhtml_function_coverage=1 00:16:27.721 --rc genhtml_legend=1 00:16:27.721 --rc geninfo_all_blocks=1 00:16:27.721 --rc geninfo_unexecuted_blocks=1 00:16:27.721 00:16:27.721 ' 00:16:27.721 03:33:08 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:27.721 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:27.721 --rc genhtml_branch_coverage=1 00:16:27.721 --rc genhtml_function_coverage=1 00:16:27.721 --rc genhtml_legend=1 00:16:27.721 --rc geninfo_all_blocks=1 00:16:27.721 --rc geninfo_unexecuted_blocks=1 00:16:27.721 00:16:27.721 ' 00:16:27.721 03:33:08 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:27.721 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:27.721 --rc genhtml_branch_coverage=1 00:16:27.721 --rc genhtml_function_coverage=1 00:16:27.721 --rc genhtml_legend=1 00:16:27.721 --rc geninfo_all_blocks=1 00:16:27.721 --rc geninfo_unexecuted_blocks=1 00:16:27.721 00:16:27.721 ' 00:16:27.721 03:33:08 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:27.721 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:27.721 --rc genhtml_branch_coverage=1 00:16:27.721 --rc genhtml_function_coverage=1 00:16:27.721 --rc genhtml_legend=1 00:16:27.721 --rc geninfo_all_blocks=1 00:16:27.721 --rc geninfo_unexecuted_blocks=1 00:16:27.721 00:16:27.721 ' 00:16:27.721 03:33:08 -- target/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:27.721 03:33:08 -- nvmf/common.sh@7 -- # uname -s 00:16:27.721 03:33:08 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:27.721 03:33:08 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:27.721 03:33:08 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:27.721 03:33:08 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:27.721 03:33:08 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:27.721 03:33:08 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:27.721 03:33:08 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:27.721 03:33:08 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:27.722 03:33:08 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:27.722 03:33:08 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:27.722 03:33:08 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:27.722 03:33:08 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:27.722 03:33:08 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:27.722 03:33:08 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:27.722 03:33:08 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:27.722 03:33:08 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:27.722 03:33:08 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:27.722 03:33:08 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:27.722 03:33:08 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:27.722 03:33:08 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:27.722 03:33:08 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:27.722 03:33:08 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:27.722 03:33:08 -- paths/export.sh@5 -- # export PATH 00:16:27.722 03:33:08 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:27.722 03:33:08 -- nvmf/common.sh@46 -- # : 0 00:16:27.722 03:33:08 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:27.722 03:33:08 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:27.722 03:33:08 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:27.722 03:33:08 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:27.722 03:33:08 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:27.722 03:33:08 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:27.722 03:33:08 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:27.722 03:33:08 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:27.722 03:33:08 -- target/fio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:27.722 03:33:08 -- target/fio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:27.722 03:33:08 -- target/fio.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:16:27.722 03:33:08 -- target/fio.sh@16 -- # nvmftestinit 00:16:27.722 03:33:08 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:27.722 03:33:08 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:27.722 03:33:08 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:27.722 03:33:08 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:27.722 03:33:08 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:27.722 03:33:08 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:27.722 03:33:08 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:27.722 03:33:08 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:27.722 03:33:08 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:27.722 03:33:08 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:27.722 03:33:08 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:27.722 03:33:08 -- common/autotest_common.sh@10 -- # set +x 00:16:29.628 03:33:09 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:29.628 03:33:09 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:29.628 03:33:09 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:29.628 03:33:09 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:29.628 03:33:09 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:29.628 03:33:09 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:29.628 03:33:09 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:29.628 03:33:09 -- nvmf/common.sh@294 -- # net_devs=() 00:16:29.628 03:33:09 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:29.628 03:33:09 -- nvmf/common.sh@295 -- # e810=() 00:16:29.628 03:33:09 -- nvmf/common.sh@295 -- # local -ga e810 00:16:29.628 03:33:09 -- nvmf/common.sh@296 -- # x722=() 00:16:29.628 03:33:09 -- nvmf/common.sh@296 -- # local -ga x722 00:16:29.628 03:33:09 -- nvmf/common.sh@297 -- # mlx=() 00:16:29.628 03:33:09 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:29.628 03:33:09 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:29.628 03:33:09 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:29.628 03:33:09 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:29.628 03:33:09 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:29.628 03:33:09 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:29.628 03:33:09 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:29.628 03:33:09 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:29.628 03:33:09 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:29.628 03:33:09 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:29.628 03:33:09 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:29.628 03:33:09 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:29.628 03:33:09 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:29.628 03:33:09 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:29.628 03:33:09 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:29.629 03:33:09 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:29.629 03:33:09 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:29.629 03:33:09 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:29.629 03:33:09 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:29.629 03:33:09 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:16:29.629 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:16:29.629 03:33:09 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:29.629 03:33:09 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:29.629 03:33:09 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:29.629 03:33:09 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:29.629 03:33:09 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:29.629 03:33:09 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:29.629 03:33:09 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:16:29.629 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:16:29.629 03:33:09 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:29.629 03:33:09 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:29.629 03:33:09 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:29.629 03:33:09 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:29.629 03:33:09 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:29.629 03:33:09 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:29.629 03:33:09 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:29.629 03:33:09 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:29.629 03:33:09 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:29.629 03:33:09 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:29.629 03:33:09 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:29.629 03:33:09 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:29.629 03:33:09 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:16:29.629 Found net devices under 0000:0a:00.0: cvl_0_0 00:16:29.629 03:33:09 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:29.629 03:33:09 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:29.629 03:33:09 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:29.629 03:33:09 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:29.629 03:33:09 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:29.629 03:33:09 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:16:29.629 Found net devices under 0000:0a:00.1: cvl_0_1 00:16:29.629 03:33:09 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:29.629 03:33:09 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:29.629 03:33:09 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:29.629 03:33:09 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:29.629 03:33:09 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:29.629 03:33:09 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:29.629 03:33:09 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:29.629 03:33:09 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:29.629 03:33:09 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:29.629 03:33:09 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:29.629 03:33:09 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:29.629 03:33:09 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:29.629 03:33:09 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:29.629 03:33:09 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:29.629 03:33:09 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:29.629 03:33:09 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:29.629 03:33:09 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:29.629 03:33:09 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:29.629 03:33:09 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:29.629 03:33:10 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:29.629 03:33:10 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:29.629 03:33:10 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:29.629 03:33:10 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:29.629 03:33:10 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:29.629 03:33:10 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:29.629 03:33:10 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:29.629 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:29.629 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.307 ms 00:16:29.629 00:16:29.629 --- 10.0.0.2 ping statistics --- 00:16:29.629 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:29.629 rtt min/avg/max/mdev = 0.307/0.307/0.307/0.000 ms 00:16:29.629 03:33:10 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:29.629 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:29.629 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.143 ms 00:16:29.629 00:16:29.629 --- 10.0.0.1 ping statistics --- 00:16:29.629 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:29.629 rtt min/avg/max/mdev = 0.143/0.143/0.143/0.000 ms 00:16:29.629 03:33:10 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:29.629 03:33:10 -- nvmf/common.sh@410 -- # return 0 00:16:29.629 03:33:10 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:29.629 03:33:10 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:29.629 03:33:10 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:29.629 03:33:10 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:29.629 03:33:10 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:29.629 03:33:10 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:29.629 03:33:10 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:29.629 03:33:10 -- target/fio.sh@17 -- # nvmfappstart -m 0xF 00:16:29.629 03:33:10 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:29.629 03:33:10 -- common/autotest_common.sh@722 -- # xtrace_disable 00:16:29.629 03:33:10 -- common/autotest_common.sh@10 -- # set +x 00:16:29.629 03:33:10 -- nvmf/common.sh@469 -- # nvmfpid=3057671 00:16:29.629 03:33:10 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:16:29.629 03:33:10 -- nvmf/common.sh@470 -- # waitforlisten 3057671 00:16:29.629 03:33:10 -- common/autotest_common.sh@829 -- # '[' -z 3057671 ']' 00:16:29.629 03:33:10 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:29.629 03:33:10 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:29.629 03:33:10 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:29.629 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:29.629 03:33:10 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:29.629 03:33:10 -- common/autotest_common.sh@10 -- # set +x 00:16:29.629 [2024-11-21 03:33:10.172591] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:29.629 [2024-11-21 03:33:10.172677] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:29.629 EAL: No free 2048 kB hugepages reported on node 1 00:16:29.629 [2024-11-21 03:33:10.237491] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:29.887 [2024-11-21 03:33:10.345344] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:29.887 [2024-11-21 03:33:10.345507] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:29.887 [2024-11-21 03:33:10.345525] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:29.887 [2024-11-21 03:33:10.345537] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:29.887 [2024-11-21 03:33:10.345607] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:29.887 [2024-11-21 03:33:10.345680] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:29.887 [2024-11-21 03:33:10.345714] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:29.887 [2024-11-21 03:33:10.345716] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:30.826 03:33:11 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:30.826 03:33:11 -- common/autotest_common.sh@862 -- # return 0 00:16:30.826 03:33:11 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:30.826 03:33:11 -- common/autotest_common.sh@728 -- # xtrace_disable 00:16:30.826 03:33:11 -- common/autotest_common.sh@10 -- # set +x 00:16:30.826 03:33:11 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:30.826 03:33:11 -- target/fio.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:16:30.826 [2024-11-21 03:33:11.455770] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:31.085 03:33:11 -- target/fio.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:31.342 03:33:11 -- target/fio.sh@21 -- # malloc_bdevs='Malloc0 ' 00:16:31.342 03:33:11 -- target/fio.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:31.600 03:33:12 -- target/fio.sh@22 -- # malloc_bdevs+=Malloc1 00:16:31.600 03:33:12 -- target/fio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:31.858 03:33:12 -- target/fio.sh@24 -- # raid_malloc_bdevs='Malloc2 ' 00:16:31.858 03:33:12 -- target/fio.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:32.115 03:33:12 -- target/fio.sh@25 -- # raid_malloc_bdevs+=Malloc3 00:16:32.115 03:33:12 -- target/fio.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc2 Malloc3' 00:16:32.373 03:33:12 -- target/fio.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:32.630 03:33:13 -- target/fio.sh@29 -- # concat_malloc_bdevs='Malloc4 ' 00:16:32.630 03:33:13 -- target/fio.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:32.888 03:33:13 -- target/fio.sh@30 -- # concat_malloc_bdevs+='Malloc5 ' 00:16:32.888 03:33:13 -- target/fio.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:33.147 03:33:13 -- target/fio.sh@31 -- # concat_malloc_bdevs+=Malloc6 00:16:33.147 03:33:13 -- target/fio.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n concat0 -r concat -z 64 -b 'Malloc4 Malloc5 Malloc6' 00:16:33.405 03:33:13 -- target/fio.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:16:33.663 03:33:14 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:16:33.663 03:33:14 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:16:33.921 03:33:14 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:16:33.921 03:33:14 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:16:34.179 03:33:14 -- target/fio.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:16:34.437 [2024-11-21 03:33:14.889897] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:34.437 03:33:14 -- target/fio.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 raid0 00:16:34.695 03:33:15 -- target/fio.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 concat0 00:16:34.954 03:33:15 -- target/fio.sh@46 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:16:35.522 03:33:16 -- target/fio.sh@48 -- # waitforserial SPDKISFASTANDAWESOME 4 00:16:35.522 03:33:16 -- common/autotest_common.sh@1187 -- # local i=0 00:16:35.522 03:33:16 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:16:35.522 03:33:16 -- common/autotest_common.sh@1189 -- # [[ -n 4 ]] 00:16:35.522 03:33:16 -- common/autotest_common.sh@1190 -- # nvme_device_counter=4 00:16:35.522 03:33:16 -- common/autotest_common.sh@1194 -- # sleep 2 00:16:38.057 03:33:18 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:16:38.057 03:33:18 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:16:38.057 03:33:18 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:16:38.057 03:33:18 -- common/autotest_common.sh@1196 -- # nvme_devices=4 00:16:38.057 03:33:18 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:16:38.057 03:33:18 -- common/autotest_common.sh@1197 -- # return 0 00:16:38.057 03:33:18 -- target/fio.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:16:38.057 [global] 00:16:38.057 thread=1 00:16:38.057 invalidate=1 00:16:38.057 rw=write 00:16:38.057 time_based=1 00:16:38.057 runtime=1 00:16:38.057 ioengine=libaio 00:16:38.057 direct=1 00:16:38.057 bs=4096 00:16:38.057 iodepth=1 00:16:38.057 norandommap=0 00:16:38.057 numjobs=1 00:16:38.057 00:16:38.057 verify_dump=1 00:16:38.057 verify_backlog=512 00:16:38.057 verify_state_save=0 00:16:38.057 do_verify=1 00:16:38.057 verify=crc32c-intel 00:16:38.057 [job0] 00:16:38.057 filename=/dev/nvme0n1 00:16:38.057 [job1] 00:16:38.057 filename=/dev/nvme0n2 00:16:38.057 [job2] 00:16:38.057 filename=/dev/nvme0n3 00:16:38.057 [job3] 00:16:38.057 filename=/dev/nvme0n4 00:16:38.057 Could not set queue depth (nvme0n1) 00:16:38.057 Could not set queue depth (nvme0n2) 00:16:38.057 Could not set queue depth (nvme0n3) 00:16:38.057 Could not set queue depth (nvme0n4) 00:16:38.057 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:38.057 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:38.057 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:38.057 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:38.057 fio-3.35 00:16:38.057 Starting 4 threads 00:16:38.993 00:16:38.993 job0: (groupid=0, jobs=1): err= 0: pid=3058786: Thu Nov 21 03:33:19 2024 00:16:38.993 read: IOPS=1534, BW=6138KiB/s (6285kB/s)(6144KiB/1001msec) 00:16:38.993 slat (nsec): min=5656, max=33128, avg=9592.78, stdev=4856.11 00:16:38.993 clat (usec): min=262, max=854, avg=360.37, stdev=51.19 00:16:38.993 lat (usec): min=268, max=861, avg=369.96, stdev=51.27 00:16:38.993 clat percentiles (usec): 00:16:38.993 | 1.00th=[ 285], 5.00th=[ 297], 10.00th=[ 306], 20.00th=[ 322], 00:16:38.993 | 30.00th=[ 330], 40.00th=[ 343], 50.00th=[ 351], 60.00th=[ 363], 00:16:38.993 | 70.00th=[ 375], 80.00th=[ 396], 90.00th=[ 420], 95.00th=[ 449], 00:16:38.993 | 99.00th=[ 553], 99.50th=[ 586], 99.90th=[ 619], 99.95th=[ 857], 00:16:38.993 | 99.99th=[ 857] 00:16:38.993 write: IOPS=1675, BW=6701KiB/s (6862kB/s)(6708KiB/1001msec); 0 zone resets 00:16:38.993 slat (nsec): min=7032, max=50181, avg=14017.70, stdev=7403.20 00:16:38.993 clat (usec): min=156, max=443, avg=236.80, stdev=46.90 00:16:38.993 lat (usec): min=165, max=454, avg=250.82, stdev=48.37 00:16:38.993 clat percentiles (usec): 00:16:38.993 | 1.00th=[ 167], 5.00th=[ 178], 10.00th=[ 190], 20.00th=[ 202], 00:16:38.993 | 30.00th=[ 208], 40.00th=[ 219], 50.00th=[ 229], 60.00th=[ 237], 00:16:38.993 | 70.00th=[ 249], 80.00th=[ 262], 90.00th=[ 310], 95.00th=[ 338], 00:16:38.993 | 99.00th=[ 392], 99.50th=[ 408], 99.90th=[ 441], 99.95th=[ 445], 00:16:38.993 | 99.99th=[ 445] 00:16:38.993 bw ( KiB/s): min= 8192, max= 8192, per=39.64%, avg=8192.00, stdev= 0.00, samples=1 00:16:38.994 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:16:38.994 lat (usec) : 250=37.19%, 500=61.90%, 750=0.87%, 1000=0.03% 00:16:38.994 cpu : usr=3.70%, sys=4.40%, ctx=3213, majf=0, minf=2 00:16:38.994 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:38.994 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:38.994 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:38.994 issued rwts: total=1536,1677,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:38.994 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:38.994 job1: (groupid=0, jobs=1): err= 0: pid=3058787: Thu Nov 21 03:33:19 2024 00:16:38.994 read: IOPS=31, BW=127KiB/s (131kB/s)(128KiB/1004msec) 00:16:38.994 slat (nsec): min=6297, max=33417, avg=16389.47, stdev=6778.17 00:16:38.994 clat (usec): min=257, max=41242, avg=27004.10, stdev=19628.57 00:16:38.994 lat (usec): min=286, max=41259, avg=27020.49, stdev=19626.87 00:16:38.994 clat percentiles (usec): 00:16:38.994 | 1.00th=[ 258], 5.00th=[ 281], 10.00th=[ 289], 20.00th=[ 297], 00:16:38.994 | 30.00th=[ 355], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:16:38.994 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:16:38.994 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:16:38.994 | 99.99th=[41157] 00:16:38.994 write: IOPS=509, BW=2040KiB/s (2089kB/s)(2048KiB/1004msec); 0 zone resets 00:16:38.994 slat (usec): min=6, max=17869, avg=51.26, stdev=789.03 00:16:38.994 clat (usec): min=172, max=459, avg=215.87, stdev=25.27 00:16:38.994 lat (usec): min=179, max=18191, avg=267.13, stdev=794.04 00:16:38.994 clat percentiles (usec): 00:16:38.994 | 1.00th=[ 178], 5.00th=[ 186], 10.00th=[ 192], 20.00th=[ 198], 00:16:38.994 | 30.00th=[ 202], 40.00th=[ 208], 50.00th=[ 212], 60.00th=[ 219], 00:16:38.994 | 70.00th=[ 225], 80.00th=[ 233], 90.00th=[ 243], 95.00th=[ 251], 00:16:38.994 | 99.00th=[ 289], 99.50th=[ 322], 99.90th=[ 461], 99.95th=[ 461], 00:16:38.994 | 99.99th=[ 461] 00:16:38.994 bw ( KiB/s): min= 4087, max= 4087, per=19.78%, avg=4087.00, stdev= 0.00, samples=1 00:16:38.994 iops : min= 1021, max= 1021, avg=1021.00, stdev= 0.00, samples=1 00:16:38.994 lat (usec) : 250=88.79%, 500=7.35% 00:16:38.994 lat (msec) : 50=3.86% 00:16:38.994 cpu : usr=0.30%, sys=0.90%, ctx=548, majf=0, minf=1 00:16:38.994 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:38.994 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:38.994 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:38.994 issued rwts: total=32,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:38.994 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:38.994 job2: (groupid=0, jobs=1): err= 0: pid=3058788: Thu Nov 21 03:33:19 2024 00:16:38.994 read: IOPS=1536, BW=6144KiB/s (6291kB/s)(6144KiB/1000msec) 00:16:38.994 slat (nsec): min=5760, max=34405, avg=7792.94, stdev=2815.63 00:16:38.994 clat (usec): min=231, max=40995, avg=414.44, stdev=2317.61 00:16:38.994 lat (usec): min=238, max=41008, avg=422.23, stdev=2317.97 00:16:38.994 clat percentiles (usec): 00:16:38.994 | 1.00th=[ 241], 5.00th=[ 247], 10.00th=[ 251], 20.00th=[ 258], 00:16:38.994 | 30.00th=[ 262], 40.00th=[ 265], 50.00th=[ 273], 60.00th=[ 277], 00:16:38.994 | 70.00th=[ 285], 80.00th=[ 314], 90.00th=[ 338], 95.00th=[ 351], 00:16:38.994 | 99.00th=[ 388], 99.50th=[ 437], 99.90th=[41157], 99.95th=[41157], 00:16:38.994 | 99.99th=[41157] 00:16:38.994 write: IOPS=1555, BW=6220KiB/s (6369kB/s)(6220KiB/1000msec); 0 zone resets 00:16:38.994 slat (usec): min=6, max=17610, avg=22.51, stdev=446.33 00:16:38.994 clat (usec): min=150, max=453, avg=198.35, stdev=24.23 00:16:38.994 lat (usec): min=160, max=17970, avg=220.86, stdev=451.14 00:16:38.994 clat percentiles (usec): 00:16:38.994 | 1.00th=[ 165], 5.00th=[ 172], 10.00th=[ 174], 20.00th=[ 180], 00:16:38.994 | 30.00th=[ 184], 40.00th=[ 190], 50.00th=[ 194], 60.00th=[ 200], 00:16:38.994 | 70.00th=[ 206], 80.00th=[ 217], 90.00th=[ 229], 95.00th=[ 241], 00:16:38.994 | 99.00th=[ 265], 99.50th=[ 310], 99.90th=[ 371], 99.95th=[ 453], 00:16:38.994 | 99.99th=[ 453] 00:16:38.994 bw ( KiB/s): min= 4096, max= 4096, per=19.82%, avg=4096.00, stdev= 0.00, samples=1 00:16:38.994 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:16:38.994 lat (usec) : 250=53.54%, 500=46.26%, 750=0.03% 00:16:38.994 lat (msec) : 50=0.16% 00:16:38.994 cpu : usr=2.20%, sys=3.50%, ctx=3093, majf=0, minf=1 00:16:38.994 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:38.994 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:38.994 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:38.994 issued rwts: total=1536,1555,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:38.994 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:38.994 job3: (groupid=0, jobs=1): err= 0: pid=3058789: Thu Nov 21 03:33:19 2024 00:16:38.994 read: IOPS=1011, BW=4047KiB/s (4144kB/s)(4136KiB/1022msec) 00:16:38.994 slat (nsec): min=4396, max=35156, avg=10608.22, stdev=4518.28 00:16:38.994 clat (usec): min=209, max=42079, avg=672.92, stdev=3995.10 00:16:38.994 lat (usec): min=215, max=42092, avg=683.53, stdev=3995.45 00:16:38.994 clat percentiles (usec): 00:16:38.994 | 1.00th=[ 217], 5.00th=[ 223], 10.00th=[ 229], 20.00th=[ 235], 00:16:38.994 | 30.00th=[ 239], 40.00th=[ 245], 50.00th=[ 253], 60.00th=[ 273], 00:16:38.994 | 70.00th=[ 318], 80.00th=[ 334], 90.00th=[ 355], 95.00th=[ 371], 00:16:38.994 | 99.00th=[ 537], 99.50th=[41157], 99.90th=[41157], 99.95th=[42206], 00:16:38.994 | 99.99th=[42206] 00:16:38.994 write: IOPS=1502, BW=6012KiB/s (6156kB/s)(6144KiB/1022msec); 0 zone resets 00:16:38.994 slat (nsec): min=5756, max=35072, avg=11830.42, stdev=4911.78 00:16:38.994 clat (usec): min=144, max=318, avg=187.73, stdev=17.95 00:16:38.994 lat (usec): min=152, max=335, avg=199.56, stdev=18.18 00:16:38.994 clat percentiles (usec): 00:16:38.994 | 1.00th=[ 157], 5.00th=[ 163], 10.00th=[ 169], 20.00th=[ 174], 00:16:38.994 | 30.00th=[ 180], 40.00th=[ 182], 50.00th=[ 186], 60.00th=[ 190], 00:16:38.994 | 70.00th=[ 194], 80.00th=[ 200], 90.00th=[ 208], 95.00th=[ 219], 00:16:38.994 | 99.00th=[ 247], 99.50th=[ 260], 99.90th=[ 314], 99.95th=[ 318], 00:16:38.994 | 99.99th=[ 318] 00:16:38.994 bw ( KiB/s): min= 4096, max= 8192, per=29.73%, avg=6144.00, stdev=2896.31, samples=2 00:16:38.994 iops : min= 1024, max= 2048, avg=1536.00, stdev=724.08, samples=2 00:16:38.994 lat (usec) : 250=78.21%, 500=21.13%, 750=0.27% 00:16:38.994 lat (msec) : 50=0.39% 00:16:38.994 cpu : usr=1.67%, sys=3.23%, ctx=2570, majf=0, minf=2 00:16:38.994 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:38.994 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:38.994 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:38.994 issued rwts: total=1034,1536,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:38.994 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:38.994 00:16:38.994 Run status group 0 (all jobs): 00:16:38.994 READ: bw=15.8MiB/s (16.6MB/s), 127KiB/s-6144KiB/s (131kB/s-6291kB/s), io=16.2MiB (16.9MB), run=1000-1022msec 00:16:38.994 WRITE: bw=20.2MiB/s (21.2MB/s), 2040KiB/s-6701KiB/s (2089kB/s-6862kB/s), io=20.6MiB (21.6MB), run=1000-1022msec 00:16:38.994 00:16:38.994 Disk stats (read/write): 00:16:38.994 nvme0n1: ios=1257/1536, merge=0/0, ticks=463/340, in_queue=803, util=86.67% 00:16:38.994 nvme0n2: ios=54/512, merge=0/0, ticks=1686/104, in_queue=1790, util=97.86% 00:16:38.994 nvme0n3: ios=1048/1501, merge=0/0, ticks=1476/284, in_queue=1760, util=97.80% 00:16:38.994 nvme0n4: ios=1029/1536, merge=0/0, ticks=480/285, in_queue=765, util=89.56% 00:16:38.994 03:33:19 -- target/fio.sh@51 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t randwrite -r 1 -v 00:16:38.994 [global] 00:16:38.994 thread=1 00:16:38.994 invalidate=1 00:16:38.994 rw=randwrite 00:16:38.994 time_based=1 00:16:38.994 runtime=1 00:16:38.994 ioengine=libaio 00:16:38.994 direct=1 00:16:38.994 bs=4096 00:16:38.994 iodepth=1 00:16:38.994 norandommap=0 00:16:38.995 numjobs=1 00:16:38.995 00:16:38.995 verify_dump=1 00:16:38.995 verify_backlog=512 00:16:38.995 verify_state_save=0 00:16:38.995 do_verify=1 00:16:38.995 verify=crc32c-intel 00:16:38.995 [job0] 00:16:38.995 filename=/dev/nvme0n1 00:16:38.995 [job1] 00:16:38.995 filename=/dev/nvme0n2 00:16:38.995 [job2] 00:16:38.995 filename=/dev/nvme0n3 00:16:38.995 [job3] 00:16:38.995 filename=/dev/nvme0n4 00:16:38.995 Could not set queue depth (nvme0n1) 00:16:39.254 Could not set queue depth (nvme0n2) 00:16:39.254 Could not set queue depth (nvme0n3) 00:16:39.254 Could not set queue depth (nvme0n4) 00:16:39.254 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:39.254 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:39.254 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:39.254 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:39.254 fio-3.35 00:16:39.254 Starting 4 threads 00:16:40.631 00:16:40.631 job0: (groupid=0, jobs=1): err= 0: pid=3059017: Thu Nov 21 03:33:21 2024 00:16:40.631 read: IOPS=338, BW=1354KiB/s (1387kB/s)(1384KiB/1022msec) 00:16:40.631 slat (nsec): min=5454, max=67245, avg=16449.16, stdev=8787.82 00:16:40.631 clat (usec): min=227, max=41155, avg=2574.14, stdev=9269.59 00:16:40.631 lat (usec): min=242, max=41177, avg=2590.59, stdev=9270.17 00:16:40.631 clat percentiles (usec): 00:16:40.631 | 1.00th=[ 239], 5.00th=[ 253], 10.00th=[ 262], 20.00th=[ 285], 00:16:40.631 | 30.00th=[ 293], 40.00th=[ 302], 50.00th=[ 318], 60.00th=[ 351], 00:16:40.631 | 70.00th=[ 400], 80.00th=[ 441], 90.00th=[ 478], 95.00th=[40633], 00:16:40.631 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:16:40.631 | 99.99th=[41157] 00:16:40.631 write: IOPS=500, BW=2004KiB/s (2052kB/s)(2048KiB/1022msec); 0 zone resets 00:16:40.631 slat (nsec): min=6566, max=40420, avg=10790.22, stdev=5540.37 00:16:40.631 clat (usec): min=161, max=751, avg=226.50, stdev=66.40 00:16:40.631 lat (usec): min=169, max=758, avg=237.29, stdev=68.60 00:16:40.631 clat percentiles (usec): 00:16:40.631 | 1.00th=[ 165], 5.00th=[ 169], 10.00th=[ 174], 20.00th=[ 180], 00:16:40.631 | 30.00th=[ 186], 40.00th=[ 194], 50.00th=[ 204], 60.00th=[ 219], 00:16:40.631 | 70.00th=[ 237], 80.00th=[ 262], 90.00th=[ 314], 95.00th=[ 355], 00:16:40.631 | 99.00th=[ 465], 99.50th=[ 506], 99.90th=[ 750], 99.95th=[ 750], 00:16:40.631 | 99.99th=[ 750] 00:16:40.631 bw ( KiB/s): min= 4096, max= 4096, per=29.60%, avg=4096.00, stdev= 0.00, samples=1 00:16:40.631 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:16:40.631 lat (usec) : 250=47.09%, 500=49.07%, 750=1.52%, 1000=0.12% 00:16:40.631 lat (msec) : 50=2.21% 00:16:40.631 cpu : usr=0.29%, sys=1.37%, ctx=858, majf=0, minf=1 00:16:40.631 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:40.631 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:40.631 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:40.631 issued rwts: total=346,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:40.631 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:40.631 job1: (groupid=0, jobs=1): err= 0: pid=3059018: Thu Nov 21 03:33:21 2024 00:16:40.632 read: IOPS=1031, BW=4128KiB/s (4227kB/s)(4132KiB/1001msec) 00:16:40.632 slat (nsec): min=6944, max=50181, avg=14415.64, stdev=5559.52 00:16:40.632 clat (usec): min=232, max=41409, avg=637.05, stdev=3790.08 00:16:40.632 lat (usec): min=239, max=41418, avg=651.46, stdev=3790.14 00:16:40.632 clat percentiles (usec): 00:16:40.632 | 1.00th=[ 243], 5.00th=[ 255], 10.00th=[ 260], 20.00th=[ 265], 00:16:40.632 | 30.00th=[ 269], 40.00th=[ 273], 50.00th=[ 277], 60.00th=[ 281], 00:16:40.632 | 70.00th=[ 285], 80.00th=[ 289], 90.00th=[ 302], 95.00th=[ 306], 00:16:40.632 | 99.00th=[ 1352], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:16:40.632 | 99.99th=[41157] 00:16:40.632 write: IOPS=1534, BW=6138KiB/s (6285kB/s)(6144KiB/1001msec); 0 zone resets 00:16:40.632 slat (nsec): min=8786, max=51794, avg=12611.42, stdev=5529.42 00:16:40.632 clat (usec): min=136, max=3246, avg=193.90, stdev=95.32 00:16:40.632 lat (usec): min=145, max=3255, avg=206.51, stdev=96.03 00:16:40.632 clat percentiles (usec): 00:16:40.632 | 1.00th=[ 143], 5.00th=[ 151], 10.00th=[ 157], 20.00th=[ 165], 00:16:40.632 | 30.00th=[ 172], 40.00th=[ 176], 50.00th=[ 182], 60.00th=[ 190], 00:16:40.632 | 70.00th=[ 200], 80.00th=[ 210], 90.00th=[ 231], 95.00th=[ 249], 00:16:40.632 | 99.00th=[ 338], 99.50th=[ 502], 99.90th=[ 1074], 99.95th=[ 3261], 00:16:40.632 | 99.99th=[ 3261] 00:16:40.632 bw ( KiB/s): min= 8192, max= 8192, per=59.20%, avg=8192.00, stdev= 0.00, samples=1 00:16:40.632 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:16:40.632 lat (usec) : 250=58.15%, 500=41.11%, 750=0.12%, 1000=0.08% 00:16:40.632 lat (msec) : 2=0.12%, 4=0.08%, 50=0.35% 00:16:40.632 cpu : usr=2.50%, sys=4.60%, ctx=2571, majf=0, minf=1 00:16:40.632 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:40.632 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:40.632 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:40.632 issued rwts: total=1033,1536,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:40.632 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:40.632 job2: (groupid=0, jobs=1): err= 0: pid=3059019: Thu Nov 21 03:33:21 2024 00:16:40.632 read: IOPS=437, BW=1749KiB/s (1791kB/s)(1812KiB/1036msec) 00:16:40.632 slat (nsec): min=5196, max=51592, avg=14624.08, stdev=7960.74 00:16:40.632 clat (usec): min=207, max=41075, avg=1993.09, stdev=8163.30 00:16:40.632 lat (usec): min=213, max=41092, avg=2007.71, stdev=8163.65 00:16:40.632 clat percentiles (usec): 00:16:40.632 | 1.00th=[ 219], 5.00th=[ 227], 10.00th=[ 233], 20.00th=[ 239], 00:16:40.632 | 30.00th=[ 245], 40.00th=[ 253], 50.00th=[ 265], 60.00th=[ 273], 00:16:40.632 | 70.00th=[ 289], 80.00th=[ 334], 90.00th=[ 453], 95.00th=[ 553], 00:16:40.632 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:16:40.632 | 99.99th=[41157] 00:16:40.632 write: IOPS=494, BW=1977KiB/s (2024kB/s)(2048KiB/1036msec); 0 zone resets 00:16:40.632 slat (nsec): min=6776, max=40308, avg=11232.03, stdev=4741.90 00:16:40.632 clat (usec): min=157, max=894, avg=228.70, stdev=81.88 00:16:40.632 lat (usec): min=165, max=906, avg=239.93, stdev=82.56 00:16:40.632 clat percentiles (usec): 00:16:40.632 | 1.00th=[ 163], 5.00th=[ 172], 10.00th=[ 178], 20.00th=[ 190], 00:16:40.632 | 30.00th=[ 200], 40.00th=[ 208], 50.00th=[ 217], 60.00th=[ 225], 00:16:40.632 | 70.00th=[ 233], 80.00th=[ 247], 90.00th=[ 273], 95.00th=[ 285], 00:16:40.632 | 99.00th=[ 791], 99.50th=[ 848], 99.90th=[ 898], 99.95th=[ 898], 00:16:40.632 | 99.99th=[ 898] 00:16:40.632 bw ( KiB/s): min= 4096, max= 4096, per=29.60%, avg=4096.00, stdev= 0.00, samples=1 00:16:40.632 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:16:40.632 lat (usec) : 250=61.14%, 500=35.13%, 750=1.04%, 1000=0.73% 00:16:40.632 lat (msec) : 50=1.97% 00:16:40.632 cpu : usr=0.48%, sys=1.35%, ctx=965, majf=0, minf=1 00:16:40.632 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:40.632 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:40.632 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:40.632 issued rwts: total=453,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:40.632 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:40.632 job3: (groupid=0, jobs=1): err= 0: pid=3059020: Thu Nov 21 03:33:21 2024 00:16:40.632 read: IOPS=523, BW=2094KiB/s (2144kB/s)(2100KiB/1003msec) 00:16:40.632 slat (nsec): min=5772, max=72949, avg=19732.85, stdev=10871.86 00:16:40.632 clat (usec): min=229, max=42234, avg=1382.05, stdev=6465.69 00:16:40.632 lat (usec): min=243, max=42250, avg=1401.79, stdev=6465.36 00:16:40.632 clat percentiles (usec): 00:16:40.632 | 1.00th=[ 241], 5.00th=[ 251], 10.00th=[ 269], 20.00th=[ 281], 00:16:40.632 | 30.00th=[ 297], 40.00th=[ 318], 50.00th=[ 338], 60.00th=[ 359], 00:16:40.632 | 70.00th=[ 400], 80.00th=[ 441], 90.00th=[ 478], 95.00th=[ 510], 00:16:40.632 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:16:40.632 | 99.99th=[42206] 00:16:40.632 write: IOPS=1020, BW=4084KiB/s (4182kB/s)(4096KiB/1003msec); 0 zone resets 00:16:40.632 slat (nsec): min=7249, max=76985, avg=15888.18, stdev=8814.02 00:16:40.632 clat (usec): min=149, max=783, avg=237.92, stdev=50.88 00:16:40.632 lat (usec): min=158, max=792, avg=253.81, stdev=51.46 00:16:40.632 clat percentiles (usec): 00:16:40.632 | 1.00th=[ 172], 5.00th=[ 192], 10.00th=[ 198], 20.00th=[ 206], 00:16:40.632 | 30.00th=[ 212], 40.00th=[ 219], 50.00th=[ 227], 60.00th=[ 235], 00:16:40.632 | 70.00th=[ 245], 80.00th=[ 265], 90.00th=[ 285], 95.00th=[ 326], 00:16:40.632 | 99.00th=[ 363], 99.50th=[ 392], 99.90th=[ 775], 99.95th=[ 783], 00:16:40.632 | 99.99th=[ 783] 00:16:40.632 bw ( KiB/s): min= 8192, max= 8192, per=59.20%, avg=8192.00, stdev= 0.00, samples=1 00:16:40.632 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:16:40.632 lat (usec) : 250=49.45%, 500=48.29%, 750=1.16%, 1000=0.26% 00:16:40.632 lat (msec) : 50=0.84% 00:16:40.632 cpu : usr=1.40%, sys=2.59%, ctx=1551, majf=0, minf=1 00:16:40.632 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:40.632 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:40.632 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:40.632 issued rwts: total=525,1024,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:40.632 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:40.632 00:16:40.632 Run status group 0 (all jobs): 00:16:40.632 READ: bw=9100KiB/s (9319kB/s), 1354KiB/s-4128KiB/s (1387kB/s-4227kB/s), io=9428KiB (9654kB), run=1001-1036msec 00:16:40.632 WRITE: bw=13.5MiB/s (14.2MB/s), 1977KiB/s-6138KiB/s (2024kB/s-6285kB/s), io=14.0MiB (14.7MB), run=1001-1036msec 00:16:40.632 00:16:40.632 Disk stats (read/write): 00:16:40.632 nvme0n1: ios=391/512, merge=0/0, ticks=711/111, in_queue=822, util=87.78% 00:16:40.632 nvme0n2: ios=1079/1536, merge=0/0, ticks=724/288, in_queue=1012, util=98.17% 00:16:40.632 nvme0n3: ios=448/512, merge=0/0, ticks=688/120, in_queue=808, util=89.04% 00:16:40.632 nvme0n4: ios=578/1024, merge=0/0, ticks=958/228, in_queue=1186, util=98.32% 00:16:40.632 03:33:21 -- target/fio.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t write -r 1 -v 00:16:40.632 [global] 00:16:40.632 thread=1 00:16:40.632 invalidate=1 00:16:40.632 rw=write 00:16:40.632 time_based=1 00:16:40.632 runtime=1 00:16:40.632 ioengine=libaio 00:16:40.632 direct=1 00:16:40.632 bs=4096 00:16:40.632 iodepth=128 00:16:40.632 norandommap=0 00:16:40.632 numjobs=1 00:16:40.632 00:16:40.632 verify_dump=1 00:16:40.632 verify_backlog=512 00:16:40.632 verify_state_save=0 00:16:40.632 do_verify=1 00:16:40.632 verify=crc32c-intel 00:16:40.632 [job0] 00:16:40.632 filename=/dev/nvme0n1 00:16:40.632 [job1] 00:16:40.632 filename=/dev/nvme0n2 00:16:40.632 [job2] 00:16:40.632 filename=/dev/nvme0n3 00:16:40.632 [job3] 00:16:40.632 filename=/dev/nvme0n4 00:16:40.632 Could not set queue depth (nvme0n1) 00:16:40.632 Could not set queue depth (nvme0n2) 00:16:40.632 Could not set queue depth (nvme0n3) 00:16:40.632 Could not set queue depth (nvme0n4) 00:16:40.892 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:40.892 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:40.892 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:40.892 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:40.892 fio-3.35 00:16:40.892 Starting 4 threads 00:16:42.269 00:16:42.269 job0: (groupid=0, jobs=1): err= 0: pid=3059372: Thu Nov 21 03:33:22 2024 00:16:42.269 read: IOPS=4020, BW=15.7MiB/s (16.5MB/s)(15.8MiB/1003msec) 00:16:42.270 slat (usec): min=2, max=12105, avg=122.20, stdev=773.13 00:16:42.270 clat (usec): min=2691, max=54565, avg=16768.73, stdev=10288.00 00:16:42.270 lat (usec): min=4188, max=54585, avg=16890.93, stdev=10345.55 00:16:42.270 clat percentiles (usec): 00:16:42.270 | 1.00th=[ 6980], 5.00th=[ 8225], 10.00th=[ 8717], 20.00th=[ 9241], 00:16:42.270 | 30.00th=[10683], 40.00th=[12256], 50.00th=[13566], 60.00th=[14484], 00:16:42.270 | 70.00th=[16188], 80.00th=[20317], 90.00th=[32113], 95.00th=[44303], 00:16:42.270 | 99.00th=[50594], 99.50th=[53740], 99.90th=[54789], 99.95th=[54789], 00:16:42.270 | 99.99th=[54789] 00:16:42.270 write: IOPS=4083, BW=16.0MiB/s (16.7MB/s)(16.0MiB/1003msec); 0 zone resets 00:16:42.270 slat (usec): min=3, max=19577, avg=113.18, stdev=880.64 00:16:42.270 clat (usec): min=3135, max=61082, avg=14533.83, stdev=10801.31 00:16:42.270 lat (usec): min=3576, max=61096, avg=14647.01, stdev=10874.22 00:16:42.270 clat percentiles (usec): 00:16:42.270 | 1.00th=[ 4621], 5.00th=[ 5604], 10.00th=[ 6128], 20.00th=[ 8356], 00:16:42.270 | 30.00th=[ 8848], 40.00th=[ 9765], 50.00th=[10814], 60.00th=[13435], 00:16:42.270 | 70.00th=[15401], 80.00th=[18744], 90.00th=[22676], 95.00th=[41681], 00:16:42.270 | 99.00th=[58459], 99.50th=[61080], 99.90th=[61080], 99.95th=[61080], 00:16:42.270 | 99.99th=[61080] 00:16:42.270 bw ( KiB/s): min= 8200, max=24518, per=27.33%, avg=16359.00, stdev=11538.57, samples=2 00:16:42.270 iops : min= 2050, max= 6129, avg=4089.50, stdev=2884.29, samples=2 00:16:42.270 lat (msec) : 4=0.30%, 10=35.32%, 20=47.40%, 50=14.86%, 100=2.13% 00:16:42.270 cpu : usr=5.09%, sys=7.98%, ctx=223, majf=0, minf=2 00:16:42.270 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:16:42.270 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:42.270 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:42.270 issued rwts: total=4033,4096,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:42.270 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:42.270 job1: (groupid=0, jobs=1): err= 0: pid=3059373: Thu Nov 21 03:33:22 2024 00:16:42.270 read: IOPS=4059, BW=15.9MiB/s (16.6MB/s)(16.0MiB/1009msec) 00:16:42.270 slat (usec): min=2, max=15485, avg=109.42, stdev=746.15 00:16:42.270 clat (usec): min=4103, max=37310, avg=12960.04, stdev=4804.51 00:16:42.270 lat (usec): min=4109, max=37315, avg=13069.46, stdev=4862.00 00:16:42.270 clat percentiles (usec): 00:16:42.270 | 1.00th=[ 4228], 5.00th=[ 7832], 10.00th=[ 8979], 20.00th=[ 9765], 00:16:42.270 | 30.00th=[10290], 40.00th=[10683], 50.00th=[11338], 60.00th=[12125], 00:16:42.270 | 70.00th=[13698], 80.00th=[16319], 90.00th=[20055], 95.00th=[22152], 00:16:42.270 | 99.00th=[31589], 99.50th=[33424], 99.90th=[37487], 99.95th=[37487], 00:16:42.270 | 99.99th=[37487] 00:16:42.270 write: IOPS=4430, BW=17.3MiB/s (18.1MB/s)(17.5MiB/1009msec); 0 zone resets 00:16:42.270 slat (usec): min=3, max=14764, avg=117.42, stdev=670.56 00:16:42.270 clat (usec): min=2767, max=37304, avg=16527.69, stdev=8456.39 00:16:42.270 lat (usec): min=2773, max=37312, avg=16645.11, stdev=8505.30 00:16:42.270 clat percentiles (usec): 00:16:42.270 | 1.00th=[ 5342], 5.00th=[ 7570], 10.00th=[ 9372], 20.00th=[10159], 00:16:42.270 | 30.00th=[10683], 40.00th=[11207], 50.00th=[11994], 60.00th=[15926], 00:16:42.270 | 70.00th=[19006], 80.00th=[25822], 90.00th=[32113], 95.00th=[33817], 00:16:42.270 | 99.00th=[36963], 99.50th=[36963], 99.90th=[36963], 99.95th=[36963], 00:16:42.270 | 99.99th=[37487] 00:16:42.270 bw ( KiB/s): min=16846, max=17864, per=28.99%, avg=17355.00, stdev=719.83, samples=2 00:16:42.270 iops : min= 4211, max= 4466, avg=4338.50, stdev=180.31, samples=2 00:16:42.270 lat (msec) : 4=0.14%, 10=17.67%, 20=64.23%, 50=17.95% 00:16:42.270 cpu : usr=3.37%, sys=5.06%, ctx=465, majf=0, minf=1 00:16:42.270 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:16:42.270 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:42.270 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:42.270 issued rwts: total=4096,4470,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:42.270 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:42.270 job2: (groupid=0, jobs=1): err= 0: pid=3059376: Thu Nov 21 03:33:22 2024 00:16:42.270 read: IOPS=4067, BW=15.9MiB/s (16.7MB/s)(16.0MiB/1007msec) 00:16:42.270 slat (usec): min=2, max=24613, avg=113.79, stdev=808.53 00:16:42.270 clat (usec): min=7025, max=68137, avg=14215.19, stdev=7184.17 00:16:42.270 lat (usec): min=7031, max=68151, avg=14328.98, stdev=7252.39 00:16:42.270 clat percentiles (usec): 00:16:42.270 | 1.00th=[ 8455], 5.00th=[ 9372], 10.00th=[ 9765], 20.00th=[10159], 00:16:42.270 | 30.00th=[10552], 40.00th=[11076], 50.00th=[11600], 60.00th=[13304], 00:16:42.270 | 70.00th=[14091], 80.00th=[16581], 90.00th=[19006], 95.00th=[25822], 00:16:42.270 | 99.00th=[51643], 99.50th=[51643], 99.90th=[51643], 99.95th=[52167], 00:16:42.270 | 99.99th=[67634] 00:16:42.270 write: IOPS=4455, BW=17.4MiB/s (18.2MB/s)(17.5MiB/1007msec); 0 zone resets 00:16:42.270 slat (usec): min=3, max=10436, avg=111.74, stdev=617.92 00:16:42.270 clat (usec): min=5210, max=38440, avg=15363.27, stdev=5421.47 00:16:42.270 lat (usec): min=6550, max=38448, avg=15475.01, stdev=5464.28 00:16:42.270 clat percentiles (usec): 00:16:42.270 | 1.00th=[ 6980], 5.00th=[ 9765], 10.00th=[10290], 20.00th=[11076], 00:16:42.270 | 30.00th=[11731], 40.00th=[12256], 50.00th=[12649], 60.00th=[16188], 00:16:42.270 | 70.00th=[17171], 80.00th=[20055], 90.00th=[22414], 95.00th=[25560], 00:16:42.270 | 99.00th=[32900], 99.50th=[34341], 99.90th=[38536], 99.95th=[38536], 00:16:42.270 | 99.99th=[38536] 00:16:42.270 bw ( KiB/s): min=16351, max=18496, per=29.10%, avg=17423.50, stdev=1516.74, samples=2 00:16:42.270 iops : min= 4087, max= 4624, avg=4355.50, stdev=379.72, samples=2 00:16:42.270 lat (msec) : 10=9.74%, 20=75.38%, 50=14.13%, 100=0.75% 00:16:42.270 cpu : usr=4.37%, sys=6.36%, ctx=448, majf=0, minf=1 00:16:42.270 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:16:42.270 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:42.270 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:42.270 issued rwts: total=4096,4487,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:42.270 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:42.270 job3: (groupid=0, jobs=1): err= 0: pid=3059378: Thu Nov 21 03:33:22 2024 00:16:42.270 read: IOPS=1780, BW=7120KiB/s (7291kB/s)(7156KiB/1005msec) 00:16:42.270 slat (usec): min=2, max=32389, avg=272.82, stdev=1749.76 00:16:42.270 clat (usec): min=3230, max=95783, avg=34349.30, stdev=18479.16 00:16:42.270 lat (usec): min=5121, max=95792, avg=34622.12, stdev=18551.57 00:16:42.270 clat percentiles (usec): 00:16:42.270 | 1.00th=[ 9110], 5.00th=[11863], 10.00th=[13698], 20.00th=[18482], 00:16:42.270 | 30.00th=[25297], 40.00th=[28443], 50.00th=[29230], 60.00th=[33424], 00:16:42.270 | 70.00th=[36439], 80.00th=[50594], 90.00th=[61080], 95.00th=[73925], 00:16:42.270 | 99.00th=[95945], 99.50th=[95945], 99.90th=[95945], 99.95th=[95945], 00:16:42.270 | 99.99th=[95945] 00:16:42.270 write: IOPS=2037, BW=8151KiB/s (8347kB/s)(8192KiB/1005msec); 0 zone resets 00:16:42.270 slat (usec): min=3, max=18438, avg=244.61, stdev=1396.45 00:16:42.270 clat (msec): min=9, max=118, avg=31.78, stdev=20.17 00:16:42.270 lat (msec): min=9, max=118, avg=32.02, stdev=20.29 00:16:42.270 clat percentiles (msec): 00:16:42.270 | 1.00th=[ 14], 5.00th=[ 18], 10.00th=[ 19], 20.00th=[ 20], 00:16:42.270 | 30.00th=[ 22], 40.00th=[ 24], 50.00th=[ 27], 60.00th=[ 29], 00:16:42.270 | 70.00th=[ 32], 80.00th=[ 37], 90.00th=[ 48], 95.00th=[ 89], 00:16:42.270 | 99.00th=[ 110], 99.50th=[ 114], 99.90th=[ 118], 99.95th=[ 118], 00:16:42.270 | 99.99th=[ 118] 00:16:42.270 bw ( KiB/s): min= 8192, max= 8192, per=13.68%, avg=8192.00, stdev= 0.00, samples=2 00:16:42.270 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=2 00:16:42.270 lat (msec) : 4=0.03%, 10=1.88%, 20=21.45%, 50=62.18%, 100=12.85% 00:16:42.270 lat (msec) : 250=1.62% 00:16:42.270 cpu : usr=1.20%, sys=2.49%, ctx=208, majf=0, minf=1 00:16:42.270 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.8%, >=64=98.4% 00:16:42.270 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:42.270 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:42.270 issued rwts: total=1789,2048,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:42.270 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:42.270 00:16:42.270 Run status group 0 (all jobs): 00:16:42.270 READ: bw=54.3MiB/s (56.9MB/s), 7120KiB/s-15.9MiB/s (7291kB/s-16.7MB/s), io=54.7MiB (57.4MB), run=1003-1009msec 00:16:42.270 WRITE: bw=58.5MiB/s (61.3MB/s), 8151KiB/s-17.4MiB/s (8347kB/s-18.2MB/s), io=59.0MiB (61.9MB), run=1003-1009msec 00:16:42.270 00:16:42.270 Disk stats (read/write): 00:16:42.270 nvme0n1: ios=3636/3725, merge=0/0, ticks=41331/35409, in_queue=76740, util=97.80% 00:16:42.270 nvme0n2: ios=3597/3623, merge=0/0, ticks=38361/41150, in_queue=79511, util=86.60% 00:16:42.270 nvme0n3: ios=3603/3911, merge=0/0, ticks=25760/26068, in_queue=51828, util=97.81% 00:16:42.270 nvme0n4: ios=1426/1536, merge=0/0, ticks=20314/18265, in_queue=38579, util=89.58% 00:16:42.270 03:33:22 -- target/fio.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t randwrite -r 1 -v 00:16:42.270 [global] 00:16:42.270 thread=1 00:16:42.270 invalidate=1 00:16:42.270 rw=randwrite 00:16:42.270 time_based=1 00:16:42.270 runtime=1 00:16:42.270 ioengine=libaio 00:16:42.270 direct=1 00:16:42.270 bs=4096 00:16:42.270 iodepth=128 00:16:42.270 norandommap=0 00:16:42.270 numjobs=1 00:16:42.270 00:16:42.270 verify_dump=1 00:16:42.270 verify_backlog=512 00:16:42.270 verify_state_save=0 00:16:42.270 do_verify=1 00:16:42.270 verify=crc32c-intel 00:16:42.270 [job0] 00:16:42.270 filename=/dev/nvme0n1 00:16:42.270 [job1] 00:16:42.270 filename=/dev/nvme0n2 00:16:42.270 [job2] 00:16:42.270 filename=/dev/nvme0n3 00:16:42.270 [job3] 00:16:42.270 filename=/dev/nvme0n4 00:16:42.270 Could not set queue depth (nvme0n1) 00:16:42.270 Could not set queue depth (nvme0n2) 00:16:42.270 Could not set queue depth (nvme0n3) 00:16:42.270 Could not set queue depth (nvme0n4) 00:16:42.270 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:42.270 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:42.270 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:42.270 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:42.270 fio-3.35 00:16:42.270 Starting 4 threads 00:16:43.649 00:16:43.649 job0: (groupid=0, jobs=1): err= 0: pid=3059614: Thu Nov 21 03:33:23 2024 00:16:43.649 read: IOPS=5109, BW=20.0MiB/s (20.9MB/s)(20.0MiB/1002msec) 00:16:43.649 slat (usec): min=2, max=5556, avg=86.08, stdev=402.94 00:16:43.649 clat (usec): min=5970, max=16616, avg=11672.03, stdev=1118.26 00:16:43.649 lat (usec): min=5978, max=17971, avg=11758.11, stdev=1067.59 00:16:43.649 clat percentiles (usec): 00:16:43.649 | 1.00th=[ 8225], 5.00th=[ 9765], 10.00th=[10421], 20.00th=[10945], 00:16:43.649 | 30.00th=[11207], 40.00th=[11600], 50.00th=[11731], 60.00th=[11994], 00:16:43.649 | 70.00th=[12125], 80.00th=[12518], 90.00th=[12780], 95.00th=[13173], 00:16:43.649 | 99.00th=[14484], 99.50th=[15139], 99.90th=[16581], 99.95th=[16581], 00:16:43.649 | 99.99th=[16581] 00:16:43.649 write: IOPS=5150, BW=20.1MiB/s (21.1MB/s)(20.2MiB/1002msec); 0 zone resets 00:16:43.649 slat (usec): min=3, max=15894, avg=95.54, stdev=526.33 00:16:43.649 clat (usec): min=466, max=35915, avg=12812.72, stdev=3880.42 00:16:43.649 lat (usec): min=2842, max=35933, avg=12908.25, stdev=3892.32 00:16:43.649 clat percentiles (usec): 00:16:43.649 | 1.00th=[ 3818], 5.00th=[ 9503], 10.00th=[ 9896], 20.00th=[10683], 00:16:43.649 | 30.00th=[11600], 40.00th=[11994], 50.00th=[12256], 60.00th=[12387], 00:16:43.649 | 70.00th=[12649], 80.00th=[13173], 90.00th=[16909], 95.00th=[21365], 00:16:43.649 | 99.00th=[29492], 99.50th=[29492], 99.90th=[29754], 99.95th=[29754], 00:16:43.649 | 99.99th=[35914] 00:16:43.649 bw ( KiB/s): min=20480, max=20480, per=26.39%, avg=20480.00, stdev= 0.00, samples=2 00:16:43.649 iops : min= 5120, max= 5120, avg=5120.00, stdev= 0.00, samples=2 00:16:43.649 lat (usec) : 500=0.01% 00:16:43.649 lat (msec) : 4=0.61%, 10=8.13%, 20=87.55%, 50=3.70% 00:16:43.649 cpu : usr=6.99%, sys=10.39%, ctx=514, majf=0, minf=1 00:16:43.649 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.4% 00:16:43.649 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:43.649 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:43.649 issued rwts: total=5120,5161,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:43.650 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:43.650 job1: (groupid=0, jobs=1): err= 0: pid=3059615: Thu Nov 21 03:33:23 2024 00:16:43.650 read: IOPS=5547, BW=21.7MiB/s (22.7MB/s)(21.8MiB/1004msec) 00:16:43.650 slat (usec): min=3, max=6705, avg=86.43, stdev=544.96 00:16:43.650 clat (usec): min=773, max=27426, avg=11359.20, stdev=2602.31 00:16:43.650 lat (usec): min=5074, max=27430, avg=11445.64, stdev=2641.08 00:16:43.650 clat percentiles (usec): 00:16:43.650 | 1.00th=[ 6128], 5.00th=[ 8848], 10.00th=[ 9503], 20.00th=[10028], 00:16:43.650 | 30.00th=[10552], 40.00th=[10814], 50.00th=[10945], 60.00th=[11076], 00:16:43.650 | 70.00th=[11207], 80.00th=[11600], 90.00th=[13698], 95.00th=[17171], 00:16:43.650 | 99.00th=[22152], 99.50th=[23200], 99.90th=[23725], 99.95th=[24249], 00:16:43.650 | 99.99th=[27395] 00:16:43.650 write: IOPS=5609, BW=21.9MiB/s (23.0MB/s)(22.0MiB/1004msec); 0 zone resets 00:16:43.650 slat (usec): min=4, max=11190, avg=82.13, stdev=469.54 00:16:43.650 clat (usec): min=5747, max=23505, avg=11325.47, stdev=1575.14 00:16:43.650 lat (usec): min=5756, max=23543, avg=11407.59, stdev=1624.43 00:16:43.650 clat percentiles (usec): 00:16:43.650 | 1.00th=[ 7046], 5.00th=[ 9372], 10.00th=[10028], 20.00th=[10421], 00:16:43.650 | 30.00th=[10552], 40.00th=[11076], 50.00th=[11338], 60.00th=[11600], 00:16:43.650 | 70.00th=[11863], 80.00th=[11994], 90.00th=[12125], 95.00th=[14353], 00:16:43.650 | 99.00th=[17433], 99.50th=[17433], 99.90th=[20055], 99.95th=[20055], 00:16:43.650 | 99.99th=[23462] 00:16:43.650 bw ( KiB/s): min=20992, max=24064, per=29.03%, avg=22528.00, stdev=2172.23, samples=2 00:16:43.650 iops : min= 5248, max= 6016, avg=5632.00, stdev=543.06, samples=2 00:16:43.650 lat (usec) : 1000=0.01% 00:16:43.650 lat (msec) : 10=14.62%, 20=83.32%, 50=2.04% 00:16:43.650 cpu : usr=7.78%, sys=10.97%, ctx=453, majf=0, minf=1 00:16:43.650 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.4% 00:16:43.650 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:43.650 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:43.650 issued rwts: total=5570,5632,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:43.650 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:43.650 job2: (groupid=0, jobs=1): err= 0: pid=3059616: Thu Nov 21 03:33:23 2024 00:16:43.650 read: IOPS=3884, BW=15.2MiB/s (15.9MB/s)(15.2MiB/1004msec) 00:16:43.650 slat (usec): min=3, max=12714, avg=113.51, stdev=691.33 00:16:43.650 clat (usec): min=666, max=54194, avg=13974.84, stdev=5350.67 00:16:43.650 lat (usec): min=5512, max=54230, avg=14088.35, stdev=5412.22 00:16:43.650 clat percentiles (usec): 00:16:43.650 | 1.00th=[ 6194], 5.00th=[10159], 10.00th=[11863], 20.00th=[12256], 00:16:43.650 | 30.00th=[12387], 40.00th=[12518], 50.00th=[12518], 60.00th=[12780], 00:16:43.650 | 70.00th=[13042], 80.00th=[14091], 90.00th=[19792], 95.00th=[20055], 00:16:43.650 | 99.00th=[49546], 99.50th=[50594], 99.90th=[50594], 99.95th=[52691], 00:16:43.650 | 99.99th=[54264] 00:16:43.650 write: IOPS=4079, BW=15.9MiB/s (16.7MB/s)(16.0MiB/1004msec); 0 zone resets 00:16:43.650 slat (usec): min=4, max=25032, avg=126.35, stdev=983.33 00:16:43.650 clat (usec): min=6768, max=82476, avg=17591.41, stdev=12561.32 00:16:43.650 lat (usec): min=7485, max=82521, avg=17717.76, stdev=12666.13 00:16:43.650 clat percentiles (usec): 00:16:43.650 | 1.00th=[ 7832], 5.00th=[ 9765], 10.00th=[12387], 20.00th=[12911], 00:16:43.650 | 30.00th=[13173], 40.00th=[13304], 50.00th=[13435], 60.00th=[13698], 00:16:43.650 | 70.00th=[13829], 80.00th=[14222], 90.00th=[37487], 95.00th=[49546], 00:16:43.650 | 99.00th=[68682], 99.50th=[68682], 99.90th=[69731], 99.95th=[72877], 00:16:43.650 | 99.99th=[82314] 00:16:43.650 bw ( KiB/s): min=12288, max=20480, per=21.11%, avg=16384.00, stdev=5792.62, samples=2 00:16:43.650 iops : min= 3072, max= 5120, avg=4096.00, stdev=1448.15, samples=2 00:16:43.650 lat (usec) : 750=0.01% 00:16:43.650 lat (msec) : 10=5.19%, 20=85.14%, 50=7.10%, 100=2.55% 00:16:43.650 cpu : usr=5.48%, sys=7.88%, ctx=328, majf=0, minf=1 00:16:43.650 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:16:43.650 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:43.650 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:43.650 issued rwts: total=3900,4096,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:43.650 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:43.650 job3: (groupid=0, jobs=1): err= 0: pid=3059617: Thu Nov 21 03:33:23 2024 00:16:43.650 read: IOPS=4451, BW=17.4MiB/s (18.2MB/s)(17.5MiB/1005msec) 00:16:43.650 slat (usec): min=3, max=12429, avg=110.95, stdev=798.84 00:16:43.650 clat (usec): min=753, max=28507, avg=14243.96, stdev=3561.78 00:16:43.650 lat (usec): min=2670, max=28525, avg=14354.91, stdev=3604.83 00:16:43.650 clat percentiles (usec): 00:16:43.650 | 1.00th=[ 8586], 5.00th=[ 9896], 10.00th=[10683], 20.00th=[11994], 00:16:43.650 | 30.00th=[12518], 40.00th=[12780], 50.00th=[13042], 60.00th=[13435], 00:16:43.650 | 70.00th=[15401], 80.00th=[16712], 90.00th=[19268], 95.00th=[21890], 00:16:43.650 | 99.00th=[25035], 99.50th=[25297], 99.90th=[28443], 99.95th=[28443], 00:16:43.650 | 99.99th=[28443] 00:16:43.650 write: IOPS=4585, BW=17.9MiB/s (18.8MB/s)(18.0MiB/1005msec); 0 zone resets 00:16:43.650 slat (usec): min=4, max=15374, avg=99.10, stdev=590.79 00:16:43.650 clat (usec): min=1983, max=29336, avg=13755.85, stdev=4913.02 00:16:43.650 lat (usec): min=1997, max=29387, avg=13854.95, stdev=4952.95 00:16:43.650 clat percentiles (usec): 00:16:43.650 | 1.00th=[ 3982], 5.00th=[ 5800], 10.00th=[ 7439], 20.00th=[10552], 00:16:43.650 | 30.00th=[12911], 40.00th=[13435], 50.00th=[13960], 60.00th=[14091], 00:16:43.650 | 70.00th=[14222], 80.00th=[14615], 90.00th=[19792], 95.00th=[26084], 00:16:43.650 | 99.00th=[26870], 99.50th=[26870], 99.90th=[27132], 99.95th=[28443], 00:16:43.650 | 99.99th=[29230] 00:16:43.650 bw ( KiB/s): min=17840, max=19024, per=23.75%, avg=18432.00, stdev=837.21, samples=2 00:16:43.650 iops : min= 4460, max= 4756, avg=4608.00, stdev=209.30, samples=2 00:16:43.650 lat (usec) : 1000=0.01% 00:16:43.650 lat (msec) : 2=0.06%, 4=0.50%, 10=12.37%, 20=78.37%, 50=8.70% 00:16:43.650 cpu : usr=6.47%, sys=9.06%, ctx=473, majf=0, minf=2 00:16:43.650 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:16:43.650 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:43.650 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:43.650 issued rwts: total=4474,4608,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:43.650 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:43.650 00:16:43.650 Run status group 0 (all jobs): 00:16:43.650 READ: bw=74.1MiB/s (77.7MB/s), 15.2MiB/s-21.7MiB/s (15.9MB/s-22.7MB/s), io=74.5MiB (78.1MB), run=1002-1005msec 00:16:43.650 WRITE: bw=75.8MiB/s (79.5MB/s), 15.9MiB/s-21.9MiB/s (16.7MB/s-23.0MB/s), io=76.2MiB (79.9MB), run=1002-1005msec 00:16:43.650 00:16:43.650 Disk stats (read/write): 00:16:43.650 nvme0n1: ios=4147/4608, merge=0/0, ticks=11723/15419, in_queue=27142, util=87.47% 00:16:43.650 nvme0n2: ios=4632/4951, merge=0/0, ticks=25590/24783, in_queue=50373, util=98.58% 00:16:43.650 nvme0n3: ios=3100/3463, merge=0/0, ticks=20011/25278, in_queue=45289, util=94.07% 00:16:43.650 nvme0n4: ios=3642/4062, merge=0/0, ticks=48584/54870, in_queue=103454, util=98.43% 00:16:43.650 03:33:23 -- target/fio.sh@55 -- # sync 00:16:43.650 03:33:23 -- target/fio.sh@59 -- # fio_pid=3059758 00:16:43.650 03:33:23 -- target/fio.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t read -r 10 00:16:43.650 03:33:23 -- target/fio.sh@61 -- # sleep 3 00:16:43.650 [global] 00:16:43.650 thread=1 00:16:43.650 invalidate=1 00:16:43.650 rw=read 00:16:43.650 time_based=1 00:16:43.650 runtime=10 00:16:43.650 ioengine=libaio 00:16:43.650 direct=1 00:16:43.650 bs=4096 00:16:43.650 iodepth=1 00:16:43.650 norandommap=1 00:16:43.650 numjobs=1 00:16:43.650 00:16:43.650 [job0] 00:16:43.650 filename=/dev/nvme0n1 00:16:43.650 [job1] 00:16:43.650 filename=/dev/nvme0n2 00:16:43.650 [job2] 00:16:43.650 filename=/dev/nvme0n3 00:16:43.650 [job3] 00:16:43.650 filename=/dev/nvme0n4 00:16:43.650 Could not set queue depth (nvme0n1) 00:16:43.650 Could not set queue depth (nvme0n2) 00:16:43.650 Could not set queue depth (nvme0n3) 00:16:43.650 Could not set queue depth (nvme0n4) 00:16:43.650 job0: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:43.650 job1: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:43.650 job2: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:43.650 job3: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:43.650 fio-3.35 00:16:43.650 Starting 4 threads 00:16:46.934 03:33:26 -- target/fio.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete concat0 00:16:46.934 03:33:27 -- target/fio.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete raid0 00:16:46.934 fio: io_u error on file /dev/nvme0n4: Operation not supported: read offset=38801408, buflen=4096 00:16:46.934 fio: pid=3059850, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:16:46.934 03:33:27 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:46.934 03:33:27 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc0 00:16:46.934 fio: io_u error on file /dev/nvme0n3: Operation not supported: read offset=2240512, buflen=4096 00:16:46.934 fio: pid=3059849, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:16:47.192 03:33:27 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:47.192 03:33:27 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc1 00:16:47.192 fio: io_u error on file /dev/nvme0n1: Operation not supported: read offset=344064, buflen=4096 00:16:47.192 fio: pid=3059847, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:16:47.450 03:33:28 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:47.450 03:33:28 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc2 00:16:47.450 fio: io_u error on file /dev/nvme0n2: Input/output error: read offset=372736, buflen=4096 00:16:47.450 fio: pid=3059848, err=5/file:io_u.c:1889, func=io_u error, error=Input/output error 00:16:47.709 00:16:47.709 job0: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=3059847: Thu Nov 21 03:33:28 2024 00:16:47.709 read: IOPS=24, BW=97.7KiB/s (100kB/s)(336KiB/3440msec) 00:16:47.709 slat (usec): min=10, max=9887, avg=136.35, stdev=1070.29 00:16:47.709 clat (usec): min=560, max=44017, avg=40531.55, stdev=4427.29 00:16:47.709 lat (usec): min=581, max=50988, avg=40669.13, stdev=4570.98 00:16:47.709 clat percentiles (usec): 00:16:47.709 | 1.00th=[ 562], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:16:47.709 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:16:47.709 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:16:47.709 | 99.00th=[43779], 99.50th=[43779], 99.90th=[43779], 99.95th=[43779], 00:16:47.709 | 99.99th=[43779] 00:16:47.709 bw ( KiB/s): min= 96, max= 104, per=0.89%, avg=98.67, stdev= 4.13, samples=6 00:16:47.709 iops : min= 24, max= 26, avg=24.67, stdev= 1.03, samples=6 00:16:47.709 lat (usec) : 750=1.18% 00:16:47.709 lat (msec) : 50=97.65% 00:16:47.709 cpu : usr=0.12%, sys=0.00%, ctx=86, majf=0, minf=1 00:16:47.709 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:47.709 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:47.709 complete : 0=1.2%, 4=98.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:47.709 issued rwts: total=85,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:47.709 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:47.709 job1: (groupid=0, jobs=1): err= 5 (file:io_u.c:1889, func=io_u error, error=Input/output error): pid=3059848: Thu Nov 21 03:33:28 2024 00:16:47.709 read: IOPS=24, BW=98.2KiB/s (101kB/s)(364KiB/3706msec) 00:16:47.709 slat (usec): min=11, max=7872, avg=178.32, stdev=1072.59 00:16:47.709 clat (usec): min=444, max=41132, avg=40533.45, stdev=4249.46 00:16:47.709 lat (usec): min=470, max=48979, avg=40639.54, stdev=4339.28 00:16:47.709 clat percentiles (usec): 00:16:47.709 | 1.00th=[ 445], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:16:47.709 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:16:47.709 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:16:47.709 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:16:47.709 | 99.99th=[41157] 00:16:47.709 bw ( KiB/s): min= 93, max= 104, per=0.88%, avg=97.86, stdev= 4.34, samples=7 00:16:47.709 iops : min= 23, max= 26, avg=24.43, stdev= 1.13, samples=7 00:16:47.709 lat (usec) : 500=1.09% 00:16:47.709 lat (msec) : 50=97.83% 00:16:47.709 cpu : usr=0.00%, sys=0.27%, ctx=94, majf=0, minf=1 00:16:47.709 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:47.709 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:47.709 complete : 0=1.1%, 4=98.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:47.709 issued rwts: total=92,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:47.709 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:47.709 job2: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=3059849: Thu Nov 21 03:33:28 2024 00:16:47.709 read: IOPS=173, BW=692KiB/s (708kB/s)(2188KiB/3164msec) 00:16:47.709 slat (nsec): min=5661, max=60181, avg=19774.28, stdev=10091.49 00:16:47.709 clat (usec): min=232, max=41155, avg=5716.96, stdev=13848.40 00:16:47.709 lat (usec): min=250, max=41169, avg=5736.70, stdev=13849.81 00:16:47.709 clat percentiles (usec): 00:16:47.709 | 1.00th=[ 239], 5.00th=[ 247], 10.00th=[ 249], 20.00th=[ 260], 00:16:47.709 | 30.00th=[ 265], 40.00th=[ 277], 50.00th=[ 289], 60.00th=[ 302], 00:16:47.709 | 70.00th=[ 326], 80.00th=[ 338], 90.00th=[41157], 95.00th=[41157], 00:16:47.709 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:16:47.709 | 99.99th=[41157] 00:16:47.709 bw ( KiB/s): min= 96, max= 3856, per=6.58%, avg=724.00, stdev=1534.36, samples=6 00:16:47.709 iops : min= 24, max= 964, avg=181.00, stdev=383.59, samples=6 00:16:47.709 lat (usec) : 250=11.50%, 500=75.00% 00:16:47.709 lat (msec) : 50=13.32% 00:16:47.709 cpu : usr=0.19%, sys=0.32%, ctx=549, majf=0, minf=2 00:16:47.709 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:47.709 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:47.709 complete : 0=0.2%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:47.709 issued rwts: total=548,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:47.709 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:47.709 job3: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=3059850: Thu Nov 21 03:33:28 2024 00:16:47.709 read: IOPS=3272, BW=12.8MiB/s (13.4MB/s)(37.0MiB/2895msec) 00:16:47.709 slat (nsec): min=4359, max=77970, avg=15634.61, stdev=9491.14 00:16:47.709 clat (usec): min=216, max=40915, avg=283.94, stdev=419.73 00:16:47.709 lat (usec): min=222, max=40933, avg=299.57, stdev=420.22 00:16:47.709 clat percentiles (usec): 00:16:47.709 | 1.00th=[ 225], 5.00th=[ 231], 10.00th=[ 235], 20.00th=[ 243], 00:16:47.709 | 30.00th=[ 249], 40.00th=[ 265], 50.00th=[ 273], 60.00th=[ 281], 00:16:47.709 | 70.00th=[ 297], 80.00th=[ 314], 90.00th=[ 338], 95.00th=[ 355], 00:16:47.709 | 99.00th=[ 408], 99.50th=[ 453], 99.90th=[ 537], 99.95th=[ 717], 00:16:47.709 | 99.99th=[41157] 00:16:47.709 bw ( KiB/s): min=11056, max=14424, per=100.00%, avg=12966.40, stdev=1508.94, samples=5 00:16:47.709 iops : min= 2764, max= 3606, avg=3241.60, stdev=377.24, samples=5 00:16:47.709 lat (usec) : 250=32.01%, 500=67.82%, 750=0.13%, 1000=0.01% 00:16:47.709 lat (msec) : 2=0.01%, 50=0.01% 00:16:47.709 cpu : usr=2.28%, sys=5.67%, ctx=9476, majf=0, minf=2 00:16:47.709 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:47.709 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:47.709 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:47.709 issued rwts: total=9474,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:47.709 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:47.709 00:16:47.709 Run status group 0 (all jobs): 00:16:47.709 READ: bw=10.7MiB/s (11.3MB/s), 97.7KiB/s-12.8MiB/s (100kB/s-13.4MB/s), io=39.8MiB (41.8MB), run=2895-3706msec 00:16:47.709 00:16:47.709 Disk stats (read/write): 00:16:47.709 nvme0n1: ios=82/0, merge=0/0, ticks=3325/0, in_queue=3325, util=95.77% 00:16:47.709 nvme0n2: ios=88/0, merge=0/0, ticks=3568/0, in_queue=3568, util=96.41% 00:16:47.709 nvme0n3: ios=596/0, merge=0/0, ticks=4131/0, in_queue=4131, util=99.56% 00:16:47.709 nvme0n4: ios=9461/0, merge=0/0, ticks=3256/0, in_queue=3256, util=99.53% 00:16:47.709 03:33:28 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:47.709 03:33:28 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc3 00:16:47.966 03:33:28 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:47.966 03:33:28 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc4 00:16:48.223 03:33:28 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:48.223 03:33:28 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc5 00:16:48.480 03:33:29 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:48.480 03:33:29 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc6 00:16:49.043 03:33:29 -- target/fio.sh@69 -- # fio_status=0 00:16:49.043 03:33:29 -- target/fio.sh@70 -- # wait 3059758 00:16:49.043 03:33:29 -- target/fio.sh@70 -- # fio_status=4 00:16:49.043 03:33:29 -- target/fio.sh@72 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:16:49.043 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:16:49.043 03:33:29 -- target/fio.sh@73 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:16:49.043 03:33:29 -- common/autotest_common.sh@1208 -- # local i=0 00:16:49.043 03:33:29 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:16:49.043 03:33:29 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:16:49.043 03:33:29 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:16:49.043 03:33:29 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:16:49.043 03:33:29 -- common/autotest_common.sh@1220 -- # return 0 00:16:49.043 03:33:29 -- target/fio.sh@75 -- # '[' 4 -eq 0 ']' 00:16:49.043 03:33:29 -- target/fio.sh@80 -- # echo 'nvmf hotplug test: fio failed as expected' 00:16:49.043 nvmf hotplug test: fio failed as expected 00:16:49.043 03:33:29 -- target/fio.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:16:49.300 03:33:29 -- target/fio.sh@85 -- # rm -f ./local-job0-0-verify.state 00:16:49.300 03:33:29 -- target/fio.sh@86 -- # rm -f ./local-job1-1-verify.state 00:16:49.300 03:33:29 -- target/fio.sh@87 -- # rm -f ./local-job2-2-verify.state 00:16:49.300 03:33:29 -- target/fio.sh@89 -- # trap - SIGINT SIGTERM EXIT 00:16:49.300 03:33:29 -- target/fio.sh@91 -- # nvmftestfini 00:16:49.300 03:33:29 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:49.300 03:33:29 -- nvmf/common.sh@116 -- # sync 00:16:49.300 03:33:29 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:49.300 03:33:29 -- nvmf/common.sh@119 -- # set +e 00:16:49.300 03:33:29 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:49.300 03:33:29 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:49.300 rmmod nvme_tcp 00:16:49.300 rmmod nvme_fabrics 00:16:49.300 rmmod nvme_keyring 00:16:49.300 03:33:29 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:49.300 03:33:29 -- nvmf/common.sh@123 -- # set -e 00:16:49.300 03:33:29 -- nvmf/common.sh@124 -- # return 0 00:16:49.300 03:33:29 -- nvmf/common.sh@477 -- # '[' -n 3057671 ']' 00:16:49.300 03:33:29 -- nvmf/common.sh@478 -- # killprocess 3057671 00:16:49.300 03:33:29 -- common/autotest_common.sh@936 -- # '[' -z 3057671 ']' 00:16:49.300 03:33:29 -- common/autotest_common.sh@940 -- # kill -0 3057671 00:16:49.300 03:33:29 -- common/autotest_common.sh@941 -- # uname 00:16:49.300 03:33:29 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:49.300 03:33:29 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3057671 00:16:49.300 03:33:29 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:49.300 03:33:29 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:49.300 03:33:29 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3057671' 00:16:49.300 killing process with pid 3057671 00:16:49.300 03:33:29 -- common/autotest_common.sh@955 -- # kill 3057671 00:16:49.300 03:33:29 -- common/autotest_common.sh@960 -- # wait 3057671 00:16:49.558 03:33:30 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:49.558 03:33:30 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:49.558 03:33:30 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:49.558 03:33:30 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:49.558 03:33:30 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:49.558 03:33:30 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:49.558 03:33:30 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:49.558 03:33:30 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:52.092 03:33:32 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:52.092 00:16:52.093 real 0m24.279s 00:16:52.093 user 1m26.188s 00:16:52.093 sys 0m6.356s 00:16:52.093 03:33:32 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:52.093 03:33:32 -- common/autotest_common.sh@10 -- # set +x 00:16:52.093 ************************************ 00:16:52.093 END TEST nvmf_fio_target 00:16:52.093 ************************************ 00:16:52.093 03:33:32 -- nvmf/nvmf.sh@55 -- # run_test nvmf_bdevio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:16:52.093 03:33:32 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:52.093 03:33:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:52.093 03:33:32 -- common/autotest_common.sh@10 -- # set +x 00:16:52.093 ************************************ 00:16:52.093 START TEST nvmf_bdevio 00:16:52.093 ************************************ 00:16:52.093 03:33:32 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:16:52.093 * Looking for test storage... 00:16:52.093 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:52.093 03:33:32 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:52.093 03:33:32 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:52.093 03:33:32 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:52.093 03:33:32 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:52.093 03:33:32 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:52.093 03:33:32 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:52.093 03:33:32 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:52.093 03:33:32 -- scripts/common.sh@335 -- # IFS=.-: 00:16:52.093 03:33:32 -- scripts/common.sh@335 -- # read -ra ver1 00:16:52.093 03:33:32 -- scripts/common.sh@336 -- # IFS=.-: 00:16:52.093 03:33:32 -- scripts/common.sh@336 -- # read -ra ver2 00:16:52.093 03:33:32 -- scripts/common.sh@337 -- # local 'op=<' 00:16:52.093 03:33:32 -- scripts/common.sh@339 -- # ver1_l=2 00:16:52.093 03:33:32 -- scripts/common.sh@340 -- # ver2_l=1 00:16:52.093 03:33:32 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:52.093 03:33:32 -- scripts/common.sh@343 -- # case "$op" in 00:16:52.093 03:33:32 -- scripts/common.sh@344 -- # : 1 00:16:52.093 03:33:32 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:52.093 03:33:32 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:52.093 03:33:32 -- scripts/common.sh@364 -- # decimal 1 00:16:52.093 03:33:32 -- scripts/common.sh@352 -- # local d=1 00:16:52.093 03:33:32 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:52.093 03:33:32 -- scripts/common.sh@354 -- # echo 1 00:16:52.093 03:33:32 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:52.093 03:33:32 -- scripts/common.sh@365 -- # decimal 2 00:16:52.093 03:33:32 -- scripts/common.sh@352 -- # local d=2 00:16:52.093 03:33:32 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:52.093 03:33:32 -- scripts/common.sh@354 -- # echo 2 00:16:52.093 03:33:32 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:52.093 03:33:32 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:52.093 03:33:32 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:52.093 03:33:32 -- scripts/common.sh@367 -- # return 0 00:16:52.093 03:33:32 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:52.093 03:33:32 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:52.093 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:52.093 --rc genhtml_branch_coverage=1 00:16:52.093 --rc genhtml_function_coverage=1 00:16:52.093 --rc genhtml_legend=1 00:16:52.093 --rc geninfo_all_blocks=1 00:16:52.093 --rc geninfo_unexecuted_blocks=1 00:16:52.093 00:16:52.093 ' 00:16:52.093 03:33:32 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:52.093 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:52.093 --rc genhtml_branch_coverage=1 00:16:52.093 --rc genhtml_function_coverage=1 00:16:52.093 --rc genhtml_legend=1 00:16:52.093 --rc geninfo_all_blocks=1 00:16:52.093 --rc geninfo_unexecuted_blocks=1 00:16:52.093 00:16:52.093 ' 00:16:52.093 03:33:32 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:52.093 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:52.093 --rc genhtml_branch_coverage=1 00:16:52.093 --rc genhtml_function_coverage=1 00:16:52.093 --rc genhtml_legend=1 00:16:52.093 --rc geninfo_all_blocks=1 00:16:52.093 --rc geninfo_unexecuted_blocks=1 00:16:52.093 00:16:52.093 ' 00:16:52.093 03:33:32 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:52.093 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:52.093 --rc genhtml_branch_coverage=1 00:16:52.093 --rc genhtml_function_coverage=1 00:16:52.093 --rc genhtml_legend=1 00:16:52.093 --rc geninfo_all_blocks=1 00:16:52.093 --rc geninfo_unexecuted_blocks=1 00:16:52.093 00:16:52.093 ' 00:16:52.093 03:33:32 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:52.093 03:33:32 -- nvmf/common.sh@7 -- # uname -s 00:16:52.093 03:33:32 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:52.093 03:33:32 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:52.093 03:33:32 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:52.093 03:33:32 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:52.093 03:33:32 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:52.093 03:33:32 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:52.093 03:33:32 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:52.093 03:33:32 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:52.093 03:33:32 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:52.093 03:33:32 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:52.093 03:33:32 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:52.093 03:33:32 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:52.093 03:33:32 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:52.093 03:33:32 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:52.093 03:33:32 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:52.093 03:33:32 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:52.093 03:33:32 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:52.093 03:33:32 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:52.093 03:33:32 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:52.093 03:33:32 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:52.093 03:33:32 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:52.093 03:33:32 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:52.093 03:33:32 -- paths/export.sh@5 -- # export PATH 00:16:52.093 03:33:32 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:52.093 03:33:32 -- nvmf/common.sh@46 -- # : 0 00:16:52.093 03:33:32 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:52.093 03:33:32 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:52.093 03:33:32 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:52.093 03:33:32 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:52.093 03:33:32 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:52.093 03:33:32 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:52.093 03:33:32 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:52.093 03:33:32 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:52.093 03:33:32 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:52.093 03:33:32 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:52.093 03:33:32 -- target/bdevio.sh@14 -- # nvmftestinit 00:16:52.093 03:33:32 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:52.093 03:33:32 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:52.093 03:33:32 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:52.093 03:33:32 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:52.093 03:33:32 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:52.093 03:33:32 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:52.094 03:33:32 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:52.094 03:33:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:52.094 03:33:32 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:52.094 03:33:32 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:52.094 03:33:32 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:52.094 03:33:32 -- common/autotest_common.sh@10 -- # set +x 00:16:54.057 03:33:34 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:54.057 03:33:34 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:54.057 03:33:34 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:54.057 03:33:34 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:54.057 03:33:34 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:54.057 03:33:34 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:54.057 03:33:34 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:54.057 03:33:34 -- nvmf/common.sh@294 -- # net_devs=() 00:16:54.057 03:33:34 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:54.057 03:33:34 -- nvmf/common.sh@295 -- # e810=() 00:16:54.057 03:33:34 -- nvmf/common.sh@295 -- # local -ga e810 00:16:54.057 03:33:34 -- nvmf/common.sh@296 -- # x722=() 00:16:54.057 03:33:34 -- nvmf/common.sh@296 -- # local -ga x722 00:16:54.057 03:33:34 -- nvmf/common.sh@297 -- # mlx=() 00:16:54.058 03:33:34 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:54.058 03:33:34 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:54.058 03:33:34 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:54.058 03:33:34 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:54.058 03:33:34 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:54.058 03:33:34 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:54.058 03:33:34 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:54.058 03:33:34 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:54.058 03:33:34 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:54.058 03:33:34 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:54.058 03:33:34 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:54.058 03:33:34 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:54.058 03:33:34 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:54.058 03:33:34 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:54.058 03:33:34 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:54.058 03:33:34 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:54.058 03:33:34 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:54.058 03:33:34 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:54.058 03:33:34 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:54.058 03:33:34 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:16:54.058 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:16:54.058 03:33:34 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:54.058 03:33:34 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:54.058 03:33:34 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:54.058 03:33:34 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:54.058 03:33:34 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:54.058 03:33:34 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:54.058 03:33:34 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:16:54.058 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:16:54.058 03:33:34 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:54.058 03:33:34 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:54.058 03:33:34 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:54.058 03:33:34 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:54.058 03:33:34 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:54.058 03:33:34 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:54.058 03:33:34 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:54.058 03:33:34 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:54.058 03:33:34 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:54.058 03:33:34 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:54.058 03:33:34 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:54.058 03:33:34 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:54.058 03:33:34 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:16:54.058 Found net devices under 0000:0a:00.0: cvl_0_0 00:16:54.058 03:33:34 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:54.058 03:33:34 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:54.058 03:33:34 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:54.058 03:33:34 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:54.058 03:33:34 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:54.058 03:33:34 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:16:54.058 Found net devices under 0000:0a:00.1: cvl_0_1 00:16:54.058 03:33:34 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:54.058 03:33:34 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:54.058 03:33:34 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:54.058 03:33:34 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:54.058 03:33:34 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:54.058 03:33:34 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:54.058 03:33:34 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:54.058 03:33:34 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:54.058 03:33:34 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:54.058 03:33:34 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:54.058 03:33:34 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:54.058 03:33:34 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:54.058 03:33:34 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:54.058 03:33:34 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:54.058 03:33:34 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:54.058 03:33:34 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:54.058 03:33:34 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:54.058 03:33:34 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:54.058 03:33:34 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:54.058 03:33:34 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:54.058 03:33:34 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:54.058 03:33:34 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:54.058 03:33:34 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:54.058 03:33:34 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:54.058 03:33:34 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:54.058 03:33:34 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:54.058 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:54.058 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.217 ms 00:16:54.058 00:16:54.058 --- 10.0.0.2 ping statistics --- 00:16:54.058 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:54.058 rtt min/avg/max/mdev = 0.217/0.217/0.217/0.000 ms 00:16:54.058 03:33:34 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:54.058 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:54.058 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.111 ms 00:16:54.058 00:16:54.058 --- 10.0.0.1 ping statistics --- 00:16:54.058 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:54.058 rtt min/avg/max/mdev = 0.111/0.111/0.111/0.000 ms 00:16:54.058 03:33:34 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:54.058 03:33:34 -- nvmf/common.sh@410 -- # return 0 00:16:54.058 03:33:34 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:54.058 03:33:34 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:54.058 03:33:34 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:54.058 03:33:34 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:54.058 03:33:34 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:54.058 03:33:34 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:54.058 03:33:34 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:54.058 03:33:34 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:16:54.058 03:33:34 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:54.058 03:33:34 -- common/autotest_common.sh@722 -- # xtrace_disable 00:16:54.058 03:33:34 -- common/autotest_common.sh@10 -- # set +x 00:16:54.058 03:33:34 -- nvmf/common.sh@469 -- # nvmfpid=3062512 00:16:54.058 03:33:34 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x78 00:16:54.058 03:33:34 -- nvmf/common.sh@470 -- # waitforlisten 3062512 00:16:54.058 03:33:34 -- common/autotest_common.sh@829 -- # '[' -z 3062512 ']' 00:16:54.058 03:33:34 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:54.058 03:33:34 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:54.058 03:33:34 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:54.058 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:54.058 03:33:34 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:54.058 03:33:34 -- common/autotest_common.sh@10 -- # set +x 00:16:54.058 [2024-11-21 03:33:34.679480] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:54.058 [2024-11-21 03:33:34.679560] [ DPDK EAL parameters: nvmf -c 0x78 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:54.318 EAL: No free 2048 kB hugepages reported on node 1 00:16:54.318 [2024-11-21 03:33:34.752888] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:54.318 [2024-11-21 03:33:34.875622] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:54.318 [2024-11-21 03:33:34.875778] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:54.318 [2024-11-21 03:33:34.875797] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:54.318 [2024-11-21 03:33:34.875820] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:54.318 [2024-11-21 03:33:34.875901] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:16:54.318 [2024-11-21 03:33:34.875938] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:16:54.318 [2024-11-21 03:33:34.875990] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:16:54.318 [2024-11-21 03:33:34.875993] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:55.256 03:33:35 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:55.256 03:33:35 -- common/autotest_common.sh@862 -- # return 0 00:16:55.256 03:33:35 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:55.256 03:33:35 -- common/autotest_common.sh@728 -- # xtrace_disable 00:16:55.256 03:33:35 -- common/autotest_common.sh@10 -- # set +x 00:16:55.256 03:33:35 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:55.256 03:33:35 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:16:55.256 03:33:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:55.256 03:33:35 -- common/autotest_common.sh@10 -- # set +x 00:16:55.256 [2024-11-21 03:33:35.727734] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:55.256 03:33:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:55.256 03:33:35 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:16:55.256 03:33:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:55.256 03:33:35 -- common/autotest_common.sh@10 -- # set +x 00:16:55.256 Malloc0 00:16:55.256 03:33:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:55.256 03:33:35 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:16:55.256 03:33:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:55.256 03:33:35 -- common/autotest_common.sh@10 -- # set +x 00:16:55.256 03:33:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:55.256 03:33:35 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:16:55.256 03:33:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:55.256 03:33:35 -- common/autotest_common.sh@10 -- # set +x 00:16:55.256 03:33:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:55.256 03:33:35 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:16:55.256 03:33:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:55.256 03:33:35 -- common/autotest_common.sh@10 -- # set +x 00:16:55.256 [2024-11-21 03:33:35.781318] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:55.256 03:33:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:55.256 03:33:35 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 00:16:55.256 03:33:35 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:16:55.256 03:33:35 -- nvmf/common.sh@520 -- # config=() 00:16:55.256 03:33:35 -- nvmf/common.sh@520 -- # local subsystem config 00:16:55.256 03:33:35 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:16:55.256 03:33:35 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:16:55.256 { 00:16:55.256 "params": { 00:16:55.256 "name": "Nvme$subsystem", 00:16:55.256 "trtype": "$TEST_TRANSPORT", 00:16:55.256 "traddr": "$NVMF_FIRST_TARGET_IP", 00:16:55.257 "adrfam": "ipv4", 00:16:55.257 "trsvcid": "$NVMF_PORT", 00:16:55.257 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:16:55.257 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:16:55.257 "hdgst": ${hdgst:-false}, 00:16:55.257 "ddgst": ${ddgst:-false} 00:16:55.257 }, 00:16:55.257 "method": "bdev_nvme_attach_controller" 00:16:55.257 } 00:16:55.257 EOF 00:16:55.257 )") 00:16:55.257 03:33:35 -- nvmf/common.sh@542 -- # cat 00:16:55.257 03:33:35 -- nvmf/common.sh@544 -- # jq . 00:16:55.257 03:33:35 -- nvmf/common.sh@545 -- # IFS=, 00:16:55.257 03:33:35 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:16:55.257 "params": { 00:16:55.257 "name": "Nvme1", 00:16:55.257 "trtype": "tcp", 00:16:55.257 "traddr": "10.0.0.2", 00:16:55.257 "adrfam": "ipv4", 00:16:55.257 "trsvcid": "4420", 00:16:55.257 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:16:55.257 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:16:55.257 "hdgst": false, 00:16:55.257 "ddgst": false 00:16:55.257 }, 00:16:55.257 "method": "bdev_nvme_attach_controller" 00:16:55.257 }' 00:16:55.257 [2024-11-21 03:33:35.824928] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:55.257 [2024-11-21 03:33:35.824993] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3062672 ] 00:16:55.257 EAL: No free 2048 kB hugepages reported on node 1 00:16:55.257 [2024-11-21 03:33:35.884978] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:16:55.515 [2024-11-21 03:33:35.997089] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:55.515 [2024-11-21 03:33:35.997142] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:55.515 [2024-11-21 03:33:35.997146] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:55.773 [2024-11-21 03:33:36.293688] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:16:55.773 [2024-11-21 03:33:36.293742] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:16:55.773 I/O targets: 00:16:55.773 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:16:55.773 00:16:55.773 00:16:55.773 CUnit - A unit testing framework for C - Version 2.1-3 00:16:55.773 http://cunit.sourceforge.net/ 00:16:55.773 00:16:55.773 00:16:55.773 Suite: bdevio tests on: Nvme1n1 00:16:55.773 Test: blockdev write read block ...passed 00:16:55.773 Test: blockdev write zeroes read block ...passed 00:16:55.773 Test: blockdev write zeroes read no split ...passed 00:16:55.773 Test: blockdev write zeroes read split ...passed 00:16:55.773 Test: blockdev write zeroes read split partial ...passed 00:16:55.773 Test: blockdev reset ...[2024-11-21 03:33:36.412196] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:16:55.773 [2024-11-21 03:33:36.412297] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x19b4f20 (9): Bad file descriptor 00:16:56.033 [2024-11-21 03:33:36.423218] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:16:56.033 passed 00:16:56.033 Test: blockdev write read 8 blocks ...passed 00:16:56.033 Test: blockdev write read size > 128k ...passed 00:16:56.033 Test: blockdev write read invalid size ...passed 00:16:56.033 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:16:56.033 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:16:56.033 Test: blockdev write read max offset ...passed 00:16:56.033 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:16:56.033 Test: blockdev writev readv 8 blocks ...passed 00:16:56.033 Test: blockdev writev readv 30 x 1block ...passed 00:16:56.033 Test: blockdev writev readv block ...passed 00:16:56.033 Test: blockdev writev readv size > 128k ...passed 00:16:56.033 Test: blockdev writev readv size > 128k in two iovs ...passed 00:16:56.033 Test: blockdev comparev and writev ...[2024-11-21 03:33:36.594459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:56.033 [2024-11-21 03:33:36.594496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:16:56.033 [2024-11-21 03:33:36.594531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:56.033 [2024-11-21 03:33:36.594549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:16:56.033 [2024-11-21 03:33:36.594896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:56.033 [2024-11-21 03:33:36.594922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:16:56.033 [2024-11-21 03:33:36.594944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:56.033 [2024-11-21 03:33:36.594961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:16:56.033 [2024-11-21 03:33:36.595315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:56.033 [2024-11-21 03:33:36.595340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:16:56.033 [2024-11-21 03:33:36.595363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:56.033 [2024-11-21 03:33:36.595379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:16:56.033 [2024-11-21 03:33:36.595717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:56.033 [2024-11-21 03:33:36.595741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:16:56.033 [2024-11-21 03:33:36.595762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:56.033 [2024-11-21 03:33:36.595779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:16:56.033 passed 00:16:56.033 Test: blockdev nvme passthru rw ...passed 00:16:56.294 Test: blockdev nvme passthru vendor specific ...[2024-11-21 03:33:36.679363] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:16:56.294 [2024-11-21 03:33:36.679393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:16:56.294 [2024-11-21 03:33:36.679553] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:16:56.294 [2024-11-21 03:33:36.679577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:16:56.294 [2024-11-21 03:33:36.679734] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:16:56.294 [2024-11-21 03:33:36.679757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:16:56.294 [2024-11-21 03:33:36.679920] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:16:56.294 [2024-11-21 03:33:36.679943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:16:56.294 passed 00:16:56.294 Test: blockdev nvme admin passthru ...passed 00:16:56.294 Test: blockdev copy ...passed 00:16:56.294 00:16:56.294 Run Summary: Type Total Ran Passed Failed Inactive 00:16:56.294 suites 1 1 n/a 0 0 00:16:56.294 tests 23 23 23 0 0 00:16:56.294 asserts 152 152 152 0 n/a 00:16:56.294 00:16:56.294 Elapsed time = 0.878 seconds 00:16:56.554 03:33:36 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:16:56.554 03:33:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:56.554 03:33:36 -- common/autotest_common.sh@10 -- # set +x 00:16:56.554 03:33:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:56.554 03:33:36 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:16:56.554 03:33:36 -- target/bdevio.sh@30 -- # nvmftestfini 00:16:56.554 03:33:36 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:56.554 03:33:36 -- nvmf/common.sh@116 -- # sync 00:16:56.554 03:33:36 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:56.554 03:33:36 -- nvmf/common.sh@119 -- # set +e 00:16:56.554 03:33:36 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:56.554 03:33:36 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:56.554 rmmod nvme_tcp 00:16:56.554 rmmod nvme_fabrics 00:16:56.554 rmmod nvme_keyring 00:16:56.554 03:33:37 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:56.554 03:33:37 -- nvmf/common.sh@123 -- # set -e 00:16:56.554 03:33:37 -- nvmf/common.sh@124 -- # return 0 00:16:56.554 03:33:37 -- nvmf/common.sh@477 -- # '[' -n 3062512 ']' 00:16:56.554 03:33:37 -- nvmf/common.sh@478 -- # killprocess 3062512 00:16:56.554 03:33:37 -- common/autotest_common.sh@936 -- # '[' -z 3062512 ']' 00:16:56.554 03:33:37 -- common/autotest_common.sh@940 -- # kill -0 3062512 00:16:56.554 03:33:37 -- common/autotest_common.sh@941 -- # uname 00:16:56.554 03:33:37 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:56.554 03:33:37 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3062512 00:16:56.554 03:33:37 -- common/autotest_common.sh@942 -- # process_name=reactor_3 00:16:56.554 03:33:37 -- common/autotest_common.sh@946 -- # '[' reactor_3 = sudo ']' 00:16:56.554 03:33:37 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3062512' 00:16:56.554 killing process with pid 3062512 00:16:56.554 03:33:37 -- common/autotest_common.sh@955 -- # kill 3062512 00:16:56.554 03:33:37 -- common/autotest_common.sh@960 -- # wait 3062512 00:16:56.813 03:33:37 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:56.813 03:33:37 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:56.813 03:33:37 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:56.813 03:33:37 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:56.813 03:33:37 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:56.813 03:33:37 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:56.813 03:33:37 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:56.813 03:33:37 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:59.358 03:33:39 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:59.358 00:16:59.358 real 0m7.222s 00:16:59.358 user 0m13.149s 00:16:59.358 sys 0m2.178s 00:16:59.358 03:33:39 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:59.358 03:33:39 -- common/autotest_common.sh@10 -- # set +x 00:16:59.358 ************************************ 00:16:59.358 END TEST nvmf_bdevio 00:16:59.358 ************************************ 00:16:59.358 03:33:39 -- nvmf/nvmf.sh@57 -- # '[' tcp = tcp ']' 00:16:59.358 03:33:39 -- nvmf/nvmf.sh@58 -- # run_test nvmf_bdevio_no_huge /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:16:59.358 03:33:39 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:16:59.358 03:33:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:59.358 03:33:39 -- common/autotest_common.sh@10 -- # set +x 00:16:59.358 ************************************ 00:16:59.358 START TEST nvmf_bdevio_no_huge 00:16:59.358 ************************************ 00:16:59.358 03:33:39 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:16:59.358 * Looking for test storage... 00:16:59.358 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:59.358 03:33:39 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:59.359 03:33:39 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:59.359 03:33:39 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:59.359 03:33:39 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:59.359 03:33:39 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:59.359 03:33:39 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:59.359 03:33:39 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:59.359 03:33:39 -- scripts/common.sh@335 -- # IFS=.-: 00:16:59.359 03:33:39 -- scripts/common.sh@335 -- # read -ra ver1 00:16:59.359 03:33:39 -- scripts/common.sh@336 -- # IFS=.-: 00:16:59.359 03:33:39 -- scripts/common.sh@336 -- # read -ra ver2 00:16:59.359 03:33:39 -- scripts/common.sh@337 -- # local 'op=<' 00:16:59.359 03:33:39 -- scripts/common.sh@339 -- # ver1_l=2 00:16:59.359 03:33:39 -- scripts/common.sh@340 -- # ver2_l=1 00:16:59.359 03:33:39 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:59.359 03:33:39 -- scripts/common.sh@343 -- # case "$op" in 00:16:59.359 03:33:39 -- scripts/common.sh@344 -- # : 1 00:16:59.359 03:33:39 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:59.359 03:33:39 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:59.359 03:33:39 -- scripts/common.sh@364 -- # decimal 1 00:16:59.359 03:33:39 -- scripts/common.sh@352 -- # local d=1 00:16:59.359 03:33:39 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:59.359 03:33:39 -- scripts/common.sh@354 -- # echo 1 00:16:59.359 03:33:39 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:59.359 03:33:39 -- scripts/common.sh@365 -- # decimal 2 00:16:59.359 03:33:39 -- scripts/common.sh@352 -- # local d=2 00:16:59.359 03:33:39 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:59.359 03:33:39 -- scripts/common.sh@354 -- # echo 2 00:16:59.359 03:33:39 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:59.359 03:33:39 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:59.359 03:33:39 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:59.359 03:33:39 -- scripts/common.sh@367 -- # return 0 00:16:59.359 03:33:39 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:59.359 03:33:39 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:59.359 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:59.359 --rc genhtml_branch_coverage=1 00:16:59.359 --rc genhtml_function_coverage=1 00:16:59.359 --rc genhtml_legend=1 00:16:59.359 --rc geninfo_all_blocks=1 00:16:59.359 --rc geninfo_unexecuted_blocks=1 00:16:59.359 00:16:59.359 ' 00:16:59.359 03:33:39 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:59.359 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:59.359 --rc genhtml_branch_coverage=1 00:16:59.359 --rc genhtml_function_coverage=1 00:16:59.359 --rc genhtml_legend=1 00:16:59.359 --rc geninfo_all_blocks=1 00:16:59.359 --rc geninfo_unexecuted_blocks=1 00:16:59.359 00:16:59.359 ' 00:16:59.359 03:33:39 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:59.359 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:59.359 --rc genhtml_branch_coverage=1 00:16:59.359 --rc genhtml_function_coverage=1 00:16:59.359 --rc genhtml_legend=1 00:16:59.359 --rc geninfo_all_blocks=1 00:16:59.359 --rc geninfo_unexecuted_blocks=1 00:16:59.359 00:16:59.359 ' 00:16:59.359 03:33:39 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:59.359 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:59.359 --rc genhtml_branch_coverage=1 00:16:59.359 --rc genhtml_function_coverage=1 00:16:59.359 --rc genhtml_legend=1 00:16:59.359 --rc geninfo_all_blocks=1 00:16:59.359 --rc geninfo_unexecuted_blocks=1 00:16:59.359 00:16:59.359 ' 00:16:59.359 03:33:39 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:59.359 03:33:39 -- nvmf/common.sh@7 -- # uname -s 00:16:59.359 03:33:39 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:59.359 03:33:39 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:59.359 03:33:39 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:59.359 03:33:39 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:59.359 03:33:39 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:59.359 03:33:39 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:59.359 03:33:39 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:59.359 03:33:39 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:59.359 03:33:39 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:59.359 03:33:39 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:59.359 03:33:39 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:59.359 03:33:39 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:59.359 03:33:39 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:59.359 03:33:39 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:59.359 03:33:39 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:59.359 03:33:39 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:59.359 03:33:39 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:59.359 03:33:39 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:59.359 03:33:39 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:59.359 03:33:39 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:59.359 03:33:39 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:59.359 03:33:39 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:59.359 03:33:39 -- paths/export.sh@5 -- # export PATH 00:16:59.359 03:33:39 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:59.359 03:33:39 -- nvmf/common.sh@46 -- # : 0 00:16:59.359 03:33:39 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:59.359 03:33:39 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:59.359 03:33:39 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:59.359 03:33:39 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:59.359 03:33:39 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:59.359 03:33:39 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:59.359 03:33:39 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:59.359 03:33:39 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:59.359 03:33:39 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:59.359 03:33:39 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:59.359 03:33:39 -- target/bdevio.sh@14 -- # nvmftestinit 00:16:59.359 03:33:39 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:59.359 03:33:39 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:59.359 03:33:39 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:59.359 03:33:39 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:59.359 03:33:39 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:59.359 03:33:39 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:59.359 03:33:39 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:59.359 03:33:39 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:59.359 03:33:39 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:59.359 03:33:39 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:59.359 03:33:39 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:59.359 03:33:39 -- common/autotest_common.sh@10 -- # set +x 00:17:01.265 03:33:41 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:01.265 03:33:41 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:01.265 03:33:41 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:01.265 03:33:41 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:01.265 03:33:41 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:01.265 03:33:41 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:01.265 03:33:41 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:01.265 03:33:41 -- nvmf/common.sh@294 -- # net_devs=() 00:17:01.265 03:33:41 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:01.265 03:33:41 -- nvmf/common.sh@295 -- # e810=() 00:17:01.265 03:33:41 -- nvmf/common.sh@295 -- # local -ga e810 00:17:01.265 03:33:41 -- nvmf/common.sh@296 -- # x722=() 00:17:01.265 03:33:41 -- nvmf/common.sh@296 -- # local -ga x722 00:17:01.265 03:33:41 -- nvmf/common.sh@297 -- # mlx=() 00:17:01.265 03:33:41 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:01.265 03:33:41 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:01.265 03:33:41 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:01.265 03:33:41 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:01.265 03:33:41 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:01.265 03:33:41 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:01.265 03:33:41 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:01.265 03:33:41 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:01.265 03:33:41 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:01.265 03:33:41 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:01.265 03:33:41 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:01.265 03:33:41 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:01.265 03:33:41 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:01.265 03:33:41 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:01.265 03:33:41 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:01.265 03:33:41 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:01.265 03:33:41 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:01.265 03:33:41 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:01.265 03:33:41 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:01.265 03:33:41 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:17:01.265 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:17:01.265 03:33:41 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:01.265 03:33:41 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:01.265 03:33:41 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:01.265 03:33:41 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:01.265 03:33:41 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:01.265 03:33:41 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:01.265 03:33:41 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:17:01.265 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:17:01.265 03:33:41 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:01.265 03:33:41 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:01.265 03:33:41 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:01.265 03:33:41 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:01.265 03:33:41 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:01.265 03:33:41 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:01.265 03:33:41 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:01.265 03:33:41 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:01.265 03:33:41 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:01.265 03:33:41 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:01.265 03:33:41 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:01.265 03:33:41 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:01.265 03:33:41 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:17:01.265 Found net devices under 0000:0a:00.0: cvl_0_0 00:17:01.265 03:33:41 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:01.265 03:33:41 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:01.265 03:33:41 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:01.265 03:33:41 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:01.265 03:33:41 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:01.265 03:33:41 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:17:01.265 Found net devices under 0000:0a:00.1: cvl_0_1 00:17:01.265 03:33:41 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:01.265 03:33:41 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:01.265 03:33:41 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:01.265 03:33:41 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:01.265 03:33:41 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:01.265 03:33:41 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:01.265 03:33:41 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:01.265 03:33:41 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:01.265 03:33:41 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:01.265 03:33:41 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:01.265 03:33:41 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:01.265 03:33:41 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:01.265 03:33:41 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:01.265 03:33:41 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:01.265 03:33:41 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:01.265 03:33:41 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:01.265 03:33:41 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:01.265 03:33:41 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:01.266 03:33:41 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:01.266 03:33:41 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:01.266 03:33:41 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:01.266 03:33:41 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:01.266 03:33:41 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:01.266 03:33:41 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:01.266 03:33:41 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:01.266 03:33:41 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:01.266 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:01.266 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.243 ms 00:17:01.266 00:17:01.266 --- 10.0.0.2 ping statistics --- 00:17:01.266 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:01.266 rtt min/avg/max/mdev = 0.243/0.243/0.243/0.000 ms 00:17:01.266 03:33:41 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:01.266 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:01.266 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.054 ms 00:17:01.266 00:17:01.266 --- 10.0.0.1 ping statistics --- 00:17:01.266 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:01.266 rtt min/avg/max/mdev = 0.054/0.054/0.054/0.000 ms 00:17:01.266 03:33:41 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:01.266 03:33:41 -- nvmf/common.sh@410 -- # return 0 00:17:01.266 03:33:41 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:01.266 03:33:41 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:01.266 03:33:41 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:01.266 03:33:41 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:01.266 03:33:41 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:01.266 03:33:41 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:01.266 03:33:41 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:01.266 03:33:41 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:17:01.266 03:33:41 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:01.266 03:33:41 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:01.266 03:33:41 -- common/autotest_common.sh@10 -- # set +x 00:17:01.266 03:33:41 -- nvmf/common.sh@469 -- # nvmfpid=3064883 00:17:01.266 03:33:41 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --no-huge -s 1024 -m 0x78 00:17:01.266 03:33:41 -- nvmf/common.sh@470 -- # waitforlisten 3064883 00:17:01.266 03:33:41 -- common/autotest_common.sh@829 -- # '[' -z 3064883 ']' 00:17:01.266 03:33:41 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:01.266 03:33:41 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:01.266 03:33:41 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:01.266 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:01.266 03:33:41 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:01.266 03:33:41 -- common/autotest_common.sh@10 -- # set +x 00:17:01.266 [2024-11-21 03:33:41.798770] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:01.266 [2024-11-21 03:33:41.798855] [ DPDK EAL parameters: nvmf -c 0x78 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk0 --proc-type=auto ] 00:17:01.266 [2024-11-21 03:33:41.873164] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:17:01.525 [2024-11-21 03:33:41.992368] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:01.525 [2024-11-21 03:33:41.992529] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:01.525 [2024-11-21 03:33:41.992548] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:01.525 [2024-11-21 03:33:41.992568] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:01.525 [2024-11-21 03:33:41.992672] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:17:01.525 [2024-11-21 03:33:41.992727] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:17:01.525 [2024-11-21 03:33:41.992779] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:17:01.525 [2024-11-21 03:33:41.992782] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:17:02.460 03:33:42 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:02.460 03:33:42 -- common/autotest_common.sh@862 -- # return 0 00:17:02.460 03:33:42 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:02.460 03:33:42 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:02.460 03:33:42 -- common/autotest_common.sh@10 -- # set +x 00:17:02.460 03:33:42 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:02.460 03:33:42 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:17:02.460 03:33:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:02.460 03:33:42 -- common/autotest_common.sh@10 -- # set +x 00:17:02.460 [2024-11-21 03:33:42.780261] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:02.460 03:33:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:02.460 03:33:42 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:17:02.460 03:33:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:02.460 03:33:42 -- common/autotest_common.sh@10 -- # set +x 00:17:02.460 Malloc0 00:17:02.460 03:33:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:02.460 03:33:42 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:17:02.460 03:33:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:02.460 03:33:42 -- common/autotest_common.sh@10 -- # set +x 00:17:02.460 03:33:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:02.460 03:33:42 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:17:02.460 03:33:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:02.460 03:33:42 -- common/autotest_common.sh@10 -- # set +x 00:17:02.460 03:33:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:02.460 03:33:42 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:17:02.460 03:33:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:02.460 03:33:42 -- common/autotest_common.sh@10 -- # set +x 00:17:02.460 [2024-11-21 03:33:42.818695] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:02.460 03:33:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:02.460 03:33:42 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 --no-huge -s 1024 00:17:02.460 03:33:42 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:17:02.460 03:33:42 -- nvmf/common.sh@520 -- # config=() 00:17:02.460 03:33:42 -- nvmf/common.sh@520 -- # local subsystem config 00:17:02.460 03:33:42 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:17:02.460 03:33:42 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:17:02.460 { 00:17:02.460 "params": { 00:17:02.460 "name": "Nvme$subsystem", 00:17:02.460 "trtype": "$TEST_TRANSPORT", 00:17:02.460 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:02.460 "adrfam": "ipv4", 00:17:02.460 "trsvcid": "$NVMF_PORT", 00:17:02.460 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:02.460 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:02.460 "hdgst": ${hdgst:-false}, 00:17:02.460 "ddgst": ${ddgst:-false} 00:17:02.460 }, 00:17:02.460 "method": "bdev_nvme_attach_controller" 00:17:02.460 } 00:17:02.460 EOF 00:17:02.460 )") 00:17:02.460 03:33:42 -- nvmf/common.sh@542 -- # cat 00:17:02.461 03:33:42 -- nvmf/common.sh@544 -- # jq . 00:17:02.461 03:33:42 -- nvmf/common.sh@545 -- # IFS=, 00:17:02.461 03:33:42 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:17:02.461 "params": { 00:17:02.461 "name": "Nvme1", 00:17:02.461 "trtype": "tcp", 00:17:02.461 "traddr": "10.0.0.2", 00:17:02.461 "adrfam": "ipv4", 00:17:02.461 "trsvcid": "4420", 00:17:02.461 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:02.461 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:02.461 "hdgst": false, 00:17:02.461 "ddgst": false 00:17:02.461 }, 00:17:02.461 "method": "bdev_nvme_attach_controller" 00:17:02.461 }' 00:17:02.461 [2024-11-21 03:33:42.861591] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:02.461 [2024-11-21 03:33:42.861666] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk_pid3064986 ] 00:17:02.461 [2024-11-21 03:33:42.927955] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:17:02.461 [2024-11-21 03:33:43.043046] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:02.461 [2024-11-21 03:33:43.043097] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:02.461 [2024-11-21 03:33:43.043102] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:02.720 [2024-11-21 03:33:43.325311] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:17:02.720 [2024-11-21 03:33:43.325372] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:17:02.720 I/O targets: 00:17:02.720 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:17:02.720 00:17:02.720 00:17:02.720 CUnit - A unit testing framework for C - Version 2.1-3 00:17:02.720 http://cunit.sourceforge.net/ 00:17:02.720 00:17:02.720 00:17:02.720 Suite: bdevio tests on: Nvme1n1 00:17:02.982 Test: blockdev write read block ...passed 00:17:02.982 Test: blockdev write zeroes read block ...passed 00:17:02.982 Test: blockdev write zeroes read no split ...passed 00:17:02.982 Test: blockdev write zeroes read split ...passed 00:17:02.982 Test: blockdev write zeroes read split partial ...passed 00:17:02.982 Test: blockdev reset ...[2024-11-21 03:33:43.492496] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:17:02.982 [2024-11-21 03:33:43.492601] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x9427d0 (9): Bad file descriptor 00:17:02.982 [2024-11-21 03:33:43.552945] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:17:02.982 passed 00:17:02.982 Test: blockdev write read 8 blocks ...passed 00:17:02.982 Test: blockdev write read size > 128k ...passed 00:17:02.982 Test: blockdev write read invalid size ...passed 00:17:02.982 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:17:02.982 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:17:02.982 Test: blockdev write read max offset ...passed 00:17:03.241 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:17:03.241 Test: blockdev writev readv 8 blocks ...passed 00:17:03.241 Test: blockdev writev readv 30 x 1block ...passed 00:17:03.241 Test: blockdev writev readv block ...passed 00:17:03.241 Test: blockdev writev readv size > 128k ...passed 00:17:03.241 Test: blockdev writev readv size > 128k in two iovs ...passed 00:17:03.241 Test: blockdev comparev and writev ...[2024-11-21 03:33:43.726390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:03.241 [2024-11-21 03:33:43.726425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:17:03.241 [2024-11-21 03:33:43.726449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:03.241 [2024-11-21 03:33:43.726466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:17:03.241 [2024-11-21 03:33:43.726780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:03.241 [2024-11-21 03:33:43.726805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:17:03.241 [2024-11-21 03:33:43.726827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:03.241 [2024-11-21 03:33:43.726843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:17:03.241 [2024-11-21 03:33:43.727154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:03.241 [2024-11-21 03:33:43.727179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:17:03.241 [2024-11-21 03:33:43.727201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:03.241 [2024-11-21 03:33:43.727223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:17:03.241 [2024-11-21 03:33:43.727539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:03.241 [2024-11-21 03:33:43.727563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:17:03.241 [2024-11-21 03:33:43.727584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:03.241 [2024-11-21 03:33:43.727600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:17:03.241 passed 00:17:03.241 Test: blockdev nvme passthru rw ...passed 00:17:03.241 Test: blockdev nvme passthru vendor specific ...[2024-11-21 03:33:43.809358] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:03.241 [2024-11-21 03:33:43.809385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:17:03.241 [2024-11-21 03:33:43.809544] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:03.241 [2024-11-21 03:33:43.809567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:17:03.241 [2024-11-21 03:33:43.809723] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:03.241 [2024-11-21 03:33:43.809746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:17:03.241 [2024-11-21 03:33:43.809902] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:03.241 [2024-11-21 03:33:43.809925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:17:03.241 passed 00:17:03.241 Test: blockdev nvme admin passthru ...passed 00:17:03.241 Test: blockdev copy ...passed 00:17:03.241 00:17:03.241 Run Summary: Type Total Ran Passed Failed Inactive 00:17:03.241 suites 1 1 n/a 0 0 00:17:03.241 tests 23 23 23 0 0 00:17:03.241 asserts 152 152 152 0 n/a 00:17:03.241 00:17:03.241 Elapsed time = 1.077 seconds 00:17:03.811 03:33:44 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:17:03.811 03:33:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:03.811 03:33:44 -- common/autotest_common.sh@10 -- # set +x 00:17:03.811 03:33:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:03.811 03:33:44 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:17:03.811 03:33:44 -- target/bdevio.sh@30 -- # nvmftestfini 00:17:03.811 03:33:44 -- nvmf/common.sh@476 -- # nvmfcleanup 00:17:03.811 03:33:44 -- nvmf/common.sh@116 -- # sync 00:17:03.811 03:33:44 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:17:03.811 03:33:44 -- nvmf/common.sh@119 -- # set +e 00:17:03.811 03:33:44 -- nvmf/common.sh@120 -- # for i in {1..20} 00:17:03.811 03:33:44 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:17:03.811 rmmod nvme_tcp 00:17:03.811 rmmod nvme_fabrics 00:17:03.811 rmmod nvme_keyring 00:17:03.811 03:33:44 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:17:03.811 03:33:44 -- nvmf/common.sh@123 -- # set -e 00:17:03.811 03:33:44 -- nvmf/common.sh@124 -- # return 0 00:17:03.811 03:33:44 -- nvmf/common.sh@477 -- # '[' -n 3064883 ']' 00:17:03.811 03:33:44 -- nvmf/common.sh@478 -- # killprocess 3064883 00:17:03.811 03:33:44 -- common/autotest_common.sh@936 -- # '[' -z 3064883 ']' 00:17:03.811 03:33:44 -- common/autotest_common.sh@940 -- # kill -0 3064883 00:17:03.811 03:33:44 -- common/autotest_common.sh@941 -- # uname 00:17:03.811 03:33:44 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:03.811 03:33:44 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3064883 00:17:03.811 03:33:44 -- common/autotest_common.sh@942 -- # process_name=reactor_3 00:17:03.811 03:33:44 -- common/autotest_common.sh@946 -- # '[' reactor_3 = sudo ']' 00:17:03.812 03:33:44 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3064883' 00:17:03.812 killing process with pid 3064883 00:17:03.812 03:33:44 -- common/autotest_common.sh@955 -- # kill 3064883 00:17:03.812 03:33:44 -- common/autotest_common.sh@960 -- # wait 3064883 00:17:04.380 03:33:44 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:17:04.380 03:33:44 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:17:04.380 03:33:44 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:17:04.380 03:33:44 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:04.380 03:33:44 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:17:04.380 03:33:44 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:04.380 03:33:44 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:04.380 03:33:44 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:06.303 03:33:46 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:17:06.303 00:17:06.303 real 0m7.373s 00:17:06.303 user 0m13.962s 00:17:06.303 sys 0m2.546s 00:17:06.303 03:33:46 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:06.303 03:33:46 -- common/autotest_common.sh@10 -- # set +x 00:17:06.303 ************************************ 00:17:06.303 END TEST nvmf_bdevio_no_huge 00:17:06.303 ************************************ 00:17:06.303 03:33:46 -- nvmf/nvmf.sh@59 -- # run_test nvmf_tls /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:17:06.303 03:33:46 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:06.303 03:33:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:06.303 03:33:46 -- common/autotest_common.sh@10 -- # set +x 00:17:06.303 ************************************ 00:17:06.303 START TEST nvmf_tls 00:17:06.303 ************************************ 00:17:06.303 03:33:46 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:17:06.303 * Looking for test storage... 00:17:06.303 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:06.303 03:33:46 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:17:06.303 03:33:46 -- common/autotest_common.sh@1690 -- # lcov --version 00:17:06.303 03:33:46 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:17:06.562 03:33:46 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:17:06.562 03:33:46 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:17:06.562 03:33:46 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:17:06.562 03:33:46 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:17:06.562 03:33:46 -- scripts/common.sh@335 -- # IFS=.-: 00:17:06.562 03:33:46 -- scripts/common.sh@335 -- # read -ra ver1 00:17:06.562 03:33:46 -- scripts/common.sh@336 -- # IFS=.-: 00:17:06.562 03:33:46 -- scripts/common.sh@336 -- # read -ra ver2 00:17:06.562 03:33:46 -- scripts/common.sh@337 -- # local 'op=<' 00:17:06.562 03:33:46 -- scripts/common.sh@339 -- # ver1_l=2 00:17:06.562 03:33:46 -- scripts/common.sh@340 -- # ver2_l=1 00:17:06.562 03:33:46 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:17:06.562 03:33:46 -- scripts/common.sh@343 -- # case "$op" in 00:17:06.562 03:33:46 -- scripts/common.sh@344 -- # : 1 00:17:06.562 03:33:46 -- scripts/common.sh@363 -- # (( v = 0 )) 00:17:06.562 03:33:46 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:06.562 03:33:46 -- scripts/common.sh@364 -- # decimal 1 00:17:06.562 03:33:46 -- scripts/common.sh@352 -- # local d=1 00:17:06.562 03:33:46 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:06.562 03:33:46 -- scripts/common.sh@354 -- # echo 1 00:17:06.562 03:33:46 -- scripts/common.sh@364 -- # ver1[v]=1 00:17:06.562 03:33:46 -- scripts/common.sh@365 -- # decimal 2 00:17:06.562 03:33:46 -- scripts/common.sh@352 -- # local d=2 00:17:06.562 03:33:46 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:06.562 03:33:46 -- scripts/common.sh@354 -- # echo 2 00:17:06.562 03:33:46 -- scripts/common.sh@365 -- # ver2[v]=2 00:17:06.562 03:33:46 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:17:06.562 03:33:46 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:17:06.562 03:33:46 -- scripts/common.sh@367 -- # return 0 00:17:06.562 03:33:46 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:06.562 03:33:46 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:17:06.562 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:06.562 --rc genhtml_branch_coverage=1 00:17:06.562 --rc genhtml_function_coverage=1 00:17:06.562 --rc genhtml_legend=1 00:17:06.562 --rc geninfo_all_blocks=1 00:17:06.562 --rc geninfo_unexecuted_blocks=1 00:17:06.562 00:17:06.562 ' 00:17:06.562 03:33:46 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:17:06.562 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:06.562 --rc genhtml_branch_coverage=1 00:17:06.562 --rc genhtml_function_coverage=1 00:17:06.562 --rc genhtml_legend=1 00:17:06.562 --rc geninfo_all_blocks=1 00:17:06.562 --rc geninfo_unexecuted_blocks=1 00:17:06.562 00:17:06.562 ' 00:17:06.562 03:33:46 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:17:06.562 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:06.562 --rc genhtml_branch_coverage=1 00:17:06.562 --rc genhtml_function_coverage=1 00:17:06.562 --rc genhtml_legend=1 00:17:06.562 --rc geninfo_all_blocks=1 00:17:06.562 --rc geninfo_unexecuted_blocks=1 00:17:06.562 00:17:06.562 ' 00:17:06.562 03:33:46 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:17:06.562 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:06.562 --rc genhtml_branch_coverage=1 00:17:06.562 --rc genhtml_function_coverage=1 00:17:06.562 --rc genhtml_legend=1 00:17:06.562 --rc geninfo_all_blocks=1 00:17:06.562 --rc geninfo_unexecuted_blocks=1 00:17:06.562 00:17:06.562 ' 00:17:06.562 03:33:46 -- target/tls.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:06.562 03:33:46 -- nvmf/common.sh@7 -- # uname -s 00:17:06.562 03:33:46 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:06.562 03:33:46 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:06.562 03:33:46 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:06.562 03:33:46 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:06.562 03:33:46 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:06.562 03:33:46 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:06.562 03:33:46 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:06.562 03:33:46 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:06.562 03:33:46 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:06.562 03:33:46 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:06.562 03:33:46 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:17:06.562 03:33:46 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:17:06.562 03:33:46 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:06.562 03:33:46 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:06.562 03:33:46 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:06.562 03:33:46 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:06.562 03:33:46 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:06.562 03:33:46 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:06.562 03:33:46 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:06.562 03:33:46 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:06.562 03:33:46 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:06.562 03:33:46 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:06.562 03:33:46 -- paths/export.sh@5 -- # export PATH 00:17:06.562 03:33:46 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:06.562 03:33:46 -- nvmf/common.sh@46 -- # : 0 00:17:06.562 03:33:46 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:06.562 03:33:46 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:06.562 03:33:46 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:06.562 03:33:46 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:06.562 03:33:46 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:06.562 03:33:46 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:06.562 03:33:46 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:06.562 03:33:46 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:06.562 03:33:46 -- target/tls.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:06.562 03:33:46 -- target/tls.sh@71 -- # nvmftestinit 00:17:06.562 03:33:46 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:06.562 03:33:46 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:06.562 03:33:46 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:06.562 03:33:46 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:06.562 03:33:46 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:06.562 03:33:46 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:06.562 03:33:46 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:06.562 03:33:46 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:06.562 03:33:46 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:06.562 03:33:46 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:06.562 03:33:46 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:06.562 03:33:46 -- common/autotest_common.sh@10 -- # set +x 00:17:08.469 03:33:48 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:08.469 03:33:48 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:08.469 03:33:48 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:08.469 03:33:48 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:08.469 03:33:48 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:08.469 03:33:48 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:08.469 03:33:48 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:08.469 03:33:48 -- nvmf/common.sh@294 -- # net_devs=() 00:17:08.469 03:33:48 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:08.469 03:33:48 -- nvmf/common.sh@295 -- # e810=() 00:17:08.469 03:33:48 -- nvmf/common.sh@295 -- # local -ga e810 00:17:08.469 03:33:48 -- nvmf/common.sh@296 -- # x722=() 00:17:08.469 03:33:48 -- nvmf/common.sh@296 -- # local -ga x722 00:17:08.469 03:33:48 -- nvmf/common.sh@297 -- # mlx=() 00:17:08.469 03:33:48 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:08.469 03:33:48 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:08.469 03:33:48 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:08.469 03:33:48 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:08.469 03:33:48 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:08.469 03:33:48 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:08.469 03:33:48 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:08.469 03:33:48 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:08.469 03:33:48 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:08.469 03:33:48 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:08.469 03:33:48 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:08.469 03:33:48 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:08.469 03:33:48 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:08.469 03:33:48 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:08.469 03:33:48 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:08.469 03:33:48 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:08.469 03:33:48 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:08.469 03:33:48 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:08.469 03:33:48 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:08.469 03:33:48 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:17:08.469 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:17:08.469 03:33:48 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:08.469 03:33:48 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:08.469 03:33:48 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:08.469 03:33:48 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:08.469 03:33:48 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:08.469 03:33:48 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:08.469 03:33:48 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:17:08.469 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:17:08.469 03:33:48 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:08.469 03:33:48 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:08.469 03:33:48 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:08.469 03:33:48 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:08.469 03:33:48 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:08.469 03:33:48 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:08.469 03:33:48 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:08.469 03:33:48 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:08.469 03:33:48 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:08.469 03:33:48 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:08.469 03:33:48 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:08.469 03:33:48 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:08.469 03:33:48 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:17:08.469 Found net devices under 0000:0a:00.0: cvl_0_0 00:17:08.469 03:33:48 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:08.469 03:33:48 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:08.469 03:33:48 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:08.469 03:33:48 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:08.469 03:33:48 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:08.469 03:33:48 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:17:08.469 Found net devices under 0000:0a:00.1: cvl_0_1 00:17:08.469 03:33:48 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:08.469 03:33:48 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:08.469 03:33:48 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:08.469 03:33:48 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:08.469 03:33:48 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:08.469 03:33:48 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:08.469 03:33:48 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:08.469 03:33:48 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:08.469 03:33:48 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:08.469 03:33:48 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:08.469 03:33:48 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:08.469 03:33:48 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:08.469 03:33:48 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:08.469 03:33:48 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:08.469 03:33:48 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:08.469 03:33:48 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:08.469 03:33:48 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:08.469 03:33:48 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:08.469 03:33:48 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:08.469 03:33:48 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:08.469 03:33:48 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:08.469 03:33:48 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:08.469 03:33:48 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:08.469 03:33:48 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:08.469 03:33:49 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:08.469 03:33:49 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:08.469 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:08.469 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.188 ms 00:17:08.469 00:17:08.469 --- 10.0.0.2 ping statistics --- 00:17:08.469 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:08.469 rtt min/avg/max/mdev = 0.188/0.188/0.188/0.000 ms 00:17:08.469 03:33:49 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:08.469 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:08.469 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.128 ms 00:17:08.469 00:17:08.469 --- 10.0.0.1 ping statistics --- 00:17:08.469 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:08.469 rtt min/avg/max/mdev = 0.128/0.128/0.128/0.000 ms 00:17:08.469 03:33:49 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:08.469 03:33:49 -- nvmf/common.sh@410 -- # return 0 00:17:08.469 03:33:49 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:08.469 03:33:49 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:08.469 03:33:49 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:08.469 03:33:49 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:08.469 03:33:49 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:08.469 03:33:49 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:08.469 03:33:49 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:08.469 03:33:49 -- target/tls.sh@72 -- # nvmfappstart -m 0x2 --wait-for-rpc 00:17:08.469 03:33:49 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:08.469 03:33:49 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:08.469 03:33:49 -- common/autotest_common.sh@10 -- # set +x 00:17:08.469 03:33:49 -- nvmf/common.sh@469 -- # nvmfpid=3067156 00:17:08.469 03:33:49 -- nvmf/common.sh@470 -- # waitforlisten 3067156 00:17:08.469 03:33:49 -- common/autotest_common.sh@829 -- # '[' -z 3067156 ']' 00:17:08.469 03:33:49 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:08.469 03:33:49 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 --wait-for-rpc 00:17:08.469 03:33:49 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:08.469 03:33:49 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:08.469 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:08.469 03:33:49 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:08.469 03:33:49 -- common/autotest_common.sh@10 -- # set +x 00:17:08.469 [2024-11-21 03:33:49.085490] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:08.469 [2024-11-21 03:33:49.085570] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:08.728 EAL: No free 2048 kB hugepages reported on node 1 00:17:08.728 [2024-11-21 03:33:49.156206] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:08.728 [2024-11-21 03:33:49.269688] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:08.728 [2024-11-21 03:33:49.269850] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:08.728 [2024-11-21 03:33:49.269870] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:08.728 [2024-11-21 03:33:49.269883] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:08.728 [2024-11-21 03:33:49.269914] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:08.728 03:33:49 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:08.728 03:33:49 -- common/autotest_common.sh@862 -- # return 0 00:17:08.728 03:33:49 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:08.728 03:33:49 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:08.728 03:33:49 -- common/autotest_common.sh@10 -- # set +x 00:17:08.728 03:33:49 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:08.728 03:33:49 -- target/tls.sh@74 -- # '[' tcp '!=' tcp ']' 00:17:08.728 03:33:49 -- target/tls.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_set_default_impl -i ssl 00:17:08.986 true 00:17:08.986 03:33:49 -- target/tls.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:08.986 03:33:49 -- target/tls.sh@82 -- # jq -r .tls_version 00:17:09.551 03:33:49 -- target/tls.sh@82 -- # version=0 00:17:09.551 03:33:49 -- target/tls.sh@83 -- # [[ 0 != \0 ]] 00:17:09.551 03:33:49 -- target/tls.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:17:09.551 03:33:50 -- target/tls.sh@90 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:09.551 03:33:50 -- target/tls.sh@90 -- # jq -r .tls_version 00:17:09.809 03:33:50 -- target/tls.sh@90 -- # version=13 00:17:09.809 03:33:50 -- target/tls.sh@91 -- # [[ 13 != \1\3 ]] 00:17:09.809 03:33:50 -- target/tls.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 7 00:17:10.068 03:33:50 -- target/tls.sh@98 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:10.068 03:33:50 -- target/tls.sh@98 -- # jq -r .tls_version 00:17:10.326 03:33:50 -- target/tls.sh@98 -- # version=7 00:17:10.326 03:33:50 -- target/tls.sh@99 -- # [[ 7 != \7 ]] 00:17:10.326 03:33:50 -- target/tls.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:10.326 03:33:50 -- target/tls.sh@105 -- # jq -r .enable_ktls 00:17:10.585 03:33:51 -- target/tls.sh@105 -- # ktls=false 00:17:10.585 03:33:51 -- target/tls.sh@106 -- # [[ false != \f\a\l\s\e ]] 00:17:10.585 03:33:51 -- target/tls.sh@112 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --enable-ktls 00:17:10.844 03:33:51 -- target/tls.sh@113 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:10.844 03:33:51 -- target/tls.sh@113 -- # jq -r .enable_ktls 00:17:11.102 03:33:51 -- target/tls.sh@113 -- # ktls=true 00:17:11.102 03:33:51 -- target/tls.sh@114 -- # [[ true != \t\r\u\e ]] 00:17:11.102 03:33:51 -- target/tls.sh@120 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --disable-ktls 00:17:11.362 03:33:51 -- target/tls.sh@121 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:11.362 03:33:51 -- target/tls.sh@121 -- # jq -r .enable_ktls 00:17:11.621 03:33:52 -- target/tls.sh@121 -- # ktls=false 00:17:11.621 03:33:52 -- target/tls.sh@122 -- # [[ false != \f\a\l\s\e ]] 00:17:11.621 03:33:52 -- target/tls.sh@127 -- # format_interchange_psk 00112233445566778899aabbccddeeff 00:17:11.621 03:33:52 -- target/tls.sh@49 -- # local key hash crc 00:17:11.621 03:33:52 -- target/tls.sh@51 -- # key=00112233445566778899aabbccddeeff 00:17:11.621 03:33:52 -- target/tls.sh@51 -- # hash=01 00:17:11.621 03:33:52 -- target/tls.sh@52 -- # echo -n 00112233445566778899aabbccddeeff 00:17:11.621 03:33:52 -- target/tls.sh@52 -- # gzip -1 -c 00:17:11.621 03:33:52 -- target/tls.sh@52 -- # tail -c8 00:17:11.621 03:33:52 -- target/tls.sh@52 -- # head -c 4 00:17:11.621 03:33:52 -- target/tls.sh@52 -- # crc='p$H�' 00:17:11.621 03:33:52 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:17:11.621 03:33:52 -- target/tls.sh@54 -- # echo -n '00112233445566778899aabbccddeeffp$H�' 00:17:11.621 03:33:52 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:17:11.621 03:33:52 -- target/tls.sh@127 -- # key=NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:17:11.621 03:33:52 -- target/tls.sh@128 -- # format_interchange_psk ffeeddccbbaa99887766554433221100 00:17:11.621 03:33:52 -- target/tls.sh@49 -- # local key hash crc 00:17:11.621 03:33:52 -- target/tls.sh@51 -- # key=ffeeddccbbaa99887766554433221100 00:17:11.621 03:33:52 -- target/tls.sh@51 -- # hash=01 00:17:11.621 03:33:52 -- target/tls.sh@52 -- # echo -n ffeeddccbbaa99887766554433221100 00:17:11.621 03:33:52 -- target/tls.sh@52 -- # gzip -1 -c 00:17:11.621 03:33:52 -- target/tls.sh@52 -- # tail -c8 00:17:11.621 03:33:52 -- target/tls.sh@52 -- # head -c 4 00:17:11.621 03:33:52 -- target/tls.sh@52 -- # crc=$'_\006o\330' 00:17:11.621 03:33:52 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:17:11.621 03:33:52 -- target/tls.sh@54 -- # echo -n $'ffeeddccbbaa99887766554433221100_\006o\330' 00:17:11.621 03:33:52 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:17:11.621 03:33:52 -- target/tls.sh@128 -- # key_2=NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:17:11.621 03:33:52 -- target/tls.sh@130 -- # key_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:11.621 03:33:52 -- target/tls.sh@131 -- # key_2_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:11.621 03:33:52 -- target/tls.sh@133 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:17:11.621 03:33:52 -- target/tls.sh@134 -- # echo -n NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:17:11.621 03:33:52 -- target/tls.sh@136 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:11.621 03:33:52 -- target/tls.sh@137 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:11.621 03:33:52 -- target/tls.sh@139 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:17:11.880 03:33:52 -- target/tls.sh@140 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_start_init 00:17:12.447 03:33:52 -- target/tls.sh@142 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:12.447 03:33:52 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:12.447 03:33:52 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:17:12.447 [2024-11-21 03:33:53.081117] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:12.706 03:33:53 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:17:12.706 03:33:53 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:17:12.966 [2024-11-21 03:33:53.586432] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:17:12.966 [2024-11-21 03:33:53.586705] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:12.966 03:33:53 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:17:13.225 malloc0 00:17:13.225 03:33:53 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:17:13.791 03:33:54 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:14.048 03:33:54 -- target/tls.sh@146 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -S ssl -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 hostnqn:nqn.2016-06.io.spdk:host1' --psk-path /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:14.048 EAL: No free 2048 kB hugepages reported on node 1 00:17:24.028 Initializing NVMe Controllers 00:17:24.028 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:17:24.028 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:17:24.028 Initialization complete. Launching workers. 00:17:24.028 ======================================================== 00:17:24.028 Latency(us) 00:17:24.028 Device Information : IOPS MiB/s Average min max 00:17:24.028 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7688.77 30.03 8326.39 1269.42 9488.67 00:17:24.028 ======================================================== 00:17:24.028 Total : 7688.77 30.03 8326.39 1269.42 9488.67 00:17:24.028 00:17:24.028 03:34:04 -- target/tls.sh@152 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:24.028 03:34:04 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:24.028 03:34:04 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:24.028 03:34:04 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:24.028 03:34:04 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:17:24.028 03:34:04 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:24.028 03:34:04 -- target/tls.sh@28 -- # bdevperf_pid=3069112 00:17:24.028 03:34:04 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:24.028 03:34:04 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:24.028 03:34:04 -- target/tls.sh@31 -- # waitforlisten 3069112 /var/tmp/bdevperf.sock 00:17:24.028 03:34:04 -- common/autotest_common.sh@829 -- # '[' -z 3069112 ']' 00:17:24.028 03:34:04 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:24.028 03:34:04 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:24.028 03:34:04 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:24.028 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:24.028 03:34:04 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:24.028 03:34:04 -- common/autotest_common.sh@10 -- # set +x 00:17:24.028 [2024-11-21 03:34:04.609659] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:24.028 [2024-11-21 03:34:04.609734] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3069112 ] 00:17:24.028 EAL: No free 2048 kB hugepages reported on node 1 00:17:24.028 [2024-11-21 03:34:04.665581] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:24.286 [2024-11-21 03:34:04.768359] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:25.222 03:34:05 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:25.222 03:34:05 -- common/autotest_common.sh@862 -- # return 0 00:17:25.222 03:34:05 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:25.222 [2024-11-21 03:34:05.800054] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:25.479 TLSTESTn1 00:17:25.479 03:34:05 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:17:25.479 Running I/O for 10 seconds... 00:17:35.452 00:17:35.452 Latency(us) 00:17:35.452 [2024-11-21T02:34:16.100Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:35.452 [2024-11-21T02:34:16.100Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:17:35.452 Verification LBA range: start 0x0 length 0x2000 00:17:35.452 TLSTESTn1 : 10.02 2918.96 11.40 0.00 0.00 43778.68 7136.14 54370.61 00:17:35.452 [2024-11-21T02:34:16.100Z] =================================================================================================================== 00:17:35.452 [2024-11-21T02:34:16.100Z] Total : 2918.96 11.40 0.00 0.00 43778.68 7136.14 54370.61 00:17:35.452 0 00:17:35.452 03:34:16 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:35.452 03:34:16 -- target/tls.sh@45 -- # killprocess 3069112 00:17:35.452 03:34:16 -- common/autotest_common.sh@936 -- # '[' -z 3069112 ']' 00:17:35.452 03:34:16 -- common/autotest_common.sh@940 -- # kill -0 3069112 00:17:35.452 03:34:16 -- common/autotest_common.sh@941 -- # uname 00:17:35.452 03:34:16 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:35.452 03:34:16 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3069112 00:17:35.452 03:34:16 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:35.452 03:34:16 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:35.452 03:34:16 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3069112' 00:17:35.452 killing process with pid 3069112 00:17:35.452 03:34:16 -- common/autotest_common.sh@955 -- # kill 3069112 00:17:35.452 Received shutdown signal, test time was about 10.000000 seconds 00:17:35.452 00:17:35.452 Latency(us) 00:17:35.452 [2024-11-21T02:34:16.100Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:35.452 [2024-11-21T02:34:16.100Z] =================================================================================================================== 00:17:35.452 [2024-11-21T02:34:16.100Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:17:35.452 03:34:16 -- common/autotest_common.sh@960 -- # wait 3069112 00:17:35.710 03:34:16 -- target/tls.sh@155 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:35.710 03:34:16 -- common/autotest_common.sh@650 -- # local es=0 00:17:35.710 03:34:16 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:35.710 03:34:16 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:17:35.710 03:34:16 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:35.710 03:34:16 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:17:35.710 03:34:16 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:35.710 03:34:16 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:35.710 03:34:16 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:35.710 03:34:16 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:35.710 03:34:16 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:35.710 03:34:16 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt' 00:17:35.710 03:34:16 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:35.710 03:34:16 -- target/tls.sh@28 -- # bdevperf_pid=3070483 00:17:35.710 03:34:16 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:35.710 03:34:16 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:35.710 03:34:16 -- target/tls.sh@31 -- # waitforlisten 3070483 /var/tmp/bdevperf.sock 00:17:35.710 03:34:16 -- common/autotest_common.sh@829 -- # '[' -z 3070483 ']' 00:17:35.710 03:34:16 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:35.710 03:34:16 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:35.710 03:34:16 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:35.710 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:35.710 03:34:16 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:35.710 03:34:16 -- common/autotest_common.sh@10 -- # set +x 00:17:35.970 [2024-11-21 03:34:16.371305] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:35.970 [2024-11-21 03:34:16.371386] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3070483 ] 00:17:35.970 EAL: No free 2048 kB hugepages reported on node 1 00:17:35.970 [2024-11-21 03:34:16.428122] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:35.970 [2024-11-21 03:34:16.537988] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:36.905 03:34:17 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:36.905 03:34:17 -- common/autotest_common.sh@862 -- # return 0 00:17:36.905 03:34:17 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:37.164 [2024-11-21 03:34:17.667367] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:37.165 [2024-11-21 03:34:17.672841] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:17:37.165 [2024-11-21 03:34:17.673351] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xce61f0 (107): Transport endpoint is not connected 00:17:37.165 [2024-11-21 03:34:17.674340] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xce61f0 (9): Bad file descriptor 00:17:37.165 [2024-11-21 03:34:17.675338] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:17:37.165 [2024-11-21 03:34:17.675378] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:17:37.165 [2024-11-21 03:34:17.675392] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:17:37.165 request: 00:17:37.165 { 00:17:37.165 "name": "TLSTEST", 00:17:37.165 "trtype": "tcp", 00:17:37.165 "traddr": "10.0.0.2", 00:17:37.165 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:37.165 "adrfam": "ipv4", 00:17:37.165 "trsvcid": "4420", 00:17:37.165 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:37.165 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt", 00:17:37.165 "method": "bdev_nvme_attach_controller", 00:17:37.165 "req_id": 1 00:17:37.165 } 00:17:37.165 Got JSON-RPC error response 00:17:37.165 response: 00:17:37.165 { 00:17:37.165 "code": -32602, 00:17:37.165 "message": "Invalid parameters" 00:17:37.165 } 00:17:37.165 03:34:17 -- target/tls.sh@36 -- # killprocess 3070483 00:17:37.165 03:34:17 -- common/autotest_common.sh@936 -- # '[' -z 3070483 ']' 00:17:37.165 03:34:17 -- common/autotest_common.sh@940 -- # kill -0 3070483 00:17:37.165 03:34:17 -- common/autotest_common.sh@941 -- # uname 00:17:37.165 03:34:17 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:37.165 03:34:17 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3070483 00:17:37.165 03:34:17 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:37.165 03:34:17 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:37.165 03:34:17 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3070483' 00:17:37.165 killing process with pid 3070483 00:17:37.165 03:34:17 -- common/autotest_common.sh@955 -- # kill 3070483 00:17:37.165 Received shutdown signal, test time was about 10.000000 seconds 00:17:37.165 00:17:37.165 Latency(us) 00:17:37.165 [2024-11-21T02:34:17.813Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:37.165 [2024-11-21T02:34:17.813Z] =================================================================================================================== 00:17:37.165 [2024-11-21T02:34:17.813Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:37.165 03:34:17 -- common/autotest_common.sh@960 -- # wait 3070483 00:17:37.423 03:34:17 -- target/tls.sh@37 -- # return 1 00:17:37.423 03:34:17 -- common/autotest_common.sh@653 -- # es=1 00:17:37.423 03:34:17 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:37.423 03:34:17 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:37.423 03:34:17 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:37.423 03:34:17 -- target/tls.sh@158 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:37.423 03:34:17 -- common/autotest_common.sh@650 -- # local es=0 00:17:37.423 03:34:17 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:37.423 03:34:17 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:17:37.423 03:34:17 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:37.423 03:34:17 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:17:37.423 03:34:17 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:37.424 03:34:17 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:37.424 03:34:17 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:37.424 03:34:17 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:37.424 03:34:17 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host2 00:17:37.424 03:34:17 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:17:37.424 03:34:17 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:37.424 03:34:17 -- target/tls.sh@28 -- # bdevperf_pid=3070643 00:17:37.424 03:34:17 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:37.424 03:34:17 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:37.424 03:34:17 -- target/tls.sh@31 -- # waitforlisten 3070643 /var/tmp/bdevperf.sock 00:17:37.424 03:34:17 -- common/autotest_common.sh@829 -- # '[' -z 3070643 ']' 00:17:37.424 03:34:17 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:37.424 03:34:17 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:37.424 03:34:17 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:37.424 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:37.424 03:34:17 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:37.424 03:34:17 -- common/autotest_common.sh@10 -- # set +x 00:17:37.424 [2024-11-21 03:34:18.038284] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:37.424 [2024-11-21 03:34:18.038385] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3070643 ] 00:17:37.424 EAL: No free 2048 kB hugepages reported on node 1 00:17:37.683 [2024-11-21 03:34:18.097925] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:37.683 [2024-11-21 03:34:18.202932] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:38.638 03:34:19 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:38.639 03:34:19 -- common/autotest_common.sh@862 -- # return 0 00:17:38.639 03:34:19 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host2 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:38.639 [2024-11-21 03:34:19.258546] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:38.639 [2024-11-21 03:34:19.265906] tcp.c: 868:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:17:38.639 [2024-11-21 03:34:19.265940] posix.c: 583:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:17:38.639 [2024-11-21 03:34:19.265995] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:17:38.639 [2024-11-21 03:34:19.266454] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1df31f0 (107): Transport endpoint is not connected 00:17:38.639 [2024-11-21 03:34:19.267441] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1df31f0 (9): Bad file descriptor 00:17:38.639 [2024-11-21 03:34:19.268439] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:17:38.639 [2024-11-21 03:34:19.268458] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:17:38.639 [2024-11-21 03:34:19.268470] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:17:38.639 request: 00:17:38.639 { 00:17:38.639 "name": "TLSTEST", 00:17:38.639 "trtype": "tcp", 00:17:38.639 "traddr": "10.0.0.2", 00:17:38.639 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:17:38.639 "adrfam": "ipv4", 00:17:38.639 "trsvcid": "4420", 00:17:38.639 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:38.639 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt", 00:17:38.639 "method": "bdev_nvme_attach_controller", 00:17:38.639 "req_id": 1 00:17:38.639 } 00:17:38.639 Got JSON-RPC error response 00:17:38.639 response: 00:17:38.639 { 00:17:38.639 "code": -32602, 00:17:38.639 "message": "Invalid parameters" 00:17:38.639 } 00:17:38.907 03:34:19 -- target/tls.sh@36 -- # killprocess 3070643 00:17:38.907 03:34:19 -- common/autotest_common.sh@936 -- # '[' -z 3070643 ']' 00:17:38.907 03:34:19 -- common/autotest_common.sh@940 -- # kill -0 3070643 00:17:38.907 03:34:19 -- common/autotest_common.sh@941 -- # uname 00:17:38.907 03:34:19 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:38.907 03:34:19 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3070643 00:17:38.907 03:34:19 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:38.907 03:34:19 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:38.907 03:34:19 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3070643' 00:17:38.907 killing process with pid 3070643 00:17:38.907 03:34:19 -- common/autotest_common.sh@955 -- # kill 3070643 00:17:38.907 Received shutdown signal, test time was about 10.000000 seconds 00:17:38.907 00:17:38.907 Latency(us) 00:17:38.907 [2024-11-21T02:34:19.555Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:38.907 [2024-11-21T02:34:19.555Z] =================================================================================================================== 00:17:38.907 [2024-11-21T02:34:19.555Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:38.907 03:34:19 -- common/autotest_common.sh@960 -- # wait 3070643 00:17:39.164 03:34:19 -- target/tls.sh@37 -- # return 1 00:17:39.164 03:34:19 -- common/autotest_common.sh@653 -- # es=1 00:17:39.164 03:34:19 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:39.164 03:34:19 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:39.164 03:34:19 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:39.164 03:34:19 -- target/tls.sh@161 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:39.164 03:34:19 -- common/autotest_common.sh@650 -- # local es=0 00:17:39.164 03:34:19 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:39.164 03:34:19 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:17:39.164 03:34:19 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:39.164 03:34:19 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:17:39.164 03:34:19 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:39.164 03:34:19 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:39.164 03:34:19 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:39.164 03:34:19 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode2 00:17:39.164 03:34:19 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:39.164 03:34:19 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:17:39.164 03:34:19 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:39.164 03:34:19 -- target/tls.sh@28 -- # bdevperf_pid=3070912 00:17:39.164 03:34:19 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:39.164 03:34:19 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:39.164 03:34:19 -- target/tls.sh@31 -- # waitforlisten 3070912 /var/tmp/bdevperf.sock 00:17:39.164 03:34:19 -- common/autotest_common.sh@829 -- # '[' -z 3070912 ']' 00:17:39.164 03:34:19 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:39.164 03:34:19 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:39.164 03:34:19 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:39.164 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:39.164 03:34:19 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:39.164 03:34:19 -- common/autotest_common.sh@10 -- # set +x 00:17:39.164 [2024-11-21 03:34:19.637697] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:39.164 [2024-11-21 03:34:19.637773] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3070912 ] 00:17:39.164 EAL: No free 2048 kB hugepages reported on node 1 00:17:39.164 [2024-11-21 03:34:19.694980] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:39.164 [2024-11-21 03:34:19.794803] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:40.099 03:34:20 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:40.099 03:34:20 -- common/autotest_common.sh@862 -- # return 0 00:17:40.099 03:34:20 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:40.356 [2024-11-21 03:34:20.911799] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:40.356 [2024-11-21 03:34:20.920434] tcp.c: 868:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:17:40.356 [2024-11-21 03:34:20.920468] posix.c: 583:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:17:40.357 [2024-11-21 03:34:20.920522] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:17:40.357 [2024-11-21 03:34:20.920752] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x140c1f0 (107): Transport endpoint is not connected 00:17:40.357 [2024-11-21 03:34:20.921741] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x140c1f0 (9): Bad file descriptor 00:17:40.357 [2024-11-21 03:34:20.922740] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:17:40.357 [2024-11-21 03:34:20.922759] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:17:40.357 [2024-11-21 03:34:20.922787] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:17:40.357 request: 00:17:40.357 { 00:17:40.357 "name": "TLSTEST", 00:17:40.357 "trtype": "tcp", 00:17:40.357 "traddr": "10.0.0.2", 00:17:40.357 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:40.357 "adrfam": "ipv4", 00:17:40.357 "trsvcid": "4420", 00:17:40.357 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:17:40.357 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt", 00:17:40.357 "method": "bdev_nvme_attach_controller", 00:17:40.357 "req_id": 1 00:17:40.357 } 00:17:40.357 Got JSON-RPC error response 00:17:40.357 response: 00:17:40.357 { 00:17:40.357 "code": -32602, 00:17:40.357 "message": "Invalid parameters" 00:17:40.357 } 00:17:40.357 03:34:20 -- target/tls.sh@36 -- # killprocess 3070912 00:17:40.357 03:34:20 -- common/autotest_common.sh@936 -- # '[' -z 3070912 ']' 00:17:40.357 03:34:20 -- common/autotest_common.sh@940 -- # kill -0 3070912 00:17:40.357 03:34:20 -- common/autotest_common.sh@941 -- # uname 00:17:40.357 03:34:20 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:40.357 03:34:20 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3070912 00:17:40.357 03:34:20 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:40.357 03:34:20 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:40.357 03:34:20 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3070912' 00:17:40.357 killing process with pid 3070912 00:17:40.357 03:34:20 -- common/autotest_common.sh@955 -- # kill 3070912 00:17:40.357 Received shutdown signal, test time was about 10.000000 seconds 00:17:40.357 00:17:40.357 Latency(us) 00:17:40.357 [2024-11-21T02:34:21.005Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:40.357 [2024-11-21T02:34:21.005Z] =================================================================================================================== 00:17:40.357 [2024-11-21T02:34:21.005Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:40.357 03:34:20 -- common/autotest_common.sh@960 -- # wait 3070912 00:17:40.615 03:34:21 -- target/tls.sh@37 -- # return 1 00:17:40.615 03:34:21 -- common/autotest_common.sh@653 -- # es=1 00:17:40.615 03:34:21 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:40.615 03:34:21 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:40.615 03:34:21 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:40.615 03:34:21 -- target/tls.sh@164 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:17:40.615 03:34:21 -- common/autotest_common.sh@650 -- # local es=0 00:17:40.615 03:34:21 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:17:40.615 03:34:21 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:17:40.615 03:34:21 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:40.615 03:34:21 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:17:40.615 03:34:21 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:40.615 03:34:21 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:17:40.615 03:34:21 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:40.615 03:34:21 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:40.615 03:34:21 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:40.615 03:34:21 -- target/tls.sh@23 -- # psk= 00:17:40.615 03:34:21 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:40.615 03:34:21 -- target/tls.sh@28 -- # bdevperf_pid=3071072 00:17:40.615 03:34:21 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:40.615 03:34:21 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:40.615 03:34:21 -- target/tls.sh@31 -- # waitforlisten 3071072 /var/tmp/bdevperf.sock 00:17:40.615 03:34:21 -- common/autotest_common.sh@829 -- # '[' -z 3071072 ']' 00:17:40.615 03:34:21 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:40.615 03:34:21 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:40.615 03:34:21 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:40.615 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:40.615 03:34:21 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:40.615 03:34:21 -- common/autotest_common.sh@10 -- # set +x 00:17:40.873 [2024-11-21 03:34:21.285109] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:40.873 [2024-11-21 03:34:21.285186] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3071072 ] 00:17:40.873 EAL: No free 2048 kB hugepages reported on node 1 00:17:40.873 [2024-11-21 03:34:21.341200] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:40.873 [2024-11-21 03:34:21.443984] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:41.809 03:34:22 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:41.809 03:34:22 -- common/autotest_common.sh@862 -- # return 0 00:17:41.809 03:34:22 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 00:17:42.068 [2024-11-21 03:34:22.534770] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:17:42.068 [2024-11-21 03:34:22.536982] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x165e050 (9): Bad file descriptor 00:17:42.068 [2024-11-21 03:34:22.537978] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:17:42.068 [2024-11-21 03:34:22.537998] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:17:42.068 [2024-11-21 03:34:22.538026] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:17:42.068 request: 00:17:42.068 { 00:17:42.068 "name": "TLSTEST", 00:17:42.068 "trtype": "tcp", 00:17:42.068 "traddr": "10.0.0.2", 00:17:42.068 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:42.068 "adrfam": "ipv4", 00:17:42.068 "trsvcid": "4420", 00:17:42.068 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:42.068 "method": "bdev_nvme_attach_controller", 00:17:42.068 "req_id": 1 00:17:42.068 } 00:17:42.068 Got JSON-RPC error response 00:17:42.068 response: 00:17:42.068 { 00:17:42.068 "code": -32602, 00:17:42.068 "message": "Invalid parameters" 00:17:42.068 } 00:17:42.068 03:34:22 -- target/tls.sh@36 -- # killprocess 3071072 00:17:42.068 03:34:22 -- common/autotest_common.sh@936 -- # '[' -z 3071072 ']' 00:17:42.068 03:34:22 -- common/autotest_common.sh@940 -- # kill -0 3071072 00:17:42.068 03:34:22 -- common/autotest_common.sh@941 -- # uname 00:17:42.068 03:34:22 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:42.068 03:34:22 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3071072 00:17:42.068 03:34:22 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:42.068 03:34:22 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:42.068 03:34:22 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3071072' 00:17:42.068 killing process with pid 3071072 00:17:42.068 03:34:22 -- common/autotest_common.sh@955 -- # kill 3071072 00:17:42.068 Received shutdown signal, test time was about 10.000000 seconds 00:17:42.068 00:17:42.068 Latency(us) 00:17:42.069 [2024-11-21T02:34:22.717Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:42.069 [2024-11-21T02:34:22.717Z] =================================================================================================================== 00:17:42.069 [2024-11-21T02:34:22.717Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:42.069 03:34:22 -- common/autotest_common.sh@960 -- # wait 3071072 00:17:42.329 03:34:22 -- target/tls.sh@37 -- # return 1 00:17:42.329 03:34:22 -- common/autotest_common.sh@653 -- # es=1 00:17:42.329 03:34:22 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:42.329 03:34:22 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:42.329 03:34:22 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:42.329 03:34:22 -- target/tls.sh@167 -- # killprocess 3067156 00:17:42.329 03:34:22 -- common/autotest_common.sh@936 -- # '[' -z 3067156 ']' 00:17:42.329 03:34:22 -- common/autotest_common.sh@940 -- # kill -0 3067156 00:17:42.329 03:34:22 -- common/autotest_common.sh@941 -- # uname 00:17:42.329 03:34:22 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:42.329 03:34:22 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3067156 00:17:42.329 03:34:22 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:17:42.329 03:34:22 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:17:42.329 03:34:22 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3067156' 00:17:42.329 killing process with pid 3067156 00:17:42.329 03:34:22 -- common/autotest_common.sh@955 -- # kill 3067156 00:17:42.329 03:34:22 -- common/autotest_common.sh@960 -- # wait 3067156 00:17:42.588 03:34:23 -- target/tls.sh@168 -- # format_interchange_psk 00112233445566778899aabbccddeeff0011223344556677 02 00:17:42.588 03:34:23 -- target/tls.sh@49 -- # local key hash crc 00:17:42.588 03:34:23 -- target/tls.sh@51 -- # key=00112233445566778899aabbccddeeff0011223344556677 00:17:42.588 03:34:23 -- target/tls.sh@51 -- # hash=02 00:17:42.588 03:34:23 -- target/tls.sh@52 -- # echo -n 00112233445566778899aabbccddeeff0011223344556677 00:17:42.588 03:34:23 -- target/tls.sh@52 -- # gzip -1 -c 00:17:42.588 03:34:23 -- target/tls.sh@52 -- # head -c 4 00:17:42.588 03:34:23 -- target/tls.sh@52 -- # tail -c8 00:17:42.588 03:34:23 -- target/tls.sh@52 -- # crc='�e�'\''' 00:17:42.588 03:34:23 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:17:42.588 03:34:23 -- target/tls.sh@54 -- # echo -n '00112233445566778899aabbccddeeff0011223344556677�e�'\''' 00:17:42.589 03:34:23 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:17:42.589 03:34:23 -- target/tls.sh@168 -- # key_long=NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:17:42.589 03:34:23 -- target/tls.sh@169 -- # key_long_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:42.589 03:34:23 -- target/tls.sh@170 -- # echo -n NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:17:42.589 03:34:23 -- target/tls.sh@171 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:42.589 03:34:23 -- target/tls.sh@172 -- # nvmfappstart -m 0x2 00:17:42.589 03:34:23 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:42.589 03:34:23 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:42.589 03:34:23 -- common/autotest_common.sh@10 -- # set +x 00:17:42.589 03:34:23 -- nvmf/common.sh@469 -- # nvmfpid=3071360 00:17:42.589 03:34:23 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:17:42.589 03:34:23 -- nvmf/common.sh@470 -- # waitforlisten 3071360 00:17:42.589 03:34:23 -- common/autotest_common.sh@829 -- # '[' -z 3071360 ']' 00:17:42.589 03:34:23 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:42.589 03:34:23 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:42.589 03:34:23 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:42.589 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:42.589 03:34:23 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:42.589 03:34:23 -- common/autotest_common.sh@10 -- # set +x 00:17:42.847 [2024-11-21 03:34:23.243060] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:42.847 [2024-11-21 03:34:23.243194] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:42.847 EAL: No free 2048 kB hugepages reported on node 1 00:17:42.847 [2024-11-21 03:34:23.308608] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:42.847 [2024-11-21 03:34:23.417233] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:42.847 [2024-11-21 03:34:23.417391] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:42.847 [2024-11-21 03:34:23.417407] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:42.847 [2024-11-21 03:34:23.417420] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:42.847 [2024-11-21 03:34:23.417447] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:43.782 03:34:24 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:43.782 03:34:24 -- common/autotest_common.sh@862 -- # return 0 00:17:43.782 03:34:24 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:43.782 03:34:24 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:43.782 03:34:24 -- common/autotest_common.sh@10 -- # set +x 00:17:43.782 03:34:24 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:43.782 03:34:24 -- target/tls.sh@174 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:43.782 03:34:24 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:43.782 03:34:24 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:17:44.041 [2024-11-21 03:34:24.466602] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:44.041 03:34:24 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:17:44.301 03:34:24 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:17:44.559 [2024-11-21 03:34:24.967975] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:17:44.559 [2024-11-21 03:34:24.968292] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:44.559 03:34:24 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:17:44.817 malloc0 00:17:44.817 03:34:25 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:17:45.074 03:34:25 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:45.332 03:34:25 -- target/tls.sh@176 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:45.332 03:34:25 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:45.332 03:34:25 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:45.332 03:34:25 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:45.332 03:34:25 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt' 00:17:45.332 03:34:25 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:45.332 03:34:25 -- target/tls.sh@28 -- # bdevperf_pid=3071661 00:17:45.332 03:34:25 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:45.332 03:34:25 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:45.332 03:34:25 -- target/tls.sh@31 -- # waitforlisten 3071661 /var/tmp/bdevperf.sock 00:17:45.332 03:34:25 -- common/autotest_common.sh@829 -- # '[' -z 3071661 ']' 00:17:45.332 03:34:25 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:45.332 03:34:25 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:45.332 03:34:25 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:45.332 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:45.332 03:34:25 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:45.332 03:34:25 -- common/autotest_common.sh@10 -- # set +x 00:17:45.332 [2024-11-21 03:34:25.781104] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:45.332 [2024-11-21 03:34:25.781192] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3071661 ] 00:17:45.332 EAL: No free 2048 kB hugepages reported on node 1 00:17:45.332 [2024-11-21 03:34:25.840654] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:45.332 [2024-11-21 03:34:25.951161] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:46.268 03:34:26 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:46.268 03:34:26 -- common/autotest_common.sh@862 -- # return 0 00:17:46.268 03:34:26 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:46.525 [2024-11-21 03:34:27.054323] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:46.525 TLSTESTn1 00:17:46.525 03:34:27 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:17:46.784 Running I/O for 10 seconds... 00:17:56.762 00:17:56.762 Latency(us) 00:17:56.762 [2024-11-21T02:34:37.410Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:56.762 [2024-11-21T02:34:37.410Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:17:56.762 Verification LBA range: start 0x0 length 0x2000 00:17:56.762 TLSTESTn1 : 10.02 3701.27 14.46 0.00 0.00 34538.81 7136.14 42913.94 00:17:56.762 [2024-11-21T02:34:37.410Z] =================================================================================================================== 00:17:56.762 [2024-11-21T02:34:37.410Z] Total : 3701.27 14.46 0.00 0.00 34538.81 7136.14 42913.94 00:17:56.762 0 00:17:56.762 03:34:37 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:56.762 03:34:37 -- target/tls.sh@45 -- # killprocess 3071661 00:17:56.762 03:34:37 -- common/autotest_common.sh@936 -- # '[' -z 3071661 ']' 00:17:56.762 03:34:37 -- common/autotest_common.sh@940 -- # kill -0 3071661 00:17:56.762 03:34:37 -- common/autotest_common.sh@941 -- # uname 00:17:56.762 03:34:37 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:56.762 03:34:37 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3071661 00:17:56.762 03:34:37 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:56.762 03:34:37 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:56.762 03:34:37 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3071661' 00:17:56.762 killing process with pid 3071661 00:17:56.762 03:34:37 -- common/autotest_common.sh@955 -- # kill 3071661 00:17:56.762 Received shutdown signal, test time was about 10.000000 seconds 00:17:56.762 00:17:56.762 Latency(us) 00:17:56.762 [2024-11-21T02:34:37.410Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:56.762 [2024-11-21T02:34:37.410Z] =================================================================================================================== 00:17:56.762 [2024-11-21T02:34:37.410Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:17:56.762 03:34:37 -- common/autotest_common.sh@960 -- # wait 3071661 00:17:57.021 03:34:37 -- target/tls.sh@179 -- # chmod 0666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:57.021 03:34:37 -- target/tls.sh@180 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:57.021 03:34:37 -- common/autotest_common.sh@650 -- # local es=0 00:17:57.021 03:34:37 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:57.021 03:34:37 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:17:57.021 03:34:37 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:57.021 03:34:37 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:17:57.021 03:34:37 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:57.021 03:34:37 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:57.021 03:34:37 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:57.021 03:34:37 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:57.021 03:34:37 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:57.021 03:34:37 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt' 00:17:57.021 03:34:37 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:57.021 03:34:37 -- target/tls.sh@28 -- # bdevperf_pid=3073150 00:17:57.021 03:34:37 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:57.021 03:34:37 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:57.021 03:34:37 -- target/tls.sh@31 -- # waitforlisten 3073150 /var/tmp/bdevperf.sock 00:17:57.021 03:34:37 -- common/autotest_common.sh@829 -- # '[' -z 3073150 ']' 00:17:57.021 03:34:37 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:57.021 03:34:37 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:57.021 03:34:37 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:57.021 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:57.021 03:34:37 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:57.021 03:34:37 -- common/autotest_common.sh@10 -- # set +x 00:17:57.021 [2024-11-21 03:34:37.657866] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:57.021 [2024-11-21 03:34:37.657938] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3073150 ] 00:17:57.281 EAL: No free 2048 kB hugepages reported on node 1 00:17:57.281 [2024-11-21 03:34:37.714506] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:57.281 [2024-11-21 03:34:37.814323] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:58.218 03:34:38 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:58.218 03:34:38 -- common/autotest_common.sh@862 -- # return 0 00:17:58.218 03:34:38 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:58.478 [2024-11-21 03:34:38.902036] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:58.478 [2024-11-21 03:34:38.902113] bdev_nvme_rpc.c: 336:tcp_load_psk: *ERROR*: Incorrect permissions for PSK file 00:17:58.478 request: 00:17:58.478 { 00:17:58.478 "name": "TLSTEST", 00:17:58.478 "trtype": "tcp", 00:17:58.478 "traddr": "10.0.0.2", 00:17:58.478 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:58.478 "adrfam": "ipv4", 00:17:58.478 "trsvcid": "4420", 00:17:58.478 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:58.478 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:17:58.478 "method": "bdev_nvme_attach_controller", 00:17:58.478 "req_id": 1 00:17:58.478 } 00:17:58.478 Got JSON-RPC error response 00:17:58.478 response: 00:17:58.478 { 00:17:58.478 "code": -22, 00:17:58.478 "message": "Could not retrieve PSK from file: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:17:58.478 } 00:17:58.478 03:34:38 -- target/tls.sh@36 -- # killprocess 3073150 00:17:58.478 03:34:38 -- common/autotest_common.sh@936 -- # '[' -z 3073150 ']' 00:17:58.478 03:34:38 -- common/autotest_common.sh@940 -- # kill -0 3073150 00:17:58.478 03:34:38 -- common/autotest_common.sh@941 -- # uname 00:17:58.478 03:34:38 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:58.478 03:34:38 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3073150 00:17:58.478 03:34:38 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:58.478 03:34:38 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:58.478 03:34:38 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3073150' 00:17:58.478 killing process with pid 3073150 00:17:58.478 03:34:38 -- common/autotest_common.sh@955 -- # kill 3073150 00:17:58.478 Received shutdown signal, test time was about 10.000000 seconds 00:17:58.478 00:17:58.478 Latency(us) 00:17:58.478 [2024-11-21T02:34:39.126Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:58.478 [2024-11-21T02:34:39.126Z] =================================================================================================================== 00:17:58.478 [2024-11-21T02:34:39.126Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:58.478 03:34:38 -- common/autotest_common.sh@960 -- # wait 3073150 00:17:58.738 03:34:39 -- target/tls.sh@37 -- # return 1 00:17:58.738 03:34:39 -- common/autotest_common.sh@653 -- # es=1 00:17:58.738 03:34:39 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:58.738 03:34:39 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:58.738 03:34:39 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:58.738 03:34:39 -- target/tls.sh@183 -- # killprocess 3071360 00:17:58.738 03:34:39 -- common/autotest_common.sh@936 -- # '[' -z 3071360 ']' 00:17:58.738 03:34:39 -- common/autotest_common.sh@940 -- # kill -0 3071360 00:17:58.738 03:34:39 -- common/autotest_common.sh@941 -- # uname 00:17:58.738 03:34:39 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:58.738 03:34:39 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3071360 00:17:58.738 03:34:39 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:17:58.738 03:34:39 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:17:58.738 03:34:39 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3071360' 00:17:58.738 killing process with pid 3071360 00:17:58.738 03:34:39 -- common/autotest_common.sh@955 -- # kill 3071360 00:17:58.738 03:34:39 -- common/autotest_common.sh@960 -- # wait 3071360 00:17:58.996 03:34:39 -- target/tls.sh@184 -- # nvmfappstart -m 0x2 00:17:58.996 03:34:39 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:58.996 03:34:39 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:58.996 03:34:39 -- common/autotest_common.sh@10 -- # set +x 00:17:58.997 03:34:39 -- nvmf/common.sh@469 -- # nvmfpid=3073387 00:17:58.997 03:34:39 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:17:58.997 03:34:39 -- nvmf/common.sh@470 -- # waitforlisten 3073387 00:17:58.997 03:34:39 -- common/autotest_common.sh@829 -- # '[' -z 3073387 ']' 00:17:58.997 03:34:39 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:58.997 03:34:39 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:58.997 03:34:39 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:58.997 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:58.997 03:34:39 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:58.997 03:34:39 -- common/autotest_common.sh@10 -- # set +x 00:17:58.997 [2024-11-21 03:34:39.606761] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:58.997 [2024-11-21 03:34:39.606835] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:58.997 EAL: No free 2048 kB hugepages reported on node 1 00:17:59.256 [2024-11-21 03:34:39.675299] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:59.256 [2024-11-21 03:34:39.790648] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:59.256 [2024-11-21 03:34:39.790812] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:59.256 [2024-11-21 03:34:39.790832] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:59.256 [2024-11-21 03:34:39.790846] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:59.256 [2024-11-21 03:34:39.790876] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:00.193 03:34:40 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:00.193 03:34:40 -- common/autotest_common.sh@862 -- # return 0 00:18:00.193 03:34:40 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:00.193 03:34:40 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:00.193 03:34:40 -- common/autotest_common.sh@10 -- # set +x 00:18:00.193 03:34:40 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:00.193 03:34:40 -- target/tls.sh@186 -- # NOT setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:00.193 03:34:40 -- common/autotest_common.sh@650 -- # local es=0 00:18:00.193 03:34:40 -- common/autotest_common.sh@652 -- # valid_exec_arg setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:00.193 03:34:40 -- common/autotest_common.sh@638 -- # local arg=setup_nvmf_tgt 00:18:00.193 03:34:40 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:00.193 03:34:40 -- common/autotest_common.sh@642 -- # type -t setup_nvmf_tgt 00:18:00.193 03:34:40 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:00.193 03:34:40 -- common/autotest_common.sh@653 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:00.193 03:34:40 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:00.193 03:34:40 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:18:00.452 [2024-11-21 03:34:40.864899] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:00.452 03:34:40 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:18:00.710 03:34:41 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:18:00.968 [2024-11-21 03:34:41.414349] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:18:00.968 [2024-11-21 03:34:41.414634] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:00.968 03:34:41 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:18:01.227 malloc0 00:18:01.227 03:34:41 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:18:01.485 03:34:41 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:01.744 [2024-11-21 03:34:42.176470] tcp.c:3551:tcp_load_psk: *ERROR*: Incorrect permissions for PSK file 00:18:01.744 [2024-11-21 03:34:42.176514] tcp.c:3620:nvmf_tcp_subsystem_add_host: *ERROR*: Could not retrieve PSK from file 00:18:01.745 [2024-11-21 03:34:42.176539] subsystem.c: 880:spdk_nvmf_subsystem_add_host: *ERROR*: Unable to add host to TCP transport 00:18:01.745 request: 00:18:01.745 { 00:18:01.745 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:01.745 "host": "nqn.2016-06.io.spdk:host1", 00:18:01.745 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:18:01.745 "method": "nvmf_subsystem_add_host", 00:18:01.745 "req_id": 1 00:18:01.745 } 00:18:01.745 Got JSON-RPC error response 00:18:01.745 response: 00:18:01.745 { 00:18:01.745 "code": -32603, 00:18:01.745 "message": "Internal error" 00:18:01.745 } 00:18:01.745 03:34:42 -- common/autotest_common.sh@653 -- # es=1 00:18:01.745 03:34:42 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:18:01.745 03:34:42 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:18:01.745 03:34:42 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:18:01.745 03:34:42 -- target/tls.sh@189 -- # killprocess 3073387 00:18:01.745 03:34:42 -- common/autotest_common.sh@936 -- # '[' -z 3073387 ']' 00:18:01.745 03:34:42 -- common/autotest_common.sh@940 -- # kill -0 3073387 00:18:01.745 03:34:42 -- common/autotest_common.sh@941 -- # uname 00:18:01.745 03:34:42 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:01.745 03:34:42 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3073387 00:18:01.745 03:34:42 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:01.745 03:34:42 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:01.745 03:34:42 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3073387' 00:18:01.745 killing process with pid 3073387 00:18:01.745 03:34:42 -- common/autotest_common.sh@955 -- # kill 3073387 00:18:01.745 03:34:42 -- common/autotest_common.sh@960 -- # wait 3073387 00:18:02.004 03:34:42 -- target/tls.sh@190 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:02.004 03:34:42 -- target/tls.sh@193 -- # nvmfappstart -m 0x2 00:18:02.004 03:34:42 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:02.004 03:34:42 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:02.004 03:34:42 -- common/autotest_common.sh@10 -- # set +x 00:18:02.004 03:34:42 -- nvmf/common.sh@469 -- # nvmfpid=3073747 00:18:02.004 03:34:42 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:18:02.004 03:34:42 -- nvmf/common.sh@470 -- # waitforlisten 3073747 00:18:02.004 03:34:42 -- common/autotest_common.sh@829 -- # '[' -z 3073747 ']' 00:18:02.004 03:34:42 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:02.004 03:34:42 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:02.004 03:34:42 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:02.004 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:02.004 03:34:42 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:02.004 03:34:42 -- common/autotest_common.sh@10 -- # set +x 00:18:02.004 [2024-11-21 03:34:42.590317] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:02.004 [2024-11-21 03:34:42.590392] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:02.004 EAL: No free 2048 kB hugepages reported on node 1 00:18:02.262 [2024-11-21 03:34:42.657099] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:02.262 [2024-11-21 03:34:42.770322] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:02.262 [2024-11-21 03:34:42.770481] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:02.262 [2024-11-21 03:34:42.770500] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:02.262 [2024-11-21 03:34:42.770514] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:02.262 [2024-11-21 03:34:42.770559] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:03.196 03:34:43 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:03.196 03:34:43 -- common/autotest_common.sh@862 -- # return 0 00:18:03.196 03:34:43 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:03.196 03:34:43 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:03.196 03:34:43 -- common/autotest_common.sh@10 -- # set +x 00:18:03.196 03:34:43 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:03.196 03:34:43 -- target/tls.sh@194 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:03.196 03:34:43 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:03.196 03:34:43 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:18:03.454 [2024-11-21 03:34:43.902107] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:03.454 03:34:43 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:18:03.713 03:34:44 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:18:03.971 [2024-11-21 03:34:44.427530] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:18:03.971 [2024-11-21 03:34:44.427806] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:03.971 03:34:44 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:18:04.229 malloc0 00:18:04.229 03:34:44 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:18:04.486 03:34:44 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:04.744 03:34:45 -- target/tls.sh@197 -- # bdevperf_pid=3074119 00:18:04.744 03:34:45 -- target/tls.sh@196 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:18:04.744 03:34:45 -- target/tls.sh@199 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:18:04.744 03:34:45 -- target/tls.sh@200 -- # waitforlisten 3074119 /var/tmp/bdevperf.sock 00:18:04.744 03:34:45 -- common/autotest_common.sh@829 -- # '[' -z 3074119 ']' 00:18:04.744 03:34:45 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:04.744 03:34:45 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:04.744 03:34:45 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:04.744 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:04.744 03:34:45 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:04.744 03:34:45 -- common/autotest_common.sh@10 -- # set +x 00:18:04.744 [2024-11-21 03:34:45.237223] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:04.744 [2024-11-21 03:34:45.237306] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3074119 ] 00:18:04.744 EAL: No free 2048 kB hugepages reported on node 1 00:18:04.744 [2024-11-21 03:34:45.298758] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:05.004 [2024-11-21 03:34:45.401930] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:05.570 03:34:46 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:05.570 03:34:46 -- common/autotest_common.sh@862 -- # return 0 00:18:05.570 03:34:46 -- target/tls.sh@201 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:05.829 [2024-11-21 03:34:46.426688] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:18:06.088 TLSTESTn1 00:18:06.088 03:34:46 -- target/tls.sh@205 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py save_config 00:18:06.346 03:34:46 -- target/tls.sh@205 -- # tgtconf='{ 00:18:06.346 "subsystems": [ 00:18:06.346 { 00:18:06.346 "subsystem": "iobuf", 00:18:06.346 "config": [ 00:18:06.346 { 00:18:06.346 "method": "iobuf_set_options", 00:18:06.346 "params": { 00:18:06.346 "small_pool_count": 8192, 00:18:06.346 "large_pool_count": 1024, 00:18:06.346 "small_bufsize": 8192, 00:18:06.346 "large_bufsize": 135168 00:18:06.346 } 00:18:06.346 } 00:18:06.346 ] 00:18:06.346 }, 00:18:06.346 { 00:18:06.346 "subsystem": "sock", 00:18:06.346 "config": [ 00:18:06.346 { 00:18:06.346 "method": "sock_impl_set_options", 00:18:06.346 "params": { 00:18:06.346 "impl_name": "posix", 00:18:06.346 "recv_buf_size": 2097152, 00:18:06.346 "send_buf_size": 2097152, 00:18:06.346 "enable_recv_pipe": true, 00:18:06.346 "enable_quickack": false, 00:18:06.346 "enable_placement_id": 0, 00:18:06.346 "enable_zerocopy_send_server": true, 00:18:06.346 "enable_zerocopy_send_client": false, 00:18:06.346 "zerocopy_threshold": 0, 00:18:06.346 "tls_version": 0, 00:18:06.346 "enable_ktls": false 00:18:06.346 } 00:18:06.346 }, 00:18:06.346 { 00:18:06.346 "method": "sock_impl_set_options", 00:18:06.346 "params": { 00:18:06.346 "impl_name": "ssl", 00:18:06.346 "recv_buf_size": 4096, 00:18:06.346 "send_buf_size": 4096, 00:18:06.346 "enable_recv_pipe": true, 00:18:06.346 "enable_quickack": false, 00:18:06.346 "enable_placement_id": 0, 00:18:06.346 "enable_zerocopy_send_server": true, 00:18:06.346 "enable_zerocopy_send_client": false, 00:18:06.346 "zerocopy_threshold": 0, 00:18:06.346 "tls_version": 0, 00:18:06.346 "enable_ktls": false 00:18:06.346 } 00:18:06.346 } 00:18:06.346 ] 00:18:06.346 }, 00:18:06.346 { 00:18:06.346 "subsystem": "vmd", 00:18:06.346 "config": [] 00:18:06.346 }, 00:18:06.346 { 00:18:06.346 "subsystem": "accel", 00:18:06.346 "config": [ 00:18:06.346 { 00:18:06.346 "method": "accel_set_options", 00:18:06.346 "params": { 00:18:06.347 "small_cache_size": 128, 00:18:06.347 "large_cache_size": 16, 00:18:06.347 "task_count": 2048, 00:18:06.347 "sequence_count": 2048, 00:18:06.347 "buf_count": 2048 00:18:06.347 } 00:18:06.347 } 00:18:06.347 ] 00:18:06.347 }, 00:18:06.347 { 00:18:06.347 "subsystem": "bdev", 00:18:06.347 "config": [ 00:18:06.347 { 00:18:06.347 "method": "bdev_set_options", 00:18:06.347 "params": { 00:18:06.347 "bdev_io_pool_size": 65535, 00:18:06.347 "bdev_io_cache_size": 256, 00:18:06.347 "bdev_auto_examine": true, 00:18:06.347 "iobuf_small_cache_size": 128, 00:18:06.347 "iobuf_large_cache_size": 16 00:18:06.347 } 00:18:06.347 }, 00:18:06.347 { 00:18:06.347 "method": "bdev_raid_set_options", 00:18:06.347 "params": { 00:18:06.347 "process_window_size_kb": 1024 00:18:06.347 } 00:18:06.347 }, 00:18:06.347 { 00:18:06.347 "method": "bdev_iscsi_set_options", 00:18:06.347 "params": { 00:18:06.347 "timeout_sec": 30 00:18:06.347 } 00:18:06.347 }, 00:18:06.347 { 00:18:06.347 "method": "bdev_nvme_set_options", 00:18:06.347 "params": { 00:18:06.347 "action_on_timeout": "none", 00:18:06.347 "timeout_us": 0, 00:18:06.347 "timeout_admin_us": 0, 00:18:06.347 "keep_alive_timeout_ms": 10000, 00:18:06.347 "transport_retry_count": 4, 00:18:06.347 "arbitration_burst": 0, 00:18:06.347 "low_priority_weight": 0, 00:18:06.347 "medium_priority_weight": 0, 00:18:06.347 "high_priority_weight": 0, 00:18:06.347 "nvme_adminq_poll_period_us": 10000, 00:18:06.347 "nvme_ioq_poll_period_us": 0, 00:18:06.347 "io_queue_requests": 0, 00:18:06.347 "delay_cmd_submit": true, 00:18:06.347 "bdev_retry_count": 3, 00:18:06.347 "transport_ack_timeout": 0, 00:18:06.347 "ctrlr_loss_timeout_sec": 0, 00:18:06.347 "reconnect_delay_sec": 0, 00:18:06.347 "fast_io_fail_timeout_sec": 0, 00:18:06.347 "generate_uuids": false, 00:18:06.347 "transport_tos": 0, 00:18:06.347 "io_path_stat": false, 00:18:06.347 "allow_accel_sequence": false 00:18:06.347 } 00:18:06.347 }, 00:18:06.347 { 00:18:06.347 "method": "bdev_nvme_set_hotplug", 00:18:06.347 "params": { 00:18:06.347 "period_us": 100000, 00:18:06.347 "enable": false 00:18:06.347 } 00:18:06.347 }, 00:18:06.347 { 00:18:06.347 "method": "bdev_malloc_create", 00:18:06.347 "params": { 00:18:06.347 "name": "malloc0", 00:18:06.347 "num_blocks": 8192, 00:18:06.347 "block_size": 4096, 00:18:06.347 "physical_block_size": 4096, 00:18:06.347 "uuid": "9b5a86cb-1bcf-4c91-b5c2-519251f1bfa5", 00:18:06.347 "optimal_io_boundary": 0 00:18:06.347 } 00:18:06.347 }, 00:18:06.347 { 00:18:06.347 "method": "bdev_wait_for_examine" 00:18:06.347 } 00:18:06.347 ] 00:18:06.347 }, 00:18:06.347 { 00:18:06.347 "subsystem": "nbd", 00:18:06.347 "config": [] 00:18:06.347 }, 00:18:06.347 { 00:18:06.347 "subsystem": "scheduler", 00:18:06.347 "config": [ 00:18:06.347 { 00:18:06.347 "method": "framework_set_scheduler", 00:18:06.347 "params": { 00:18:06.347 "name": "static" 00:18:06.347 } 00:18:06.347 } 00:18:06.347 ] 00:18:06.347 }, 00:18:06.347 { 00:18:06.347 "subsystem": "nvmf", 00:18:06.347 "config": [ 00:18:06.347 { 00:18:06.347 "method": "nvmf_set_config", 00:18:06.347 "params": { 00:18:06.347 "discovery_filter": "match_any", 00:18:06.347 "admin_cmd_passthru": { 00:18:06.347 "identify_ctrlr": false 00:18:06.347 } 00:18:06.347 } 00:18:06.347 }, 00:18:06.347 { 00:18:06.347 "method": "nvmf_set_max_subsystems", 00:18:06.347 "params": { 00:18:06.347 "max_subsystems": 1024 00:18:06.347 } 00:18:06.347 }, 00:18:06.347 { 00:18:06.347 "method": "nvmf_set_crdt", 00:18:06.347 "params": { 00:18:06.347 "crdt1": 0, 00:18:06.347 "crdt2": 0, 00:18:06.347 "crdt3": 0 00:18:06.347 } 00:18:06.347 }, 00:18:06.347 { 00:18:06.347 "method": "nvmf_create_transport", 00:18:06.347 "params": { 00:18:06.347 "trtype": "TCP", 00:18:06.347 "max_queue_depth": 128, 00:18:06.347 "max_io_qpairs_per_ctrlr": 127, 00:18:06.347 "in_capsule_data_size": 4096, 00:18:06.347 "max_io_size": 131072, 00:18:06.347 "io_unit_size": 131072, 00:18:06.347 "max_aq_depth": 128, 00:18:06.347 "num_shared_buffers": 511, 00:18:06.347 "buf_cache_size": 4294967295, 00:18:06.347 "dif_insert_or_strip": false, 00:18:06.347 "zcopy": false, 00:18:06.347 "c2h_success": false, 00:18:06.347 "sock_priority": 0, 00:18:06.347 "abort_timeout_sec": 1 00:18:06.347 } 00:18:06.347 }, 00:18:06.347 { 00:18:06.347 "method": "nvmf_create_subsystem", 00:18:06.347 "params": { 00:18:06.347 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:06.347 "allow_any_host": false, 00:18:06.347 "serial_number": "SPDK00000000000001", 00:18:06.347 "model_number": "SPDK bdev Controller", 00:18:06.347 "max_namespaces": 10, 00:18:06.347 "min_cntlid": 1, 00:18:06.347 "max_cntlid": 65519, 00:18:06.347 "ana_reporting": false 00:18:06.347 } 00:18:06.347 }, 00:18:06.347 { 00:18:06.347 "method": "nvmf_subsystem_add_host", 00:18:06.347 "params": { 00:18:06.347 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:06.347 "host": "nqn.2016-06.io.spdk:host1", 00:18:06.347 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:18:06.347 } 00:18:06.347 }, 00:18:06.347 { 00:18:06.347 "method": "nvmf_subsystem_add_ns", 00:18:06.347 "params": { 00:18:06.347 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:06.347 "namespace": { 00:18:06.347 "nsid": 1, 00:18:06.347 "bdev_name": "malloc0", 00:18:06.347 "nguid": "9B5A86CB1BCF4C91B5C2519251F1BFA5", 00:18:06.347 "uuid": "9b5a86cb-1bcf-4c91-b5c2-519251f1bfa5" 00:18:06.347 } 00:18:06.347 } 00:18:06.347 }, 00:18:06.347 { 00:18:06.347 "method": "nvmf_subsystem_add_listener", 00:18:06.347 "params": { 00:18:06.347 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:06.347 "listen_address": { 00:18:06.347 "trtype": "TCP", 00:18:06.347 "adrfam": "IPv4", 00:18:06.347 "traddr": "10.0.0.2", 00:18:06.347 "trsvcid": "4420" 00:18:06.347 }, 00:18:06.347 "secure_channel": true 00:18:06.347 } 00:18:06.347 } 00:18:06.347 ] 00:18:06.347 } 00:18:06.347 ] 00:18:06.347 }' 00:18:06.347 03:34:46 -- target/tls.sh@206 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock save_config 00:18:06.607 03:34:47 -- target/tls.sh@206 -- # bdevperfconf='{ 00:18:06.608 "subsystems": [ 00:18:06.608 { 00:18:06.608 "subsystem": "iobuf", 00:18:06.608 "config": [ 00:18:06.608 { 00:18:06.608 "method": "iobuf_set_options", 00:18:06.608 "params": { 00:18:06.608 "small_pool_count": 8192, 00:18:06.608 "large_pool_count": 1024, 00:18:06.608 "small_bufsize": 8192, 00:18:06.608 "large_bufsize": 135168 00:18:06.608 } 00:18:06.608 } 00:18:06.608 ] 00:18:06.608 }, 00:18:06.608 { 00:18:06.608 "subsystem": "sock", 00:18:06.608 "config": [ 00:18:06.608 { 00:18:06.608 "method": "sock_impl_set_options", 00:18:06.608 "params": { 00:18:06.608 "impl_name": "posix", 00:18:06.608 "recv_buf_size": 2097152, 00:18:06.608 "send_buf_size": 2097152, 00:18:06.608 "enable_recv_pipe": true, 00:18:06.608 "enable_quickack": false, 00:18:06.608 "enable_placement_id": 0, 00:18:06.608 "enable_zerocopy_send_server": true, 00:18:06.608 "enable_zerocopy_send_client": false, 00:18:06.608 "zerocopy_threshold": 0, 00:18:06.608 "tls_version": 0, 00:18:06.608 "enable_ktls": false 00:18:06.608 } 00:18:06.608 }, 00:18:06.608 { 00:18:06.608 "method": "sock_impl_set_options", 00:18:06.608 "params": { 00:18:06.608 "impl_name": "ssl", 00:18:06.608 "recv_buf_size": 4096, 00:18:06.608 "send_buf_size": 4096, 00:18:06.608 "enable_recv_pipe": true, 00:18:06.608 "enable_quickack": false, 00:18:06.608 "enable_placement_id": 0, 00:18:06.608 "enable_zerocopy_send_server": true, 00:18:06.608 "enable_zerocopy_send_client": false, 00:18:06.608 "zerocopy_threshold": 0, 00:18:06.608 "tls_version": 0, 00:18:06.608 "enable_ktls": false 00:18:06.608 } 00:18:06.608 } 00:18:06.608 ] 00:18:06.608 }, 00:18:06.608 { 00:18:06.608 "subsystem": "vmd", 00:18:06.608 "config": [] 00:18:06.608 }, 00:18:06.608 { 00:18:06.608 "subsystem": "accel", 00:18:06.608 "config": [ 00:18:06.608 { 00:18:06.608 "method": "accel_set_options", 00:18:06.608 "params": { 00:18:06.608 "small_cache_size": 128, 00:18:06.608 "large_cache_size": 16, 00:18:06.608 "task_count": 2048, 00:18:06.608 "sequence_count": 2048, 00:18:06.608 "buf_count": 2048 00:18:06.608 } 00:18:06.608 } 00:18:06.608 ] 00:18:06.608 }, 00:18:06.608 { 00:18:06.608 "subsystem": "bdev", 00:18:06.608 "config": [ 00:18:06.608 { 00:18:06.608 "method": "bdev_set_options", 00:18:06.608 "params": { 00:18:06.608 "bdev_io_pool_size": 65535, 00:18:06.608 "bdev_io_cache_size": 256, 00:18:06.608 "bdev_auto_examine": true, 00:18:06.608 "iobuf_small_cache_size": 128, 00:18:06.608 "iobuf_large_cache_size": 16 00:18:06.608 } 00:18:06.608 }, 00:18:06.608 { 00:18:06.608 "method": "bdev_raid_set_options", 00:18:06.608 "params": { 00:18:06.608 "process_window_size_kb": 1024 00:18:06.608 } 00:18:06.608 }, 00:18:06.608 { 00:18:06.608 "method": "bdev_iscsi_set_options", 00:18:06.608 "params": { 00:18:06.608 "timeout_sec": 30 00:18:06.608 } 00:18:06.608 }, 00:18:06.608 { 00:18:06.608 "method": "bdev_nvme_set_options", 00:18:06.608 "params": { 00:18:06.608 "action_on_timeout": "none", 00:18:06.608 "timeout_us": 0, 00:18:06.608 "timeout_admin_us": 0, 00:18:06.608 "keep_alive_timeout_ms": 10000, 00:18:06.608 "transport_retry_count": 4, 00:18:06.608 "arbitration_burst": 0, 00:18:06.608 "low_priority_weight": 0, 00:18:06.608 "medium_priority_weight": 0, 00:18:06.608 "high_priority_weight": 0, 00:18:06.608 "nvme_adminq_poll_period_us": 10000, 00:18:06.608 "nvme_ioq_poll_period_us": 0, 00:18:06.608 "io_queue_requests": 512, 00:18:06.608 "delay_cmd_submit": true, 00:18:06.608 "bdev_retry_count": 3, 00:18:06.608 "transport_ack_timeout": 0, 00:18:06.608 "ctrlr_loss_timeout_sec": 0, 00:18:06.608 "reconnect_delay_sec": 0, 00:18:06.608 "fast_io_fail_timeout_sec": 0, 00:18:06.608 "generate_uuids": false, 00:18:06.608 "transport_tos": 0, 00:18:06.608 "io_path_stat": false, 00:18:06.608 "allow_accel_sequence": false 00:18:06.608 } 00:18:06.608 }, 00:18:06.608 { 00:18:06.608 "method": "bdev_nvme_attach_controller", 00:18:06.608 "params": { 00:18:06.608 "name": "TLSTEST", 00:18:06.608 "trtype": "TCP", 00:18:06.608 "adrfam": "IPv4", 00:18:06.608 "traddr": "10.0.0.2", 00:18:06.608 "trsvcid": "4420", 00:18:06.608 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:06.608 "prchk_reftag": false, 00:18:06.608 "prchk_guard": false, 00:18:06.608 "ctrlr_loss_timeout_sec": 0, 00:18:06.608 "reconnect_delay_sec": 0, 00:18:06.608 "fast_io_fail_timeout_sec": 0, 00:18:06.608 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:18:06.608 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:06.608 "hdgst": false, 00:18:06.608 "ddgst": false 00:18:06.608 } 00:18:06.608 }, 00:18:06.608 { 00:18:06.608 "method": "bdev_nvme_set_hotplug", 00:18:06.608 "params": { 00:18:06.608 "period_us": 100000, 00:18:06.608 "enable": false 00:18:06.608 } 00:18:06.608 }, 00:18:06.608 { 00:18:06.608 "method": "bdev_wait_for_examine" 00:18:06.608 } 00:18:06.608 ] 00:18:06.608 }, 00:18:06.608 { 00:18:06.608 "subsystem": "nbd", 00:18:06.608 "config": [] 00:18:06.608 } 00:18:06.608 ] 00:18:06.608 }' 00:18:06.608 03:34:47 -- target/tls.sh@208 -- # killprocess 3074119 00:18:06.608 03:34:47 -- common/autotest_common.sh@936 -- # '[' -z 3074119 ']' 00:18:06.608 03:34:47 -- common/autotest_common.sh@940 -- # kill -0 3074119 00:18:06.608 03:34:47 -- common/autotest_common.sh@941 -- # uname 00:18:06.608 03:34:47 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:06.608 03:34:47 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3074119 00:18:06.608 03:34:47 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:18:06.608 03:34:47 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:18:06.608 03:34:47 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3074119' 00:18:06.608 killing process with pid 3074119 00:18:06.608 03:34:47 -- common/autotest_common.sh@955 -- # kill 3074119 00:18:06.608 Received shutdown signal, test time was about 10.000000 seconds 00:18:06.608 00:18:06.608 Latency(us) 00:18:06.608 [2024-11-21T02:34:47.256Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:06.608 [2024-11-21T02:34:47.256Z] =================================================================================================================== 00:18:06.608 [2024-11-21T02:34:47.256Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:18:06.608 03:34:47 -- common/autotest_common.sh@960 -- # wait 3074119 00:18:06.868 03:34:47 -- target/tls.sh@209 -- # killprocess 3073747 00:18:06.868 03:34:47 -- common/autotest_common.sh@936 -- # '[' -z 3073747 ']' 00:18:06.868 03:34:47 -- common/autotest_common.sh@940 -- # kill -0 3073747 00:18:06.868 03:34:47 -- common/autotest_common.sh@941 -- # uname 00:18:06.868 03:34:47 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:06.868 03:34:47 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3073747 00:18:06.868 03:34:47 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:06.868 03:34:47 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:06.868 03:34:47 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3073747' 00:18:06.868 killing process with pid 3073747 00:18:06.868 03:34:47 -- common/autotest_common.sh@955 -- # kill 3073747 00:18:06.868 03:34:47 -- common/autotest_common.sh@960 -- # wait 3073747 00:18:07.127 03:34:47 -- target/tls.sh@212 -- # nvmfappstart -m 0x2 -c /dev/fd/62 00:18:07.127 03:34:47 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:07.127 03:34:47 -- target/tls.sh@212 -- # echo '{ 00:18:07.127 "subsystems": [ 00:18:07.127 { 00:18:07.127 "subsystem": "iobuf", 00:18:07.127 "config": [ 00:18:07.127 { 00:18:07.127 "method": "iobuf_set_options", 00:18:07.127 "params": { 00:18:07.127 "small_pool_count": 8192, 00:18:07.127 "large_pool_count": 1024, 00:18:07.127 "small_bufsize": 8192, 00:18:07.127 "large_bufsize": 135168 00:18:07.127 } 00:18:07.127 } 00:18:07.127 ] 00:18:07.127 }, 00:18:07.127 { 00:18:07.127 "subsystem": "sock", 00:18:07.127 "config": [ 00:18:07.127 { 00:18:07.127 "method": "sock_impl_set_options", 00:18:07.127 "params": { 00:18:07.127 "impl_name": "posix", 00:18:07.127 "recv_buf_size": 2097152, 00:18:07.127 "send_buf_size": 2097152, 00:18:07.127 "enable_recv_pipe": true, 00:18:07.127 "enable_quickack": false, 00:18:07.127 "enable_placement_id": 0, 00:18:07.127 "enable_zerocopy_send_server": true, 00:18:07.127 "enable_zerocopy_send_client": false, 00:18:07.127 "zerocopy_threshold": 0, 00:18:07.127 "tls_version": 0, 00:18:07.127 "enable_ktls": false 00:18:07.127 } 00:18:07.127 }, 00:18:07.127 { 00:18:07.127 "method": "sock_impl_set_options", 00:18:07.127 "params": { 00:18:07.127 "impl_name": "ssl", 00:18:07.127 "recv_buf_size": 4096, 00:18:07.127 "send_buf_size": 4096, 00:18:07.127 "enable_recv_pipe": true, 00:18:07.127 "enable_quickack": false, 00:18:07.127 "enable_placement_id": 0, 00:18:07.127 "enable_zerocopy_send_server": true, 00:18:07.127 "enable_zerocopy_send_client": false, 00:18:07.127 "zerocopy_threshold": 0, 00:18:07.127 "tls_version": 0, 00:18:07.127 "enable_ktls": false 00:18:07.127 } 00:18:07.127 } 00:18:07.127 ] 00:18:07.127 }, 00:18:07.127 { 00:18:07.127 "subsystem": "vmd", 00:18:07.127 "config": [] 00:18:07.127 }, 00:18:07.127 { 00:18:07.127 "subsystem": "accel", 00:18:07.127 "config": [ 00:18:07.127 { 00:18:07.127 "method": "accel_set_options", 00:18:07.127 "params": { 00:18:07.127 "small_cache_size": 128, 00:18:07.127 "large_cache_size": 16, 00:18:07.127 "task_count": 2048, 00:18:07.127 "sequence_count": 2048, 00:18:07.127 "buf_count": 2048 00:18:07.127 } 00:18:07.127 } 00:18:07.127 ] 00:18:07.127 }, 00:18:07.127 { 00:18:07.127 "subsystem": "bdev", 00:18:07.127 "config": [ 00:18:07.127 { 00:18:07.127 "method": "bdev_set_options", 00:18:07.127 "params": { 00:18:07.127 "bdev_io_pool_size": 65535, 00:18:07.128 "bdev_io_cache_size": 256, 00:18:07.128 "bdev_auto_examine": true, 00:18:07.128 "iobuf_small_cache_size": 128, 00:18:07.128 "iobuf_large_cache_size": 16 00:18:07.128 } 00:18:07.128 }, 00:18:07.128 { 00:18:07.128 "method": "bdev_raid_set_options", 00:18:07.128 "params": { 00:18:07.128 "process_window_size_kb": 1024 00:18:07.128 } 00:18:07.128 }, 00:18:07.128 { 00:18:07.128 "method": "bdev_iscsi_set_options", 00:18:07.128 "params": { 00:18:07.128 "timeout_sec": 30 00:18:07.128 } 00:18:07.128 }, 00:18:07.128 { 00:18:07.128 "method": "bdev_nvme_set_options", 00:18:07.128 "params": { 00:18:07.128 "action_on_timeout": "none", 00:18:07.128 "timeout_us": 0, 00:18:07.128 "timeout_admin_us": 0, 00:18:07.128 "keep_alive_timeout_ms": 10000, 00:18:07.128 "transport_retry_count": 4, 00:18:07.128 "arbitration_burst": 0, 00:18:07.128 "low_priority_weight": 0, 00:18:07.128 "medium_priority_weight": 0, 00:18:07.128 "high_priority_weight": 0, 00:18:07.128 "nvme_adminq_poll_period_us": 10000, 00:18:07.128 "nvme_ioq_poll_period_us": 0, 00:18:07.128 "io_queue_requests": 0, 00:18:07.128 "delay_cmd_submit": true, 00:18:07.128 "bdev_retry_count": 3, 00:18:07.128 "transport_ack_timeout": 0, 00:18:07.128 "ctrlr_loss_timeout_sec": 0, 00:18:07.128 "reconnect_delay_sec": 0, 00:18:07.128 "fast_io_fail_timeout_sec": 0, 00:18:07.128 "generate_uuids": false, 00:18:07.128 "transport_tos": 0, 00:18:07.128 "io_path_stat": false, 00:18:07.128 "allow_accel_sequence": false 00:18:07.128 } 00:18:07.128 }, 00:18:07.128 { 00:18:07.128 "method": "bdev_nvme_set_hotplug", 00:18:07.128 "params": { 00:18:07.128 "period_us": 100000, 00:18:07.128 "enable": false 00:18:07.128 } 00:18:07.128 }, 00:18:07.128 { 00:18:07.128 "method": "bdev_malloc_create", 00:18:07.128 "params": { 00:18:07.128 "name": "malloc0", 00:18:07.128 "num_blocks": 8192, 00:18:07.128 "block_size": 4096, 00:18:07.128 "physical_block_size": 4096, 00:18:07.128 "uuid": "9b5a86cb-1bcf-4c91-b5c2-519251f1bfa5", 00:18:07.128 "optimal_io_boundary": 0 00:18:07.128 } 00:18:07.128 }, 00:18:07.128 { 00:18:07.128 "method": "bdev_wait_for_examine" 00:18:07.128 } 00:18:07.128 ] 00:18:07.128 }, 00:18:07.128 { 00:18:07.128 "subsystem": "nbd", 00:18:07.128 "config": [] 00:18:07.128 }, 00:18:07.128 { 00:18:07.128 "subsystem": "scheduler", 00:18:07.128 "config": [ 00:18:07.128 { 00:18:07.128 "method": "framework_set_scheduler", 00:18:07.128 "params": { 00:18:07.128 "name": "static" 00:18:07.128 } 00:18:07.128 } 00:18:07.128 ] 00:18:07.128 }, 00:18:07.128 { 00:18:07.128 "subsystem": "nvmf", 00:18:07.128 "config": [ 00:18:07.128 { 00:18:07.128 "method": "nvmf_set_config", 00:18:07.128 "params": { 00:18:07.128 "discovery_filter": "match_any", 00:18:07.128 "admin_cmd_passthru": { 00:18:07.128 "identify_ctrlr": false 00:18:07.128 } 00:18:07.128 } 00:18:07.128 }, 00:18:07.128 { 00:18:07.128 "method": "nvmf_set_max_subsystems", 00:18:07.128 "params": { 00:18:07.128 "max_subsystems": 1024 00:18:07.128 } 00:18:07.128 }, 00:18:07.128 { 00:18:07.128 "method": "nvmf_set_crdt", 00:18:07.128 "params": { 00:18:07.128 "crdt1": 0, 00:18:07.128 "crdt2": 0, 00:18:07.128 "crdt3": 0 00:18:07.128 } 00:18:07.128 }, 00:18:07.128 { 00:18:07.128 "method": "nvmf_create_transport", 00:18:07.128 "params": { 00:18:07.128 "trtype": "TCP", 00:18:07.128 "max_queue_depth": 128, 00:18:07.128 "max_io_qpairs_per_ctrlr": 127, 00:18:07.128 "in_capsule_data_size": 4096, 00:18:07.128 "max_io_size": 131072, 00:18:07.128 "io_unit_size": 131072, 00:18:07.128 "max_aq_depth": 128, 00:18:07.128 "num_shared_buffers": 511, 00:18:07.128 "buf_cache_size": 4294967295, 00:18:07.128 "dif_insert_or_strip": false, 00:18:07.128 "zcopy": false, 00:18:07.128 "c2h_success": false, 00:18:07.128 "sock_priority": 0, 00:18:07.128 "abort_timeout_sec": 1 00:18:07.128 } 00:18:07.128 }, 00:18:07.128 { 00:18:07.128 "method": "nvmf_create_subsystem", 00:18:07.128 "params": { 00:18:07.128 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:07.128 "allow_any_host": false, 00:18:07.128 "serial_number": "SPDK00000000000001", 00:18:07.128 "model_number": "SPDK bdev Controller", 00:18:07.128 "max_namespaces": 10, 00:18:07.128 "min_cntlid": 1, 00:18:07.128 "max_cntlid": 65519, 00:18:07.128 "ana_reporting": false 00:18:07.128 } 00:18:07.128 }, 00:18:07.128 { 00:18:07.128 "method": "nvmf_subsystem_add_host", 00:18:07.128 "params": { 00:18:07.128 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:07.128 "host": "nqn.2016-06.io.spdk:host1", 00:18:07.128 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:18:07.128 } 00:18:07.128 }, 00:18:07.128 { 00:18:07.128 "method": "nvmf_subsystem_add_ns", 00:18:07.128 "params": { 00:18:07.128 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:07.128 "namespace": { 00:18:07.128 "nsid": 1, 00:18:07.128 "bdev_name": "malloc0", 00:18:07.128 "nguid": "9B5A86CB1BCF4C91B5C2519251F1BFA5", 00:18:07.128 "uuid": "9b5a86cb-1bcf-4c91-b5c2-519251f1bfa5" 00:18:07.128 } 00:18:07.128 } 00:18:07.128 }, 00:18:07.128 { 00:18:07.128 "method": "nvmf_subsystem_add_listener", 00:18:07.128 "params": { 00:18:07.128 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:07.128 "listen_address": { 00:18:07.128 "trtype": "TCP", 00:18:07.128 "adrfam": "IPv4", 00:18:07.128 "traddr": "10.0.0.2", 00:18:07.128 "trsvcid": "4420" 00:18:07.128 }, 00:18:07.128 "secure_channel": true 00:18:07.128 } 00:18:07.128 } 00:18:07.128 ] 00:18:07.128 } 00:18:07.128 ] 00:18:07.128 }' 00:18:07.128 03:34:47 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:07.128 03:34:47 -- common/autotest_common.sh@10 -- # set +x 00:18:07.128 03:34:47 -- nvmf/common.sh@469 -- # nvmfpid=3074468 00:18:07.128 03:34:47 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 -c /dev/fd/62 00:18:07.128 03:34:47 -- nvmf/common.sh@470 -- # waitforlisten 3074468 00:18:07.128 03:34:47 -- common/autotest_common.sh@829 -- # '[' -z 3074468 ']' 00:18:07.128 03:34:47 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:07.128 03:34:47 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:07.128 03:34:47 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:07.128 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:07.128 03:34:47 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:07.128 03:34:47 -- common/autotest_common.sh@10 -- # set +x 00:18:07.389 [2024-11-21 03:34:47.790760] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:07.389 [2024-11-21 03:34:47.790849] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:07.389 EAL: No free 2048 kB hugepages reported on node 1 00:18:07.389 [2024-11-21 03:34:47.852805] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:07.389 [2024-11-21 03:34:47.961272] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:07.389 [2024-11-21 03:34:47.961429] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:07.389 [2024-11-21 03:34:47.961444] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:07.389 [2024-11-21 03:34:47.961457] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:07.389 [2024-11-21 03:34:47.961485] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:07.650 [2024-11-21 03:34:48.193065] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:07.650 [2024-11-21 03:34:48.225093] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:18:07.650 [2024-11-21 03:34:48.225407] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:08.218 03:34:48 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:08.218 03:34:48 -- common/autotest_common.sh@862 -- # return 0 00:18:08.218 03:34:48 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:08.218 03:34:48 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:08.218 03:34:48 -- common/autotest_common.sh@10 -- # set +x 00:18:08.218 03:34:48 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:08.218 03:34:48 -- target/tls.sh@216 -- # bdevperf_pid=3074620 00:18:08.218 03:34:48 -- target/tls.sh@217 -- # waitforlisten 3074620 /var/tmp/bdevperf.sock 00:18:08.218 03:34:48 -- common/autotest_common.sh@829 -- # '[' -z 3074620 ']' 00:18:08.218 03:34:48 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:08.218 03:34:48 -- target/tls.sh@213 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 -c /dev/fd/63 00:18:08.218 03:34:48 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:08.218 03:34:48 -- target/tls.sh@213 -- # echo '{ 00:18:08.218 "subsystems": [ 00:18:08.218 { 00:18:08.218 "subsystem": "iobuf", 00:18:08.218 "config": [ 00:18:08.218 { 00:18:08.218 "method": "iobuf_set_options", 00:18:08.218 "params": { 00:18:08.218 "small_pool_count": 8192, 00:18:08.218 "large_pool_count": 1024, 00:18:08.218 "small_bufsize": 8192, 00:18:08.218 "large_bufsize": 135168 00:18:08.218 } 00:18:08.218 } 00:18:08.218 ] 00:18:08.218 }, 00:18:08.218 { 00:18:08.218 "subsystem": "sock", 00:18:08.218 "config": [ 00:18:08.218 { 00:18:08.218 "method": "sock_impl_set_options", 00:18:08.218 "params": { 00:18:08.218 "impl_name": "posix", 00:18:08.218 "recv_buf_size": 2097152, 00:18:08.218 "send_buf_size": 2097152, 00:18:08.218 "enable_recv_pipe": true, 00:18:08.218 "enable_quickack": false, 00:18:08.218 "enable_placement_id": 0, 00:18:08.218 "enable_zerocopy_send_server": true, 00:18:08.218 "enable_zerocopy_send_client": false, 00:18:08.218 "zerocopy_threshold": 0, 00:18:08.218 "tls_version": 0, 00:18:08.218 "enable_ktls": false 00:18:08.218 } 00:18:08.218 }, 00:18:08.218 { 00:18:08.218 "method": "sock_impl_set_options", 00:18:08.218 "params": { 00:18:08.218 "impl_name": "ssl", 00:18:08.218 "recv_buf_size": 4096, 00:18:08.218 "send_buf_size": 4096, 00:18:08.218 "enable_recv_pipe": true, 00:18:08.218 "enable_quickack": false, 00:18:08.218 "enable_placement_id": 0, 00:18:08.218 "enable_zerocopy_send_server": true, 00:18:08.218 "enable_zerocopy_send_client": false, 00:18:08.218 "zerocopy_threshold": 0, 00:18:08.218 "tls_version": 0, 00:18:08.218 "enable_ktls": false 00:18:08.218 } 00:18:08.218 } 00:18:08.218 ] 00:18:08.218 }, 00:18:08.218 { 00:18:08.218 "subsystem": "vmd", 00:18:08.218 "config": [] 00:18:08.218 }, 00:18:08.218 { 00:18:08.218 "subsystem": "accel", 00:18:08.218 "config": [ 00:18:08.218 { 00:18:08.218 "method": "accel_set_options", 00:18:08.218 "params": { 00:18:08.218 "small_cache_size": 128, 00:18:08.218 "large_cache_size": 16, 00:18:08.218 "task_count": 2048, 00:18:08.218 "sequence_count": 2048, 00:18:08.218 "buf_count": 2048 00:18:08.218 } 00:18:08.218 } 00:18:08.218 ] 00:18:08.218 }, 00:18:08.218 { 00:18:08.218 "subsystem": "bdev", 00:18:08.218 "config": [ 00:18:08.218 { 00:18:08.218 "method": "bdev_set_options", 00:18:08.218 "params": { 00:18:08.218 "bdev_io_pool_size": 65535, 00:18:08.218 "bdev_io_cache_size": 256, 00:18:08.218 "bdev_auto_examine": true, 00:18:08.218 "iobuf_small_cache_size": 128, 00:18:08.218 "iobuf_large_cache_size": 16 00:18:08.218 } 00:18:08.218 }, 00:18:08.218 { 00:18:08.218 "method": "bdev_raid_set_options", 00:18:08.218 "params": { 00:18:08.218 "process_window_size_kb": 1024 00:18:08.218 } 00:18:08.218 }, 00:18:08.218 { 00:18:08.218 "method": "bdev_iscsi_set_options", 00:18:08.218 "params": { 00:18:08.218 "timeout_sec": 30 00:18:08.218 } 00:18:08.218 }, 00:18:08.218 { 00:18:08.218 "method": "bdev_nvme_set_options", 00:18:08.218 "params": { 00:18:08.218 "action_on_timeout": "none", 00:18:08.218 "timeout_us": 0, 00:18:08.218 "timeout_admin_us": 0, 00:18:08.218 "keep_alive_timeout_ms": 10000, 00:18:08.218 "transport_retry_count": 4, 00:18:08.218 "arbitration_burst": 0, 00:18:08.218 "low_priority_weight": 0, 00:18:08.218 "medium_priority_weight": 0, 00:18:08.218 "high_priority_weight": 0, 00:18:08.218 "nvme_adminq_poll_period_us": 10000, 00:18:08.218 "nvme_ioq_poll_period_us": 0, 00:18:08.218 "io_queue_requests": 512, 00:18:08.218 "delay_cmd_submit": true, 00:18:08.218 "bdev_retry_count": 3, 00:18:08.218 "transport_ack_timeout": 0, 00:18:08.218 "ctrlr_loss_timeout_sec": 0, 00:18:08.218 "reconnect_delay_sec": 0, 00:18:08.218 "fast_io_fail_timeout_sec": 0, 00:18:08.218 "generate_uuids": false, 00:18:08.218 "transport_tos": 0, 00:18:08.218 "io_path_stat": false, 00:18:08.218 "allow_accel_sequence": false 00:18:08.218 } 00:18:08.218 }, 00:18:08.218 { 00:18:08.218 "method": "bdev_nvme_attach_controller", 00:18:08.218 "params": { 00:18:08.218 "name": "TLSTEST", 00:18:08.219 "trtype": "TCP", 00:18:08.219 "adrfam": "IPv4", 00:18:08.219 "traddr": "10.0.0.2", 00:18:08.219 "trsvcid": "4420", 00:18:08.219 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:08.219 "prchk_reftag": false, 00:18:08.219 "prchk_guard": false, 00:18:08.219 "ctrlr_loss_timeout_sec": 0, 00:18:08.219 "reconnect_delay_sec": 0, 00:18:08.219 "fast_io_fail_timeout_sec": 0, 00:18:08.219 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:18:08.219 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:08.219 "hdgst": false, 00:18:08.219 "ddgst": false 00:18:08.219 } 00:18:08.219 }, 00:18:08.219 { 00:18:08.219 "method": "bdev_nvme_set_hotplug", 00:18:08.219 "params": { 00:18:08.219 "period_us": 100000, 00:18:08.219 "enable": false 00:18:08.219 } 00:18:08.219 }, 00:18:08.219 { 00:18:08.219 "method": "bdev_wait_for_examine" 00:18:08.219 } 00:18:08.219 ] 00:18:08.219 }, 00:18:08.219 { 00:18:08.219 "subsystem": "nbd", 00:18:08.219 "config": [] 00:18:08.219 } 00:18:08.219 ] 00:18:08.219 }' 00:18:08.219 03:34:48 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:08.219 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:08.219 03:34:48 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:08.219 03:34:48 -- common/autotest_common.sh@10 -- # set +x 00:18:08.219 [2024-11-21 03:34:48.823918] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:08.219 [2024-11-21 03:34:48.823992] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3074620 ] 00:18:08.219 EAL: No free 2048 kB hugepages reported on node 1 00:18:08.478 [2024-11-21 03:34:48.882016] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:08.478 [2024-11-21 03:34:48.988731] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:08.737 [2024-11-21 03:34:49.154852] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:18:09.301 03:34:49 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:09.301 03:34:49 -- common/autotest_common.sh@862 -- # return 0 00:18:09.301 03:34:49 -- target/tls.sh@220 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:18:09.301 Running I/O for 10 seconds... 00:18:21.495 00:18:21.495 Latency(us) 00:18:21.495 [2024-11-21T02:35:02.143Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:21.495 [2024-11-21T02:35:02.143Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:18:21.495 Verification LBA range: start 0x0 length 0x2000 00:18:21.495 TLSTESTn1 : 10.02 4433.16 17.32 0.00 0.00 28834.95 4927.34 46020.84 00:18:21.495 [2024-11-21T02:35:02.143Z] =================================================================================================================== 00:18:21.495 [2024-11-21T02:35:02.143Z] Total : 4433.16 17.32 0.00 0.00 28834.95 4927.34 46020.84 00:18:21.495 0 00:18:21.495 03:34:59 -- target/tls.sh@222 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:18:21.495 03:34:59 -- target/tls.sh@223 -- # killprocess 3074620 00:18:21.495 03:34:59 -- common/autotest_common.sh@936 -- # '[' -z 3074620 ']' 00:18:21.495 03:34:59 -- common/autotest_common.sh@940 -- # kill -0 3074620 00:18:21.495 03:34:59 -- common/autotest_common.sh@941 -- # uname 00:18:21.495 03:34:59 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:21.495 03:34:59 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3074620 00:18:21.495 03:35:00 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:18:21.495 03:35:00 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:18:21.495 03:35:00 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3074620' 00:18:21.495 killing process with pid 3074620 00:18:21.495 03:35:00 -- common/autotest_common.sh@955 -- # kill 3074620 00:18:21.495 Received shutdown signal, test time was about 10.000000 seconds 00:18:21.495 00:18:21.495 Latency(us) 00:18:21.495 [2024-11-21T02:35:02.143Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:21.495 [2024-11-21T02:35:02.143Z] =================================================================================================================== 00:18:21.495 [2024-11-21T02:35:02.143Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:21.495 03:35:00 -- common/autotest_common.sh@960 -- # wait 3074620 00:18:21.495 03:35:00 -- target/tls.sh@224 -- # killprocess 3074468 00:18:21.495 03:35:00 -- common/autotest_common.sh@936 -- # '[' -z 3074468 ']' 00:18:21.495 03:35:00 -- common/autotest_common.sh@940 -- # kill -0 3074468 00:18:21.495 03:35:00 -- common/autotest_common.sh@941 -- # uname 00:18:21.495 03:35:00 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:21.495 03:35:00 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3074468 00:18:21.495 03:35:00 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:21.495 03:35:00 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:21.495 03:35:00 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3074468' 00:18:21.495 killing process with pid 3074468 00:18:21.495 03:35:00 -- common/autotest_common.sh@955 -- # kill 3074468 00:18:21.495 03:35:00 -- common/autotest_common.sh@960 -- # wait 3074468 00:18:21.495 03:35:00 -- target/tls.sh@226 -- # trap - SIGINT SIGTERM EXIT 00:18:21.495 03:35:00 -- target/tls.sh@227 -- # cleanup 00:18:21.495 03:35:00 -- target/tls.sh@15 -- # process_shm --id 0 00:18:21.495 03:35:00 -- common/autotest_common.sh@806 -- # type=--id 00:18:21.495 03:35:00 -- common/autotest_common.sh@807 -- # id=0 00:18:21.495 03:35:00 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:18:21.495 03:35:00 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:18:21.495 03:35:00 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:18:21.495 03:35:00 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:18:21.495 03:35:00 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:18:21.495 03:35:00 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:18:21.495 nvmf_trace.0 00:18:21.495 03:35:00 -- common/autotest_common.sh@821 -- # return 0 00:18:21.495 03:35:00 -- target/tls.sh@16 -- # killprocess 3074620 00:18:21.495 03:35:00 -- common/autotest_common.sh@936 -- # '[' -z 3074620 ']' 00:18:21.495 03:35:00 -- common/autotest_common.sh@940 -- # kill -0 3074620 00:18:21.495 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (3074620) - No such process 00:18:21.495 03:35:00 -- common/autotest_common.sh@963 -- # echo 'Process with pid 3074620 is not found' 00:18:21.495 Process with pid 3074620 is not found 00:18:21.495 03:35:00 -- target/tls.sh@17 -- # nvmftestfini 00:18:21.495 03:35:00 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:21.495 03:35:00 -- nvmf/common.sh@116 -- # sync 00:18:21.495 03:35:00 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:21.495 03:35:00 -- nvmf/common.sh@119 -- # set +e 00:18:21.495 03:35:00 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:21.495 03:35:00 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:21.495 rmmod nvme_tcp 00:18:21.495 rmmod nvme_fabrics 00:18:21.495 rmmod nvme_keyring 00:18:21.495 03:35:00 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:21.495 03:35:00 -- nvmf/common.sh@123 -- # set -e 00:18:21.495 03:35:00 -- nvmf/common.sh@124 -- # return 0 00:18:21.495 03:35:00 -- nvmf/common.sh@477 -- # '[' -n 3074468 ']' 00:18:21.495 03:35:00 -- nvmf/common.sh@478 -- # killprocess 3074468 00:18:21.495 03:35:00 -- common/autotest_common.sh@936 -- # '[' -z 3074468 ']' 00:18:21.495 03:35:00 -- common/autotest_common.sh@940 -- # kill -0 3074468 00:18:21.495 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (3074468) - No such process 00:18:21.495 03:35:00 -- common/autotest_common.sh@963 -- # echo 'Process with pid 3074468 is not found' 00:18:21.495 Process with pid 3074468 is not found 00:18:21.495 03:35:00 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:21.495 03:35:00 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:21.495 03:35:00 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:21.495 03:35:00 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:21.495 03:35:00 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:21.495 03:35:00 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:21.495 03:35:00 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:21.495 03:35:00 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:22.433 03:35:02 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:22.433 03:35:02 -- target/tls.sh@18 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:22.433 00:18:22.433 real 1m15.916s 00:18:22.433 user 1m58.154s 00:18:22.433 sys 0m24.354s 00:18:22.433 03:35:02 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:22.433 03:35:02 -- common/autotest_common.sh@10 -- # set +x 00:18:22.433 ************************************ 00:18:22.433 END TEST nvmf_tls 00:18:22.433 ************************************ 00:18:22.433 03:35:02 -- nvmf/nvmf.sh@60 -- # run_test nvmf_fips /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:18:22.433 03:35:02 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:22.433 03:35:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:22.433 03:35:02 -- common/autotest_common.sh@10 -- # set +x 00:18:22.433 ************************************ 00:18:22.433 START TEST nvmf_fips 00:18:22.433 ************************************ 00:18:22.433 03:35:02 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:18:22.433 * Looking for test storage... 00:18:22.433 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips 00:18:22.433 03:35:02 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:22.434 03:35:02 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:22.434 03:35:02 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:22.434 03:35:02 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:22.434 03:35:02 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:22.434 03:35:02 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:22.434 03:35:02 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:22.434 03:35:02 -- scripts/common.sh@335 -- # IFS=.-: 00:18:22.434 03:35:02 -- scripts/common.sh@335 -- # read -ra ver1 00:18:22.434 03:35:02 -- scripts/common.sh@336 -- # IFS=.-: 00:18:22.434 03:35:02 -- scripts/common.sh@336 -- # read -ra ver2 00:18:22.434 03:35:02 -- scripts/common.sh@337 -- # local 'op=<' 00:18:22.434 03:35:02 -- scripts/common.sh@339 -- # ver1_l=2 00:18:22.434 03:35:02 -- scripts/common.sh@340 -- # ver2_l=1 00:18:22.434 03:35:02 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:22.434 03:35:02 -- scripts/common.sh@343 -- # case "$op" in 00:18:22.434 03:35:02 -- scripts/common.sh@344 -- # : 1 00:18:22.434 03:35:02 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:22.434 03:35:02 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:22.434 03:35:02 -- scripts/common.sh@364 -- # decimal 1 00:18:22.434 03:35:02 -- scripts/common.sh@352 -- # local d=1 00:18:22.434 03:35:02 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:22.434 03:35:02 -- scripts/common.sh@354 -- # echo 1 00:18:22.434 03:35:02 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:22.434 03:35:02 -- scripts/common.sh@365 -- # decimal 2 00:18:22.434 03:35:02 -- scripts/common.sh@352 -- # local d=2 00:18:22.434 03:35:02 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:22.434 03:35:02 -- scripts/common.sh@354 -- # echo 2 00:18:22.434 03:35:02 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:22.434 03:35:02 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:22.434 03:35:02 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:22.434 03:35:02 -- scripts/common.sh@367 -- # return 0 00:18:22.434 03:35:02 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:22.434 03:35:02 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:22.434 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:22.434 --rc genhtml_branch_coverage=1 00:18:22.434 --rc genhtml_function_coverage=1 00:18:22.434 --rc genhtml_legend=1 00:18:22.434 --rc geninfo_all_blocks=1 00:18:22.434 --rc geninfo_unexecuted_blocks=1 00:18:22.434 00:18:22.434 ' 00:18:22.434 03:35:02 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:22.434 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:22.434 --rc genhtml_branch_coverage=1 00:18:22.434 --rc genhtml_function_coverage=1 00:18:22.434 --rc genhtml_legend=1 00:18:22.434 --rc geninfo_all_blocks=1 00:18:22.434 --rc geninfo_unexecuted_blocks=1 00:18:22.434 00:18:22.434 ' 00:18:22.434 03:35:02 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:22.434 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:22.434 --rc genhtml_branch_coverage=1 00:18:22.434 --rc genhtml_function_coverage=1 00:18:22.434 --rc genhtml_legend=1 00:18:22.434 --rc geninfo_all_blocks=1 00:18:22.434 --rc geninfo_unexecuted_blocks=1 00:18:22.434 00:18:22.434 ' 00:18:22.434 03:35:02 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:22.434 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:22.434 --rc genhtml_branch_coverage=1 00:18:22.434 --rc genhtml_function_coverage=1 00:18:22.434 --rc genhtml_legend=1 00:18:22.434 --rc geninfo_all_blocks=1 00:18:22.434 --rc geninfo_unexecuted_blocks=1 00:18:22.434 00:18:22.434 ' 00:18:22.434 03:35:02 -- fips/fips.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:22.434 03:35:02 -- nvmf/common.sh@7 -- # uname -s 00:18:22.434 03:35:02 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:22.434 03:35:02 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:22.434 03:35:02 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:22.434 03:35:02 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:22.434 03:35:02 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:22.434 03:35:02 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:22.434 03:35:02 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:22.434 03:35:02 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:22.434 03:35:02 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:22.434 03:35:02 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:22.434 03:35:02 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:22.434 03:35:02 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:22.434 03:35:02 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:22.434 03:35:02 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:22.434 03:35:02 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:22.434 03:35:02 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:22.434 03:35:02 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:22.434 03:35:02 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:22.434 03:35:02 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:22.434 03:35:02 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:22.434 03:35:02 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:22.434 03:35:02 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:22.434 03:35:02 -- paths/export.sh@5 -- # export PATH 00:18:22.434 03:35:02 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:22.434 03:35:02 -- nvmf/common.sh@46 -- # : 0 00:18:22.434 03:35:02 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:22.434 03:35:02 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:22.434 03:35:02 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:22.434 03:35:02 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:22.434 03:35:02 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:22.434 03:35:02 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:22.434 03:35:02 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:22.434 03:35:02 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:22.434 03:35:02 -- fips/fips.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:22.434 03:35:02 -- fips/fips.sh@89 -- # check_openssl_version 00:18:22.434 03:35:02 -- fips/fips.sh@83 -- # local target=3.0.0 00:18:22.435 03:35:02 -- fips/fips.sh@85 -- # openssl version 00:18:22.435 03:35:02 -- fips/fips.sh@85 -- # awk '{print $2}' 00:18:22.435 03:35:02 -- fips/fips.sh@85 -- # ge 3.1.1 3.0.0 00:18:22.435 03:35:02 -- scripts/common.sh@375 -- # cmp_versions 3.1.1 '>=' 3.0.0 00:18:22.435 03:35:02 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:22.435 03:35:02 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:22.435 03:35:02 -- scripts/common.sh@335 -- # IFS=.-: 00:18:22.435 03:35:02 -- scripts/common.sh@335 -- # read -ra ver1 00:18:22.435 03:35:02 -- scripts/common.sh@336 -- # IFS=.-: 00:18:22.435 03:35:02 -- scripts/common.sh@336 -- # read -ra ver2 00:18:22.435 03:35:02 -- scripts/common.sh@337 -- # local 'op=>=' 00:18:22.435 03:35:02 -- scripts/common.sh@339 -- # ver1_l=3 00:18:22.435 03:35:02 -- scripts/common.sh@340 -- # ver2_l=3 00:18:22.435 03:35:02 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:22.435 03:35:02 -- scripts/common.sh@343 -- # case "$op" in 00:18:22.435 03:35:02 -- scripts/common.sh@347 -- # : 1 00:18:22.435 03:35:02 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:22.435 03:35:02 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:22.435 03:35:02 -- scripts/common.sh@364 -- # decimal 3 00:18:22.435 03:35:02 -- scripts/common.sh@352 -- # local d=3 00:18:22.435 03:35:02 -- scripts/common.sh@353 -- # [[ 3 =~ ^[0-9]+$ ]] 00:18:22.435 03:35:02 -- scripts/common.sh@354 -- # echo 3 00:18:22.435 03:35:02 -- scripts/common.sh@364 -- # ver1[v]=3 00:18:22.435 03:35:02 -- scripts/common.sh@365 -- # decimal 3 00:18:22.435 03:35:02 -- scripts/common.sh@352 -- # local d=3 00:18:22.435 03:35:02 -- scripts/common.sh@353 -- # [[ 3 =~ ^[0-9]+$ ]] 00:18:22.435 03:35:02 -- scripts/common.sh@354 -- # echo 3 00:18:22.435 03:35:02 -- scripts/common.sh@365 -- # ver2[v]=3 00:18:22.435 03:35:02 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:22.435 03:35:02 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:22.435 03:35:02 -- scripts/common.sh@363 -- # (( v++ )) 00:18:22.435 03:35:02 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:22.435 03:35:02 -- scripts/common.sh@364 -- # decimal 1 00:18:22.435 03:35:02 -- scripts/common.sh@352 -- # local d=1 00:18:22.435 03:35:02 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:22.435 03:35:02 -- scripts/common.sh@354 -- # echo 1 00:18:22.435 03:35:02 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:22.435 03:35:02 -- scripts/common.sh@365 -- # decimal 0 00:18:22.435 03:35:02 -- scripts/common.sh@352 -- # local d=0 00:18:22.435 03:35:02 -- scripts/common.sh@353 -- # [[ 0 =~ ^[0-9]+$ ]] 00:18:22.435 03:35:02 -- scripts/common.sh@354 -- # echo 0 00:18:22.435 03:35:02 -- scripts/common.sh@365 -- # ver2[v]=0 00:18:22.435 03:35:02 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:22.435 03:35:02 -- scripts/common.sh@366 -- # return 0 00:18:22.435 03:35:02 -- fips/fips.sh@95 -- # openssl info -modulesdir 00:18:22.435 03:35:02 -- fips/fips.sh@95 -- # [[ ! -f /usr/lib64/ossl-modules/fips.so ]] 00:18:22.435 03:35:02 -- fips/fips.sh@100 -- # openssl fipsinstall -help 00:18:22.435 03:35:02 -- fips/fips.sh@100 -- # warn='This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode' 00:18:22.435 03:35:02 -- fips/fips.sh@101 -- # [[ This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode == \T\h\i\s\ \c\o\m\m\a\n\d\ \i\s\ \n\o\t\ \e\n\a\b\l\e\d* ]] 00:18:22.435 03:35:02 -- fips/fips.sh@104 -- # export callback=build_openssl_config 00:18:22.435 03:35:02 -- fips/fips.sh@104 -- # callback=build_openssl_config 00:18:22.435 03:35:02 -- fips/fips.sh@113 -- # build_openssl_config 00:18:22.435 03:35:02 -- fips/fips.sh@37 -- # cat 00:18:22.435 03:35:02 -- fips/fips.sh@57 -- # [[ ! -t 0 ]] 00:18:22.435 03:35:02 -- fips/fips.sh@58 -- # cat - 00:18:22.435 03:35:02 -- fips/fips.sh@114 -- # export OPENSSL_CONF=spdk_fips.conf 00:18:22.435 03:35:02 -- fips/fips.sh@114 -- # OPENSSL_CONF=spdk_fips.conf 00:18:22.435 03:35:02 -- fips/fips.sh@116 -- # mapfile -t providers 00:18:22.435 03:35:02 -- fips/fips.sh@116 -- # openssl list -providers 00:18:22.435 03:35:02 -- fips/fips.sh@116 -- # grep name 00:18:22.435 03:35:03 -- fips/fips.sh@120 -- # (( 2 != 2 )) 00:18:22.435 03:35:03 -- fips/fips.sh@120 -- # [[ name: openssl base provider != *base* ]] 00:18:22.435 03:35:03 -- fips/fips.sh@120 -- # [[ name: red hat enterprise linux 9 - openssl fips provider != *fips* ]] 00:18:22.435 03:35:03 -- fips/fips.sh@127 -- # NOT openssl md5 /dev/fd/62 00:18:22.435 03:35:03 -- fips/fips.sh@127 -- # : 00:18:22.435 03:35:03 -- common/autotest_common.sh@650 -- # local es=0 00:18:22.435 03:35:03 -- common/autotest_common.sh@652 -- # valid_exec_arg openssl md5 /dev/fd/62 00:18:22.435 03:35:03 -- common/autotest_common.sh@638 -- # local arg=openssl 00:18:22.435 03:35:03 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:22.435 03:35:03 -- common/autotest_common.sh@642 -- # type -t openssl 00:18:22.435 03:35:03 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:22.435 03:35:03 -- common/autotest_common.sh@644 -- # type -P openssl 00:18:22.435 03:35:03 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:22.435 03:35:03 -- common/autotest_common.sh@644 -- # arg=/usr/bin/openssl 00:18:22.435 03:35:03 -- common/autotest_common.sh@644 -- # [[ -x /usr/bin/openssl ]] 00:18:22.435 03:35:03 -- common/autotest_common.sh@653 -- # openssl md5 /dev/fd/62 00:18:22.435 Error setting digest 00:18:22.435 40B221FBFC7E0000:error:0308010C:digital envelope routines:inner_evp_generic_fetch:unsupported:crypto/evp/evp_fetch.c:341:Global default library context, Algorithm (MD5 : 95), Properties () 00:18:22.435 40B221FBFC7E0000:error:03000086:digital envelope routines:evp_md_init_internal:initialization error:crypto/evp/digest.c:272: 00:18:22.435 03:35:03 -- common/autotest_common.sh@653 -- # es=1 00:18:22.435 03:35:03 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:18:22.435 03:35:03 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:18:22.435 03:35:03 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:18:22.435 03:35:03 -- fips/fips.sh@130 -- # nvmftestinit 00:18:22.435 03:35:03 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:22.435 03:35:03 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:22.435 03:35:03 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:22.435 03:35:03 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:22.435 03:35:03 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:22.435 03:35:03 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:22.435 03:35:03 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:22.435 03:35:03 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:22.694 03:35:03 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:22.694 03:35:03 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:22.694 03:35:03 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:22.694 03:35:03 -- common/autotest_common.sh@10 -- # set +x 00:18:24.664 03:35:05 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:24.664 03:35:05 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:24.664 03:35:05 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:24.664 03:35:05 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:24.664 03:35:05 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:24.664 03:35:05 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:24.664 03:35:05 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:24.664 03:35:05 -- nvmf/common.sh@294 -- # net_devs=() 00:18:24.664 03:35:05 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:24.664 03:35:05 -- nvmf/common.sh@295 -- # e810=() 00:18:24.664 03:35:05 -- nvmf/common.sh@295 -- # local -ga e810 00:18:24.664 03:35:05 -- nvmf/common.sh@296 -- # x722=() 00:18:24.664 03:35:05 -- nvmf/common.sh@296 -- # local -ga x722 00:18:24.664 03:35:05 -- nvmf/common.sh@297 -- # mlx=() 00:18:24.664 03:35:05 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:24.664 03:35:05 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:24.664 03:35:05 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:24.664 03:35:05 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:24.664 03:35:05 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:24.664 03:35:05 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:24.664 03:35:05 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:24.664 03:35:05 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:24.664 03:35:05 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:24.664 03:35:05 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:24.664 03:35:05 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:24.664 03:35:05 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:24.664 03:35:05 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:24.664 03:35:05 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:24.664 03:35:05 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:24.664 03:35:05 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:24.664 03:35:05 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:24.664 03:35:05 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:24.664 03:35:05 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:24.664 03:35:05 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:24.664 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:24.664 03:35:05 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:24.664 03:35:05 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:24.664 03:35:05 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:24.664 03:35:05 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:24.664 03:35:05 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:24.664 03:35:05 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:24.664 03:35:05 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:24.664 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:24.664 03:35:05 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:24.664 03:35:05 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:24.664 03:35:05 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:24.664 03:35:05 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:24.664 03:35:05 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:24.664 03:35:05 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:24.664 03:35:05 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:24.664 03:35:05 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:24.664 03:35:05 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:24.664 03:35:05 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:24.664 03:35:05 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:24.664 03:35:05 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:24.664 03:35:05 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:24.664 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:24.664 03:35:05 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:24.664 03:35:05 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:24.664 03:35:05 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:24.664 03:35:05 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:24.664 03:35:05 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:24.664 03:35:05 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:24.664 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:24.664 03:35:05 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:24.664 03:35:05 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:24.664 03:35:05 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:24.664 03:35:05 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:24.664 03:35:05 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:24.664 03:35:05 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:24.664 03:35:05 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:24.664 03:35:05 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:24.665 03:35:05 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:24.665 03:35:05 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:24.665 03:35:05 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:24.665 03:35:05 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:24.665 03:35:05 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:24.665 03:35:05 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:24.665 03:35:05 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:24.665 03:35:05 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:24.665 03:35:05 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:24.665 03:35:05 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:24.665 03:35:05 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:24.665 03:35:05 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:24.665 03:35:05 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:24.665 03:35:05 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:24.665 03:35:05 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:24.665 03:35:05 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:24.665 03:35:05 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:24.665 03:35:05 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:24.665 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:24.665 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.243 ms 00:18:24.665 00:18:24.665 --- 10.0.0.2 ping statistics --- 00:18:24.665 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:24.665 rtt min/avg/max/mdev = 0.243/0.243/0.243/0.000 ms 00:18:24.665 03:35:05 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:24.665 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:24.665 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.097 ms 00:18:24.665 00:18:24.665 --- 10.0.0.1 ping statistics --- 00:18:24.665 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:24.665 rtt min/avg/max/mdev = 0.097/0.097/0.097/0.000 ms 00:18:24.665 03:35:05 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:24.665 03:35:05 -- nvmf/common.sh@410 -- # return 0 00:18:24.665 03:35:05 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:24.665 03:35:05 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:24.665 03:35:05 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:24.665 03:35:05 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:24.665 03:35:05 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:24.665 03:35:05 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:24.665 03:35:05 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:24.665 03:35:05 -- fips/fips.sh@131 -- # nvmfappstart -m 0x2 00:18:24.665 03:35:05 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:24.665 03:35:05 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:24.665 03:35:05 -- common/autotest_common.sh@10 -- # set +x 00:18:24.665 03:35:05 -- nvmf/common.sh@469 -- # nvmfpid=3077965 00:18:24.665 03:35:05 -- nvmf/common.sh@470 -- # waitforlisten 3077965 00:18:24.665 03:35:05 -- common/autotest_common.sh@829 -- # '[' -z 3077965 ']' 00:18:24.665 03:35:05 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:24.665 03:35:05 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:24.665 03:35:05 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:18:24.665 03:35:05 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:24.665 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:24.665 03:35:05 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:24.665 03:35:05 -- common/autotest_common.sh@10 -- # set +x 00:18:24.924 [2024-11-21 03:35:05.317362] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:24.924 [2024-11-21 03:35:05.317454] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:24.924 EAL: No free 2048 kB hugepages reported on node 1 00:18:24.924 [2024-11-21 03:35:05.385472] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:24.924 [2024-11-21 03:35:05.498601] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:24.924 [2024-11-21 03:35:05.498769] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:24.924 [2024-11-21 03:35:05.498788] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:24.924 [2024-11-21 03:35:05.498803] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:24.924 [2024-11-21 03:35:05.498834] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:25.860 03:35:06 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:25.860 03:35:06 -- common/autotest_common.sh@862 -- # return 0 00:18:25.860 03:35:06 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:25.860 03:35:06 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:25.860 03:35:06 -- common/autotest_common.sh@10 -- # set +x 00:18:25.860 03:35:06 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:25.860 03:35:06 -- fips/fips.sh@133 -- # trap cleanup EXIT 00:18:25.860 03:35:06 -- fips/fips.sh@136 -- # key=NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:18:25.860 03:35:06 -- fips/fips.sh@137 -- # key_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:25.860 03:35:06 -- fips/fips.sh@138 -- # echo -n NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:18:25.860 03:35:06 -- fips/fips.sh@139 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:25.860 03:35:06 -- fips/fips.sh@141 -- # setup_nvmf_tgt_conf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:25.860 03:35:06 -- fips/fips.sh@22 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:25.860 03:35:06 -- fips/fips.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:25.860 [2024-11-21 03:35:06.497138] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:26.118 [2024-11-21 03:35:06.513126] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:18:26.118 [2024-11-21 03:35:06.513393] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:26.118 malloc0 00:18:26.118 03:35:06 -- fips/fips.sh@144 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:18:26.118 03:35:06 -- fips/fips.sh@147 -- # bdevperf_pid=3078122 00:18:26.118 03:35:06 -- fips/fips.sh@145 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:18:26.118 03:35:06 -- fips/fips.sh@148 -- # waitforlisten 3078122 /var/tmp/bdevperf.sock 00:18:26.118 03:35:06 -- common/autotest_common.sh@829 -- # '[' -z 3078122 ']' 00:18:26.118 03:35:06 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:26.118 03:35:06 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:26.118 03:35:06 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:26.118 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:26.118 03:35:06 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:26.118 03:35:06 -- common/autotest_common.sh@10 -- # set +x 00:18:26.118 [2024-11-21 03:35:06.628106] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:26.118 [2024-11-21 03:35:06.628198] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3078122 ] 00:18:26.118 EAL: No free 2048 kB hugepages reported on node 1 00:18:26.118 [2024-11-21 03:35:06.684319] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:26.376 [2024-11-21 03:35:06.797753] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:27.311 03:35:07 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:27.311 03:35:07 -- common/autotest_common.sh@862 -- # return 0 00:18:27.311 03:35:07 -- fips/fips.sh@150 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:27.311 [2024-11-21 03:35:07.879303] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:18:27.311 TLSTESTn1 00:18:27.571 03:35:07 -- fips/fips.sh@154 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:18:27.571 Running I/O for 10 seconds... 00:18:37.548 00:18:37.548 Latency(us) 00:18:37.548 [2024-11-21T02:35:18.196Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:37.548 [2024-11-21T02:35:18.196Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:18:37.548 Verification LBA range: start 0x0 length 0x2000 00:18:37.548 TLSTESTn1 : 10.01 4430.34 17.31 0.00 0.00 28857.57 5315.70 64079.64 00:18:37.548 [2024-11-21T02:35:18.196Z] =================================================================================================================== 00:18:37.548 [2024-11-21T02:35:18.196Z] Total : 4430.34 17.31 0.00 0.00 28857.57 5315.70 64079.64 00:18:37.548 0 00:18:37.549 03:35:18 -- fips/fips.sh@1 -- # cleanup 00:18:37.549 03:35:18 -- fips/fips.sh@15 -- # process_shm --id 0 00:18:37.549 03:35:18 -- common/autotest_common.sh@806 -- # type=--id 00:18:37.549 03:35:18 -- common/autotest_common.sh@807 -- # id=0 00:18:37.549 03:35:18 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:18:37.549 03:35:18 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:18:37.549 03:35:18 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:18:37.549 03:35:18 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:18:37.549 03:35:18 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:18:37.549 03:35:18 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:18:37.549 nvmf_trace.0 00:18:37.808 03:35:18 -- common/autotest_common.sh@821 -- # return 0 00:18:37.808 03:35:18 -- fips/fips.sh@16 -- # killprocess 3078122 00:18:37.808 03:35:18 -- common/autotest_common.sh@936 -- # '[' -z 3078122 ']' 00:18:37.808 03:35:18 -- common/autotest_common.sh@940 -- # kill -0 3078122 00:18:37.808 03:35:18 -- common/autotest_common.sh@941 -- # uname 00:18:37.808 03:35:18 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:37.808 03:35:18 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3078122 00:18:37.808 03:35:18 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:18:37.808 03:35:18 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:18:37.808 03:35:18 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3078122' 00:18:37.808 killing process with pid 3078122 00:18:37.808 03:35:18 -- common/autotest_common.sh@955 -- # kill 3078122 00:18:37.808 Received shutdown signal, test time was about 10.000000 seconds 00:18:37.808 00:18:37.808 Latency(us) 00:18:37.808 [2024-11-21T02:35:18.456Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:37.808 [2024-11-21T02:35:18.456Z] =================================================================================================================== 00:18:37.808 [2024-11-21T02:35:18.456Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:37.808 03:35:18 -- common/autotest_common.sh@960 -- # wait 3078122 00:18:38.069 03:35:18 -- fips/fips.sh@17 -- # nvmftestfini 00:18:38.069 03:35:18 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:38.069 03:35:18 -- nvmf/common.sh@116 -- # sync 00:18:38.069 03:35:18 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:38.069 03:35:18 -- nvmf/common.sh@119 -- # set +e 00:18:38.069 03:35:18 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:38.069 03:35:18 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:38.069 rmmod nvme_tcp 00:18:38.069 rmmod nvme_fabrics 00:18:38.069 rmmod nvme_keyring 00:18:38.069 03:35:18 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:38.069 03:35:18 -- nvmf/common.sh@123 -- # set -e 00:18:38.069 03:35:18 -- nvmf/common.sh@124 -- # return 0 00:18:38.069 03:35:18 -- nvmf/common.sh@477 -- # '[' -n 3077965 ']' 00:18:38.069 03:35:18 -- nvmf/common.sh@478 -- # killprocess 3077965 00:18:38.069 03:35:18 -- common/autotest_common.sh@936 -- # '[' -z 3077965 ']' 00:18:38.069 03:35:18 -- common/autotest_common.sh@940 -- # kill -0 3077965 00:18:38.069 03:35:18 -- common/autotest_common.sh@941 -- # uname 00:18:38.069 03:35:18 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:38.069 03:35:18 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3077965 00:18:38.069 03:35:18 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:38.069 03:35:18 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:38.069 03:35:18 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3077965' 00:18:38.069 killing process with pid 3077965 00:18:38.069 03:35:18 -- common/autotest_common.sh@955 -- # kill 3077965 00:18:38.069 03:35:18 -- common/autotest_common.sh@960 -- # wait 3077965 00:18:38.327 03:35:18 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:38.327 03:35:18 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:38.327 03:35:18 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:38.327 03:35:18 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:38.327 03:35:18 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:38.327 03:35:18 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:38.327 03:35:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:38.327 03:35:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:40.868 03:35:20 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:40.868 03:35:20 -- fips/fips.sh@18 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:40.868 00:18:40.868 real 0m18.177s 00:18:40.868 user 0m23.595s 00:18:40.868 sys 0m6.096s 00:18:40.868 03:35:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:40.868 03:35:20 -- common/autotest_common.sh@10 -- # set +x 00:18:40.868 ************************************ 00:18:40.869 END TEST nvmf_fips 00:18:40.869 ************************************ 00:18:40.869 03:35:20 -- nvmf/nvmf.sh@63 -- # '[' 1 -eq 1 ']' 00:18:40.869 03:35:20 -- nvmf/nvmf.sh@64 -- # run_test nvmf_fuzz /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=tcp 00:18:40.869 03:35:20 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:40.869 03:35:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:40.869 03:35:20 -- common/autotest_common.sh@10 -- # set +x 00:18:40.869 ************************************ 00:18:40.869 START TEST nvmf_fuzz 00:18:40.869 ************************************ 00:18:40.869 03:35:20 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=tcp 00:18:40.869 * Looking for test storage... 00:18:40.869 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:40.869 03:35:21 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:40.869 03:35:21 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:40.869 03:35:21 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:40.869 03:35:21 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:40.869 03:35:21 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:40.869 03:35:21 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:40.869 03:35:21 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:40.869 03:35:21 -- scripts/common.sh@335 -- # IFS=.-: 00:18:40.869 03:35:21 -- scripts/common.sh@335 -- # read -ra ver1 00:18:40.869 03:35:21 -- scripts/common.sh@336 -- # IFS=.-: 00:18:40.869 03:35:21 -- scripts/common.sh@336 -- # read -ra ver2 00:18:40.869 03:35:21 -- scripts/common.sh@337 -- # local 'op=<' 00:18:40.869 03:35:21 -- scripts/common.sh@339 -- # ver1_l=2 00:18:40.869 03:35:21 -- scripts/common.sh@340 -- # ver2_l=1 00:18:40.869 03:35:21 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:40.869 03:35:21 -- scripts/common.sh@343 -- # case "$op" in 00:18:40.869 03:35:21 -- scripts/common.sh@344 -- # : 1 00:18:40.869 03:35:21 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:40.869 03:35:21 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:40.869 03:35:21 -- scripts/common.sh@364 -- # decimal 1 00:18:40.869 03:35:21 -- scripts/common.sh@352 -- # local d=1 00:18:40.869 03:35:21 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:40.869 03:35:21 -- scripts/common.sh@354 -- # echo 1 00:18:40.869 03:35:21 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:40.869 03:35:21 -- scripts/common.sh@365 -- # decimal 2 00:18:40.869 03:35:21 -- scripts/common.sh@352 -- # local d=2 00:18:40.869 03:35:21 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:40.869 03:35:21 -- scripts/common.sh@354 -- # echo 2 00:18:40.869 03:35:21 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:40.869 03:35:21 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:40.869 03:35:21 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:40.869 03:35:21 -- scripts/common.sh@367 -- # return 0 00:18:40.869 03:35:21 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:40.869 03:35:21 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:40.869 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:40.869 --rc genhtml_branch_coverage=1 00:18:40.869 --rc genhtml_function_coverage=1 00:18:40.869 --rc genhtml_legend=1 00:18:40.869 --rc geninfo_all_blocks=1 00:18:40.869 --rc geninfo_unexecuted_blocks=1 00:18:40.869 00:18:40.869 ' 00:18:40.869 03:35:21 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:40.869 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:40.869 --rc genhtml_branch_coverage=1 00:18:40.869 --rc genhtml_function_coverage=1 00:18:40.869 --rc genhtml_legend=1 00:18:40.869 --rc geninfo_all_blocks=1 00:18:40.869 --rc geninfo_unexecuted_blocks=1 00:18:40.869 00:18:40.869 ' 00:18:40.869 03:35:21 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:40.869 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:40.869 --rc genhtml_branch_coverage=1 00:18:40.869 --rc genhtml_function_coverage=1 00:18:40.869 --rc genhtml_legend=1 00:18:40.869 --rc geninfo_all_blocks=1 00:18:40.869 --rc geninfo_unexecuted_blocks=1 00:18:40.869 00:18:40.869 ' 00:18:40.869 03:35:21 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:40.869 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:40.869 --rc genhtml_branch_coverage=1 00:18:40.869 --rc genhtml_function_coverage=1 00:18:40.869 --rc genhtml_legend=1 00:18:40.869 --rc geninfo_all_blocks=1 00:18:40.869 --rc geninfo_unexecuted_blocks=1 00:18:40.869 00:18:40.869 ' 00:18:40.869 03:35:21 -- target/fabrics_fuzz.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:40.869 03:35:21 -- nvmf/common.sh@7 -- # uname -s 00:18:40.869 03:35:21 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:40.869 03:35:21 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:40.869 03:35:21 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:40.869 03:35:21 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:40.869 03:35:21 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:40.869 03:35:21 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:40.869 03:35:21 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:40.869 03:35:21 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:40.869 03:35:21 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:40.869 03:35:21 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:40.869 03:35:21 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:40.869 03:35:21 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:40.869 03:35:21 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:40.869 03:35:21 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:40.869 03:35:21 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:40.869 03:35:21 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:40.869 03:35:21 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:40.869 03:35:21 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:40.869 03:35:21 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:40.869 03:35:21 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:40.869 03:35:21 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:40.869 03:35:21 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:40.869 03:35:21 -- paths/export.sh@5 -- # export PATH 00:18:40.869 03:35:21 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:40.869 03:35:21 -- nvmf/common.sh@46 -- # : 0 00:18:40.869 03:35:21 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:40.869 03:35:21 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:40.869 03:35:21 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:40.869 03:35:21 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:40.869 03:35:21 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:40.869 03:35:21 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:40.869 03:35:21 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:40.869 03:35:21 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:40.869 03:35:21 -- target/fabrics_fuzz.sh@11 -- # nvmftestinit 00:18:40.869 03:35:21 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:40.869 03:35:21 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:40.869 03:35:21 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:40.869 03:35:21 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:40.869 03:35:21 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:40.869 03:35:21 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:40.869 03:35:21 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:40.869 03:35:21 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:40.869 03:35:21 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:40.869 03:35:21 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:40.869 03:35:21 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:40.869 03:35:21 -- common/autotest_common.sh@10 -- # set +x 00:18:42.776 03:35:23 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:42.776 03:35:23 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:42.776 03:35:23 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:42.776 03:35:23 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:42.776 03:35:23 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:42.776 03:35:23 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:42.776 03:35:23 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:42.776 03:35:23 -- nvmf/common.sh@294 -- # net_devs=() 00:18:42.776 03:35:23 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:42.776 03:35:23 -- nvmf/common.sh@295 -- # e810=() 00:18:42.776 03:35:23 -- nvmf/common.sh@295 -- # local -ga e810 00:18:42.776 03:35:23 -- nvmf/common.sh@296 -- # x722=() 00:18:42.776 03:35:23 -- nvmf/common.sh@296 -- # local -ga x722 00:18:42.776 03:35:23 -- nvmf/common.sh@297 -- # mlx=() 00:18:42.776 03:35:23 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:42.776 03:35:23 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:42.776 03:35:23 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:42.776 03:35:23 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:42.776 03:35:23 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:42.776 03:35:23 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:42.776 03:35:23 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:42.776 03:35:23 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:42.776 03:35:23 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:42.776 03:35:23 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:42.776 03:35:23 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:42.776 03:35:23 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:42.776 03:35:23 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:42.776 03:35:23 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:42.776 03:35:23 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:42.776 03:35:23 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:42.776 03:35:23 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:42.776 03:35:23 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:42.776 03:35:23 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:42.776 03:35:23 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:42.777 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:42.777 03:35:23 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:42.777 03:35:23 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:42.777 03:35:23 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:42.777 03:35:23 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:42.777 03:35:23 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:42.777 03:35:23 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:42.777 03:35:23 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:42.777 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:42.777 03:35:23 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:42.777 03:35:23 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:42.777 03:35:23 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:42.777 03:35:23 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:42.777 03:35:23 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:42.777 03:35:23 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:42.777 03:35:23 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:42.777 03:35:23 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:42.777 03:35:23 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:42.777 03:35:23 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:42.777 03:35:23 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:42.777 03:35:23 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:42.777 03:35:23 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:42.777 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:42.777 03:35:23 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:42.777 03:35:23 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:42.777 03:35:23 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:42.777 03:35:23 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:42.777 03:35:23 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:42.777 03:35:23 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:42.777 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:42.777 03:35:23 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:42.777 03:35:23 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:42.777 03:35:23 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:42.777 03:35:23 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:42.777 03:35:23 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:42.777 03:35:23 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:42.777 03:35:23 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:42.777 03:35:23 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:42.777 03:35:23 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:42.777 03:35:23 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:42.777 03:35:23 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:42.777 03:35:23 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:42.777 03:35:23 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:42.777 03:35:23 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:42.777 03:35:23 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:42.777 03:35:23 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:42.777 03:35:23 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:42.777 03:35:23 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:42.777 03:35:23 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:42.777 03:35:23 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:42.777 03:35:23 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:42.777 03:35:23 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:42.777 03:35:23 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:42.777 03:35:23 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:42.777 03:35:23 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:42.777 03:35:23 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:42.777 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:42.777 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.287 ms 00:18:42.777 00:18:42.777 --- 10.0.0.2 ping statistics --- 00:18:42.777 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:42.777 rtt min/avg/max/mdev = 0.287/0.287/0.287/0.000 ms 00:18:42.777 03:35:23 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:42.777 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:42.777 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.110 ms 00:18:42.777 00:18:42.777 --- 10.0.0.1 ping statistics --- 00:18:42.777 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:42.777 rtt min/avg/max/mdev = 0.110/0.110/0.110/0.000 ms 00:18:42.777 03:35:23 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:42.777 03:35:23 -- nvmf/common.sh@410 -- # return 0 00:18:42.777 03:35:23 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:42.777 03:35:23 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:42.777 03:35:23 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:42.777 03:35:23 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:42.777 03:35:23 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:42.777 03:35:23 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:42.777 03:35:23 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:42.777 03:35:23 -- target/fabrics_fuzz.sh@14 -- # nvmfpid=3081566 00:18:42.777 03:35:23 -- target/fabrics_fuzz.sh@13 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:18:42.777 03:35:23 -- target/fabrics_fuzz.sh@16 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:18:42.777 03:35:23 -- target/fabrics_fuzz.sh@18 -- # waitforlisten 3081566 00:18:42.777 03:35:23 -- common/autotest_common.sh@829 -- # '[' -z 3081566 ']' 00:18:42.777 03:35:23 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:42.777 03:35:23 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:42.777 03:35:23 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:42.777 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:42.777 03:35:23 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:42.777 03:35:23 -- common/autotest_common.sh@10 -- # set +x 00:18:44.157 03:35:24 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:44.157 03:35:24 -- common/autotest_common.sh@862 -- # return 0 00:18:44.157 03:35:24 -- target/fabrics_fuzz.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:18:44.157 03:35:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:44.157 03:35:24 -- common/autotest_common.sh@10 -- # set +x 00:18:44.157 03:35:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:44.157 03:35:24 -- target/fabrics_fuzz.sh@21 -- # rpc_cmd bdev_malloc_create -b Malloc0 64 512 00:18:44.157 03:35:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:44.157 03:35:24 -- common/autotest_common.sh@10 -- # set +x 00:18:44.157 Malloc0 00:18:44.157 03:35:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:44.157 03:35:24 -- target/fabrics_fuzz.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:18:44.157 03:35:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:44.157 03:35:24 -- common/autotest_common.sh@10 -- # set +x 00:18:44.157 03:35:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:44.157 03:35:24 -- target/fabrics_fuzz.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:18:44.157 03:35:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:44.157 03:35:24 -- common/autotest_common.sh@10 -- # set +x 00:18:44.157 03:35:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:44.157 03:35:24 -- target/fabrics_fuzz.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:18:44.157 03:35:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:44.157 03:35:24 -- common/autotest_common.sh@10 -- # set +x 00:18:44.157 03:35:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:44.157 03:35:24 -- target/fabrics_fuzz.sh@27 -- # trid='trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' 00:18:44.157 03:35:24 -- target/fabrics_fuzz.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/nvme_fuzz -t 30 -S 123456 -F 'trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' -N -a 00:19:16.237 Fuzzing completed. Shutting down the fuzz application 00:19:16.237 00:19:16.237 Dumping successful admin opcodes: 00:19:16.237 8, 9, 10, 24, 00:19:16.237 Dumping successful io opcodes: 00:19:16.237 0, 9, 00:19:16.237 NS: 0x200003aeff00 I/O qp, Total commands completed: 446186, total successful commands: 2590, random_seed: 2599999680 00:19:16.237 NS: 0x200003aeff00 admin qp, Total commands completed: 55968, total successful commands: 444, random_seed: 1882755136 00:19:16.237 03:35:54 -- target/fabrics_fuzz.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/nvme_fuzz -F 'trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' -j /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/example.json -a 00:19:16.237 Fuzzing completed. Shutting down the fuzz application 00:19:16.237 00:19:16.237 Dumping successful admin opcodes: 00:19:16.237 24, 00:19:16.237 Dumping successful io opcodes: 00:19:16.237 00:19:16.237 NS: 0x200003aeff00 I/O qp, Total commands completed: 0, total successful commands: 0, random_seed: 4283564289 00:19:16.237 NS: 0x200003aeff00 admin qp, Total commands completed: 16, total successful commands: 4, random_seed: 4283724977 00:19:16.237 03:35:56 -- target/fabrics_fuzz.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:19:16.237 03:35:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:16.237 03:35:56 -- common/autotest_common.sh@10 -- # set +x 00:19:16.237 03:35:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:16.237 03:35:56 -- target/fabrics_fuzz.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:19:16.237 03:35:56 -- target/fabrics_fuzz.sh@38 -- # nvmftestfini 00:19:16.237 03:35:56 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:16.237 03:35:56 -- nvmf/common.sh@116 -- # sync 00:19:16.237 03:35:56 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:16.237 03:35:56 -- nvmf/common.sh@119 -- # set +e 00:19:16.237 03:35:56 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:16.237 03:35:56 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:16.237 rmmod nvme_tcp 00:19:16.237 rmmod nvme_fabrics 00:19:16.237 rmmod nvme_keyring 00:19:16.237 03:35:56 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:16.237 03:35:56 -- nvmf/common.sh@123 -- # set -e 00:19:16.237 03:35:56 -- nvmf/common.sh@124 -- # return 0 00:19:16.237 03:35:56 -- nvmf/common.sh@477 -- # '[' -n 3081566 ']' 00:19:16.237 03:35:56 -- nvmf/common.sh@478 -- # killprocess 3081566 00:19:16.237 03:35:56 -- common/autotest_common.sh@936 -- # '[' -z 3081566 ']' 00:19:16.237 03:35:56 -- common/autotest_common.sh@940 -- # kill -0 3081566 00:19:16.237 03:35:56 -- common/autotest_common.sh@941 -- # uname 00:19:16.237 03:35:56 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:16.237 03:35:56 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3081566 00:19:16.237 03:35:56 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:19:16.237 03:35:56 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:19:16.237 03:35:56 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3081566' 00:19:16.237 killing process with pid 3081566 00:19:16.237 03:35:56 -- common/autotest_common.sh@955 -- # kill 3081566 00:19:16.237 03:35:56 -- common/autotest_common.sh@960 -- # wait 3081566 00:19:16.237 03:35:56 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:16.237 03:35:56 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:16.237 03:35:56 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:16.237 03:35:56 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:16.237 03:35:56 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:16.237 03:35:56 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:16.237 03:35:56 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:16.237 03:35:56 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:18.779 03:35:58 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:18.779 03:35:58 -- target/fabrics_fuzz.sh@39 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_fuzz_logs1.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_fuzz_logs2.txt 00:19:18.779 00:19:18.779 real 0m37.846s 00:19:18.779 user 0m51.824s 00:19:18.779 sys 0m15.377s 00:19:18.779 03:35:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:19:18.779 03:35:58 -- common/autotest_common.sh@10 -- # set +x 00:19:18.779 ************************************ 00:19:18.779 END TEST nvmf_fuzz 00:19:18.779 ************************************ 00:19:18.780 03:35:58 -- nvmf/nvmf.sh@65 -- # run_test nvmf_multiconnection /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=tcp 00:19:18.780 03:35:58 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:18.780 03:35:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:18.780 03:35:58 -- common/autotest_common.sh@10 -- # set +x 00:19:18.780 ************************************ 00:19:18.780 START TEST nvmf_multiconnection 00:19:18.780 ************************************ 00:19:18.780 03:35:58 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=tcp 00:19:18.780 * Looking for test storage... 00:19:18.780 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:18.780 03:35:58 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:19:18.780 03:35:58 -- common/autotest_common.sh@1690 -- # lcov --version 00:19:18.780 03:35:58 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:19:18.780 03:35:58 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:19:18.780 03:35:58 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:19:18.780 03:35:58 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:19:18.780 03:35:58 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:19:18.780 03:35:58 -- scripts/common.sh@335 -- # IFS=.-: 00:19:18.780 03:35:58 -- scripts/common.sh@335 -- # read -ra ver1 00:19:18.780 03:35:59 -- scripts/common.sh@336 -- # IFS=.-: 00:19:18.780 03:35:59 -- scripts/common.sh@336 -- # read -ra ver2 00:19:18.780 03:35:59 -- scripts/common.sh@337 -- # local 'op=<' 00:19:18.780 03:35:59 -- scripts/common.sh@339 -- # ver1_l=2 00:19:18.780 03:35:59 -- scripts/common.sh@340 -- # ver2_l=1 00:19:18.780 03:35:59 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:19:18.780 03:35:59 -- scripts/common.sh@343 -- # case "$op" in 00:19:18.781 03:35:59 -- scripts/common.sh@344 -- # : 1 00:19:18.781 03:35:59 -- scripts/common.sh@363 -- # (( v = 0 )) 00:19:18.781 03:35:59 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:19:18.781 03:35:59 -- scripts/common.sh@364 -- # decimal 1 00:19:18.781 03:35:59 -- scripts/common.sh@352 -- # local d=1 00:19:18.781 03:35:59 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:19:18.781 03:35:59 -- scripts/common.sh@354 -- # echo 1 00:19:18.781 03:35:59 -- scripts/common.sh@364 -- # ver1[v]=1 00:19:18.781 03:35:59 -- scripts/common.sh@365 -- # decimal 2 00:19:18.781 03:35:59 -- scripts/common.sh@352 -- # local d=2 00:19:18.781 03:35:59 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:19:18.781 03:35:59 -- scripts/common.sh@354 -- # echo 2 00:19:18.781 03:35:59 -- scripts/common.sh@365 -- # ver2[v]=2 00:19:18.781 03:35:59 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:19:18.781 03:35:59 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:19:18.781 03:35:59 -- scripts/common.sh@367 -- # return 0 00:19:18.781 03:35:59 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:19:18.781 03:35:59 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:19:18.781 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:18.781 --rc genhtml_branch_coverage=1 00:19:18.781 --rc genhtml_function_coverage=1 00:19:18.781 --rc genhtml_legend=1 00:19:18.781 --rc geninfo_all_blocks=1 00:19:18.781 --rc geninfo_unexecuted_blocks=1 00:19:18.781 00:19:18.781 ' 00:19:18.781 03:35:59 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:19:18.781 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:18.781 --rc genhtml_branch_coverage=1 00:19:18.781 --rc genhtml_function_coverage=1 00:19:18.781 --rc genhtml_legend=1 00:19:18.781 --rc geninfo_all_blocks=1 00:19:18.781 --rc geninfo_unexecuted_blocks=1 00:19:18.781 00:19:18.781 ' 00:19:18.782 03:35:59 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:19:18.782 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:18.782 --rc genhtml_branch_coverage=1 00:19:18.782 --rc genhtml_function_coverage=1 00:19:18.782 --rc genhtml_legend=1 00:19:18.782 --rc geninfo_all_blocks=1 00:19:18.782 --rc geninfo_unexecuted_blocks=1 00:19:18.782 00:19:18.782 ' 00:19:18.782 03:35:59 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:19:18.782 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:18.782 --rc genhtml_branch_coverage=1 00:19:18.782 --rc genhtml_function_coverage=1 00:19:18.782 --rc genhtml_legend=1 00:19:18.782 --rc geninfo_all_blocks=1 00:19:18.782 --rc geninfo_unexecuted_blocks=1 00:19:18.782 00:19:18.782 ' 00:19:18.782 03:35:59 -- target/multiconnection.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:18.782 03:35:59 -- nvmf/common.sh@7 -- # uname -s 00:19:18.782 03:35:59 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:18.782 03:35:59 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:18.782 03:35:59 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:18.782 03:35:59 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:18.782 03:35:59 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:18.782 03:35:59 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:18.785 03:35:59 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:18.785 03:35:59 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:18.785 03:35:59 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:18.785 03:35:59 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:18.785 03:35:59 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:19:18.786 03:35:59 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:19:18.786 03:35:59 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:18.786 03:35:59 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:18.786 03:35:59 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:18.786 03:35:59 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:18.786 03:35:59 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:18.786 03:35:59 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:18.786 03:35:59 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:18.786 03:35:59 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:18.786 03:35:59 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:18.786 03:35:59 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:18.786 03:35:59 -- paths/export.sh@5 -- # export PATH 00:19:18.786 03:35:59 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:18.786 03:35:59 -- nvmf/common.sh@46 -- # : 0 00:19:18.786 03:35:59 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:18.787 03:35:59 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:18.787 03:35:59 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:18.787 03:35:59 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:18.787 03:35:59 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:18.787 03:35:59 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:18.787 03:35:59 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:18.787 03:35:59 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:18.787 03:35:59 -- target/multiconnection.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:18.787 03:35:59 -- target/multiconnection.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:18.787 03:35:59 -- target/multiconnection.sh@14 -- # NVMF_SUBSYS=11 00:19:18.787 03:35:59 -- target/multiconnection.sh@16 -- # nvmftestinit 00:19:18.787 03:35:59 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:18.787 03:35:59 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:18.787 03:35:59 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:18.787 03:35:59 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:18.787 03:35:59 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:18.787 03:35:59 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:18.787 03:35:59 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:18.787 03:35:59 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:18.787 03:35:59 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:18.787 03:35:59 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:18.787 03:35:59 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:18.787 03:35:59 -- common/autotest_common.sh@10 -- # set +x 00:19:20.694 03:36:01 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:20.694 03:36:01 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:20.694 03:36:01 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:20.694 03:36:01 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:20.694 03:36:01 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:20.694 03:36:01 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:20.694 03:36:01 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:20.694 03:36:01 -- nvmf/common.sh@294 -- # net_devs=() 00:19:20.694 03:36:01 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:20.694 03:36:01 -- nvmf/common.sh@295 -- # e810=() 00:19:20.694 03:36:01 -- nvmf/common.sh@295 -- # local -ga e810 00:19:20.694 03:36:01 -- nvmf/common.sh@296 -- # x722=() 00:19:20.694 03:36:01 -- nvmf/common.sh@296 -- # local -ga x722 00:19:20.694 03:36:01 -- nvmf/common.sh@297 -- # mlx=() 00:19:20.694 03:36:01 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:20.694 03:36:01 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:20.694 03:36:01 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:20.694 03:36:01 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:20.694 03:36:01 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:20.694 03:36:01 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:20.694 03:36:01 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:20.694 03:36:01 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:20.694 03:36:01 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:20.694 03:36:01 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:20.694 03:36:01 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:20.694 03:36:01 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:20.694 03:36:01 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:20.694 03:36:01 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:20.694 03:36:01 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:20.694 03:36:01 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:20.694 03:36:01 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:20.694 03:36:01 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:20.694 03:36:01 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:20.694 03:36:01 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:20.694 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:20.694 03:36:01 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:20.694 03:36:01 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:20.694 03:36:01 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:20.695 03:36:01 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:20.695 03:36:01 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:20.695 03:36:01 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:20.695 03:36:01 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:20.695 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:20.695 03:36:01 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:20.695 03:36:01 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:20.695 03:36:01 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:20.695 03:36:01 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:20.695 03:36:01 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:20.695 03:36:01 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:20.695 03:36:01 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:20.695 03:36:01 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:20.695 03:36:01 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:20.695 03:36:01 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:20.695 03:36:01 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:20.695 03:36:01 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:20.695 03:36:01 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:20.695 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:20.695 03:36:01 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:20.695 03:36:01 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:20.695 03:36:01 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:20.695 03:36:01 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:20.695 03:36:01 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:20.695 03:36:01 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:20.695 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:20.695 03:36:01 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:20.695 03:36:01 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:20.695 03:36:01 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:20.695 03:36:01 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:20.695 03:36:01 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:20.695 03:36:01 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:20.695 03:36:01 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:20.695 03:36:01 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:20.695 03:36:01 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:20.695 03:36:01 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:20.695 03:36:01 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:20.695 03:36:01 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:20.695 03:36:01 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:20.695 03:36:01 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:20.695 03:36:01 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:20.695 03:36:01 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:20.695 03:36:01 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:20.695 03:36:01 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:20.695 03:36:01 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:20.695 03:36:01 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:20.695 03:36:01 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:20.695 03:36:01 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:20.695 03:36:01 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:20.695 03:36:01 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:20.695 03:36:01 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:20.695 03:36:01 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:20.695 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:20.695 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.295 ms 00:19:20.695 00:19:20.695 --- 10.0.0.2 ping statistics --- 00:19:20.695 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:20.695 rtt min/avg/max/mdev = 0.295/0.295/0.295/0.000 ms 00:19:20.695 03:36:01 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:20.695 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:20.695 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.120 ms 00:19:20.695 00:19:20.695 --- 10.0.0.1 ping statistics --- 00:19:20.695 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:20.695 rtt min/avg/max/mdev = 0.120/0.120/0.120/0.000 ms 00:19:20.695 03:36:01 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:20.695 03:36:01 -- nvmf/common.sh@410 -- # return 0 00:19:20.695 03:36:01 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:20.695 03:36:01 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:20.695 03:36:01 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:20.695 03:36:01 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:20.695 03:36:01 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:20.695 03:36:01 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:20.695 03:36:01 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:20.695 03:36:01 -- target/multiconnection.sh@17 -- # nvmfappstart -m 0xF 00:19:20.695 03:36:01 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:20.695 03:36:01 -- common/autotest_common.sh@722 -- # xtrace_disable 00:19:20.695 03:36:01 -- common/autotest_common.sh@10 -- # set +x 00:19:20.695 03:36:01 -- nvmf/common.sh@469 -- # nvmfpid=3087526 00:19:20.695 03:36:01 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:19:20.695 03:36:01 -- nvmf/common.sh@470 -- # waitforlisten 3087526 00:19:20.695 03:36:01 -- common/autotest_common.sh@829 -- # '[' -z 3087526 ']' 00:19:20.695 03:36:01 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:20.695 03:36:01 -- common/autotest_common.sh@834 -- # local max_retries=100 00:19:20.695 03:36:01 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:20.695 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:20.695 03:36:01 -- common/autotest_common.sh@838 -- # xtrace_disable 00:19:20.695 03:36:01 -- common/autotest_common.sh@10 -- # set +x 00:19:20.695 [2024-11-21 03:36:01.303005] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:19:20.695 [2024-11-21 03:36:01.303097] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:20.954 EAL: No free 2048 kB hugepages reported on node 1 00:19:20.954 [2024-11-21 03:36:01.377086] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:20.954 [2024-11-21 03:36:01.502187] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:20.954 [2024-11-21 03:36:01.502328] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:20.954 [2024-11-21 03:36:01.502347] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:20.954 [2024-11-21 03:36:01.502360] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:20.954 [2024-11-21 03:36:01.502439] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:20.954 [2024-11-21 03:36:01.502517] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:20.954 [2024-11-21 03:36:01.502542] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:20.954 [2024-11-21 03:36:01.502545] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:21.888 03:36:02 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:19:21.888 03:36:02 -- common/autotest_common.sh@862 -- # return 0 00:19:21.888 03:36:02 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:21.888 03:36:02 -- common/autotest_common.sh@728 -- # xtrace_disable 00:19:21.888 03:36:02 -- common/autotest_common.sh@10 -- # set +x 00:19:21.888 03:36:02 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:21.888 03:36:02 -- target/multiconnection.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:19:21.888 03:36:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:21.888 03:36:02 -- common/autotest_common.sh@10 -- # set +x 00:19:21.888 [2024-11-21 03:36:02.371829] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:21.888 03:36:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:21.888 03:36:02 -- target/multiconnection.sh@21 -- # seq 1 11 00:19:21.888 03:36:02 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:21.888 03:36:02 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:19:21.888 03:36:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:21.888 03:36:02 -- common/autotest_common.sh@10 -- # set +x 00:19:21.888 Malloc1 00:19:21.888 03:36:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:21.888 03:36:02 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK1 00:19:21.888 03:36:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:21.888 03:36:02 -- common/autotest_common.sh@10 -- # set +x 00:19:21.888 03:36:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:21.888 03:36:02 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:19:21.888 03:36:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:21.888 03:36:02 -- common/autotest_common.sh@10 -- # set +x 00:19:21.888 03:36:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:21.888 03:36:02 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:19:21.888 03:36:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:21.888 03:36:02 -- common/autotest_common.sh@10 -- # set +x 00:19:21.888 [2024-11-21 03:36:02.426771] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:21.888 03:36:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:21.888 03:36:02 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:21.888 03:36:02 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc2 00:19:21.888 03:36:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:21.888 03:36:02 -- common/autotest_common.sh@10 -- # set +x 00:19:21.888 Malloc2 00:19:21.888 03:36:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:21.888 03:36:02 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:19:21.888 03:36:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:21.888 03:36:02 -- common/autotest_common.sh@10 -- # set +x 00:19:21.888 03:36:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:21.888 03:36:02 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc2 00:19:21.888 03:36:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:21.888 03:36:02 -- common/autotest_common.sh@10 -- # set +x 00:19:21.888 03:36:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:21.888 03:36:02 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:19:21.888 03:36:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:21.888 03:36:02 -- common/autotest_common.sh@10 -- # set +x 00:19:21.888 03:36:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:21.888 03:36:02 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:21.888 03:36:02 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc3 00:19:21.888 03:36:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:21.888 03:36:02 -- common/autotest_common.sh@10 -- # set +x 00:19:21.888 Malloc3 00:19:21.888 03:36:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:21.888 03:36:02 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK3 00:19:21.888 03:36:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:21.888 03:36:02 -- common/autotest_common.sh@10 -- # set +x 00:19:21.888 03:36:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:21.888 03:36:02 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Malloc3 00:19:21.888 03:36:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:21.888 03:36:02 -- common/autotest_common.sh@10 -- # set +x 00:19:21.888 03:36:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:21.888 03:36:02 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:19:21.888 03:36:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:21.888 03:36:02 -- common/autotest_common.sh@10 -- # set +x 00:19:21.888 03:36:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:21.888 03:36:02 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:21.888 03:36:02 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc4 00:19:21.888 03:36:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:21.888 03:36:02 -- common/autotest_common.sh@10 -- # set +x 00:19:22.147 Malloc4 00:19:22.147 03:36:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.147 03:36:02 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK4 00:19:22.147 03:36:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.147 03:36:02 -- common/autotest_common.sh@10 -- # set +x 00:19:22.147 03:36:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.147 03:36:02 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Malloc4 00:19:22.147 03:36:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.147 03:36:02 -- common/autotest_common.sh@10 -- # set +x 00:19:22.147 03:36:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.147 03:36:02 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:19:22.147 03:36:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.147 03:36:02 -- common/autotest_common.sh@10 -- # set +x 00:19:22.147 03:36:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.147 03:36:02 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:22.147 03:36:02 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc5 00:19:22.147 03:36:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.147 03:36:02 -- common/autotest_common.sh@10 -- # set +x 00:19:22.147 Malloc5 00:19:22.147 03:36:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.147 03:36:02 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode5 -a -s SPDK5 00:19:22.147 03:36:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.147 03:36:02 -- common/autotest_common.sh@10 -- # set +x 00:19:22.147 03:36:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.147 03:36:02 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode5 Malloc5 00:19:22.147 03:36:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.147 03:36:02 -- common/autotest_common.sh@10 -- # set +x 00:19:22.147 03:36:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.147 03:36:02 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode5 -t tcp -a 10.0.0.2 -s 4420 00:19:22.147 03:36:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.147 03:36:02 -- common/autotest_common.sh@10 -- # set +x 00:19:22.147 03:36:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.147 03:36:02 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:22.147 03:36:02 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc6 00:19:22.147 03:36:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.147 03:36:02 -- common/autotest_common.sh@10 -- # set +x 00:19:22.147 Malloc6 00:19:22.147 03:36:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.147 03:36:02 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode6 -a -s SPDK6 00:19:22.147 03:36:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.147 03:36:02 -- common/autotest_common.sh@10 -- # set +x 00:19:22.147 03:36:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.147 03:36:02 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode6 Malloc6 00:19:22.147 03:36:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.147 03:36:02 -- common/autotest_common.sh@10 -- # set +x 00:19:22.147 03:36:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.147 03:36:02 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode6 -t tcp -a 10.0.0.2 -s 4420 00:19:22.147 03:36:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.147 03:36:02 -- common/autotest_common.sh@10 -- # set +x 00:19:22.147 03:36:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.147 03:36:02 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:22.147 03:36:02 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc7 00:19:22.147 03:36:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.147 03:36:02 -- common/autotest_common.sh@10 -- # set +x 00:19:22.147 Malloc7 00:19:22.147 03:36:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.147 03:36:02 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode7 -a -s SPDK7 00:19:22.147 03:36:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.147 03:36:02 -- common/autotest_common.sh@10 -- # set +x 00:19:22.147 03:36:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.147 03:36:02 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode7 Malloc7 00:19:22.147 03:36:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.147 03:36:02 -- common/autotest_common.sh@10 -- # set +x 00:19:22.148 03:36:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.148 03:36:02 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode7 -t tcp -a 10.0.0.2 -s 4420 00:19:22.148 03:36:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.148 03:36:02 -- common/autotest_common.sh@10 -- # set +x 00:19:22.148 03:36:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.148 03:36:02 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:22.148 03:36:02 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc8 00:19:22.148 03:36:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.148 03:36:02 -- common/autotest_common.sh@10 -- # set +x 00:19:22.148 Malloc8 00:19:22.148 03:36:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.148 03:36:02 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode8 -a -s SPDK8 00:19:22.148 03:36:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.148 03:36:02 -- common/autotest_common.sh@10 -- # set +x 00:19:22.148 03:36:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.148 03:36:02 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode8 Malloc8 00:19:22.148 03:36:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.148 03:36:02 -- common/autotest_common.sh@10 -- # set +x 00:19:22.148 03:36:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.148 03:36:02 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode8 -t tcp -a 10.0.0.2 -s 4420 00:19:22.148 03:36:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.148 03:36:02 -- common/autotest_common.sh@10 -- # set +x 00:19:22.148 03:36:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.148 03:36:02 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:22.148 03:36:02 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc9 00:19:22.148 03:36:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.148 03:36:02 -- common/autotest_common.sh@10 -- # set +x 00:19:22.148 Malloc9 00:19:22.148 03:36:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.148 03:36:02 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode9 -a -s SPDK9 00:19:22.148 03:36:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.148 03:36:02 -- common/autotest_common.sh@10 -- # set +x 00:19:22.407 03:36:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.407 03:36:02 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode9 Malloc9 00:19:22.407 03:36:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.407 03:36:02 -- common/autotest_common.sh@10 -- # set +x 00:19:22.407 03:36:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.407 03:36:02 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode9 -t tcp -a 10.0.0.2 -s 4420 00:19:22.407 03:36:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.407 03:36:02 -- common/autotest_common.sh@10 -- # set +x 00:19:22.407 03:36:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.407 03:36:02 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:22.407 03:36:02 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc10 00:19:22.407 03:36:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.407 03:36:02 -- common/autotest_common.sh@10 -- # set +x 00:19:22.407 Malloc10 00:19:22.407 03:36:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.407 03:36:02 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode10 -a -s SPDK10 00:19:22.408 03:36:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.408 03:36:02 -- common/autotest_common.sh@10 -- # set +x 00:19:22.408 03:36:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.408 03:36:02 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode10 Malloc10 00:19:22.408 03:36:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.408 03:36:02 -- common/autotest_common.sh@10 -- # set +x 00:19:22.408 03:36:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.408 03:36:02 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode10 -t tcp -a 10.0.0.2 -s 4420 00:19:22.408 03:36:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.408 03:36:02 -- common/autotest_common.sh@10 -- # set +x 00:19:22.408 03:36:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.408 03:36:02 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:22.408 03:36:02 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc11 00:19:22.408 03:36:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.408 03:36:02 -- common/autotest_common.sh@10 -- # set +x 00:19:22.408 Malloc11 00:19:22.408 03:36:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.408 03:36:02 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode11 -a -s SPDK11 00:19:22.408 03:36:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.408 03:36:02 -- common/autotest_common.sh@10 -- # set +x 00:19:22.408 03:36:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.408 03:36:02 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode11 Malloc11 00:19:22.408 03:36:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.408 03:36:02 -- common/autotest_common.sh@10 -- # set +x 00:19:22.408 03:36:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.408 03:36:02 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode11 -t tcp -a 10.0.0.2 -s 4420 00:19:22.408 03:36:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:22.408 03:36:02 -- common/autotest_common.sh@10 -- # set +x 00:19:22.408 03:36:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:22.408 03:36:02 -- target/multiconnection.sh@28 -- # seq 1 11 00:19:22.408 03:36:02 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:22.408 03:36:02 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:19:22.978 03:36:03 -- target/multiconnection.sh@30 -- # waitforserial SPDK1 00:19:22.978 03:36:03 -- common/autotest_common.sh@1187 -- # local i=0 00:19:22.978 03:36:03 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:22.978 03:36:03 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:22.978 03:36:03 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:25.571 03:36:05 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:25.571 03:36:05 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:25.571 03:36:05 -- common/autotest_common.sh@1196 -- # grep -c SPDK1 00:19:25.571 03:36:05 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:25.571 03:36:05 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:25.571 03:36:05 -- common/autotest_common.sh@1197 -- # return 0 00:19:25.571 03:36:05 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:25.571 03:36:05 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode2 -a 10.0.0.2 -s 4420 00:19:25.832 03:36:06 -- target/multiconnection.sh@30 -- # waitforserial SPDK2 00:19:25.832 03:36:06 -- common/autotest_common.sh@1187 -- # local i=0 00:19:25.832 03:36:06 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:25.832 03:36:06 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:25.832 03:36:06 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:27.736 03:36:08 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:27.737 03:36:08 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:27.737 03:36:08 -- common/autotest_common.sh@1196 -- # grep -c SPDK2 00:19:27.737 03:36:08 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:27.737 03:36:08 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:27.737 03:36:08 -- common/autotest_common.sh@1197 -- # return 0 00:19:27.737 03:36:08 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:27.737 03:36:08 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode3 -a 10.0.0.2 -s 4420 00:19:28.673 03:36:09 -- target/multiconnection.sh@30 -- # waitforserial SPDK3 00:19:28.673 03:36:09 -- common/autotest_common.sh@1187 -- # local i=0 00:19:28.673 03:36:09 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:28.673 03:36:09 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:28.673 03:36:09 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:30.584 03:36:11 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:30.584 03:36:11 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:30.584 03:36:11 -- common/autotest_common.sh@1196 -- # grep -c SPDK3 00:19:30.584 03:36:11 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:30.584 03:36:11 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:30.584 03:36:11 -- common/autotest_common.sh@1197 -- # return 0 00:19:30.584 03:36:11 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:30.584 03:36:11 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode4 -a 10.0.0.2 -s 4420 00:19:31.154 03:36:11 -- target/multiconnection.sh@30 -- # waitforserial SPDK4 00:19:31.154 03:36:11 -- common/autotest_common.sh@1187 -- # local i=0 00:19:31.154 03:36:11 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:31.154 03:36:11 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:31.154 03:36:11 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:33.059 03:36:13 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:33.059 03:36:13 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:33.059 03:36:13 -- common/autotest_common.sh@1196 -- # grep -c SPDK4 00:19:33.059 03:36:13 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:33.059 03:36:13 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:33.059 03:36:13 -- common/autotest_common.sh@1197 -- # return 0 00:19:33.059 03:36:13 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:33.059 03:36:13 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode5 -a 10.0.0.2 -s 4420 00:19:33.998 03:36:14 -- target/multiconnection.sh@30 -- # waitforserial SPDK5 00:19:33.998 03:36:14 -- common/autotest_common.sh@1187 -- # local i=0 00:19:33.998 03:36:14 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:33.999 03:36:14 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:33.999 03:36:14 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:35.905 03:36:16 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:35.905 03:36:16 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:35.905 03:36:16 -- common/autotest_common.sh@1196 -- # grep -c SPDK5 00:19:35.905 03:36:16 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:35.905 03:36:16 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:35.905 03:36:16 -- common/autotest_common.sh@1197 -- # return 0 00:19:35.905 03:36:16 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:35.905 03:36:16 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode6 -a 10.0.0.2 -s 4420 00:19:36.844 03:36:17 -- target/multiconnection.sh@30 -- # waitforserial SPDK6 00:19:36.844 03:36:17 -- common/autotest_common.sh@1187 -- # local i=0 00:19:36.844 03:36:17 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:36.844 03:36:17 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:36.844 03:36:17 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:38.751 03:36:19 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:38.751 03:36:19 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:38.751 03:36:19 -- common/autotest_common.sh@1196 -- # grep -c SPDK6 00:19:38.751 03:36:19 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:38.751 03:36:19 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:38.751 03:36:19 -- common/autotest_common.sh@1197 -- # return 0 00:19:38.751 03:36:19 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:38.751 03:36:19 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode7 -a 10.0.0.2 -s 4420 00:19:39.687 03:36:20 -- target/multiconnection.sh@30 -- # waitforserial SPDK7 00:19:39.687 03:36:20 -- common/autotest_common.sh@1187 -- # local i=0 00:19:39.687 03:36:20 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:39.687 03:36:20 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:39.687 03:36:20 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:41.588 03:36:22 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:41.588 03:36:22 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:41.588 03:36:22 -- common/autotest_common.sh@1196 -- # grep -c SPDK7 00:19:41.588 03:36:22 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:41.588 03:36:22 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:41.588 03:36:22 -- common/autotest_common.sh@1197 -- # return 0 00:19:41.588 03:36:22 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:41.588 03:36:22 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode8 -a 10.0.0.2 -s 4420 00:19:42.525 03:36:23 -- target/multiconnection.sh@30 -- # waitforserial SPDK8 00:19:42.525 03:36:23 -- common/autotest_common.sh@1187 -- # local i=0 00:19:42.525 03:36:23 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:42.525 03:36:23 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:42.525 03:36:23 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:44.429 03:36:25 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:44.429 03:36:25 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:44.429 03:36:25 -- common/autotest_common.sh@1196 -- # grep -c SPDK8 00:19:44.429 03:36:25 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:44.429 03:36:25 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:44.429 03:36:25 -- common/autotest_common.sh@1197 -- # return 0 00:19:44.429 03:36:25 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:44.429 03:36:25 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode9 -a 10.0.0.2 -s 4420 00:19:45.366 03:36:25 -- target/multiconnection.sh@30 -- # waitforserial SPDK9 00:19:45.366 03:36:25 -- common/autotest_common.sh@1187 -- # local i=0 00:19:45.366 03:36:25 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:45.366 03:36:25 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:45.366 03:36:25 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:47.902 03:36:27 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:47.902 03:36:27 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:47.902 03:36:27 -- common/autotest_common.sh@1196 -- # grep -c SPDK9 00:19:47.902 03:36:27 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:47.902 03:36:27 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:47.902 03:36:27 -- common/autotest_common.sh@1197 -- # return 0 00:19:47.902 03:36:27 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:47.902 03:36:27 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode10 -a 10.0.0.2 -s 4420 00:19:48.160 03:36:28 -- target/multiconnection.sh@30 -- # waitforserial SPDK10 00:19:48.160 03:36:28 -- common/autotest_common.sh@1187 -- # local i=0 00:19:48.160 03:36:28 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:48.160 03:36:28 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:48.160 03:36:28 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:50.064 03:36:30 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:50.064 03:36:30 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:50.064 03:36:30 -- common/autotest_common.sh@1196 -- # grep -c SPDK10 00:19:50.064 03:36:30 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:50.064 03:36:30 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:50.064 03:36:30 -- common/autotest_common.sh@1197 -- # return 0 00:19:50.064 03:36:30 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:50.064 03:36:30 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode11 -a 10.0.0.2 -s 4420 00:19:51.445 03:36:31 -- target/multiconnection.sh@30 -- # waitforserial SPDK11 00:19:51.445 03:36:31 -- common/autotest_common.sh@1187 -- # local i=0 00:19:51.445 03:36:31 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:51.445 03:36:31 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:51.445 03:36:31 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:53.349 03:36:33 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:53.349 03:36:33 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:53.349 03:36:33 -- common/autotest_common.sh@1196 -- # grep -c SPDK11 00:19:53.349 03:36:33 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:53.349 03:36:33 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:53.349 03:36:33 -- common/autotest_common.sh@1197 -- # return 0 00:19:53.349 03:36:33 -- target/multiconnection.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t read -r 10 00:19:53.349 [global] 00:19:53.349 thread=1 00:19:53.349 invalidate=1 00:19:53.349 rw=read 00:19:53.349 time_based=1 00:19:53.349 runtime=10 00:19:53.349 ioengine=libaio 00:19:53.349 direct=1 00:19:53.349 bs=262144 00:19:53.349 iodepth=64 00:19:53.349 norandommap=1 00:19:53.349 numjobs=1 00:19:53.349 00:19:53.349 [job0] 00:19:53.349 filename=/dev/nvme0n1 00:19:53.349 [job1] 00:19:53.349 filename=/dev/nvme10n1 00:19:53.349 [job2] 00:19:53.349 filename=/dev/nvme1n1 00:19:53.349 [job3] 00:19:53.349 filename=/dev/nvme2n1 00:19:53.349 [job4] 00:19:53.349 filename=/dev/nvme3n1 00:19:53.349 [job5] 00:19:53.349 filename=/dev/nvme4n1 00:19:53.349 [job6] 00:19:53.349 filename=/dev/nvme5n1 00:19:53.349 [job7] 00:19:53.349 filename=/dev/nvme6n1 00:19:53.349 [job8] 00:19:53.349 filename=/dev/nvme7n1 00:19:53.349 [job9] 00:19:53.349 filename=/dev/nvme8n1 00:19:53.349 [job10] 00:19:53.349 filename=/dev/nvme9n1 00:19:53.349 Could not set queue depth (nvme0n1) 00:19:53.349 Could not set queue depth (nvme10n1) 00:19:53.349 Could not set queue depth (nvme1n1) 00:19:53.349 Could not set queue depth (nvme2n1) 00:19:53.349 Could not set queue depth (nvme3n1) 00:19:53.349 Could not set queue depth (nvme4n1) 00:19:53.349 Could not set queue depth (nvme5n1) 00:19:53.349 Could not set queue depth (nvme6n1) 00:19:53.349 Could not set queue depth (nvme7n1) 00:19:53.349 Could not set queue depth (nvme8n1) 00:19:53.349 Could not set queue depth (nvme9n1) 00:19:53.609 job0: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:53.609 job1: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:53.609 job2: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:53.609 job3: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:53.609 job4: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:53.609 job5: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:53.609 job6: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:53.609 job7: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:53.609 job8: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:53.609 job9: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:53.609 job10: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:53.609 fio-3.35 00:19:53.609 Starting 11 threads 00:20:05.851 00:20:05.851 job0: (groupid=0, jobs=1): err= 0: pid=3092565: Thu Nov 21 03:36:44 2024 00:20:05.851 read: IOPS=741, BW=185MiB/s (194MB/s)(1875MiB/10121msec) 00:20:05.851 slat (usec): min=9, max=91276, avg=1197.63, stdev=4661.93 00:20:05.851 clat (usec): min=1383, max=294467, avg=85088.42, stdev=58541.07 00:20:05.851 lat (usec): min=1430, max=294511, avg=86286.05, stdev=59381.46 00:20:05.851 clat percentiles (msec): 00:20:05.851 | 1.00th=[ 5], 5.00th=[ 28], 10.00th=[ 29], 20.00th=[ 33], 00:20:05.851 | 30.00th=[ 45], 40.00th=[ 53], 50.00th=[ 65], 60.00th=[ 77], 00:20:05.851 | 70.00th=[ 100], 80.00th=[ 155], 90.00th=[ 178], 95.00th=[ 197], 00:20:05.851 | 99.00th=[ 230], 99.50th=[ 241], 99.90th=[ 275], 99.95th=[ 296], 00:20:05.851 | 99.99th=[ 296] 00:20:05.851 bw ( KiB/s): min=82432, max=461723, per=9.98%, avg=190394.35, stdev=122143.88, samples=20 00:20:05.851 iops : min= 322, max= 1803, avg=743.60, stdev=476.97, samples=20 00:20:05.851 lat (msec) : 2=0.01%, 4=0.91%, 10=0.69%, 20=0.35%, 50=34.21% 00:20:05.851 lat (msec) : 100=34.01%, 250=29.45%, 500=0.36% 00:20:05.851 cpu : usr=0.37%, sys=2.51%, ctx=1414, majf=0, minf=4097 00:20:05.851 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:20:05.851 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:05.851 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:05.851 issued rwts: total=7500,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:05.851 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:05.851 job1: (groupid=0, jobs=1): err= 0: pid=3092566: Thu Nov 21 03:36:44 2024 00:20:05.851 read: IOPS=641, BW=160MiB/s (168MB/s)(1624MiB/10127msec) 00:20:05.851 slat (usec): min=15, max=113436, avg=1466.67, stdev=5310.73 00:20:05.851 clat (msec): min=4, max=309, avg=98.21, stdev=58.51 00:20:05.851 lat (msec): min=4, max=309, avg=99.67, stdev=59.41 00:20:05.851 clat percentiles (msec): 00:20:05.851 | 1.00th=[ 17], 5.00th=[ 32], 10.00th=[ 39], 20.00th=[ 47], 00:20:05.851 | 30.00th=[ 54], 40.00th=[ 63], 50.00th=[ 73], 60.00th=[ 105], 00:20:05.851 | 70.00th=[ 140], 80.00th=[ 165], 90.00th=[ 182], 95.00th=[ 197], 00:20:05.851 | 99.00th=[ 236], 99.50th=[ 249], 99.90th=[ 300], 99.95th=[ 309], 00:20:05.851 | 99.99th=[ 309] 00:20:05.851 bw ( KiB/s): min=80896, max=386810, per=8.63%, avg=164606.95, stdev=94622.05, samples=20 00:20:05.851 iops : min= 316, max= 1510, avg=642.90, stdev=369.45, samples=20 00:20:05.851 lat (msec) : 10=0.29%, 20=1.74%, 50=23.18%, 100=33.61%, 250=40.86% 00:20:05.851 lat (msec) : 500=0.32% 00:20:05.851 cpu : usr=0.51%, sys=2.02%, ctx=1153, majf=0, minf=3721 00:20:05.851 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.0% 00:20:05.851 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:05.851 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:05.851 issued rwts: total=6496,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:05.851 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:05.851 job2: (groupid=0, jobs=1): err= 0: pid=3092567: Thu Nov 21 03:36:44 2024 00:20:05.851 read: IOPS=977, BW=244MiB/s (256MB/s)(2452MiB/10032msec) 00:20:05.851 slat (usec): min=9, max=100005, avg=614.93, stdev=3096.63 00:20:05.851 clat (usec): min=902, max=244652, avg=64810.68, stdev=40085.53 00:20:05.851 lat (usec): min=926, max=303886, avg=65425.61, stdev=40427.38 00:20:05.851 clat percentiles (msec): 00:20:05.851 | 1.00th=[ 5], 5.00th=[ 13], 10.00th=[ 22], 20.00th=[ 31], 00:20:05.851 | 30.00th=[ 40], 40.00th=[ 47], 50.00th=[ 57], 60.00th=[ 67], 00:20:05.851 | 70.00th=[ 83], 80.00th=[ 97], 90.00th=[ 117], 95.00th=[ 144], 00:20:05.851 | 99.00th=[ 184], 99.50th=[ 194], 99.90th=[ 220], 99.95th=[ 232], 00:20:05.851 | 99.99th=[ 245] 00:20:05.851 bw ( KiB/s): min=135680, max=407040, per=13.07%, avg=249425.30, stdev=89141.54, samples=20 00:20:05.851 iops : min= 530, max= 1590, avg=974.20, stdev=348.23, samples=20 00:20:05.851 lat (usec) : 1000=0.02% 00:20:05.851 lat (msec) : 2=0.03%, 4=0.49%, 10=3.04%, 20=5.37%, 50=34.82% 00:20:05.851 lat (msec) : 100=37.66%, 250=18.57% 00:20:05.851 cpu : usr=0.35%, sys=2.51%, ctx=1979, majf=0, minf=4097 00:20:05.851 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.4% 00:20:05.851 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:05.851 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:05.851 issued rwts: total=9806,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:05.851 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:05.851 job3: (groupid=0, jobs=1): err= 0: pid=3092574: Thu Nov 21 03:36:44 2024 00:20:05.851 read: IOPS=778, BW=195MiB/s (204MB/s)(1955MiB/10038msec) 00:20:05.851 slat (usec): min=9, max=88290, avg=1097.17, stdev=3835.73 00:20:05.851 clat (msec): min=4, max=219, avg=81.01, stdev=33.66 00:20:05.851 lat (msec): min=4, max=244, avg=82.11, stdev=34.16 00:20:05.851 clat percentiles (msec): 00:20:05.851 | 1.00th=[ 17], 5.00th=[ 31], 10.00th=[ 36], 20.00th=[ 52], 00:20:05.851 | 30.00th=[ 62], 40.00th=[ 72], 50.00th=[ 82], 60.00th=[ 90], 00:20:05.851 | 70.00th=[ 99], 80.00th=[ 109], 90.00th=[ 125], 95.00th=[ 142], 00:20:05.851 | 99.00th=[ 163], 99.50th=[ 174], 99.90th=[ 178], 99.95th=[ 194], 00:20:05.851 | 99.99th=[ 220] 00:20:05.851 bw ( KiB/s): min=134656, max=417280, per=10.40%, avg=198487.95, stdev=62160.64, samples=20 00:20:05.851 iops : min= 526, max= 1630, avg=775.25, stdev=242.85, samples=20 00:20:05.851 lat (msec) : 10=0.26%, 20=1.73%, 50=17.54%, 100=52.21%, 250=28.27% 00:20:05.851 cpu : usr=0.47%, sys=2.56%, ctx=1470, majf=0, minf=4097 00:20:05.851 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:20:05.851 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:05.851 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:05.851 issued rwts: total=7818,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:05.851 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:05.851 job4: (groupid=0, jobs=1): err= 0: pid=3092581: Thu Nov 21 03:36:44 2024 00:20:05.851 read: IOPS=497, BW=124MiB/s (130MB/s)(1259MiB/10124msec) 00:20:05.851 slat (usec): min=14, max=78551, avg=1713.00, stdev=5439.18 00:20:05.851 clat (msec): min=39, max=311, avg=126.82, stdev=46.24 00:20:05.851 lat (msec): min=39, max=311, avg=128.53, stdev=47.07 00:20:05.851 clat percentiles (msec): 00:20:05.851 | 1.00th=[ 47], 5.00th=[ 59], 10.00th=[ 65], 20.00th=[ 81], 00:20:05.851 | 30.00th=[ 97], 40.00th=[ 112], 50.00th=[ 126], 60.00th=[ 142], 00:20:05.851 | 70.00th=[ 155], 80.00th=[ 169], 90.00th=[ 186], 95.00th=[ 203], 00:20:05.851 | 99.00th=[ 232], 99.50th=[ 247], 99.90th=[ 296], 99.95th=[ 296], 00:20:05.851 | 99.99th=[ 313] 00:20:05.851 bw ( KiB/s): min=81920, max=222208, per=6.67%, avg=127275.65, stdev=41128.11, samples=20 00:20:05.851 iops : min= 320, max= 868, avg=497.05, stdev=160.60, samples=20 00:20:05.851 lat (msec) : 50=1.79%, 100=29.77%, 250=68.03%, 500=0.42% 00:20:05.851 cpu : usr=0.32%, sys=1.80%, ctx=1078, majf=0, minf=4097 00:20:05.851 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.7% 00:20:05.851 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:05.851 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:05.851 issued rwts: total=5036,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:05.852 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:05.852 job5: (groupid=0, jobs=1): err= 0: pid=3092607: Thu Nov 21 03:36:44 2024 00:20:05.852 read: IOPS=587, BW=147MiB/s (154MB/s)(1488MiB/10120msec) 00:20:05.852 slat (usec): min=13, max=112442, avg=1581.55, stdev=5196.34 00:20:05.852 clat (msec): min=24, max=329, avg=107.18, stdev=42.59 00:20:05.852 lat (msec): min=26, max=329, avg=108.76, stdev=43.18 00:20:05.852 clat percentiles (msec): 00:20:05.852 | 1.00th=[ 29], 5.00th=[ 47], 10.00th=[ 57], 20.00th=[ 72], 00:20:05.852 | 30.00th=[ 84], 40.00th=[ 92], 50.00th=[ 102], 60.00th=[ 113], 00:20:05.852 | 70.00th=[ 125], 80.00th=[ 144], 90.00th=[ 169], 95.00th=[ 186], 00:20:05.852 | 99.00th=[ 211], 99.50th=[ 239], 99.90th=[ 313], 99.95th=[ 313], 00:20:05.852 | 99.99th=[ 330] 00:20:05.852 bw ( KiB/s): min=87040, max=293376, per=7.90%, avg=150645.35, stdev=52443.94, samples=20 00:20:05.852 iops : min= 340, max= 1146, avg=588.35, stdev=204.89, samples=20 00:20:05.852 lat (msec) : 50=7.29%, 100=41.09%, 250=51.28%, 500=0.34% 00:20:05.852 cpu : usr=0.27%, sys=2.16%, ctx=1112, majf=0, minf=4097 00:20:05.852 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=98.9% 00:20:05.852 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:05.852 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:05.852 issued rwts: total=5950,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:05.852 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:05.852 job6: (groupid=0, jobs=1): err= 0: pid=3092622: Thu Nov 21 03:36:44 2024 00:20:05.852 read: IOPS=575, BW=144MiB/s (151MB/s)(1455MiB/10119msec) 00:20:05.852 slat (usec): min=13, max=130097, avg=1534.07, stdev=5718.57 00:20:05.852 clat (usec): min=1266, max=325491, avg=109649.62, stdev=61719.45 00:20:05.852 lat (usec): min=1287, max=325525, avg=111183.69, stdev=62749.91 00:20:05.852 clat percentiles (msec): 00:20:05.852 | 1.00th=[ 3], 5.00th=[ 6], 10.00th=[ 17], 20.00th=[ 51], 00:20:05.852 | 30.00th=[ 73], 40.00th=[ 95], 50.00th=[ 112], 60.00th=[ 133], 00:20:05.852 | 70.00th=[ 155], 80.00th=[ 169], 90.00th=[ 186], 95.00th=[ 201], 00:20:05.852 | 99.00th=[ 226], 99.50th=[ 253], 99.90th=[ 279], 99.95th=[ 279], 00:20:05.852 | 99.99th=[ 326] 00:20:05.852 bw ( KiB/s): min=82944, max=281600, per=7.72%, avg=147274.95, stdev=61051.72, samples=20 00:20:05.852 iops : min= 324, max= 1100, avg=575.20, stdev=238.47, samples=20 00:20:05.852 lat (msec) : 2=0.57%, 4=3.66%, 10=3.13%, 20=4.14%, 50=8.40% 00:20:05.852 lat (msec) : 100=22.94%, 250=56.62%, 500=0.55% 00:20:05.852 cpu : usr=0.35%, sys=1.95%, ctx=1271, majf=0, minf=4097 00:20:05.852 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=98.9% 00:20:05.852 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:05.852 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:05.852 issued rwts: total=5820,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:05.852 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:05.852 job7: (groupid=0, jobs=1): err= 0: pid=3092640: Thu Nov 21 03:36:44 2024 00:20:05.852 read: IOPS=809, BW=202MiB/s (212MB/s)(2036MiB/10057msec) 00:20:05.852 slat (usec): min=9, max=107241, avg=765.78, stdev=3279.54 00:20:05.852 clat (usec): min=837, max=230591, avg=78217.61, stdev=41869.13 00:20:05.852 lat (usec): min=895, max=235938, avg=78983.39, stdev=42276.41 00:20:05.852 clat percentiles (msec): 00:20:05.852 | 1.00th=[ 5], 5.00th=[ 11], 10.00th=[ 23], 20.00th=[ 43], 00:20:05.852 | 30.00th=[ 56], 40.00th=[ 67], 50.00th=[ 79], 60.00th=[ 86], 00:20:05.852 | 70.00th=[ 95], 80.00th=[ 107], 90.00th=[ 136], 95.00th=[ 161], 00:20:05.852 | 99.00th=[ 190], 99.50th=[ 209], 99.90th=[ 222], 99.95th=[ 226], 00:20:05.852 | 99.99th=[ 230] 00:20:05.852 bw ( KiB/s): min=120320, max=290816, per=10.84%, avg=206778.20, stdev=50506.17, samples=20 00:20:05.852 iops : min= 470, max= 1136, avg=807.65, stdev=197.37, samples=20 00:20:05.852 lat (usec) : 1000=0.02% 00:20:05.852 lat (msec) : 2=0.15%, 4=0.56%, 10=3.70%, 20=4.20%, 50=16.76% 00:20:05.852 lat (msec) : 100=49.67%, 250=24.93% 00:20:05.852 cpu : usr=0.37%, sys=2.33%, ctx=1889, majf=0, minf=4097 00:20:05.852 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:20:05.852 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:05.852 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:05.852 issued rwts: total=8142,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:05.852 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:05.852 job8: (groupid=0, jobs=1): err= 0: pid=3092694: Thu Nov 21 03:36:44 2024 00:20:05.852 read: IOPS=568, BW=142MiB/s (149MB/s)(1439MiB/10127msec) 00:20:05.852 slat (usec): min=9, max=113318, avg=1235.29, stdev=5102.72 00:20:05.852 clat (msec): min=3, max=320, avg=111.27, stdev=51.73 00:20:05.852 lat (msec): min=3, max=320, avg=112.51, stdev=52.76 00:20:05.852 clat percentiles (msec): 00:20:05.852 | 1.00th=[ 14], 5.00th=[ 34], 10.00th=[ 46], 20.00th=[ 63], 00:20:05.852 | 30.00th=[ 75], 40.00th=[ 92], 50.00th=[ 114], 60.00th=[ 127], 00:20:05.852 | 70.00th=[ 142], 80.00th=[ 159], 90.00th=[ 182], 95.00th=[ 199], 00:20:05.852 | 99.00th=[ 224], 99.50th=[ 234], 99.90th=[ 296], 99.95th=[ 296], 00:20:05.852 | 99.99th=[ 321] 00:20:05.852 bw ( KiB/s): min=83456, max=256512, per=7.64%, avg=145705.85, stdev=59094.36, samples=20 00:20:05.852 iops : min= 326, max= 1002, avg=569.15, stdev=230.84, samples=20 00:20:05.852 lat (msec) : 4=0.02%, 10=0.40%, 20=1.74%, 50=10.44%, 100=31.12% 00:20:05.852 lat (msec) : 250=55.99%, 500=0.30% 00:20:05.852 cpu : usr=0.38%, sys=1.89%, ctx=1325, majf=0, minf=4097 00:20:05.852 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:20:05.852 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:05.852 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:05.852 issued rwts: total=5755,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:05.852 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:05.852 job9: (groupid=0, jobs=1): err= 0: pid=3092717: Thu Nov 21 03:36:44 2024 00:20:05.852 read: IOPS=573, BW=143MiB/s (150MB/s)(1438MiB/10039msec) 00:20:05.852 slat (usec): min=12, max=77752, avg=1597.83, stdev=4722.05 00:20:05.852 clat (usec): min=931, max=228243, avg=109975.68, stdev=36816.91 00:20:05.852 lat (usec): min=989, max=258812, avg=111573.51, stdev=37450.88 00:20:05.852 clat percentiles (msec): 00:20:05.852 | 1.00th=[ 5], 5.00th=[ 63], 10.00th=[ 68], 20.00th=[ 79], 00:20:05.852 | 30.00th=[ 89], 40.00th=[ 96], 50.00th=[ 105], 60.00th=[ 116], 00:20:05.852 | 70.00th=[ 129], 80.00th=[ 146], 90.00th=[ 161], 95.00th=[ 176], 00:20:05.852 | 99.00th=[ 192], 99.50th=[ 199], 99.90th=[ 211], 99.95th=[ 224], 00:20:05.852 | 99.99th=[ 228] 00:20:05.852 bw ( KiB/s): min=90112, max=213504, per=7.63%, avg=145639.05, stdev=39926.03, samples=20 00:20:05.852 iops : min= 352, max= 834, avg=568.80, stdev=156.04, samples=20 00:20:05.852 lat (usec) : 1000=0.02% 00:20:05.852 lat (msec) : 2=0.24%, 4=0.64%, 10=0.66%, 20=0.02%, 50=0.14% 00:20:05.852 lat (msec) : 100=43.84%, 250=54.44% 00:20:05.852 cpu : usr=0.34%, sys=2.14%, ctx=1196, majf=0, minf=4097 00:20:05.852 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:20:05.852 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:05.852 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:05.852 issued rwts: total=5753,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:05.852 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:05.852 job10: (groupid=0, jobs=1): err= 0: pid=3092727: Thu Nov 21 03:36:44 2024 00:20:05.852 read: IOPS=736, BW=184MiB/s (193MB/s)(1851MiB/10052msec) 00:20:05.852 slat (usec): min=9, max=91763, avg=911.08, stdev=3430.93 00:20:05.852 clat (usec): min=866, max=241316, avg=85914.49, stdev=42146.71 00:20:05.852 lat (usec): min=891, max=284222, avg=86825.58, stdev=42497.75 00:20:05.852 clat percentiles (msec): 00:20:05.852 | 1.00th=[ 4], 5.00th=[ 20], 10.00th=[ 37], 20.00th=[ 51], 00:20:05.852 | 30.00th=[ 65], 40.00th=[ 75], 50.00th=[ 83], 60.00th=[ 89], 00:20:05.852 | 70.00th=[ 100], 80.00th=[ 116], 90.00th=[ 148], 95.00th=[ 165], 00:20:05.852 | 99.00th=[ 207], 99.50th=[ 213], 99.90th=[ 226], 99.95th=[ 232], 00:20:05.852 | 99.99th=[ 243] 00:20:05.852 bw ( KiB/s): min=96256, max=289213, per=9.85%, avg=187875.15, stdev=53918.02, samples=20 00:20:05.852 iops : min= 376, max= 1129, avg=733.80, stdev=210.62, samples=20 00:20:05.852 lat (usec) : 1000=0.01% 00:20:05.852 lat (msec) : 2=0.15%, 4=1.12%, 10=1.36%, 20=2.39%, 50=14.13% 00:20:05.852 lat (msec) : 100=51.97%, 250=28.87% 00:20:05.852 cpu : usr=0.32%, sys=2.22%, ctx=1569, majf=0, minf=4097 00:20:05.852 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.1% 00:20:05.852 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:05.852 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:05.852 issued rwts: total=7403,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:05.852 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:05.852 00:20:05.852 Run status group 0 (all jobs): 00:20:05.852 READ: bw=1863MiB/s (1954MB/s), 124MiB/s-244MiB/s (130MB/s-256MB/s), io=18.4GiB (19.8GB), run=10032-10127msec 00:20:05.852 00:20:05.852 Disk stats (read/write): 00:20:05.852 nvme0n1: ios=14853/0, merge=0/0, ticks=1231111/0, in_queue=1231111, util=97.07% 00:20:05.852 nvme10n1: ios=12820/0, merge=0/0, ticks=1225750/0, in_queue=1225750, util=97.32% 00:20:05.852 nvme1n1: ios=19321/0, merge=0/0, ticks=1240718/0, in_queue=1240718, util=97.55% 00:20:05.852 nvme2n1: ios=15393/0, merge=0/0, ticks=1234679/0, in_queue=1234679, util=97.71% 00:20:05.852 nvme3n1: ios=9900/0, merge=0/0, ticks=1225151/0, in_queue=1225151, util=97.79% 00:20:05.852 nvme4n1: ios=11725/0, merge=0/0, ticks=1223513/0, in_queue=1223513, util=98.13% 00:20:05.852 nvme5n1: ios=11479/0, merge=0/0, ticks=1224952/0, in_queue=1224952, util=98.29% 00:20:05.853 nvme6n1: ios=16003/0, merge=0/0, ticks=1238885/0, in_queue=1238885, util=98.44% 00:20:05.853 nvme7n1: ios=11298/0, merge=0/0, ticks=1226357/0, in_queue=1226357, util=98.87% 00:20:05.853 nvme8n1: ios=11295/0, merge=0/0, ticks=1232308/0, in_queue=1232308, util=99.08% 00:20:05.853 nvme9n1: ios=14506/0, merge=0/0, ticks=1241908/0, in_queue=1241908, util=99.22% 00:20:05.853 03:36:44 -- target/multiconnection.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t randwrite -r 10 00:20:05.853 [global] 00:20:05.853 thread=1 00:20:05.853 invalidate=1 00:20:05.853 rw=randwrite 00:20:05.853 time_based=1 00:20:05.853 runtime=10 00:20:05.853 ioengine=libaio 00:20:05.853 direct=1 00:20:05.853 bs=262144 00:20:05.853 iodepth=64 00:20:05.853 norandommap=1 00:20:05.853 numjobs=1 00:20:05.853 00:20:05.853 [job0] 00:20:05.853 filename=/dev/nvme0n1 00:20:05.853 [job1] 00:20:05.853 filename=/dev/nvme10n1 00:20:05.853 [job2] 00:20:05.853 filename=/dev/nvme1n1 00:20:05.853 [job3] 00:20:05.853 filename=/dev/nvme2n1 00:20:05.853 [job4] 00:20:05.853 filename=/dev/nvme3n1 00:20:05.853 [job5] 00:20:05.853 filename=/dev/nvme4n1 00:20:05.853 [job6] 00:20:05.853 filename=/dev/nvme5n1 00:20:05.853 [job7] 00:20:05.853 filename=/dev/nvme6n1 00:20:05.853 [job8] 00:20:05.853 filename=/dev/nvme7n1 00:20:05.853 [job9] 00:20:05.853 filename=/dev/nvme8n1 00:20:05.853 [job10] 00:20:05.853 filename=/dev/nvme9n1 00:20:05.853 Could not set queue depth (nvme0n1) 00:20:05.853 Could not set queue depth (nvme10n1) 00:20:05.853 Could not set queue depth (nvme1n1) 00:20:05.853 Could not set queue depth (nvme2n1) 00:20:05.853 Could not set queue depth (nvme3n1) 00:20:05.853 Could not set queue depth (nvme4n1) 00:20:05.853 Could not set queue depth (nvme5n1) 00:20:05.853 Could not set queue depth (nvme6n1) 00:20:05.853 Could not set queue depth (nvme7n1) 00:20:05.853 Could not set queue depth (nvme8n1) 00:20:05.853 Could not set queue depth (nvme9n1) 00:20:05.853 job0: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:05.853 job1: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:05.853 job2: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:05.853 job3: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:05.853 job4: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:05.853 job5: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:05.853 job6: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:05.853 job7: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:05.853 job8: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:05.853 job9: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:05.853 job10: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:05.853 fio-3.35 00:20:05.853 Starting 11 threads 00:20:15.833 00:20:15.833 job0: (groupid=0, jobs=1): err= 0: pid=3093769: Thu Nov 21 03:36:55 2024 00:20:15.833 write: IOPS=475, BW=119MiB/s (125MB/s)(1200MiB/10091msec); 0 zone resets 00:20:15.833 slat (usec): min=19, max=53155, avg=1593.01, stdev=4343.79 00:20:15.833 clat (usec): min=1280, max=368736, avg=132892.95, stdev=92114.01 00:20:15.833 lat (usec): min=1374, max=370633, avg=134485.97, stdev=93298.56 00:20:15.833 clat percentiles (msec): 00:20:15.833 | 1.00th=[ 4], 5.00th=[ 14], 10.00th=[ 39], 20.00th=[ 68], 00:20:15.833 | 30.00th=[ 75], 40.00th=[ 79], 50.00th=[ 88], 60.00th=[ 129], 00:20:15.833 | 70.00th=[ 178], 80.00th=[ 230], 90.00th=[ 284], 95.00th=[ 309], 00:20:15.833 | 99.00th=[ 351], 99.50th=[ 359], 99.90th=[ 368], 99.95th=[ 368], 00:20:15.833 | 99.99th=[ 368] 00:20:15.833 bw ( KiB/s): min=51200, max=229376, per=9.34%, avg=121194.20, stdev=57949.80, samples=20 00:20:15.833 iops : min= 200, max= 896, avg=473.35, stdev=226.37, samples=20 00:20:15.833 lat (msec) : 2=0.10%, 4=0.92%, 10=3.36%, 20=2.42%, 50=7.25% 00:20:15.833 lat (msec) : 100=41.60%, 250=27.99%, 500=16.36% 00:20:15.833 cpu : usr=1.67%, sys=1.62%, ctx=2313, majf=0, minf=1 00:20:15.833 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.7% 00:20:15.833 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:15.833 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:15.833 issued rwts: total=0,4798,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:15.833 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:15.833 job1: (groupid=0, jobs=1): err= 0: pid=3093781: Thu Nov 21 03:36:55 2024 00:20:15.833 write: IOPS=476, BW=119MiB/s (125MB/s)(1210MiB/10156msec); 0 zone resets 00:20:15.833 slat (usec): min=17, max=93154, avg=1442.42, stdev=4540.90 00:20:15.833 clat (usec): min=1150, max=407174, avg=132782.50, stdev=87722.49 00:20:15.833 lat (usec): min=1191, max=407218, avg=134224.93, stdev=88834.43 00:20:15.833 clat percentiles (msec): 00:20:15.833 | 1.00th=[ 4], 5.00th=[ 10], 10.00th=[ 20], 20.00th=[ 56], 00:20:15.833 | 30.00th=[ 85], 40.00th=[ 111], 50.00th=[ 124], 60.00th=[ 140], 00:20:15.833 | 70.00th=[ 161], 80.00th=[ 197], 90.00th=[ 249], 95.00th=[ 326], 00:20:15.833 | 99.00th=[ 380], 99.50th=[ 388], 99.90th=[ 405], 99.95th=[ 409], 00:20:15.833 | 99.99th=[ 409] 00:20:15.833 bw ( KiB/s): min=36864, max=214528, per=9.42%, avg=122277.70, stdev=51939.42, samples=20 00:20:15.833 iops : min= 144, max= 838, avg=477.55, stdev=202.92, samples=20 00:20:15.834 lat (msec) : 2=0.14%, 4=1.05%, 10=4.13%, 20=4.94%, 50=7.15% 00:20:15.834 lat (msec) : 100=16.30%, 250=56.59%, 500=9.69% 00:20:15.834 cpu : usr=1.47%, sys=1.82%, ctx=2744, majf=0, minf=2 00:20:15.834 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.7% 00:20:15.834 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:15.834 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:15.834 issued rwts: total=0,4840,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:15.834 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:15.834 job2: (groupid=0, jobs=1): err= 0: pid=3093782: Thu Nov 21 03:36:55 2024 00:20:15.834 write: IOPS=471, BW=118MiB/s (124MB/s)(1192MiB/10104msec); 0 zone resets 00:20:15.834 slat (usec): min=19, max=78243, avg=1702.28, stdev=4647.78 00:20:15.834 clat (usec): min=870, max=403420, avg=133841.36, stdev=89257.56 00:20:15.834 lat (usec): min=895, max=403521, avg=135543.65, stdev=90601.97 00:20:15.834 clat percentiles (msec): 00:20:15.834 | 1.00th=[ 9], 5.00th=[ 18], 10.00th=[ 28], 20.00th=[ 47], 00:20:15.834 | 30.00th=[ 79], 40.00th=[ 104], 50.00th=[ 113], 60.00th=[ 140], 00:20:15.834 | 70.00th=[ 161], 80.00th=[ 211], 90.00th=[ 284], 95.00th=[ 305], 00:20:15.834 | 99.00th=[ 355], 99.50th=[ 376], 99.90th=[ 405], 99.95th=[ 405], 00:20:15.834 | 99.99th=[ 405] 00:20:15.834 bw ( KiB/s): min=49152, max=264704, per=9.28%, avg=120473.60, stdev=60451.18, samples=20 00:20:15.834 iops : min= 192, max= 1034, avg=470.60, stdev=236.14, samples=20 00:20:15.834 lat (usec) : 1000=0.02% 00:20:15.834 lat (msec) : 2=0.17%, 4=0.19%, 10=1.24%, 20=4.40%, 50=15.08% 00:20:15.834 lat (msec) : 100=17.11%, 250=46.63%, 500=15.16% 00:20:15.834 cpu : usr=1.33%, sys=1.71%, ctx=2444, majf=0, minf=1 00:20:15.834 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.7% 00:20:15.834 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:15.834 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:15.834 issued rwts: total=0,4769,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:15.834 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:15.834 job3: (groupid=0, jobs=1): err= 0: pid=3093783: Thu Nov 21 03:36:55 2024 00:20:15.834 write: IOPS=431, BW=108MiB/s (113MB/s)(1090MiB/10105msec); 0 zone resets 00:20:15.834 slat (usec): min=19, max=126006, avg=1927.71, stdev=5594.02 00:20:15.834 clat (usec): min=1105, max=358362, avg=146237.73, stdev=104478.08 00:20:15.834 lat (usec): min=1162, max=358403, avg=148165.44, stdev=105969.00 00:20:15.834 clat percentiles (msec): 00:20:15.834 | 1.00th=[ 3], 5.00th=[ 7], 10.00th=[ 12], 20.00th=[ 26], 00:20:15.834 | 30.00th=[ 64], 40.00th=[ 91], 50.00th=[ 148], 60.00th=[ 188], 00:20:15.834 | 70.00th=[ 228], 80.00th=[ 253], 90.00th=[ 288], 95.00th=[ 309], 00:20:15.834 | 99.00th=[ 338], 99.50th=[ 351], 99.90th=[ 359], 99.95th=[ 359], 00:20:15.834 | 99.99th=[ 359] 00:20:15.834 bw ( KiB/s): min=51200, max=229835, per=8.48%, avg=110009.70, stdev=58306.91, samples=20 00:20:15.834 iops : min= 200, max= 897, avg=429.65, stdev=227.69, samples=20 00:20:15.834 lat (msec) : 2=0.46%, 4=1.63%, 10=6.65%, 20=7.34%, 50=11.56% 00:20:15.834 lat (msec) : 100=14.95%, 250=36.64%, 500=20.78% 00:20:15.834 cpu : usr=1.34%, sys=1.55%, ctx=2296, majf=0, minf=1 00:20:15.834 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.7%, >=64=98.6% 00:20:15.834 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:15.834 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:15.834 issued rwts: total=0,4361,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:15.834 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:15.834 job4: (groupid=0, jobs=1): err= 0: pid=3093784: Thu Nov 21 03:36:55 2024 00:20:15.834 write: IOPS=526, BW=132MiB/s (138MB/s)(1327MiB/10092msec); 0 zone resets 00:20:15.834 slat (usec): min=16, max=114958, avg=1307.97, stdev=4517.16 00:20:15.834 clat (usec): min=1019, max=432544, avg=120240.29, stdev=96132.49 00:20:15.834 lat (usec): min=1059, max=432606, avg=121548.26, stdev=97447.76 00:20:15.834 clat percentiles (msec): 00:20:15.834 | 1.00th=[ 3], 5.00th=[ 10], 10.00th=[ 16], 20.00th=[ 32], 00:20:15.834 | 30.00th=[ 44], 40.00th=[ 70], 50.00th=[ 101], 60.00th=[ 127], 00:20:15.834 | 70.00th=[ 163], 80.00th=[ 211], 90.00th=[ 259], 95.00th=[ 300], 00:20:15.834 | 99.00th=[ 368], 99.50th=[ 401], 99.90th=[ 422], 99.95th=[ 430], 00:20:15.834 | 99.99th=[ 435] 00:20:15.834 bw ( KiB/s): min=43008, max=332800, per=10.35%, avg=134285.45, stdev=79377.84, samples=20 00:20:15.834 iops : min= 168, max= 1300, avg=524.45, stdev=310.11, samples=20 00:20:15.834 lat (msec) : 2=0.70%, 4=1.24%, 10=3.28%, 20=7.95%, 50=21.13% 00:20:15.834 lat (msec) : 100=15.75%, 250=38.12%, 500=11.83% 00:20:15.834 cpu : usr=1.72%, sys=1.85%, ctx=3461, majf=0, minf=1 00:20:15.834 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:20:15.834 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:15.834 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:15.834 issued rwts: total=0,5309,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:15.834 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:15.834 job5: (groupid=0, jobs=1): err= 0: pid=3093791: Thu Nov 21 03:36:55 2024 00:20:15.834 write: IOPS=462, BW=116MiB/s (121MB/s)(1175MiB/10150msec); 0 zone resets 00:20:15.834 slat (usec): min=20, max=99456, avg=1572.90, stdev=4560.10 00:20:15.834 clat (usec): min=835, max=373137, avg=136604.70, stdev=90619.94 00:20:15.834 lat (usec): min=893, max=373178, avg=138177.60, stdev=91652.00 00:20:15.834 clat percentiles (msec): 00:20:15.834 | 1.00th=[ 4], 5.00th=[ 13], 10.00th=[ 25], 20.00th=[ 54], 00:20:15.834 | 30.00th=[ 60], 40.00th=[ 103], 50.00th=[ 138], 60.00th=[ 157], 00:20:15.834 | 70.00th=[ 174], 80.00th=[ 205], 90.00th=[ 275], 95.00th=[ 313], 00:20:15.834 | 99.00th=[ 351], 99.50th=[ 368], 99.90th=[ 372], 99.95th=[ 372], 00:20:15.834 | 99.99th=[ 372] 00:20:15.834 bw ( KiB/s): min=45056, max=263153, per=9.14%, avg=118660.60, stdev=56065.92, samples=20 00:20:15.834 iops : min= 176, max= 1027, avg=463.45, stdev=218.89, samples=20 00:20:15.834 lat (usec) : 1000=0.06% 00:20:15.834 lat (msec) : 2=0.40%, 4=0.70%, 10=2.43%, 20=5.13%, 50=8.38% 00:20:15.834 lat (msec) : 100=22.30%, 250=47.52%, 500=13.07% 00:20:15.834 cpu : usr=1.45%, sys=1.74%, ctx=2441, majf=0, minf=1 00:20:15.834 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.7% 00:20:15.834 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:15.834 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:15.834 issued rwts: total=0,4699,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:15.834 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:15.834 job6: (groupid=0, jobs=1): err= 0: pid=3093792: Thu Nov 21 03:36:55 2024 00:20:15.834 write: IOPS=348, BW=87.1MiB/s (91.3MB/s)(882MiB/10129msec); 0 zone resets 00:20:15.834 slat (usec): min=18, max=64047, avg=2010.50, stdev=5611.17 00:20:15.834 clat (msec): min=3, max=388, avg=181.60, stdev=93.07 00:20:15.834 lat (msec): min=3, max=388, avg=183.61, stdev=94.53 00:20:15.834 clat percentiles (msec): 00:20:15.834 | 1.00th=[ 10], 5.00th=[ 25], 10.00th=[ 40], 20.00th=[ 84], 00:20:15.834 | 30.00th=[ 111], 40.00th=[ 174], 50.00th=[ 209], 60.00th=[ 226], 00:20:15.834 | 70.00th=[ 239], 80.00th=[ 257], 90.00th=[ 300], 95.00th=[ 326], 00:20:15.834 | 99.00th=[ 342], 99.50th=[ 347], 99.90th=[ 363], 99.95th=[ 388], 00:20:15.834 | 99.99th=[ 388] 00:20:15.834 bw ( KiB/s): min=47104, max=153600, per=6.83%, avg=88688.55, stdev=36280.96, samples=20 00:20:15.834 iops : min= 184, max= 600, avg=346.40, stdev=141.74, samples=20 00:20:15.834 lat (msec) : 4=0.03%, 10=1.22%, 20=2.66%, 50=7.85%, 100=13.69% 00:20:15.834 lat (msec) : 250=50.96%, 500=23.58% 00:20:15.834 cpu : usr=1.15%, sys=1.23%, ctx=2066, majf=0, minf=1 00:20:15.834 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.5%, 32=0.9%, >=64=98.2% 00:20:15.834 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:15.834 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:15.834 issued rwts: total=0,3528,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:15.834 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:15.834 job7: (groupid=0, jobs=1): err= 0: pid=3093793: Thu Nov 21 03:36:55 2024 00:20:15.834 write: IOPS=608, BW=152MiB/s (159MB/s)(1543MiB/10152msec); 0 zone resets 00:20:15.834 slat (usec): min=16, max=339669, avg=1115.30, stdev=6802.78 00:20:15.834 clat (usec): min=1207, max=684421, avg=104069.46, stdev=80205.64 00:20:15.834 lat (usec): min=1267, max=699393, avg=105184.77, stdev=81021.83 00:20:15.834 clat percentiles (msec): 00:20:15.834 | 1.00th=[ 6], 5.00th=[ 17], 10.00th=[ 29], 20.00th=[ 55], 00:20:15.834 | 30.00th=[ 72], 40.00th=[ 75], 50.00th=[ 78], 60.00th=[ 86], 00:20:15.834 | 70.00th=[ 108], 80.00th=[ 148], 90.00th=[ 211], 95.00th=[ 262], 00:20:15.834 | 99.00th=[ 384], 99.50th=[ 542], 99.90th=[ 667], 99.95th=[ 684], 00:20:15.834 | 99.99th=[ 684] 00:20:15.834 bw ( KiB/s): min=65024, max=250368, per=12.05%, avg=156398.30, stdev=61421.07, samples=20 00:20:15.834 iops : min= 254, max= 978, avg=610.90, stdev=239.92, samples=20 00:20:15.834 lat (msec) : 2=0.10%, 4=0.50%, 10=1.72%, 20=4.10%, 50=11.26% 00:20:15.834 lat (msec) : 100=47.59%, 250=28.85%, 500=5.20%, 750=0.68% 00:20:15.834 cpu : usr=1.74%, sys=1.85%, ctx=3258, majf=0, minf=1 00:20:15.834 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:20:15.834 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:15.834 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:15.834 issued rwts: total=0,6173,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:15.834 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:15.834 job8: (groupid=0, jobs=1): err= 0: pid=3093796: Thu Nov 21 03:36:55 2024 00:20:15.834 write: IOPS=283, BW=71.0MiB/s (74.4MB/s)(721MiB/10154msec); 0 zone resets 00:20:15.834 slat (usec): min=25, max=86866, avg=2892.29, stdev=6538.90 00:20:15.834 clat (msec): min=23, max=382, avg=222.34, stdev=67.01 00:20:15.834 lat (msec): min=23, max=382, avg=225.23, stdev=67.86 00:20:15.834 clat percentiles (msec): 00:20:15.834 | 1.00th=[ 51], 5.00th=[ 116], 10.00th=[ 153], 20.00th=[ 171], 00:20:15.834 | 30.00th=[ 186], 40.00th=[ 199], 50.00th=[ 220], 60.00th=[ 236], 00:20:15.834 | 70.00th=[ 255], 80.00th=[ 275], 90.00th=[ 313], 95.00th=[ 342], 00:20:15.834 | 99.00th=[ 376], 99.50th=[ 380], 99.90th=[ 384], 99.95th=[ 384], 00:20:15.834 | 99.99th=[ 384] 00:20:15.834 bw ( KiB/s): min=44966, max=105472, per=5.56%, avg=72161.90, stdev=18180.12, samples=20 00:20:15.834 iops : min= 175, max= 412, avg=281.85, stdev=71.07, samples=20 00:20:15.835 lat (msec) : 50=1.01%, 100=3.33%, 250=62.77%, 500=32.89% 00:20:15.835 cpu : usr=0.89%, sys=1.04%, ctx=1122, majf=0, minf=1 00:20:15.835 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.3%, 16=0.6%, 32=1.1%, >=64=97.8% 00:20:15.835 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:15.835 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:15.835 issued rwts: total=0,2882,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:15.835 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:15.835 job9: (groupid=0, jobs=1): err= 0: pid=3093803: Thu Nov 21 03:36:55 2024 00:20:15.835 write: IOPS=641, BW=160MiB/s (168MB/s)(1626MiB/10140msec); 0 zone resets 00:20:15.835 slat (usec): min=19, max=98542, avg=1109.33, stdev=3337.62 00:20:15.835 clat (usec): min=1006, max=340069, avg=98558.64, stdev=65444.08 00:20:15.835 lat (usec): min=1091, max=340134, avg=99667.97, stdev=65994.90 00:20:15.835 clat percentiles (msec): 00:20:15.835 | 1.00th=[ 5], 5.00th=[ 12], 10.00th=[ 31], 20.00th=[ 45], 00:20:15.835 | 30.00th=[ 64], 40.00th=[ 77], 50.00th=[ 84], 60.00th=[ 99], 00:20:15.835 | 70.00th=[ 111], 80.00th=[ 134], 90.00th=[ 215], 95.00th=[ 241], 00:20:15.835 | 99.00th=[ 284], 99.50th=[ 300], 99.90th=[ 330], 99.95th=[ 338], 00:20:15.835 | 99.99th=[ 342] 00:20:15.835 bw ( KiB/s): min=69632, max=283136, per=12.71%, avg=164923.60, stdev=71533.32, samples=20 00:20:15.835 iops : min= 272, max= 1106, avg=644.15, stdev=279.43, samples=20 00:20:15.835 lat (msec) : 2=0.17%, 4=0.83%, 10=3.12%, 20=3.94%, 50=16.51% 00:20:15.835 lat (msec) : 100=36.63%, 250=35.54%, 500=3.26% 00:20:15.835 cpu : usr=1.81%, sys=2.35%, ctx=2920, majf=0, minf=1 00:20:15.835 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.0% 00:20:15.835 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:15.835 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:15.835 issued rwts: total=0,6505,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:15.835 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:15.835 job10: (groupid=0, jobs=1): err= 0: pid=3093804: Thu Nov 21 03:36:55 2024 00:20:15.835 write: IOPS=360, BW=90.0MiB/s (94.4MB/s)(906MiB/10064msec); 0 zone resets 00:20:15.835 slat (usec): min=17, max=54278, avg=2028.22, stdev=5096.14 00:20:15.835 clat (usec): min=1143, max=352202, avg=175643.53, stdev=87250.72 00:20:15.835 lat (usec): min=1220, max=353300, avg=177671.75, stdev=88440.57 00:20:15.835 clat percentiles (msec): 00:20:15.835 | 1.00th=[ 3], 5.00th=[ 10], 10.00th=[ 27], 20.00th=[ 104], 00:20:15.835 | 30.00th=[ 146], 40.00th=[ 165], 50.00th=[ 182], 60.00th=[ 203], 00:20:15.835 | 70.00th=[ 224], 80.00th=[ 247], 90.00th=[ 292], 95.00th=[ 309], 00:20:15.835 | 99.00th=[ 334], 99.50th=[ 338], 99.90th=[ 351], 99.95th=[ 351], 00:20:15.835 | 99.99th=[ 351] 00:20:15.835 bw ( KiB/s): min=51200, max=194560, per=7.02%, avg=91142.90, stdev=31475.90, samples=20 00:20:15.835 iops : min= 200, max= 760, avg=356.00, stdev=122.96, samples=20 00:20:15.835 lat (msec) : 2=0.50%, 4=1.66%, 10=2.92%, 20=2.68%, 50=5.38% 00:20:15.835 lat (msec) : 100=6.57%, 250=61.67%, 500=18.63% 00:20:15.835 cpu : usr=1.12%, sys=1.16%, ctx=1935, majf=0, minf=2 00:20:15.835 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.9%, >=64=98.3% 00:20:15.835 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:15.835 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:15.835 issued rwts: total=0,3624,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:15.835 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:15.835 00:20:15.835 Run status group 0 (all jobs): 00:20:15.835 WRITE: bw=1267MiB/s (1329MB/s), 71.0MiB/s-160MiB/s (74.4MB/s-168MB/s), io=12.6GiB (13.5GB), run=10064-10156msec 00:20:15.835 00:20:15.835 Disk stats (read/write): 00:20:15.835 nvme0n1: ios=48/9388, merge=0/0, ticks=396/1216401, in_queue=1216797, util=99.88% 00:20:15.835 nvme10n1: ios=40/9507, merge=0/0, ticks=43/1215678, in_queue=1215721, util=97.49% 00:20:15.835 nvme1n1: ios=0/9358, merge=0/0, ticks=0/1210065, in_queue=1210065, util=97.54% 00:20:15.835 nvme2n1: ios=44/8541, merge=0/0, ticks=2419/1194937, in_queue=1197356, util=100.00% 00:20:15.835 nvme3n1: ios=35/10432, merge=0/0, ticks=1254/1218970, in_queue=1220224, util=100.00% 00:20:15.835 nvme4n1: ios=42/9222, merge=0/0, ticks=111/1211363, in_queue=1211474, util=99.01% 00:20:15.835 nvme5n1: ios=37/6819, merge=0/0, ticks=234/1216279, in_queue=1216513, util=100.00% 00:20:15.835 nvme6n1: ios=42/12161, merge=0/0, ticks=5639/1147842, in_queue=1153481, util=100.00% 00:20:15.835 nvme7n1: ios=38/5580, merge=0/0, ticks=1180/1208807, in_queue=1209987, util=100.00% 00:20:15.835 nvme8n1: ios=41/12565, merge=0/0, ticks=2102/1202953, in_queue=1205055, util=100.00% 00:20:15.835 nvme9n1: ios=0/7005, merge=0/0, ticks=0/1215982, in_queue=1215982, util=99.14% 00:20:15.835 03:36:55 -- target/multiconnection.sh@36 -- # sync 00:20:15.835 03:36:55 -- target/multiconnection.sh@37 -- # seq 1 11 00:20:15.835 03:36:55 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:15.835 03:36:55 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:20:15.835 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:20:15.835 03:36:55 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK1 00:20:15.835 03:36:55 -- common/autotest_common.sh@1208 -- # local i=0 00:20:15.835 03:36:55 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:15.835 03:36:55 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK1 00:20:15.835 03:36:55 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:15.835 03:36:55 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK1 00:20:15.835 03:36:55 -- common/autotest_common.sh@1220 -- # return 0 00:20:15.835 03:36:55 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:20:15.835 03:36:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:15.835 03:36:55 -- common/autotest_common.sh@10 -- # set +x 00:20:15.835 03:36:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:15.835 03:36:55 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:15.835 03:36:55 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode2 00:20:15.835 NQN:nqn.2016-06.io.spdk:cnode2 disconnected 1 controller(s) 00:20:15.835 03:36:56 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK2 00:20:15.835 03:36:56 -- common/autotest_common.sh@1208 -- # local i=0 00:20:15.835 03:36:56 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:15.835 03:36:56 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK2 00:20:15.835 03:36:56 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:15.835 03:36:56 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK2 00:20:15.835 03:36:56 -- common/autotest_common.sh@1220 -- # return 0 00:20:15.835 03:36:56 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:20:15.835 03:36:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:15.835 03:36:56 -- common/autotest_common.sh@10 -- # set +x 00:20:15.835 03:36:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:15.835 03:36:56 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:15.835 03:36:56 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode3 00:20:15.835 NQN:nqn.2016-06.io.spdk:cnode3 disconnected 1 controller(s) 00:20:15.835 03:36:56 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK3 00:20:15.835 03:36:56 -- common/autotest_common.sh@1208 -- # local i=0 00:20:15.835 03:36:56 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:15.835 03:36:56 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK3 00:20:15.835 03:36:56 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:15.835 03:36:56 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK3 00:20:15.835 03:36:56 -- common/autotest_common.sh@1220 -- # return 0 00:20:15.835 03:36:56 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:20:15.835 03:36:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:15.835 03:36:56 -- common/autotest_common.sh@10 -- # set +x 00:20:15.835 03:36:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:15.835 03:36:56 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:15.835 03:36:56 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode4 00:20:16.096 NQN:nqn.2016-06.io.spdk:cnode4 disconnected 1 controller(s) 00:20:16.096 03:36:56 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK4 00:20:16.096 03:36:56 -- common/autotest_common.sh@1208 -- # local i=0 00:20:16.096 03:36:56 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:16.096 03:36:56 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK4 00:20:16.096 03:36:56 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:16.096 03:36:56 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK4 00:20:16.096 03:36:56 -- common/autotest_common.sh@1220 -- # return 0 00:20:16.096 03:36:56 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:20:16.096 03:36:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:16.096 03:36:56 -- common/autotest_common.sh@10 -- # set +x 00:20:16.096 03:36:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:16.096 03:36:56 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:16.096 03:36:56 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode5 00:20:16.354 NQN:nqn.2016-06.io.spdk:cnode5 disconnected 1 controller(s) 00:20:16.354 03:36:56 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK5 00:20:16.354 03:36:56 -- common/autotest_common.sh@1208 -- # local i=0 00:20:16.354 03:36:56 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:16.354 03:36:56 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK5 00:20:16.354 03:36:56 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:16.354 03:36:56 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK5 00:20:16.613 03:36:57 -- common/autotest_common.sh@1220 -- # return 0 00:20:16.613 03:36:57 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode5 00:20:16.613 03:36:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:16.613 03:36:57 -- common/autotest_common.sh@10 -- # set +x 00:20:16.613 03:36:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:16.613 03:36:57 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:16.613 03:36:57 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode6 00:20:16.613 NQN:nqn.2016-06.io.spdk:cnode6 disconnected 1 controller(s) 00:20:16.613 03:36:57 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK6 00:20:16.613 03:36:57 -- common/autotest_common.sh@1208 -- # local i=0 00:20:16.613 03:36:57 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:16.613 03:36:57 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK6 00:20:16.613 03:36:57 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:16.613 03:36:57 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK6 00:20:16.613 03:36:57 -- common/autotest_common.sh@1220 -- # return 0 00:20:16.613 03:36:57 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode6 00:20:16.613 03:36:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:16.613 03:36:57 -- common/autotest_common.sh@10 -- # set +x 00:20:16.613 03:36:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:16.613 03:36:57 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:16.613 03:36:57 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode7 00:20:16.871 NQN:nqn.2016-06.io.spdk:cnode7 disconnected 1 controller(s) 00:20:16.871 03:36:57 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK7 00:20:16.871 03:36:57 -- common/autotest_common.sh@1208 -- # local i=0 00:20:16.871 03:36:57 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:16.871 03:36:57 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK7 00:20:16.871 03:36:57 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:16.871 03:36:57 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK7 00:20:16.871 03:36:57 -- common/autotest_common.sh@1220 -- # return 0 00:20:16.871 03:36:57 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode7 00:20:16.871 03:36:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:16.871 03:36:57 -- common/autotest_common.sh@10 -- # set +x 00:20:16.871 03:36:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:16.871 03:36:57 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:16.871 03:36:57 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode8 00:20:16.871 NQN:nqn.2016-06.io.spdk:cnode8 disconnected 1 controller(s) 00:20:16.871 03:36:57 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK8 00:20:16.871 03:36:57 -- common/autotest_common.sh@1208 -- # local i=0 00:20:16.871 03:36:57 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:16.871 03:36:57 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK8 00:20:16.871 03:36:57 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:16.871 03:36:57 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK8 00:20:16.871 03:36:57 -- common/autotest_common.sh@1220 -- # return 0 00:20:16.871 03:36:57 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode8 00:20:16.871 03:36:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:16.871 03:36:57 -- common/autotest_common.sh@10 -- # set +x 00:20:16.871 03:36:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:16.871 03:36:57 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:16.871 03:36:57 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode9 00:20:17.129 NQN:nqn.2016-06.io.spdk:cnode9 disconnected 1 controller(s) 00:20:17.129 03:36:57 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK9 00:20:17.129 03:36:57 -- common/autotest_common.sh@1208 -- # local i=0 00:20:17.129 03:36:57 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:17.129 03:36:57 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK9 00:20:17.129 03:36:57 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:17.129 03:36:57 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK9 00:20:17.129 03:36:57 -- common/autotest_common.sh@1220 -- # return 0 00:20:17.129 03:36:57 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode9 00:20:17.129 03:36:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:17.129 03:36:57 -- common/autotest_common.sh@10 -- # set +x 00:20:17.129 03:36:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:17.129 03:36:57 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:17.129 03:36:57 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode10 00:20:17.389 NQN:nqn.2016-06.io.spdk:cnode10 disconnected 1 controller(s) 00:20:17.389 03:36:57 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK10 00:20:17.389 03:36:57 -- common/autotest_common.sh@1208 -- # local i=0 00:20:17.389 03:36:57 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:17.389 03:36:57 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK10 00:20:17.389 03:36:57 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:17.389 03:36:57 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK10 00:20:17.389 03:36:57 -- common/autotest_common.sh@1220 -- # return 0 00:20:17.389 03:36:57 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode10 00:20:17.389 03:36:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:17.389 03:36:57 -- common/autotest_common.sh@10 -- # set +x 00:20:17.389 03:36:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:17.389 03:36:57 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:17.389 03:36:57 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode11 00:20:17.389 NQN:nqn.2016-06.io.spdk:cnode11 disconnected 1 controller(s) 00:20:17.389 03:36:57 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK11 00:20:17.389 03:36:57 -- common/autotest_common.sh@1208 -- # local i=0 00:20:17.389 03:36:57 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:17.389 03:36:57 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK11 00:20:17.389 03:36:57 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:17.389 03:36:57 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK11 00:20:17.389 03:36:57 -- common/autotest_common.sh@1220 -- # return 0 00:20:17.389 03:36:57 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode11 00:20:17.389 03:36:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:17.389 03:36:57 -- common/autotest_common.sh@10 -- # set +x 00:20:17.389 03:36:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:17.389 03:36:57 -- target/multiconnection.sh@43 -- # rm -f ./local-job0-0-verify.state 00:20:17.389 03:36:58 -- target/multiconnection.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:20:17.389 03:36:58 -- target/multiconnection.sh@47 -- # nvmftestfini 00:20:17.389 03:36:58 -- nvmf/common.sh@476 -- # nvmfcleanup 00:20:17.389 03:36:58 -- nvmf/common.sh@116 -- # sync 00:20:17.389 03:36:58 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:20:17.389 03:36:58 -- nvmf/common.sh@119 -- # set +e 00:20:17.389 03:36:58 -- nvmf/common.sh@120 -- # for i in {1..20} 00:20:17.389 03:36:58 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:20:17.389 rmmod nvme_tcp 00:20:17.389 rmmod nvme_fabrics 00:20:17.649 rmmod nvme_keyring 00:20:17.649 03:36:58 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:20:17.649 03:36:58 -- nvmf/common.sh@123 -- # set -e 00:20:17.649 03:36:58 -- nvmf/common.sh@124 -- # return 0 00:20:17.649 03:36:58 -- nvmf/common.sh@477 -- # '[' -n 3087526 ']' 00:20:17.649 03:36:58 -- nvmf/common.sh@478 -- # killprocess 3087526 00:20:17.649 03:36:58 -- common/autotest_common.sh@936 -- # '[' -z 3087526 ']' 00:20:17.649 03:36:58 -- common/autotest_common.sh@940 -- # kill -0 3087526 00:20:17.649 03:36:58 -- common/autotest_common.sh@941 -- # uname 00:20:17.649 03:36:58 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:17.649 03:36:58 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3087526 00:20:17.649 03:36:58 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:20:17.649 03:36:58 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:20:17.649 03:36:58 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3087526' 00:20:17.649 killing process with pid 3087526 00:20:17.649 03:36:58 -- common/autotest_common.sh@955 -- # kill 3087526 00:20:17.649 03:36:58 -- common/autotest_common.sh@960 -- # wait 3087526 00:20:18.216 03:36:58 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:20:18.216 03:36:58 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:20:18.216 03:36:58 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:20:18.216 03:36:58 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:20:18.216 03:36:58 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:20:18.216 03:36:58 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:18.216 03:36:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:18.216 03:36:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:20.126 03:37:00 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:20:20.126 00:20:20.126 real 1m1.866s 00:20:20.126 user 3m27.316s 00:20:20.126 sys 0m24.705s 00:20:20.126 03:37:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:20:20.126 03:37:00 -- common/autotest_common.sh@10 -- # set +x 00:20:20.126 ************************************ 00:20:20.126 END TEST nvmf_multiconnection 00:20:20.126 ************************************ 00:20:20.126 03:37:00 -- nvmf/nvmf.sh@66 -- # run_test nvmf_initiator_timeout /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=tcp 00:20:20.126 03:37:00 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:20:20.126 03:37:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:20:20.126 03:37:00 -- common/autotest_common.sh@10 -- # set +x 00:20:20.126 ************************************ 00:20:20.126 START TEST nvmf_initiator_timeout 00:20:20.126 ************************************ 00:20:20.126 03:37:00 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=tcp 00:20:20.384 * Looking for test storage... 00:20:20.384 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:20:20.384 03:37:00 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:20:20.384 03:37:00 -- common/autotest_common.sh@1690 -- # lcov --version 00:20:20.384 03:37:00 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:20:20.385 03:37:00 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:20:20.385 03:37:00 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:20:20.385 03:37:00 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:20:20.385 03:37:00 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:20:20.385 03:37:00 -- scripts/common.sh@335 -- # IFS=.-: 00:20:20.385 03:37:00 -- scripts/common.sh@335 -- # read -ra ver1 00:20:20.385 03:37:00 -- scripts/common.sh@336 -- # IFS=.-: 00:20:20.385 03:37:00 -- scripts/common.sh@336 -- # read -ra ver2 00:20:20.385 03:37:00 -- scripts/common.sh@337 -- # local 'op=<' 00:20:20.385 03:37:00 -- scripts/common.sh@339 -- # ver1_l=2 00:20:20.385 03:37:00 -- scripts/common.sh@340 -- # ver2_l=1 00:20:20.385 03:37:00 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:20:20.385 03:37:00 -- scripts/common.sh@343 -- # case "$op" in 00:20:20.385 03:37:00 -- scripts/common.sh@344 -- # : 1 00:20:20.385 03:37:00 -- scripts/common.sh@363 -- # (( v = 0 )) 00:20:20.385 03:37:00 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:20:20.385 03:37:00 -- scripts/common.sh@364 -- # decimal 1 00:20:20.385 03:37:00 -- scripts/common.sh@352 -- # local d=1 00:20:20.385 03:37:00 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:20:20.385 03:37:00 -- scripts/common.sh@354 -- # echo 1 00:20:20.385 03:37:00 -- scripts/common.sh@364 -- # ver1[v]=1 00:20:20.385 03:37:00 -- scripts/common.sh@365 -- # decimal 2 00:20:20.385 03:37:00 -- scripts/common.sh@352 -- # local d=2 00:20:20.385 03:37:00 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:20:20.385 03:37:00 -- scripts/common.sh@354 -- # echo 2 00:20:20.385 03:37:00 -- scripts/common.sh@365 -- # ver2[v]=2 00:20:20.385 03:37:00 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:20:20.385 03:37:00 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:20:20.385 03:37:00 -- scripts/common.sh@367 -- # return 0 00:20:20.385 03:37:00 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:20:20.385 03:37:00 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:20:20.385 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:20.385 --rc genhtml_branch_coverage=1 00:20:20.385 --rc genhtml_function_coverage=1 00:20:20.385 --rc genhtml_legend=1 00:20:20.385 --rc geninfo_all_blocks=1 00:20:20.385 --rc geninfo_unexecuted_blocks=1 00:20:20.385 00:20:20.385 ' 00:20:20.385 03:37:00 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:20:20.385 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:20.385 --rc genhtml_branch_coverage=1 00:20:20.385 --rc genhtml_function_coverage=1 00:20:20.385 --rc genhtml_legend=1 00:20:20.385 --rc geninfo_all_blocks=1 00:20:20.385 --rc geninfo_unexecuted_blocks=1 00:20:20.385 00:20:20.385 ' 00:20:20.385 03:37:00 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:20:20.385 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:20.385 --rc genhtml_branch_coverage=1 00:20:20.385 --rc genhtml_function_coverage=1 00:20:20.385 --rc genhtml_legend=1 00:20:20.385 --rc geninfo_all_blocks=1 00:20:20.385 --rc geninfo_unexecuted_blocks=1 00:20:20.385 00:20:20.385 ' 00:20:20.385 03:37:00 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:20:20.385 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:20.385 --rc genhtml_branch_coverage=1 00:20:20.385 --rc genhtml_function_coverage=1 00:20:20.385 --rc genhtml_legend=1 00:20:20.385 --rc geninfo_all_blocks=1 00:20:20.385 --rc geninfo_unexecuted_blocks=1 00:20:20.385 00:20:20.385 ' 00:20:20.385 03:37:00 -- target/initiator_timeout.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:20:20.385 03:37:00 -- nvmf/common.sh@7 -- # uname -s 00:20:20.385 03:37:00 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:20:20.385 03:37:00 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:20:20.385 03:37:00 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:20:20.385 03:37:00 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:20:20.385 03:37:00 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:20:20.385 03:37:00 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:20:20.385 03:37:00 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:20:20.385 03:37:00 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:20:20.385 03:37:00 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:20:20.385 03:37:00 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:20:20.385 03:37:00 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:20:20.385 03:37:00 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:20:20.385 03:37:00 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:20:20.385 03:37:00 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:20:20.385 03:37:00 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:20:20.385 03:37:00 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:20:20.385 03:37:00 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:20:20.385 03:37:00 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:20:20.385 03:37:00 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:20:20.385 03:37:00 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:20.385 03:37:00 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:20.385 03:37:00 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:20.385 03:37:00 -- paths/export.sh@5 -- # export PATH 00:20:20.385 03:37:00 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:20.385 03:37:00 -- nvmf/common.sh@46 -- # : 0 00:20:20.385 03:37:00 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:20:20.385 03:37:00 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:20:20.385 03:37:00 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:20:20.385 03:37:00 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:20:20.385 03:37:00 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:20:20.385 03:37:00 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:20:20.385 03:37:00 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:20:20.385 03:37:00 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:20:20.385 03:37:00 -- target/initiator_timeout.sh@11 -- # MALLOC_BDEV_SIZE=64 00:20:20.385 03:37:00 -- target/initiator_timeout.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:20:20.385 03:37:00 -- target/initiator_timeout.sh@14 -- # nvmftestinit 00:20:20.385 03:37:00 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:20:20.385 03:37:00 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:20:20.385 03:37:00 -- nvmf/common.sh@436 -- # prepare_net_devs 00:20:20.385 03:37:00 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:20:20.385 03:37:00 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:20:20.385 03:37:00 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:20.385 03:37:00 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:20.385 03:37:00 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:20.385 03:37:00 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:20:20.385 03:37:00 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:20:20.385 03:37:00 -- nvmf/common.sh@284 -- # xtrace_disable 00:20:20.385 03:37:00 -- common/autotest_common.sh@10 -- # set +x 00:20:22.290 03:37:02 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:20:22.290 03:37:02 -- nvmf/common.sh@290 -- # pci_devs=() 00:20:22.290 03:37:02 -- nvmf/common.sh@290 -- # local -a pci_devs 00:20:22.290 03:37:02 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:20:22.290 03:37:02 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:20:22.290 03:37:02 -- nvmf/common.sh@292 -- # pci_drivers=() 00:20:22.290 03:37:02 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:20:22.290 03:37:02 -- nvmf/common.sh@294 -- # net_devs=() 00:20:22.290 03:37:02 -- nvmf/common.sh@294 -- # local -ga net_devs 00:20:22.290 03:37:02 -- nvmf/common.sh@295 -- # e810=() 00:20:22.290 03:37:02 -- nvmf/common.sh@295 -- # local -ga e810 00:20:22.290 03:37:02 -- nvmf/common.sh@296 -- # x722=() 00:20:22.290 03:37:02 -- nvmf/common.sh@296 -- # local -ga x722 00:20:22.290 03:37:02 -- nvmf/common.sh@297 -- # mlx=() 00:20:22.290 03:37:02 -- nvmf/common.sh@297 -- # local -ga mlx 00:20:22.290 03:37:02 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:20:22.290 03:37:02 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:20:22.290 03:37:02 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:20:22.290 03:37:02 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:20:22.290 03:37:02 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:20:22.290 03:37:02 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:20:22.290 03:37:02 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:20:22.290 03:37:02 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:20:22.291 03:37:02 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:20:22.291 03:37:02 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:20:22.291 03:37:02 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:20:22.291 03:37:02 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:20:22.291 03:37:02 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:20:22.291 03:37:02 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:20:22.291 03:37:02 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:20:22.291 03:37:02 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:20:22.291 03:37:02 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:20:22.291 03:37:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:22.291 03:37:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:20:22.291 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:20:22.291 03:37:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:22.291 03:37:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:22.291 03:37:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:22.291 03:37:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:22.291 03:37:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:22.291 03:37:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:22.291 03:37:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:20:22.291 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:20:22.291 03:37:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:22.291 03:37:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:22.291 03:37:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:22.291 03:37:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:22.291 03:37:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:22.291 03:37:02 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:20:22.291 03:37:02 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:20:22.291 03:37:02 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:20:22.291 03:37:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:22.291 03:37:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:22.291 03:37:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:22.291 03:37:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:22.291 03:37:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:20:22.291 Found net devices under 0000:0a:00.0: cvl_0_0 00:20:22.291 03:37:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:22.291 03:37:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:22.291 03:37:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:22.291 03:37:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:22.291 03:37:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:22.291 03:37:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:20:22.291 Found net devices under 0000:0a:00.1: cvl_0_1 00:20:22.291 03:37:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:22.291 03:37:02 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:20:22.291 03:37:02 -- nvmf/common.sh@402 -- # is_hw=yes 00:20:22.291 03:37:02 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:20:22.291 03:37:02 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:20:22.291 03:37:02 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:20:22.291 03:37:02 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:20:22.291 03:37:02 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:20:22.291 03:37:02 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:20:22.291 03:37:02 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:20:22.291 03:37:02 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:20:22.291 03:37:02 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:20:22.291 03:37:02 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:20:22.291 03:37:02 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:20:22.291 03:37:02 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:20:22.291 03:37:02 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:20:22.291 03:37:02 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:20:22.291 03:37:02 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:20:22.291 03:37:02 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:20:22.291 03:37:02 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:20:22.291 03:37:02 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:20:22.291 03:37:02 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:20:22.291 03:37:02 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:20:22.291 03:37:02 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:20:22.291 03:37:02 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:20:22.291 03:37:02 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:20:22.291 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:20:22.291 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.219 ms 00:20:22.291 00:20:22.291 --- 10.0.0.2 ping statistics --- 00:20:22.291 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:22.291 rtt min/avg/max/mdev = 0.219/0.219/0.219/0.000 ms 00:20:22.291 03:37:02 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:20:22.550 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:20:22.550 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.090 ms 00:20:22.550 00:20:22.550 --- 10.0.0.1 ping statistics --- 00:20:22.550 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:22.550 rtt min/avg/max/mdev = 0.090/0.090/0.090/0.000 ms 00:20:22.550 03:37:02 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:20:22.550 03:37:02 -- nvmf/common.sh@410 -- # return 0 00:20:22.550 03:37:02 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:20:22.550 03:37:02 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:20:22.550 03:37:02 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:20:22.550 03:37:02 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:20:22.550 03:37:02 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:20:22.550 03:37:02 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:20:22.550 03:37:02 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:20:22.550 03:37:02 -- target/initiator_timeout.sh@15 -- # nvmfappstart -m 0xF 00:20:22.550 03:37:02 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:22.550 03:37:02 -- common/autotest_common.sh@722 -- # xtrace_disable 00:20:22.550 03:37:02 -- common/autotest_common.sh@10 -- # set +x 00:20:22.550 03:37:02 -- nvmf/common.sh@469 -- # nvmfpid=3097181 00:20:22.550 03:37:02 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:20:22.550 03:37:02 -- nvmf/common.sh@470 -- # waitforlisten 3097181 00:20:22.550 03:37:02 -- common/autotest_common.sh@829 -- # '[' -z 3097181 ']' 00:20:22.550 03:37:02 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:22.550 03:37:02 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:22.550 03:37:02 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:22.550 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:22.550 03:37:02 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:22.550 03:37:02 -- common/autotest_common.sh@10 -- # set +x 00:20:22.550 [2024-11-21 03:37:03.015465] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:22.550 [2024-11-21 03:37:03.015542] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:22.550 EAL: No free 2048 kB hugepages reported on node 1 00:20:22.550 [2024-11-21 03:37:03.090063] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:20:22.809 [2024-11-21 03:37:03.211708] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:22.809 [2024-11-21 03:37:03.211853] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:22.809 [2024-11-21 03:37:03.211870] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:22.809 [2024-11-21 03:37:03.211883] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:22.809 [2024-11-21 03:37:03.211946] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:22.809 [2024-11-21 03:37:03.211980] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:22.809 [2024-11-21 03:37:03.212040] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:20:22.809 [2024-11-21 03:37:03.212043] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:20:23.375 03:37:04 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:23.375 03:37:04 -- common/autotest_common.sh@862 -- # return 0 00:20:23.375 03:37:04 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:23.375 03:37:04 -- common/autotest_common.sh@728 -- # xtrace_disable 00:20:23.375 03:37:04 -- common/autotest_common.sh@10 -- # set +x 00:20:23.633 03:37:04 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:23.633 03:37:04 -- target/initiator_timeout.sh@17 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:20:23.633 03:37:04 -- target/initiator_timeout.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:20:23.633 03:37:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:23.633 03:37:04 -- common/autotest_common.sh@10 -- # set +x 00:20:23.633 Malloc0 00:20:23.633 03:37:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:23.633 03:37:04 -- target/initiator_timeout.sh@22 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 30 -t 30 -w 30 -n 30 00:20:23.633 03:37:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:23.633 03:37:04 -- common/autotest_common.sh@10 -- # set +x 00:20:23.633 Delay0 00:20:23.633 03:37:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:23.633 03:37:04 -- target/initiator_timeout.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:20:23.633 03:37:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:23.633 03:37:04 -- common/autotest_common.sh@10 -- # set +x 00:20:23.633 [2024-11-21 03:37:04.074795] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:23.633 03:37:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:23.633 03:37:04 -- target/initiator_timeout.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:20:23.633 03:37:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:23.633 03:37:04 -- common/autotest_common.sh@10 -- # set +x 00:20:23.633 03:37:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:23.633 03:37:04 -- target/initiator_timeout.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:20:23.633 03:37:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:23.633 03:37:04 -- common/autotest_common.sh@10 -- # set +x 00:20:23.633 03:37:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:23.633 03:37:04 -- target/initiator_timeout.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:20:23.633 03:37:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:23.633 03:37:04 -- common/autotest_common.sh@10 -- # set +x 00:20:23.633 [2024-11-21 03:37:04.103161] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:23.633 03:37:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:23.633 03:37:04 -- target/initiator_timeout.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:20:24.199 03:37:04 -- target/initiator_timeout.sh@31 -- # waitforserial SPDKISFASTANDAWESOME 00:20:24.199 03:37:04 -- common/autotest_common.sh@1187 -- # local i=0 00:20:24.199 03:37:04 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:20:24.199 03:37:04 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:20:24.199 03:37:04 -- common/autotest_common.sh@1194 -- # sleep 2 00:20:26.725 03:37:06 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:20:26.725 03:37:06 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:20:26.725 03:37:06 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:20:26.725 03:37:06 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:20:26.725 03:37:06 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:20:26.725 03:37:06 -- common/autotest_common.sh@1197 -- # return 0 00:20:26.725 03:37:06 -- target/initiator_timeout.sh@35 -- # fio_pid=3097754 00:20:26.725 03:37:06 -- target/initiator_timeout.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 60 -v 00:20:26.725 03:37:06 -- target/initiator_timeout.sh@37 -- # sleep 3 00:20:26.725 [global] 00:20:26.725 thread=1 00:20:26.725 invalidate=1 00:20:26.725 rw=write 00:20:26.725 time_based=1 00:20:26.725 runtime=60 00:20:26.725 ioengine=libaio 00:20:26.725 direct=1 00:20:26.725 bs=4096 00:20:26.725 iodepth=1 00:20:26.725 norandommap=0 00:20:26.725 numjobs=1 00:20:26.725 00:20:26.725 verify_dump=1 00:20:26.725 verify_backlog=512 00:20:26.725 verify_state_save=0 00:20:26.725 do_verify=1 00:20:26.725 verify=crc32c-intel 00:20:26.725 [job0] 00:20:26.725 filename=/dev/nvme0n1 00:20:26.725 Could not set queue depth (nvme0n1) 00:20:26.725 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:20:26.725 fio-3.35 00:20:26.725 Starting 1 thread 00:20:29.251 03:37:09 -- target/initiator_timeout.sh@40 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 31000000 00:20:29.251 03:37:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:29.251 03:37:09 -- common/autotest_common.sh@10 -- # set +x 00:20:29.251 true 00:20:29.251 03:37:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:29.251 03:37:09 -- target/initiator_timeout.sh@41 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 31000000 00:20:29.251 03:37:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:29.251 03:37:09 -- common/autotest_common.sh@10 -- # set +x 00:20:29.251 true 00:20:29.251 03:37:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:29.251 03:37:09 -- target/initiator_timeout.sh@42 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 31000000 00:20:29.251 03:37:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:29.251 03:37:09 -- common/autotest_common.sh@10 -- # set +x 00:20:29.251 true 00:20:29.251 03:37:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:29.251 03:37:09 -- target/initiator_timeout.sh@43 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 310000000 00:20:29.251 03:37:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:29.251 03:37:09 -- common/autotest_common.sh@10 -- # set +x 00:20:29.251 true 00:20:29.251 03:37:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:29.251 03:37:09 -- target/initiator_timeout.sh@45 -- # sleep 3 00:20:32.533 03:37:12 -- target/initiator_timeout.sh@48 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 30 00:20:32.533 03:37:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:32.533 03:37:12 -- common/autotest_common.sh@10 -- # set +x 00:20:32.533 true 00:20:32.533 03:37:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:32.533 03:37:12 -- target/initiator_timeout.sh@49 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 30 00:20:32.533 03:37:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:32.533 03:37:12 -- common/autotest_common.sh@10 -- # set +x 00:20:32.533 true 00:20:32.533 03:37:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:32.533 03:37:12 -- target/initiator_timeout.sh@50 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 30 00:20:32.533 03:37:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:32.533 03:37:12 -- common/autotest_common.sh@10 -- # set +x 00:20:32.533 true 00:20:32.533 03:37:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:32.533 03:37:12 -- target/initiator_timeout.sh@51 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 30 00:20:32.533 03:37:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:32.533 03:37:12 -- common/autotest_common.sh@10 -- # set +x 00:20:32.533 true 00:20:32.533 03:37:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:32.533 03:37:12 -- target/initiator_timeout.sh@53 -- # fio_status=0 00:20:32.533 03:37:12 -- target/initiator_timeout.sh@54 -- # wait 3097754 00:21:28.761 00:21:28.761 job0: (groupid=0, jobs=1): err= 0: pid=3097828: Thu Nov 21 03:38:07 2024 00:21:28.761 read: IOPS=7, BW=29.8KiB/s (30.5kB/s)(1788KiB/60005msec) 00:21:28.761 slat (nsec): min=7599, max=54106, avg=23905.84, stdev=10026.16 00:21:28.761 clat (usec): min=330, max=41280k, avg=133815.54, stdev=1950504.16 00:21:28.761 lat (usec): min=343, max=41280k, avg=133839.44, stdev=1950503.81 00:21:28.761 clat percentiles (msec): 00:21:28.761 | 1.00th=[ 41], 5.00th=[ 42], 10.00th=[ 42], 20.00th=[ 42], 00:21:28.761 | 30.00th=[ 42], 40.00th=[ 43], 50.00th=[ 43], 60.00th=[ 43], 00:21:28.761 | 70.00th=[ 43], 80.00th=[ 43], 90.00th=[ 43], 95.00th=[ 43], 00:21:28.761 | 99.00th=[ 43], 99.50th=[ 43], 99.90th=[17113], 99.95th=[17113], 00:21:28.761 | 99.99th=[17113] 00:21:28.761 write: IOPS=8, BW=34.1KiB/s (34.9kB/s)(2048KiB/60005msec); 0 zone resets 00:21:28.761 slat (usec): min=6, max=31800, avg=77.88, stdev=1404.71 00:21:28.761 clat (usec): min=206, max=429, avg=258.93, stdev=24.07 00:21:28.762 lat (usec): min=219, max=32039, avg=336.81, stdev=1404.06 00:21:28.762 clat percentiles (usec): 00:21:28.762 | 1.00th=[ 215], 5.00th=[ 229], 10.00th=[ 239], 20.00th=[ 243], 00:21:28.762 | 30.00th=[ 245], 40.00th=[ 249], 50.00th=[ 255], 60.00th=[ 260], 00:21:28.762 | 70.00th=[ 269], 80.00th=[ 273], 90.00th=[ 285], 95.00th=[ 293], 00:21:28.762 | 99.00th=[ 322], 99.50th=[ 412], 99.90th=[ 429], 99.95th=[ 429], 00:21:28.762 | 99.99th=[ 429] 00:21:28.762 bw ( KiB/s): min= 4096, max= 4096, per=100.00%, avg=4096.00, stdev= 0.00, samples=1 00:21:28.762 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:21:28.762 lat (usec) : 250=22.21%, 500=31.49% 00:21:28.762 lat (msec) : 50=46.19%, >=2000=0.10% 00:21:28.762 cpu : usr=0.01%, sys=0.05%, ctx=963, majf=0, minf=1 00:21:28.762 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:21:28.762 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:28.762 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:28.762 issued rwts: total=447,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:28.762 latency : target=0, window=0, percentile=100.00%, depth=1 00:21:28.762 00:21:28.762 Run status group 0 (all jobs): 00:21:28.762 READ: bw=29.8KiB/s (30.5kB/s), 29.8KiB/s-29.8KiB/s (30.5kB/s-30.5kB/s), io=1788KiB (1831kB), run=60005-60005msec 00:21:28.762 WRITE: bw=34.1KiB/s (34.9kB/s), 34.1KiB/s-34.1KiB/s (34.9kB/s-34.9kB/s), io=2048KiB (2097kB), run=60005-60005msec 00:21:28.762 00:21:28.762 Disk stats (read/write): 00:21:28.762 nvme0n1: ios=496/512, merge=0/0, ticks=19697/128, in_queue=19825, util=99.89% 00:21:28.762 03:38:07 -- target/initiator_timeout.sh@56 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:21:28.762 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:21:28.762 03:38:07 -- target/initiator_timeout.sh@57 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:21:28.762 03:38:07 -- common/autotest_common.sh@1208 -- # local i=0 00:21:28.762 03:38:07 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:21:28.762 03:38:07 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:21:28.762 03:38:07 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:21:28.762 03:38:07 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:21:28.762 03:38:07 -- common/autotest_common.sh@1220 -- # return 0 00:21:28.762 03:38:07 -- target/initiator_timeout.sh@59 -- # '[' 0 -eq 0 ']' 00:21:28.762 03:38:07 -- target/initiator_timeout.sh@60 -- # echo 'nvmf hotplug test: fio successful as expected' 00:21:28.762 nvmf hotplug test: fio successful as expected 00:21:28.762 03:38:07 -- target/initiator_timeout.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:21:28.762 03:38:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:28.762 03:38:07 -- common/autotest_common.sh@10 -- # set +x 00:21:28.762 03:38:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:28.762 03:38:07 -- target/initiator_timeout.sh@69 -- # rm -f ./local-job0-0-verify.state 00:21:28.762 03:38:07 -- target/initiator_timeout.sh@71 -- # trap - SIGINT SIGTERM EXIT 00:21:28.762 03:38:07 -- target/initiator_timeout.sh@73 -- # nvmftestfini 00:21:28.762 03:38:07 -- nvmf/common.sh@476 -- # nvmfcleanup 00:21:28.762 03:38:07 -- nvmf/common.sh@116 -- # sync 00:21:28.762 03:38:07 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:21:28.762 03:38:07 -- nvmf/common.sh@119 -- # set +e 00:21:28.762 03:38:07 -- nvmf/common.sh@120 -- # for i in {1..20} 00:21:28.762 03:38:07 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:21:28.762 rmmod nvme_tcp 00:21:28.762 rmmod nvme_fabrics 00:21:28.762 rmmod nvme_keyring 00:21:28.762 03:38:07 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:21:28.762 03:38:07 -- nvmf/common.sh@123 -- # set -e 00:21:28.762 03:38:07 -- nvmf/common.sh@124 -- # return 0 00:21:28.762 03:38:07 -- nvmf/common.sh@477 -- # '[' -n 3097181 ']' 00:21:28.762 03:38:07 -- nvmf/common.sh@478 -- # killprocess 3097181 00:21:28.762 03:38:07 -- common/autotest_common.sh@936 -- # '[' -z 3097181 ']' 00:21:28.762 03:38:07 -- common/autotest_common.sh@940 -- # kill -0 3097181 00:21:28.762 03:38:07 -- common/autotest_common.sh@941 -- # uname 00:21:28.762 03:38:07 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:28.762 03:38:07 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3097181 00:21:28.762 03:38:07 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:21:28.762 03:38:07 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:21:28.762 03:38:07 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3097181' 00:21:28.762 killing process with pid 3097181 00:21:28.762 03:38:07 -- common/autotest_common.sh@955 -- # kill 3097181 00:21:28.762 03:38:07 -- common/autotest_common.sh@960 -- # wait 3097181 00:21:28.762 03:38:07 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:21:28.762 03:38:07 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:21:28.762 03:38:07 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:21:28.762 03:38:07 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:28.762 03:38:07 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:21:28.762 03:38:07 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:28.762 03:38:07 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:28.762 03:38:07 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:29.330 03:38:09 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:21:29.330 00:21:29.330 real 1m9.026s 00:21:29.330 user 4m14.689s 00:21:29.330 sys 0m5.956s 00:21:29.330 03:38:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:21:29.330 03:38:09 -- common/autotest_common.sh@10 -- # set +x 00:21:29.330 ************************************ 00:21:29.330 END TEST nvmf_initiator_timeout 00:21:29.330 ************************************ 00:21:29.330 03:38:09 -- nvmf/nvmf.sh@69 -- # [[ phy == phy ]] 00:21:29.330 03:38:09 -- nvmf/nvmf.sh@70 -- # '[' tcp = tcp ']' 00:21:29.330 03:38:09 -- nvmf/nvmf.sh@71 -- # gather_supported_nvmf_pci_devs 00:21:29.330 03:38:09 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:29.330 03:38:09 -- common/autotest_common.sh@10 -- # set +x 00:21:31.359 03:38:11 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:31.359 03:38:11 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:31.359 03:38:11 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:31.359 03:38:11 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:31.359 03:38:11 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:31.359 03:38:11 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:31.359 03:38:11 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:31.359 03:38:11 -- nvmf/common.sh@294 -- # net_devs=() 00:21:31.359 03:38:11 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:31.359 03:38:11 -- nvmf/common.sh@295 -- # e810=() 00:21:31.359 03:38:11 -- nvmf/common.sh@295 -- # local -ga e810 00:21:31.359 03:38:11 -- nvmf/common.sh@296 -- # x722=() 00:21:31.359 03:38:11 -- nvmf/common.sh@296 -- # local -ga x722 00:21:31.359 03:38:11 -- nvmf/common.sh@297 -- # mlx=() 00:21:31.359 03:38:11 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:31.359 03:38:11 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:31.359 03:38:11 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:31.359 03:38:11 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:31.359 03:38:11 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:31.359 03:38:11 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:31.359 03:38:11 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:31.359 03:38:11 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:31.359 03:38:11 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:31.359 03:38:11 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:31.359 03:38:11 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:31.359 03:38:11 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:31.359 03:38:11 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:31.359 03:38:11 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:31.359 03:38:11 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:31.359 03:38:11 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:31.359 03:38:11 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:31.359 03:38:11 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:31.359 03:38:11 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:31.359 03:38:11 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:31.359 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:31.359 03:38:11 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:31.359 03:38:11 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:31.359 03:38:11 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:31.359 03:38:11 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:31.359 03:38:11 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:31.359 03:38:11 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:31.359 03:38:11 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:31.359 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:31.359 03:38:11 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:31.359 03:38:11 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:31.359 03:38:11 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:31.359 03:38:11 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:31.359 03:38:11 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:31.359 03:38:11 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:31.359 03:38:11 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:31.359 03:38:11 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:31.359 03:38:11 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:31.359 03:38:11 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:31.359 03:38:11 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:31.359 03:38:11 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:31.359 03:38:11 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:31.359 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:31.359 03:38:11 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:31.359 03:38:11 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:31.359 03:38:11 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:31.359 03:38:11 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:31.359 03:38:11 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:31.359 03:38:11 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:31.359 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:31.359 03:38:11 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:31.359 03:38:11 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:31.359 03:38:11 -- nvmf/nvmf.sh@72 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:31.359 03:38:11 -- nvmf/nvmf.sh@73 -- # (( 2 > 0 )) 00:21:31.359 03:38:11 -- nvmf/nvmf.sh@74 -- # run_test nvmf_perf_adq /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:21:31.359 03:38:11 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:21:31.359 03:38:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:21:31.359 03:38:11 -- common/autotest_common.sh@10 -- # set +x 00:21:31.359 ************************************ 00:21:31.359 START TEST nvmf_perf_adq 00:21:31.359 ************************************ 00:21:31.359 03:38:11 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:21:31.359 * Looking for test storage... 00:21:31.359 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:21:31.359 03:38:11 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:21:31.359 03:38:11 -- common/autotest_common.sh@1690 -- # lcov --version 00:21:31.359 03:38:11 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:21:31.359 03:38:11 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:21:31.359 03:38:11 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:21:31.359 03:38:11 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:21:31.359 03:38:11 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:21:31.359 03:38:11 -- scripts/common.sh@335 -- # IFS=.-: 00:21:31.359 03:38:11 -- scripts/common.sh@335 -- # read -ra ver1 00:21:31.359 03:38:11 -- scripts/common.sh@336 -- # IFS=.-: 00:21:31.359 03:38:11 -- scripts/common.sh@336 -- # read -ra ver2 00:21:31.359 03:38:11 -- scripts/common.sh@337 -- # local 'op=<' 00:21:31.359 03:38:11 -- scripts/common.sh@339 -- # ver1_l=2 00:21:31.359 03:38:11 -- scripts/common.sh@340 -- # ver2_l=1 00:21:31.359 03:38:11 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:21:31.359 03:38:11 -- scripts/common.sh@343 -- # case "$op" in 00:21:31.359 03:38:11 -- scripts/common.sh@344 -- # : 1 00:21:31.359 03:38:11 -- scripts/common.sh@363 -- # (( v = 0 )) 00:21:31.359 03:38:11 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:31.359 03:38:11 -- scripts/common.sh@364 -- # decimal 1 00:21:31.359 03:38:11 -- scripts/common.sh@352 -- # local d=1 00:21:31.359 03:38:11 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:21:31.359 03:38:11 -- scripts/common.sh@354 -- # echo 1 00:21:31.359 03:38:11 -- scripts/common.sh@364 -- # ver1[v]=1 00:21:31.359 03:38:11 -- scripts/common.sh@365 -- # decimal 2 00:21:31.359 03:38:11 -- scripts/common.sh@352 -- # local d=2 00:21:31.359 03:38:11 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:21:31.359 03:38:11 -- scripts/common.sh@354 -- # echo 2 00:21:31.359 03:38:11 -- scripts/common.sh@365 -- # ver2[v]=2 00:21:31.359 03:38:11 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:21:31.359 03:38:11 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:21:31.359 03:38:11 -- scripts/common.sh@367 -- # return 0 00:21:31.359 03:38:11 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:21:31.359 03:38:11 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:21:31.359 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:31.359 --rc genhtml_branch_coverage=1 00:21:31.359 --rc genhtml_function_coverage=1 00:21:31.359 --rc genhtml_legend=1 00:21:31.359 --rc geninfo_all_blocks=1 00:21:31.359 --rc geninfo_unexecuted_blocks=1 00:21:31.359 00:21:31.359 ' 00:21:31.359 03:38:11 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:21:31.359 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:31.359 --rc genhtml_branch_coverage=1 00:21:31.359 --rc genhtml_function_coverage=1 00:21:31.359 --rc genhtml_legend=1 00:21:31.359 --rc geninfo_all_blocks=1 00:21:31.359 --rc geninfo_unexecuted_blocks=1 00:21:31.359 00:21:31.359 ' 00:21:31.359 03:38:11 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:21:31.359 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:31.359 --rc genhtml_branch_coverage=1 00:21:31.359 --rc genhtml_function_coverage=1 00:21:31.359 --rc genhtml_legend=1 00:21:31.359 --rc geninfo_all_blocks=1 00:21:31.359 --rc geninfo_unexecuted_blocks=1 00:21:31.360 00:21:31.360 ' 00:21:31.360 03:38:11 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:21:31.360 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:31.360 --rc genhtml_branch_coverage=1 00:21:31.360 --rc genhtml_function_coverage=1 00:21:31.360 --rc genhtml_legend=1 00:21:31.360 --rc geninfo_all_blocks=1 00:21:31.360 --rc geninfo_unexecuted_blocks=1 00:21:31.360 00:21:31.360 ' 00:21:31.360 03:38:11 -- target/perf_adq.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:21:31.360 03:38:11 -- nvmf/common.sh@7 -- # uname -s 00:21:31.360 03:38:11 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:31.360 03:38:11 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:31.360 03:38:11 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:31.360 03:38:11 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:31.360 03:38:11 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:31.360 03:38:11 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:31.360 03:38:11 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:31.360 03:38:11 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:31.360 03:38:11 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:31.360 03:38:11 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:31.360 03:38:11 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:21:31.360 03:38:11 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:21:31.360 03:38:11 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:31.360 03:38:11 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:31.360 03:38:11 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:31.360 03:38:11 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:21:31.360 03:38:11 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:31.360 03:38:11 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:31.360 03:38:11 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:31.360 03:38:11 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:31.360 03:38:11 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:31.360 03:38:11 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:31.360 03:38:11 -- paths/export.sh@5 -- # export PATH 00:21:31.360 03:38:11 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:31.360 03:38:11 -- nvmf/common.sh@46 -- # : 0 00:21:31.360 03:38:11 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:21:31.360 03:38:11 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:21:31.360 03:38:11 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:21:31.360 03:38:11 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:31.360 03:38:11 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:31.360 03:38:11 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:21:31.360 03:38:11 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:21:31.360 03:38:11 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:21:31.360 03:38:11 -- target/perf_adq.sh@11 -- # gather_supported_nvmf_pci_devs 00:21:31.360 03:38:11 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:31.360 03:38:11 -- common/autotest_common.sh@10 -- # set +x 00:21:33.897 03:38:13 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:33.897 03:38:13 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:33.897 03:38:13 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:33.897 03:38:13 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:33.897 03:38:13 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:33.897 03:38:13 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:33.897 03:38:13 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:33.897 03:38:13 -- nvmf/common.sh@294 -- # net_devs=() 00:21:33.897 03:38:13 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:33.897 03:38:13 -- nvmf/common.sh@295 -- # e810=() 00:21:33.897 03:38:13 -- nvmf/common.sh@295 -- # local -ga e810 00:21:33.897 03:38:13 -- nvmf/common.sh@296 -- # x722=() 00:21:33.897 03:38:13 -- nvmf/common.sh@296 -- # local -ga x722 00:21:33.897 03:38:13 -- nvmf/common.sh@297 -- # mlx=() 00:21:33.897 03:38:13 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:33.897 03:38:13 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:33.897 03:38:13 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:33.897 03:38:13 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:33.897 03:38:13 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:33.897 03:38:13 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:33.897 03:38:13 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:33.897 03:38:13 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:33.897 03:38:13 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:33.897 03:38:13 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:33.897 03:38:13 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:33.897 03:38:13 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:33.897 03:38:13 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:33.897 03:38:13 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:33.897 03:38:13 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:33.897 03:38:13 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:33.897 03:38:13 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:33.897 03:38:13 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:33.897 03:38:13 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:33.897 03:38:13 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:33.897 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:33.897 03:38:13 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:33.897 03:38:13 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:33.897 03:38:13 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:33.897 03:38:13 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:33.897 03:38:13 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:33.897 03:38:13 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:33.897 03:38:13 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:33.897 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:33.897 03:38:13 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:33.897 03:38:13 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:33.897 03:38:13 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:33.897 03:38:13 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:33.897 03:38:13 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:33.897 03:38:13 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:33.897 03:38:13 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:33.897 03:38:13 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:33.897 03:38:13 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:33.897 03:38:13 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:33.897 03:38:13 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:33.897 03:38:13 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:33.897 03:38:13 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:33.897 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:33.897 03:38:13 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:33.897 03:38:13 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:33.897 03:38:13 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:33.897 03:38:13 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:33.897 03:38:13 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:33.897 03:38:13 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:33.897 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:33.897 03:38:13 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:33.897 03:38:13 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:33.897 03:38:13 -- target/perf_adq.sh@12 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:33.897 03:38:13 -- target/perf_adq.sh@13 -- # (( 2 == 0 )) 00:21:33.897 03:38:13 -- target/perf_adq.sh@18 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:21:33.897 03:38:13 -- target/perf_adq.sh@59 -- # adq_reload_driver 00:21:33.897 03:38:13 -- target/perf_adq.sh@52 -- # rmmod ice 00:21:34.156 03:38:14 -- target/perf_adq.sh@53 -- # modprobe ice 00:21:36.687 03:38:16 -- target/perf_adq.sh@54 -- # sleep 5 00:21:41.966 03:38:21 -- target/perf_adq.sh@67 -- # nvmftestinit 00:21:41.966 03:38:21 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:21:41.966 03:38:21 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:41.966 03:38:21 -- nvmf/common.sh@436 -- # prepare_net_devs 00:21:41.966 03:38:21 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:21:41.966 03:38:21 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:21:41.966 03:38:21 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:41.966 03:38:21 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:41.966 03:38:21 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:41.966 03:38:21 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:21:41.966 03:38:21 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:21:41.966 03:38:21 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:41.966 03:38:21 -- common/autotest_common.sh@10 -- # set +x 00:21:41.966 03:38:21 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:41.966 03:38:21 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:41.966 03:38:21 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:41.966 03:38:21 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:41.966 03:38:21 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:41.966 03:38:21 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:41.966 03:38:21 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:41.966 03:38:21 -- nvmf/common.sh@294 -- # net_devs=() 00:21:41.966 03:38:21 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:41.966 03:38:21 -- nvmf/common.sh@295 -- # e810=() 00:21:41.966 03:38:21 -- nvmf/common.sh@295 -- # local -ga e810 00:21:41.966 03:38:21 -- nvmf/common.sh@296 -- # x722=() 00:21:41.966 03:38:21 -- nvmf/common.sh@296 -- # local -ga x722 00:21:41.966 03:38:21 -- nvmf/common.sh@297 -- # mlx=() 00:21:41.966 03:38:21 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:41.966 03:38:21 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:41.966 03:38:21 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:41.966 03:38:21 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:41.966 03:38:21 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:41.966 03:38:21 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:41.966 03:38:21 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:41.966 03:38:21 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:41.966 03:38:21 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:41.966 03:38:21 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:41.966 03:38:21 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:41.966 03:38:21 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:41.966 03:38:21 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:41.966 03:38:21 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:41.966 03:38:21 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:41.966 03:38:21 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:41.966 03:38:21 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:41.966 03:38:21 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:41.966 03:38:21 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:41.966 03:38:21 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:41.966 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:41.966 03:38:21 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:41.966 03:38:21 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:41.966 03:38:21 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:41.966 03:38:21 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:41.966 03:38:21 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:41.966 03:38:21 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:41.966 03:38:21 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:41.966 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:41.966 03:38:21 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:41.966 03:38:21 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:41.966 03:38:21 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:41.966 03:38:21 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:41.966 03:38:21 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:41.966 03:38:21 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:41.966 03:38:21 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:41.966 03:38:21 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:41.966 03:38:21 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:41.966 03:38:21 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:41.966 03:38:21 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:41.966 03:38:21 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:41.966 03:38:21 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:41.966 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:41.966 03:38:21 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:41.966 03:38:21 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:41.966 03:38:21 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:41.966 03:38:21 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:41.966 03:38:21 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:41.966 03:38:21 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:41.966 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:41.966 03:38:21 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:41.966 03:38:21 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:41.966 03:38:21 -- nvmf/common.sh@402 -- # is_hw=yes 00:21:41.966 03:38:21 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:21:41.966 03:38:21 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:21:41.966 03:38:21 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:21:41.966 03:38:21 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:41.966 03:38:21 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:21:41.966 03:38:21 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:41.966 03:38:21 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:21:41.966 03:38:21 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:21:41.966 03:38:21 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:21:41.966 03:38:21 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:21:41.966 03:38:21 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:21:41.966 03:38:21 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:41.966 03:38:21 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:21:41.966 03:38:21 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:21:41.966 03:38:21 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:21:41.966 03:38:22 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:21:41.966 03:38:22 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:21:41.966 03:38:22 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:21:41.966 03:38:22 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:21:41.966 03:38:22 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:21:41.966 03:38:22 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:21:41.966 03:38:22 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:21:41.966 03:38:22 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:21:41.966 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:41.966 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.223 ms 00:21:41.966 00:21:41.967 --- 10.0.0.2 ping statistics --- 00:21:41.967 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:41.967 rtt min/avg/max/mdev = 0.223/0.223/0.223/0.000 ms 00:21:41.967 03:38:22 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:21:41.967 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:41.967 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.131 ms 00:21:41.967 00:21:41.967 --- 10.0.0.1 ping statistics --- 00:21:41.967 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:41.967 rtt min/avg/max/mdev = 0.131/0.131/0.131/0.000 ms 00:21:41.967 03:38:22 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:41.967 03:38:22 -- nvmf/common.sh@410 -- # return 0 00:21:41.967 03:38:22 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:21:41.967 03:38:22 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:41.967 03:38:22 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:21:41.967 03:38:22 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:21:41.967 03:38:22 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:41.967 03:38:22 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:21:41.967 03:38:22 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:21:41.967 03:38:22 -- target/perf_adq.sh@68 -- # nvmfappstart -m 0xF --wait-for-rpc 00:21:41.967 03:38:22 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:21:41.967 03:38:22 -- common/autotest_common.sh@722 -- # xtrace_disable 00:21:41.967 03:38:22 -- common/autotest_common.sh@10 -- # set +x 00:21:41.967 03:38:22 -- nvmf/common.sh@469 -- # nvmfpid=3109645 00:21:41.967 03:38:22 -- nvmf/common.sh@470 -- # waitforlisten 3109645 00:21:41.967 03:38:22 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:21:41.967 03:38:22 -- common/autotest_common.sh@829 -- # '[' -z 3109645 ']' 00:21:41.967 03:38:22 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:41.967 03:38:22 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:41.967 03:38:22 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:41.967 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:41.967 03:38:22 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:41.967 03:38:22 -- common/autotest_common.sh@10 -- # set +x 00:21:41.967 [2024-11-21 03:38:22.191289] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:21:41.967 [2024-11-21 03:38:22.191366] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:41.967 EAL: No free 2048 kB hugepages reported on node 1 00:21:41.967 [2024-11-21 03:38:22.258252] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:21:41.967 [2024-11-21 03:38:22.369188] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:21:41.967 [2024-11-21 03:38:22.369346] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:41.967 [2024-11-21 03:38:22.369378] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:41.967 [2024-11-21 03:38:22.369392] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:41.967 [2024-11-21 03:38:22.369462] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:41.967 [2024-11-21 03:38:22.369515] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:41.967 [2024-11-21 03:38:22.369564] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:21:41.967 [2024-11-21 03:38:22.369567] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:21:41.967 03:38:22 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:41.967 03:38:22 -- common/autotest_common.sh@862 -- # return 0 00:21:41.967 03:38:22 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:21:41.967 03:38:22 -- common/autotest_common.sh@728 -- # xtrace_disable 00:21:41.967 03:38:22 -- common/autotest_common.sh@10 -- # set +x 00:21:41.967 03:38:22 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:41.967 03:38:22 -- target/perf_adq.sh@69 -- # adq_configure_nvmf_target 0 00:21:41.967 03:38:22 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 0 --enable-zerocopy-send-server -i posix 00:21:41.967 03:38:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:41.967 03:38:22 -- common/autotest_common.sh@10 -- # set +x 00:21:41.967 03:38:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:41.967 03:38:22 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:21:41.967 03:38:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:41.967 03:38:22 -- common/autotest_common.sh@10 -- # set +x 00:21:41.967 03:38:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:41.967 03:38:22 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 0 00:21:41.967 03:38:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:41.967 03:38:22 -- common/autotest_common.sh@10 -- # set +x 00:21:41.967 [2024-11-21 03:38:22.549781] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:41.967 03:38:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:41.967 03:38:22 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:21:41.967 03:38:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:41.967 03:38:22 -- common/autotest_common.sh@10 -- # set +x 00:21:41.967 Malloc1 00:21:41.967 03:38:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:41.967 03:38:22 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:21:41.967 03:38:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:41.967 03:38:22 -- common/autotest_common.sh@10 -- # set +x 00:21:41.967 03:38:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:41.967 03:38:22 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:21:41.967 03:38:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:41.967 03:38:22 -- common/autotest_common.sh@10 -- # set +x 00:21:41.967 03:38:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:41.967 03:38:22 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:21:41.967 03:38:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:41.967 03:38:22 -- common/autotest_common.sh@10 -- # set +x 00:21:41.967 [2024-11-21 03:38:22.601012] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:41.967 03:38:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:41.967 03:38:22 -- target/perf_adq.sh@73 -- # perfpid=3109788 00:21:41.967 03:38:22 -- target/perf_adq.sh@70 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:21:41.967 03:38:22 -- target/perf_adq.sh@74 -- # sleep 2 00:21:42.226 EAL: No free 2048 kB hugepages reported on node 1 00:21:44.131 03:38:24 -- target/perf_adq.sh@76 -- # rpc_cmd nvmf_get_stats 00:21:44.131 03:38:24 -- target/perf_adq.sh@76 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 1) | length' 00:21:44.131 03:38:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:44.131 03:38:24 -- target/perf_adq.sh@76 -- # wc -l 00:21:44.131 03:38:24 -- common/autotest_common.sh@10 -- # set +x 00:21:44.131 03:38:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:44.131 03:38:24 -- target/perf_adq.sh@76 -- # count=4 00:21:44.131 03:38:24 -- target/perf_adq.sh@77 -- # [[ 4 -ne 4 ]] 00:21:44.131 03:38:24 -- target/perf_adq.sh@81 -- # wait 3109788 00:21:52.249 Initializing NVMe Controllers 00:21:52.249 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:21:52.249 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:21:52.249 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:21:52.249 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:21:52.249 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:21:52.249 Initialization complete. Launching workers. 00:21:52.249 ======================================================== 00:21:52.249 Latency(us) 00:21:52.249 Device Information : IOPS MiB/s Average min max 00:21:52.249 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 10826.40 42.29 5912.16 1838.25 9507.67 00:21:52.249 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 11342.30 44.31 5643.89 1446.40 9348.58 00:21:52.249 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 11636.40 45.45 5501.69 1190.85 9304.25 00:21:52.249 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 9953.60 38.88 6430.07 1326.65 10988.53 00:21:52.249 ======================================================== 00:21:52.249 Total : 43758.69 170.93 5851.28 1190.85 10988.53 00:21:52.249 00:21:52.249 03:38:32 -- target/perf_adq.sh@82 -- # nvmftestfini 00:21:52.249 03:38:32 -- nvmf/common.sh@476 -- # nvmfcleanup 00:21:52.249 03:38:32 -- nvmf/common.sh@116 -- # sync 00:21:52.249 03:38:32 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:21:52.249 03:38:32 -- nvmf/common.sh@119 -- # set +e 00:21:52.249 03:38:32 -- nvmf/common.sh@120 -- # for i in {1..20} 00:21:52.249 03:38:32 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:21:52.249 rmmod nvme_tcp 00:21:52.249 rmmod nvme_fabrics 00:21:52.249 rmmod nvme_keyring 00:21:52.250 03:38:32 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:21:52.250 03:38:32 -- nvmf/common.sh@123 -- # set -e 00:21:52.250 03:38:32 -- nvmf/common.sh@124 -- # return 0 00:21:52.250 03:38:32 -- nvmf/common.sh@477 -- # '[' -n 3109645 ']' 00:21:52.250 03:38:32 -- nvmf/common.sh@478 -- # killprocess 3109645 00:21:52.250 03:38:32 -- common/autotest_common.sh@936 -- # '[' -z 3109645 ']' 00:21:52.250 03:38:32 -- common/autotest_common.sh@940 -- # kill -0 3109645 00:21:52.250 03:38:32 -- common/autotest_common.sh@941 -- # uname 00:21:52.250 03:38:32 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:52.250 03:38:32 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3109645 00:21:52.250 03:38:32 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:21:52.250 03:38:32 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:21:52.250 03:38:32 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3109645' 00:21:52.250 killing process with pid 3109645 00:21:52.250 03:38:32 -- common/autotest_common.sh@955 -- # kill 3109645 00:21:52.250 03:38:32 -- common/autotest_common.sh@960 -- # wait 3109645 00:21:52.508 03:38:33 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:21:52.508 03:38:33 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:21:52.508 03:38:33 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:21:52.508 03:38:33 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:52.508 03:38:33 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:21:52.508 03:38:33 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:52.508 03:38:33 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:52.508 03:38:33 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:55.049 03:38:35 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:21:55.049 03:38:35 -- target/perf_adq.sh@84 -- # adq_reload_driver 00:21:55.049 03:38:35 -- target/perf_adq.sh@52 -- # rmmod ice 00:21:55.309 03:38:35 -- target/perf_adq.sh@53 -- # modprobe ice 00:21:57.845 03:38:38 -- target/perf_adq.sh@54 -- # sleep 5 00:22:03.114 03:38:43 -- target/perf_adq.sh@87 -- # nvmftestinit 00:22:03.114 03:38:43 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:03.114 03:38:43 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:03.114 03:38:43 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:03.114 03:38:43 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:03.114 03:38:43 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:03.114 03:38:43 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:03.114 03:38:43 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:03.114 03:38:43 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:03.114 03:38:43 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:03.114 03:38:43 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:03.114 03:38:43 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:03.114 03:38:43 -- common/autotest_common.sh@10 -- # set +x 00:22:03.114 03:38:43 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:03.114 03:38:43 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:03.114 03:38:43 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:03.114 03:38:43 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:03.114 03:38:43 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:03.114 03:38:43 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:03.114 03:38:43 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:03.114 03:38:43 -- nvmf/common.sh@294 -- # net_devs=() 00:22:03.114 03:38:43 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:03.114 03:38:43 -- nvmf/common.sh@295 -- # e810=() 00:22:03.114 03:38:43 -- nvmf/common.sh@295 -- # local -ga e810 00:22:03.114 03:38:43 -- nvmf/common.sh@296 -- # x722=() 00:22:03.114 03:38:43 -- nvmf/common.sh@296 -- # local -ga x722 00:22:03.114 03:38:43 -- nvmf/common.sh@297 -- # mlx=() 00:22:03.114 03:38:43 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:03.114 03:38:43 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:03.114 03:38:43 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:03.114 03:38:43 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:03.114 03:38:43 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:03.114 03:38:43 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:03.114 03:38:43 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:03.114 03:38:43 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:03.114 03:38:43 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:03.114 03:38:43 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:03.114 03:38:43 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:03.114 03:38:43 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:03.114 03:38:43 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:03.114 03:38:43 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:03.114 03:38:43 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:03.114 03:38:43 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:03.114 03:38:43 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:03.114 03:38:43 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:03.114 03:38:43 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:03.114 03:38:43 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:03.114 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:03.114 03:38:43 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:03.114 03:38:43 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:03.114 03:38:43 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:03.114 03:38:43 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:03.114 03:38:43 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:03.114 03:38:43 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:03.114 03:38:43 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:03.114 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:03.114 03:38:43 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:03.114 03:38:43 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:03.114 03:38:43 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:03.114 03:38:43 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:03.114 03:38:43 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:03.114 03:38:43 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:03.114 03:38:43 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:03.114 03:38:43 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:03.114 03:38:43 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:03.114 03:38:43 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:03.114 03:38:43 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:03.114 03:38:43 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:03.114 03:38:43 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:03.114 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:03.114 03:38:43 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:03.114 03:38:43 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:03.114 03:38:43 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:03.114 03:38:43 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:03.114 03:38:43 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:03.114 03:38:43 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:03.114 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:03.114 03:38:43 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:03.114 03:38:43 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:03.114 03:38:43 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:03.114 03:38:43 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:03.114 03:38:43 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:03.114 03:38:43 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:03.114 03:38:43 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:03.114 03:38:43 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:03.114 03:38:43 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:03.114 03:38:43 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:03.114 03:38:43 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:03.114 03:38:43 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:03.114 03:38:43 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:03.114 03:38:43 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:03.114 03:38:43 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:03.114 03:38:43 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:03.114 03:38:43 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:03.114 03:38:43 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:03.114 03:38:43 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:03.114 03:38:43 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:03.114 03:38:43 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:03.114 03:38:43 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:03.114 03:38:43 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:03.114 03:38:43 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:03.114 03:38:43 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:03.114 03:38:43 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:03.114 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:03.114 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.208 ms 00:22:03.114 00:22:03.114 --- 10.0.0.2 ping statistics --- 00:22:03.114 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:03.114 rtt min/avg/max/mdev = 0.208/0.208/0.208/0.000 ms 00:22:03.114 03:38:43 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:03.114 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:03.114 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.116 ms 00:22:03.114 00:22:03.114 --- 10.0.0.1 ping statistics --- 00:22:03.114 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:03.114 rtt min/avg/max/mdev = 0.116/0.116/0.116/0.000 ms 00:22:03.114 03:38:43 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:03.114 03:38:43 -- nvmf/common.sh@410 -- # return 0 00:22:03.114 03:38:43 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:03.114 03:38:43 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:03.114 03:38:43 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:03.114 03:38:43 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:03.114 03:38:43 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:03.114 03:38:43 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:03.114 03:38:43 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:03.114 03:38:43 -- target/perf_adq.sh@88 -- # adq_configure_driver 00:22:03.114 03:38:43 -- target/perf_adq.sh@22 -- # ip netns exec cvl_0_0_ns_spdk ethtool --offload cvl_0_0 hw-tc-offload on 00:22:03.114 03:38:43 -- target/perf_adq.sh@24 -- # ip netns exec cvl_0_0_ns_spdk ethtool --set-priv-flags cvl_0_0 channel-pkt-inspect-optimize off 00:22:03.114 03:38:43 -- target/perf_adq.sh@26 -- # sysctl -w net.core.busy_poll=1 00:22:03.114 net.core.busy_poll = 1 00:22:03.114 03:38:43 -- target/perf_adq.sh@27 -- # sysctl -w net.core.busy_read=1 00:22:03.114 net.core.busy_read = 1 00:22:03.114 03:38:43 -- target/perf_adq.sh@29 -- # tc=/usr/sbin/tc 00:22:03.115 03:38:43 -- target/perf_adq.sh@31 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 root mqprio num_tc 2 map 0 1 queues 2@0 2@2 hw 1 mode channel 00:22:03.115 03:38:43 -- target/perf_adq.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 ingress 00:22:03.115 03:38:43 -- target/perf_adq.sh@35 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc filter add dev cvl_0_0 protocol ip parent ffff: prio 1 flower dst_ip 10.0.0.2/32 ip_proto tcp dst_port 4420 skip_sw hw_tc 1 00:22:03.115 03:38:43 -- target/perf_adq.sh@38 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/nvmf/set_xps_rxqs cvl_0_0 00:22:03.115 03:38:43 -- target/perf_adq.sh@89 -- # nvmfappstart -m 0xF --wait-for-rpc 00:22:03.115 03:38:43 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:03.115 03:38:43 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:03.115 03:38:43 -- common/autotest_common.sh@10 -- # set +x 00:22:03.115 03:38:43 -- nvmf/common.sh@469 -- # nvmfpid=3112476 00:22:03.115 03:38:43 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:22:03.115 03:38:43 -- nvmf/common.sh@470 -- # waitforlisten 3112476 00:22:03.115 03:38:43 -- common/autotest_common.sh@829 -- # '[' -z 3112476 ']' 00:22:03.115 03:38:43 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:03.115 03:38:43 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:03.115 03:38:43 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:03.115 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:03.115 03:38:43 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:03.115 03:38:43 -- common/autotest_common.sh@10 -- # set +x 00:22:03.115 [2024-11-21 03:38:43.536323] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:03.115 [2024-11-21 03:38:43.536416] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:03.115 EAL: No free 2048 kB hugepages reported on node 1 00:22:03.115 [2024-11-21 03:38:43.599208] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:03.115 [2024-11-21 03:38:43.707953] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:03.115 [2024-11-21 03:38:43.708107] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:03.115 [2024-11-21 03:38:43.708125] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:03.115 [2024-11-21 03:38:43.708138] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:03.115 [2024-11-21 03:38:43.708191] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:03.115 [2024-11-21 03:38:43.708251] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:03.115 [2024-11-21 03:38:43.708319] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:03.115 [2024-11-21 03:38:43.708321] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:03.115 03:38:43 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:03.115 03:38:43 -- common/autotest_common.sh@862 -- # return 0 00:22:03.115 03:38:43 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:03.115 03:38:43 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:03.115 03:38:43 -- common/autotest_common.sh@10 -- # set +x 00:22:03.373 03:38:43 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:03.373 03:38:43 -- target/perf_adq.sh@90 -- # adq_configure_nvmf_target 1 00:22:03.373 03:38:43 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 1 --enable-zerocopy-send-server -i posix 00:22:03.373 03:38:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:03.373 03:38:43 -- common/autotest_common.sh@10 -- # set +x 00:22:03.373 03:38:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:03.373 03:38:43 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:22:03.373 03:38:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:03.373 03:38:43 -- common/autotest_common.sh@10 -- # set +x 00:22:03.373 03:38:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:03.373 03:38:43 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 1 00:22:03.373 03:38:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:03.373 03:38:43 -- common/autotest_common.sh@10 -- # set +x 00:22:03.373 [2024-11-21 03:38:43.906909] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:03.373 03:38:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:03.373 03:38:43 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:22:03.373 03:38:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:03.373 03:38:43 -- common/autotest_common.sh@10 -- # set +x 00:22:03.373 Malloc1 00:22:03.373 03:38:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:03.373 03:38:43 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:22:03.373 03:38:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:03.373 03:38:43 -- common/autotest_common.sh@10 -- # set +x 00:22:03.373 03:38:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:03.373 03:38:43 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:22:03.373 03:38:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:03.373 03:38:43 -- common/autotest_common.sh@10 -- # set +x 00:22:03.373 03:38:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:03.373 03:38:43 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:22:03.373 03:38:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:03.373 03:38:43 -- common/autotest_common.sh@10 -- # set +x 00:22:03.373 [2024-11-21 03:38:43.960185] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:03.373 03:38:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:03.373 03:38:43 -- target/perf_adq.sh@94 -- # perfpid=3112625 00:22:03.373 03:38:43 -- target/perf_adq.sh@95 -- # sleep 2 00:22:03.373 03:38:43 -- target/perf_adq.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:22:03.373 EAL: No free 2048 kB hugepages reported on node 1 00:22:05.901 03:38:45 -- target/perf_adq.sh@97 -- # rpc_cmd nvmf_get_stats 00:22:05.901 03:38:45 -- target/perf_adq.sh@97 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 0) | length' 00:22:05.901 03:38:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:05.901 03:38:45 -- common/autotest_common.sh@10 -- # set +x 00:22:05.902 03:38:45 -- target/perf_adq.sh@97 -- # wc -l 00:22:05.902 03:38:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:05.902 03:38:46 -- target/perf_adq.sh@97 -- # count=2 00:22:05.902 03:38:46 -- target/perf_adq.sh@98 -- # [[ 2 -lt 2 ]] 00:22:05.902 03:38:46 -- target/perf_adq.sh@103 -- # wait 3112625 00:22:14.014 Initializing NVMe Controllers 00:22:14.014 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:22:14.014 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:22:14.014 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:22:14.014 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:22:14.014 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:22:14.014 Initialization complete. Launching workers. 00:22:14.014 ======================================================== 00:22:14.014 Latency(us) 00:22:14.014 Device Information : IOPS MiB/s Average min max 00:22:14.014 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 7687.70 30.03 8354.84 1426.71 54379.63 00:22:14.014 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 7075.00 27.64 9051.33 1539.59 54131.81 00:22:14.014 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 7739.70 30.23 8274.00 1204.66 51741.29 00:22:14.014 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 7088.80 27.69 9029.75 1555.95 51550.37 00:22:14.014 ======================================================== 00:22:14.014 Total : 29591.20 115.59 8661.90 1204.66 54379.63 00:22:14.014 00:22:14.014 03:38:54 -- target/perf_adq.sh@104 -- # nvmftestfini 00:22:14.014 03:38:54 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:14.014 03:38:54 -- nvmf/common.sh@116 -- # sync 00:22:14.014 03:38:54 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:14.014 03:38:54 -- nvmf/common.sh@119 -- # set +e 00:22:14.014 03:38:54 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:14.014 03:38:54 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:14.014 rmmod nvme_tcp 00:22:14.014 rmmod nvme_fabrics 00:22:14.014 rmmod nvme_keyring 00:22:14.014 03:38:54 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:14.014 03:38:54 -- nvmf/common.sh@123 -- # set -e 00:22:14.014 03:38:54 -- nvmf/common.sh@124 -- # return 0 00:22:14.014 03:38:54 -- nvmf/common.sh@477 -- # '[' -n 3112476 ']' 00:22:14.014 03:38:54 -- nvmf/common.sh@478 -- # killprocess 3112476 00:22:14.014 03:38:54 -- common/autotest_common.sh@936 -- # '[' -z 3112476 ']' 00:22:14.014 03:38:54 -- common/autotest_common.sh@940 -- # kill -0 3112476 00:22:14.014 03:38:54 -- common/autotest_common.sh@941 -- # uname 00:22:14.014 03:38:54 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:14.014 03:38:54 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3112476 00:22:14.014 03:38:54 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:14.014 03:38:54 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:14.014 03:38:54 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3112476' 00:22:14.014 killing process with pid 3112476 00:22:14.014 03:38:54 -- common/autotest_common.sh@955 -- # kill 3112476 00:22:14.014 03:38:54 -- common/autotest_common.sh@960 -- # wait 3112476 00:22:14.014 03:38:54 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:14.014 03:38:54 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:14.014 03:38:54 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:14.014 03:38:54 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:14.014 03:38:54 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:14.014 03:38:54 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:14.014 03:38:54 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:14.014 03:38:54 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:16.551 03:38:56 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:16.551 03:38:56 -- target/perf_adq.sh@106 -- # trap - SIGINT SIGTERM EXIT 00:22:16.551 00:22:16.551 real 0m44.867s 00:22:16.551 user 2m36.533s 00:22:16.551 sys 0m10.802s 00:22:16.551 03:38:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:16.551 03:38:56 -- common/autotest_common.sh@10 -- # set +x 00:22:16.551 ************************************ 00:22:16.551 END TEST nvmf_perf_adq 00:22:16.551 ************************************ 00:22:16.551 03:38:56 -- nvmf/nvmf.sh@81 -- # run_test nvmf_shutdown /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:22:16.551 03:38:56 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:22:16.551 03:38:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:16.551 03:38:56 -- common/autotest_common.sh@10 -- # set +x 00:22:16.551 ************************************ 00:22:16.551 START TEST nvmf_shutdown 00:22:16.551 ************************************ 00:22:16.551 03:38:56 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:22:16.551 * Looking for test storage... 00:22:16.551 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:22:16.551 03:38:56 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:22:16.551 03:38:56 -- common/autotest_common.sh@1690 -- # lcov --version 00:22:16.551 03:38:56 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:22:16.551 03:38:56 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:22:16.551 03:38:56 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:22:16.552 03:38:56 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:22:16.552 03:38:56 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:22:16.552 03:38:56 -- scripts/common.sh@335 -- # IFS=.-: 00:22:16.552 03:38:56 -- scripts/common.sh@335 -- # read -ra ver1 00:22:16.552 03:38:56 -- scripts/common.sh@336 -- # IFS=.-: 00:22:16.552 03:38:56 -- scripts/common.sh@336 -- # read -ra ver2 00:22:16.552 03:38:56 -- scripts/common.sh@337 -- # local 'op=<' 00:22:16.552 03:38:56 -- scripts/common.sh@339 -- # ver1_l=2 00:22:16.552 03:38:56 -- scripts/common.sh@340 -- # ver2_l=1 00:22:16.552 03:38:56 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:22:16.552 03:38:56 -- scripts/common.sh@343 -- # case "$op" in 00:22:16.552 03:38:56 -- scripts/common.sh@344 -- # : 1 00:22:16.552 03:38:56 -- scripts/common.sh@363 -- # (( v = 0 )) 00:22:16.552 03:38:56 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:22:16.552 03:38:56 -- scripts/common.sh@364 -- # decimal 1 00:22:16.552 03:38:56 -- scripts/common.sh@352 -- # local d=1 00:22:16.552 03:38:56 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:22:16.552 03:38:56 -- scripts/common.sh@354 -- # echo 1 00:22:16.552 03:38:56 -- scripts/common.sh@364 -- # ver1[v]=1 00:22:16.552 03:38:56 -- scripts/common.sh@365 -- # decimal 2 00:22:16.552 03:38:56 -- scripts/common.sh@352 -- # local d=2 00:22:16.552 03:38:56 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:22:16.552 03:38:56 -- scripts/common.sh@354 -- # echo 2 00:22:16.552 03:38:56 -- scripts/common.sh@365 -- # ver2[v]=2 00:22:16.552 03:38:56 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:22:16.552 03:38:56 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:22:16.552 03:38:56 -- scripts/common.sh@367 -- # return 0 00:22:16.552 03:38:56 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:22:16.552 03:38:56 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:22:16.552 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:16.552 --rc genhtml_branch_coverage=1 00:22:16.552 --rc genhtml_function_coverage=1 00:22:16.552 --rc genhtml_legend=1 00:22:16.552 --rc geninfo_all_blocks=1 00:22:16.552 --rc geninfo_unexecuted_blocks=1 00:22:16.552 00:22:16.552 ' 00:22:16.552 03:38:56 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:22:16.552 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:16.552 --rc genhtml_branch_coverage=1 00:22:16.552 --rc genhtml_function_coverage=1 00:22:16.552 --rc genhtml_legend=1 00:22:16.552 --rc geninfo_all_blocks=1 00:22:16.552 --rc geninfo_unexecuted_blocks=1 00:22:16.552 00:22:16.552 ' 00:22:16.552 03:38:56 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:22:16.552 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:16.552 --rc genhtml_branch_coverage=1 00:22:16.552 --rc genhtml_function_coverage=1 00:22:16.552 --rc genhtml_legend=1 00:22:16.552 --rc geninfo_all_blocks=1 00:22:16.552 --rc geninfo_unexecuted_blocks=1 00:22:16.552 00:22:16.552 ' 00:22:16.552 03:38:56 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:22:16.552 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:16.552 --rc genhtml_branch_coverage=1 00:22:16.552 --rc genhtml_function_coverage=1 00:22:16.552 --rc genhtml_legend=1 00:22:16.552 --rc geninfo_all_blocks=1 00:22:16.552 --rc geninfo_unexecuted_blocks=1 00:22:16.552 00:22:16.552 ' 00:22:16.552 03:38:56 -- target/shutdown.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:16.552 03:38:56 -- nvmf/common.sh@7 -- # uname -s 00:22:16.552 03:38:56 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:16.552 03:38:56 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:16.552 03:38:56 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:16.552 03:38:56 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:16.552 03:38:56 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:16.552 03:38:56 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:16.552 03:38:56 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:16.552 03:38:56 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:16.552 03:38:56 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:16.552 03:38:56 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:16.552 03:38:56 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:22:16.552 03:38:56 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:22:16.552 03:38:56 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:16.552 03:38:56 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:16.552 03:38:56 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:16.552 03:38:56 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:16.552 03:38:56 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:16.552 03:38:56 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:16.552 03:38:56 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:16.552 03:38:56 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:16.552 03:38:56 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:16.552 03:38:56 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:16.552 03:38:56 -- paths/export.sh@5 -- # export PATH 00:22:16.552 03:38:56 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:16.552 03:38:56 -- nvmf/common.sh@46 -- # : 0 00:22:16.552 03:38:56 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:16.552 03:38:56 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:16.552 03:38:56 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:16.552 03:38:56 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:16.552 03:38:56 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:16.552 03:38:56 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:16.552 03:38:56 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:16.552 03:38:56 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:16.552 03:38:56 -- target/shutdown.sh@11 -- # MALLOC_BDEV_SIZE=64 00:22:16.552 03:38:56 -- target/shutdown.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:22:16.552 03:38:56 -- target/shutdown.sh@146 -- # run_test nvmf_shutdown_tc1 nvmf_shutdown_tc1 00:22:16.552 03:38:56 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:22:16.552 03:38:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:16.552 03:38:56 -- common/autotest_common.sh@10 -- # set +x 00:22:16.552 ************************************ 00:22:16.552 START TEST nvmf_shutdown_tc1 00:22:16.552 ************************************ 00:22:16.552 03:38:56 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc1 00:22:16.552 03:38:56 -- target/shutdown.sh@74 -- # starttarget 00:22:16.552 03:38:56 -- target/shutdown.sh@15 -- # nvmftestinit 00:22:16.552 03:38:56 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:16.552 03:38:56 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:16.552 03:38:56 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:16.552 03:38:56 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:16.552 03:38:56 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:16.552 03:38:56 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:16.552 03:38:56 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:16.552 03:38:56 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:16.552 03:38:56 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:16.552 03:38:56 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:16.552 03:38:56 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:16.552 03:38:56 -- common/autotest_common.sh@10 -- # set +x 00:22:18.494 03:38:58 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:18.494 03:38:58 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:18.494 03:38:58 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:18.494 03:38:58 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:18.494 03:38:58 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:18.494 03:38:58 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:18.494 03:38:58 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:18.494 03:38:58 -- nvmf/common.sh@294 -- # net_devs=() 00:22:18.494 03:38:58 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:18.494 03:38:58 -- nvmf/common.sh@295 -- # e810=() 00:22:18.494 03:38:58 -- nvmf/common.sh@295 -- # local -ga e810 00:22:18.494 03:38:58 -- nvmf/common.sh@296 -- # x722=() 00:22:18.494 03:38:58 -- nvmf/common.sh@296 -- # local -ga x722 00:22:18.494 03:38:58 -- nvmf/common.sh@297 -- # mlx=() 00:22:18.494 03:38:58 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:18.494 03:38:58 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:18.494 03:38:58 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:18.494 03:38:58 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:18.494 03:38:58 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:18.494 03:38:58 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:18.494 03:38:58 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:18.494 03:38:58 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:18.494 03:38:58 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:18.494 03:38:58 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:18.494 03:38:58 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:18.494 03:38:58 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:18.494 03:38:58 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:18.494 03:38:58 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:18.494 03:38:58 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:18.494 03:38:58 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:18.494 03:38:58 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:18.494 03:38:58 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:18.494 03:38:58 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:18.494 03:38:58 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:18.494 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:18.494 03:38:58 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:18.494 03:38:58 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:18.494 03:38:58 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:18.494 03:38:58 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:18.494 03:38:58 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:18.494 03:38:58 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:18.494 03:38:58 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:18.494 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:18.494 03:38:58 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:18.494 03:38:58 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:18.494 03:38:58 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:18.494 03:38:58 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:18.494 03:38:58 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:18.494 03:38:58 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:18.494 03:38:58 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:18.494 03:38:58 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:18.494 03:38:58 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:18.494 03:38:58 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:18.494 03:38:58 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:18.494 03:38:58 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:18.494 03:38:58 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:18.494 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:18.494 03:38:58 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:18.494 03:38:58 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:18.494 03:38:58 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:18.494 03:38:58 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:18.494 03:38:58 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:18.494 03:38:58 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:18.494 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:18.494 03:38:58 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:18.494 03:38:58 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:18.494 03:38:58 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:18.494 03:38:58 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:18.494 03:38:58 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:18.494 03:38:58 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:18.494 03:38:58 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:18.494 03:38:58 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:18.494 03:38:58 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:18.494 03:38:58 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:18.494 03:38:58 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:18.494 03:38:58 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:18.494 03:38:58 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:18.494 03:38:58 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:18.494 03:38:58 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:18.494 03:38:58 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:18.494 03:38:58 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:18.494 03:38:58 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:18.494 03:38:58 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:18.494 03:38:58 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:18.494 03:38:58 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:18.494 03:38:58 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:18.494 03:38:58 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:18.494 03:38:58 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:18.494 03:38:58 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:18.494 03:38:58 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:18.494 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:18.494 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.231 ms 00:22:18.494 00:22:18.494 --- 10.0.0.2 ping statistics --- 00:22:18.494 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:18.494 rtt min/avg/max/mdev = 0.231/0.231/0.231/0.000 ms 00:22:18.495 03:38:58 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:18.495 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:18.495 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.115 ms 00:22:18.495 00:22:18.495 --- 10.0.0.1 ping statistics --- 00:22:18.495 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:18.495 rtt min/avg/max/mdev = 0.115/0.115/0.115/0.000 ms 00:22:18.495 03:38:58 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:18.495 03:38:58 -- nvmf/common.sh@410 -- # return 0 00:22:18.495 03:38:58 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:18.495 03:38:58 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:18.495 03:38:58 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:18.495 03:38:58 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:18.495 03:38:58 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:18.495 03:38:58 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:18.495 03:38:58 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:18.495 03:38:58 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:22:18.495 03:38:58 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:18.495 03:38:58 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:18.495 03:38:58 -- common/autotest_common.sh@10 -- # set +x 00:22:18.495 03:38:58 -- nvmf/common.sh@469 -- # nvmfpid=3115855 00:22:18.495 03:38:58 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:22:18.495 03:38:58 -- nvmf/common.sh@470 -- # waitforlisten 3115855 00:22:18.495 03:38:58 -- common/autotest_common.sh@829 -- # '[' -z 3115855 ']' 00:22:18.495 03:38:58 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:18.495 03:38:58 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:18.495 03:38:58 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:18.495 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:18.495 03:38:58 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:18.495 03:38:58 -- common/autotest_common.sh@10 -- # set +x 00:22:18.495 [2024-11-21 03:38:58.982730] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:18.495 [2024-11-21 03:38:58.982808] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:18.495 EAL: No free 2048 kB hugepages reported on node 1 00:22:18.495 [2024-11-21 03:38:59.049665] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:18.755 [2024-11-21 03:38:59.164399] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:18.756 [2024-11-21 03:38:59.164553] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:18.756 [2024-11-21 03:38:59.164579] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:18.756 [2024-11-21 03:38:59.164593] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:18.756 [2024-11-21 03:38:59.164696] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:18.756 [2024-11-21 03:38:59.164791] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:18.756 [2024-11-21 03:38:59.164942] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:22:18.756 [2024-11-21 03:38:59.164945] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:19.689 03:38:59 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:19.689 03:38:59 -- common/autotest_common.sh@862 -- # return 0 00:22:19.689 03:38:59 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:19.689 03:38:59 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:19.689 03:38:59 -- common/autotest_common.sh@10 -- # set +x 00:22:19.689 03:39:00 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:19.689 03:39:00 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:19.689 03:39:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:19.689 03:39:00 -- common/autotest_common.sh@10 -- # set +x 00:22:19.689 [2024-11-21 03:39:00.012787] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:19.689 03:39:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:19.689 03:39:00 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:22:19.689 03:39:00 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:22:19.689 03:39:00 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:19.689 03:39:00 -- common/autotest_common.sh@10 -- # set +x 00:22:19.689 03:39:00 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:19.689 03:39:00 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:19.689 03:39:00 -- target/shutdown.sh@28 -- # cat 00:22:19.689 03:39:00 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:19.689 03:39:00 -- target/shutdown.sh@28 -- # cat 00:22:19.689 03:39:00 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:19.689 03:39:00 -- target/shutdown.sh@28 -- # cat 00:22:19.689 03:39:00 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:19.689 03:39:00 -- target/shutdown.sh@28 -- # cat 00:22:19.689 03:39:00 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:19.689 03:39:00 -- target/shutdown.sh@28 -- # cat 00:22:19.689 03:39:00 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:19.689 03:39:00 -- target/shutdown.sh@28 -- # cat 00:22:19.689 03:39:00 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:19.689 03:39:00 -- target/shutdown.sh@28 -- # cat 00:22:19.689 03:39:00 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:19.689 03:39:00 -- target/shutdown.sh@28 -- # cat 00:22:19.689 03:39:00 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:19.689 03:39:00 -- target/shutdown.sh@28 -- # cat 00:22:19.689 03:39:00 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:19.689 03:39:00 -- target/shutdown.sh@28 -- # cat 00:22:19.689 03:39:00 -- target/shutdown.sh@35 -- # rpc_cmd 00:22:19.689 03:39:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:19.689 03:39:00 -- common/autotest_common.sh@10 -- # set +x 00:22:19.689 Malloc1 00:22:19.689 [2024-11-21 03:39:00.088512] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:19.689 Malloc2 00:22:19.689 Malloc3 00:22:19.689 Malloc4 00:22:19.689 Malloc5 00:22:19.689 Malloc6 00:22:19.949 Malloc7 00:22:19.949 Malloc8 00:22:19.949 Malloc9 00:22:19.949 Malloc10 00:22:19.949 03:39:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:19.949 03:39:00 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:22:19.949 03:39:00 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:19.949 03:39:00 -- common/autotest_common.sh@10 -- # set +x 00:22:19.949 03:39:00 -- target/shutdown.sh@78 -- # perfpid=3116093 00:22:19.949 03:39:00 -- target/shutdown.sh@79 -- # waitforlisten 3116093 /var/tmp/bdevperf.sock 00:22:19.949 03:39:00 -- common/autotest_common.sh@829 -- # '[' -z 3116093 ']' 00:22:19.949 03:39:00 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:22:19.949 03:39:00 -- target/shutdown.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json /dev/fd/63 00:22:19.949 03:39:00 -- target/shutdown.sh@77 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:22:19.949 03:39:00 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:19.949 03:39:00 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:22:19.949 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:22:19.949 03:39:00 -- nvmf/common.sh@520 -- # config=() 00:22:19.949 03:39:00 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:19.949 03:39:00 -- nvmf/common.sh@520 -- # local subsystem config 00:22:19.949 03:39:00 -- common/autotest_common.sh@10 -- # set +x 00:22:19.949 03:39:00 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:19.949 03:39:00 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:19.949 { 00:22:19.949 "params": { 00:22:19.949 "name": "Nvme$subsystem", 00:22:19.949 "trtype": "$TEST_TRANSPORT", 00:22:19.949 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:19.949 "adrfam": "ipv4", 00:22:19.949 "trsvcid": "$NVMF_PORT", 00:22:19.949 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:19.949 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:19.949 "hdgst": ${hdgst:-false}, 00:22:19.949 "ddgst": ${ddgst:-false} 00:22:19.949 }, 00:22:19.949 "method": "bdev_nvme_attach_controller" 00:22:19.949 } 00:22:19.949 EOF 00:22:19.949 )") 00:22:19.949 03:39:00 -- nvmf/common.sh@542 -- # cat 00:22:19.949 03:39:00 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:19.949 03:39:00 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:19.949 { 00:22:19.949 "params": { 00:22:19.949 "name": "Nvme$subsystem", 00:22:19.949 "trtype": "$TEST_TRANSPORT", 00:22:19.949 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:19.949 "adrfam": "ipv4", 00:22:19.949 "trsvcid": "$NVMF_PORT", 00:22:19.949 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:19.949 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:19.949 "hdgst": ${hdgst:-false}, 00:22:19.949 "ddgst": ${ddgst:-false} 00:22:19.949 }, 00:22:19.949 "method": "bdev_nvme_attach_controller" 00:22:19.949 } 00:22:19.949 EOF 00:22:19.949 )") 00:22:19.949 03:39:00 -- nvmf/common.sh@542 -- # cat 00:22:19.949 03:39:00 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:19.949 03:39:00 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:19.949 { 00:22:19.949 "params": { 00:22:19.949 "name": "Nvme$subsystem", 00:22:19.949 "trtype": "$TEST_TRANSPORT", 00:22:19.949 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:19.949 "adrfam": "ipv4", 00:22:19.949 "trsvcid": "$NVMF_PORT", 00:22:19.949 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:19.949 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:19.949 "hdgst": ${hdgst:-false}, 00:22:19.949 "ddgst": ${ddgst:-false} 00:22:19.949 }, 00:22:19.949 "method": "bdev_nvme_attach_controller" 00:22:19.949 } 00:22:19.949 EOF 00:22:19.949 )") 00:22:19.949 03:39:00 -- nvmf/common.sh@542 -- # cat 00:22:19.949 03:39:00 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:19.949 03:39:00 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:19.949 { 00:22:19.949 "params": { 00:22:19.949 "name": "Nvme$subsystem", 00:22:19.949 "trtype": "$TEST_TRANSPORT", 00:22:19.949 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:19.949 "adrfam": "ipv4", 00:22:19.949 "trsvcid": "$NVMF_PORT", 00:22:19.949 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:19.949 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:19.949 "hdgst": ${hdgst:-false}, 00:22:19.949 "ddgst": ${ddgst:-false} 00:22:19.949 }, 00:22:19.949 "method": "bdev_nvme_attach_controller" 00:22:19.949 } 00:22:19.949 EOF 00:22:19.949 )") 00:22:19.949 03:39:00 -- nvmf/common.sh@542 -- # cat 00:22:19.949 03:39:00 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:19.949 03:39:00 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:19.949 { 00:22:19.949 "params": { 00:22:19.949 "name": "Nvme$subsystem", 00:22:19.949 "trtype": "$TEST_TRANSPORT", 00:22:19.949 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:19.949 "adrfam": "ipv4", 00:22:19.949 "trsvcid": "$NVMF_PORT", 00:22:19.949 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:19.949 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:19.949 "hdgst": ${hdgst:-false}, 00:22:19.949 "ddgst": ${ddgst:-false} 00:22:19.949 }, 00:22:19.949 "method": "bdev_nvme_attach_controller" 00:22:19.949 } 00:22:19.949 EOF 00:22:19.949 )") 00:22:19.949 03:39:00 -- nvmf/common.sh@542 -- # cat 00:22:19.949 03:39:00 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:19.949 03:39:00 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:19.949 { 00:22:19.949 "params": { 00:22:19.949 "name": "Nvme$subsystem", 00:22:19.949 "trtype": "$TEST_TRANSPORT", 00:22:19.949 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:19.949 "adrfam": "ipv4", 00:22:19.949 "trsvcid": "$NVMF_PORT", 00:22:19.949 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:19.949 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:19.949 "hdgst": ${hdgst:-false}, 00:22:19.949 "ddgst": ${ddgst:-false} 00:22:19.949 }, 00:22:19.949 "method": "bdev_nvme_attach_controller" 00:22:19.949 } 00:22:19.949 EOF 00:22:19.949 )") 00:22:19.949 03:39:00 -- nvmf/common.sh@542 -- # cat 00:22:19.949 03:39:00 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:19.949 03:39:00 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:19.949 { 00:22:19.949 "params": { 00:22:19.949 "name": "Nvme$subsystem", 00:22:19.949 "trtype": "$TEST_TRANSPORT", 00:22:19.949 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:19.949 "adrfam": "ipv4", 00:22:19.949 "trsvcid": "$NVMF_PORT", 00:22:19.949 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:19.949 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:19.949 "hdgst": ${hdgst:-false}, 00:22:19.949 "ddgst": ${ddgst:-false} 00:22:19.949 }, 00:22:19.949 "method": "bdev_nvme_attach_controller" 00:22:19.949 } 00:22:19.949 EOF 00:22:19.949 )") 00:22:19.949 03:39:00 -- nvmf/common.sh@542 -- # cat 00:22:19.949 03:39:00 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:19.950 03:39:00 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:19.950 { 00:22:19.950 "params": { 00:22:19.950 "name": "Nvme$subsystem", 00:22:19.950 "trtype": "$TEST_TRANSPORT", 00:22:19.950 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:19.950 "adrfam": "ipv4", 00:22:19.950 "trsvcid": "$NVMF_PORT", 00:22:19.950 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:19.950 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:19.950 "hdgst": ${hdgst:-false}, 00:22:19.950 "ddgst": ${ddgst:-false} 00:22:19.950 }, 00:22:19.950 "method": "bdev_nvme_attach_controller" 00:22:19.950 } 00:22:19.950 EOF 00:22:19.950 )") 00:22:19.950 03:39:00 -- nvmf/common.sh@542 -- # cat 00:22:19.950 03:39:00 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:19.950 03:39:00 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:19.950 { 00:22:19.950 "params": { 00:22:19.950 "name": "Nvme$subsystem", 00:22:19.950 "trtype": "$TEST_TRANSPORT", 00:22:19.950 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:19.950 "adrfam": "ipv4", 00:22:19.950 "trsvcid": "$NVMF_PORT", 00:22:19.950 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:19.950 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:19.950 "hdgst": ${hdgst:-false}, 00:22:19.950 "ddgst": ${ddgst:-false} 00:22:19.950 }, 00:22:19.950 "method": "bdev_nvme_attach_controller" 00:22:19.950 } 00:22:19.950 EOF 00:22:19.950 )") 00:22:19.950 03:39:00 -- nvmf/common.sh@542 -- # cat 00:22:19.950 03:39:00 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:19.950 03:39:00 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:19.950 { 00:22:19.950 "params": { 00:22:19.950 "name": "Nvme$subsystem", 00:22:19.950 "trtype": "$TEST_TRANSPORT", 00:22:19.950 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:19.950 "adrfam": "ipv4", 00:22:19.950 "trsvcid": "$NVMF_PORT", 00:22:19.950 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:19.950 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:19.950 "hdgst": ${hdgst:-false}, 00:22:19.950 "ddgst": ${ddgst:-false} 00:22:19.950 }, 00:22:19.950 "method": "bdev_nvme_attach_controller" 00:22:19.950 } 00:22:19.950 EOF 00:22:19.950 )") 00:22:19.950 03:39:00 -- nvmf/common.sh@542 -- # cat 00:22:19.950 03:39:00 -- nvmf/common.sh@544 -- # jq . 00:22:19.950 03:39:00 -- nvmf/common.sh@545 -- # IFS=, 00:22:19.950 03:39:00 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:22:19.950 "params": { 00:22:19.950 "name": "Nvme1", 00:22:19.950 "trtype": "tcp", 00:22:19.950 "traddr": "10.0.0.2", 00:22:19.950 "adrfam": "ipv4", 00:22:19.950 "trsvcid": "4420", 00:22:19.950 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:19.950 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:22:19.950 "hdgst": false, 00:22:19.950 "ddgst": false 00:22:19.950 }, 00:22:19.950 "method": "bdev_nvme_attach_controller" 00:22:19.950 },{ 00:22:19.950 "params": { 00:22:19.950 "name": "Nvme2", 00:22:19.950 "trtype": "tcp", 00:22:19.950 "traddr": "10.0.0.2", 00:22:19.950 "adrfam": "ipv4", 00:22:19.950 "trsvcid": "4420", 00:22:19.950 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:19.950 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:22:19.950 "hdgst": false, 00:22:19.950 "ddgst": false 00:22:19.950 }, 00:22:19.950 "method": "bdev_nvme_attach_controller" 00:22:19.950 },{ 00:22:19.950 "params": { 00:22:19.950 "name": "Nvme3", 00:22:19.950 "trtype": "tcp", 00:22:19.950 "traddr": "10.0.0.2", 00:22:19.950 "adrfam": "ipv4", 00:22:19.950 "trsvcid": "4420", 00:22:19.950 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:22:19.950 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:22:19.950 "hdgst": false, 00:22:19.950 "ddgst": false 00:22:19.950 }, 00:22:19.950 "method": "bdev_nvme_attach_controller" 00:22:19.950 },{ 00:22:19.950 "params": { 00:22:19.950 "name": "Nvme4", 00:22:19.950 "trtype": "tcp", 00:22:19.950 "traddr": "10.0.0.2", 00:22:19.950 "adrfam": "ipv4", 00:22:19.950 "trsvcid": "4420", 00:22:19.950 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:22:19.950 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:22:19.950 "hdgst": false, 00:22:19.950 "ddgst": false 00:22:19.950 }, 00:22:19.950 "method": "bdev_nvme_attach_controller" 00:22:19.950 },{ 00:22:19.950 "params": { 00:22:19.950 "name": "Nvme5", 00:22:19.950 "trtype": "tcp", 00:22:19.950 "traddr": "10.0.0.2", 00:22:19.950 "adrfam": "ipv4", 00:22:19.950 "trsvcid": "4420", 00:22:19.950 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:22:19.950 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:22:19.950 "hdgst": false, 00:22:19.950 "ddgst": false 00:22:19.950 }, 00:22:19.950 "method": "bdev_nvme_attach_controller" 00:22:19.950 },{ 00:22:19.950 "params": { 00:22:19.950 "name": "Nvme6", 00:22:19.950 "trtype": "tcp", 00:22:19.950 "traddr": "10.0.0.2", 00:22:19.950 "adrfam": "ipv4", 00:22:19.950 "trsvcid": "4420", 00:22:19.950 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:22:19.950 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:22:19.950 "hdgst": false, 00:22:19.950 "ddgst": false 00:22:19.950 }, 00:22:19.950 "method": "bdev_nvme_attach_controller" 00:22:19.950 },{ 00:22:19.950 "params": { 00:22:19.950 "name": "Nvme7", 00:22:19.950 "trtype": "tcp", 00:22:19.950 "traddr": "10.0.0.2", 00:22:19.950 "adrfam": "ipv4", 00:22:19.950 "trsvcid": "4420", 00:22:19.950 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:22:19.950 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:22:19.950 "hdgst": false, 00:22:19.950 "ddgst": false 00:22:19.950 }, 00:22:19.950 "method": "bdev_nvme_attach_controller" 00:22:19.950 },{ 00:22:19.950 "params": { 00:22:19.950 "name": "Nvme8", 00:22:19.950 "trtype": "tcp", 00:22:19.950 "traddr": "10.0.0.2", 00:22:19.950 "adrfam": "ipv4", 00:22:19.950 "trsvcid": "4420", 00:22:19.950 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:22:19.950 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:22:19.950 "hdgst": false, 00:22:19.950 "ddgst": false 00:22:19.950 }, 00:22:19.950 "method": "bdev_nvme_attach_controller" 00:22:19.950 },{ 00:22:19.950 "params": { 00:22:19.950 "name": "Nvme9", 00:22:19.950 "trtype": "tcp", 00:22:19.950 "traddr": "10.0.0.2", 00:22:19.950 "adrfam": "ipv4", 00:22:19.950 "trsvcid": "4420", 00:22:19.950 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:22:19.950 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:22:19.950 "hdgst": false, 00:22:19.950 "ddgst": false 00:22:19.950 }, 00:22:19.950 "method": "bdev_nvme_attach_controller" 00:22:19.950 },{ 00:22:19.950 "params": { 00:22:19.950 "name": "Nvme10", 00:22:19.950 "trtype": "tcp", 00:22:19.950 "traddr": "10.0.0.2", 00:22:19.950 "adrfam": "ipv4", 00:22:19.950 "trsvcid": "4420", 00:22:19.950 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:22:19.950 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:22:19.950 "hdgst": false, 00:22:19.950 "ddgst": false 00:22:19.950 }, 00:22:19.950 "method": "bdev_nvme_attach_controller" 00:22:19.950 }' 00:22:19.950 [2024-11-21 03:39:00.586320] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:19.950 [2024-11-21 03:39:00.586413] [ DPDK EAL parameters: bdev_svc -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:22:20.209 EAL: No free 2048 kB hugepages reported on node 1 00:22:20.209 [2024-11-21 03:39:00.651578] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:20.209 [2024-11-21 03:39:00.762288] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:22.105 03:39:02 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:22.105 03:39:02 -- common/autotest_common.sh@862 -- # return 0 00:22:22.105 03:39:02 -- target/shutdown.sh@80 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:22:22.105 03:39:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:22.105 03:39:02 -- common/autotest_common.sh@10 -- # set +x 00:22:22.105 03:39:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:22.105 03:39:02 -- target/shutdown.sh@83 -- # kill -9 3116093 00:22:22.105 03:39:02 -- target/shutdown.sh@84 -- # rm -f /var/run/spdk_bdev1 00:22:22.105 03:39:02 -- target/shutdown.sh@87 -- # sleep 1 00:22:23.039 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 73: 3116093 Killed $rootdir/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json <(gen_nvmf_target_json "${num_subsystems[@]}") 00:22:23.039 03:39:03 -- target/shutdown.sh@88 -- # kill -0 3115855 00:22:23.039 03:39:03 -- target/shutdown.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:22:23.039 03:39:03 -- target/shutdown.sh@91 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:22:23.039 03:39:03 -- nvmf/common.sh@520 -- # config=() 00:22:23.039 03:39:03 -- nvmf/common.sh@520 -- # local subsystem config 00:22:23.039 03:39:03 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:23.039 03:39:03 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:23.039 { 00:22:23.039 "params": { 00:22:23.039 "name": "Nvme$subsystem", 00:22:23.039 "trtype": "$TEST_TRANSPORT", 00:22:23.039 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:23.039 "adrfam": "ipv4", 00:22:23.039 "trsvcid": "$NVMF_PORT", 00:22:23.039 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:23.039 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:23.039 "hdgst": ${hdgst:-false}, 00:22:23.039 "ddgst": ${ddgst:-false} 00:22:23.039 }, 00:22:23.039 "method": "bdev_nvme_attach_controller" 00:22:23.039 } 00:22:23.039 EOF 00:22:23.039 )") 00:22:23.039 03:39:03 -- nvmf/common.sh@542 -- # cat 00:22:23.039 03:39:03 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:23.039 03:39:03 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:23.039 { 00:22:23.039 "params": { 00:22:23.039 "name": "Nvme$subsystem", 00:22:23.039 "trtype": "$TEST_TRANSPORT", 00:22:23.039 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:23.039 "adrfam": "ipv4", 00:22:23.039 "trsvcid": "$NVMF_PORT", 00:22:23.039 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:23.039 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:23.039 "hdgst": ${hdgst:-false}, 00:22:23.039 "ddgst": ${ddgst:-false} 00:22:23.039 }, 00:22:23.039 "method": "bdev_nvme_attach_controller" 00:22:23.039 } 00:22:23.039 EOF 00:22:23.039 )") 00:22:23.039 03:39:03 -- nvmf/common.sh@542 -- # cat 00:22:23.039 03:39:03 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:23.039 03:39:03 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:23.039 { 00:22:23.039 "params": { 00:22:23.039 "name": "Nvme$subsystem", 00:22:23.039 "trtype": "$TEST_TRANSPORT", 00:22:23.039 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:23.039 "adrfam": "ipv4", 00:22:23.039 "trsvcid": "$NVMF_PORT", 00:22:23.039 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:23.039 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:23.039 "hdgst": ${hdgst:-false}, 00:22:23.039 "ddgst": ${ddgst:-false} 00:22:23.039 }, 00:22:23.039 "method": "bdev_nvme_attach_controller" 00:22:23.039 } 00:22:23.039 EOF 00:22:23.039 )") 00:22:23.039 03:39:03 -- nvmf/common.sh@542 -- # cat 00:22:23.039 03:39:03 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:23.039 03:39:03 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:23.039 { 00:22:23.039 "params": { 00:22:23.040 "name": "Nvme$subsystem", 00:22:23.040 "trtype": "$TEST_TRANSPORT", 00:22:23.040 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:23.040 "adrfam": "ipv4", 00:22:23.040 "trsvcid": "$NVMF_PORT", 00:22:23.040 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:23.040 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:23.040 "hdgst": ${hdgst:-false}, 00:22:23.040 "ddgst": ${ddgst:-false} 00:22:23.040 }, 00:22:23.040 "method": "bdev_nvme_attach_controller" 00:22:23.040 } 00:22:23.040 EOF 00:22:23.040 )") 00:22:23.040 03:39:03 -- nvmf/common.sh@542 -- # cat 00:22:23.040 03:39:03 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:23.040 03:39:03 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:23.040 { 00:22:23.040 "params": { 00:22:23.040 "name": "Nvme$subsystem", 00:22:23.040 "trtype": "$TEST_TRANSPORT", 00:22:23.040 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:23.040 "adrfam": "ipv4", 00:22:23.040 "trsvcid": "$NVMF_PORT", 00:22:23.040 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:23.040 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:23.040 "hdgst": ${hdgst:-false}, 00:22:23.040 "ddgst": ${ddgst:-false} 00:22:23.040 }, 00:22:23.040 "method": "bdev_nvme_attach_controller" 00:22:23.040 } 00:22:23.040 EOF 00:22:23.040 )") 00:22:23.040 03:39:03 -- nvmf/common.sh@542 -- # cat 00:22:23.040 03:39:03 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:23.040 03:39:03 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:23.040 { 00:22:23.040 "params": { 00:22:23.040 "name": "Nvme$subsystem", 00:22:23.040 "trtype": "$TEST_TRANSPORT", 00:22:23.040 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:23.040 "adrfam": "ipv4", 00:22:23.040 "trsvcid": "$NVMF_PORT", 00:22:23.040 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:23.040 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:23.040 "hdgst": ${hdgst:-false}, 00:22:23.040 "ddgst": ${ddgst:-false} 00:22:23.040 }, 00:22:23.040 "method": "bdev_nvme_attach_controller" 00:22:23.040 } 00:22:23.040 EOF 00:22:23.040 )") 00:22:23.040 03:39:03 -- nvmf/common.sh@542 -- # cat 00:22:23.040 03:39:03 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:23.040 03:39:03 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:23.040 { 00:22:23.040 "params": { 00:22:23.040 "name": "Nvme$subsystem", 00:22:23.040 "trtype": "$TEST_TRANSPORT", 00:22:23.040 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:23.040 "adrfam": "ipv4", 00:22:23.040 "trsvcid": "$NVMF_PORT", 00:22:23.040 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:23.040 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:23.040 "hdgst": ${hdgst:-false}, 00:22:23.040 "ddgst": ${ddgst:-false} 00:22:23.040 }, 00:22:23.040 "method": "bdev_nvme_attach_controller" 00:22:23.040 } 00:22:23.040 EOF 00:22:23.040 )") 00:22:23.040 03:39:03 -- nvmf/common.sh@542 -- # cat 00:22:23.040 03:39:03 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:23.040 03:39:03 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:23.040 { 00:22:23.040 "params": { 00:22:23.040 "name": "Nvme$subsystem", 00:22:23.040 "trtype": "$TEST_TRANSPORT", 00:22:23.040 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:23.040 "adrfam": "ipv4", 00:22:23.040 "trsvcid": "$NVMF_PORT", 00:22:23.040 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:23.040 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:23.040 "hdgst": ${hdgst:-false}, 00:22:23.040 "ddgst": ${ddgst:-false} 00:22:23.040 }, 00:22:23.040 "method": "bdev_nvme_attach_controller" 00:22:23.040 } 00:22:23.040 EOF 00:22:23.040 )") 00:22:23.040 03:39:03 -- nvmf/common.sh@542 -- # cat 00:22:23.040 03:39:03 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:23.040 03:39:03 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:23.040 { 00:22:23.040 "params": { 00:22:23.040 "name": "Nvme$subsystem", 00:22:23.040 "trtype": "$TEST_TRANSPORT", 00:22:23.040 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:23.040 "adrfam": "ipv4", 00:22:23.040 "trsvcid": "$NVMF_PORT", 00:22:23.040 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:23.040 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:23.040 "hdgst": ${hdgst:-false}, 00:22:23.040 "ddgst": ${ddgst:-false} 00:22:23.040 }, 00:22:23.040 "method": "bdev_nvme_attach_controller" 00:22:23.040 } 00:22:23.040 EOF 00:22:23.040 )") 00:22:23.040 03:39:03 -- nvmf/common.sh@542 -- # cat 00:22:23.040 03:39:03 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:23.040 03:39:03 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:23.040 { 00:22:23.040 "params": { 00:22:23.040 "name": "Nvme$subsystem", 00:22:23.040 "trtype": "$TEST_TRANSPORT", 00:22:23.040 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:23.040 "adrfam": "ipv4", 00:22:23.040 "trsvcid": "$NVMF_PORT", 00:22:23.040 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:23.040 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:23.040 "hdgst": ${hdgst:-false}, 00:22:23.040 "ddgst": ${ddgst:-false} 00:22:23.040 }, 00:22:23.040 "method": "bdev_nvme_attach_controller" 00:22:23.040 } 00:22:23.040 EOF 00:22:23.040 )") 00:22:23.040 03:39:03 -- nvmf/common.sh@542 -- # cat 00:22:23.040 03:39:03 -- nvmf/common.sh@544 -- # jq . 00:22:23.040 03:39:03 -- nvmf/common.sh@545 -- # IFS=, 00:22:23.040 03:39:03 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:22:23.040 "params": { 00:22:23.040 "name": "Nvme1", 00:22:23.040 "trtype": "tcp", 00:22:23.040 "traddr": "10.0.0.2", 00:22:23.040 "adrfam": "ipv4", 00:22:23.040 "trsvcid": "4420", 00:22:23.040 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:23.040 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:22:23.040 "hdgst": false, 00:22:23.040 "ddgst": false 00:22:23.040 }, 00:22:23.040 "method": "bdev_nvme_attach_controller" 00:22:23.040 },{ 00:22:23.040 "params": { 00:22:23.040 "name": "Nvme2", 00:22:23.040 "trtype": "tcp", 00:22:23.040 "traddr": "10.0.0.2", 00:22:23.040 "adrfam": "ipv4", 00:22:23.040 "trsvcid": "4420", 00:22:23.040 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:23.040 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:22:23.040 "hdgst": false, 00:22:23.040 "ddgst": false 00:22:23.040 }, 00:22:23.040 "method": "bdev_nvme_attach_controller" 00:22:23.040 },{ 00:22:23.040 "params": { 00:22:23.040 "name": "Nvme3", 00:22:23.040 "trtype": "tcp", 00:22:23.040 "traddr": "10.0.0.2", 00:22:23.040 "adrfam": "ipv4", 00:22:23.040 "trsvcid": "4420", 00:22:23.040 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:22:23.040 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:22:23.040 "hdgst": false, 00:22:23.040 "ddgst": false 00:22:23.040 }, 00:22:23.040 "method": "bdev_nvme_attach_controller" 00:22:23.040 },{ 00:22:23.040 "params": { 00:22:23.040 "name": "Nvme4", 00:22:23.040 "trtype": "tcp", 00:22:23.040 "traddr": "10.0.0.2", 00:22:23.040 "adrfam": "ipv4", 00:22:23.040 "trsvcid": "4420", 00:22:23.040 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:22:23.040 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:22:23.040 "hdgst": false, 00:22:23.040 "ddgst": false 00:22:23.040 }, 00:22:23.040 "method": "bdev_nvme_attach_controller" 00:22:23.040 },{ 00:22:23.040 "params": { 00:22:23.040 "name": "Nvme5", 00:22:23.040 "trtype": "tcp", 00:22:23.040 "traddr": "10.0.0.2", 00:22:23.040 "adrfam": "ipv4", 00:22:23.040 "trsvcid": "4420", 00:22:23.040 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:22:23.040 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:22:23.040 "hdgst": false, 00:22:23.040 "ddgst": false 00:22:23.040 }, 00:22:23.040 "method": "bdev_nvme_attach_controller" 00:22:23.040 },{ 00:22:23.040 "params": { 00:22:23.040 "name": "Nvme6", 00:22:23.040 "trtype": "tcp", 00:22:23.040 "traddr": "10.0.0.2", 00:22:23.040 "adrfam": "ipv4", 00:22:23.040 "trsvcid": "4420", 00:22:23.040 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:22:23.040 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:22:23.040 "hdgst": false, 00:22:23.040 "ddgst": false 00:22:23.040 }, 00:22:23.040 "method": "bdev_nvme_attach_controller" 00:22:23.040 },{ 00:22:23.040 "params": { 00:22:23.040 "name": "Nvme7", 00:22:23.040 "trtype": "tcp", 00:22:23.040 "traddr": "10.0.0.2", 00:22:23.040 "adrfam": "ipv4", 00:22:23.040 "trsvcid": "4420", 00:22:23.040 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:22:23.040 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:22:23.040 "hdgst": false, 00:22:23.040 "ddgst": false 00:22:23.040 }, 00:22:23.040 "method": "bdev_nvme_attach_controller" 00:22:23.040 },{ 00:22:23.040 "params": { 00:22:23.040 "name": "Nvme8", 00:22:23.040 "trtype": "tcp", 00:22:23.040 "traddr": "10.0.0.2", 00:22:23.040 "adrfam": "ipv4", 00:22:23.040 "trsvcid": "4420", 00:22:23.040 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:22:23.040 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:22:23.040 "hdgst": false, 00:22:23.040 "ddgst": false 00:22:23.040 }, 00:22:23.040 "method": "bdev_nvme_attach_controller" 00:22:23.040 },{ 00:22:23.040 "params": { 00:22:23.040 "name": "Nvme9", 00:22:23.040 "trtype": "tcp", 00:22:23.040 "traddr": "10.0.0.2", 00:22:23.040 "adrfam": "ipv4", 00:22:23.040 "trsvcid": "4420", 00:22:23.040 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:22:23.041 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:22:23.041 "hdgst": false, 00:22:23.041 "ddgst": false 00:22:23.041 }, 00:22:23.041 "method": "bdev_nvme_attach_controller" 00:22:23.041 },{ 00:22:23.041 "params": { 00:22:23.041 "name": "Nvme10", 00:22:23.041 "trtype": "tcp", 00:22:23.041 "traddr": "10.0.0.2", 00:22:23.041 "adrfam": "ipv4", 00:22:23.041 "trsvcid": "4420", 00:22:23.041 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:22:23.041 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:22:23.041 "hdgst": false, 00:22:23.041 "ddgst": false 00:22:23.041 }, 00:22:23.041 "method": "bdev_nvme_attach_controller" 00:22:23.041 }' 00:22:23.041 [2024-11-21 03:39:03.396549] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:23.041 [2024-11-21 03:39:03.396625] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3116593 ] 00:22:23.041 EAL: No free 2048 kB hugepages reported on node 1 00:22:23.041 [2024-11-21 03:39:03.461127] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:23.041 [2024-11-21 03:39:03.569591] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:24.939 Running I/O for 1 seconds... 00:22:25.873 00:22:25.873 Latency(us) 00:22:25.873 [2024-11-21T02:39:06.521Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:25.873 [2024-11-21T02:39:06.521Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:25.873 Verification LBA range: start 0x0 length 0x400 00:22:25.873 Nvme1n1 : 1.10 393.33 24.58 0.00 0.00 159500.35 21651.15 125829.12 00:22:25.873 [2024-11-21T02:39:06.521Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:25.873 Verification LBA range: start 0x0 length 0x400 00:22:25.873 Nvme2n1 : 1.09 366.05 22.88 0.00 0.00 169148.99 40195.41 140586.86 00:22:25.873 [2024-11-21T02:39:06.521Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:25.873 Verification LBA range: start 0x0 length 0x400 00:22:25.873 Nvme3n1 : 1.11 392.51 24.53 0.00 0.00 157790.76 20388.98 121168.78 00:22:25.873 [2024-11-21T02:39:06.521Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:25.873 Verification LBA range: start 0x0 length 0x400 00:22:25.873 Nvme4n1 : 1.11 391.52 24.47 0.00 0.00 157233.94 19320.98 125052.40 00:22:25.873 [2024-11-21T02:39:06.521Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:25.873 Verification LBA range: start 0x0 length 0x400 00:22:25.873 Nvme5n1 : 1.11 390.65 24.42 0.00 0.00 156615.83 18447.17 121168.78 00:22:25.873 [2024-11-21T02:39:06.521Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:25.873 Verification LBA range: start 0x0 length 0x400 00:22:25.873 Nvme6n1 : 1.09 363.74 22.73 0.00 0.00 165207.32 33787.45 131266.18 00:22:25.873 [2024-11-21T02:39:06.521Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:25.873 Verification LBA range: start 0x0 length 0x400 00:22:25.873 Nvme7n1 : 1.11 389.81 24.36 0.00 0.00 155123.01 14757.74 122722.23 00:22:25.873 [2024-11-21T02:39:06.521Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:25.873 Verification LBA range: start 0x0 length 0x400 00:22:25.873 Nvme8n1 : 1.12 388.61 24.29 0.00 0.00 154477.60 15340.28 125052.40 00:22:25.873 [2024-11-21T02:39:06.521Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:25.873 Verification LBA range: start 0x0 length 0x400 00:22:25.873 Nvme9n1 : 1.12 387.10 24.19 0.00 0.00 155178.21 6359.42 131266.18 00:22:25.873 [2024-11-21T02:39:06.521Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:25.873 Verification LBA range: start 0x0 length 0x400 00:22:25.873 Nvme10n1 : 1.17 375.10 23.44 0.00 0.00 153988.19 5509.88 128159.29 00:22:25.873 [2024-11-21T02:39:06.521Z] =================================================================================================================== 00:22:25.873 [2024-11-21T02:39:06.521Z] Total : 3838.42 239.90 0.00 0.00 158275.77 5509.88 140586.86 00:22:26.131 03:39:06 -- target/shutdown.sh@93 -- # stoptarget 00:22:26.131 03:39:06 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:22:26.131 03:39:06 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:22:26.131 03:39:06 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:26.131 03:39:06 -- target/shutdown.sh@45 -- # nvmftestfini 00:22:26.131 03:39:06 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:26.131 03:39:06 -- nvmf/common.sh@116 -- # sync 00:22:26.131 03:39:06 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:26.131 03:39:06 -- nvmf/common.sh@119 -- # set +e 00:22:26.131 03:39:06 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:26.131 03:39:06 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:26.131 rmmod nvme_tcp 00:22:26.131 rmmod nvme_fabrics 00:22:26.131 rmmod nvme_keyring 00:22:26.131 03:39:06 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:26.131 03:39:06 -- nvmf/common.sh@123 -- # set -e 00:22:26.131 03:39:06 -- nvmf/common.sh@124 -- # return 0 00:22:26.131 03:39:06 -- nvmf/common.sh@477 -- # '[' -n 3115855 ']' 00:22:26.131 03:39:06 -- nvmf/common.sh@478 -- # killprocess 3115855 00:22:26.131 03:39:06 -- common/autotest_common.sh@936 -- # '[' -z 3115855 ']' 00:22:26.131 03:39:06 -- common/autotest_common.sh@940 -- # kill -0 3115855 00:22:26.131 03:39:06 -- common/autotest_common.sh@941 -- # uname 00:22:26.131 03:39:06 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:26.131 03:39:06 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3115855 00:22:26.131 03:39:06 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:22:26.131 03:39:06 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:22:26.131 03:39:06 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3115855' 00:22:26.131 killing process with pid 3115855 00:22:26.131 03:39:06 -- common/autotest_common.sh@955 -- # kill 3115855 00:22:26.131 03:39:06 -- common/autotest_common.sh@960 -- # wait 3115855 00:22:26.697 03:39:07 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:26.697 03:39:07 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:26.697 03:39:07 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:26.697 03:39:07 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:26.697 03:39:07 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:26.697 03:39:07 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:26.697 03:39:07 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:26.697 03:39:07 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:28.599 03:39:09 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:28.599 00:22:28.599 real 0m12.432s 00:22:28.599 user 0m37.029s 00:22:28.599 sys 0m3.203s 00:22:28.599 03:39:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:28.599 03:39:09 -- common/autotest_common.sh@10 -- # set +x 00:22:28.599 ************************************ 00:22:28.599 END TEST nvmf_shutdown_tc1 00:22:28.599 ************************************ 00:22:28.859 03:39:09 -- target/shutdown.sh@147 -- # run_test nvmf_shutdown_tc2 nvmf_shutdown_tc2 00:22:28.859 03:39:09 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:22:28.859 03:39:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:28.859 03:39:09 -- common/autotest_common.sh@10 -- # set +x 00:22:28.859 ************************************ 00:22:28.859 START TEST nvmf_shutdown_tc2 00:22:28.859 ************************************ 00:22:28.859 03:39:09 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc2 00:22:28.859 03:39:09 -- target/shutdown.sh@98 -- # starttarget 00:22:28.859 03:39:09 -- target/shutdown.sh@15 -- # nvmftestinit 00:22:28.859 03:39:09 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:28.859 03:39:09 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:28.859 03:39:09 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:28.859 03:39:09 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:28.859 03:39:09 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:28.859 03:39:09 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:28.859 03:39:09 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:28.859 03:39:09 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:28.859 03:39:09 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:28.859 03:39:09 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:28.859 03:39:09 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:28.859 03:39:09 -- common/autotest_common.sh@10 -- # set +x 00:22:28.859 03:39:09 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:28.859 03:39:09 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:28.859 03:39:09 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:28.859 03:39:09 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:28.859 03:39:09 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:28.859 03:39:09 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:28.859 03:39:09 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:28.859 03:39:09 -- nvmf/common.sh@294 -- # net_devs=() 00:22:28.859 03:39:09 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:28.859 03:39:09 -- nvmf/common.sh@295 -- # e810=() 00:22:28.859 03:39:09 -- nvmf/common.sh@295 -- # local -ga e810 00:22:28.859 03:39:09 -- nvmf/common.sh@296 -- # x722=() 00:22:28.859 03:39:09 -- nvmf/common.sh@296 -- # local -ga x722 00:22:28.859 03:39:09 -- nvmf/common.sh@297 -- # mlx=() 00:22:28.859 03:39:09 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:28.859 03:39:09 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:28.859 03:39:09 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:28.860 03:39:09 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:28.860 03:39:09 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:28.860 03:39:09 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:28.860 03:39:09 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:28.860 03:39:09 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:28.860 03:39:09 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:28.860 03:39:09 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:28.860 03:39:09 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:28.860 03:39:09 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:28.860 03:39:09 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:28.860 03:39:09 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:28.860 03:39:09 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:28.860 03:39:09 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:28.860 03:39:09 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:28.860 03:39:09 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:28.860 03:39:09 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:28.860 03:39:09 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:28.860 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:28.860 03:39:09 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:28.860 03:39:09 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:28.860 03:39:09 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:28.860 03:39:09 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:28.860 03:39:09 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:28.860 03:39:09 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:28.860 03:39:09 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:28.860 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:28.860 03:39:09 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:28.860 03:39:09 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:28.860 03:39:09 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:28.860 03:39:09 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:28.860 03:39:09 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:28.860 03:39:09 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:28.860 03:39:09 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:28.860 03:39:09 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:28.860 03:39:09 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:28.860 03:39:09 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:28.860 03:39:09 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:28.860 03:39:09 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:28.860 03:39:09 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:28.860 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:28.860 03:39:09 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:28.860 03:39:09 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:28.860 03:39:09 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:28.860 03:39:09 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:28.860 03:39:09 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:28.860 03:39:09 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:28.860 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:28.860 03:39:09 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:28.860 03:39:09 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:28.860 03:39:09 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:28.860 03:39:09 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:28.860 03:39:09 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:28.860 03:39:09 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:28.860 03:39:09 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:28.860 03:39:09 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:28.860 03:39:09 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:28.860 03:39:09 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:28.860 03:39:09 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:28.860 03:39:09 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:28.860 03:39:09 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:28.860 03:39:09 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:28.860 03:39:09 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:28.860 03:39:09 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:28.860 03:39:09 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:28.860 03:39:09 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:28.860 03:39:09 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:28.860 03:39:09 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:28.860 03:39:09 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:28.860 03:39:09 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:28.860 03:39:09 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:28.860 03:39:09 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:28.860 03:39:09 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:28.860 03:39:09 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:28.860 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:28.860 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.310 ms 00:22:28.860 00:22:28.860 --- 10.0.0.2 ping statistics --- 00:22:28.860 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:28.860 rtt min/avg/max/mdev = 0.310/0.310/0.310/0.000 ms 00:22:28.860 03:39:09 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:28.860 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:28.860 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.118 ms 00:22:28.860 00:22:28.860 --- 10.0.0.1 ping statistics --- 00:22:28.860 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:28.860 rtt min/avg/max/mdev = 0.118/0.118/0.118/0.000 ms 00:22:28.860 03:39:09 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:28.860 03:39:09 -- nvmf/common.sh@410 -- # return 0 00:22:28.860 03:39:09 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:28.860 03:39:09 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:28.860 03:39:09 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:28.860 03:39:09 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:28.860 03:39:09 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:28.860 03:39:09 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:28.860 03:39:09 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:28.860 03:39:09 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:22:28.860 03:39:09 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:28.860 03:39:09 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:28.860 03:39:09 -- common/autotest_common.sh@10 -- # set +x 00:22:28.860 03:39:09 -- nvmf/common.sh@469 -- # nvmfpid=3117881 00:22:28.860 03:39:09 -- nvmf/common.sh@470 -- # waitforlisten 3117881 00:22:28.860 03:39:09 -- common/autotest_common.sh@829 -- # '[' -z 3117881 ']' 00:22:28.860 03:39:09 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:28.860 03:39:09 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:22:28.860 03:39:09 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:28.860 03:39:09 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:28.861 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:28.861 03:39:09 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:28.861 03:39:09 -- common/autotest_common.sh@10 -- # set +x 00:22:28.861 [2024-11-21 03:39:09.468249] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:28.861 [2024-11-21 03:39:09.468336] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:28.861 EAL: No free 2048 kB hugepages reported on node 1 00:22:29.119 [2024-11-21 03:39:09.537798] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:29.119 [2024-11-21 03:39:09.652777] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:29.119 [2024-11-21 03:39:09.652950] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:29.119 [2024-11-21 03:39:09.652971] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:29.119 [2024-11-21 03:39:09.652987] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:29.119 [2024-11-21 03:39:09.653111] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:29.119 [2024-11-21 03:39:09.653203] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:29.119 [2024-11-21 03:39:09.653267] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:22:29.119 [2024-11-21 03:39:09.653270] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:30.052 03:39:10 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:30.052 03:39:10 -- common/autotest_common.sh@862 -- # return 0 00:22:30.052 03:39:10 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:30.052 03:39:10 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:30.052 03:39:10 -- common/autotest_common.sh@10 -- # set +x 00:22:30.052 03:39:10 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:30.052 03:39:10 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:30.052 03:39:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:30.052 03:39:10 -- common/autotest_common.sh@10 -- # set +x 00:22:30.052 [2024-11-21 03:39:10.448598] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:30.052 03:39:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:30.053 03:39:10 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:22:30.053 03:39:10 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:22:30.053 03:39:10 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:30.053 03:39:10 -- common/autotest_common.sh@10 -- # set +x 00:22:30.053 03:39:10 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:30.053 03:39:10 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:30.053 03:39:10 -- target/shutdown.sh@28 -- # cat 00:22:30.053 03:39:10 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:30.053 03:39:10 -- target/shutdown.sh@28 -- # cat 00:22:30.053 03:39:10 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:30.053 03:39:10 -- target/shutdown.sh@28 -- # cat 00:22:30.053 03:39:10 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:30.053 03:39:10 -- target/shutdown.sh@28 -- # cat 00:22:30.053 03:39:10 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:30.053 03:39:10 -- target/shutdown.sh@28 -- # cat 00:22:30.053 03:39:10 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:30.053 03:39:10 -- target/shutdown.sh@28 -- # cat 00:22:30.053 03:39:10 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:30.053 03:39:10 -- target/shutdown.sh@28 -- # cat 00:22:30.053 03:39:10 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:30.053 03:39:10 -- target/shutdown.sh@28 -- # cat 00:22:30.053 03:39:10 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:30.053 03:39:10 -- target/shutdown.sh@28 -- # cat 00:22:30.053 03:39:10 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:30.053 03:39:10 -- target/shutdown.sh@28 -- # cat 00:22:30.053 03:39:10 -- target/shutdown.sh@35 -- # rpc_cmd 00:22:30.053 03:39:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:30.053 03:39:10 -- common/autotest_common.sh@10 -- # set +x 00:22:30.053 Malloc1 00:22:30.053 [2024-11-21 03:39:10.524282] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:30.053 Malloc2 00:22:30.053 Malloc3 00:22:30.053 Malloc4 00:22:30.053 Malloc5 00:22:30.311 Malloc6 00:22:30.311 Malloc7 00:22:30.311 Malloc8 00:22:30.311 Malloc9 00:22:30.311 Malloc10 00:22:30.570 03:39:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:30.570 03:39:10 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:22:30.570 03:39:10 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:30.570 03:39:10 -- common/autotest_common.sh@10 -- # set +x 00:22:30.570 03:39:10 -- target/shutdown.sh@102 -- # perfpid=3118078 00:22:30.570 03:39:10 -- target/shutdown.sh@103 -- # waitforlisten 3118078 /var/tmp/bdevperf.sock 00:22:30.570 03:39:10 -- common/autotest_common.sh@829 -- # '[' -z 3118078 ']' 00:22:30.570 03:39:10 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:22:30.570 03:39:10 -- target/shutdown.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:22:30.570 03:39:10 -- target/shutdown.sh@101 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:22:30.570 03:39:10 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:30.570 03:39:10 -- nvmf/common.sh@520 -- # config=() 00:22:30.570 03:39:10 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:22:30.570 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:22:30.570 03:39:10 -- nvmf/common.sh@520 -- # local subsystem config 00:22:30.570 03:39:10 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:30.570 03:39:10 -- common/autotest_common.sh@10 -- # set +x 00:22:30.570 03:39:10 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:30.570 03:39:10 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:30.570 { 00:22:30.570 "params": { 00:22:30.570 "name": "Nvme$subsystem", 00:22:30.570 "trtype": "$TEST_TRANSPORT", 00:22:30.570 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:30.570 "adrfam": "ipv4", 00:22:30.570 "trsvcid": "$NVMF_PORT", 00:22:30.570 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:30.570 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:30.570 "hdgst": ${hdgst:-false}, 00:22:30.570 "ddgst": ${ddgst:-false} 00:22:30.570 }, 00:22:30.570 "method": "bdev_nvme_attach_controller" 00:22:30.570 } 00:22:30.570 EOF 00:22:30.570 )") 00:22:30.570 03:39:10 -- nvmf/common.sh@542 -- # cat 00:22:30.570 03:39:10 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:30.570 03:39:10 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:30.570 { 00:22:30.570 "params": { 00:22:30.570 "name": "Nvme$subsystem", 00:22:30.570 "trtype": "$TEST_TRANSPORT", 00:22:30.570 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:30.570 "adrfam": "ipv4", 00:22:30.570 "trsvcid": "$NVMF_PORT", 00:22:30.570 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:30.570 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:30.570 "hdgst": ${hdgst:-false}, 00:22:30.570 "ddgst": ${ddgst:-false} 00:22:30.570 }, 00:22:30.570 "method": "bdev_nvme_attach_controller" 00:22:30.570 } 00:22:30.570 EOF 00:22:30.570 )") 00:22:30.570 03:39:10 -- nvmf/common.sh@542 -- # cat 00:22:30.570 03:39:10 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:30.570 03:39:10 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:30.570 { 00:22:30.570 "params": { 00:22:30.570 "name": "Nvme$subsystem", 00:22:30.570 "trtype": "$TEST_TRANSPORT", 00:22:30.571 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:30.571 "adrfam": "ipv4", 00:22:30.571 "trsvcid": "$NVMF_PORT", 00:22:30.571 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:30.571 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:30.571 "hdgst": ${hdgst:-false}, 00:22:30.571 "ddgst": ${ddgst:-false} 00:22:30.571 }, 00:22:30.571 "method": "bdev_nvme_attach_controller" 00:22:30.571 } 00:22:30.571 EOF 00:22:30.571 )") 00:22:30.571 03:39:10 -- nvmf/common.sh@542 -- # cat 00:22:30.571 03:39:10 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:30.571 03:39:10 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:30.571 { 00:22:30.571 "params": { 00:22:30.571 "name": "Nvme$subsystem", 00:22:30.571 "trtype": "$TEST_TRANSPORT", 00:22:30.571 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:30.571 "adrfam": "ipv4", 00:22:30.571 "trsvcid": "$NVMF_PORT", 00:22:30.571 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:30.571 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:30.571 "hdgst": ${hdgst:-false}, 00:22:30.571 "ddgst": ${ddgst:-false} 00:22:30.571 }, 00:22:30.571 "method": "bdev_nvme_attach_controller" 00:22:30.571 } 00:22:30.571 EOF 00:22:30.571 )") 00:22:30.571 03:39:10 -- nvmf/common.sh@542 -- # cat 00:22:30.571 03:39:11 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:30.571 03:39:11 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:30.571 { 00:22:30.571 "params": { 00:22:30.571 "name": "Nvme$subsystem", 00:22:30.571 "trtype": "$TEST_TRANSPORT", 00:22:30.571 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:30.571 "adrfam": "ipv4", 00:22:30.571 "trsvcid": "$NVMF_PORT", 00:22:30.571 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:30.571 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:30.571 "hdgst": ${hdgst:-false}, 00:22:30.571 "ddgst": ${ddgst:-false} 00:22:30.571 }, 00:22:30.571 "method": "bdev_nvme_attach_controller" 00:22:30.571 } 00:22:30.571 EOF 00:22:30.571 )") 00:22:30.571 03:39:11 -- nvmf/common.sh@542 -- # cat 00:22:30.571 03:39:11 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:30.571 03:39:11 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:30.571 { 00:22:30.571 "params": { 00:22:30.571 "name": "Nvme$subsystem", 00:22:30.571 "trtype": "$TEST_TRANSPORT", 00:22:30.571 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:30.571 "adrfam": "ipv4", 00:22:30.571 "trsvcid": "$NVMF_PORT", 00:22:30.571 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:30.571 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:30.571 "hdgst": ${hdgst:-false}, 00:22:30.571 "ddgst": ${ddgst:-false} 00:22:30.571 }, 00:22:30.571 "method": "bdev_nvme_attach_controller" 00:22:30.571 } 00:22:30.571 EOF 00:22:30.571 )") 00:22:30.571 03:39:11 -- nvmf/common.sh@542 -- # cat 00:22:30.571 03:39:11 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:30.571 03:39:11 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:30.571 { 00:22:30.571 "params": { 00:22:30.571 "name": "Nvme$subsystem", 00:22:30.571 "trtype": "$TEST_TRANSPORT", 00:22:30.571 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:30.571 "adrfam": "ipv4", 00:22:30.571 "trsvcid": "$NVMF_PORT", 00:22:30.571 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:30.571 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:30.571 "hdgst": ${hdgst:-false}, 00:22:30.571 "ddgst": ${ddgst:-false} 00:22:30.571 }, 00:22:30.571 "method": "bdev_nvme_attach_controller" 00:22:30.571 } 00:22:30.571 EOF 00:22:30.571 )") 00:22:30.571 03:39:11 -- nvmf/common.sh@542 -- # cat 00:22:30.571 03:39:11 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:30.571 03:39:11 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:30.571 { 00:22:30.571 "params": { 00:22:30.571 "name": "Nvme$subsystem", 00:22:30.571 "trtype": "$TEST_TRANSPORT", 00:22:30.571 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:30.571 "adrfam": "ipv4", 00:22:30.571 "trsvcid": "$NVMF_PORT", 00:22:30.571 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:30.571 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:30.571 "hdgst": ${hdgst:-false}, 00:22:30.571 "ddgst": ${ddgst:-false} 00:22:30.571 }, 00:22:30.571 "method": "bdev_nvme_attach_controller" 00:22:30.571 } 00:22:30.571 EOF 00:22:30.571 )") 00:22:30.571 03:39:11 -- nvmf/common.sh@542 -- # cat 00:22:30.571 03:39:11 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:30.571 03:39:11 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:30.571 { 00:22:30.571 "params": { 00:22:30.571 "name": "Nvme$subsystem", 00:22:30.571 "trtype": "$TEST_TRANSPORT", 00:22:30.571 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:30.571 "adrfam": "ipv4", 00:22:30.571 "trsvcid": "$NVMF_PORT", 00:22:30.571 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:30.571 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:30.571 "hdgst": ${hdgst:-false}, 00:22:30.571 "ddgst": ${ddgst:-false} 00:22:30.571 }, 00:22:30.571 "method": "bdev_nvme_attach_controller" 00:22:30.571 } 00:22:30.571 EOF 00:22:30.571 )") 00:22:30.571 03:39:11 -- nvmf/common.sh@542 -- # cat 00:22:30.571 03:39:11 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:30.571 03:39:11 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:30.571 { 00:22:30.571 "params": { 00:22:30.571 "name": "Nvme$subsystem", 00:22:30.571 "trtype": "$TEST_TRANSPORT", 00:22:30.571 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:30.571 "adrfam": "ipv4", 00:22:30.571 "trsvcid": "$NVMF_PORT", 00:22:30.571 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:30.571 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:30.571 "hdgst": ${hdgst:-false}, 00:22:30.571 "ddgst": ${ddgst:-false} 00:22:30.571 }, 00:22:30.571 "method": "bdev_nvme_attach_controller" 00:22:30.571 } 00:22:30.571 EOF 00:22:30.571 )") 00:22:30.571 03:39:11 -- nvmf/common.sh@542 -- # cat 00:22:30.571 03:39:11 -- nvmf/common.sh@544 -- # jq . 00:22:30.571 03:39:11 -- nvmf/common.sh@545 -- # IFS=, 00:22:30.571 03:39:11 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:22:30.571 "params": { 00:22:30.571 "name": "Nvme1", 00:22:30.571 "trtype": "tcp", 00:22:30.571 "traddr": "10.0.0.2", 00:22:30.571 "adrfam": "ipv4", 00:22:30.571 "trsvcid": "4420", 00:22:30.571 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:30.571 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:22:30.571 "hdgst": false, 00:22:30.571 "ddgst": false 00:22:30.571 }, 00:22:30.571 "method": "bdev_nvme_attach_controller" 00:22:30.571 },{ 00:22:30.571 "params": { 00:22:30.571 "name": "Nvme2", 00:22:30.571 "trtype": "tcp", 00:22:30.571 "traddr": "10.0.0.2", 00:22:30.571 "adrfam": "ipv4", 00:22:30.571 "trsvcid": "4420", 00:22:30.571 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:30.571 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:22:30.571 "hdgst": false, 00:22:30.571 "ddgst": false 00:22:30.571 }, 00:22:30.571 "method": "bdev_nvme_attach_controller" 00:22:30.571 },{ 00:22:30.571 "params": { 00:22:30.571 "name": "Nvme3", 00:22:30.571 "trtype": "tcp", 00:22:30.571 "traddr": "10.0.0.2", 00:22:30.571 "adrfam": "ipv4", 00:22:30.571 "trsvcid": "4420", 00:22:30.571 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:22:30.571 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:22:30.571 "hdgst": false, 00:22:30.572 "ddgst": false 00:22:30.572 }, 00:22:30.572 "method": "bdev_nvme_attach_controller" 00:22:30.572 },{ 00:22:30.572 "params": { 00:22:30.572 "name": "Nvme4", 00:22:30.572 "trtype": "tcp", 00:22:30.572 "traddr": "10.0.0.2", 00:22:30.572 "adrfam": "ipv4", 00:22:30.572 "trsvcid": "4420", 00:22:30.572 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:22:30.572 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:22:30.572 "hdgst": false, 00:22:30.572 "ddgst": false 00:22:30.572 }, 00:22:30.572 "method": "bdev_nvme_attach_controller" 00:22:30.572 },{ 00:22:30.572 "params": { 00:22:30.572 "name": "Nvme5", 00:22:30.572 "trtype": "tcp", 00:22:30.572 "traddr": "10.0.0.2", 00:22:30.572 "adrfam": "ipv4", 00:22:30.572 "trsvcid": "4420", 00:22:30.572 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:22:30.572 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:22:30.572 "hdgst": false, 00:22:30.572 "ddgst": false 00:22:30.572 }, 00:22:30.572 "method": "bdev_nvme_attach_controller" 00:22:30.572 },{ 00:22:30.572 "params": { 00:22:30.572 "name": "Nvme6", 00:22:30.572 "trtype": "tcp", 00:22:30.572 "traddr": "10.0.0.2", 00:22:30.572 "adrfam": "ipv4", 00:22:30.572 "trsvcid": "4420", 00:22:30.572 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:22:30.572 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:22:30.572 "hdgst": false, 00:22:30.572 "ddgst": false 00:22:30.572 }, 00:22:30.572 "method": "bdev_nvme_attach_controller" 00:22:30.572 },{ 00:22:30.572 "params": { 00:22:30.572 "name": "Nvme7", 00:22:30.572 "trtype": "tcp", 00:22:30.572 "traddr": "10.0.0.2", 00:22:30.572 "adrfam": "ipv4", 00:22:30.572 "trsvcid": "4420", 00:22:30.572 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:22:30.572 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:22:30.572 "hdgst": false, 00:22:30.572 "ddgst": false 00:22:30.572 }, 00:22:30.572 "method": "bdev_nvme_attach_controller" 00:22:30.572 },{ 00:22:30.572 "params": { 00:22:30.572 "name": "Nvme8", 00:22:30.572 "trtype": "tcp", 00:22:30.572 "traddr": "10.0.0.2", 00:22:30.572 "adrfam": "ipv4", 00:22:30.572 "trsvcid": "4420", 00:22:30.572 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:22:30.572 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:22:30.572 "hdgst": false, 00:22:30.572 "ddgst": false 00:22:30.572 }, 00:22:30.572 "method": "bdev_nvme_attach_controller" 00:22:30.572 },{ 00:22:30.572 "params": { 00:22:30.572 "name": "Nvme9", 00:22:30.572 "trtype": "tcp", 00:22:30.572 "traddr": "10.0.0.2", 00:22:30.572 "adrfam": "ipv4", 00:22:30.572 "trsvcid": "4420", 00:22:30.572 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:22:30.572 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:22:30.572 "hdgst": false, 00:22:30.572 "ddgst": false 00:22:30.572 }, 00:22:30.572 "method": "bdev_nvme_attach_controller" 00:22:30.572 },{ 00:22:30.572 "params": { 00:22:30.572 "name": "Nvme10", 00:22:30.572 "trtype": "tcp", 00:22:30.572 "traddr": "10.0.0.2", 00:22:30.572 "adrfam": "ipv4", 00:22:30.572 "trsvcid": "4420", 00:22:30.572 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:22:30.572 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:22:30.572 "hdgst": false, 00:22:30.572 "ddgst": false 00:22:30.572 }, 00:22:30.572 "method": "bdev_nvme_attach_controller" 00:22:30.572 }' 00:22:30.572 [2024-11-21 03:39:11.027887] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:30.572 [2024-11-21 03:39:11.027976] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3118078 ] 00:22:30.572 EAL: No free 2048 kB hugepages reported on node 1 00:22:30.572 [2024-11-21 03:39:11.093573] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:30.572 [2024-11-21 03:39:11.202420] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:32.471 Running I/O for 10 seconds... 00:22:33.038 03:39:13 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:33.038 03:39:13 -- common/autotest_common.sh@862 -- # return 0 00:22:33.038 03:39:13 -- target/shutdown.sh@104 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:22:33.038 03:39:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:33.038 03:39:13 -- common/autotest_common.sh@10 -- # set +x 00:22:33.038 03:39:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:33.038 03:39:13 -- target/shutdown.sh@106 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:22:33.038 03:39:13 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:22:33.038 03:39:13 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:22:33.038 03:39:13 -- target/shutdown.sh@57 -- # local ret=1 00:22:33.038 03:39:13 -- target/shutdown.sh@58 -- # local i 00:22:33.038 03:39:13 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:22:33.038 03:39:13 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:22:33.038 03:39:13 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:22:33.038 03:39:13 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:22:33.038 03:39:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:33.038 03:39:13 -- common/autotest_common.sh@10 -- # set +x 00:22:33.038 03:39:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:33.038 03:39:13 -- target/shutdown.sh@60 -- # read_io_count=211 00:22:33.038 03:39:13 -- target/shutdown.sh@63 -- # '[' 211 -ge 100 ']' 00:22:33.038 03:39:13 -- target/shutdown.sh@64 -- # ret=0 00:22:33.038 03:39:13 -- target/shutdown.sh@65 -- # break 00:22:33.038 03:39:13 -- target/shutdown.sh@69 -- # return 0 00:22:33.038 03:39:13 -- target/shutdown.sh@109 -- # killprocess 3118078 00:22:33.038 03:39:13 -- common/autotest_common.sh@936 -- # '[' -z 3118078 ']' 00:22:33.038 03:39:13 -- common/autotest_common.sh@940 -- # kill -0 3118078 00:22:33.038 03:39:13 -- common/autotest_common.sh@941 -- # uname 00:22:33.038 03:39:13 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:33.038 03:39:13 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3118078 00:22:33.038 03:39:13 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:33.038 03:39:13 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:33.038 03:39:13 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3118078' 00:22:33.038 killing process with pid 3118078 00:22:33.038 03:39:13 -- common/autotest_common.sh@955 -- # kill 3118078 00:22:33.038 03:39:13 -- common/autotest_common.sh@960 -- # wait 3118078 00:22:33.296 Received shutdown signal, test time was about 0.756119 seconds 00:22:33.296 00:22:33.296 Latency(us) 00:22:33.296 [2024-11-21T02:39:13.944Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:33.296 [2024-11-21T02:39:13.944Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:33.296 Verification LBA range: start 0x0 length 0x400 00:22:33.296 Nvme1n1 : 0.75 419.64 26.23 0.00 0.00 149272.59 17670.45 135926.52 00:22:33.296 [2024-11-21T02:39:13.944Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:33.296 Verification LBA range: start 0x0 length 0x400 00:22:33.296 Nvme2n1 : 0.75 418.85 26.18 0.00 0.00 148073.91 16990.81 146800.64 00:22:33.296 [2024-11-21T02:39:13.944Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:33.296 Verification LBA range: start 0x0 length 0x400 00:22:33.296 Nvme3n1 : 0.76 417.05 26.07 0.00 0.00 147042.60 18058.81 153791.15 00:22:33.296 [2024-11-21T02:39:13.944Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:33.296 Verification LBA range: start 0x0 length 0x400 00:22:33.296 Nvme4n1 : 0.75 420.73 26.30 0.00 0.00 144374.31 17282.09 126605.84 00:22:33.296 [2024-11-21T02:39:13.944Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:33.296 Verification LBA range: start 0x0 length 0x400 00:22:33.296 Nvme5n1 : 0.75 422.62 26.41 0.00 0.00 141797.56 20097.71 115731.72 00:22:33.296 [2024-11-21T02:39:13.944Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:33.296 Verification LBA range: start 0x0 length 0x400 00:22:33.296 Nvme6n1 : 0.75 421.83 26.36 0.00 0.00 140573.29 20097.71 114955.00 00:22:33.296 [2024-11-21T02:39:13.944Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:33.296 Verification LBA range: start 0x0 length 0x400 00:22:33.296 Nvme7n1 : 0.72 379.65 23.73 0.00 0.00 153751.35 20291.89 118838.61 00:22:33.296 [2024-11-21T02:39:13.944Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:33.296 Verification LBA range: start 0x0 length 0x400 00:22:33.296 Nvme8n1 : 0.72 377.66 23.60 0.00 0.00 152916.80 20291.89 121168.78 00:22:33.296 [2024-11-21T02:39:13.944Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:33.296 Verification LBA range: start 0x0 length 0x400 00:22:33.296 Nvme9n1 : 0.73 373.50 23.34 0.00 0.00 152859.33 21554.06 121945.51 00:22:33.296 [2024-11-21T02:39:13.944Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:33.296 Verification LBA range: start 0x0 length 0x400 00:22:33.296 Nvme10n1 : 0.73 375.56 23.47 0.00 0.00 150450.39 18447.17 124275.67 00:22:33.296 [2024-11-21T02:39:13.944Z] =================================================================================================================== 00:22:33.296 [2024-11-21T02:39:13.944Z] Total : 4027.09 251.69 0.00 0.00 147859.79 16990.81 153791.15 00:22:33.555 03:39:13 -- target/shutdown.sh@112 -- # sleep 1 00:22:34.489 03:39:14 -- target/shutdown.sh@113 -- # kill -0 3117881 00:22:34.489 03:39:14 -- target/shutdown.sh@115 -- # stoptarget 00:22:34.489 03:39:14 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:22:34.489 03:39:14 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:22:34.489 03:39:14 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:34.489 03:39:14 -- target/shutdown.sh@45 -- # nvmftestfini 00:22:34.489 03:39:14 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:34.489 03:39:14 -- nvmf/common.sh@116 -- # sync 00:22:34.489 03:39:14 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:34.489 03:39:14 -- nvmf/common.sh@119 -- # set +e 00:22:34.489 03:39:14 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:34.489 03:39:14 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:34.489 rmmod nvme_tcp 00:22:34.489 rmmod nvme_fabrics 00:22:34.489 rmmod nvme_keyring 00:22:34.489 03:39:15 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:34.489 03:39:15 -- nvmf/common.sh@123 -- # set -e 00:22:34.489 03:39:15 -- nvmf/common.sh@124 -- # return 0 00:22:34.489 03:39:15 -- nvmf/common.sh@477 -- # '[' -n 3117881 ']' 00:22:34.489 03:39:15 -- nvmf/common.sh@478 -- # killprocess 3117881 00:22:34.489 03:39:15 -- common/autotest_common.sh@936 -- # '[' -z 3117881 ']' 00:22:34.489 03:39:15 -- common/autotest_common.sh@940 -- # kill -0 3117881 00:22:34.489 03:39:15 -- common/autotest_common.sh@941 -- # uname 00:22:34.489 03:39:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:34.489 03:39:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3117881 00:22:34.489 03:39:15 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:22:34.489 03:39:15 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:22:34.489 03:39:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3117881' 00:22:34.489 killing process with pid 3117881 00:22:34.489 03:39:15 -- common/autotest_common.sh@955 -- # kill 3117881 00:22:34.489 03:39:15 -- common/autotest_common.sh@960 -- # wait 3117881 00:22:35.055 03:39:15 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:35.055 03:39:15 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:35.055 03:39:15 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:35.055 03:39:15 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:35.055 03:39:15 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:35.055 03:39:15 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:35.055 03:39:15 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:35.055 03:39:15 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:37.589 03:39:17 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:37.589 00:22:37.589 real 0m8.368s 00:22:37.589 user 0m26.594s 00:22:37.589 sys 0m1.478s 00:22:37.589 03:39:17 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:37.589 03:39:17 -- common/autotest_common.sh@10 -- # set +x 00:22:37.589 ************************************ 00:22:37.589 END TEST nvmf_shutdown_tc2 00:22:37.589 ************************************ 00:22:37.589 03:39:17 -- target/shutdown.sh@148 -- # run_test nvmf_shutdown_tc3 nvmf_shutdown_tc3 00:22:37.589 03:39:17 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:22:37.589 03:39:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:37.589 03:39:17 -- common/autotest_common.sh@10 -- # set +x 00:22:37.589 ************************************ 00:22:37.589 START TEST nvmf_shutdown_tc3 00:22:37.589 ************************************ 00:22:37.589 03:39:17 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc3 00:22:37.589 03:39:17 -- target/shutdown.sh@120 -- # starttarget 00:22:37.589 03:39:17 -- target/shutdown.sh@15 -- # nvmftestinit 00:22:37.589 03:39:17 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:37.589 03:39:17 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:37.589 03:39:17 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:37.589 03:39:17 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:37.589 03:39:17 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:37.589 03:39:17 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:37.589 03:39:17 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:37.589 03:39:17 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:37.589 03:39:17 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:37.589 03:39:17 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:37.589 03:39:17 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:37.589 03:39:17 -- common/autotest_common.sh@10 -- # set +x 00:22:37.589 03:39:17 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:37.589 03:39:17 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:37.589 03:39:17 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:37.589 03:39:17 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:37.589 03:39:17 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:37.589 03:39:17 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:37.589 03:39:17 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:37.589 03:39:17 -- nvmf/common.sh@294 -- # net_devs=() 00:22:37.589 03:39:17 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:37.589 03:39:17 -- nvmf/common.sh@295 -- # e810=() 00:22:37.589 03:39:17 -- nvmf/common.sh@295 -- # local -ga e810 00:22:37.589 03:39:17 -- nvmf/common.sh@296 -- # x722=() 00:22:37.589 03:39:17 -- nvmf/common.sh@296 -- # local -ga x722 00:22:37.589 03:39:17 -- nvmf/common.sh@297 -- # mlx=() 00:22:37.589 03:39:17 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:37.589 03:39:17 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:37.589 03:39:17 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:37.589 03:39:17 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:37.589 03:39:17 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:37.589 03:39:17 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:37.589 03:39:17 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:37.589 03:39:17 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:37.589 03:39:17 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:37.589 03:39:17 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:37.589 03:39:17 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:37.589 03:39:17 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:37.589 03:39:17 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:37.589 03:39:17 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:37.589 03:39:17 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:37.589 03:39:17 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:37.589 03:39:17 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:37.589 03:39:17 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:37.589 03:39:17 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:37.589 03:39:17 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:37.589 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:37.589 03:39:17 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:37.589 03:39:17 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:37.589 03:39:17 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:37.589 03:39:17 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:37.589 03:39:17 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:37.589 03:39:17 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:37.589 03:39:17 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:37.589 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:37.589 03:39:17 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:37.589 03:39:17 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:37.589 03:39:17 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:37.589 03:39:17 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:37.589 03:39:17 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:37.589 03:39:17 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:37.589 03:39:17 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:37.589 03:39:17 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:37.589 03:39:17 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:37.589 03:39:17 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:37.589 03:39:17 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:37.589 03:39:17 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:37.589 03:39:17 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:37.589 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:37.589 03:39:17 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:37.589 03:39:17 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:37.589 03:39:17 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:37.589 03:39:17 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:37.589 03:39:17 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:37.589 03:39:17 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:37.589 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:37.589 03:39:17 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:37.589 03:39:17 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:37.589 03:39:17 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:37.589 03:39:17 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:37.589 03:39:17 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:37.589 03:39:17 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:37.589 03:39:17 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:37.589 03:39:17 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:37.589 03:39:17 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:37.589 03:39:17 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:37.589 03:39:17 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:37.589 03:39:17 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:37.589 03:39:17 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:37.589 03:39:17 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:37.589 03:39:17 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:37.589 03:39:17 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:37.589 03:39:17 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:37.589 03:39:17 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:37.589 03:39:17 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:37.589 03:39:17 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:37.589 03:39:17 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:37.589 03:39:17 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:37.589 03:39:17 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:37.589 03:39:17 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:37.589 03:39:17 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:37.589 03:39:17 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:37.589 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:37.589 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.238 ms 00:22:37.589 00:22:37.589 --- 10.0.0.2 ping statistics --- 00:22:37.589 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:37.589 rtt min/avg/max/mdev = 0.238/0.238/0.238/0.000 ms 00:22:37.589 03:39:17 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:37.589 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:37.589 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.173 ms 00:22:37.589 00:22:37.589 --- 10.0.0.1 ping statistics --- 00:22:37.589 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:37.589 rtt min/avg/max/mdev = 0.173/0.173/0.173/0.000 ms 00:22:37.589 03:39:17 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:37.589 03:39:17 -- nvmf/common.sh@410 -- # return 0 00:22:37.589 03:39:17 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:37.589 03:39:17 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:37.589 03:39:17 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:37.589 03:39:17 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:37.589 03:39:17 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:37.589 03:39:17 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:37.590 03:39:17 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:37.590 03:39:17 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:22:37.590 03:39:17 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:37.590 03:39:17 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:37.590 03:39:17 -- common/autotest_common.sh@10 -- # set +x 00:22:37.590 03:39:17 -- nvmf/common.sh@469 -- # nvmfpid=3119059 00:22:37.590 03:39:17 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:22:37.590 03:39:17 -- nvmf/common.sh@470 -- # waitforlisten 3119059 00:22:37.590 03:39:17 -- common/autotest_common.sh@829 -- # '[' -z 3119059 ']' 00:22:37.590 03:39:17 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:37.590 03:39:17 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:37.590 03:39:17 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:37.590 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:37.590 03:39:17 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:37.590 03:39:17 -- common/autotest_common.sh@10 -- # set +x 00:22:37.590 [2024-11-21 03:39:17.876376] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:37.590 [2024-11-21 03:39:17.876472] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:37.590 EAL: No free 2048 kB hugepages reported on node 1 00:22:37.590 [2024-11-21 03:39:17.940607] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:37.590 [2024-11-21 03:39:18.048520] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:37.590 [2024-11-21 03:39:18.048676] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:37.590 [2024-11-21 03:39:18.048693] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:37.590 [2024-11-21 03:39:18.048705] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:37.590 [2024-11-21 03:39:18.048796] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:37.590 [2024-11-21 03:39:18.048864] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:37.590 [2024-11-21 03:39:18.048911] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:22:37.590 [2024-11-21 03:39:18.048914] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:38.524 03:39:18 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:38.524 03:39:18 -- common/autotest_common.sh@862 -- # return 0 00:22:38.524 03:39:18 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:38.524 03:39:18 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:38.524 03:39:18 -- common/autotest_common.sh@10 -- # set +x 00:22:38.524 03:39:18 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:38.524 03:39:18 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:38.524 03:39:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:38.524 03:39:18 -- common/autotest_common.sh@10 -- # set +x 00:22:38.524 [2024-11-21 03:39:18.865683] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:38.524 03:39:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:38.524 03:39:18 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:22:38.524 03:39:18 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:22:38.524 03:39:18 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:38.524 03:39:18 -- common/autotest_common.sh@10 -- # set +x 00:22:38.524 03:39:18 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:38.524 03:39:18 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:38.524 03:39:18 -- target/shutdown.sh@28 -- # cat 00:22:38.524 03:39:18 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:38.524 03:39:18 -- target/shutdown.sh@28 -- # cat 00:22:38.524 03:39:18 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:38.524 03:39:18 -- target/shutdown.sh@28 -- # cat 00:22:38.524 03:39:18 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:38.524 03:39:18 -- target/shutdown.sh@28 -- # cat 00:22:38.524 03:39:18 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:38.524 03:39:18 -- target/shutdown.sh@28 -- # cat 00:22:38.524 03:39:18 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:38.524 03:39:18 -- target/shutdown.sh@28 -- # cat 00:22:38.524 03:39:18 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:38.524 03:39:18 -- target/shutdown.sh@28 -- # cat 00:22:38.524 03:39:18 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:38.524 03:39:18 -- target/shutdown.sh@28 -- # cat 00:22:38.524 03:39:18 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:38.524 03:39:18 -- target/shutdown.sh@28 -- # cat 00:22:38.524 03:39:18 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:38.524 03:39:18 -- target/shutdown.sh@28 -- # cat 00:22:38.524 03:39:18 -- target/shutdown.sh@35 -- # rpc_cmd 00:22:38.524 03:39:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:38.524 03:39:18 -- common/autotest_common.sh@10 -- # set +x 00:22:38.524 Malloc1 00:22:38.524 [2024-11-21 03:39:18.941980] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:38.524 Malloc2 00:22:38.524 Malloc3 00:22:38.524 Malloc4 00:22:38.524 Malloc5 00:22:38.524 Malloc6 00:22:38.782 Malloc7 00:22:38.782 Malloc8 00:22:38.782 Malloc9 00:22:38.782 Malloc10 00:22:38.782 03:39:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:38.782 03:39:19 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:22:38.782 03:39:19 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:38.782 03:39:19 -- common/autotest_common.sh@10 -- # set +x 00:22:38.782 03:39:19 -- target/shutdown.sh@124 -- # perfpid=3119324 00:22:38.782 03:39:19 -- target/shutdown.sh@125 -- # waitforlisten 3119324 /var/tmp/bdevperf.sock 00:22:38.782 03:39:19 -- common/autotest_common.sh@829 -- # '[' -z 3119324 ']' 00:22:38.782 03:39:19 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:22:38.782 03:39:19 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:38.782 03:39:19 -- target/shutdown.sh@123 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:22:38.782 03:39:19 -- target/shutdown.sh@123 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:22:38.782 03:39:19 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:22:38.782 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:22:38.782 03:39:19 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:38.782 03:39:19 -- nvmf/common.sh@520 -- # config=() 00:22:38.782 03:39:19 -- common/autotest_common.sh@10 -- # set +x 00:22:38.782 03:39:19 -- nvmf/common.sh@520 -- # local subsystem config 00:22:38.782 03:39:19 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:38.782 03:39:19 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:38.782 { 00:22:38.782 "params": { 00:22:38.782 "name": "Nvme$subsystem", 00:22:38.782 "trtype": "$TEST_TRANSPORT", 00:22:38.782 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:38.782 "adrfam": "ipv4", 00:22:38.782 "trsvcid": "$NVMF_PORT", 00:22:38.782 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:38.782 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:38.782 "hdgst": ${hdgst:-false}, 00:22:38.782 "ddgst": ${ddgst:-false} 00:22:38.782 }, 00:22:38.782 "method": "bdev_nvme_attach_controller" 00:22:38.782 } 00:22:38.782 EOF 00:22:38.782 )") 00:22:38.782 03:39:19 -- nvmf/common.sh@542 -- # cat 00:22:38.782 03:39:19 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:38.782 03:39:19 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:38.782 { 00:22:38.782 "params": { 00:22:38.782 "name": "Nvme$subsystem", 00:22:38.782 "trtype": "$TEST_TRANSPORT", 00:22:38.782 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:38.782 "adrfam": "ipv4", 00:22:38.782 "trsvcid": "$NVMF_PORT", 00:22:38.782 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:38.782 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:38.782 "hdgst": ${hdgst:-false}, 00:22:38.782 "ddgst": ${ddgst:-false} 00:22:38.782 }, 00:22:38.782 "method": "bdev_nvme_attach_controller" 00:22:38.782 } 00:22:38.782 EOF 00:22:38.782 )") 00:22:38.782 03:39:19 -- nvmf/common.sh@542 -- # cat 00:22:38.782 03:39:19 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:38.782 03:39:19 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:38.782 { 00:22:38.782 "params": { 00:22:38.782 "name": "Nvme$subsystem", 00:22:38.782 "trtype": "$TEST_TRANSPORT", 00:22:38.782 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:38.782 "adrfam": "ipv4", 00:22:38.782 "trsvcid": "$NVMF_PORT", 00:22:38.782 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:38.782 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:38.782 "hdgst": ${hdgst:-false}, 00:22:38.782 "ddgst": ${ddgst:-false} 00:22:38.782 }, 00:22:38.782 "method": "bdev_nvme_attach_controller" 00:22:38.782 } 00:22:38.782 EOF 00:22:38.782 )") 00:22:38.782 03:39:19 -- nvmf/common.sh@542 -- # cat 00:22:38.782 03:39:19 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:38.782 03:39:19 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:38.782 { 00:22:38.782 "params": { 00:22:38.782 "name": "Nvme$subsystem", 00:22:38.782 "trtype": "$TEST_TRANSPORT", 00:22:38.782 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:38.782 "adrfam": "ipv4", 00:22:38.782 "trsvcid": "$NVMF_PORT", 00:22:38.782 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:38.782 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:38.782 "hdgst": ${hdgst:-false}, 00:22:38.782 "ddgst": ${ddgst:-false} 00:22:38.782 }, 00:22:38.782 "method": "bdev_nvme_attach_controller" 00:22:38.782 } 00:22:38.782 EOF 00:22:38.782 )") 00:22:38.782 03:39:19 -- nvmf/common.sh@542 -- # cat 00:22:38.782 03:39:19 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:38.782 03:39:19 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:38.782 { 00:22:38.782 "params": { 00:22:38.782 "name": "Nvme$subsystem", 00:22:38.782 "trtype": "$TEST_TRANSPORT", 00:22:38.782 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:38.782 "adrfam": "ipv4", 00:22:38.782 "trsvcid": "$NVMF_PORT", 00:22:38.782 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:38.782 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:38.782 "hdgst": ${hdgst:-false}, 00:22:38.782 "ddgst": ${ddgst:-false} 00:22:38.782 }, 00:22:38.782 "method": "bdev_nvme_attach_controller" 00:22:38.782 } 00:22:38.782 EOF 00:22:38.782 )") 00:22:39.040 03:39:19 -- nvmf/common.sh@542 -- # cat 00:22:39.040 03:39:19 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:39.040 03:39:19 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:39.040 { 00:22:39.040 "params": { 00:22:39.040 "name": "Nvme$subsystem", 00:22:39.040 "trtype": "$TEST_TRANSPORT", 00:22:39.040 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:39.040 "adrfam": "ipv4", 00:22:39.040 "trsvcid": "$NVMF_PORT", 00:22:39.040 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:39.040 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:39.041 "hdgst": ${hdgst:-false}, 00:22:39.041 "ddgst": ${ddgst:-false} 00:22:39.041 }, 00:22:39.041 "method": "bdev_nvme_attach_controller" 00:22:39.041 } 00:22:39.041 EOF 00:22:39.041 )") 00:22:39.041 03:39:19 -- nvmf/common.sh@542 -- # cat 00:22:39.041 03:39:19 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:39.041 03:39:19 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:39.041 { 00:22:39.041 "params": { 00:22:39.041 "name": "Nvme$subsystem", 00:22:39.041 "trtype": "$TEST_TRANSPORT", 00:22:39.041 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:39.041 "adrfam": "ipv4", 00:22:39.041 "trsvcid": "$NVMF_PORT", 00:22:39.041 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:39.041 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:39.041 "hdgst": ${hdgst:-false}, 00:22:39.041 "ddgst": ${ddgst:-false} 00:22:39.041 }, 00:22:39.041 "method": "bdev_nvme_attach_controller" 00:22:39.041 } 00:22:39.041 EOF 00:22:39.041 )") 00:22:39.041 03:39:19 -- nvmf/common.sh@542 -- # cat 00:22:39.041 03:39:19 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:39.041 03:39:19 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:39.041 { 00:22:39.041 "params": { 00:22:39.041 "name": "Nvme$subsystem", 00:22:39.041 "trtype": "$TEST_TRANSPORT", 00:22:39.041 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:39.041 "adrfam": "ipv4", 00:22:39.041 "trsvcid": "$NVMF_PORT", 00:22:39.041 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:39.041 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:39.041 "hdgst": ${hdgst:-false}, 00:22:39.041 "ddgst": ${ddgst:-false} 00:22:39.041 }, 00:22:39.041 "method": "bdev_nvme_attach_controller" 00:22:39.041 } 00:22:39.041 EOF 00:22:39.041 )") 00:22:39.041 03:39:19 -- nvmf/common.sh@542 -- # cat 00:22:39.041 03:39:19 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:39.041 03:39:19 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:39.041 { 00:22:39.041 "params": { 00:22:39.041 "name": "Nvme$subsystem", 00:22:39.041 "trtype": "$TEST_TRANSPORT", 00:22:39.041 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:39.041 "adrfam": "ipv4", 00:22:39.041 "trsvcid": "$NVMF_PORT", 00:22:39.041 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:39.041 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:39.041 "hdgst": ${hdgst:-false}, 00:22:39.041 "ddgst": ${ddgst:-false} 00:22:39.041 }, 00:22:39.041 "method": "bdev_nvme_attach_controller" 00:22:39.041 } 00:22:39.041 EOF 00:22:39.041 )") 00:22:39.041 03:39:19 -- nvmf/common.sh@542 -- # cat 00:22:39.041 03:39:19 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:39.041 03:39:19 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:39.041 { 00:22:39.041 "params": { 00:22:39.041 "name": "Nvme$subsystem", 00:22:39.041 "trtype": "$TEST_TRANSPORT", 00:22:39.041 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:39.041 "adrfam": "ipv4", 00:22:39.041 "trsvcid": "$NVMF_PORT", 00:22:39.041 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:39.041 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:39.041 "hdgst": ${hdgst:-false}, 00:22:39.041 "ddgst": ${ddgst:-false} 00:22:39.041 }, 00:22:39.041 "method": "bdev_nvme_attach_controller" 00:22:39.041 } 00:22:39.041 EOF 00:22:39.041 )") 00:22:39.041 03:39:19 -- nvmf/common.sh@542 -- # cat 00:22:39.041 03:39:19 -- nvmf/common.sh@544 -- # jq . 00:22:39.041 03:39:19 -- nvmf/common.sh@545 -- # IFS=, 00:22:39.041 03:39:19 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:22:39.041 "params": { 00:22:39.041 "name": "Nvme1", 00:22:39.041 "trtype": "tcp", 00:22:39.041 "traddr": "10.0.0.2", 00:22:39.041 "adrfam": "ipv4", 00:22:39.041 "trsvcid": "4420", 00:22:39.041 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:39.041 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:22:39.041 "hdgst": false, 00:22:39.041 "ddgst": false 00:22:39.041 }, 00:22:39.041 "method": "bdev_nvme_attach_controller" 00:22:39.041 },{ 00:22:39.041 "params": { 00:22:39.041 "name": "Nvme2", 00:22:39.041 "trtype": "tcp", 00:22:39.041 "traddr": "10.0.0.2", 00:22:39.041 "adrfam": "ipv4", 00:22:39.041 "trsvcid": "4420", 00:22:39.041 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:39.041 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:22:39.041 "hdgst": false, 00:22:39.041 "ddgst": false 00:22:39.041 }, 00:22:39.041 "method": "bdev_nvme_attach_controller" 00:22:39.041 },{ 00:22:39.041 "params": { 00:22:39.041 "name": "Nvme3", 00:22:39.041 "trtype": "tcp", 00:22:39.041 "traddr": "10.0.0.2", 00:22:39.041 "adrfam": "ipv4", 00:22:39.041 "trsvcid": "4420", 00:22:39.041 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:22:39.041 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:22:39.041 "hdgst": false, 00:22:39.041 "ddgst": false 00:22:39.041 }, 00:22:39.041 "method": "bdev_nvme_attach_controller" 00:22:39.041 },{ 00:22:39.041 "params": { 00:22:39.041 "name": "Nvme4", 00:22:39.041 "trtype": "tcp", 00:22:39.041 "traddr": "10.0.0.2", 00:22:39.041 "adrfam": "ipv4", 00:22:39.041 "trsvcid": "4420", 00:22:39.041 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:22:39.041 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:22:39.041 "hdgst": false, 00:22:39.041 "ddgst": false 00:22:39.041 }, 00:22:39.041 "method": "bdev_nvme_attach_controller" 00:22:39.041 },{ 00:22:39.041 "params": { 00:22:39.041 "name": "Nvme5", 00:22:39.041 "trtype": "tcp", 00:22:39.041 "traddr": "10.0.0.2", 00:22:39.041 "adrfam": "ipv4", 00:22:39.041 "trsvcid": "4420", 00:22:39.041 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:22:39.041 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:22:39.041 "hdgst": false, 00:22:39.041 "ddgst": false 00:22:39.041 }, 00:22:39.041 "method": "bdev_nvme_attach_controller" 00:22:39.041 },{ 00:22:39.041 "params": { 00:22:39.041 "name": "Nvme6", 00:22:39.041 "trtype": "tcp", 00:22:39.041 "traddr": "10.0.0.2", 00:22:39.041 "adrfam": "ipv4", 00:22:39.041 "trsvcid": "4420", 00:22:39.041 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:22:39.041 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:22:39.041 "hdgst": false, 00:22:39.041 "ddgst": false 00:22:39.041 }, 00:22:39.041 "method": "bdev_nvme_attach_controller" 00:22:39.041 },{ 00:22:39.041 "params": { 00:22:39.041 "name": "Nvme7", 00:22:39.041 "trtype": "tcp", 00:22:39.041 "traddr": "10.0.0.2", 00:22:39.041 "adrfam": "ipv4", 00:22:39.041 "trsvcid": "4420", 00:22:39.041 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:22:39.041 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:22:39.041 "hdgst": false, 00:22:39.041 "ddgst": false 00:22:39.041 }, 00:22:39.041 "method": "bdev_nvme_attach_controller" 00:22:39.041 },{ 00:22:39.041 "params": { 00:22:39.041 "name": "Nvme8", 00:22:39.041 "trtype": "tcp", 00:22:39.041 "traddr": "10.0.0.2", 00:22:39.041 "adrfam": "ipv4", 00:22:39.041 "trsvcid": "4420", 00:22:39.041 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:22:39.041 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:22:39.041 "hdgst": false, 00:22:39.041 "ddgst": false 00:22:39.041 }, 00:22:39.041 "method": "bdev_nvme_attach_controller" 00:22:39.041 },{ 00:22:39.041 "params": { 00:22:39.041 "name": "Nvme9", 00:22:39.041 "trtype": "tcp", 00:22:39.041 "traddr": "10.0.0.2", 00:22:39.041 "adrfam": "ipv4", 00:22:39.041 "trsvcid": "4420", 00:22:39.041 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:22:39.041 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:22:39.041 "hdgst": false, 00:22:39.041 "ddgst": false 00:22:39.041 }, 00:22:39.041 "method": "bdev_nvme_attach_controller" 00:22:39.041 },{ 00:22:39.041 "params": { 00:22:39.041 "name": "Nvme10", 00:22:39.041 "trtype": "tcp", 00:22:39.041 "traddr": "10.0.0.2", 00:22:39.041 "adrfam": "ipv4", 00:22:39.041 "trsvcid": "4420", 00:22:39.041 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:22:39.041 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:22:39.041 "hdgst": false, 00:22:39.041 "ddgst": false 00:22:39.041 }, 00:22:39.041 "method": "bdev_nvme_attach_controller" 00:22:39.041 }' 00:22:39.041 [2024-11-21 03:39:19.451567] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:39.041 [2024-11-21 03:39:19.451655] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3119324 ] 00:22:39.041 EAL: No free 2048 kB hugepages reported on node 1 00:22:39.041 [2024-11-21 03:39:19.515474] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:39.041 [2024-11-21 03:39:19.623319] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:40.947 Running I/O for 10 seconds... 00:22:41.535 03:39:21 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:41.535 03:39:21 -- common/autotest_common.sh@862 -- # return 0 00:22:41.535 03:39:21 -- target/shutdown.sh@126 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:22:41.535 03:39:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:41.535 03:39:21 -- common/autotest_common.sh@10 -- # set +x 00:22:41.535 03:39:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:41.535 03:39:21 -- target/shutdown.sh@129 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:22:41.535 03:39:21 -- target/shutdown.sh@131 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:22:41.535 03:39:21 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:22:41.535 03:39:21 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:22:41.535 03:39:21 -- target/shutdown.sh@57 -- # local ret=1 00:22:41.535 03:39:21 -- target/shutdown.sh@58 -- # local i 00:22:41.535 03:39:21 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:22:41.535 03:39:21 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:22:41.535 03:39:21 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:22:41.535 03:39:21 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:22:41.535 03:39:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:41.535 03:39:21 -- common/autotest_common.sh@10 -- # set +x 00:22:41.535 03:39:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:41.535 03:39:22 -- target/shutdown.sh@60 -- # read_io_count=211 00:22:41.535 03:39:22 -- target/shutdown.sh@63 -- # '[' 211 -ge 100 ']' 00:22:41.535 03:39:22 -- target/shutdown.sh@64 -- # ret=0 00:22:41.535 03:39:22 -- target/shutdown.sh@65 -- # break 00:22:41.535 03:39:22 -- target/shutdown.sh@69 -- # return 0 00:22:41.535 03:39:22 -- target/shutdown.sh@134 -- # killprocess 3119059 00:22:41.535 03:39:22 -- common/autotest_common.sh@936 -- # '[' -z 3119059 ']' 00:22:41.535 03:39:22 -- common/autotest_common.sh@940 -- # kill -0 3119059 00:22:41.535 03:39:22 -- common/autotest_common.sh@941 -- # uname 00:22:41.535 03:39:22 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:41.535 03:39:22 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3119059 00:22:41.535 03:39:22 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:22:41.535 03:39:22 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:22:41.535 03:39:22 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3119059' 00:22:41.535 killing process with pid 3119059 00:22:41.535 03:39:22 -- common/autotest_common.sh@955 -- # kill 3119059 00:22:41.535 03:39:22 -- common/autotest_common.sh@960 -- # wait 3119059 00:22:41.535 [2024-11-21 03:39:22.043027] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe962e0 is same with the state(5) to be set 00:22:41.535 [2024-11-21 03:39:22.043157] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe962e0 is same with the state(5) to be set 00:22:41.536 [2024-11-21 03:39:22.043182] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe962e0 is same with the state(5) to be set 00:22:41.536 [2024-11-21 03:39:22.043195] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe962e0 is same with the state(5) to be set 00:22:41.536 [2024-11-21 03:39:22.043208] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe962e0 is same with the state(5) to be set 00:22:41.536 [2024-11-21 03:39:22.043221] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe962e0 is same with the state(5) to be set 00:22:41.536 [2024-11-21 03:39:22.043246] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe962e0 is same with the state(5) to be set 00:22:41.536 [2024-11-21 03:39:22.043258] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe962e0 is same with the state(5) to be set 00:22:41.536 [2024-11-21 03:39:22.043271] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe962e0 is same with the state(5) to be set 00:22:41.536 [2024-11-21 03:39:22.043283] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe962e0 is same with the state(5) to be set 00:22:41.536 [2024-11-21 03:39:22.043295] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe962e0 is same with the state(5) to be set 00:22:41.536 [2024-11-21 03:39:22.043307] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe962e0 is same with the state(5) to be set 00:22:41.536 [2024-11-21 03:39:22.043318] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe962e0 is same with the state(5) to be set 00:22:41.536 [2024-11-21 03:39:22.043330] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe962e0 is same with the state(5) to be set 00:22:41.536 [2024-11-21 03:39:22.043342] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe962e0 is same with the state(5) to be set 00:22:41.536 [2024-11-21 03:39:22.043363] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe962e0 is same with the state(5) to be set 00:22:41.536 [2024-11-21 03:39:22.043375] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe962e0 is same with the state(5) to be set 00:22:41.536 [2024-11-21 03:39:22.043386] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe962e0 is same with the state(5) to be set 00:22:41.536 [2024-11-21 03:39:22.043402] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe962e0 is same with the state(5) to be set 00:22:41.536 [2024-11-21 03:39:22.043423] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe962e0 is same with the state(5) to be set 00:22:41.536 [2024-11-21 03:39:22.043445] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe962e0 is same with the state(5) to be set 00:22:41.536 [2024-11-21 03:39:22.043468] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe962e0 is same with the state(5) to be set 00:22:41.536 [2024-11-21 03:39:22.043489] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe962e0 is same with the state(5) to be set 00:22:41.536 [2024-11-21 03:39:22.043503] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe962e0 is same with the state(5) to be set 00:22:41.536 [2024-11-21 03:39:22.043515] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe962e0 is same with the state(5) to be set 00:22:41.536 [2024-11-21 03:39:22.043527] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe962e0 is same with the state(5) to be set 00:22:41.536 [2024-11-21 03:39:22.043539] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe962e0 is same with the state(5) to be set 00:22:41.536 [2024-11-21 03:39:22.043551] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe962e0 is same with the state(5) to be set 00:22:41.536 [2024-11-21 03:39:22.043563] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe962e0 is same with the state(5) to be set 00:22:41.536 [2024-11-21 03:39:22.043574] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe962e0 is same with the state(5) to be set 00:22:41.536 [2024-11-21 03:39:22.043586] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe962e0 is same with the state(5) to be set 00:22:41.536 [2024-11-21 03:39:22.043598] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe962e0 is same with the state(5) to be set 00:22:41.536 [2024-11-21 03:39:22.043611] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe962e0 is same with the state(5) to be set 00:22:41.536 [2024-11-21 03:39:22.043628] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe962e0 is same with the state(5) to be set 00:22:41.536 [2024-11-21 03:39:22.043641] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe962e0 is same with the state(5) to be set 00:22:41.536 [2024-11-21 03:39:22.043694] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe962e0 is same with the state(5) to be set 00:22:41.536 [2024-11-21 03:39:22.043709] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe962e0 is same with the state(5) to be set 00:22:41.536 [2024-11-21 03:39:22.043721] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe962e0 is same with the state(5) to be set 00:22:41.536 [2024-11-21 03:39:22.043733] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe962e0 is same with the state(5) to be set 00:22:41.536 [2024-11-21 03:39:22.043746] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe962e0 is same with the state(5) to be set 00:22:41.536 [2024-11-21 03:39:22.043758] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe962e0 is same with the state(5) to be set 00:22:41.536 [2024-11-21 03:39:22.043771] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe962e0 is same with the state(5) to be set 00:22:41.536 [2024-11-21 03:39:22.043784] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe962e0 is same with the state(5) to be set 00:22:41.536 [2024-11-21 03:39:22.043796] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe962e0 is same with the state(5) to be set 00:22:41.536 [2024-11-21 03:39:22.043807] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe962e0 is same with the state(5) to be set 00:22:41.536 [2024-11-21 03:39:22.043819] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe962e0 is same with the state(5) to be set 00:22:41.536 [2024-11-21 03:39:22.043832] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe962e0 is same with the state(5) to be set 00:22:41.536 [2024-11-21 03:39:22.043844] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe962e0 is same with the state(5) to be set 00:22:41.536 [2024-11-21 03:39:22.043856] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe962e0 is same with the state(5) to be set 00:22:41.536 [2024-11-21 03:39:22.043868] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe962e0 is same with the state(5) to be set 00:22:41.536 [2024-11-21 03:39:22.043880] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe962e0 is same with the state(5) to be set 00:22:41.536 [2024-11-21 03:39:22.043892] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe962e0 is same with the state(5) to be set 00:22:41.536 [2024-11-21 03:39:22.043904] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe962e0 is same with the state(5) to be set 00:22:41.536 [2024-11-21 03:39:22.043916] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe962e0 is same with the state(5) to be set 00:22:41.536 [2024-11-21 03:39:22.043928] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe962e0 is same with the state(5) to be set 00:22:41.536 [2024-11-21 03:39:22.043940] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe962e0 is same with the state(5) to be set 00:22:41.536 [2024-11-21 03:39:22.043953] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe962e0 is same with the state(5) to be set 00:22:41.536 [2024-11-21 03:39:22.043965] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe962e0 is same with the state(5) to be set 00:22:41.536 [2024-11-21 03:39:22.043977] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe962e0 is same with the state(5) to be set 00:22:41.536 [2024-11-21 03:39:22.043990] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe962e0 is same with the state(5) to be set 00:22:41.536 [2024-11-21 03:39:22.044006] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe962e0 is same with the state(5) to be set 00:22:41.536 [2024-11-21 03:39:22.044019] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe962e0 is same with the state(5) to be set 00:22:41.536 [2024-11-21 03:39:22.044032] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe962e0 is same with the state(5) to be set 00:22:41.536 [2024-11-21 03:39:22.045093] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:41.536 [2024-11-21 03:39:22.045133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.536 [2024-11-21 03:39:22.045152] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:41.536 [2024-11-21 03:39:22.045166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.536 [2024-11-21 03:39:22.045182] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:41.536 [2024-11-21 03:39:22.045197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.536 [2024-11-21 03:39:22.045211] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:41.536 [2024-11-21 03:39:22.045225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.536 [2024-11-21 03:39:22.045239] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2095f70 is same with the state(5) to be set 00:22:41.536 [2024-11-21 03:39:22.045371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:34816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.537 [2024-11-21 03:39:22.045395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.537 [2024-11-21 03:39:22.045433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.537 [2024-11-21 03:39:22.045449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.537 [2024-11-21 03:39:22.045467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:35072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.537 [2024-11-21 03:39:22.045482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.537 [2024-11-21 03:39:22.045499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.537 [2024-11-21 03:39:22.045513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.537 [2024-11-21 03:39:22.045530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.537 [2024-11-21 03:39:22.045545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.537 [2024-11-21 03:39:22.045562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.537 [2024-11-21 03:39:22.045577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.537 [2024-11-21 03:39:22.045593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.537 [2024-11-21 03:39:22.045608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.537 [2024-11-21 03:39:22.045631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.537 [2024-11-21 03:39:22.045647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.537 [2024-11-21 03:39:22.045664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.537 [2024-11-21 03:39:22.045678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.537 [2024-11-21 03:39:22.045695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.537 [2024-11-21 03:39:22.045710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.537 [2024-11-21 03:39:22.045726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.537 [2024-11-21 03:39:22.045741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.537 [2024-11-21 03:39:22.045758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.537 [2024-11-21 03:39:22.045773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.537 [2024-11-21 03:39:22.045790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.537 [2024-11-21 03:39:22.045820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.537 [2024-11-21 03:39:22.045837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.537 [2024-11-21 03:39:22.045852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.537 [2024-11-21 03:39:22.045868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.537 [2024-11-21 03:39:22.045882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.537 [2024-11-21 03:39:22.045898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.537 [2024-11-21 03:39:22.045913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.537 [2024-11-21 03:39:22.045930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.537 [2024-11-21 03:39:22.045944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.537 [2024-11-21 03:39:22.045960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.537 [2024-11-21 03:39:22.045974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.537 [2024-11-21 03:39:22.045991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:35456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.537 [2024-11-21 03:39:22.046006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.537 [2024-11-21 03:39:22.046021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.537 [2024-11-21 03:39:22.046040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.537 [2024-11-21 03:39:22.046081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.537 [2024-11-21 03:39:22.046099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.537 [2024-11-21 03:39:22.046116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.537 [2024-11-21 03:39:22.046130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.537 [2024-11-21 03:39:22.046158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.537 [2024-11-21 03:39:22.046173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.537 [2024-11-21 03:39:22.046190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.537 [2024-11-21 03:39:22.046205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.537 [2024-11-21 03:39:22.046221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.537 [2024-11-21 03:39:22.046236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.537 [2024-11-21 03:39:22.046252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.537 [2024-11-21 03:39:22.046268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.537 [2024-11-21 03:39:22.046284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.537 [2024-11-21 03:39:22.046299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.537 [2024-11-21 03:39:22.046316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.537 [2024-11-21 03:39:22.046332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.537 [2024-11-21 03:39:22.046349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.537 [2024-11-21 03:39:22.046363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.537 [2024-11-21 03:39:22.046380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.537 [2024-11-21 03:39:22.046394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.537 [2024-11-21 03:39:22.046410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:35968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.537 [2024-11-21 03:39:22.046428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.537 [2024-11-21 03:39:22.046444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.537 [2024-11-21 03:39:22.046475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.537 [2024-11-21 03:39:22.046503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.537 [2024-11-21 03:39:22.046518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.537 [2024-11-21 03:39:22.046534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:36352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.538 [2024-11-21 03:39:22.046548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.538 [2024-11-21 03:39:22.046564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.538 [2024-11-21 03:39:22.046578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.538 [2024-11-21 03:39:22.046595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.538 [2024-11-21 03:39:22.046609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.538 [2024-11-21 03:39:22.046625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.538 [2024-11-21 03:39:22.046639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.538 [2024-11-21 03:39:22.046655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.538 [2024-11-21 03:39:22.046669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.538 [2024-11-21 03:39:22.046684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.538 [2024-11-21 03:39:22.046699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.538 [2024-11-21 03:39:22.046715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.538 [2024-11-21 03:39:22.046729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.538 [2024-11-21 03:39:22.046745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.538 [2024-11-21 03:39:22.046759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.538 [2024-11-21 03:39:22.046775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.538 [2024-11-21 03:39:22.046789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.538 [2024-11-21 03:39:22.046806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.538 [2024-11-21 03:39:22.046820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.538 [2024-11-21 03:39:22.046836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:37632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.538 [2024-11-21 03:39:22.046851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.538 [2024-11-21 03:39:22.046867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.538 [2024-11-21 03:39:22.046885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.538 [2024-11-21 03:39:22.046901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.538 [2024-11-21 03:39:22.046915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.538 [2024-11-21 03:39:22.046931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.538 [2024-11-21 03:39:22.046945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.538 [2024-11-21 03:39:22.046962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:38144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.538 [2024-11-21 03:39:22.046991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.538 [2024-11-21 03:39:22.047009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:38272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.538 [2024-11-21 03:39:22.047023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.538 [2024-11-21 03:39:22.047040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.538 [2024-11-21 03:39:22.047064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.538 [2024-11-21 03:39:22.047091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.538 [2024-11-21 03:39:22.047107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.538 [2024-11-21 03:39:22.047124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.538 [2024-11-21 03:39:22.047138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.538 [2024-11-21 03:39:22.047155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.538 [2024-11-21 03:39:22.047169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.538 [2024-11-21 03:39:22.047186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.538 [2024-11-21 03:39:22.047201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.538 [2024-11-21 03:39:22.047217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.538 [2024-11-21 03:39:22.047231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.538 [2024-11-21 03:39:22.047247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.538 [2024-11-21 03:39:22.047262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.538 [2024-11-21 03:39:22.047278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:39296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.538 [2024-11-21 03:39:22.047293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.538 [2024-11-21 03:39:22.047313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.538 [2024-11-21 03:39:22.047329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.538 [2024-11-21 03:39:22.047345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.538 [2024-11-21 03:39:22.047365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.538 [2024-11-21 03:39:22.047381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.538 [2024-11-21 03:39:22.047396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.538 [2024-11-21 03:39:22.047413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.538 [2024-11-21 03:39:22.047428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.538 [2024-11-21 03:39:22.047444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.538 [2024-11-21 03:39:22.047459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.538 [2024-11-21 03:39:22.047475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.538 [2024-11-21 03:39:22.047489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.538 [2024-11-21 03:39:22.047505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.538 [2024-11-21 03:39:22.047519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.538 [2024-11-21 03:39:22.047621] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x22da260 was disconnected and freed. reset controller. 00:22:41.538 [2024-11-21 03:39:22.049059] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98cd0 is same with the state(5) to be set 00:22:41.538 [2024-11-21 03:39:22.049109] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98cd0 is same with the state(5) to be set 00:22:41.539 [2024-11-21 03:39:22.049125] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98cd0 is same with the state(5) to be set 00:22:41.539 [2024-11-21 03:39:22.049138] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98cd0 is same with the state(5) to be set 00:22:41.539 [2024-11-21 03:39:22.049150] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98cd0 is same with the state(5) to be set 00:22:41.539 [2024-11-21 03:39:22.049163] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98cd0 is same with the state(5) to be set 00:22:41.539 [2024-11-21 03:39:22.049175] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98cd0 is same with the state(5) to be set 00:22:41.539 [2024-11-21 03:39:22.049187] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98cd0 is same with the state(5) to be set 00:22:41.539 [2024-11-21 03:39:22.049200] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98cd0 is same with the state(5) to be set 00:22:41.539 [2024-11-21 03:39:22.049211] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98cd0 is same with the state(5) to be set 00:22:41.539 [2024-11-21 03:39:22.049224] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98cd0 is same with the state(5) to be set 00:22:41.539 [2024-11-21 03:39:22.049247] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98cd0 is same with the state(5) to be set 00:22:41.539 [2024-11-21 03:39:22.049260] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98cd0 is same with the state(5) to be set 00:22:41.539 [2024-11-21 03:39:22.049272] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98cd0 is same with the state(5) to be set 00:22:41.539 [2024-11-21 03:39:22.049284] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98cd0 is same with the state(5) to be set 00:22:41.539 [2024-11-21 03:39:22.049296] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98cd0 is same with the state(5) to be set 00:22:41.539 [2024-11-21 03:39:22.049308] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98cd0 is same with the state(5) to be set 00:22:41.539 [2024-11-21 03:39:22.049320] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98cd0 is same with the state(5) to be set 00:22:41.539 [2024-11-21 03:39:22.049333] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98cd0 is same with the state(5) to be set 00:22:41.539 [2024-11-21 03:39:22.049345] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98cd0 is same with the state(5) to be set 00:22:41.539 [2024-11-21 03:39:22.049371] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98cd0 is same with the state(5) to be set 00:22:41.539 [2024-11-21 03:39:22.049384] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98cd0 is same with the state(5) to be set 00:22:41.539 [2024-11-21 03:39:22.049396] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98cd0 is same with the state(5) to be set 00:22:41.539 [2024-11-21 03:39:22.049408] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98cd0 is same with the state(5) to be set 00:22:41.539 [2024-11-21 03:39:22.049420] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98cd0 is same with the state(5) to be set 00:22:41.539 [2024-11-21 03:39:22.049433] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98cd0 is same with the state(5) to be set 00:22:41.539 [2024-11-21 03:39:22.049445] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98cd0 is same with the state(5) to be set 00:22:41.539 [2024-11-21 03:39:22.049457] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98cd0 is same with the state(5) to be set 00:22:41.539 [2024-11-21 03:39:22.049469] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98cd0 is same with the state(5) to be set 00:22:41.539 [2024-11-21 03:39:22.049482] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98cd0 is same with the state(5) to be set 00:22:41.539 [2024-11-21 03:39:22.049494] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98cd0 is same with the state(5) to be set 00:22:41.539 [2024-11-21 03:39:22.049507] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98cd0 is same with the state(5) to be set 00:22:41.539 [2024-11-21 03:39:22.049519] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98cd0 is same with the state(5) to be set 00:22:41.539 [2024-11-21 03:39:22.049531] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98cd0 is same with the state(5) to be set 00:22:41.539 [2024-11-21 03:39:22.049543] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98cd0 is same with the state(5) to be set 00:22:41.539 [2024-11-21 03:39:22.049555] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98cd0 is same with the state(5) to be set 00:22:41.539 [2024-11-21 03:39:22.049567] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98cd0 is same with the state(5) to be set 00:22:41.539 [2024-11-21 03:39:22.049580] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98cd0 is same with the state(5) to be set 00:22:41.539 [2024-11-21 03:39:22.049597] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98cd0 is same with the state(5) to be set 00:22:41.539 [2024-11-21 03:39:22.049611] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98cd0 is same with the state(5) to be set 00:22:41.539 [2024-11-21 03:39:22.049623] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98cd0 is same with the state(5) to be set 00:22:41.539 [2024-11-21 03:39:22.049636] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98cd0 is same with the state(5) to be set 00:22:41.539 [2024-11-21 03:39:22.049649] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98cd0 is same with the state(5) to be set 00:22:41.539 [2024-11-21 03:39:22.049661] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98cd0 is same with the state(5) to be set 00:22:41.539 [2024-11-21 03:39:22.049674] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98cd0 is same with the state(5) to be set 00:22:41.539 [2024-11-21 03:39:22.049686] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98cd0 is same with the state(5) to be set 00:22:41.539 [2024-11-21 03:39:22.049700] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98cd0 is same with the state(5) to be set 00:22:41.539 [2024-11-21 03:39:22.049713] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98cd0 is same with the state(5) to be set 00:22:41.539 [2024-11-21 03:39:22.049726] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98cd0 is same with the state(5) to be set 00:22:41.539 [2024-11-21 03:39:22.049739] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98cd0 is same with the state(5) to be set 00:22:41.539 [2024-11-21 03:39:22.049751] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98cd0 is same with the state(5) to be set 00:22:41.539 [2024-11-21 03:39:22.049765] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98cd0 is same with the state(5) to be set 00:22:41.539 [2024-11-21 03:39:22.049777] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98cd0 is same with the state(5) to be set 00:22:41.539 [2024-11-21 03:39:22.049789] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98cd0 is same with the state(5) to be set 00:22:41.539 [2024-11-21 03:39:22.049801] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98cd0 is same with the state(5) to be set 00:22:41.539 [2024-11-21 03:39:22.049813] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98cd0 is same with the state(5) to be set 00:22:41.539 [2024-11-21 03:39:22.049825] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98cd0 is same with the state(5) to be set 00:22:41.539 [2024-11-21 03:39:22.049837] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98cd0 is same with the state(5) to be set 00:22:41.539 [2024-11-21 03:39:22.049848] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98cd0 is same with the state(5) to be set 00:22:41.539 [2024-11-21 03:39:22.049860] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98cd0 is same with the state(5) to be set 00:22:41.539 [2024-11-21 03:39:22.049871] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98cd0 is same with the state(5) to be set 00:22:41.539 [2024-11-21 03:39:22.049883] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98cd0 is same with the state(5) to be set 00:22:41.539 [2024-11-21 03:39:22.049895] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98cd0 is same with the state(5) to be set 00:22:41.539 [2024-11-21 03:39:22.051111] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:41.539 [2024-11-21 03:39:22.051181] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2095f70 (9): Bad file descriptor 00:22:41.539 [2024-11-21 03:39:22.052207] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96790 is same with the state(5) to be set 00:22:41.539 [2024-11-21 03:39:22.052247] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96790 is same with the state(5) to be set 00:22:41.539 [2024-11-21 03:39:22.052263] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96790 is same with the state(5) to be set 00:22:41.539 [2024-11-21 03:39:22.052275] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96790 is same with the state(5) to be set 00:22:41.539 [2024-11-21 03:39:22.052288] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96790 is same with the state(5) to be set 00:22:41.539 [2024-11-21 03:39:22.052300] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96790 is same with the state(5) to be set 00:22:41.539 [2024-11-21 03:39:22.052312] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96790 is same with the state(5) to be set 00:22:41.539 [2024-11-21 03:39:22.052324] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96790 is same with the state(5) to be set 00:22:41.539 [2024-11-21 03:39:22.052336] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96790 is same with the state(5) to be set 00:22:41.539 [2024-11-21 03:39:22.052347] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96790 is same with the state(5) to be set 00:22:41.540 [2024-11-21 03:39:22.052360] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96790 is same with the state(5) to be set 00:22:41.540 [2024-11-21 03:39:22.052373] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96790 is same with the state(5) to be set 00:22:41.540 [2024-11-21 03:39:22.052385] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96790 is same with the state(5) to be set 00:22:41.540 [2024-11-21 03:39:22.052402] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96790 is same with the state(5) to be set 00:22:41.540 [2024-11-21 03:39:22.052416] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96790 is same with the state(5) to be set 00:22:41.540 [2024-11-21 03:39:22.052429] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96790 is same with the state(5) to be set 00:22:41.540 [2024-11-21 03:39:22.052440] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96790 is same with the state(5) to be set 00:22:41.540 [2024-11-21 03:39:22.052452] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96790 is same with the state(5) to be set 00:22:41.540 [2024-11-21 03:39:22.052464] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96790 is same with the state(5) to be set 00:22:41.540 [2024-11-21 03:39:22.052475] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96790 is same with the state(5) to be set 00:22:41.540 [2024-11-21 03:39:22.052488] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96790 is same with the state(5) to be set 00:22:41.540 [2024-11-21 03:39:22.052500] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96790 is same with the state(5) to be set 00:22:41.540 [2024-11-21 03:39:22.052512] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96790 is same with the state(5) to be set 00:22:41.540 [2024-11-21 03:39:22.052525] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96790 is same with the state(5) to be set 00:22:41.540 [2024-11-21 03:39:22.052537] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96790 is same with the state(5) to be set 00:22:41.540 [2024-11-21 03:39:22.052550] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96790 is same with the state(5) to be set 00:22:41.540 [2024-11-21 03:39:22.052563] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96790 is same with the state(5) to be set 00:22:41.540 [2024-11-21 03:39:22.052576] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96790 is same with the state(5) to be set 00:22:41.540 [2024-11-21 03:39:22.052593] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96790 is same with the state(5) to be set 00:22:41.540 [2024-11-21 03:39:22.052606] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96790 is same with the state(5) to be set 00:22:41.540 [2024-11-21 03:39:22.052619] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96790 is same with the state(5) to be set 00:22:41.540 [2024-11-21 03:39:22.052631] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96790 is same with the state(5) to be set 00:22:41.540 [2024-11-21 03:39:22.052643] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96790 is same with the state(5) to be set 00:22:41.540 [2024-11-21 03:39:22.052659] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96790 is same with the state(5) to be set 00:22:41.540 [2024-11-21 03:39:22.052672] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96790 is same with the state(5) to be set 00:22:41.540 [2024-11-21 03:39:22.052684] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96790 is same with the state(5) to be set 00:22:41.540 [2024-11-21 03:39:22.052696] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96790 is same with the state(5) to be set 00:22:41.540 [2024-11-21 03:39:22.052709] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96790 is same with the state(5) to be set 00:22:41.540 [2024-11-21 03:39:22.052721] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96790 is same with the state(5) to be set 00:22:41.540 [2024-11-21 03:39:22.052733] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96790 is same with the state(5) to be set 00:22:41.540 [2024-11-21 03:39:22.052745] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96790 is same with the state(5) to be set 00:22:41.540 [2024-11-21 03:39:22.052758] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96790 is same with the state(5) to be set 00:22:41.540 [2024-11-21 03:39:22.052770] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96790 is same with the state(5) to be set 00:22:41.540 [2024-11-21 03:39:22.054259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:34816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.540 [2024-11-21 03:39:22.054293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.540 [2024-11-21 03:39:22.054320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.540 [2024-11-21 03:39:22.054338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.540 [2024-11-21 03:39:22.054355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:35072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.540 [2024-11-21 03:39:22.054371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.540 [2024-11-21 03:39:22.054388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.540 [2024-11-21 03:39:22.054403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.540 [2024-11-21 03:39:22.054419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.540 [2024-11-21 03:39:22.054434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.540 [2024-11-21 03:39:22.054451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.540 [2024-11-21 03:39:22.054474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.540 [2024-11-21 03:39:22.054492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.540 [2024-11-21 03:39:22.054508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-21 03:39:22.054499] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96c40 is same with tdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.540 he state(5) to be set 00:22:41.540 [2024-11-21 03:39:22.054529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.540 [2024-11-21 03:39:22.054533] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96c40 is same with the state(5) to be set 00:22:41.540 [2024-11-21 03:39:22.054544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.540 [2024-11-21 03:39:22.054552] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96c40 is same with the state(5) to be set 00:22:41.540 [2024-11-21 03:39:22.054561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.540 [2024-11-21 03:39:22.054566] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96c40 is same with the state(5) to be set 00:22:41.540 [2024-11-21 03:39:22.054576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.540 [2024-11-21 03:39:22.054579] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96c40 is same with the state(5) to be set 00:22:41.540 [2024-11-21 03:39:22.054592] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96c40 is same with the state(5) to be set 00:22:41.540 [2024-11-21 03:39:22.054593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.540 [2024-11-21 03:39:22.054604] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96c40 is same with the state(5) to be set 00:22:41.540 [2024-11-21 03:39:22.054608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.540 [2024-11-21 03:39:22.054617] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96c40 is same with the state(5) to be set 00:22:41.540 [2024-11-21 03:39:22.054625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.540 [2024-11-21 03:39:22.054629] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96c40 is same with the state(5) to be set 00:22:41.540 [2024-11-21 03:39:22.054640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-21 03:39:22.054641] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96c40 is same with tdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.541 he state(5) to be set 00:22:41.541 [2024-11-21 03:39:22.054656] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96c40 is same with the state(5) to be set 00:22:41.541 [2024-11-21 03:39:22.054660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.541 [2024-11-21 03:39:22.054669] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96c40 is same with the state(5) to be set 00:22:41.541 [2024-11-21 03:39:22.054675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.541 [2024-11-21 03:39:22.054681] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96c40 is same with the state(5) to be set 00:22:41.541 [2024-11-21 03:39:22.054692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:31488 len:12[2024-11-21 03:39:22.054694] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96c40 is same with t8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.541 he state(5) to be set 00:22:41.541 [2024-11-21 03:39:22.054712] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96c40 is same with the state(5) to be set 00:22:41.541 [2024-11-21 03:39:22.054713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.541 [2024-11-21 03:39:22.054724] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96c40 is same with the state(5) to be set 00:22:41.541 [2024-11-21 03:39:22.054730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:35456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.541 [2024-11-21 03:39:22.054736] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96c40 is same with the state(5) to be set 00:22:41.541 [2024-11-21 03:39:22.054745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.541 [2024-11-21 03:39:22.054749] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96c40 is same with the state(5) to be set 00:22:41.541 [2024-11-21 03:39:22.054763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:35584 len:1[2024-11-21 03:39:22.054761] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96c40 is same with t28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.541 he state(5) to be set 00:22:41.541 [2024-11-21 03:39:22.054780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-21 03:39:22.054780] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96c40 is same with tdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.541 he state(5) to be set 00:22:41.541 [2024-11-21 03:39:22.054796] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96c40 is same with the state(5) to be set 00:22:41.541 [2024-11-21 03:39:22.054798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.541 [2024-11-21 03:39:22.054808] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96c40 is same with the state(5) to be set 00:22:41.541 [2024-11-21 03:39:22.054813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.541 [2024-11-21 03:39:22.054824] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96c40 is same with the state(5) to be set 00:22:41.541 [2024-11-21 03:39:22.054830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.541 [2024-11-21 03:39:22.054838] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96c40 is same with the state(5) to be set 00:22:41.541 [2024-11-21 03:39:22.054845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.541 [2024-11-21 03:39:22.054851] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96c40 is same with the state(5) to be set 00:22:41.541 [2024-11-21 03:39:22.054862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:35968 len:12[2024-11-21 03:39:22.054863] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96c40 is same with t8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.541 he state(5) to be set 00:22:41.541 [2024-11-21 03:39:22.054878] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96c40 is same with t[2024-11-21 03:39:22.054878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 che state(5) to be set 00:22:41.541 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.541 [2024-11-21 03:39:22.054892] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96c40 is same with t[2024-11-21 03:39:22.054896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:36096 len:1he state(5) to be set 00:22:41.541 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.541 [2024-11-21 03:39:22.054912] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96c40 is same with t[2024-11-21 03:39:22.054913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 che state(5) to be set 00:22:41.541 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.541 [2024-11-21 03:39:22.054927] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96c40 is same with the state(5) to be set 00:22:41.541 [2024-11-21 03:39:22.054932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.541 [2024-11-21 03:39:22.054940] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96c40 is same with the state(5) to be set 00:22:41.541 [2024-11-21 03:39:22.054948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.541 [2024-11-21 03:39:22.054952] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96c40 is same with the state(5) to be set 00:22:41.541 [2024-11-21 03:39:22.054965] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96c40 is same with t[2024-11-21 03:39:22.054965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:36352 len:12he state(5) to be set 00:22:41.541 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.541 [2024-11-21 03:39:22.054978] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96c40 is same with the state(5) to be set 00:22:41.541 [2024-11-21 03:39:22.054981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.541 [2024-11-21 03:39:22.054994] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96c40 is same with the state(5) to be set 00:22:41.541 [2024-11-21 03:39:22.054998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.541 [2024-11-21 03:39:22.055007] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96c40 is same with the state(5) to be set 00:22:41.541 [2024-11-21 03:39:22.055013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.541 [2024-11-21 03:39:22.055020] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96c40 is same with the state(5) to be set 00:22:41.541 [2024-11-21 03:39:22.055030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:36608 len:1[2024-11-21 03:39:22.055032] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96c40 is same with t28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.541 he state(5) to be set 00:22:41.541 [2024-11-21 03:39:22.055046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.541 [2024-11-21 03:39:22.055049] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96c40 is same with the state(5) to be set 00:22:41.541 [2024-11-21 03:39:22.055065] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96c40 is same with the state(5) to be set 00:22:41.542 [2024-11-21 03:39:22.055080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.542 [2024-11-21 03:39:22.055087] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96c40 is same with the state(5) to be set 00:22:41.542 [2024-11-21 03:39:22.055098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.542 [2024-11-21 03:39:22.055100] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96c40 is same with the state(5) to be set 00:22:41.542 [2024-11-21 03:39:22.055115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.542 [2024-11-21 03:39:22.055118] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96c40 is same with the state(5) to be set 00:22:41.542 [2024-11-21 03:39:22.055130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-21 03:39:22.055132] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96c40 is same with tdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.542 he state(5) to be set 00:22:41.542 [2024-11-21 03:39:22.055146] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96c40 is same with the state(5) to be set 00:22:41.542 [2024-11-21 03:39:22.055149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.542 [2024-11-21 03:39:22.055158] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96c40 is same with the state(5) to be set 00:22:41.542 [2024-11-21 03:39:22.055164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.542 [2024-11-21 03:39:22.055170] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96c40 is same with the state(5) to be set 00:22:41.542 [2024-11-21 03:39:22.055182] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96c40 is same with t[2024-11-21 03:39:22.055182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:37120 len:1he state(5) to be set 00:22:41.542 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.542 [2024-11-21 03:39:22.055196] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96c40 is same with the state(5) to be set 00:22:41.542 [2024-11-21 03:39:22.055198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.542 [2024-11-21 03:39:22.055208] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96c40 is same with the state(5) to be set 00:22:41.542 [2024-11-21 03:39:22.055215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.542 [2024-11-21 03:39:22.055220] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96c40 is same with the state(5) to be set 00:22:41.542 [2024-11-21 03:39:22.055230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-21 03:39:22.055231] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96c40 is same with tdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.542 he state(5) to be set 00:22:41.542 [2024-11-21 03:39:22.055245] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96c40 is same with the state(5) to be set 00:22:41.542 [2024-11-21 03:39:22.055247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.542 [2024-11-21 03:39:22.055257] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96c40 is same with the state(5) to be set 00:22:41.542 [2024-11-21 03:39:22.055262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.542 [2024-11-21 03:39:22.055269] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96c40 is same with the state(5) to be set 00:22:41.542 [2024-11-21 03:39:22.055279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:37504 len:12[2024-11-21 03:39:22.055281] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96c40 is same with t8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.542 he state(5) to be set 00:22:41.542 [2024-11-21 03:39:22.055296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-21 03:39:22.055296] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96c40 is same with tdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.542 he state(5) to be set 00:22:41.542 [2024-11-21 03:39:22.055315] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96c40 is same with the state(5) to be set 00:22:41.542 [2024-11-21 03:39:22.055319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:37632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.542 [2024-11-21 03:39:22.055327] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96c40 is same with the state(5) to be set 00:22:41.542 [2024-11-21 03:39:22.055334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.542 [2024-11-21 03:39:22.055339] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96c40 is same with the state(5) to be set 00:22:41.542 [2024-11-21 03:39:22.055352] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96c40 is same with t[2024-11-21 03:39:22.055351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:37760 len:12he state(5) to be set 00:22:41.542 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.542 [2024-11-21 03:39:22.055366] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96c40 is same with the state(5) to be set 00:22:41.542 [2024-11-21 03:39:22.055368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.542 [2024-11-21 03:39:22.055378] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe96c40 is same with the state(5) to be set 00:22:41.542 [2024-11-21 03:39:22.055385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.542 [2024-11-21 03:39:22.055399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.542 [2024-11-21 03:39:22.055415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.542 [2024-11-21 03:39:22.055430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.542 [2024-11-21 03:39:22.055446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:38144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.542 [2024-11-21 03:39:22.055460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.542 [2024-11-21 03:39:22.055477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:38272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.542 [2024-11-21 03:39:22.055491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.542 [2024-11-21 03:39:22.055507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.542 [2024-11-21 03:39:22.055521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.542 [2024-11-21 03:39:22.055538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.542 [2024-11-21 03:39:22.055552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.542 [2024-11-21 03:39:22.055568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.542 [2024-11-21 03:39:22.055598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.542 [2024-11-21 03:39:22.055615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.542 [2024-11-21 03:39:22.055632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.542 [2024-11-21 03:39:22.055649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.542 [2024-11-21 03:39:22.055663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.542 [2024-11-21 03:39:22.055679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.542 [2024-11-21 03:39:22.055694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.542 [2024-11-21 03:39:22.055710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.542 [2024-11-21 03:39:22.055725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.542 [2024-11-21 03:39:22.055741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:39296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.543 [2024-11-21 03:39:22.055755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.543 [2024-11-21 03:39:22.055771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.543 [2024-11-21 03:39:22.055785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.543 [2024-11-21 03:39:22.055801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.543 [2024-11-21 03:39:22.055815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.543 [2024-11-21 03:39:22.055831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.543 [2024-11-21 03:39:22.055845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.543 [2024-11-21 03:39:22.055860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.543 [2024-11-21 03:39:22.055874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.543 [2024-11-21 03:39:22.055890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.543 [2024-11-21 03:39:22.055904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.543 [2024-11-21 03:39:22.055919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.543 [2024-11-21 03:39:22.055934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.543 [2024-11-21 03:39:22.055949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.543 [2024-11-21 03:39:22.055964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.543 [2024-11-21 03:39:22.055979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.543 [2024-11-21 03:39:22.055993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.543 [2024-11-21 03:39:22.056013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.543 [2024-11-21 03:39:22.056027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.543 [2024-11-21 03:39:22.056043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.543 [2024-11-21 03:39:22.056063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.543 [2024-11-21 03:39:22.056107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.543 [2024-11-21 03:39:22.056122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.543 [2024-11-21 03:39:22.056139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.543 [2024-11-21 03:39:22.056154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.543 [2024-11-21 03:39:22.056170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.543 [2024-11-21 03:39:22.056185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.543 [2024-11-21 03:39:22.056201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.543 [2024-11-21 03:39:22.056216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.543 [2024-11-21 03:39:22.056232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.543 [2024-11-21 03:39:22.056247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.543 [2024-11-21 03:39:22.056264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.543 [2024-11-21 03:39:22.056279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.543 [2024-11-21 03:39:22.056296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.543 [2024-11-21 03:39:22.056310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.543 [2024-11-21 03:39:22.056326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.543 [2024-11-21 03:39:22.056341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.543 [2024-11-21 03:39:22.056367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.543 [2024-11-21 03:39:22.056381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.543 [2024-11-21 03:39:22.056398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.543 [2024-11-21 03:39:22.056413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.543 [2024-11-21 03:39:22.056476] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe970d0 is same with the state(5) to be set 00:22:41.543 [2024-11-21 03:39:22.056513] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe970d0 is same with the state(5) to be set 00:22:41.543 [2024-11-21 03:39:22.056517] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x2086550 was disconnected and freed. reset controller. 00:22:41.543 [2024-11-21 03:39:22.056528] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe970d0 is same with the state(5) to be set 00:22:41.543 [2024-11-21 03:39:22.056540] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe970d0 is same with the state(5) to be set 00:22:41.543 [2024-11-21 03:39:22.056552] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe970d0 is same with the state(5) to be set 00:22:41.543 [2024-11-21 03:39:22.056564] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe970d0 is same with the state(5) to be set 00:22:41.543 [2024-11-21 03:39:22.056576] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe970d0 is same with the state(5) to be set 00:22:41.543 [2024-11-21 03:39:22.056588] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe970d0 is same with the state(5) to be set 00:22:41.543 [2024-11-21 03:39:22.056599] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe970d0 is same with the state(5) to be set 00:22:41.543 [2024-11-21 03:39:22.056611] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe970d0 is same with the state(5) to be set 00:22:41.543 [2024-11-21 03:39:22.056623] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe970d0 is same with the state(5) to be set 00:22:41.543 [2024-11-21 03:39:22.056656] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe970d0 is same with the state(5) to be set 00:22:41.543 [2024-11-21 03:39:22.056674] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe970d0 is same with the state(5) to be set 00:22:41.543 [2024-11-21 03:39:22.056687] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe970d0 is same with the state(5) to be set 00:22:41.543 [2024-11-21 03:39:22.056698] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe970d0 is same with the state(5) to be set 00:22:41.543 [2024-11-21 03:39:22.056710] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe970d0 is same with the state(5) to be set 00:22:41.543 [2024-11-21 03:39:22.056722] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe970d0 is same with the state(5) to be set 00:22:41.543 [2024-11-21 03:39:22.056734] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe970d0 is same with the state(5) to be set 00:22:41.543 [2024-11-21 03:39:22.056747] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe970d0 is same with the state(5) to be set 00:22:41.543 [2024-11-21 03:39:22.056759] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe970d0 is same with the state(5) to be set 00:22:41.543 [2024-11-21 03:39:22.056771] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe970d0 is same with the state(5) to be set 00:22:41.543 [2024-11-21 03:39:22.056783] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe970d0 is same with the state(5) to be set 00:22:41.543 [2024-11-21 03:39:22.056795] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe970d0 is same with the state(5) to be set 00:22:41.543 [2024-11-21 03:39:22.056807] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe970d0 is same with the state(5) to be set 00:22:41.543 [2024-11-21 03:39:22.056818] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe970d0 is same with the state(5) to be set 00:22:41.543 [2024-11-21 03:39:22.056830] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe970d0 is same with the state(5) to be set 00:22:41.544 [2024-11-21 03:39:22.056842] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe970d0 is same with the state(5) to be set 00:22:41.544 [2024-11-21 03:39:22.056859] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe970d0 is same with the state(5) to be set 00:22:41.544 [2024-11-21 03:39:22.056871] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe970d0 is same with the state(5) to be set 00:22:41.544 [2024-11-21 03:39:22.056883] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe970d0 is same with the state(5) to be set 00:22:41.544 [2024-11-21 03:39:22.056895] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe970d0 is same with the state(5) to be set 00:22:41.544 [2024-11-21 03:39:22.056907] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe970d0 is same with the state(5) to be set 00:22:41.544 [2024-11-21 03:39:22.056929] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe970d0 is same with the state(5) to be set 00:22:41.544 [2024-11-21 03:39:22.056944] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe970d0 is same with the state(5) to be set 00:22:41.544 [2024-11-21 03:39:22.056956] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe970d0 is same with the state(5) to be set 00:22:41.544 [2024-11-21 03:39:22.056968] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe970d0 is same with the state(5) to be set 00:22:41.544 [2024-11-21 03:39:22.056979] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe970d0 is same with the state(5) to be set 00:22:41.544 [2024-11-21 03:39:22.056991] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe970d0 is same with the state(5) to be set 00:22:41.544 [2024-11-21 03:39:22.057003] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe970d0 is same with the state(5) to be set 00:22:41.544 [2024-11-21 03:39:22.057015] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe970d0 is same with the state(5) to be set 00:22:41.544 [2024-11-21 03:39:22.057027] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe970d0 is same with the state(5) to be set 00:22:41.544 [2024-11-21 03:39:22.057040] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe970d0 is same with the state(5) to be set 00:22:41.544 [2024-11-21 03:39:22.057083] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe970d0 is same with the state(5) to be set 00:22:41.544 [2024-11-21 03:39:22.057099] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe970d0 is same with the state(5) to be set 00:22:41.544 [2024-11-21 03:39:22.057111] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe970d0 is same with the state(5) to be set 00:22:41.544 [2024-11-21 03:39:22.057123] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe970d0 is same with the state(5) to be set 00:22:41.544 [2024-11-21 03:39:22.057135] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe970d0 is same with the state(5) to be set 00:22:41.544 [2024-11-21 03:39:22.057148] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe970d0 is same with the state(5) to be set 00:22:41.544 [2024-11-21 03:39:22.057159] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe970d0 is same with the state(5) to be set 00:22:41.544 [2024-11-21 03:39:22.057171] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe970d0 is same with the state(5) to be set 00:22:41.544 [2024-11-21 03:39:22.057183] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe970d0 is same with the state(5) to be set 00:22:41.544 [2024-11-21 03:39:22.057194] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe970d0 is same with the state(5) to be set 00:22:41.544 [2024-11-21 03:39:22.057197] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 ns[2024-11-21 03:39:22.057206] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe970d0 is same with tid:0 cdw10:00000000 cdw11:00000000 00:22:41.544 he state(5) to be set 00:22:41.544 [2024-11-21 03:39:22.057223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 c[2024-11-21 03:39:22.057225] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe970d0 is same with tdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.544 he state(5) to be set 00:22:41.544 [2024-11-21 03:39:22.057241] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe970d0 is same with the state(5) to be set 00:22:41.544 [2024-11-21 03:39:22.057242] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:41.544 [2024-11-21 03:39:22.057255] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe970d0 is same with the state(5) to be set 00:22:41.544 [2024-11-21 03:39:22.057258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.544 [2024-11-21 03:39:22.057267] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe970d0 is same with the state(5) to be set 00:22:41.544 [2024-11-21 03:39:22.057273] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:41.544 [2024-11-21 03:39:22.057280] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe970d0 is same with the state(5) to be set 00:22:41.544 [2024-11-21 03:39:22.057287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.544 [2024-11-21 03:39:22.057292] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe970d0 is same with the state(5) to be set 00:22:41.544 [2024-11-21 03:39:22.057302] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:41.544 [2024-11-21 03:39:22.057305] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe970d0 is same with the state(5) to be set 00:22:41.544 [2024-11-21 03:39:22.057316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 c[2024-11-21 03:39:22.057318] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe970d0 is same with tdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.544 he state(5) to be set 00:22:41.544 [2024-11-21 03:39:22.057332] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe970d0 is same with t[2024-11-21 03:39:22.057332] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x20b81b0 is same he state(5) to be set 00:22:41.544 with the state(5) to be set 00:22:41.544 [2024-11-21 03:39:22.057346] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe970d0 is same with the state(5) to be set 00:22:41.544 [2024-11-21 03:39:22.057389] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:41.544 [2024-11-21 03:39:22.057411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.544 [2024-11-21 03:39:22.057431] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:41.544 [2024-11-21 03:39:22.057445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.544 [2024-11-21 03:39:22.057460] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:41.544 [2024-11-21 03:39:22.057474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.544 [2024-11-21 03:39:22.057491] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:41.544 [2024-11-21 03:39:22.057506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.544 [2024-11-21 03:39:22.057520] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x225c600 is same with the state(5) to be set 00:22:41.544 [2024-11-21 03:39:22.057565] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:41.544 [2024-11-21 03:39:22.057586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.544 [2024-11-21 03:39:22.057604] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:41.544 [2024-11-21 03:39:22.057619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.544 [2024-11-21 03:39:22.057634] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:41.544 [2024-11-21 03:39:22.057648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.544 [2024-11-21 03:39:22.057663] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:41.544 [2024-11-21 03:39:22.057678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.544 [2024-11-21 03:39:22.057691] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x20c1690 is same with the state(5) to be set 00:22:41.545 [2024-11-21 03:39:22.057748] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:41.545 [2024-11-21 03:39:22.057770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.545 [2024-11-21 03:39:22.057786] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:41.545 [2024-11-21 03:39:22.057801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.545 [2024-11-21 03:39:22.057817] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:41.545 [2024-11-21 03:39:22.057831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.545 [2024-11-21 03:39:22.057846] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:41.545 [2024-11-21 03:39:22.057861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.545 [2024-11-21 03:39:22.057875] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x20ee590 is same with the state(5) to be set 00:22:41.545 [2024-11-21 03:39:22.058662] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97580 is same with the state(5) to be set 00:22:41.545 [2024-11-21 03:39:22.058692] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97580 is same with the state(5) to be set 00:22:41.545 [2024-11-21 03:39:22.058706] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97580 is same with the state(5) to be set 00:22:41.545 [2024-11-21 03:39:22.058719] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97580 is same with the state(5) to be set 00:22:41.545 [2024-11-21 03:39:22.058731] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97580 is same with the state(5) to be set 00:22:41.545 [2024-11-21 03:39:22.058744] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97580 is same with the state(5) to be set 00:22:41.545 [2024-11-21 03:39:22.058755] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97580 is same with the state(5) to be set 00:22:41.545 [2024-11-21 03:39:22.058768] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97580 is same with the state(5) to be set 00:22:41.545 [2024-11-21 03:39:22.058786] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97580 is same with the state(5) to be set 00:22:41.545 [2024-11-21 03:39:22.058799] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97580 is same with the state(5) to be set 00:22:41.545 [2024-11-21 03:39:22.058811] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97580 is same with the state(5) to be set 00:22:41.545 [2024-11-21 03:39:22.058823] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97580 is same with the state(5) to be set 00:22:41.545 [2024-11-21 03:39:22.058835] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97580 is same with the state(5) to be set 00:22:41.545 [2024-11-21 03:39:22.058847] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97580 is same with the state(5) to be set 00:22:41.545 [2024-11-21 03:39:22.058860] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97580 is same with the state(5) to be set 00:22:41.545 [2024-11-21 03:39:22.058873] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97580 is same with the state(5) to be set 00:22:41.545 [2024-11-21 03:39:22.058885] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97580 is same with the state(5) to be set 00:22:41.545 [2024-11-21 03:39:22.058897] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97580 is same with the state(5) to be set 00:22:41.545 [2024-11-21 03:39:22.058909] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97580 is same with the state(5) to be set 00:22:41.545 [2024-11-21 03:39:22.058921] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97580 is same with the state(5) to be set 00:22:41.545 [2024-11-21 03:39:22.058933] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97580 is same with the state(5) to be set 00:22:41.545 [2024-11-21 03:39:22.058945] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97580 is same with the state(5) to be set 00:22:41.545 [2024-11-21 03:39:22.058957] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97580 is same with the state(5) to be set 00:22:41.545 [2024-11-21 03:39:22.058969] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97580 is same with the state(5) to be set 00:22:41.545 [2024-11-21 03:39:22.058981] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97580 is same with the state(5) to be set 00:22:41.545 [2024-11-21 03:39:22.058993] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97580 is same with the state(5) to be set 00:22:41.545 [2024-11-21 03:39:22.059005] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97580 is same with the state(5) to be set 00:22:41.545 [2024-11-21 03:39:22.059016] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97580 is same with the state(5) to be set 00:22:41.545 [2024-11-21 03:39:22.059028] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97580 is same with the state(5) to be set 00:22:41.545 [2024-11-21 03:39:22.059040] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97580 is same with the state(5) to be set 00:22:41.545 [2024-11-21 03:39:22.059063] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97580 is same with the state(5) to be set 00:22:41.545 [2024-11-21 03:39:22.059084] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97580 is same with the state(5) to be set 00:22:41.545 [2024-11-21 03:39:22.059097] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97580 is same with the state(5) to be set 00:22:41.545 [2024-11-21 03:39:22.059109] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97580 is same with the state(5) to be set 00:22:41.545 [2024-11-21 03:39:22.059121] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97580 is same with the state(5) to be set 00:22:41.545 [2024-11-21 03:39:22.059138] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97580 is same with the state(5) to be set 00:22:41.545 [2024-11-21 03:39:22.059150] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97580 is same with the state(5) to be set 00:22:41.545 [2024-11-21 03:39:22.059162] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97580 is same with the state(5) to be set 00:22:41.545 [2024-11-21 03:39:22.059174] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97580 is same with the state(5) to be set 00:22:41.545 [2024-11-21 03:39:22.059191] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97580 is same with the state(5) to be set 00:22:41.545 [2024-11-21 03:39:22.059204] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97580 is same with the state(5) to be set 00:22:41.545 [2024-11-21 03:39:22.059216] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97580 is same with the state(5) to be set 00:22:41.545 [2024-11-21 03:39:22.059232] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97580 is same with the state(5) to be set 00:22:41.545 [2024-11-21 03:39:22.059244] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97580 is same with the state(5) to be set 00:22:41.545 [2024-11-21 03:39:22.059256] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97580 is same with the state(5) to be set 00:22:41.545 [2024-11-21 03:39:22.059269] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97580 is same with the state(5) to be set 00:22:41.545 [2024-11-21 03:39:22.059281] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97580 is same with the state(5) to be set 00:22:41.545 [2024-11-21 03:39:22.059293] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97580 is same with the state(5) to be set 00:22:41.545 [2024-11-21 03:39:22.059304] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97580 is same with the state(5) to be set 00:22:41.545 [2024-11-21 03:39:22.059316] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97580 is same with the state(5) to be set 00:22:41.545 [2024-11-21 03:39:22.059327] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97580 is same with the state(5) to be set 00:22:41.545 [2024-11-21 03:39:22.059342] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97580 is same with the state(5) to be set 00:22:41.545 [2024-11-21 03:39:22.059353] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97580 is same with the state(5) to be set 00:22:41.545 [2024-11-21 03:39:22.059364] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97580 is same with the state(5) to be set 00:22:41.545 [2024-11-21 03:39:22.059380] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97580 is same with the state(5) to be set 00:22:41.545 [2024-11-21 03:39:22.059407] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97580 is same with the state(5) to be set 00:22:41.545 [2024-11-21 03:39:22.059432] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97580 is same with the state(5) to be set 00:22:41.545 [2024-11-21 03:39:22.059455] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97580 is same with the state(5) to be set 00:22:41.545 [2024-11-21 03:39:22.059477] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97580 is same with the state(5) to be set 00:22:41.546 [2024-11-21 03:39:22.059492] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97580 is same with the state(5) to be set 00:22:41.546 [2024-11-21 03:39:22.059508] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97580 is same with the state(5) to be set 00:22:41.546 [2024-11-21 03:39:22.059529] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97580 is same with the state(5) to be set 00:22:41.546 [2024-11-21 03:39:22.059570] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:41.546 [2024-11-21 03:39:22.059557] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97580 is same with the state(5) to be set 00:22:41.546 [2024-11-21 03:39:22.059604] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode2] resetting controller 00:22:41.546 [2024-11-21 03:39:22.059637] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x225c600 (9): Bad file descriptor 00:22:41.546 [2024-11-21 03:39:22.060676] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97a30 is same with the state(5) to be set 00:22:41.546 [2024-11-21 03:39:22.060706] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97a30 is same with the state(5) to be set 00:22:41.546 [2024-11-21 03:39:22.060720] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97a30 is same with the state(5) to be set 00:22:41.546 [2024-11-21 03:39:22.060733] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97a30 is same with the state(5) to be set 00:22:41.546 [2024-11-21 03:39:22.060750] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97a30 is same with the state(5) to be set 00:22:41.546 [2024-11-21 03:39:22.060765] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97a30 is same with the state(5) to be set 00:22:41.546 [2024-11-21 03:39:22.060778] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97a30 is same with the state(5) to be set 00:22:41.546 [2024-11-21 03:39:22.060790] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97a30 is same with the state(5) to be set 00:22:41.546 [2024-11-21 03:39:22.060802] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97a30 is same with the state(5) to be set 00:22:41.546 [2024-11-21 03:39:22.060814] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97a30 is same with the state(5) to be set 00:22:41.546 [2024-11-21 03:39:22.060827] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97a30 is same with the state(5) to be set 00:22:41.546 [2024-11-21 03:39:22.060839] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97a30 is same with the state(5) to be set 00:22:41.546 [2024-11-21 03:39:22.060851] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97a30 is same with the state(5) to be set 00:22:41.546 [2024-11-21 03:39:22.060863] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97a30 is same with the state(5) to be set 00:22:41.546 [2024-11-21 03:39:22.060875] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97a30 is same with the state(5) to be set 00:22:41.546 [2024-11-21 03:39:22.060887] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97a30 is same with the state(5) to be set 00:22:41.546 [2024-11-21 03:39:22.060900] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97a30 is same with the state(5) to be set 00:22:41.546 [2024-11-21 03:39:22.060911] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97a30 is same with the state(5) to be set 00:22:41.546 [2024-11-21 03:39:22.060923] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97a30 is same with the state(5) to be set 00:22:41.546 [2024-11-21 03:39:22.060935] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97a30 is same with the state(5) to be set 00:22:41.546 [2024-11-21 03:39:22.060947] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97a30 is same with the state(5) to be set 00:22:41.546 [2024-11-21 03:39:22.060960] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97a30 is same with the state(5) to be set 00:22:41.546 [2024-11-21 03:39:22.060971] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97a30 is same with the state(5) to be set 00:22:41.546 [2024-11-21 03:39:22.060983] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97a30 is same with the state(5) to be set 00:22:41.546 [2024-11-21 03:39:22.061002] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97a30 is same with the state(5) to be set 00:22:41.546 [2024-11-21 03:39:22.061015] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97a30 is same with the state(5) to be set 00:22:41.546 [2024-11-21 03:39:22.061027] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97a30 is same with the state(5) to be set 00:22:41.546 [2024-11-21 03:39:22.061039] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97a30 is same with the state(5) to be set 00:22:41.546 [2024-11-21 03:39:22.061061] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97a30 is same with the state(5) to be set 00:22:41.546 [2024-11-21 03:39:22.061081] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97a30 is same with the state(5) to be set 00:22:41.546 [2024-11-21 03:39:22.061096] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97a30 is same with the state(5) to be set 00:22:41.546 [2024-11-21 03:39:22.061108] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97a30 is same with the state(5) to be set 00:22:41.546 [2024-11-21 03:39:22.061120] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97a30 is same with the state(5) to be set 00:22:41.546 [2024-11-21 03:39:22.061133] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97a30 is same with the state(5) to be set 00:22:41.546 [2024-11-21 03:39:22.061145] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97a30 is same with the state(5) to be set 00:22:41.546 [2024-11-21 03:39:22.061157] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97a30 is same with the state(5) to be set 00:22:41.546 [2024-11-21 03:39:22.061169] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97a30 is same with the state(5) to be set 00:22:41.546 [2024-11-21 03:39:22.061181] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97a30 is same with the state(5) to be set 00:22:41.546 [2024-11-21 03:39:22.061193] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97a30 is same with the state(5) to be set 00:22:41.546 [2024-11-21 03:39:22.061205] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97a30 is same with the state(5) to be set 00:22:41.546 [2024-11-21 03:39:22.061216] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97a30 is same with the state(5) to be set 00:22:41.546 [2024-11-21 03:39:22.061229] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97a30 is same with the state(5) to be set 00:22:41.546 [2024-11-21 03:39:22.061241] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97a30 is same with the state(5) to be set 00:22:41.546 [2024-11-21 03:39:22.061252] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97a30 is same with the state(5) to be set 00:22:41.546 [2024-11-21 03:39:22.061263] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97a30 is same with the state(5) to be set 00:22:41.546 [2024-11-21 03:39:22.061275] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97a30 is same with the state(5) to be set 00:22:41.547 [2024-11-21 03:39:22.061287] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97a30 is same with the state(5) to be set 00:22:41.547 [2024-11-21 03:39:22.061298] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97a30 is same with the state(5) to be set 00:22:41.547 [2024-11-21 03:39:22.061310] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97a30 is same with the state(5) to be set 00:22:41.547 [2024-11-21 03:39:22.061322] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97a30 is same with the state(5) to be set 00:22:41.547 [2024-11-21 03:39:22.061333] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97a30 is same with the state(5) to be set 00:22:41.547 [2024-11-21 03:39:22.061359] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97a30 is same with the state(5) to be set 00:22:41.547 [2024-11-21 03:39:22.061372] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97a30 is same with the state(5) to be set 00:22:41.547 [2024-11-21 03:39:22.061384] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97a30 is same with the state(5) to be set 00:22:41.547 [2024-11-21 03:39:22.061396] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97a30 is same with the state(5) to be set 00:22:41.547 [2024-11-21 03:39:22.061407] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97a30 is same with the state(5) to be set 00:22:41.547 [2024-11-21 03:39:22.061424] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97a30 is same with the state(5) to be set 00:22:41.547 [2024-11-21 03:39:22.061436] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97a30 is same with the state(5) to be set 00:22:41.547 [2024-11-21 03:39:22.061447] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97a30 is same with the state(5) to be set 00:22:41.547 [2024-11-21 03:39:22.061458] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97a30 is same with the state(5) to be set 00:22:41.547 [2024-11-21 03:39:22.061470] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97a30 is same with the state(5) to be set 00:22:41.547 [2024-11-21 03:39:22.061482] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97a30 is same with the state(5) to be set 00:22:41.547 [2024-11-21 03:39:22.061494] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97a30 is same with the state(5) to be set 00:22:41.547 [2024-11-21 03:39:22.061890] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:41.547 [2024-11-21 03:39:22.062427] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:41.547 [2024-11-21 03:39:22.063795] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:41.547 [2024-11-21 03:39:22.064469] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:41.547 [2024-11-21 03:39:22.066309] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97ec0 is same with the state(5) to be set 00:22:41.547 [2024-11-21 03:39:22.066344] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97ec0 is same with the state(5) to be set 00:22:41.547 [2024-11-21 03:39:22.066363] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97ec0 is same with the state(5) to be set 00:22:41.547 [2024-11-21 03:39:22.066376] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97ec0 is same with the state(5) to be set 00:22:41.547 [2024-11-21 03:39:22.066388] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97ec0 is same with the state(5) to be set 00:22:41.547 [2024-11-21 03:39:22.066405] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97ec0 is same with the state(5) to be set 00:22:41.547 [2024-11-21 03:39:22.066428] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97ec0 is same with the state(5) to be set 00:22:41.547 [2024-11-21 03:39:22.066440] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97ec0 is same with the state(5) to be set 00:22:41.547 [2024-11-21 03:39:22.066451] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97ec0 is same with the state(5) to be set 00:22:41.547 [2024-11-21 03:39:22.066463] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97ec0 is same with the state(5) to be set 00:22:41.547 [2024-11-21 03:39:22.066476] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97ec0 is same with the state(5) to be set 00:22:41.547 [2024-11-21 03:39:22.066487] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97ec0 is same with the state(5) to be set 00:22:41.547 [2024-11-21 03:39:22.066499] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97ec0 is same with the state(5) to be set 00:22:41.547 [2024-11-21 03:39:22.066517] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97ec0 is same with the state(5) to be set 00:22:41.547 [2024-11-21 03:39:22.066531] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97ec0 is same with the state(5) to be set 00:22:41.547 [2024-11-21 03:39:22.066543] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97ec0 is same with the state(5) to be set 00:22:41.547 [2024-11-21 03:39:22.066555] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97ec0 is same with the state(5) to be set 00:22:41.547 [2024-11-21 03:39:22.066567] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97ec0 is same with the state(5) to be set 00:22:41.547 [2024-11-21 03:39:22.066579] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97ec0 is same with the state(5) to be set 00:22:41.547 [2024-11-21 03:39:22.066594] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe97ec0 is same with the state(5) to be set 00:22:41.547 [2024-11-21 03:39:22.067313] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98370 is same with the state(5) to be set 00:22:41.547 [2024-11-21 03:39:22.067345] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98370 is same with the state(5) to be set 00:22:41.547 [2024-11-21 03:39:22.067372] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98370 is same with the state(5) to be set 00:22:41.547 [2024-11-21 03:39:22.067370] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:41.547 [2024-11-21 03:39:22.067384] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98370 is same with the state(5) to be set 00:22:41.547 [2024-11-21 03:39:22.067397] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98370 is same with the state(5) to be set 00:22:41.547 [2024-11-21 03:39:22.067398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.547 [2024-11-21 03:39:22.067408] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98370 is same with the state(5) to be set 00:22:41.547 [2024-11-21 03:39:22.067428] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98370 is same with t[2024-11-21 03:39:22.067427] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nshe state(5) to be set 00:22:41.547 id:0 cdw10:00000000 cdw11:00000000 00:22:41.547 [2024-11-21 03:39:22.067443] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98370 is same with the state(5) to be set 00:22:41.547 [2024-11-21 03:39:22.067445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.547 [2024-11-21 03:39:22.067456] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98370 is same with the state(5) to be set 00:22:41.547 [2024-11-21 03:39:22.067461] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:41.547 [2024-11-21 03:39:22.067468] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98370 is same with the state(5) to be set 00:22:41.547 [2024-11-21 03:39:22.067476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.547 [2024-11-21 03:39:22.067481] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98370 is same with the state(5) to be set 00:22:41.547 [2024-11-21 03:39:22.067491] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 ns[2024-11-21 03:39:22.067492] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98370 is same with tid:0 cdw10:00000000 cdw11:00000000 00:22:41.547 he state(5) to be set 00:22:41.547 [2024-11-21 03:39:22.067507] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98370 is same with t[2024-11-21 03:39:22.067507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 che state(5) to be set 00:22:41.547 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.547 [2024-11-21 03:39:22.067526] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98370 is same with the state(5) to be set 00:22:41.547 [2024-11-21 03:39:22.067528] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224c150 is same with the state(5) to be set 00:22:41.547 [2024-11-21 03:39:22.067540] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98370 is same with the state(5) to be set 00:22:41.547 [2024-11-21 03:39:22.067552] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98370 is same with the state(5) to be set 00:22:41.547 [2024-11-21 03:39:22.067564] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98370 is same with the state(5) to be set 00:22:41.548 [2024-11-21 03:39:22.067576] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98370 is same with the state(5) to be set 00:22:41.548 [2024-11-21 03:39:22.067581] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 ns[2024-11-21 03:39:22.067588] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98370 is same with tid:0 cdw10:00000000 cdw11:00000000 00:22:41.548 he state(5) to be set 00:22:41.548 [2024-11-21 03:39:22.067602] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98370 is same with the state(5) to be set 00:22:41.548 [2024-11-21 03:39:22.067604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.548 [2024-11-21 03:39:22.067621] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:41.548 [2024-11-21 03:39:22.067636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.548 [2024-11-21 03:39:22.067651] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:41.548 [2024-11-21 03:39:22.067665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.548 [2024-11-21 03:39:22.067680] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:41.548 [2024-11-21 03:39:22.067694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.548 [2024-11-21 03:39:22.067709] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2246a60 is same with the state(5) to be set 00:22:41.548 [2024-11-21 03:39:22.067755] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:41.548 [2024-11-21 03:39:22.067775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.548 [2024-11-21 03:39:22.067791] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:41.548 [2024-11-21 03:39:22.067805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.548 [2024-11-21 03:39:22.067820] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:41.548 [2024-11-21 03:39:22.067834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.548 [2024-11-21 03:39:22.067848] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:41.548 [2024-11-21 03:39:22.067862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.548 [2024-11-21 03:39:22.067881] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224bc70 is same with the state(5) to be set 00:22:41.548 [2024-11-21 03:39:22.067912] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x20b81b0 (9): Bad file descriptor 00:22:41.548 [2024-11-21 03:39:22.067945] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x20c1690 (9): Bad file descriptor 00:22:41.548 [2024-11-21 03:39:22.067992] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 ns[2024-11-21 03:39:22.067987] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98820 is same with tid:0 cdw10:00000000 cdw11:00000000 00:22:41.548 he state(5) to be set 00:22:41.548 [2024-11-21 03:39:22.068017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.548 [2024-11-21 03:39:22.068020] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98820 is same with the state(5) to be set 00:22:41.548 [2024-11-21 03:39:22.068032] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:41.548 [2024-11-21 03:39:22.068035] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98820 is same with the state(5) to be set 00:22:41.548 [2024-11-21 03:39:22.068047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 c[2024-11-21 03:39:22.068048] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98820 is same with tdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.548 he state(5) to be set 00:22:41.548 [2024-11-21 03:39:22.068065] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98820 is same with the state(5) to be set 00:22:41.548 [2024-11-21 03:39:22.068074] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:41.548 [2024-11-21 03:39:22.068088] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98820 is same with the state(5) to be set 00:22:41.548 [2024-11-21 03:39:22.068091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.548 [2024-11-21 03:39:22.068102] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98820 is same with the state(5) to be set 00:22:41.548 [2024-11-21 03:39:22.068106] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:41.548 [2024-11-21 03:39:22.068114] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98820 is same with the state(5) to be set 00:22:41.548 [2024-11-21 03:39:22.068121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.548 [2024-11-21 03:39:22.068127] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98820 is same with the state(5) to be set 00:22:41.548 [2024-11-21 03:39:22.068135] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22370a0 is same with the state(5) to be set 00:22:41.548 [2024-11-21 03:39:22.068139] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98820 is same with the state(5) to be set 00:22:41.548 [2024-11-21 03:39:22.068151] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98820 is same with the state(5) to be set 00:22:41.548 [2024-11-21 03:39:22.068163] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98820 is same with the state(5) to be set 00:22:41.548 [2024-11-21 03:39:22.068163] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x20ee590 (9): Bad file descriptor 00:22:41.548 [2024-11-21 03:39:22.068175] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98820 is same with the state(5) to be set 00:22:41.548 [2024-11-21 03:39:22.068193] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98820 is same with the state(5) to be set 00:22:41.548 [2024-11-21 03:39:22.068207] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98820 is same with the state(5) to be set 00:22:41.548 [2024-11-21 03:39:22.068218] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98820 is same with the state(5) to be set 00:22:41.548 [2024-11-21 03:39:22.068230] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98820 is same with the state(5) to be set 00:22:41.548 [2024-11-21 03:39:22.068242] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98820 is same with the state(5) to be set 00:22:41.548 [2024-11-21 03:39:22.068254] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98820 is same with the state(5) to be set 00:22:41.548 [2024-11-21 03:39:22.068266] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe98820 is same with the state(5) to be set 00:22:41.548 [2024-11-21 03:39:22.068734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.548 [2024-11-21 03:39:22.068759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.548 [2024-11-21 03:39:22.068782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.548 [2024-11-21 03:39:22.068799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.548 [2024-11-21 03:39:22.068816] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22e83e0 is same with the state(5) to be set 00:22:41.548 [2024-11-21 03:39:22.068891] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x22e83e0 was disconnected and freed. reset controller. 00:22:41.548 [2024-11-21 03:39:22.070143] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode7] resetting controller 00:22:41.548 [2024-11-21 03:39:22.070195] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2246a60 (9): Bad file descriptor 00:22:41.548 [2024-11-21 03:39:22.070252] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:3 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:22:41.548 [2024-11-21 03:39:22.070273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.548 [2024-11-21 03:39:22.070289] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2095f70 is same with the state(5) to be set 00:22:41.548 [2024-11-21 03:39:22.070490] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2095f70 (9): Bad file descriptor 00:22:41.549 [2024-11-21 03:39:22.070860] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:41.549 [2024-11-21 03:39:22.070936] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:41.549 [2024-11-21 03:39:22.071131] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:41.549 [2024-11-21 03:39:22.071155] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:41.549 [2024-11-21 03:39:22.071173] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:41.549 [2024-11-21 03:39:22.071270] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:41.549 [2024-11-21 03:39:22.071528] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2246a60 (9): Bad file descriptor 00:22:41.549 [2024-11-21 03:39:22.071557] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x225c600 (9): Bad file descriptor 00:22:41.549 [2024-11-21 03:39:22.071613] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode7] Ctrlr is in error state 00:22:41.549 [2024-11-21 03:39:22.071633] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode7] controller reinitialization failed 00:22:41.549 [2024-11-21 03:39:22.071654] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode7] in failed state. 00:22:41.549 [2024-11-21 03:39:22.071675] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:22:41.549 [2024-11-21 03:39:22.071691] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode2] controller reinitialization failed 00:22:41.549 [2024-11-21 03:39:22.071705] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:22:41.549 [2024-11-21 03:39:22.071763] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:41.549 [2024-11-21 03:39:22.071782] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:41.549 [2024-11-21 03:39:22.072398] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:41.549 [2024-11-21 03:39:22.072582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:41.549 [2024-11-21 03:39:22.072684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:41.549 [2024-11-21 03:39:22.072711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2095f70 with addr=10.0.0.2, port=4420 00:22:41.549 [2024-11-21 03:39:22.072728] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2095f70 is same with the state(5) to be set 00:22:41.549 [2024-11-21 03:39:22.072787] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2095f70 (9): Bad file descriptor 00:22:41.549 [2024-11-21 03:39:22.072870] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:41.549 [2024-11-21 03:39:22.072892] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:41.549 [2024-11-21 03:39:22.072907] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:41.549 [2024-11-21 03:39:22.072965] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:41.549 [2024-11-21 03:39:22.077362] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x224c150 (9): Bad file descriptor 00:22:41.549 [2024-11-21 03:39:22.077429] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x224bc70 (9): Bad file descriptor 00:22:41.549 [2024-11-21 03:39:22.077479] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x22370a0 (9): Bad file descriptor 00:22:41.549 [2024-11-21 03:39:22.077557] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:41.549 [2024-11-21 03:39:22.077582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.549 [2024-11-21 03:39:22.077600] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:41.549 [2024-11-21 03:39:22.077615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.549 [2024-11-21 03:39:22.077631] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:41.549 [2024-11-21 03:39:22.077645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.549 [2024-11-21 03:39:22.077660] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:41.549 [2024-11-21 03:39:22.077674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.549 [2024-11-21 03:39:22.077688] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x20e3490 is same with the state(5) to be set 00:22:41.549 [2024-11-21 03:39:22.077838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:34816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.549 [2024-11-21 03:39:22.077863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.549 [2024-11-21 03:39:22.077890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.549 [2024-11-21 03:39:22.077907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.549 [2024-11-21 03:39:22.077926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:35072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.549 [2024-11-21 03:39:22.077942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.549 [2024-11-21 03:39:22.077959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.549 [2024-11-21 03:39:22.077974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.549 [2024-11-21 03:39:22.077991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.549 [2024-11-21 03:39:22.078007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.549 [2024-11-21 03:39:22.078024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.549 [2024-11-21 03:39:22.078039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.549 [2024-11-21 03:39:22.078063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.549 [2024-11-21 03:39:22.078085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.549 [2024-11-21 03:39:22.078103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.549 [2024-11-21 03:39:22.078119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.549 [2024-11-21 03:39:22.078136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.549 [2024-11-21 03:39:22.078150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.549 [2024-11-21 03:39:22.078167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.549 [2024-11-21 03:39:22.078182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.549 [2024-11-21 03:39:22.078199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.549 [2024-11-21 03:39:22.078214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.549 [2024-11-21 03:39:22.078231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.549 [2024-11-21 03:39:22.078246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.549 [2024-11-21 03:39:22.078263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.549 [2024-11-21 03:39:22.078287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.549 [2024-11-21 03:39:22.078306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.549 [2024-11-21 03:39:22.078321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.549 [2024-11-21 03:39:22.078338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:35456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.549 [2024-11-21 03:39:22.078362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.550 [2024-11-21 03:39:22.078379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.550 [2024-11-21 03:39:22.078394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.550 [2024-11-21 03:39:22.078411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.550 [2024-11-21 03:39:22.078426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.550 [2024-11-21 03:39:22.078443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.550 [2024-11-21 03:39:22.078458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.550 [2024-11-21 03:39:22.078475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.550 [2024-11-21 03:39:22.078490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.550 [2024-11-21 03:39:22.078506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.550 [2024-11-21 03:39:22.078521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.550 [2024-11-21 03:39:22.078539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.550 [2024-11-21 03:39:22.078554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.550 [2024-11-21 03:39:22.078571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.550 [2024-11-21 03:39:22.078586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.550 [2024-11-21 03:39:22.078603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.550 [2024-11-21 03:39:22.078618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.550 [2024-11-21 03:39:22.078635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.550 [2024-11-21 03:39:22.078650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.550 [2024-11-21 03:39:22.078667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.550 [2024-11-21 03:39:22.078681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.550 [2024-11-21 03:39:22.078703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.550 [2024-11-21 03:39:22.078719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.550 [2024-11-21 03:39:22.078736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.550 [2024-11-21 03:39:22.078751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.550 [2024-11-21 03:39:22.078768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.550 [2024-11-21 03:39:22.078783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.550 [2024-11-21 03:39:22.078802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.550 [2024-11-21 03:39:22.078817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.550 [2024-11-21 03:39:22.078834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.550 [2024-11-21 03:39:22.078849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.550 [2024-11-21 03:39:22.078866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:35968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.550 [2024-11-21 03:39:22.078881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.550 [2024-11-21 03:39:22.078898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.550 [2024-11-21 03:39:22.078912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.550 [2024-11-21 03:39:22.078930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.550 [2024-11-21 03:39:22.078945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.550 [2024-11-21 03:39:22.078962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:36352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.550 [2024-11-21 03:39:22.078977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.550 [2024-11-21 03:39:22.078994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.550 [2024-11-21 03:39:22.079009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.550 [2024-11-21 03:39:22.079026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.550 [2024-11-21 03:39:22.079040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.550 [2024-11-21 03:39:22.079067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.550 [2024-11-21 03:39:22.079090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.550 [2024-11-21 03:39:22.079107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.550 [2024-11-21 03:39:22.079127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.550 [2024-11-21 03:39:22.079145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.550 [2024-11-21 03:39:22.079161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.550 [2024-11-21 03:39:22.079178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.550 [2024-11-21 03:39:22.079193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.550 [2024-11-21 03:39:22.079210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.550 [2024-11-21 03:39:22.079225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.550 [2024-11-21 03:39:22.079243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.550 [2024-11-21 03:39:22.079258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.550 [2024-11-21 03:39:22.079275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.550 [2024-11-21 03:39:22.079290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.550 [2024-11-21 03:39:22.079307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:37632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.550 [2024-11-21 03:39:22.079322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.550 [2024-11-21 03:39:22.079339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.550 [2024-11-21 03:39:22.079360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.550 [2024-11-21 03:39:22.079377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.550 [2024-11-21 03:39:22.079392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.550 [2024-11-21 03:39:22.079409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.550 [2024-11-21 03:39:22.079424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.550 [2024-11-21 03:39:22.079441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:38144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.550 [2024-11-21 03:39:22.079456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.550 [2024-11-21 03:39:22.079472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:38272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.551 [2024-11-21 03:39:22.079487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.551 [2024-11-21 03:39:22.079505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.551 [2024-11-21 03:39:22.079520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.551 [2024-11-21 03:39:22.079536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.551 [2024-11-21 03:39:22.079555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.551 [2024-11-21 03:39:22.079572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.551 [2024-11-21 03:39:22.079588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.551 [2024-11-21 03:39:22.079605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.551 [2024-11-21 03:39:22.079620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.551 [2024-11-21 03:39:22.079636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.551 [2024-11-21 03:39:22.079651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.551 [2024-11-21 03:39:22.079668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.551 [2024-11-21 03:39:22.079683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.551 [2024-11-21 03:39:22.079699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.551 [2024-11-21 03:39:22.079714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.551 [2024-11-21 03:39:22.079731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:39296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.551 [2024-11-21 03:39:22.079746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.551 [2024-11-21 03:39:22.079763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.551 [2024-11-21 03:39:22.079778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.551 [2024-11-21 03:39:22.079795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.551 [2024-11-21 03:39:22.079810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.551 [2024-11-21 03:39:22.079828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.551 [2024-11-21 03:39:22.079843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.551 [2024-11-21 03:39:22.079860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.551 [2024-11-21 03:39:22.079874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.551 [2024-11-21 03:39:22.079891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.551 [2024-11-21 03:39:22.079905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.551 [2024-11-21 03:39:22.079922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.551 [2024-11-21 03:39:22.079937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.551 [2024-11-21 03:39:22.079958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.551 [2024-11-21 03:39:22.079973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.551 [2024-11-21 03:39:22.079988] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22221a0 is same with the state(5) to be set 00:22:41.551 [2024-11-21 03:39:22.081279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:34816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.551 [2024-11-21 03:39:22.081304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.551 [2024-11-21 03:39:22.081325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.551 [2024-11-21 03:39:22.081342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.551 [2024-11-21 03:39:22.081366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:35072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.551 [2024-11-21 03:39:22.081381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.551 [2024-11-21 03:39:22.081398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.551 [2024-11-21 03:39:22.081413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.551 [2024-11-21 03:39:22.081431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.551 [2024-11-21 03:39:22.081445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.551 [2024-11-21 03:39:22.081462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.551 [2024-11-21 03:39:22.081477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.551 [2024-11-21 03:39:22.081494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.551 [2024-11-21 03:39:22.081509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.551 [2024-11-21 03:39:22.081526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.551 [2024-11-21 03:39:22.081540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.551 [2024-11-21 03:39:22.081558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.551 [2024-11-21 03:39:22.081573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.551 [2024-11-21 03:39:22.081590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.551 [2024-11-21 03:39:22.081604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.551 [2024-11-21 03:39:22.081621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.551 [2024-11-21 03:39:22.081636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.551 [2024-11-21 03:39:22.081658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.551 [2024-11-21 03:39:22.081673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.551 [2024-11-21 03:39:22.081690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.551 [2024-11-21 03:39:22.081704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.551 [2024-11-21 03:39:22.081722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.551 [2024-11-21 03:39:22.081737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.551 [2024-11-21 03:39:22.081754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.551 [2024-11-21 03:39:22.081769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.551 [2024-11-21 03:39:22.081786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.551 [2024-11-21 03:39:22.081800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.552 [2024-11-21 03:39:22.081817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.552 [2024-11-21 03:39:22.081832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.552 [2024-11-21 03:39:22.081849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.552 [2024-11-21 03:39:22.081863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.552 [2024-11-21 03:39:22.081880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.552 [2024-11-21 03:39:22.081896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.552 [2024-11-21 03:39:22.081913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:35456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.552 [2024-11-21 03:39:22.081927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.552 [2024-11-21 03:39:22.081944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.552 [2024-11-21 03:39:22.081958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.552 [2024-11-21 03:39:22.081975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.552 [2024-11-21 03:39:22.081990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.552 [2024-11-21 03:39:22.082007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.552 [2024-11-21 03:39:22.082022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.552 [2024-11-21 03:39:22.082038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.552 [2024-11-21 03:39:22.082058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.552 [2024-11-21 03:39:22.082084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.552 [2024-11-21 03:39:22.082101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.552 [2024-11-21 03:39:22.082118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.552 [2024-11-21 03:39:22.082133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.552 [2024-11-21 03:39:22.082150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.552 [2024-11-21 03:39:22.082165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.552 [2024-11-21 03:39:22.082182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.552 [2024-11-21 03:39:22.082197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.552 [2024-11-21 03:39:22.082214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.552 [2024-11-21 03:39:22.082229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.552 [2024-11-21 03:39:22.082247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.552 [2024-11-21 03:39:22.082262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.552 [2024-11-21 03:39:22.082279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:35968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.552 [2024-11-21 03:39:22.082294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.552 [2024-11-21 03:39:22.082311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.552 [2024-11-21 03:39:22.082326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.552 [2024-11-21 03:39:22.082343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.552 [2024-11-21 03:39:22.082358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.552 [2024-11-21 03:39:22.082374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:36352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.552 [2024-11-21 03:39:22.082389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.552 [2024-11-21 03:39:22.082406] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.552 [2024-11-21 03:39:22.082421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.552 [2024-11-21 03:39:22.082438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.552 [2024-11-21 03:39:22.082452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.552 [2024-11-21 03:39:22.082473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.552 [2024-11-21 03:39:22.082489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.552 [2024-11-21 03:39:22.082506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.552 [2024-11-21 03:39:22.082521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.552 [2024-11-21 03:39:22.082537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.552 [2024-11-21 03:39:22.082553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.552 [2024-11-21 03:39:22.082571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.552 [2024-11-21 03:39:22.082586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.552 [2024-11-21 03:39:22.082603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.552 [2024-11-21 03:39:22.082618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.552 [2024-11-21 03:39:22.082635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.552 [2024-11-21 03:39:22.082649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.553 [2024-11-21 03:39:22.082667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.553 [2024-11-21 03:39:22.082682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.553 [2024-11-21 03:39:22.082698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:37632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.553 [2024-11-21 03:39:22.082713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.553 [2024-11-21 03:39:22.082729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.553 [2024-11-21 03:39:22.082744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.553 [2024-11-21 03:39:22.082760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.553 [2024-11-21 03:39:22.082774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.553 [2024-11-21 03:39:22.082791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.553 [2024-11-21 03:39:22.082806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.553 [2024-11-21 03:39:22.082822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:38144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.553 [2024-11-21 03:39:22.082837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.553 [2024-11-21 03:39:22.082854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:38272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.553 [2024-11-21 03:39:22.082872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.553 [2024-11-21 03:39:22.082889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.553 [2024-11-21 03:39:22.082904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.553 [2024-11-21 03:39:22.082921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.553 [2024-11-21 03:39:22.082936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.553 [2024-11-21 03:39:22.082952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.553 [2024-11-21 03:39:22.082967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.553 [2024-11-21 03:39:22.082983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.553 [2024-11-21 03:39:22.082998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.553 [2024-11-21 03:39:22.083015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.553 [2024-11-21 03:39:22.083030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.553 [2024-11-21 03:39:22.083046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.553 [2024-11-21 03:39:22.083061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.553 [2024-11-21 03:39:22.083084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.553 [2024-11-21 03:39:22.083100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.553 [2024-11-21 03:39:22.083117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:39296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.553 [2024-11-21 03:39:22.083132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.553 [2024-11-21 03:39:22.083148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.553 [2024-11-21 03:39:22.083163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.553 [2024-11-21 03:39:22.083181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.553 [2024-11-21 03:39:22.083196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.553 [2024-11-21 03:39:22.083213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.553 [2024-11-21 03:39:22.083230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.553 [2024-11-21 03:39:22.083246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.553 [2024-11-21 03:39:22.083261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.553 [2024-11-21 03:39:22.083282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.553 [2024-11-21 03:39:22.083297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.553 [2024-11-21 03:39:22.083314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.553 [2024-11-21 03:39:22.083328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.553 [2024-11-21 03:39:22.083345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.553 [2024-11-21 03:39:22.083359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.553 [2024-11-21 03:39:22.083374] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22236f0 is same with the state(5) to be set 00:22:41.553 [2024-11-21 03:39:22.084632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.553 [2024-11-21 03:39:22.084658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.553 [2024-11-21 03:39:22.084682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.553 [2024-11-21 03:39:22.084699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.553 [2024-11-21 03:39:22.084716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.553 [2024-11-21 03:39:22.084732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.553 [2024-11-21 03:39:22.084749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.553 [2024-11-21 03:39:22.084764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.553 [2024-11-21 03:39:22.084781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.553 [2024-11-21 03:39:22.084795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.553 [2024-11-21 03:39:22.084813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.553 [2024-11-21 03:39:22.084828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.553 [2024-11-21 03:39:22.084845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.553 [2024-11-21 03:39:22.084860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.553 [2024-11-21 03:39:22.084876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.553 [2024-11-21 03:39:22.084891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.554 [2024-11-21 03:39:22.084908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.554 [2024-11-21 03:39:22.084923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.554 [2024-11-21 03:39:22.084945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.554 [2024-11-21 03:39:22.084961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.554 [2024-11-21 03:39:22.084978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.554 [2024-11-21 03:39:22.084993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.554 [2024-11-21 03:39:22.085011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.554 [2024-11-21 03:39:22.085026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.554 [2024-11-21 03:39:22.085042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.554 [2024-11-21 03:39:22.085057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.554 [2024-11-21 03:39:22.085086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.554 [2024-11-21 03:39:22.085103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.554 [2024-11-21 03:39:22.085121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.554 [2024-11-21 03:39:22.085143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.554 [2024-11-21 03:39:22.085160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.554 [2024-11-21 03:39:22.085175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.554 [2024-11-21 03:39:22.085191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.554 [2024-11-21 03:39:22.085206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.554 [2024-11-21 03:39:22.085223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.554 [2024-11-21 03:39:22.085238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.554 [2024-11-21 03:39:22.085254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.554 [2024-11-21 03:39:22.085269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.554 [2024-11-21 03:39:22.085286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.554 [2024-11-21 03:39:22.085301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.554 [2024-11-21 03:39:22.085318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.554 [2024-11-21 03:39:22.085333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.554 [2024-11-21 03:39:22.085349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.554 [2024-11-21 03:39:22.085369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.554 [2024-11-21 03:39:22.085387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.554 [2024-11-21 03:39:22.085402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.554 [2024-11-21 03:39:22.085420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.554 [2024-11-21 03:39:22.085435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.554 [2024-11-21 03:39:22.085461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.554 [2024-11-21 03:39:22.085476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.554 [2024-11-21 03:39:22.085492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.554 [2024-11-21 03:39:22.085507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.554 [2024-11-21 03:39:22.085524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.554 [2024-11-21 03:39:22.085538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.554 [2024-11-21 03:39:22.085555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.554 [2024-11-21 03:39:22.085572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.554 [2024-11-21 03:39:22.085589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.554 [2024-11-21 03:39:22.085604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.554 [2024-11-21 03:39:22.085620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.554 [2024-11-21 03:39:22.085635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.554 [2024-11-21 03:39:22.085653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.554 [2024-11-21 03:39:22.085667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.554 [2024-11-21 03:39:22.085684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.554 [2024-11-21 03:39:22.085699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.554 [2024-11-21 03:39:22.085716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.554 [2024-11-21 03:39:22.085731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.554 [2024-11-21 03:39:22.085747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.554 [2024-11-21 03:39:22.085763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.554 [2024-11-21 03:39:22.085784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.554 [2024-11-21 03:39:22.085800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.554 [2024-11-21 03:39:22.085817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.554 [2024-11-21 03:39:22.085832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.554 [2024-11-21 03:39:22.085849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.554 [2024-11-21 03:39:22.085864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.554 [2024-11-21 03:39:22.085880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.554 [2024-11-21 03:39:22.085896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.554 [2024-11-21 03:39:22.085913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.554 [2024-11-21 03:39:22.085927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.554 [2024-11-21 03:39:22.085944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.554 [2024-11-21 03:39:22.085960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.554 [2024-11-21 03:39:22.085976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.555 [2024-11-21 03:39:22.085991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.555 [2024-11-21 03:39:22.086008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.555 [2024-11-21 03:39:22.086023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.555 [2024-11-21 03:39:22.086040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.555 [2024-11-21 03:39:22.086055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.555 [2024-11-21 03:39:22.086077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.555 [2024-11-21 03:39:22.086094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.555 [2024-11-21 03:39:22.086111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.555 [2024-11-21 03:39:22.086126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.555 [2024-11-21 03:39:22.086144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.555 [2024-11-21 03:39:22.086158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.555 [2024-11-21 03:39:22.086175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.555 [2024-11-21 03:39:22.086194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.555 [2024-11-21 03:39:22.086211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.555 [2024-11-21 03:39:22.086227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.555 [2024-11-21 03:39:22.086244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.555 [2024-11-21 03:39:22.086259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.555 [2024-11-21 03:39:22.086276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.555 [2024-11-21 03:39:22.086291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.555 [2024-11-21 03:39:22.086308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.555 [2024-11-21 03:39:22.086323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.555 [2024-11-21 03:39:22.086340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.555 [2024-11-21 03:39:22.086356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.555 [2024-11-21 03:39:22.086373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.555 [2024-11-21 03:39:22.086387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.555 [2024-11-21 03:39:22.086404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.555 [2024-11-21 03:39:22.086419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.555 [2024-11-21 03:39:22.086435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.555 [2024-11-21 03:39:22.086450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.555 [2024-11-21 03:39:22.086467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.555 [2024-11-21 03:39:22.086481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.555 [2024-11-21 03:39:22.086498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.555 [2024-11-21 03:39:22.086512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.555 [2024-11-21 03:39:22.086529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.555 [2024-11-21 03:39:22.086543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.555 [2024-11-21 03:39:22.086562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.555 [2024-11-21 03:39:22.086577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.555 [2024-11-21 03:39:22.086598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:34816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.555 [2024-11-21 03:39:22.086614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.555 [2024-11-21 03:39:22.086630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.555 [2024-11-21 03:39:22.086645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.555 [2024-11-21 03:39:22.086663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.555 [2024-11-21 03:39:22.086678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.555 [2024-11-21 03:39:22.086695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.555 [2024-11-21 03:39:22.086710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.555 [2024-11-21 03:39:22.086726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.555 [2024-11-21 03:39:22.086741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.555 [2024-11-21 03:39:22.086756] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22ec580 is same with the state(5) to be set 00:22:41.555 [2024-11-21 03:39:22.088968] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:22:41.555 [2024-11-21 03:39:22.089004] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:22:41.555 [2024-11-21 03:39:22.089025] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode10] resetting controller 00:22:41.555 [2024-11-21 03:39:22.089177] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x20e3490 (9): Bad file descriptor 00:22:41.555 [2024-11-21 03:39:22.089587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:41.555 [2024-11-21 03:39:22.089722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:41.555 [2024-11-21 03:39:22.089750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b81b0 with addr=10.0.0.2, port=4420 00:22:41.555 [2024-11-21 03:39:22.089769] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x20b81b0 is same with the state(5) to be set 00:22:41.555 [2024-11-21 03:39:22.089875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:41.555 [2024-11-21 03:39:22.089977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:41.555 [2024-11-21 03:39:22.090003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20c1690 with addr=10.0.0.2, port=4420 00:22:41.555 [2024-11-21 03:39:22.090020] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x20c1690 is same with the state(5) to be set 00:22:41.555 [2024-11-21 03:39:22.090122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:41.555 [2024-11-21 03:39:22.090232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:41.555 [2024-11-21 03:39:22.090259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20ee590 with addr=10.0.0.2, port=4420 00:22:41.555 [2024-11-21 03:39:22.090275] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x20ee590 is same with the state(5) to be set 00:22:41.555 [2024-11-21 03:39:22.090868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:34816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.556 [2024-11-21 03:39:22.090900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.556 [2024-11-21 03:39:22.090923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.556 [2024-11-21 03:39:22.090941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.556 [2024-11-21 03:39:22.090958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:35072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.556 [2024-11-21 03:39:22.090974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.556 [2024-11-21 03:39:22.090991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.556 [2024-11-21 03:39:22.091006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.556 [2024-11-21 03:39:22.091023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.556 [2024-11-21 03:39:22.091038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.556 [2024-11-21 03:39:22.091055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.556 [2024-11-21 03:39:22.091078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.556 [2024-11-21 03:39:22.091097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.556 [2024-11-21 03:39:22.091112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.556 [2024-11-21 03:39:22.091128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.556 [2024-11-21 03:39:22.091143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.556 [2024-11-21 03:39:22.091160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.556 [2024-11-21 03:39:22.091175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.556 [2024-11-21 03:39:22.091192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.556 [2024-11-21 03:39:22.091207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.556 [2024-11-21 03:39:22.091223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.556 [2024-11-21 03:39:22.091238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.556 [2024-11-21 03:39:22.091255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.556 [2024-11-21 03:39:22.091270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.556 [2024-11-21 03:39:22.091286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.556 [2024-11-21 03:39:22.091301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.556 [2024-11-21 03:39:22.091317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.556 [2024-11-21 03:39:22.091337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.556 [2024-11-21 03:39:22.091355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.556 [2024-11-21 03:39:22.091369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.556 [2024-11-21 03:39:22.091386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.556 [2024-11-21 03:39:22.091401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.556 [2024-11-21 03:39:22.091417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:35456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.556 [2024-11-21 03:39:22.091432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.556 [2024-11-21 03:39:22.091449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.556 [2024-11-21 03:39:22.091463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.556 [2024-11-21 03:39:22.091480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.556 [2024-11-21 03:39:22.091495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.556 [2024-11-21 03:39:22.091512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.556 [2024-11-21 03:39:22.091527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.556 [2024-11-21 03:39:22.091543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.556 [2024-11-21 03:39:22.091558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.556 [2024-11-21 03:39:22.091575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:35968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.556 [2024-11-21 03:39:22.091590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.556 [2024-11-21 03:39:22.091607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.556 [2024-11-21 03:39:22.091621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.556 [2024-11-21 03:39:22.091639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.556 [2024-11-21 03:39:22.091654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.556 [2024-11-21 03:39:22.091671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.556 [2024-11-21 03:39:22.091686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.556 [2024-11-21 03:39:22.091702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.556 [2024-11-21 03:39:22.091717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.556 [2024-11-21 03:39:22.091738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.556 [2024-11-21 03:39:22.091754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.556 [2024-11-21 03:39:22.091771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.556 [2024-11-21 03:39:22.091786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.556 [2024-11-21 03:39:22.091802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.556 [2024-11-21 03:39:22.091817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.556 [2024-11-21 03:39:22.091834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.556 [2024-11-21 03:39:22.091849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.556 [2024-11-21 03:39:22.091866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.556 [2024-11-21 03:39:22.091880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.556 [2024-11-21 03:39:22.091897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.556 [2024-11-21 03:39:22.091912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.556 [2024-11-21 03:39:22.091929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.556 [2024-11-21 03:39:22.091944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.557 [2024-11-21 03:39:22.091961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:36352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.557 [2024-11-21 03:39:22.091975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.557 [2024-11-21 03:39:22.091992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.557 [2024-11-21 03:39:22.092007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.557 [2024-11-21 03:39:22.092024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.557 [2024-11-21 03:39:22.092039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.557 [2024-11-21 03:39:22.092056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.557 [2024-11-21 03:39:22.092089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.557 [2024-11-21 03:39:22.092107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.557 [2024-11-21 03:39:22.092123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.557 [2024-11-21 03:39:22.092139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.557 [2024-11-21 03:39:22.092158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.557 [2024-11-21 03:39:22.092176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.557 [2024-11-21 03:39:22.092191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.557 [2024-11-21 03:39:22.092208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.557 [2024-11-21 03:39:22.092224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.557 [2024-11-21 03:39:22.092240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.557 [2024-11-21 03:39:22.092255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.557 [2024-11-21 03:39:22.092272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.557 [2024-11-21 03:39:22.092286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.557 [2024-11-21 03:39:22.092303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:37632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.557 [2024-11-21 03:39:22.092317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.557 [2024-11-21 03:39:22.092334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.557 [2024-11-21 03:39:22.092349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.557 [2024-11-21 03:39:22.092365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.557 [2024-11-21 03:39:22.092380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.557 [2024-11-21 03:39:22.092396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.557 [2024-11-21 03:39:22.092411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.557 [2024-11-21 03:39:22.092427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:38144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.557 [2024-11-21 03:39:22.092442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.557 [2024-11-21 03:39:22.092458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:38272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.557 [2024-11-21 03:39:22.092473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.557 [2024-11-21 03:39:22.092490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.557 [2024-11-21 03:39:22.092504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.557 [2024-11-21 03:39:22.092521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.557 [2024-11-21 03:39:22.092536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.557 [2024-11-21 03:39:22.092558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.557 [2024-11-21 03:39:22.092573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.557 [2024-11-21 03:39:22.092590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.557 [2024-11-21 03:39:22.092605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.557 [2024-11-21 03:39:22.092621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.557 [2024-11-21 03:39:22.092636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.557 [2024-11-21 03:39:22.092653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.557 [2024-11-21 03:39:22.092668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.557 [2024-11-21 03:39:22.092684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.557 [2024-11-21 03:39:22.092699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.557 [2024-11-21 03:39:22.092715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:39296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.557 [2024-11-21 03:39:22.092730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.557 [2024-11-21 03:39:22.092747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.557 [2024-11-21 03:39:22.092762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.557 [2024-11-21 03:39:22.092779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.557 [2024-11-21 03:39:22.092793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.557 [2024-11-21 03:39:22.092809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.557 [2024-11-21 03:39:22.092824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.557 [2024-11-21 03:39:22.092840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.558 [2024-11-21 03:39:22.092855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.558 [2024-11-21 03:39:22.092872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.558 [2024-11-21 03:39:22.092886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.558 [2024-11-21 03:39:22.092902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.558 [2024-11-21 03:39:22.092917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.558 [2024-11-21 03:39:22.092934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.558 [2024-11-21 03:39:22.092953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.558 [2024-11-21 03:39:22.092969] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22e5950 is same with the state(5) to be set 00:22:41.558 [2024-11-21 03:39:22.094201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:34816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.558 [2024-11-21 03:39:22.094225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.558 [2024-11-21 03:39:22.094247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.558 [2024-11-21 03:39:22.094264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.558 [2024-11-21 03:39:22.094281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:35072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.558 [2024-11-21 03:39:22.094296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.558 [2024-11-21 03:39:22.094313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.558 [2024-11-21 03:39:22.094328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.558 [2024-11-21 03:39:22.094344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.558 [2024-11-21 03:39:22.094359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.558 [2024-11-21 03:39:22.094376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.558 [2024-11-21 03:39:22.094390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.558 [2024-11-21 03:39:22.094407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.558 [2024-11-21 03:39:22.094422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.558 [2024-11-21 03:39:22.094438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.558 [2024-11-21 03:39:22.094452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.558 [2024-11-21 03:39:22.094469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.558 [2024-11-21 03:39:22.094484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.558 [2024-11-21 03:39:22.094501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:35456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.558 [2024-11-21 03:39:22.094515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.558 [2024-11-21 03:39:22.094531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.558 [2024-11-21 03:39:22.094546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.558 [2024-11-21 03:39:22.094563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.558 [2024-11-21 03:39:22.094582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.558 [2024-11-21 03:39:22.094600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.558 [2024-11-21 03:39:22.094615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.558 [2024-11-21 03:39:22.094632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.558 [2024-11-21 03:39:22.094646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.558 [2024-11-21 03:39:22.094663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.558 [2024-11-21 03:39:22.094678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.558 [2024-11-21 03:39:22.094694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.558 [2024-11-21 03:39:22.094709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.558 [2024-11-21 03:39:22.094726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.558 [2024-11-21 03:39:22.094741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.558 [2024-11-21 03:39:22.094758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.558 [2024-11-21 03:39:22.094772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.558 [2024-11-21 03:39:22.094789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.558 [2024-11-21 03:39:22.094803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.558 [2024-11-21 03:39:22.094820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.558 [2024-11-21 03:39:22.094835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.558 [2024-11-21 03:39:22.094851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.558 [2024-11-21 03:39:22.094866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.558 [2024-11-21 03:39:22.094882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.558 [2024-11-21 03:39:22.094897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.558 [2024-11-21 03:39:22.094914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.558 [2024-11-21 03:39:22.094929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.558 [2024-11-21 03:39:22.094946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.558 [2024-11-21 03:39:22.094960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.558 [2024-11-21 03:39:22.094981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.558 [2024-11-21 03:39:22.094996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.558 [2024-11-21 03:39:22.095014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.558 [2024-11-21 03:39:22.095028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.558 [2024-11-21 03:39:22.095045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.558 [2024-11-21 03:39:22.095059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.558 [2024-11-21 03:39:22.095083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:35968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.558 [2024-11-21 03:39:22.095099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.558 [2024-11-21 03:39:22.095116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.559 [2024-11-21 03:39:22.095131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.559 [2024-11-21 03:39:22.095148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.559 [2024-11-21 03:39:22.095163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.559 [2024-11-21 03:39:22.095181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.559 [2024-11-21 03:39:22.095195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.559 [2024-11-21 03:39:22.095211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.559 [2024-11-21 03:39:22.095226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.559 [2024-11-21 03:39:22.095243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.559 [2024-11-21 03:39:22.095258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.559 [2024-11-21 03:39:22.095275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:36352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.559 [2024-11-21 03:39:22.095290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.559 [2024-11-21 03:39:22.095307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.559 [2024-11-21 03:39:22.095321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.559 [2024-11-21 03:39:22.095338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.559 [2024-11-21 03:39:22.095354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.559 [2024-11-21 03:39:22.095371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.559 [2024-11-21 03:39:22.095389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.559 [2024-11-21 03:39:22.095407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.559 [2024-11-21 03:39:22.095423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.559 [2024-11-21 03:39:22.095440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.559 [2024-11-21 03:39:22.095454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.559 [2024-11-21 03:39:22.095471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.559 [2024-11-21 03:39:22.095486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.559 [2024-11-21 03:39:22.095503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.559 [2024-11-21 03:39:22.095518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.559 [2024-11-21 03:39:22.095535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.559 [2024-11-21 03:39:22.095550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.559 [2024-11-21 03:39:22.095567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.559 [2024-11-21 03:39:22.095581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.559 [2024-11-21 03:39:22.095598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:37632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.559 [2024-11-21 03:39:22.095613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.559 [2024-11-21 03:39:22.095630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.559 [2024-11-21 03:39:22.095644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.559 [2024-11-21 03:39:22.095660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.559 [2024-11-21 03:39:22.095676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.559 [2024-11-21 03:39:22.095693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.559 [2024-11-21 03:39:22.095707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.559 [2024-11-21 03:39:22.095723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:38144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.559 [2024-11-21 03:39:22.095738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.559 [2024-11-21 03:39:22.095755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:38272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.559 [2024-11-21 03:39:22.095770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.559 [2024-11-21 03:39:22.095790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.559 [2024-11-21 03:39:22.095806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.559 [2024-11-21 03:39:22.095822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.559 [2024-11-21 03:39:22.095837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.559 [2024-11-21 03:39:22.095853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.559 [2024-11-21 03:39:22.095868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.559 [2024-11-21 03:39:22.095884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.559 [2024-11-21 03:39:22.095899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.559 [2024-11-21 03:39:22.095915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.559 [2024-11-21 03:39:22.095930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.559 [2024-11-21 03:39:22.095946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.559 [2024-11-21 03:39:22.095961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.559 [2024-11-21 03:39:22.095977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.559 [2024-11-21 03:39:22.095992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.559 [2024-11-21 03:39:22.096009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:39296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.559 [2024-11-21 03:39:22.096025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.559 [2024-11-21 03:39:22.096042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.559 [2024-11-21 03:39:22.096058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.559 [2024-11-21 03:39:22.096081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.559 [2024-11-21 03:39:22.096098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.560 [2024-11-21 03:39:22.096115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.560 [2024-11-21 03:39:22.096129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.560 [2024-11-21 03:39:22.096146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.560 [2024-11-21 03:39:22.096161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.560 [2024-11-21 03:39:22.096177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.560 [2024-11-21 03:39:22.096196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.560 [2024-11-21 03:39:22.096213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.560 [2024-11-21 03:39:22.096228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.560 [2024-11-21 03:39:22.096244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.560 [2024-11-21 03:39:22.096259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.560 [2024-11-21 03:39:22.096275] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22e6e00 is same with the state(5) to be set 00:22:41.560 [2024-11-21 03:39:22.097481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.560 [2024-11-21 03:39:22.097505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.560 [2024-11-21 03:39:22.097527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.560 [2024-11-21 03:39:22.097543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.560 [2024-11-21 03:39:22.097561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.560 [2024-11-21 03:39:22.097576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.560 [2024-11-21 03:39:22.097597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.560 [2024-11-21 03:39:22.097612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.560 [2024-11-21 03:39:22.097628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.560 [2024-11-21 03:39:22.097643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.560 [2024-11-21 03:39:22.097660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.560 [2024-11-21 03:39:22.097675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.560 [2024-11-21 03:39:22.097691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.560 [2024-11-21 03:39:22.097706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.560 [2024-11-21 03:39:22.097728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.560 [2024-11-21 03:39:22.097742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.560 [2024-11-21 03:39:22.097758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.560 [2024-11-21 03:39:22.097773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.560 [2024-11-21 03:39:22.097791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.560 [2024-11-21 03:39:22.097813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.560 [2024-11-21 03:39:22.097831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.560 [2024-11-21 03:39:22.097846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.560 [2024-11-21 03:39:22.097863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.560 [2024-11-21 03:39:22.097878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.560 [2024-11-21 03:39:22.097894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.560 [2024-11-21 03:39:22.097909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.560 [2024-11-21 03:39:22.097926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.560 [2024-11-21 03:39:22.097941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.560 [2024-11-21 03:39:22.097958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.560 [2024-11-21 03:39:22.097972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.560 [2024-11-21 03:39:22.097989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.560 [2024-11-21 03:39:22.098004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.560 [2024-11-21 03:39:22.098020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.560 [2024-11-21 03:39:22.098035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.560 [2024-11-21 03:39:22.098052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.560 [2024-11-21 03:39:22.098090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.560 [2024-11-21 03:39:22.098110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.560 [2024-11-21 03:39:22.098125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.560 [2024-11-21 03:39:22.098141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.560 [2024-11-21 03:39:22.098156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.560 [2024-11-21 03:39:22.098173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.560 [2024-11-21 03:39:22.098188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.560 [2024-11-21 03:39:22.098203] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22e99c0 is same with the state(5) to be set 00:22:41.560 [2024-11-21 03:39:22.099525] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode2] resetting controller 00:22:41.560 [2024-11-21 03:39:22.099564] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode7] resetting controller 00:22:41.560 [2024-11-21 03:39:22.099594] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:41.560 [2024-11-21 03:39:22.099613] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode5] resetting controller 00:22:41.560 [2024-11-21 03:39:22.099631] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode6] resetting controller 00:22:41.560 [2024-11-21 03:39:22.099705] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x20b81b0 (9): Bad file descriptor 00:22:41.560 [2024-11-21 03:39:22.099731] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x20c1690 (9): Bad file descriptor 00:22:41.560 [2024-11-21 03:39:22.099751] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x20ee590 (9): Bad file descriptor 00:22:41.561 [2024-11-21 03:39:22.099805] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:41.561 [2024-11-21 03:39:22.099843] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:41.561 [2024-11-21 03:39:22.099866] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:41.561 [2024-11-21 03:39:22.099888] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:41.561 [2024-11-21 03:39:22.099986] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode8] resetting controller 00:22:41.561 [2024-11-21 03:39:22.100247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:41.561 [2024-11-21 03:39:22.100362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:41.561 [2024-11-21 03:39:22.100389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x225c600 with addr=10.0.0.2, port=4420 00:22:41.561 [2024-11-21 03:39:22.100406] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x225c600 is same with the state(5) to be set 00:22:41.561 [2024-11-21 03:39:22.100501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:41.561 [2024-11-21 03:39:22.100613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:41.561 [2024-11-21 03:39:22.100639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2246a60 with addr=10.0.0.2, port=4420 00:22:41.561 [2024-11-21 03:39:22.100655] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2246a60 is same with the state(5) to be set 00:22:41.561 [2024-11-21 03:39:22.100753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:41.561 [2024-11-21 03:39:22.100855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:41.561 [2024-11-21 03:39:22.100881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2095f70 with addr=10.0.0.2, port=4420 00:22:41.561 [2024-11-21 03:39:22.100897] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2095f70 is same with the state(5) to be set 00:22:41.561 [2024-11-21 03:39:22.100999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:41.561 [2024-11-21 03:39:22.101115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:41.561 [2024-11-21 03:39:22.101141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x224c150 with addr=10.0.0.2, port=4420 00:22:41.561 [2024-11-21 03:39:22.101158] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224c150 is same with the state(5) to be set 00:22:41.561 [2024-11-21 03:39:22.101245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:41.561 [2024-11-21 03:39:22.101345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:41.561 [2024-11-21 03:39:22.101370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x22370a0 with addr=10.0.0.2, port=4420 00:22:41.561 [2024-11-21 03:39:22.101387] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22370a0 is same with the state(5) to be set 00:22:41.561 [2024-11-21 03:39:22.101408] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode3] Ctrlr is in error state 00:22:41.561 [2024-11-21 03:39:22.101423] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode3] controller reinitialization failed 00:22:41.561 [2024-11-21 03:39:22.101440] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:22:41.561 [2024-11-21 03:39:22.101460] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode4] Ctrlr is in error state 00:22:41.561 [2024-11-21 03:39:22.101475] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode4] controller reinitialization failed 00:22:41.561 [2024-11-21 03:39:22.101489] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:22:41.561 [2024-11-21 03:39:22.101507] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode10] Ctrlr is in error state 00:22:41.561 [2024-11-21 03:39:22.101522] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode10] controller reinitialization failed 00:22:41.561 [2024-11-21 03:39:22.101536] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode10] in failed state. 00:22:41.561 [2024-11-21 03:39:22.102403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.561 [2024-11-21 03:39:22.102428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.561 [2024-11-21 03:39:22.102454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.561 [2024-11-21 03:39:22.102471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.561 [2024-11-21 03:39:22.102489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.561 [2024-11-21 03:39:22.102504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.561 [2024-11-21 03:39:22.102521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.561 [2024-11-21 03:39:22.102536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.561 [2024-11-21 03:39:22.102553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.561 [2024-11-21 03:39:22.102568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.561 [2024-11-21 03:39:22.102585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.561 [2024-11-21 03:39:22.102600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.561 [2024-11-21 03:39:22.102616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.561 [2024-11-21 03:39:22.102631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.561 [2024-11-21 03:39:22.102648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.561 [2024-11-21 03:39:22.102663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.561 [2024-11-21 03:39:22.102679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.561 [2024-11-21 03:39:22.102705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.561 [2024-11-21 03:39:22.102722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.561 [2024-11-21 03:39:22.102738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.561 [2024-11-21 03:39:22.102755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.561 [2024-11-21 03:39:22.102769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.561 [2024-11-21 03:39:22.102786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.561 [2024-11-21 03:39:22.102801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.561 [2024-11-21 03:39:22.102818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.561 [2024-11-21 03:39:22.102832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.561 [2024-11-21 03:39:22.102849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.561 [2024-11-21 03:39:22.102864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.561 [2024-11-21 03:39:22.102881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.561 [2024-11-21 03:39:22.102896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.561 [2024-11-21 03:39:22.102912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.561 [2024-11-21 03:39:22.102927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.561 [2024-11-21 03:39:22.102944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.561 [2024-11-21 03:39:22.102959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.561 [2024-11-21 03:39:22.102976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.561 [2024-11-21 03:39:22.102991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.561 [2024-11-21 03:39:22.103007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.561 [2024-11-21 03:39:22.103022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.561 [2024-11-21 03:39:22.103038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.562 [2024-11-21 03:39:22.103053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.562 [2024-11-21 03:39:22.103077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.562 [2024-11-21 03:39:22.103094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.562 [2024-11-21 03:39:22.103114] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22eafa0 is same with the state(5) to be set 00:22:41.562 [2024-11-21 03:39:22.104549] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:41.562 [2024-11-21 03:39:22.104575] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:41.562 [2024-11-21 03:39:22.104590] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:41.562 task offset: 34816 on job bdev=Nvme1n1 fails 00:22:41.562 00:22:41.562 Latency(us) 00:22:41.562 [2024-11-21T02:39:22.210Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:41.562 [2024-11-21T02:39:22.210Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:41.562 [2024-11-21T02:39:22.210Z] Job: Nvme1n1 ended in about 0.71 seconds with error 00:22:41.562 Verification LBA range: start 0x0 length 0x400 00:22:41.562 Nvme1n1 : 0.71 354.05 22.13 90.28 0.00 143005.79 48545.19 120392.06 00:22:41.562 [2024-11-21T02:39:22.210Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:41.562 [2024-11-21T02:39:22.210Z] Job: Nvme2n1 ended in about 0.72 seconds with error 00:22:41.562 Verification LBA range: start 0x0 length 0x400 00:22:41.562 Nvme2n1 : 0.72 349.60 21.85 89.14 0.00 143335.28 49321.91 118838.61 00:22:41.562 [2024-11-21T02:39:22.210Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:41.562 [2024-11-21T02:39:22.210Z] Job: Nvme3n1 ended in about 0.74 seconds with error 00:22:41.562 Verification LBA range: start 0x0 length 0x400 00:22:41.562 Nvme3n1 : 0.74 339.17 21.20 86.48 0.00 146287.14 62914.56 118061.89 00:22:41.562 [2024-11-21T02:39:22.210Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:41.562 [2024-11-21T02:39:22.210Z] Job: Nvme4n1 ended in about 0.74 seconds with error 00:22:41.562 Verification LBA range: start 0x0 length 0x400 00:22:41.562 Nvme4n1 : 0.74 337.65 21.10 86.09 0.00 145449.39 58254.22 118061.89 00:22:41.562 [2024-11-21T02:39:22.210Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:41.562 [2024-11-21T02:39:22.210Z] Job: Nvme5n1 ended in about 0.75 seconds with error 00:22:41.562 Verification LBA range: start 0x0 length 0x400 00:22:41.562 Nvme5n1 : 0.75 333.35 20.83 85.00 0.00 145863.02 59419.31 118838.61 00:22:41.562 [2024-11-21T02:39:22.210Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:41.562 [2024-11-21T02:39:22.210Z] Job: Nvme6n1 ended in about 0.76 seconds with error 00:22:41.562 Verification LBA range: start 0x0 length 0x400 00:22:41.562 Nvme6n1 : 0.76 331.91 20.74 84.63 0.00 144995.68 52817.16 118061.89 00:22:41.562 [2024-11-21T02:39:22.210Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:41.562 [2024-11-21T02:39:22.210Z] Job: Nvme7n1 ended in about 0.73 seconds with error 00:22:41.562 Verification LBA range: start 0x0 length 0x400 00:22:41.562 Nvme7n1 : 0.73 370.42 23.15 2.74 0.00 157327.63 14951.92 121168.78 00:22:41.562 [2024-11-21T02:39:22.210Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:41.562 [2024-11-21T02:39:22.210Z] Job: Nvme8n1 ended in about 0.76 seconds with error 00:22:41.562 Verification LBA range: start 0x0 length 0x400 00:22:41.562 Nvme8n1 : 0.76 331.14 20.70 27.70 0.00 159132.19 36894.34 123498.95 00:22:41.562 [2024-11-21T02:39:22.210Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:41.562 [2024-11-21T02:39:22.210Z] Job: Nvme9n1 ended in about 0.76 seconds with error 00:22:41.562 Verification LBA range: start 0x0 length 0x400 00:22:41.562 Nvme9n1 : 0.76 329.01 20.56 27.53 0.00 158041.35 39612.87 124275.67 00:22:41.562 [2024-11-21T02:39:22.210Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:41.562 [2024-11-21T02:39:22.210Z] Job: Nvme10n1 ended in about 0.75 seconds with error 00:22:41.562 Verification LBA range: start 0x0 length 0x400 00:22:41.562 Nvme10n1 : 0.75 281.22 17.58 85.70 0.00 157583.34 33399.09 125052.40 00:22:41.562 [2024-11-21T02:39:22.210Z] =================================================================================================================== 00:22:41.562 [2024-11-21T02:39:22.210Z] Total : 3357.52 209.84 665.30 0.00 149650.03 14951.92 125052.40 00:22:41.562 [2024-11-21 03:39:22.130156] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:22:41.562 [2024-11-21 03:39:22.130240] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode9] resetting controller 00:22:41.562 [2024-11-21 03:39:22.130566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:41.562 [2024-11-21 03:39:22.130674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:41.562 [2024-11-21 03:39:22.130700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x224bc70 with addr=10.0.0.2, port=4420 00:22:41.562 [2024-11-21 03:39:22.130720] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x224bc70 is same with the state(5) to be set 00:22:41.562 [2024-11-21 03:39:22.130749] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x225c600 (9): Bad file descriptor 00:22:41.562 [2024-11-21 03:39:22.130772] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2246a60 (9): Bad file descriptor 00:22:41.562 [2024-11-21 03:39:22.130792] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2095f70 (9): Bad file descriptor 00:22:41.562 [2024-11-21 03:39:22.130812] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x224c150 (9): Bad file descriptor 00:22:41.562 [2024-11-21 03:39:22.130831] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x22370a0 (9): Bad file descriptor 00:22:41.562 [2024-11-21 03:39:22.131134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:41.562 [2024-11-21 03:39:22.131246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:41.562 [2024-11-21 03:39:22.131273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20e3490 with addr=10.0.0.2, port=4420 00:22:41.562 [2024-11-21 03:39:22.131290] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x20e3490 is same with the state(5) to be set 00:22:41.562 [2024-11-21 03:39:22.131309] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x224bc70 (9): Bad file descriptor 00:22:41.562 [2024-11-21 03:39:22.131327] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:22:41.562 [2024-11-21 03:39:22.131342] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode2] controller reinitialization failed 00:22:41.562 [2024-11-21 03:39:22.131360] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:22:41.562 [2024-11-21 03:39:22.131389] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode7] Ctrlr is in error state 00:22:41.562 [2024-11-21 03:39:22.131405] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode7] controller reinitialization failed 00:22:41.562 [2024-11-21 03:39:22.131419] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode7] in failed state. 00:22:41.562 [2024-11-21 03:39:22.131437] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:41.562 [2024-11-21 03:39:22.131453] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:41.562 [2024-11-21 03:39:22.131467] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:41.562 [2024-11-21 03:39:22.131487] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode5] Ctrlr is in error state 00:22:41.562 [2024-11-21 03:39:22.131501] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode5] controller reinitialization failed 00:22:41.562 [2024-11-21 03:39:22.131515] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode5] in failed state. 00:22:41.562 [2024-11-21 03:39:22.131532] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode6] Ctrlr is in error state 00:22:41.562 [2024-11-21 03:39:22.131547] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode6] controller reinitialization failed 00:22:41.563 [2024-11-21 03:39:22.131561] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode6] in failed state. 00:22:41.563 [2024-11-21 03:39:22.131619] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:41.563 [2024-11-21 03:39:22.131652] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:41.563 [2024-11-21 03:39:22.131673] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:41.563 [2024-11-21 03:39:22.131692] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:41.563 [2024-11-21 03:39:22.131711] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:41.563 [2024-11-21 03:39:22.131730] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:41.563 [2024-11-21 03:39:22.132101] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:41.563 [2024-11-21 03:39:22.132127] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:41.563 [2024-11-21 03:39:22.132141] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:41.563 [2024-11-21 03:39:22.132154] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:41.563 [2024-11-21 03:39:22.132167] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:41.563 [2024-11-21 03:39:22.132192] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x20e3490 (9): Bad file descriptor 00:22:41.563 [2024-11-21 03:39:22.132212] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode8] Ctrlr is in error state 00:22:41.563 [2024-11-21 03:39:22.132227] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode8] controller reinitialization failed 00:22:41.563 [2024-11-21 03:39:22.132241] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode8] in failed state. 00:22:41.563 [2024-11-21 03:39:22.132299] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode10] resetting controller 00:22:41.563 [2024-11-21 03:39:22.132324] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:22:41.563 [2024-11-21 03:39:22.132341] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:41.563 [2024-11-21 03:39:22.132381] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode9] Ctrlr is in error state 00:22:41.563 [2024-11-21 03:39:22.132398] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode9] controller reinitialization failed 00:22:41.563 [2024-11-21 03:39:22.132412] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode9] in failed state. 00:22:41.563 [2024-11-21 03:39:22.132450] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:22:41.563 [2024-11-21 03:39:22.132487] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:41.563 [2024-11-21 03:39:22.132612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:41.563 [2024-11-21 03:39:22.132719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:41.563 [2024-11-21 03:39:22.132745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20ee590 with addr=10.0.0.2, port=4420 00:22:41.563 [2024-11-21 03:39:22.132762] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x20ee590 is same with the state(5) to be set 00:22:41.563 [2024-11-21 03:39:22.132854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:41.563 [2024-11-21 03:39:22.132964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:41.563 [2024-11-21 03:39:22.132990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20c1690 with addr=10.0.0.2, port=4420 00:22:41.563 [2024-11-21 03:39:22.133006] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x20c1690 is same with the state(5) to be set 00:22:41.563 [2024-11-21 03:39:22.133207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:41.563 [2024-11-21 03:39:22.133309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:41.563 [2024-11-21 03:39:22.133341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20b81b0 with addr=10.0.0.2, port=4420 00:22:41.563 [2024-11-21 03:39:22.133359] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x20b81b0 is same with the state(5) to be set 00:22:41.563 [2024-11-21 03:39:22.133385] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x20ee590 (9): Bad file descriptor 00:22:41.563 [2024-11-21 03:39:22.133405] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x20c1690 (9): Bad file descriptor 00:22:41.563 [2024-11-21 03:39:22.133453] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x20b81b0 (9): Bad file descriptor 00:22:41.563 [2024-11-21 03:39:22.133476] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode10] Ctrlr is in error state 00:22:41.563 [2024-11-21 03:39:22.133490] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode10] controller reinitialization failed 00:22:41.563 [2024-11-21 03:39:22.133505] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode10] in failed state. 00:22:41.563 [2024-11-21 03:39:22.133522] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode4] Ctrlr is in error state 00:22:41.563 [2024-11-21 03:39:22.133537] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode4] controller reinitialization failed 00:22:41.563 [2024-11-21 03:39:22.133551] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:22:41.563 [2024-11-21 03:39:22.133589] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:41.563 [2024-11-21 03:39:22.133607] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:41.563 [2024-11-21 03:39:22.133620] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode3] Ctrlr is in error state 00:22:41.563 [2024-11-21 03:39:22.133634] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode3] controller reinitialization failed 00:22:41.563 [2024-11-21 03:39:22.133648] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:22:41.563 [2024-11-21 03:39:22.133686] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:42.134 03:39:22 -- target/shutdown.sh@135 -- # nvmfpid= 00:22:42.134 03:39:22 -- target/shutdown.sh@138 -- # sleep 1 00:22:43.074 03:39:23 -- target/shutdown.sh@141 -- # kill -9 3119324 00:22:43.074 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 141: kill: (3119324) - No such process 00:22:43.074 03:39:23 -- target/shutdown.sh@141 -- # true 00:22:43.074 03:39:23 -- target/shutdown.sh@143 -- # stoptarget 00:22:43.074 03:39:23 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:22:43.074 03:39:23 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:22:43.074 03:39:23 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:43.074 03:39:23 -- target/shutdown.sh@45 -- # nvmftestfini 00:22:43.074 03:39:23 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:43.074 03:39:23 -- nvmf/common.sh@116 -- # sync 00:22:43.074 03:39:23 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:43.074 03:39:23 -- nvmf/common.sh@119 -- # set +e 00:22:43.074 03:39:23 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:43.074 03:39:23 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:43.074 rmmod nvme_tcp 00:22:43.074 rmmod nvme_fabrics 00:22:43.074 rmmod nvme_keyring 00:22:43.074 03:39:23 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:43.074 03:39:23 -- nvmf/common.sh@123 -- # set -e 00:22:43.074 03:39:23 -- nvmf/common.sh@124 -- # return 0 00:22:43.074 03:39:23 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:22:43.074 03:39:23 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:43.074 03:39:23 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:43.074 03:39:23 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:43.074 03:39:23 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:43.074 03:39:23 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:43.074 03:39:23 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:43.074 03:39:23 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:43.074 03:39:23 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:45.677 03:39:25 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:45.677 00:22:45.677 real 0m8.078s 00:22:45.677 user 0m21.038s 00:22:45.677 sys 0m1.544s 00:22:45.677 03:39:25 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:45.677 03:39:25 -- common/autotest_common.sh@10 -- # set +x 00:22:45.677 ************************************ 00:22:45.677 END TEST nvmf_shutdown_tc3 00:22:45.677 ************************************ 00:22:45.677 03:39:25 -- target/shutdown.sh@150 -- # trap - SIGINT SIGTERM EXIT 00:22:45.677 00:22:45.677 real 0m29.107s 00:22:45.677 user 1m24.799s 00:22:45.677 sys 0m6.339s 00:22:45.677 03:39:25 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:45.677 03:39:25 -- common/autotest_common.sh@10 -- # set +x 00:22:45.677 ************************************ 00:22:45.677 END TEST nvmf_shutdown 00:22:45.677 ************************************ 00:22:45.677 03:39:25 -- nvmf/nvmf.sh@86 -- # timing_exit target 00:22:45.677 03:39:25 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:45.678 03:39:25 -- common/autotest_common.sh@10 -- # set +x 00:22:45.678 03:39:25 -- nvmf/nvmf.sh@88 -- # timing_enter host 00:22:45.678 03:39:25 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:45.678 03:39:25 -- common/autotest_common.sh@10 -- # set +x 00:22:45.678 03:39:25 -- nvmf/nvmf.sh@90 -- # [[ 0 -eq 0 ]] 00:22:45.678 03:39:25 -- nvmf/nvmf.sh@91 -- # run_test nvmf_multicontroller /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:22:45.678 03:39:25 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:22:45.678 03:39:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:45.678 03:39:25 -- common/autotest_common.sh@10 -- # set +x 00:22:45.678 ************************************ 00:22:45.678 START TEST nvmf_multicontroller 00:22:45.678 ************************************ 00:22:45.678 03:39:25 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:22:45.678 * Looking for test storage... 00:22:45.678 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:22:45.678 03:39:25 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:22:45.678 03:39:25 -- common/autotest_common.sh@1690 -- # lcov --version 00:22:45.678 03:39:25 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:22:45.678 03:39:25 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:22:45.678 03:39:25 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:22:45.678 03:39:25 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:22:45.678 03:39:25 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:22:45.678 03:39:25 -- scripts/common.sh@335 -- # IFS=.-: 00:22:45.678 03:39:25 -- scripts/common.sh@335 -- # read -ra ver1 00:22:45.678 03:39:25 -- scripts/common.sh@336 -- # IFS=.-: 00:22:45.678 03:39:25 -- scripts/common.sh@336 -- # read -ra ver2 00:22:45.678 03:39:25 -- scripts/common.sh@337 -- # local 'op=<' 00:22:45.678 03:39:25 -- scripts/common.sh@339 -- # ver1_l=2 00:22:45.678 03:39:25 -- scripts/common.sh@340 -- # ver2_l=1 00:22:45.678 03:39:25 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:22:45.678 03:39:25 -- scripts/common.sh@343 -- # case "$op" in 00:22:45.678 03:39:25 -- scripts/common.sh@344 -- # : 1 00:22:45.678 03:39:25 -- scripts/common.sh@363 -- # (( v = 0 )) 00:22:45.678 03:39:25 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:22:45.678 03:39:25 -- scripts/common.sh@364 -- # decimal 1 00:22:45.678 03:39:25 -- scripts/common.sh@352 -- # local d=1 00:22:45.678 03:39:25 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:22:45.678 03:39:25 -- scripts/common.sh@354 -- # echo 1 00:22:45.678 03:39:25 -- scripts/common.sh@364 -- # ver1[v]=1 00:22:45.678 03:39:25 -- scripts/common.sh@365 -- # decimal 2 00:22:45.678 03:39:25 -- scripts/common.sh@352 -- # local d=2 00:22:45.678 03:39:25 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:22:45.678 03:39:25 -- scripts/common.sh@354 -- # echo 2 00:22:45.678 03:39:25 -- scripts/common.sh@365 -- # ver2[v]=2 00:22:45.678 03:39:25 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:22:45.678 03:39:25 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:22:45.678 03:39:25 -- scripts/common.sh@367 -- # return 0 00:22:45.678 03:39:25 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:22:45.678 03:39:25 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:22:45.678 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:45.678 --rc genhtml_branch_coverage=1 00:22:45.678 --rc genhtml_function_coverage=1 00:22:45.678 --rc genhtml_legend=1 00:22:45.678 --rc geninfo_all_blocks=1 00:22:45.678 --rc geninfo_unexecuted_blocks=1 00:22:45.678 00:22:45.678 ' 00:22:45.678 03:39:25 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:22:45.678 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:45.678 --rc genhtml_branch_coverage=1 00:22:45.678 --rc genhtml_function_coverage=1 00:22:45.678 --rc genhtml_legend=1 00:22:45.678 --rc geninfo_all_blocks=1 00:22:45.678 --rc geninfo_unexecuted_blocks=1 00:22:45.678 00:22:45.678 ' 00:22:45.678 03:39:25 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:22:45.678 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:45.678 --rc genhtml_branch_coverage=1 00:22:45.678 --rc genhtml_function_coverage=1 00:22:45.678 --rc genhtml_legend=1 00:22:45.678 --rc geninfo_all_blocks=1 00:22:45.678 --rc geninfo_unexecuted_blocks=1 00:22:45.678 00:22:45.678 ' 00:22:45.678 03:39:25 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:22:45.678 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:45.678 --rc genhtml_branch_coverage=1 00:22:45.678 --rc genhtml_function_coverage=1 00:22:45.678 --rc genhtml_legend=1 00:22:45.678 --rc geninfo_all_blocks=1 00:22:45.678 --rc geninfo_unexecuted_blocks=1 00:22:45.678 00:22:45.678 ' 00:22:45.678 03:39:25 -- host/multicontroller.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:45.678 03:39:25 -- nvmf/common.sh@7 -- # uname -s 00:22:45.678 03:39:25 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:45.678 03:39:25 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:45.678 03:39:25 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:45.678 03:39:25 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:45.678 03:39:25 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:45.678 03:39:25 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:45.678 03:39:25 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:45.678 03:39:25 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:45.678 03:39:25 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:45.678 03:39:25 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:45.678 03:39:25 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:22:45.678 03:39:25 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:22:45.678 03:39:25 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:45.678 03:39:25 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:45.678 03:39:25 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:45.678 03:39:25 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:45.678 03:39:25 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:45.678 03:39:25 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:45.678 03:39:25 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:45.678 03:39:25 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:45.678 03:39:25 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:45.678 03:39:25 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:45.678 03:39:25 -- paths/export.sh@5 -- # export PATH 00:22:45.678 03:39:25 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:45.678 03:39:25 -- nvmf/common.sh@46 -- # : 0 00:22:45.678 03:39:25 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:45.678 03:39:25 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:45.678 03:39:25 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:45.678 03:39:25 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:45.678 03:39:25 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:45.678 03:39:25 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:45.678 03:39:25 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:45.678 03:39:25 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:45.678 03:39:25 -- host/multicontroller.sh@11 -- # MALLOC_BDEV_SIZE=64 00:22:45.678 03:39:25 -- host/multicontroller.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:22:45.678 03:39:25 -- host/multicontroller.sh@13 -- # NVMF_HOST_FIRST_PORT=60000 00:22:45.678 03:39:25 -- host/multicontroller.sh@14 -- # NVMF_HOST_SECOND_PORT=60001 00:22:45.678 03:39:25 -- host/multicontroller.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:22:45.678 03:39:25 -- host/multicontroller.sh@18 -- # '[' tcp == rdma ']' 00:22:45.678 03:39:25 -- host/multicontroller.sh@23 -- # nvmftestinit 00:22:45.678 03:39:25 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:45.678 03:39:25 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:45.678 03:39:25 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:45.678 03:39:25 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:45.678 03:39:25 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:45.678 03:39:25 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:45.678 03:39:25 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:45.678 03:39:25 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:45.678 03:39:25 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:45.678 03:39:25 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:45.678 03:39:25 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:45.678 03:39:25 -- common/autotest_common.sh@10 -- # set +x 00:22:47.605 03:39:27 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:47.605 03:39:27 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:47.605 03:39:27 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:47.605 03:39:27 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:47.605 03:39:27 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:47.605 03:39:27 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:47.605 03:39:27 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:47.605 03:39:27 -- nvmf/common.sh@294 -- # net_devs=() 00:22:47.605 03:39:27 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:47.605 03:39:27 -- nvmf/common.sh@295 -- # e810=() 00:22:47.605 03:39:27 -- nvmf/common.sh@295 -- # local -ga e810 00:22:47.605 03:39:27 -- nvmf/common.sh@296 -- # x722=() 00:22:47.605 03:39:27 -- nvmf/common.sh@296 -- # local -ga x722 00:22:47.605 03:39:27 -- nvmf/common.sh@297 -- # mlx=() 00:22:47.605 03:39:27 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:47.605 03:39:27 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:47.605 03:39:27 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:47.605 03:39:27 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:47.605 03:39:27 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:47.605 03:39:27 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:47.605 03:39:27 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:47.605 03:39:27 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:47.605 03:39:27 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:47.606 03:39:27 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:47.606 03:39:27 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:47.606 03:39:27 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:47.606 03:39:27 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:47.606 03:39:27 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:47.606 03:39:27 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:47.606 03:39:27 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:47.606 03:39:27 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:47.606 03:39:27 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:47.606 03:39:27 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:47.606 03:39:27 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:47.606 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:47.606 03:39:27 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:47.606 03:39:27 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:47.606 03:39:27 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:47.606 03:39:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:47.606 03:39:27 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:47.606 03:39:27 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:47.606 03:39:27 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:47.606 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:47.606 03:39:27 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:47.606 03:39:27 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:47.606 03:39:27 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:47.606 03:39:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:47.606 03:39:27 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:47.606 03:39:27 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:47.606 03:39:27 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:47.606 03:39:27 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:47.606 03:39:27 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:47.606 03:39:27 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:47.606 03:39:27 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:47.606 03:39:27 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:47.606 03:39:27 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:47.606 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:47.606 03:39:27 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:47.606 03:39:27 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:47.606 03:39:27 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:47.606 03:39:27 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:47.606 03:39:27 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:47.606 03:39:27 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:47.606 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:47.606 03:39:27 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:47.606 03:39:27 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:47.606 03:39:27 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:47.606 03:39:27 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:47.606 03:39:27 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:47.606 03:39:27 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:47.606 03:39:27 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:47.606 03:39:27 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:47.606 03:39:27 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:47.606 03:39:27 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:47.606 03:39:27 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:47.606 03:39:27 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:47.606 03:39:27 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:47.606 03:39:27 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:47.606 03:39:27 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:47.606 03:39:27 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:47.606 03:39:27 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:47.606 03:39:27 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:47.606 03:39:27 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:47.606 03:39:28 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:47.606 03:39:28 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:47.606 03:39:28 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:47.606 03:39:28 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:47.606 03:39:28 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:47.606 03:39:28 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:47.606 03:39:28 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:47.606 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:47.606 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.231 ms 00:22:47.606 00:22:47.606 --- 10.0.0.2 ping statistics --- 00:22:47.606 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:47.606 rtt min/avg/max/mdev = 0.231/0.231/0.231/0.000 ms 00:22:47.606 03:39:28 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:47.606 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:47.606 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.117 ms 00:22:47.606 00:22:47.606 --- 10.0.0.1 ping statistics --- 00:22:47.606 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:47.606 rtt min/avg/max/mdev = 0.117/0.117/0.117/0.000 ms 00:22:47.606 03:39:28 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:47.606 03:39:28 -- nvmf/common.sh@410 -- # return 0 00:22:47.606 03:39:28 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:47.606 03:39:28 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:47.606 03:39:28 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:47.606 03:39:28 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:47.606 03:39:28 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:47.606 03:39:28 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:47.606 03:39:28 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:47.606 03:39:28 -- host/multicontroller.sh@25 -- # nvmfappstart -m 0xE 00:22:47.606 03:39:28 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:47.606 03:39:28 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:47.606 03:39:28 -- common/autotest_common.sh@10 -- # set +x 00:22:47.606 03:39:28 -- nvmf/common.sh@469 -- # nvmfpid=3121869 00:22:47.606 03:39:28 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:22:47.606 03:39:28 -- nvmf/common.sh@470 -- # waitforlisten 3121869 00:22:47.606 03:39:28 -- common/autotest_common.sh@829 -- # '[' -z 3121869 ']' 00:22:47.606 03:39:28 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:47.606 03:39:28 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:47.606 03:39:28 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:47.606 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:47.606 03:39:28 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:47.606 03:39:28 -- common/autotest_common.sh@10 -- # set +x 00:22:47.606 [2024-11-21 03:39:28.138986] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:47.606 [2024-11-21 03:39:28.139085] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:47.606 EAL: No free 2048 kB hugepages reported on node 1 00:22:47.606 [2024-11-21 03:39:28.208572] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:22:47.867 [2024-11-21 03:39:28.323427] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:47.867 [2024-11-21 03:39:28.323618] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:47.867 [2024-11-21 03:39:28.323638] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:47.867 [2024-11-21 03:39:28.323653] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:47.867 [2024-11-21 03:39:28.323768] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:47.867 [2024-11-21 03:39:28.323862] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:47.867 [2024-11-21 03:39:28.323865] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:48.802 03:39:29 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:48.802 03:39:29 -- common/autotest_common.sh@862 -- # return 0 00:22:48.802 03:39:29 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:48.802 03:39:29 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:48.802 03:39:29 -- common/autotest_common.sh@10 -- # set +x 00:22:48.802 03:39:29 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:48.802 03:39:29 -- host/multicontroller.sh@27 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:48.802 03:39:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:48.802 03:39:29 -- common/autotest_common.sh@10 -- # set +x 00:22:48.802 [2024-11-21 03:39:29.125884] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:48.802 03:39:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:48.802 03:39:29 -- host/multicontroller.sh@29 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:22:48.802 03:39:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:48.802 03:39:29 -- common/autotest_common.sh@10 -- # set +x 00:22:48.802 Malloc0 00:22:48.802 03:39:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:48.802 03:39:29 -- host/multicontroller.sh@30 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:22:48.802 03:39:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:48.802 03:39:29 -- common/autotest_common.sh@10 -- # set +x 00:22:48.802 03:39:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:48.802 03:39:29 -- host/multicontroller.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:22:48.802 03:39:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:48.803 03:39:29 -- common/autotest_common.sh@10 -- # set +x 00:22:48.803 03:39:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:48.803 03:39:29 -- host/multicontroller.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:22:48.803 03:39:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:48.803 03:39:29 -- common/autotest_common.sh@10 -- # set +x 00:22:48.803 [2024-11-21 03:39:29.191782] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:48.803 03:39:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:48.803 03:39:29 -- host/multicontroller.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:22:48.803 03:39:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:48.803 03:39:29 -- common/autotest_common.sh@10 -- # set +x 00:22:48.803 [2024-11-21 03:39:29.199648] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:22:48.803 03:39:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:48.803 03:39:29 -- host/multicontroller.sh@36 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:22:48.803 03:39:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:48.803 03:39:29 -- common/autotest_common.sh@10 -- # set +x 00:22:48.803 Malloc1 00:22:48.803 03:39:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:48.803 03:39:29 -- host/multicontroller.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:22:48.803 03:39:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:48.803 03:39:29 -- common/autotest_common.sh@10 -- # set +x 00:22:48.803 03:39:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:48.803 03:39:29 -- host/multicontroller.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc1 00:22:48.803 03:39:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:48.803 03:39:29 -- common/autotest_common.sh@10 -- # set +x 00:22:48.803 03:39:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:48.803 03:39:29 -- host/multicontroller.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:22:48.803 03:39:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:48.803 03:39:29 -- common/autotest_common.sh@10 -- # set +x 00:22:48.803 03:39:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:48.803 03:39:29 -- host/multicontroller.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4421 00:22:48.803 03:39:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:48.803 03:39:29 -- common/autotest_common.sh@10 -- # set +x 00:22:48.803 03:39:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:48.803 03:39:29 -- host/multicontroller.sh@44 -- # bdevperf_pid=3122033 00:22:48.803 03:39:29 -- host/multicontroller.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w write -t 1 -f 00:22:48.803 03:39:29 -- host/multicontroller.sh@46 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; pap "$testdir/try.txt"; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:22:48.803 03:39:29 -- host/multicontroller.sh@47 -- # waitforlisten 3122033 /var/tmp/bdevperf.sock 00:22:48.803 03:39:29 -- common/autotest_common.sh@829 -- # '[' -z 3122033 ']' 00:22:48.803 03:39:29 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:22:48.803 03:39:29 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:48.803 03:39:29 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:22:48.803 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:22:48.803 03:39:29 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:48.803 03:39:29 -- common/autotest_common.sh@10 -- # set +x 00:22:49.740 03:39:30 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:49.740 03:39:30 -- common/autotest_common.sh@862 -- # return 0 00:22:49.740 03:39:30 -- host/multicontroller.sh@50 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:22:49.740 03:39:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:49.740 03:39:30 -- common/autotest_common.sh@10 -- # set +x 00:22:49.999 NVMe0n1 00:22:49.999 03:39:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:49.999 03:39:30 -- host/multicontroller.sh@54 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:22:49.999 03:39:30 -- host/multicontroller.sh@54 -- # grep -c NVMe 00:22:49.999 03:39:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:49.999 03:39:30 -- common/autotest_common.sh@10 -- # set +x 00:22:49.999 03:39:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:49.999 1 00:22:49.999 03:39:30 -- host/multicontroller.sh@60 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:22:49.999 03:39:30 -- common/autotest_common.sh@650 -- # local es=0 00:22:49.999 03:39:30 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:22:49.999 03:39:30 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:22:49.999 03:39:30 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:49.999 03:39:30 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:22:49.999 03:39:30 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:49.999 03:39:30 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:22:49.999 03:39:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:49.999 03:39:30 -- common/autotest_common.sh@10 -- # set +x 00:22:49.999 request: 00:22:49.999 { 00:22:49.999 "name": "NVMe0", 00:22:49.999 "trtype": "tcp", 00:22:49.999 "traddr": "10.0.0.2", 00:22:49.999 "hostnqn": "nqn.2021-09-7.io.spdk:00001", 00:22:49.999 "hostaddr": "10.0.0.2", 00:22:49.999 "hostsvcid": "60000", 00:22:49.999 "adrfam": "ipv4", 00:22:49.999 "trsvcid": "4420", 00:22:49.999 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:49.999 "method": "bdev_nvme_attach_controller", 00:22:49.999 "req_id": 1 00:22:49.999 } 00:22:49.999 Got JSON-RPC error response 00:22:49.999 response: 00:22:49.999 { 00:22:49.999 "code": -114, 00:22:49.999 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:22:49.999 } 00:22:49.999 03:39:30 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:22:49.999 03:39:30 -- common/autotest_common.sh@653 -- # es=1 00:22:49.999 03:39:30 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:22:49.999 03:39:30 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:22:49.999 03:39:30 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:22:49.999 03:39:30 -- host/multicontroller.sh@65 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:22:49.999 03:39:30 -- common/autotest_common.sh@650 -- # local es=0 00:22:49.999 03:39:30 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:22:49.999 03:39:30 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:22:49.999 03:39:30 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:49.999 03:39:30 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:22:49.999 03:39:30 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:49.999 03:39:30 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:22:49.999 03:39:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:49.999 03:39:30 -- common/autotest_common.sh@10 -- # set +x 00:22:49.999 request: 00:22:49.999 { 00:22:49.999 "name": "NVMe0", 00:22:49.999 "trtype": "tcp", 00:22:49.999 "traddr": "10.0.0.2", 00:22:49.999 "hostaddr": "10.0.0.2", 00:22:49.999 "hostsvcid": "60000", 00:22:50.000 "adrfam": "ipv4", 00:22:50.000 "trsvcid": "4420", 00:22:50.000 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:50.000 "method": "bdev_nvme_attach_controller", 00:22:50.000 "req_id": 1 00:22:50.000 } 00:22:50.000 Got JSON-RPC error response 00:22:50.000 response: 00:22:50.000 { 00:22:50.000 "code": -114, 00:22:50.000 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:22:50.000 } 00:22:50.000 03:39:30 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:22:50.000 03:39:30 -- common/autotest_common.sh@653 -- # es=1 00:22:50.000 03:39:30 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:22:50.000 03:39:30 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:22:50.000 03:39:30 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:22:50.000 03:39:30 -- host/multicontroller.sh@69 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:22:50.000 03:39:30 -- common/autotest_common.sh@650 -- # local es=0 00:22:50.000 03:39:30 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:22:50.000 03:39:30 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:22:50.000 03:39:30 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:50.000 03:39:30 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:22:50.000 03:39:30 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:50.000 03:39:30 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:22:50.000 03:39:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:50.000 03:39:30 -- common/autotest_common.sh@10 -- # set +x 00:22:50.000 request: 00:22:50.000 { 00:22:50.000 "name": "NVMe0", 00:22:50.000 "trtype": "tcp", 00:22:50.000 "traddr": "10.0.0.2", 00:22:50.000 "hostaddr": "10.0.0.2", 00:22:50.000 "hostsvcid": "60000", 00:22:50.000 "adrfam": "ipv4", 00:22:50.000 "trsvcid": "4420", 00:22:50.000 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:50.000 "multipath": "disable", 00:22:50.000 "method": "bdev_nvme_attach_controller", 00:22:50.000 "req_id": 1 00:22:50.000 } 00:22:50.000 Got JSON-RPC error response 00:22:50.000 response: 00:22:50.000 { 00:22:50.000 "code": -114, 00:22:50.000 "message": "A controller named NVMe0 already exists and multipath is disabled\n" 00:22:50.000 } 00:22:50.000 03:39:30 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:22:50.000 03:39:30 -- common/autotest_common.sh@653 -- # es=1 00:22:50.000 03:39:30 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:22:50.000 03:39:30 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:22:50.000 03:39:30 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:22:50.000 03:39:30 -- host/multicontroller.sh@74 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:22:50.000 03:39:30 -- common/autotest_common.sh@650 -- # local es=0 00:22:50.000 03:39:30 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:22:50.000 03:39:30 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:22:50.000 03:39:30 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:50.000 03:39:30 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:22:50.000 03:39:30 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:50.000 03:39:30 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:22:50.000 03:39:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:50.000 03:39:30 -- common/autotest_common.sh@10 -- # set +x 00:22:50.000 request: 00:22:50.000 { 00:22:50.000 "name": "NVMe0", 00:22:50.000 "trtype": "tcp", 00:22:50.000 "traddr": "10.0.0.2", 00:22:50.000 "hostaddr": "10.0.0.2", 00:22:50.000 "hostsvcid": "60000", 00:22:50.000 "adrfam": "ipv4", 00:22:50.000 "trsvcid": "4420", 00:22:50.000 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:50.000 "multipath": "failover", 00:22:50.000 "method": "bdev_nvme_attach_controller", 00:22:50.000 "req_id": 1 00:22:50.000 } 00:22:50.000 Got JSON-RPC error response 00:22:50.000 response: 00:22:50.000 { 00:22:50.000 "code": -114, 00:22:50.000 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:22:50.000 } 00:22:50.000 03:39:30 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:22:50.000 03:39:30 -- common/autotest_common.sh@653 -- # es=1 00:22:50.000 03:39:30 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:22:50.000 03:39:30 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:22:50.000 03:39:30 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:22:50.000 03:39:30 -- host/multicontroller.sh@79 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:22:50.000 03:39:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:50.000 03:39:30 -- common/autotest_common.sh@10 -- # set +x 00:22:50.258 00:22:50.258 03:39:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:50.258 03:39:30 -- host/multicontroller.sh@83 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:22:50.258 03:39:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:50.258 03:39:30 -- common/autotest_common.sh@10 -- # set +x 00:22:50.258 03:39:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:50.258 03:39:30 -- host/multicontroller.sh@87 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe1 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:22:50.258 03:39:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:50.258 03:39:30 -- common/autotest_common.sh@10 -- # set +x 00:22:50.518 00:22:50.518 03:39:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:50.518 03:39:30 -- host/multicontroller.sh@90 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:22:50.518 03:39:30 -- host/multicontroller.sh@90 -- # grep -c NVMe 00:22:50.518 03:39:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:50.518 03:39:30 -- common/autotest_common.sh@10 -- # set +x 00:22:50.518 03:39:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:50.518 03:39:30 -- host/multicontroller.sh@90 -- # '[' 2 '!=' 2 ']' 00:22:50.518 03:39:30 -- host/multicontroller.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:22:51.456 0 00:22:51.456 03:39:32 -- host/multicontroller.sh@98 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe1 00:22:51.456 03:39:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:51.456 03:39:32 -- common/autotest_common.sh@10 -- # set +x 00:22:51.456 03:39:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:51.456 03:39:32 -- host/multicontroller.sh@100 -- # killprocess 3122033 00:22:51.456 03:39:32 -- common/autotest_common.sh@936 -- # '[' -z 3122033 ']' 00:22:51.456 03:39:32 -- common/autotest_common.sh@940 -- # kill -0 3122033 00:22:51.456 03:39:32 -- common/autotest_common.sh@941 -- # uname 00:22:51.456 03:39:32 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:51.457 03:39:32 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3122033 00:22:51.714 03:39:32 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:51.714 03:39:32 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:51.714 03:39:32 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3122033' 00:22:51.714 killing process with pid 3122033 00:22:51.715 03:39:32 -- common/autotest_common.sh@955 -- # kill 3122033 00:22:51.715 03:39:32 -- common/autotest_common.sh@960 -- # wait 3122033 00:22:51.715 03:39:32 -- host/multicontroller.sh@102 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:22:51.715 03:39:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:51.715 03:39:32 -- common/autotest_common.sh@10 -- # set +x 00:22:51.974 03:39:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:51.974 03:39:32 -- host/multicontroller.sh@103 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:22:51.974 03:39:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:51.974 03:39:32 -- common/autotest_common.sh@10 -- # set +x 00:22:51.974 03:39:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:51.974 03:39:32 -- host/multicontroller.sh@105 -- # trap - SIGINT SIGTERM EXIT 00:22:51.974 03:39:32 -- host/multicontroller.sh@107 -- # pap /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:22:51.974 03:39:32 -- common/autotest_common.sh@1607 -- # read -r file 00:22:51.974 03:39:32 -- common/autotest_common.sh@1606 -- # find /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt -type f 00:22:51.974 03:39:32 -- common/autotest_common.sh@1606 -- # sort -u 00:22:51.974 03:39:32 -- common/autotest_common.sh@1608 -- # cat 00:22:51.974 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:22:51.974 [2024-11-21 03:39:29.293532] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:51.974 [2024-11-21 03:39:29.293629] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3122033 ] 00:22:51.974 EAL: No free 2048 kB hugepages reported on node 1 00:22:51.974 [2024-11-21 03:39:29.357824] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:51.974 [2024-11-21 03:39:29.465601] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:51.974 [2024-11-21 03:39:30.911268] bdev.c:4553:bdev_name_add: *ERROR*: Bdev name 5930c41f-c450-45b7-8623-bdbed1724c3f already exists 00:22:51.974 [2024-11-21 03:39:30.911309] bdev.c:7603:bdev_register: *ERROR*: Unable to add uuid:5930c41f-c450-45b7-8623-bdbed1724c3f alias for bdev NVMe1n1 00:22:51.974 [2024-11-21 03:39:30.911333] bdev_nvme.c:4236:nvme_bdev_create: *ERROR*: spdk_bdev_register() failed 00:22:51.974 Running I/O for 1 seconds... 00:22:51.974 00:22:51.974 Latency(us) 00:22:51.974 [2024-11-21T02:39:32.622Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:51.974 [2024-11-21T02:39:32.622Z] Job: NVMe0n1 (Core Mask 0x1, workload: write, depth: 128, IO size: 4096) 00:22:51.974 NVMe0n1 : 1.00 19690.82 76.92 0.00 0.00 6490.95 3252.53 11602.30 00:22:51.974 [2024-11-21T02:39:32.622Z] =================================================================================================================== 00:22:51.974 [2024-11-21T02:39:32.622Z] Total : 19690.82 76.92 0.00 0.00 6490.95 3252.53 11602.30 00:22:51.974 Received shutdown signal, test time was about 1.000000 seconds 00:22:51.974 00:22:51.974 Latency(us) 00:22:51.974 [2024-11-21T02:39:32.623Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:51.975 [2024-11-21T02:39:32.623Z] =================================================================================================================== 00:22:51.975 [2024-11-21T02:39:32.623Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:22:51.975 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:22:51.975 03:39:32 -- common/autotest_common.sh@1613 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:22:51.975 03:39:32 -- common/autotest_common.sh@1607 -- # read -r file 00:22:51.975 03:39:32 -- host/multicontroller.sh@108 -- # nvmftestfini 00:22:51.975 03:39:32 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:51.975 03:39:32 -- nvmf/common.sh@116 -- # sync 00:22:51.975 03:39:32 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:51.975 03:39:32 -- nvmf/common.sh@119 -- # set +e 00:22:51.975 03:39:32 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:51.975 03:39:32 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:51.975 rmmod nvme_tcp 00:22:51.975 rmmod nvme_fabrics 00:22:51.975 rmmod nvme_keyring 00:22:51.975 03:39:32 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:51.975 03:39:32 -- nvmf/common.sh@123 -- # set -e 00:22:51.975 03:39:32 -- nvmf/common.sh@124 -- # return 0 00:22:51.975 03:39:32 -- nvmf/common.sh@477 -- # '[' -n 3121869 ']' 00:22:51.975 03:39:32 -- nvmf/common.sh@478 -- # killprocess 3121869 00:22:51.975 03:39:32 -- common/autotest_common.sh@936 -- # '[' -z 3121869 ']' 00:22:51.975 03:39:32 -- common/autotest_common.sh@940 -- # kill -0 3121869 00:22:51.975 03:39:32 -- common/autotest_common.sh@941 -- # uname 00:22:51.975 03:39:32 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:51.975 03:39:32 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3121869 00:22:51.975 03:39:32 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:22:51.975 03:39:32 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:22:51.975 03:39:32 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3121869' 00:22:51.975 killing process with pid 3121869 00:22:51.975 03:39:32 -- common/autotest_common.sh@955 -- # kill 3121869 00:22:51.975 03:39:32 -- common/autotest_common.sh@960 -- # wait 3121869 00:22:52.235 03:39:32 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:52.235 03:39:32 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:52.235 03:39:32 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:52.235 03:39:32 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:52.235 03:39:32 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:52.235 03:39:32 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:52.235 03:39:32 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:52.235 03:39:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:54.778 03:39:34 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:54.778 00:22:54.778 real 0m9.036s 00:22:54.778 user 0m17.623s 00:22:54.778 sys 0m2.340s 00:22:54.778 03:39:34 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:54.778 03:39:34 -- common/autotest_common.sh@10 -- # set +x 00:22:54.778 ************************************ 00:22:54.778 END TEST nvmf_multicontroller 00:22:54.778 ************************************ 00:22:54.778 03:39:34 -- nvmf/nvmf.sh@92 -- # run_test nvmf_aer /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:22:54.778 03:39:34 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:22:54.778 03:39:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:54.778 03:39:34 -- common/autotest_common.sh@10 -- # set +x 00:22:54.778 ************************************ 00:22:54.778 START TEST nvmf_aer 00:22:54.778 ************************************ 00:22:54.778 03:39:34 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:22:54.778 * Looking for test storage... 00:22:54.778 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:22:54.778 03:39:34 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:22:54.778 03:39:34 -- common/autotest_common.sh@1690 -- # lcov --version 00:22:54.778 03:39:34 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:22:54.778 03:39:35 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:22:54.778 03:39:35 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:22:54.778 03:39:35 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:22:54.778 03:39:35 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:22:54.778 03:39:35 -- scripts/common.sh@335 -- # IFS=.-: 00:22:54.778 03:39:35 -- scripts/common.sh@335 -- # read -ra ver1 00:22:54.778 03:39:35 -- scripts/common.sh@336 -- # IFS=.-: 00:22:54.778 03:39:35 -- scripts/common.sh@336 -- # read -ra ver2 00:22:54.778 03:39:35 -- scripts/common.sh@337 -- # local 'op=<' 00:22:54.778 03:39:35 -- scripts/common.sh@339 -- # ver1_l=2 00:22:54.778 03:39:35 -- scripts/common.sh@340 -- # ver2_l=1 00:22:54.778 03:39:35 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:22:54.778 03:39:35 -- scripts/common.sh@343 -- # case "$op" in 00:22:54.778 03:39:35 -- scripts/common.sh@344 -- # : 1 00:22:54.778 03:39:35 -- scripts/common.sh@363 -- # (( v = 0 )) 00:22:54.778 03:39:35 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:22:54.778 03:39:35 -- scripts/common.sh@364 -- # decimal 1 00:22:54.778 03:39:35 -- scripts/common.sh@352 -- # local d=1 00:22:54.778 03:39:35 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:22:54.778 03:39:35 -- scripts/common.sh@354 -- # echo 1 00:22:54.778 03:39:35 -- scripts/common.sh@364 -- # ver1[v]=1 00:22:54.778 03:39:35 -- scripts/common.sh@365 -- # decimal 2 00:22:54.778 03:39:35 -- scripts/common.sh@352 -- # local d=2 00:22:54.778 03:39:35 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:22:54.778 03:39:35 -- scripts/common.sh@354 -- # echo 2 00:22:54.778 03:39:35 -- scripts/common.sh@365 -- # ver2[v]=2 00:22:54.778 03:39:35 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:22:54.778 03:39:35 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:22:54.778 03:39:35 -- scripts/common.sh@367 -- # return 0 00:22:54.778 03:39:35 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:22:54.778 03:39:35 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:22:54.778 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:54.778 --rc genhtml_branch_coverage=1 00:22:54.778 --rc genhtml_function_coverage=1 00:22:54.778 --rc genhtml_legend=1 00:22:54.778 --rc geninfo_all_blocks=1 00:22:54.778 --rc geninfo_unexecuted_blocks=1 00:22:54.778 00:22:54.778 ' 00:22:54.778 03:39:35 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:22:54.778 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:54.778 --rc genhtml_branch_coverage=1 00:22:54.778 --rc genhtml_function_coverage=1 00:22:54.778 --rc genhtml_legend=1 00:22:54.778 --rc geninfo_all_blocks=1 00:22:54.778 --rc geninfo_unexecuted_blocks=1 00:22:54.778 00:22:54.778 ' 00:22:54.778 03:39:35 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:22:54.778 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:54.778 --rc genhtml_branch_coverage=1 00:22:54.778 --rc genhtml_function_coverage=1 00:22:54.778 --rc genhtml_legend=1 00:22:54.778 --rc geninfo_all_blocks=1 00:22:54.778 --rc geninfo_unexecuted_blocks=1 00:22:54.778 00:22:54.778 ' 00:22:54.778 03:39:35 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:22:54.778 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:54.778 --rc genhtml_branch_coverage=1 00:22:54.778 --rc genhtml_function_coverage=1 00:22:54.778 --rc genhtml_legend=1 00:22:54.778 --rc geninfo_all_blocks=1 00:22:54.778 --rc geninfo_unexecuted_blocks=1 00:22:54.778 00:22:54.778 ' 00:22:54.778 03:39:35 -- host/aer.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:54.778 03:39:35 -- nvmf/common.sh@7 -- # uname -s 00:22:54.778 03:39:35 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:54.778 03:39:35 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:54.778 03:39:35 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:54.778 03:39:35 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:54.778 03:39:35 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:54.778 03:39:35 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:54.778 03:39:35 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:54.778 03:39:35 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:54.778 03:39:35 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:54.778 03:39:35 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:54.778 03:39:35 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:22:54.778 03:39:35 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:22:54.778 03:39:35 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:54.778 03:39:35 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:54.778 03:39:35 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:54.778 03:39:35 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:54.778 03:39:35 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:54.778 03:39:35 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:54.778 03:39:35 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:54.778 03:39:35 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:54.778 03:39:35 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:54.778 03:39:35 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:54.778 03:39:35 -- paths/export.sh@5 -- # export PATH 00:22:54.778 03:39:35 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:54.778 03:39:35 -- nvmf/common.sh@46 -- # : 0 00:22:54.778 03:39:35 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:54.778 03:39:35 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:54.778 03:39:35 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:54.778 03:39:35 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:54.778 03:39:35 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:54.778 03:39:35 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:54.778 03:39:35 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:54.778 03:39:35 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:54.778 03:39:35 -- host/aer.sh@11 -- # nvmftestinit 00:22:54.778 03:39:35 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:54.778 03:39:35 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:54.778 03:39:35 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:54.778 03:39:35 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:54.779 03:39:35 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:54.779 03:39:35 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:54.779 03:39:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:54.779 03:39:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:54.779 03:39:35 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:54.779 03:39:35 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:54.779 03:39:35 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:54.779 03:39:35 -- common/autotest_common.sh@10 -- # set +x 00:22:56.690 03:39:37 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:56.690 03:39:37 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:56.690 03:39:37 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:56.690 03:39:37 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:56.690 03:39:37 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:56.690 03:39:37 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:56.690 03:39:37 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:56.690 03:39:37 -- nvmf/common.sh@294 -- # net_devs=() 00:22:56.690 03:39:37 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:56.690 03:39:37 -- nvmf/common.sh@295 -- # e810=() 00:22:56.690 03:39:37 -- nvmf/common.sh@295 -- # local -ga e810 00:22:56.690 03:39:37 -- nvmf/common.sh@296 -- # x722=() 00:22:56.690 03:39:37 -- nvmf/common.sh@296 -- # local -ga x722 00:22:56.690 03:39:37 -- nvmf/common.sh@297 -- # mlx=() 00:22:56.690 03:39:37 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:56.690 03:39:37 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:56.690 03:39:37 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:56.690 03:39:37 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:56.690 03:39:37 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:56.690 03:39:37 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:56.690 03:39:37 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:56.690 03:39:37 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:56.690 03:39:37 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:56.690 03:39:37 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:56.690 03:39:37 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:56.690 03:39:37 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:56.690 03:39:37 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:56.690 03:39:37 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:56.690 03:39:37 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:56.690 03:39:37 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:56.690 03:39:37 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:56.690 03:39:37 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:56.690 03:39:37 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:56.690 03:39:37 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:56.690 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:56.690 03:39:37 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:56.690 03:39:37 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:56.690 03:39:37 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:56.690 03:39:37 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:56.690 03:39:37 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:56.690 03:39:37 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:56.690 03:39:37 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:56.690 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:56.690 03:39:37 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:56.690 03:39:37 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:56.690 03:39:37 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:56.690 03:39:37 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:56.690 03:39:37 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:56.690 03:39:37 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:56.690 03:39:37 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:56.690 03:39:37 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:56.691 03:39:37 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:56.691 03:39:37 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:56.691 03:39:37 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:56.691 03:39:37 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:56.691 03:39:37 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:56.691 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:56.691 03:39:37 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:56.691 03:39:37 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:56.691 03:39:37 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:56.691 03:39:37 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:56.691 03:39:37 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:56.691 03:39:37 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:56.691 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:56.691 03:39:37 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:56.691 03:39:37 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:56.691 03:39:37 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:56.691 03:39:37 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:56.691 03:39:37 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:56.691 03:39:37 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:56.691 03:39:37 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:56.691 03:39:37 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:56.691 03:39:37 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:56.691 03:39:37 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:56.691 03:39:37 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:56.691 03:39:37 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:56.691 03:39:37 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:56.691 03:39:37 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:56.691 03:39:37 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:56.691 03:39:37 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:56.691 03:39:37 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:56.691 03:39:37 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:56.691 03:39:37 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:56.691 03:39:37 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:56.691 03:39:37 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:56.691 03:39:37 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:56.691 03:39:37 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:56.691 03:39:37 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:56.691 03:39:37 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:56.691 03:39:37 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:56.691 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:56.691 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.326 ms 00:22:56.691 00:22:56.691 --- 10.0.0.2 ping statistics --- 00:22:56.691 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:56.691 rtt min/avg/max/mdev = 0.326/0.326/0.326/0.000 ms 00:22:56.691 03:39:37 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:56.691 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:56.691 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.191 ms 00:22:56.691 00:22:56.691 --- 10.0.0.1 ping statistics --- 00:22:56.691 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:56.691 rtt min/avg/max/mdev = 0.191/0.191/0.191/0.000 ms 00:22:56.691 03:39:37 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:56.691 03:39:37 -- nvmf/common.sh@410 -- # return 0 00:22:56.691 03:39:37 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:56.691 03:39:37 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:56.691 03:39:37 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:56.691 03:39:37 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:56.691 03:39:37 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:56.691 03:39:37 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:56.691 03:39:37 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:56.691 03:39:37 -- host/aer.sh@12 -- # nvmfappstart -m 0xF 00:22:56.691 03:39:37 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:56.691 03:39:37 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:56.691 03:39:37 -- common/autotest_common.sh@10 -- # set +x 00:22:56.691 03:39:37 -- nvmf/common.sh@469 -- # nvmfpid=3124402 00:22:56.691 03:39:37 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:22:56.691 03:39:37 -- nvmf/common.sh@470 -- # waitforlisten 3124402 00:22:56.691 03:39:37 -- common/autotest_common.sh@829 -- # '[' -z 3124402 ']' 00:22:56.691 03:39:37 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:56.691 03:39:37 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:56.691 03:39:37 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:56.691 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:56.691 03:39:37 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:56.691 03:39:37 -- common/autotest_common.sh@10 -- # set +x 00:22:56.691 [2024-11-21 03:39:37.315751] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:56.691 [2024-11-21 03:39:37.315819] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:56.952 EAL: No free 2048 kB hugepages reported on node 1 00:22:56.952 [2024-11-21 03:39:37.382107] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:56.952 [2024-11-21 03:39:37.488370] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:56.952 [2024-11-21 03:39:37.488510] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:56.952 [2024-11-21 03:39:37.488527] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:56.952 [2024-11-21 03:39:37.488540] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:56.952 [2024-11-21 03:39:37.488591] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:56.952 [2024-11-21 03:39:37.488664] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:56.952 [2024-11-21 03:39:37.488720] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:56.952 [2024-11-21 03:39:37.488723] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:57.891 03:39:38 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:57.891 03:39:38 -- common/autotest_common.sh@862 -- # return 0 00:22:57.891 03:39:38 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:57.891 03:39:38 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:57.891 03:39:38 -- common/autotest_common.sh@10 -- # set +x 00:22:57.891 03:39:38 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:57.891 03:39:38 -- host/aer.sh@14 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:57.891 03:39:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:57.891 03:39:38 -- common/autotest_common.sh@10 -- # set +x 00:22:57.891 [2024-11-21 03:39:38.358840] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:57.891 03:39:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:57.891 03:39:38 -- host/aer.sh@16 -- # rpc_cmd bdev_malloc_create 64 512 --name Malloc0 00:22:57.891 03:39:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:57.891 03:39:38 -- common/autotest_common.sh@10 -- # set +x 00:22:57.891 Malloc0 00:22:57.891 03:39:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:57.891 03:39:38 -- host/aer.sh@17 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 2 00:22:57.891 03:39:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:57.891 03:39:38 -- common/autotest_common.sh@10 -- # set +x 00:22:57.891 03:39:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:57.891 03:39:38 -- host/aer.sh@18 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:22:57.891 03:39:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:57.891 03:39:38 -- common/autotest_common.sh@10 -- # set +x 00:22:57.891 03:39:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:57.891 03:39:38 -- host/aer.sh@19 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:22:57.891 03:39:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:57.891 03:39:38 -- common/autotest_common.sh@10 -- # set +x 00:22:57.891 [2024-11-21 03:39:38.412726] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:57.891 03:39:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:57.891 03:39:38 -- host/aer.sh@21 -- # rpc_cmd nvmf_get_subsystems 00:22:57.891 03:39:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:57.891 03:39:38 -- common/autotest_common.sh@10 -- # set +x 00:22:57.891 [2024-11-21 03:39:38.420442] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:22:57.891 [ 00:22:57.891 { 00:22:57.891 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:22:57.891 "subtype": "Discovery", 00:22:57.891 "listen_addresses": [], 00:22:57.891 "allow_any_host": true, 00:22:57.891 "hosts": [] 00:22:57.891 }, 00:22:57.891 { 00:22:57.891 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:22:57.891 "subtype": "NVMe", 00:22:57.891 "listen_addresses": [ 00:22:57.891 { 00:22:57.891 "transport": "TCP", 00:22:57.891 "trtype": "TCP", 00:22:57.891 "adrfam": "IPv4", 00:22:57.891 "traddr": "10.0.0.2", 00:22:57.891 "trsvcid": "4420" 00:22:57.891 } 00:22:57.891 ], 00:22:57.891 "allow_any_host": true, 00:22:57.891 "hosts": [], 00:22:57.891 "serial_number": "SPDK00000000000001", 00:22:57.891 "model_number": "SPDK bdev Controller", 00:22:57.891 "max_namespaces": 2, 00:22:57.891 "min_cntlid": 1, 00:22:57.891 "max_cntlid": 65519, 00:22:57.891 "namespaces": [ 00:22:57.891 { 00:22:57.891 "nsid": 1, 00:22:57.891 "bdev_name": "Malloc0", 00:22:57.891 "name": "Malloc0", 00:22:57.891 "nguid": "41F2DE1615404856B926EA5526375115", 00:22:57.891 "uuid": "41f2de16-1540-4856-b926-ea5526375115" 00:22:57.891 } 00:22:57.891 ] 00:22:57.891 } 00:22:57.891 ] 00:22:57.891 03:39:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:57.891 03:39:38 -- host/aer.sh@23 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:22:57.891 03:39:38 -- host/aer.sh@24 -- # rm -f /tmp/aer_touch_file 00:22:57.891 03:39:38 -- host/aer.sh@33 -- # aerpid=3124566 00:22:57.891 03:39:38 -- host/aer.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -n 2 -t /tmp/aer_touch_file 00:22:57.891 03:39:38 -- host/aer.sh@36 -- # waitforfile /tmp/aer_touch_file 00:22:57.891 03:39:38 -- common/autotest_common.sh@1254 -- # local i=0 00:22:57.891 03:39:38 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:22:57.891 03:39:38 -- common/autotest_common.sh@1256 -- # '[' 0 -lt 200 ']' 00:22:57.891 03:39:38 -- common/autotest_common.sh@1257 -- # i=1 00:22:57.891 03:39:38 -- common/autotest_common.sh@1258 -- # sleep 0.1 00:22:57.891 EAL: No free 2048 kB hugepages reported on node 1 00:22:57.891 03:39:38 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:22:57.891 03:39:38 -- common/autotest_common.sh@1256 -- # '[' 1 -lt 200 ']' 00:22:57.891 03:39:38 -- common/autotest_common.sh@1257 -- # i=2 00:22:57.891 03:39:38 -- common/autotest_common.sh@1258 -- # sleep 0.1 00:22:58.151 03:39:38 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:22:58.151 03:39:38 -- common/autotest_common.sh@1261 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:22:58.151 03:39:38 -- common/autotest_common.sh@1265 -- # return 0 00:22:58.151 03:39:38 -- host/aer.sh@39 -- # rpc_cmd bdev_malloc_create 64 4096 --name Malloc1 00:22:58.151 03:39:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:58.151 03:39:38 -- common/autotest_common.sh@10 -- # set +x 00:22:58.151 Malloc1 00:22:58.151 03:39:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:58.151 03:39:38 -- host/aer.sh@40 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 2 00:22:58.151 03:39:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:58.151 03:39:38 -- common/autotest_common.sh@10 -- # set +x 00:22:58.151 03:39:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:58.151 03:39:38 -- host/aer.sh@41 -- # rpc_cmd nvmf_get_subsystems 00:22:58.151 03:39:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:58.151 03:39:38 -- common/autotest_common.sh@10 -- # set +x 00:22:58.151 Asynchronous Event Request test 00:22:58.151 Attaching to 10.0.0.2 00:22:58.151 Attached to 10.0.0.2 00:22:58.151 Registering asynchronous event callbacks... 00:22:58.151 Starting namespace attribute notice tests for all controllers... 00:22:58.151 10.0.0.2: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:22:58.151 aer_cb - Changed Namespace 00:22:58.151 Cleaning up... 00:22:58.151 [ 00:22:58.151 { 00:22:58.151 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:22:58.151 "subtype": "Discovery", 00:22:58.151 "listen_addresses": [], 00:22:58.151 "allow_any_host": true, 00:22:58.151 "hosts": [] 00:22:58.151 }, 00:22:58.151 { 00:22:58.151 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:22:58.151 "subtype": "NVMe", 00:22:58.151 "listen_addresses": [ 00:22:58.151 { 00:22:58.151 "transport": "TCP", 00:22:58.151 "trtype": "TCP", 00:22:58.151 "adrfam": "IPv4", 00:22:58.151 "traddr": "10.0.0.2", 00:22:58.151 "trsvcid": "4420" 00:22:58.151 } 00:22:58.151 ], 00:22:58.151 "allow_any_host": true, 00:22:58.151 "hosts": [], 00:22:58.151 "serial_number": "SPDK00000000000001", 00:22:58.151 "model_number": "SPDK bdev Controller", 00:22:58.151 "max_namespaces": 2, 00:22:58.151 "min_cntlid": 1, 00:22:58.151 "max_cntlid": 65519, 00:22:58.151 "namespaces": [ 00:22:58.151 { 00:22:58.151 "nsid": 1, 00:22:58.151 "bdev_name": "Malloc0", 00:22:58.151 "name": "Malloc0", 00:22:58.151 "nguid": "41F2DE1615404856B926EA5526375115", 00:22:58.151 "uuid": "41f2de16-1540-4856-b926-ea5526375115" 00:22:58.151 }, 00:22:58.151 { 00:22:58.151 "nsid": 2, 00:22:58.151 "bdev_name": "Malloc1", 00:22:58.151 "name": "Malloc1", 00:22:58.151 "nguid": "BAB6DFD4784340638FC23D8EAFF82A04", 00:22:58.151 "uuid": "bab6dfd4-7843-4063-8fc2-3d8eaff82a04" 00:22:58.151 } 00:22:58.151 ] 00:22:58.151 } 00:22:58.151 ] 00:22:58.151 03:39:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:58.151 03:39:38 -- host/aer.sh@43 -- # wait 3124566 00:22:58.151 03:39:38 -- host/aer.sh@45 -- # rpc_cmd bdev_malloc_delete Malloc0 00:22:58.151 03:39:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:58.151 03:39:38 -- common/autotest_common.sh@10 -- # set +x 00:22:58.151 03:39:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:58.151 03:39:38 -- host/aer.sh@46 -- # rpc_cmd bdev_malloc_delete Malloc1 00:22:58.151 03:39:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:58.151 03:39:38 -- common/autotest_common.sh@10 -- # set +x 00:22:58.151 03:39:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:58.151 03:39:38 -- host/aer.sh@47 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:22:58.151 03:39:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:58.151 03:39:38 -- common/autotest_common.sh@10 -- # set +x 00:22:58.151 03:39:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:58.151 03:39:38 -- host/aer.sh@49 -- # trap - SIGINT SIGTERM EXIT 00:22:58.151 03:39:38 -- host/aer.sh@51 -- # nvmftestfini 00:22:58.151 03:39:38 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:58.151 03:39:38 -- nvmf/common.sh@116 -- # sync 00:22:58.151 03:39:38 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:58.151 03:39:38 -- nvmf/common.sh@119 -- # set +e 00:22:58.151 03:39:38 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:58.151 03:39:38 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:58.410 rmmod nvme_tcp 00:22:58.410 rmmod nvme_fabrics 00:22:58.410 rmmod nvme_keyring 00:22:58.410 03:39:38 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:58.410 03:39:38 -- nvmf/common.sh@123 -- # set -e 00:22:58.410 03:39:38 -- nvmf/common.sh@124 -- # return 0 00:22:58.410 03:39:38 -- nvmf/common.sh@477 -- # '[' -n 3124402 ']' 00:22:58.410 03:39:38 -- nvmf/common.sh@478 -- # killprocess 3124402 00:22:58.410 03:39:38 -- common/autotest_common.sh@936 -- # '[' -z 3124402 ']' 00:22:58.410 03:39:38 -- common/autotest_common.sh@940 -- # kill -0 3124402 00:22:58.410 03:39:38 -- common/autotest_common.sh@941 -- # uname 00:22:58.410 03:39:38 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:58.410 03:39:38 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3124402 00:22:58.410 03:39:38 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:58.410 03:39:38 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:58.410 03:39:38 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3124402' 00:22:58.410 killing process with pid 3124402 00:22:58.410 03:39:38 -- common/autotest_common.sh@955 -- # kill 3124402 00:22:58.410 [2024-11-21 03:39:38.882569] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:22:58.410 03:39:38 -- common/autotest_common.sh@960 -- # wait 3124402 00:22:58.668 03:39:39 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:58.668 03:39:39 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:58.668 03:39:39 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:58.668 03:39:39 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:58.668 03:39:39 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:58.668 03:39:39 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:58.668 03:39:39 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:58.668 03:39:39 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:00.575 03:39:41 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:23:00.575 00:23:00.575 real 0m6.310s 00:23:00.575 user 0m7.419s 00:23:00.575 sys 0m2.026s 00:23:00.575 03:39:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:23:00.575 03:39:41 -- common/autotest_common.sh@10 -- # set +x 00:23:00.575 ************************************ 00:23:00.575 END TEST nvmf_aer 00:23:00.575 ************************************ 00:23:00.575 03:39:41 -- nvmf/nvmf.sh@93 -- # run_test nvmf_async_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:23:00.575 03:39:41 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:23:00.575 03:39:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:00.575 03:39:41 -- common/autotest_common.sh@10 -- # set +x 00:23:00.575 ************************************ 00:23:00.575 START TEST nvmf_async_init 00:23:00.575 ************************************ 00:23:00.575 03:39:41 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:23:00.832 * Looking for test storage... 00:23:00.832 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:23:00.832 03:39:41 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:23:00.832 03:39:41 -- common/autotest_common.sh@1690 -- # lcov --version 00:23:00.832 03:39:41 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:23:00.832 03:39:41 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:23:00.832 03:39:41 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:23:00.832 03:39:41 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:23:00.832 03:39:41 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:23:00.832 03:39:41 -- scripts/common.sh@335 -- # IFS=.-: 00:23:00.832 03:39:41 -- scripts/common.sh@335 -- # read -ra ver1 00:23:00.832 03:39:41 -- scripts/common.sh@336 -- # IFS=.-: 00:23:00.832 03:39:41 -- scripts/common.sh@336 -- # read -ra ver2 00:23:00.832 03:39:41 -- scripts/common.sh@337 -- # local 'op=<' 00:23:00.832 03:39:41 -- scripts/common.sh@339 -- # ver1_l=2 00:23:00.832 03:39:41 -- scripts/common.sh@340 -- # ver2_l=1 00:23:00.832 03:39:41 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:23:00.832 03:39:41 -- scripts/common.sh@343 -- # case "$op" in 00:23:00.832 03:39:41 -- scripts/common.sh@344 -- # : 1 00:23:00.832 03:39:41 -- scripts/common.sh@363 -- # (( v = 0 )) 00:23:00.832 03:39:41 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:23:00.832 03:39:41 -- scripts/common.sh@364 -- # decimal 1 00:23:00.832 03:39:41 -- scripts/common.sh@352 -- # local d=1 00:23:00.832 03:39:41 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:23:00.832 03:39:41 -- scripts/common.sh@354 -- # echo 1 00:23:00.832 03:39:41 -- scripts/common.sh@364 -- # ver1[v]=1 00:23:00.832 03:39:41 -- scripts/common.sh@365 -- # decimal 2 00:23:00.832 03:39:41 -- scripts/common.sh@352 -- # local d=2 00:23:00.832 03:39:41 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:23:00.832 03:39:41 -- scripts/common.sh@354 -- # echo 2 00:23:00.832 03:39:41 -- scripts/common.sh@365 -- # ver2[v]=2 00:23:00.832 03:39:41 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:23:00.832 03:39:41 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:23:00.832 03:39:41 -- scripts/common.sh@367 -- # return 0 00:23:00.832 03:39:41 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:23:00.832 03:39:41 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:23:00.832 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:00.832 --rc genhtml_branch_coverage=1 00:23:00.832 --rc genhtml_function_coverage=1 00:23:00.832 --rc genhtml_legend=1 00:23:00.832 --rc geninfo_all_blocks=1 00:23:00.832 --rc geninfo_unexecuted_blocks=1 00:23:00.832 00:23:00.832 ' 00:23:00.832 03:39:41 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:23:00.832 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:00.832 --rc genhtml_branch_coverage=1 00:23:00.832 --rc genhtml_function_coverage=1 00:23:00.832 --rc genhtml_legend=1 00:23:00.832 --rc geninfo_all_blocks=1 00:23:00.832 --rc geninfo_unexecuted_blocks=1 00:23:00.832 00:23:00.832 ' 00:23:00.832 03:39:41 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:23:00.832 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:00.832 --rc genhtml_branch_coverage=1 00:23:00.832 --rc genhtml_function_coverage=1 00:23:00.832 --rc genhtml_legend=1 00:23:00.832 --rc geninfo_all_blocks=1 00:23:00.832 --rc geninfo_unexecuted_blocks=1 00:23:00.832 00:23:00.832 ' 00:23:00.832 03:39:41 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:23:00.832 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:00.832 --rc genhtml_branch_coverage=1 00:23:00.833 --rc genhtml_function_coverage=1 00:23:00.833 --rc genhtml_legend=1 00:23:00.833 --rc geninfo_all_blocks=1 00:23:00.833 --rc geninfo_unexecuted_blocks=1 00:23:00.833 00:23:00.833 ' 00:23:00.833 03:39:41 -- host/async_init.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:00.833 03:39:41 -- nvmf/common.sh@7 -- # uname -s 00:23:00.833 03:39:41 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:00.833 03:39:41 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:00.833 03:39:41 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:00.833 03:39:41 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:00.833 03:39:41 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:00.833 03:39:41 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:00.833 03:39:41 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:00.833 03:39:41 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:00.833 03:39:41 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:00.833 03:39:41 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:00.833 03:39:41 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:23:00.833 03:39:41 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:23:00.833 03:39:41 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:00.833 03:39:41 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:00.833 03:39:41 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:00.833 03:39:41 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:00.833 03:39:41 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:00.833 03:39:41 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:00.833 03:39:41 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:00.833 03:39:41 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:00.833 03:39:41 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:00.833 03:39:41 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:00.833 03:39:41 -- paths/export.sh@5 -- # export PATH 00:23:00.833 03:39:41 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:00.833 03:39:41 -- nvmf/common.sh@46 -- # : 0 00:23:00.833 03:39:41 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:00.833 03:39:41 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:00.833 03:39:41 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:00.833 03:39:41 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:00.833 03:39:41 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:00.833 03:39:41 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:00.833 03:39:41 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:00.833 03:39:41 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:00.833 03:39:41 -- host/async_init.sh@13 -- # null_bdev_size=1024 00:23:00.833 03:39:41 -- host/async_init.sh@14 -- # null_block_size=512 00:23:00.833 03:39:41 -- host/async_init.sh@15 -- # null_bdev=null0 00:23:00.833 03:39:41 -- host/async_init.sh@16 -- # nvme_bdev=nvme0 00:23:00.833 03:39:41 -- host/async_init.sh@20 -- # uuidgen 00:23:00.833 03:39:41 -- host/async_init.sh@20 -- # tr -d - 00:23:00.833 03:39:41 -- host/async_init.sh@20 -- # nguid=0dbf12d81d514b1bb77eaa4f6f78fb7f 00:23:00.833 03:39:41 -- host/async_init.sh@22 -- # nvmftestinit 00:23:00.833 03:39:41 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:23:00.833 03:39:41 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:00.833 03:39:41 -- nvmf/common.sh@436 -- # prepare_net_devs 00:23:00.833 03:39:41 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:23:00.833 03:39:41 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:23:00.833 03:39:41 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:00.833 03:39:41 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:00.833 03:39:41 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:00.833 03:39:41 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:23:00.833 03:39:41 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:23:00.833 03:39:41 -- nvmf/common.sh@284 -- # xtrace_disable 00:23:00.833 03:39:41 -- common/autotest_common.sh@10 -- # set +x 00:23:03.371 03:39:43 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:03.371 03:39:43 -- nvmf/common.sh@290 -- # pci_devs=() 00:23:03.371 03:39:43 -- nvmf/common.sh@290 -- # local -a pci_devs 00:23:03.371 03:39:43 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:23:03.371 03:39:43 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:23:03.371 03:39:43 -- nvmf/common.sh@292 -- # pci_drivers=() 00:23:03.371 03:39:43 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:23:03.371 03:39:43 -- nvmf/common.sh@294 -- # net_devs=() 00:23:03.371 03:39:43 -- nvmf/common.sh@294 -- # local -ga net_devs 00:23:03.371 03:39:43 -- nvmf/common.sh@295 -- # e810=() 00:23:03.371 03:39:43 -- nvmf/common.sh@295 -- # local -ga e810 00:23:03.371 03:39:43 -- nvmf/common.sh@296 -- # x722=() 00:23:03.371 03:39:43 -- nvmf/common.sh@296 -- # local -ga x722 00:23:03.371 03:39:43 -- nvmf/common.sh@297 -- # mlx=() 00:23:03.371 03:39:43 -- nvmf/common.sh@297 -- # local -ga mlx 00:23:03.371 03:39:43 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:03.371 03:39:43 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:03.371 03:39:43 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:03.371 03:39:43 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:03.371 03:39:43 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:03.371 03:39:43 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:03.371 03:39:43 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:03.371 03:39:43 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:03.371 03:39:43 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:03.371 03:39:43 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:03.371 03:39:43 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:03.371 03:39:43 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:23:03.371 03:39:43 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:23:03.371 03:39:43 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:23:03.371 03:39:43 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:23:03.371 03:39:43 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:23:03.371 03:39:43 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:23:03.371 03:39:43 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:03.371 03:39:43 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:23:03.371 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:23:03.371 03:39:43 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:03.371 03:39:43 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:03.371 03:39:43 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:03.371 03:39:43 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:03.371 03:39:43 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:03.371 03:39:43 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:03.371 03:39:43 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:23:03.371 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:23:03.371 03:39:43 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:03.371 03:39:43 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:03.371 03:39:43 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:03.371 03:39:43 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:03.371 03:39:43 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:03.371 03:39:43 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:23:03.371 03:39:43 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:23:03.371 03:39:43 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:23:03.371 03:39:43 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:03.371 03:39:43 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:03.371 03:39:43 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:03.371 03:39:43 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:03.371 03:39:43 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:23:03.371 Found net devices under 0000:0a:00.0: cvl_0_0 00:23:03.371 03:39:43 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:03.371 03:39:43 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:03.371 03:39:43 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:03.371 03:39:43 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:03.371 03:39:43 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:03.371 03:39:43 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:23:03.371 Found net devices under 0000:0a:00.1: cvl_0_1 00:23:03.371 03:39:43 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:03.371 03:39:43 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:23:03.371 03:39:43 -- nvmf/common.sh@402 -- # is_hw=yes 00:23:03.371 03:39:43 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:23:03.371 03:39:43 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:23:03.371 03:39:43 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:23:03.372 03:39:43 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:23:03.372 03:39:43 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:23:03.372 03:39:43 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:03.372 03:39:43 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:23:03.372 03:39:43 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:23:03.372 03:39:43 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:23:03.372 03:39:43 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:23:03.372 03:39:43 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:23:03.372 03:39:43 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:23:03.372 03:39:43 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:23:03.372 03:39:43 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:23:03.372 03:39:43 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:23:03.372 03:39:43 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:23:03.372 03:39:43 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:23:03.372 03:39:43 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:23:03.372 03:39:43 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:23:03.372 03:39:43 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:23:03.372 03:39:43 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:23:03.372 03:39:43 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:23:03.372 03:39:43 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:23:03.372 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:23:03.372 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.326 ms 00:23:03.372 00:23:03.372 --- 10.0.0.2 ping statistics --- 00:23:03.372 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:03.372 rtt min/avg/max/mdev = 0.326/0.326/0.326/0.000 ms 00:23:03.372 03:39:43 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:23:03.372 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:23:03.372 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.162 ms 00:23:03.372 00:23:03.372 --- 10.0.0.1 ping statistics --- 00:23:03.372 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:03.372 rtt min/avg/max/mdev = 0.162/0.162/0.162/0.000 ms 00:23:03.372 03:39:43 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:23:03.372 03:39:43 -- nvmf/common.sh@410 -- # return 0 00:23:03.372 03:39:43 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:23:03.372 03:39:43 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:23:03.372 03:39:43 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:23:03.372 03:39:43 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:23:03.372 03:39:43 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:23:03.372 03:39:43 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:23:03.372 03:39:43 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:23:03.372 03:39:43 -- host/async_init.sh@23 -- # nvmfappstart -m 0x1 00:23:03.372 03:39:43 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:23:03.372 03:39:43 -- common/autotest_common.sh@722 -- # xtrace_disable 00:23:03.372 03:39:43 -- common/autotest_common.sh@10 -- # set +x 00:23:03.372 03:39:43 -- nvmf/common.sh@469 -- # nvmfpid=3126522 00:23:03.372 03:39:43 -- nvmf/common.sh@470 -- # waitforlisten 3126522 00:23:03.372 03:39:43 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:23:03.372 03:39:43 -- common/autotest_common.sh@829 -- # '[' -z 3126522 ']' 00:23:03.372 03:39:43 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:03.372 03:39:43 -- common/autotest_common.sh@834 -- # local max_retries=100 00:23:03.372 03:39:43 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:03.372 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:03.372 03:39:43 -- common/autotest_common.sh@838 -- # xtrace_disable 00:23:03.372 03:39:43 -- common/autotest_common.sh@10 -- # set +x 00:23:03.372 [2024-11-21 03:39:43.621225] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:03.372 [2024-11-21 03:39:43.621312] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:03.372 EAL: No free 2048 kB hugepages reported on node 1 00:23:03.372 [2024-11-21 03:39:43.689294] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:23:03.372 [2024-11-21 03:39:43.802228] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:23:03.372 [2024-11-21 03:39:43.802411] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:03.372 [2024-11-21 03:39:43.802430] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:03.372 [2024-11-21 03:39:43.802444] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:03.372 [2024-11-21 03:39:43.802476] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:03.940 03:39:44 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:23:03.940 03:39:44 -- common/autotest_common.sh@862 -- # return 0 00:23:03.940 03:39:44 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:23:03.940 03:39:44 -- common/autotest_common.sh@728 -- # xtrace_disable 00:23:03.940 03:39:44 -- common/autotest_common.sh@10 -- # set +x 00:23:04.200 03:39:44 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:23:04.200 03:39:44 -- host/async_init.sh@26 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:23:04.200 03:39:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:04.200 03:39:44 -- common/autotest_common.sh@10 -- # set +x 00:23:04.200 [2024-11-21 03:39:44.593475] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:04.200 03:39:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:04.200 03:39:44 -- host/async_init.sh@27 -- # rpc_cmd bdev_null_create null0 1024 512 00:23:04.200 03:39:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:04.200 03:39:44 -- common/autotest_common.sh@10 -- # set +x 00:23:04.200 null0 00:23:04.200 03:39:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:04.200 03:39:44 -- host/async_init.sh@28 -- # rpc_cmd bdev_wait_for_examine 00:23:04.200 03:39:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:04.200 03:39:44 -- common/autotest_common.sh@10 -- # set +x 00:23:04.200 03:39:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:04.200 03:39:44 -- host/async_init.sh@29 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a 00:23:04.200 03:39:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:04.200 03:39:44 -- common/autotest_common.sh@10 -- # set +x 00:23:04.200 03:39:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:04.200 03:39:44 -- host/async_init.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 -g 0dbf12d81d514b1bb77eaa4f6f78fb7f 00:23:04.200 03:39:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:04.200 03:39:44 -- common/autotest_common.sh@10 -- # set +x 00:23:04.200 03:39:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:04.200 03:39:44 -- host/async_init.sh@31 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:23:04.200 03:39:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:04.200 03:39:44 -- common/autotest_common.sh@10 -- # set +x 00:23:04.200 [2024-11-21 03:39:44.633708] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:04.200 03:39:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:04.200 03:39:44 -- host/async_init.sh@37 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4420 -n nqn.2016-06.io.spdk:cnode0 00:23:04.200 03:39:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:04.200 03:39:44 -- common/autotest_common.sh@10 -- # set +x 00:23:04.460 nvme0n1 00:23:04.460 03:39:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:04.460 03:39:44 -- host/async_init.sh@41 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:23:04.460 03:39:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:04.460 03:39:44 -- common/autotest_common.sh@10 -- # set +x 00:23:04.460 [ 00:23:04.460 { 00:23:04.460 "name": "nvme0n1", 00:23:04.460 "aliases": [ 00:23:04.460 "0dbf12d8-1d51-4b1b-b77e-aa4f6f78fb7f" 00:23:04.460 ], 00:23:04.460 "product_name": "NVMe disk", 00:23:04.460 "block_size": 512, 00:23:04.460 "num_blocks": 2097152, 00:23:04.460 "uuid": "0dbf12d8-1d51-4b1b-b77e-aa4f6f78fb7f", 00:23:04.460 "assigned_rate_limits": { 00:23:04.460 "rw_ios_per_sec": 0, 00:23:04.460 "rw_mbytes_per_sec": 0, 00:23:04.460 "r_mbytes_per_sec": 0, 00:23:04.460 "w_mbytes_per_sec": 0 00:23:04.460 }, 00:23:04.460 "claimed": false, 00:23:04.460 "zoned": false, 00:23:04.460 "supported_io_types": { 00:23:04.460 "read": true, 00:23:04.460 "write": true, 00:23:04.460 "unmap": false, 00:23:04.460 "write_zeroes": true, 00:23:04.460 "flush": true, 00:23:04.460 "reset": true, 00:23:04.460 "compare": true, 00:23:04.460 "compare_and_write": true, 00:23:04.460 "abort": true, 00:23:04.460 "nvme_admin": true, 00:23:04.460 "nvme_io": true 00:23:04.460 }, 00:23:04.460 "driver_specific": { 00:23:04.460 "nvme": [ 00:23:04.460 { 00:23:04.460 "trid": { 00:23:04.460 "trtype": "TCP", 00:23:04.460 "adrfam": "IPv4", 00:23:04.460 "traddr": "10.0.0.2", 00:23:04.460 "trsvcid": "4420", 00:23:04.460 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:23:04.460 }, 00:23:04.460 "ctrlr_data": { 00:23:04.460 "cntlid": 1, 00:23:04.460 "vendor_id": "0x8086", 00:23:04.460 "model_number": "SPDK bdev Controller", 00:23:04.460 "serial_number": "00000000000000000000", 00:23:04.460 "firmware_revision": "24.01.1", 00:23:04.460 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:23:04.460 "oacs": { 00:23:04.460 "security": 0, 00:23:04.460 "format": 0, 00:23:04.460 "firmware": 0, 00:23:04.460 "ns_manage": 0 00:23:04.460 }, 00:23:04.460 "multi_ctrlr": true, 00:23:04.460 "ana_reporting": false 00:23:04.460 }, 00:23:04.460 "vs": { 00:23:04.460 "nvme_version": "1.3" 00:23:04.460 }, 00:23:04.460 "ns_data": { 00:23:04.460 "id": 1, 00:23:04.460 "can_share": true 00:23:04.460 } 00:23:04.460 } 00:23:04.460 ], 00:23:04.460 "mp_policy": "active_passive" 00:23:04.460 } 00:23:04.460 } 00:23:04.460 ] 00:23:04.460 03:39:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:04.460 03:39:44 -- host/async_init.sh@44 -- # rpc_cmd bdev_nvme_reset_controller nvme0 00:23:04.460 03:39:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:04.460 03:39:44 -- common/autotest_common.sh@10 -- # set +x 00:23:04.460 [2024-11-21 03:39:44.882239] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:23:04.460 [2024-11-21 03:39:44.882327] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2292ba0 (9): Bad file descriptor 00:23:04.460 [2024-11-21 03:39:45.014221] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:23:04.460 03:39:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:04.460 03:39:45 -- host/async_init.sh@47 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:23:04.460 03:39:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:04.460 03:39:45 -- common/autotest_common.sh@10 -- # set +x 00:23:04.460 [ 00:23:04.460 { 00:23:04.460 "name": "nvme0n1", 00:23:04.460 "aliases": [ 00:23:04.460 "0dbf12d8-1d51-4b1b-b77e-aa4f6f78fb7f" 00:23:04.460 ], 00:23:04.460 "product_name": "NVMe disk", 00:23:04.460 "block_size": 512, 00:23:04.460 "num_blocks": 2097152, 00:23:04.460 "uuid": "0dbf12d8-1d51-4b1b-b77e-aa4f6f78fb7f", 00:23:04.460 "assigned_rate_limits": { 00:23:04.460 "rw_ios_per_sec": 0, 00:23:04.460 "rw_mbytes_per_sec": 0, 00:23:04.460 "r_mbytes_per_sec": 0, 00:23:04.460 "w_mbytes_per_sec": 0 00:23:04.460 }, 00:23:04.460 "claimed": false, 00:23:04.460 "zoned": false, 00:23:04.460 "supported_io_types": { 00:23:04.460 "read": true, 00:23:04.460 "write": true, 00:23:04.460 "unmap": false, 00:23:04.460 "write_zeroes": true, 00:23:04.460 "flush": true, 00:23:04.460 "reset": true, 00:23:04.460 "compare": true, 00:23:04.460 "compare_and_write": true, 00:23:04.460 "abort": true, 00:23:04.460 "nvme_admin": true, 00:23:04.460 "nvme_io": true 00:23:04.460 }, 00:23:04.460 "driver_specific": { 00:23:04.460 "nvme": [ 00:23:04.460 { 00:23:04.460 "trid": { 00:23:04.460 "trtype": "TCP", 00:23:04.460 "adrfam": "IPv4", 00:23:04.460 "traddr": "10.0.0.2", 00:23:04.460 "trsvcid": "4420", 00:23:04.460 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:23:04.460 }, 00:23:04.460 "ctrlr_data": { 00:23:04.460 "cntlid": 2, 00:23:04.460 "vendor_id": "0x8086", 00:23:04.460 "model_number": "SPDK bdev Controller", 00:23:04.460 "serial_number": "00000000000000000000", 00:23:04.460 "firmware_revision": "24.01.1", 00:23:04.460 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:23:04.460 "oacs": { 00:23:04.461 "security": 0, 00:23:04.461 "format": 0, 00:23:04.461 "firmware": 0, 00:23:04.461 "ns_manage": 0 00:23:04.461 }, 00:23:04.461 "multi_ctrlr": true, 00:23:04.461 "ana_reporting": false 00:23:04.461 }, 00:23:04.461 "vs": { 00:23:04.461 "nvme_version": "1.3" 00:23:04.461 }, 00:23:04.461 "ns_data": { 00:23:04.461 "id": 1, 00:23:04.461 "can_share": true 00:23:04.461 } 00:23:04.461 } 00:23:04.461 ], 00:23:04.461 "mp_policy": "active_passive" 00:23:04.461 } 00:23:04.461 } 00:23:04.461 ] 00:23:04.461 03:39:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:04.461 03:39:45 -- host/async_init.sh@50 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:04.461 03:39:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:04.461 03:39:45 -- common/autotest_common.sh@10 -- # set +x 00:23:04.461 03:39:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:04.461 03:39:45 -- host/async_init.sh@53 -- # mktemp 00:23:04.461 03:39:45 -- host/async_init.sh@53 -- # key_path=/tmp/tmp.vsAnXa6rg1 00:23:04.461 03:39:45 -- host/async_init.sh@54 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:23:04.461 03:39:45 -- host/async_init.sh@55 -- # chmod 0600 /tmp/tmp.vsAnXa6rg1 00:23:04.461 03:39:45 -- host/async_init.sh@56 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode0 --disable 00:23:04.461 03:39:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:04.461 03:39:45 -- common/autotest_common.sh@10 -- # set +x 00:23:04.461 03:39:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:04.461 03:39:45 -- host/async_init.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 --secure-channel 00:23:04.461 03:39:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:04.461 03:39:45 -- common/autotest_common.sh@10 -- # set +x 00:23:04.461 [2024-11-21 03:39:45.058873] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:23:04.461 [2024-11-21 03:39:45.059010] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:23:04.461 03:39:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:04.461 03:39:45 -- host/async_init.sh@59 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.vsAnXa6rg1 00:23:04.461 03:39:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:04.461 03:39:45 -- common/autotest_common.sh@10 -- # set +x 00:23:04.461 03:39:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:04.461 03:39:45 -- host/async_init.sh@65 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4421 -n nqn.2016-06.io.spdk:cnode0 -q nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.vsAnXa6rg1 00:23:04.461 03:39:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:04.461 03:39:45 -- common/autotest_common.sh@10 -- # set +x 00:23:04.461 [2024-11-21 03:39:45.074911] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:23:04.721 nvme0n1 00:23:04.721 03:39:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:04.721 03:39:45 -- host/async_init.sh@69 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:23:04.721 03:39:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:04.721 03:39:45 -- common/autotest_common.sh@10 -- # set +x 00:23:04.721 [ 00:23:04.721 { 00:23:04.721 "name": "nvme0n1", 00:23:04.722 "aliases": [ 00:23:04.722 "0dbf12d8-1d51-4b1b-b77e-aa4f6f78fb7f" 00:23:04.722 ], 00:23:04.722 "product_name": "NVMe disk", 00:23:04.722 "block_size": 512, 00:23:04.722 "num_blocks": 2097152, 00:23:04.722 "uuid": "0dbf12d8-1d51-4b1b-b77e-aa4f6f78fb7f", 00:23:04.722 "assigned_rate_limits": { 00:23:04.722 "rw_ios_per_sec": 0, 00:23:04.722 "rw_mbytes_per_sec": 0, 00:23:04.722 "r_mbytes_per_sec": 0, 00:23:04.722 "w_mbytes_per_sec": 0 00:23:04.722 }, 00:23:04.722 "claimed": false, 00:23:04.722 "zoned": false, 00:23:04.722 "supported_io_types": { 00:23:04.722 "read": true, 00:23:04.722 "write": true, 00:23:04.722 "unmap": false, 00:23:04.722 "write_zeroes": true, 00:23:04.722 "flush": true, 00:23:04.722 "reset": true, 00:23:04.722 "compare": true, 00:23:04.722 "compare_and_write": true, 00:23:04.722 "abort": true, 00:23:04.722 "nvme_admin": true, 00:23:04.722 "nvme_io": true 00:23:04.722 }, 00:23:04.722 "driver_specific": { 00:23:04.722 "nvme": [ 00:23:04.722 { 00:23:04.722 "trid": { 00:23:04.722 "trtype": "TCP", 00:23:04.722 "adrfam": "IPv4", 00:23:04.722 "traddr": "10.0.0.2", 00:23:04.722 "trsvcid": "4421", 00:23:04.722 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:23:04.722 }, 00:23:04.722 "ctrlr_data": { 00:23:04.722 "cntlid": 3, 00:23:04.722 "vendor_id": "0x8086", 00:23:04.722 "model_number": "SPDK bdev Controller", 00:23:04.722 "serial_number": "00000000000000000000", 00:23:04.722 "firmware_revision": "24.01.1", 00:23:04.722 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:23:04.722 "oacs": { 00:23:04.722 "security": 0, 00:23:04.722 "format": 0, 00:23:04.722 "firmware": 0, 00:23:04.722 "ns_manage": 0 00:23:04.722 }, 00:23:04.722 "multi_ctrlr": true, 00:23:04.722 "ana_reporting": false 00:23:04.722 }, 00:23:04.722 "vs": { 00:23:04.722 "nvme_version": "1.3" 00:23:04.722 }, 00:23:04.722 "ns_data": { 00:23:04.722 "id": 1, 00:23:04.722 "can_share": true 00:23:04.722 } 00:23:04.722 } 00:23:04.722 ], 00:23:04.722 "mp_policy": "active_passive" 00:23:04.722 } 00:23:04.722 } 00:23:04.722 ] 00:23:04.722 03:39:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:04.722 03:39:45 -- host/async_init.sh@72 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:04.722 03:39:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:04.722 03:39:45 -- common/autotest_common.sh@10 -- # set +x 00:23:04.722 03:39:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:04.722 03:39:45 -- host/async_init.sh@75 -- # rm -f /tmp/tmp.vsAnXa6rg1 00:23:04.722 03:39:45 -- host/async_init.sh@77 -- # trap - SIGINT SIGTERM EXIT 00:23:04.722 03:39:45 -- host/async_init.sh@78 -- # nvmftestfini 00:23:04.722 03:39:45 -- nvmf/common.sh@476 -- # nvmfcleanup 00:23:04.722 03:39:45 -- nvmf/common.sh@116 -- # sync 00:23:04.722 03:39:45 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:23:04.722 03:39:45 -- nvmf/common.sh@119 -- # set +e 00:23:04.722 03:39:45 -- nvmf/common.sh@120 -- # for i in {1..20} 00:23:04.722 03:39:45 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:23:04.722 rmmod nvme_tcp 00:23:04.722 rmmod nvme_fabrics 00:23:04.722 rmmod nvme_keyring 00:23:04.722 03:39:45 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:23:04.722 03:39:45 -- nvmf/common.sh@123 -- # set -e 00:23:04.722 03:39:45 -- nvmf/common.sh@124 -- # return 0 00:23:04.722 03:39:45 -- nvmf/common.sh@477 -- # '[' -n 3126522 ']' 00:23:04.722 03:39:45 -- nvmf/common.sh@478 -- # killprocess 3126522 00:23:04.722 03:39:45 -- common/autotest_common.sh@936 -- # '[' -z 3126522 ']' 00:23:04.722 03:39:45 -- common/autotest_common.sh@940 -- # kill -0 3126522 00:23:04.722 03:39:45 -- common/autotest_common.sh@941 -- # uname 00:23:04.722 03:39:45 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:23:04.722 03:39:45 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3126522 00:23:04.722 03:39:45 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:23:04.722 03:39:45 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:23:04.722 03:39:45 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3126522' 00:23:04.722 killing process with pid 3126522 00:23:04.722 03:39:45 -- common/autotest_common.sh@955 -- # kill 3126522 00:23:04.722 03:39:45 -- common/autotest_common.sh@960 -- # wait 3126522 00:23:04.983 03:39:45 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:23:04.983 03:39:45 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:23:04.983 03:39:45 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:23:04.983 03:39:45 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:23:04.983 03:39:45 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:23:04.983 03:39:45 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:04.983 03:39:45 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:04.983 03:39:45 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:07.520 03:39:47 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:23:07.520 00:23:07.520 real 0m6.373s 00:23:07.520 user 0m3.140s 00:23:07.520 sys 0m1.846s 00:23:07.520 03:39:47 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:23:07.520 03:39:47 -- common/autotest_common.sh@10 -- # set +x 00:23:07.520 ************************************ 00:23:07.520 END TEST nvmf_async_init 00:23:07.520 ************************************ 00:23:07.520 03:39:47 -- nvmf/nvmf.sh@94 -- # run_test dma /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:23:07.520 03:39:47 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:23:07.520 03:39:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:07.520 03:39:47 -- common/autotest_common.sh@10 -- # set +x 00:23:07.520 ************************************ 00:23:07.520 START TEST dma 00:23:07.520 ************************************ 00:23:07.520 03:39:47 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:23:07.520 * Looking for test storage... 00:23:07.520 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:23:07.520 03:39:47 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:23:07.520 03:39:47 -- common/autotest_common.sh@1690 -- # lcov --version 00:23:07.520 03:39:47 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:23:07.520 03:39:47 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:23:07.520 03:39:47 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:23:07.520 03:39:47 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:23:07.520 03:39:47 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:23:07.520 03:39:47 -- scripts/common.sh@335 -- # IFS=.-: 00:23:07.520 03:39:47 -- scripts/common.sh@335 -- # read -ra ver1 00:23:07.520 03:39:47 -- scripts/common.sh@336 -- # IFS=.-: 00:23:07.520 03:39:47 -- scripts/common.sh@336 -- # read -ra ver2 00:23:07.520 03:39:47 -- scripts/common.sh@337 -- # local 'op=<' 00:23:07.520 03:39:47 -- scripts/common.sh@339 -- # ver1_l=2 00:23:07.520 03:39:47 -- scripts/common.sh@340 -- # ver2_l=1 00:23:07.520 03:39:47 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:23:07.520 03:39:47 -- scripts/common.sh@343 -- # case "$op" in 00:23:07.520 03:39:47 -- scripts/common.sh@344 -- # : 1 00:23:07.520 03:39:47 -- scripts/common.sh@363 -- # (( v = 0 )) 00:23:07.520 03:39:47 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:23:07.520 03:39:47 -- scripts/common.sh@364 -- # decimal 1 00:23:07.520 03:39:47 -- scripts/common.sh@352 -- # local d=1 00:23:07.520 03:39:47 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:23:07.520 03:39:47 -- scripts/common.sh@354 -- # echo 1 00:23:07.520 03:39:47 -- scripts/common.sh@364 -- # ver1[v]=1 00:23:07.520 03:39:47 -- scripts/common.sh@365 -- # decimal 2 00:23:07.520 03:39:47 -- scripts/common.sh@352 -- # local d=2 00:23:07.520 03:39:47 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:23:07.520 03:39:47 -- scripts/common.sh@354 -- # echo 2 00:23:07.520 03:39:47 -- scripts/common.sh@365 -- # ver2[v]=2 00:23:07.520 03:39:47 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:23:07.520 03:39:47 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:23:07.520 03:39:47 -- scripts/common.sh@367 -- # return 0 00:23:07.520 03:39:47 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:23:07.520 03:39:47 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:23:07.520 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:07.520 --rc genhtml_branch_coverage=1 00:23:07.520 --rc genhtml_function_coverage=1 00:23:07.520 --rc genhtml_legend=1 00:23:07.520 --rc geninfo_all_blocks=1 00:23:07.520 --rc geninfo_unexecuted_blocks=1 00:23:07.520 00:23:07.520 ' 00:23:07.520 03:39:47 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:23:07.520 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:07.520 --rc genhtml_branch_coverage=1 00:23:07.520 --rc genhtml_function_coverage=1 00:23:07.520 --rc genhtml_legend=1 00:23:07.520 --rc geninfo_all_blocks=1 00:23:07.520 --rc geninfo_unexecuted_blocks=1 00:23:07.520 00:23:07.520 ' 00:23:07.520 03:39:47 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:23:07.520 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:07.520 --rc genhtml_branch_coverage=1 00:23:07.520 --rc genhtml_function_coverage=1 00:23:07.520 --rc genhtml_legend=1 00:23:07.520 --rc geninfo_all_blocks=1 00:23:07.520 --rc geninfo_unexecuted_blocks=1 00:23:07.520 00:23:07.520 ' 00:23:07.520 03:39:47 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:23:07.520 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:07.520 --rc genhtml_branch_coverage=1 00:23:07.520 --rc genhtml_function_coverage=1 00:23:07.520 --rc genhtml_legend=1 00:23:07.520 --rc geninfo_all_blocks=1 00:23:07.520 --rc geninfo_unexecuted_blocks=1 00:23:07.520 00:23:07.520 ' 00:23:07.520 03:39:47 -- host/dma.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:07.520 03:39:47 -- nvmf/common.sh@7 -- # uname -s 00:23:07.520 03:39:47 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:07.520 03:39:47 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:07.520 03:39:47 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:07.520 03:39:47 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:07.520 03:39:47 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:07.520 03:39:47 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:07.520 03:39:47 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:07.520 03:39:47 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:07.520 03:39:47 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:07.520 03:39:47 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:07.520 03:39:47 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:23:07.520 03:39:47 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:23:07.520 03:39:47 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:07.520 03:39:47 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:07.520 03:39:47 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:07.520 03:39:47 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:07.520 03:39:47 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:07.520 03:39:47 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:07.520 03:39:47 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:07.520 03:39:47 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:07.520 03:39:47 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:07.520 03:39:47 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:07.521 03:39:47 -- paths/export.sh@5 -- # export PATH 00:23:07.521 03:39:47 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:07.521 03:39:47 -- nvmf/common.sh@46 -- # : 0 00:23:07.521 03:39:47 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:07.521 03:39:47 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:07.521 03:39:47 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:07.521 03:39:47 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:07.521 03:39:47 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:07.521 03:39:47 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:07.521 03:39:47 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:07.521 03:39:47 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:07.521 03:39:47 -- host/dma.sh@12 -- # '[' tcp '!=' rdma ']' 00:23:07.521 03:39:47 -- host/dma.sh@13 -- # exit 0 00:23:07.521 00:23:07.521 real 0m0.146s 00:23:07.521 user 0m0.099s 00:23:07.521 sys 0m0.055s 00:23:07.521 03:39:47 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:23:07.521 03:39:47 -- common/autotest_common.sh@10 -- # set +x 00:23:07.521 ************************************ 00:23:07.521 END TEST dma 00:23:07.521 ************************************ 00:23:07.521 03:39:47 -- nvmf/nvmf.sh@97 -- # run_test nvmf_identify /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:23:07.521 03:39:47 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:23:07.521 03:39:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:07.521 03:39:47 -- common/autotest_common.sh@10 -- # set +x 00:23:07.521 ************************************ 00:23:07.521 START TEST nvmf_identify 00:23:07.521 ************************************ 00:23:07.521 03:39:47 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:23:07.521 * Looking for test storage... 00:23:07.521 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:23:07.521 03:39:47 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:23:07.521 03:39:47 -- common/autotest_common.sh@1690 -- # lcov --version 00:23:07.521 03:39:47 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:23:07.521 03:39:47 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:23:07.521 03:39:47 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:23:07.521 03:39:47 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:23:07.521 03:39:47 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:23:07.521 03:39:47 -- scripts/common.sh@335 -- # IFS=.-: 00:23:07.521 03:39:47 -- scripts/common.sh@335 -- # read -ra ver1 00:23:07.521 03:39:47 -- scripts/common.sh@336 -- # IFS=.-: 00:23:07.521 03:39:47 -- scripts/common.sh@336 -- # read -ra ver2 00:23:07.521 03:39:47 -- scripts/common.sh@337 -- # local 'op=<' 00:23:07.521 03:39:47 -- scripts/common.sh@339 -- # ver1_l=2 00:23:07.521 03:39:47 -- scripts/common.sh@340 -- # ver2_l=1 00:23:07.521 03:39:47 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:23:07.521 03:39:47 -- scripts/common.sh@343 -- # case "$op" in 00:23:07.521 03:39:47 -- scripts/common.sh@344 -- # : 1 00:23:07.521 03:39:47 -- scripts/common.sh@363 -- # (( v = 0 )) 00:23:07.521 03:39:47 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:23:07.521 03:39:47 -- scripts/common.sh@364 -- # decimal 1 00:23:07.521 03:39:47 -- scripts/common.sh@352 -- # local d=1 00:23:07.521 03:39:47 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:23:07.521 03:39:47 -- scripts/common.sh@354 -- # echo 1 00:23:07.521 03:39:47 -- scripts/common.sh@364 -- # ver1[v]=1 00:23:07.521 03:39:47 -- scripts/common.sh@365 -- # decimal 2 00:23:07.521 03:39:47 -- scripts/common.sh@352 -- # local d=2 00:23:07.521 03:39:47 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:23:07.521 03:39:47 -- scripts/common.sh@354 -- # echo 2 00:23:07.521 03:39:47 -- scripts/common.sh@365 -- # ver2[v]=2 00:23:07.521 03:39:47 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:23:07.521 03:39:47 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:23:07.521 03:39:47 -- scripts/common.sh@367 -- # return 0 00:23:07.521 03:39:47 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:23:07.521 03:39:47 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:23:07.521 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:07.521 --rc genhtml_branch_coverage=1 00:23:07.521 --rc genhtml_function_coverage=1 00:23:07.521 --rc genhtml_legend=1 00:23:07.521 --rc geninfo_all_blocks=1 00:23:07.521 --rc geninfo_unexecuted_blocks=1 00:23:07.521 00:23:07.521 ' 00:23:07.521 03:39:47 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:23:07.521 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:07.521 --rc genhtml_branch_coverage=1 00:23:07.521 --rc genhtml_function_coverage=1 00:23:07.521 --rc genhtml_legend=1 00:23:07.521 --rc geninfo_all_blocks=1 00:23:07.521 --rc geninfo_unexecuted_blocks=1 00:23:07.521 00:23:07.521 ' 00:23:07.521 03:39:47 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:23:07.521 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:07.521 --rc genhtml_branch_coverage=1 00:23:07.521 --rc genhtml_function_coverage=1 00:23:07.521 --rc genhtml_legend=1 00:23:07.521 --rc geninfo_all_blocks=1 00:23:07.521 --rc geninfo_unexecuted_blocks=1 00:23:07.521 00:23:07.521 ' 00:23:07.521 03:39:47 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:23:07.521 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:07.521 --rc genhtml_branch_coverage=1 00:23:07.521 --rc genhtml_function_coverage=1 00:23:07.521 --rc genhtml_legend=1 00:23:07.521 --rc geninfo_all_blocks=1 00:23:07.521 --rc geninfo_unexecuted_blocks=1 00:23:07.521 00:23:07.521 ' 00:23:07.521 03:39:47 -- host/identify.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:07.521 03:39:47 -- nvmf/common.sh@7 -- # uname -s 00:23:07.521 03:39:47 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:07.521 03:39:47 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:07.521 03:39:47 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:07.521 03:39:47 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:07.521 03:39:47 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:07.521 03:39:47 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:07.521 03:39:47 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:07.521 03:39:47 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:07.521 03:39:47 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:07.521 03:39:47 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:07.521 03:39:47 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:23:07.521 03:39:47 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:23:07.521 03:39:47 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:07.521 03:39:47 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:07.521 03:39:47 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:07.521 03:39:47 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:07.521 03:39:47 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:07.521 03:39:47 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:07.521 03:39:47 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:07.521 03:39:47 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:07.521 03:39:47 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:07.521 03:39:47 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:07.521 03:39:47 -- paths/export.sh@5 -- # export PATH 00:23:07.522 03:39:47 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:07.522 03:39:47 -- nvmf/common.sh@46 -- # : 0 00:23:07.522 03:39:47 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:07.522 03:39:47 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:07.522 03:39:47 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:07.522 03:39:47 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:07.522 03:39:47 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:07.522 03:39:47 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:07.522 03:39:47 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:07.522 03:39:47 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:07.522 03:39:47 -- host/identify.sh@11 -- # MALLOC_BDEV_SIZE=64 00:23:07.522 03:39:47 -- host/identify.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:23:07.522 03:39:47 -- host/identify.sh@14 -- # nvmftestinit 00:23:07.522 03:39:47 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:23:07.522 03:39:47 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:07.522 03:39:47 -- nvmf/common.sh@436 -- # prepare_net_devs 00:23:07.522 03:39:47 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:23:07.522 03:39:47 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:23:07.522 03:39:47 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:07.522 03:39:47 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:07.522 03:39:47 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:07.522 03:39:47 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:23:07.522 03:39:47 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:23:07.522 03:39:47 -- nvmf/common.sh@284 -- # xtrace_disable 00:23:07.522 03:39:47 -- common/autotest_common.sh@10 -- # set +x 00:23:09.425 03:39:49 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:09.425 03:39:49 -- nvmf/common.sh@290 -- # pci_devs=() 00:23:09.425 03:39:49 -- nvmf/common.sh@290 -- # local -a pci_devs 00:23:09.425 03:39:49 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:23:09.425 03:39:49 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:23:09.425 03:39:49 -- nvmf/common.sh@292 -- # pci_drivers=() 00:23:09.425 03:39:49 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:23:09.425 03:39:49 -- nvmf/common.sh@294 -- # net_devs=() 00:23:09.425 03:39:49 -- nvmf/common.sh@294 -- # local -ga net_devs 00:23:09.425 03:39:49 -- nvmf/common.sh@295 -- # e810=() 00:23:09.425 03:39:49 -- nvmf/common.sh@295 -- # local -ga e810 00:23:09.425 03:39:49 -- nvmf/common.sh@296 -- # x722=() 00:23:09.425 03:39:49 -- nvmf/common.sh@296 -- # local -ga x722 00:23:09.425 03:39:49 -- nvmf/common.sh@297 -- # mlx=() 00:23:09.425 03:39:49 -- nvmf/common.sh@297 -- # local -ga mlx 00:23:09.425 03:39:49 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:09.425 03:39:49 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:09.425 03:39:49 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:09.425 03:39:49 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:09.425 03:39:49 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:09.425 03:39:49 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:09.425 03:39:49 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:09.425 03:39:49 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:09.425 03:39:49 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:09.425 03:39:49 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:09.425 03:39:49 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:09.425 03:39:49 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:23:09.425 03:39:49 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:23:09.425 03:39:49 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:23:09.425 03:39:49 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:23:09.425 03:39:49 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:23:09.425 03:39:49 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:23:09.425 03:39:49 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:09.425 03:39:49 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:23:09.425 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:23:09.425 03:39:49 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:09.425 03:39:49 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:09.425 03:39:49 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:09.425 03:39:49 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:09.425 03:39:49 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:09.425 03:39:49 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:09.425 03:39:49 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:23:09.425 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:23:09.425 03:39:49 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:09.425 03:39:49 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:09.425 03:39:49 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:09.425 03:39:49 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:09.425 03:39:49 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:09.425 03:39:49 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:23:09.425 03:39:49 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:23:09.425 03:39:49 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:23:09.425 03:39:49 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:09.425 03:39:49 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:09.425 03:39:49 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:09.425 03:39:49 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:09.425 03:39:49 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:23:09.425 Found net devices under 0000:0a:00.0: cvl_0_0 00:23:09.425 03:39:49 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:09.425 03:39:49 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:09.425 03:39:49 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:09.425 03:39:49 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:09.425 03:39:49 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:09.425 03:39:49 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:23:09.425 Found net devices under 0000:0a:00.1: cvl_0_1 00:23:09.425 03:39:49 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:09.426 03:39:49 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:23:09.426 03:39:49 -- nvmf/common.sh@402 -- # is_hw=yes 00:23:09.426 03:39:49 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:23:09.426 03:39:49 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:23:09.426 03:39:49 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:23:09.426 03:39:49 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:23:09.426 03:39:49 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:23:09.426 03:39:49 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:09.426 03:39:49 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:23:09.426 03:39:49 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:23:09.426 03:39:49 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:23:09.426 03:39:49 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:23:09.426 03:39:49 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:23:09.426 03:39:49 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:23:09.426 03:39:49 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:23:09.426 03:39:49 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:23:09.426 03:39:49 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:23:09.426 03:39:49 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:23:09.426 03:39:49 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:23:09.426 03:39:49 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:23:09.426 03:39:49 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:23:09.426 03:39:49 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:23:09.426 03:39:49 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:23:09.426 03:39:50 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:23:09.426 03:39:50 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:23:09.426 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:23:09.426 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.272 ms 00:23:09.426 00:23:09.426 --- 10.0.0.2 ping statistics --- 00:23:09.426 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:09.426 rtt min/avg/max/mdev = 0.272/0.272/0.272/0.000 ms 00:23:09.426 03:39:50 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:23:09.426 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:23:09.426 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.080 ms 00:23:09.426 00:23:09.426 --- 10.0.0.1 ping statistics --- 00:23:09.426 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:09.426 rtt min/avg/max/mdev = 0.080/0.080/0.080/0.000 ms 00:23:09.426 03:39:50 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:23:09.426 03:39:50 -- nvmf/common.sh@410 -- # return 0 00:23:09.426 03:39:50 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:23:09.426 03:39:50 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:23:09.426 03:39:50 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:23:09.426 03:39:50 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:23:09.426 03:39:50 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:23:09.426 03:39:50 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:23:09.426 03:39:50 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:23:09.426 03:39:50 -- host/identify.sh@16 -- # timing_enter start_nvmf_tgt 00:23:09.426 03:39:50 -- common/autotest_common.sh@722 -- # xtrace_disable 00:23:09.426 03:39:50 -- common/autotest_common.sh@10 -- # set +x 00:23:09.426 03:39:50 -- host/identify.sh@19 -- # nvmfpid=3128804 00:23:09.426 03:39:50 -- host/identify.sh@18 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:23:09.426 03:39:50 -- host/identify.sh@21 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:23:09.426 03:39:50 -- host/identify.sh@23 -- # waitforlisten 3128804 00:23:09.426 03:39:50 -- common/autotest_common.sh@829 -- # '[' -z 3128804 ']' 00:23:09.426 03:39:50 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:09.426 03:39:50 -- common/autotest_common.sh@834 -- # local max_retries=100 00:23:09.426 03:39:50 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:09.426 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:09.426 03:39:50 -- common/autotest_common.sh@838 -- # xtrace_disable 00:23:09.426 03:39:50 -- common/autotest_common.sh@10 -- # set +x 00:23:09.687 [2024-11-21 03:39:50.096110] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:09.687 [2024-11-21 03:39:50.096181] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:09.687 EAL: No free 2048 kB hugepages reported on node 1 00:23:09.687 [2024-11-21 03:39:50.162573] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:23:09.687 [2024-11-21 03:39:50.278754] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:23:09.688 [2024-11-21 03:39:50.278924] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:09.688 [2024-11-21 03:39:50.278944] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:09.688 [2024-11-21 03:39:50.278959] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:09.688 [2024-11-21 03:39:50.279041] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:23:09.688 [2024-11-21 03:39:50.279105] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:23:09.688 [2024-11-21 03:39:50.279143] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:23:09.688 [2024-11-21 03:39:50.279146] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:10.627 03:39:51 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:23:10.627 03:39:51 -- common/autotest_common.sh@862 -- # return 0 00:23:10.627 03:39:51 -- host/identify.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:23:10.627 03:39:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:10.627 03:39:51 -- common/autotest_common.sh@10 -- # set +x 00:23:10.627 [2024-11-21 03:39:51.062556] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:10.627 03:39:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:10.627 03:39:51 -- host/identify.sh@25 -- # timing_exit start_nvmf_tgt 00:23:10.627 03:39:51 -- common/autotest_common.sh@728 -- # xtrace_disable 00:23:10.627 03:39:51 -- common/autotest_common.sh@10 -- # set +x 00:23:10.627 03:39:51 -- host/identify.sh@27 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:23:10.627 03:39:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:10.627 03:39:51 -- common/autotest_common.sh@10 -- # set +x 00:23:10.627 Malloc0 00:23:10.627 03:39:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:10.627 03:39:51 -- host/identify.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:23:10.627 03:39:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:10.628 03:39:51 -- common/autotest_common.sh@10 -- # set +x 00:23:10.628 03:39:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:10.628 03:39:51 -- host/identify.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 --nguid ABCDEF0123456789ABCDEF0123456789 --eui64 ABCDEF0123456789 00:23:10.628 03:39:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:10.628 03:39:51 -- common/autotest_common.sh@10 -- # set +x 00:23:10.628 03:39:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:10.628 03:39:51 -- host/identify.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:10.628 03:39:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:10.628 03:39:51 -- common/autotest_common.sh@10 -- # set +x 00:23:10.628 [2024-11-21 03:39:51.133858] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:10.628 03:39:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:10.628 03:39:51 -- host/identify.sh@35 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:23:10.628 03:39:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:10.628 03:39:51 -- common/autotest_common.sh@10 -- # set +x 00:23:10.628 03:39:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:10.628 03:39:51 -- host/identify.sh@37 -- # rpc_cmd nvmf_get_subsystems 00:23:10.628 03:39:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:10.628 03:39:51 -- common/autotest_common.sh@10 -- # set +x 00:23:10.628 [2024-11-21 03:39:51.149664] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:23:10.628 [ 00:23:10.628 { 00:23:10.628 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:23:10.628 "subtype": "Discovery", 00:23:10.628 "listen_addresses": [ 00:23:10.628 { 00:23:10.628 "transport": "TCP", 00:23:10.628 "trtype": "TCP", 00:23:10.628 "adrfam": "IPv4", 00:23:10.628 "traddr": "10.0.0.2", 00:23:10.628 "trsvcid": "4420" 00:23:10.628 } 00:23:10.628 ], 00:23:10.628 "allow_any_host": true, 00:23:10.628 "hosts": [] 00:23:10.628 }, 00:23:10.628 { 00:23:10.628 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:23:10.628 "subtype": "NVMe", 00:23:10.628 "listen_addresses": [ 00:23:10.628 { 00:23:10.628 "transport": "TCP", 00:23:10.628 "trtype": "TCP", 00:23:10.628 "adrfam": "IPv4", 00:23:10.628 "traddr": "10.0.0.2", 00:23:10.628 "trsvcid": "4420" 00:23:10.628 } 00:23:10.628 ], 00:23:10.628 "allow_any_host": true, 00:23:10.628 "hosts": [], 00:23:10.628 "serial_number": "SPDK00000000000001", 00:23:10.628 "model_number": "SPDK bdev Controller", 00:23:10.628 "max_namespaces": 32, 00:23:10.628 "min_cntlid": 1, 00:23:10.628 "max_cntlid": 65519, 00:23:10.628 "namespaces": [ 00:23:10.628 { 00:23:10.628 "nsid": 1, 00:23:10.628 "bdev_name": "Malloc0", 00:23:10.628 "name": "Malloc0", 00:23:10.628 "nguid": "ABCDEF0123456789ABCDEF0123456789", 00:23:10.628 "eui64": "ABCDEF0123456789", 00:23:10.628 "uuid": "32f69f56-456c-4cf5-98f2-45f4f6e03170" 00:23:10.628 } 00:23:10.628 ] 00:23:10.628 } 00:23:10.628 ] 00:23:10.628 03:39:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:10.628 03:39:51 -- host/identify.sh@39 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2014-08.org.nvmexpress.discovery' -L all 00:23:10.628 [2024-11-21 03:39:51.170973] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:10.628 [2024-11-21 03:39:51.171011] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3128965 ] 00:23:10.628 EAL: No free 2048 kB hugepages reported on node 1 00:23:10.628 [2024-11-21 03:39:51.204301] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to connect adminq (no timeout) 00:23:10.628 [2024-11-21 03:39:51.204375] nvme_tcp.c:2244:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:23:10.628 [2024-11-21 03:39:51.204385] nvme_tcp.c:2248:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:23:10.628 [2024-11-21 03:39:51.204399] nvme_tcp.c:2266:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:23:10.628 [2024-11-21 03:39:51.204411] sock.c: 334:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:23:10.628 [2024-11-21 03:39:51.204781] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for connect adminq (no timeout) 00:23:10.628 [2024-11-21 03:39:51.204842] nvme_tcp.c:1487:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0x21d7e10 0 00:23:10.628 [2024-11-21 03:39:51.218082] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:23:10.628 [2024-11-21 03:39:51.218103] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:23:10.628 [2024-11-21 03:39:51.218111] nvme_tcp.c:1533:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:23:10.628 [2024-11-21 03:39:51.218117] nvme_tcp.c:1534:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:23:10.628 [2024-11-21 03:39:51.218181] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.628 [2024-11-21 03:39:51.218194] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.628 [2024-11-21 03:39:51.218201] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x21d7e10) 00:23:10.628 [2024-11-21 03:39:51.218218] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:23:10.628 [2024-11-21 03:39:51.218245] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2257b30, cid 0, qid 0 00:23:10.628 [2024-11-21 03:39:51.225082] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.628 [2024-11-21 03:39:51.225100] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.628 [2024-11-21 03:39:51.225108] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.628 [2024-11-21 03:39:51.225116] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2257b30) on tqpair=0x21d7e10 00:23:10.628 [2024-11-21 03:39:51.225137] nvme_fabric.c: 620:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:23:10.628 [2024-11-21 03:39:51.225149] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs (no timeout) 00:23:10.628 [2024-11-21 03:39:51.225158] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs wait for vs (no timeout) 00:23:10.628 [2024-11-21 03:39:51.225176] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.628 [2024-11-21 03:39:51.225185] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.628 [2024-11-21 03:39:51.225191] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x21d7e10) 00:23:10.628 [2024-11-21 03:39:51.225203] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.628 [2024-11-21 03:39:51.225231] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2257b30, cid 0, qid 0 00:23:10.628 [2024-11-21 03:39:51.225368] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.628 [2024-11-21 03:39:51.225379] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.628 [2024-11-21 03:39:51.225386] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.628 [2024-11-21 03:39:51.225393] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2257b30) on tqpair=0x21d7e10 00:23:10.628 [2024-11-21 03:39:51.225403] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap (no timeout) 00:23:10.628 [2024-11-21 03:39:51.225415] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap wait for cap (no timeout) 00:23:10.628 [2024-11-21 03:39:51.225427] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.628 [2024-11-21 03:39:51.225434] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.628 [2024-11-21 03:39:51.225441] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x21d7e10) 00:23:10.628 [2024-11-21 03:39:51.225451] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.628 [2024-11-21 03:39:51.225472] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2257b30, cid 0, qid 0 00:23:10.628 [2024-11-21 03:39:51.225574] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.628 [2024-11-21 03:39:51.225589] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.628 [2024-11-21 03:39:51.225596] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.628 [2024-11-21 03:39:51.225602] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2257b30) on tqpair=0x21d7e10 00:23:10.628 [2024-11-21 03:39:51.225612] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en (no timeout) 00:23:10.629 [2024-11-21 03:39:51.225625] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en wait for cc (timeout 15000 ms) 00:23:10.629 [2024-11-21 03:39:51.225637] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.629 [2024-11-21 03:39:51.225645] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.629 [2024-11-21 03:39:51.225651] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x21d7e10) 00:23:10.629 [2024-11-21 03:39:51.225661] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.629 [2024-11-21 03:39:51.225682] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2257b30, cid 0, qid 0 00:23:10.629 [2024-11-21 03:39:51.225772] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.629 [2024-11-21 03:39:51.225783] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.629 [2024-11-21 03:39:51.225790] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.629 [2024-11-21 03:39:51.225796] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2257b30) on tqpair=0x21d7e10 00:23:10.629 [2024-11-21 03:39:51.225806] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:23:10.629 [2024-11-21 03:39:51.225822] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.629 [2024-11-21 03:39:51.225831] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.629 [2024-11-21 03:39:51.225837] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x21d7e10) 00:23:10.629 [2024-11-21 03:39:51.225848] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.629 [2024-11-21 03:39:51.225868] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2257b30, cid 0, qid 0 00:23:10.629 [2024-11-21 03:39:51.225962] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.629 [2024-11-21 03:39:51.225981] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.629 [2024-11-21 03:39:51.225989] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.629 [2024-11-21 03:39:51.225995] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2257b30) on tqpair=0x21d7e10 00:23:10.629 [2024-11-21 03:39:51.226005] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 0 && CSTS.RDY = 0 00:23:10.629 [2024-11-21 03:39:51.226013] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to controller is disabled (timeout 15000 ms) 00:23:10.629 [2024-11-21 03:39:51.226026] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:23:10.629 [2024-11-21 03:39:51.226136] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Setting CC.EN = 1 00:23:10.629 [2024-11-21 03:39:51.226145] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:23:10.629 [2024-11-21 03:39:51.226160] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.629 [2024-11-21 03:39:51.226167] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.629 [2024-11-21 03:39:51.226173] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x21d7e10) 00:23:10.629 [2024-11-21 03:39:51.226184] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.629 [2024-11-21 03:39:51.226205] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2257b30, cid 0, qid 0 00:23:10.629 [2024-11-21 03:39:51.226337] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.629 [2024-11-21 03:39:51.226352] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.629 [2024-11-21 03:39:51.226359] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.629 [2024-11-21 03:39:51.226365] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2257b30) on tqpair=0x21d7e10 00:23:10.629 [2024-11-21 03:39:51.226375] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:23:10.629 [2024-11-21 03:39:51.226392] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.629 [2024-11-21 03:39:51.226400] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.629 [2024-11-21 03:39:51.226406] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x21d7e10) 00:23:10.629 [2024-11-21 03:39:51.226417] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.629 [2024-11-21 03:39:51.226437] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2257b30, cid 0, qid 0 00:23:10.629 [2024-11-21 03:39:51.226534] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.629 [2024-11-21 03:39:51.226549] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.629 [2024-11-21 03:39:51.226555] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.629 [2024-11-21 03:39:51.226562] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2257b30) on tqpair=0x21d7e10 00:23:10.629 [2024-11-21 03:39:51.226571] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:23:10.629 [2024-11-21 03:39:51.226579] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to reset admin queue (timeout 30000 ms) 00:23:10.629 [2024-11-21 03:39:51.226592] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to identify controller (no timeout) 00:23:10.629 [2024-11-21 03:39:51.226612] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for identify controller (timeout 30000 ms) 00:23:10.629 [2024-11-21 03:39:51.226631] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.629 [2024-11-21 03:39:51.226639] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.629 [2024-11-21 03:39:51.226645] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x21d7e10) 00:23:10.629 [2024-11-21 03:39:51.226656] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.629 [2024-11-21 03:39:51.226677] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2257b30, cid 0, qid 0 00:23:10.629 [2024-11-21 03:39:51.226811] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:10.629 [2024-11-21 03:39:51.226826] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:10.629 [2024-11-21 03:39:51.226833] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:10.629 [2024-11-21 03:39:51.226840] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x21d7e10): datao=0, datal=4096, cccid=0 00:23:10.629 [2024-11-21 03:39:51.226848] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x2257b30) on tqpair(0x21d7e10): expected_datao=0, payload_size=4096 00:23:10.629 [2024-11-21 03:39:51.226879] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:10.629 [2024-11-21 03:39:51.226889] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:10.629 [2024-11-21 03:39:51.226944] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.629 [2024-11-21 03:39:51.226959] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.629 [2024-11-21 03:39:51.226966] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.629 [2024-11-21 03:39:51.226972] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2257b30) on tqpair=0x21d7e10 00:23:10.629 [2024-11-21 03:39:51.226985] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_xfer_size 4294967295 00:23:10.629 [2024-11-21 03:39:51.226994] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] MDTS max_xfer_size 131072 00:23:10.629 [2024-11-21 03:39:51.227001] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CNTLID 0x0001 00:23:10.629 [2024-11-21 03:39:51.227009] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_sges 16 00:23:10.629 [2024-11-21 03:39:51.227016] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] fuses compare and write: 1 00:23:10.629 [2024-11-21 03:39:51.227024] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to configure AER (timeout 30000 ms) 00:23:10.629 [2024-11-21 03:39:51.227044] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for configure aer (timeout 30000 ms) 00:23:10.629 [2024-11-21 03:39:51.227057] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.629 [2024-11-21 03:39:51.227065] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.629 [2024-11-21 03:39:51.227080] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x21d7e10) 00:23:10.629 [2024-11-21 03:39:51.227092] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:23:10.629 [2024-11-21 03:39:51.227114] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2257b30, cid 0, qid 0 00:23:10.629 [2024-11-21 03:39:51.227226] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.629 [2024-11-21 03:39:51.227241] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.629 [2024-11-21 03:39:51.227247] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.629 [2024-11-21 03:39:51.227254] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2257b30) on tqpair=0x21d7e10 00:23:10.629 [2024-11-21 03:39:51.227266] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.629 [2024-11-21 03:39:51.227273] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.629 [2024-11-21 03:39:51.227284] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x21d7e10) 00:23:10.629 [2024-11-21 03:39:51.227294] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:23:10.629 [2024-11-21 03:39:51.227304] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.629 [2024-11-21 03:39:51.227311] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.629 [2024-11-21 03:39:51.227317] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0x21d7e10) 00:23:10.629 [2024-11-21 03:39:51.227326] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:23:10.629 [2024-11-21 03:39:51.227336] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.629 [2024-11-21 03:39:51.227342] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.629 [2024-11-21 03:39:51.227348] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0x21d7e10) 00:23:10.629 [2024-11-21 03:39:51.227357] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:23:10.629 [2024-11-21 03:39:51.227367] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.629 [2024-11-21 03:39:51.227373] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.629 [2024-11-21 03:39:51.227379] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x21d7e10) 00:23:10.630 [2024-11-21 03:39:51.227388] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:23:10.630 [2024-11-21 03:39:51.227397] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to set keep alive timeout (timeout 30000 ms) 00:23:10.630 [2024-11-21 03:39:51.227432] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:23:10.630 [2024-11-21 03:39:51.227445] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.630 [2024-11-21 03:39:51.227452] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.630 [2024-11-21 03:39:51.227458] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x21d7e10) 00:23:10.630 [2024-11-21 03:39:51.227468] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.630 [2024-11-21 03:39:51.227490] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2257b30, cid 0, qid 0 00:23:10.630 [2024-11-21 03:39:51.227516] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2257c90, cid 1, qid 0 00:23:10.630 [2024-11-21 03:39:51.227524] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2257df0, cid 2, qid 0 00:23:10.630 [2024-11-21 03:39:51.227532] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2257f50, cid 3, qid 0 00:23:10.630 [2024-11-21 03:39:51.227539] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x22580b0, cid 4, qid 0 00:23:10.630 [2024-11-21 03:39:51.227698] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.630 [2024-11-21 03:39:51.227714] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.630 [2024-11-21 03:39:51.227720] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.630 [2024-11-21 03:39:51.227727] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x22580b0) on tqpair=0x21d7e10 00:23:10.630 [2024-11-21 03:39:51.227736] nvme_ctrlr.c:2890:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Sending keep alive every 5000000 us 00:23:10.630 [2024-11-21 03:39:51.227745] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to ready (no timeout) 00:23:10.630 [2024-11-21 03:39:51.227762] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.630 [2024-11-21 03:39:51.227771] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.630 [2024-11-21 03:39:51.227782] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x21d7e10) 00:23:10.630 [2024-11-21 03:39:51.227793] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.630 [2024-11-21 03:39:51.227828] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x22580b0, cid 4, qid 0 00:23:10.630 [2024-11-21 03:39:51.228017] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:10.630 [2024-11-21 03:39:51.228033] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:10.630 [2024-11-21 03:39:51.228040] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:10.630 [2024-11-21 03:39:51.228046] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x21d7e10): datao=0, datal=4096, cccid=4 00:23:10.630 [2024-11-21 03:39:51.228053] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x22580b0) on tqpair(0x21d7e10): expected_datao=0, payload_size=4096 00:23:10.630 [2024-11-21 03:39:51.228078] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:10.630 [2024-11-21 03:39:51.228089] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:10.630 [2024-11-21 03:39:51.271081] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.630 [2024-11-21 03:39:51.271100] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.630 [2024-11-21 03:39:51.271108] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.630 [2024-11-21 03:39:51.271115] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x22580b0) on tqpair=0x21d7e10 00:23:10.630 [2024-11-21 03:39:51.271136] nvme_ctrlr.c:4024:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Ctrlr already in ready state 00:23:10.630 [2024-11-21 03:39:51.271172] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.630 [2024-11-21 03:39:51.271182] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.630 [2024-11-21 03:39:51.271189] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x21d7e10) 00:23:10.630 [2024-11-21 03:39:51.271200] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.630 [2024-11-21 03:39:51.271212] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.630 [2024-11-21 03:39:51.271219] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.630 [2024-11-21 03:39:51.271225] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x21d7e10) 00:23:10.630 [2024-11-21 03:39:51.271234] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:23:10.630 [2024-11-21 03:39:51.271263] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x22580b0, cid 4, qid 0 00:23:10.630 [2024-11-21 03:39:51.271275] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2258210, cid 5, qid 0 00:23:10.630 [2024-11-21 03:39:51.271448] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:10.630 [2024-11-21 03:39:51.271463] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:10.630 [2024-11-21 03:39:51.271470] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:10.630 [2024-11-21 03:39:51.271476] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x21d7e10): datao=0, datal=1024, cccid=4 00:23:10.630 [2024-11-21 03:39:51.271484] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x22580b0) on tqpair(0x21d7e10): expected_datao=0, payload_size=1024 00:23:10.630 [2024-11-21 03:39:51.271494] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:10.630 [2024-11-21 03:39:51.271502] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:10.630 [2024-11-21 03:39:51.271510] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.630 [2024-11-21 03:39:51.271519] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.630 [2024-11-21 03:39:51.271525] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.630 [2024-11-21 03:39:51.271532] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2258210) on tqpair=0x21d7e10 00:23:10.895 [2024-11-21 03:39:51.313081] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.895 [2024-11-21 03:39:51.313100] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.895 [2024-11-21 03:39:51.313108] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.895 [2024-11-21 03:39:51.313114] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x22580b0) on tqpair=0x21d7e10 00:23:10.895 [2024-11-21 03:39:51.313133] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.895 [2024-11-21 03:39:51.313141] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.895 [2024-11-21 03:39:51.313147] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x21d7e10) 00:23:10.895 [2024-11-21 03:39:51.313158] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:02ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.895 [2024-11-21 03:39:51.313204] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x22580b0, cid 4, qid 0 00:23:10.895 [2024-11-21 03:39:51.313385] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:10.895 [2024-11-21 03:39:51.313400] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:10.895 [2024-11-21 03:39:51.313407] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:10.895 [2024-11-21 03:39:51.313414] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x21d7e10): datao=0, datal=3072, cccid=4 00:23:10.895 [2024-11-21 03:39:51.313421] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x22580b0) on tqpair(0x21d7e10): expected_datao=0, payload_size=3072 00:23:10.895 [2024-11-21 03:39:51.313455] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:10.895 [2024-11-21 03:39:51.313465] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:10.895 [2024-11-21 03:39:51.313526] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.895 [2024-11-21 03:39:51.313541] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.895 [2024-11-21 03:39:51.313548] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.895 [2024-11-21 03:39:51.313554] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x22580b0) on tqpair=0x21d7e10 00:23:10.895 [2024-11-21 03:39:51.313571] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.895 [2024-11-21 03:39:51.313579] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.895 [2024-11-21 03:39:51.313586] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x21d7e10) 00:23:10.895 [2024-11-21 03:39:51.313596] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00010070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.895 [2024-11-21 03:39:51.313625] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x22580b0, cid 4, qid 0 00:23:10.895 [2024-11-21 03:39:51.313734] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:10.895 [2024-11-21 03:39:51.313745] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:10.895 [2024-11-21 03:39:51.313752] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:10.895 [2024-11-21 03:39:51.313758] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x21d7e10): datao=0, datal=8, cccid=4 00:23:10.895 [2024-11-21 03:39:51.313766] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x22580b0) on tqpair(0x21d7e10): expected_datao=0, payload_size=8 00:23:10.895 [2024-11-21 03:39:51.313776] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:10.895 [2024-11-21 03:39:51.313784] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:10.895 [2024-11-21 03:39:51.354188] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.895 [2024-11-21 03:39:51.354206] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.895 [2024-11-21 03:39:51.354213] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.895 [2024-11-21 03:39:51.354220] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x22580b0) on tqpair=0x21d7e10 00:23:10.895 ===================================================== 00:23:10.895 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2014-08.org.nvmexpress.discovery 00:23:10.895 ===================================================== 00:23:10.895 Controller Capabilities/Features 00:23:10.895 ================================ 00:23:10.895 Vendor ID: 0000 00:23:10.895 Subsystem Vendor ID: 0000 00:23:10.895 Serial Number: .................... 00:23:10.895 Model Number: ........................................ 00:23:10.895 Firmware Version: 24.01.1 00:23:10.895 Recommended Arb Burst: 0 00:23:10.895 IEEE OUI Identifier: 00 00 00 00:23:10.895 Multi-path I/O 00:23:10.895 May have multiple subsystem ports: No 00:23:10.895 May have multiple controllers: No 00:23:10.895 Associated with SR-IOV VF: No 00:23:10.895 Max Data Transfer Size: 131072 00:23:10.895 Max Number of Namespaces: 0 00:23:10.895 Max Number of I/O Queues: 1024 00:23:10.895 NVMe Specification Version (VS): 1.3 00:23:10.895 NVMe Specification Version (Identify): 1.3 00:23:10.895 Maximum Queue Entries: 128 00:23:10.895 Contiguous Queues Required: Yes 00:23:10.895 Arbitration Mechanisms Supported 00:23:10.895 Weighted Round Robin: Not Supported 00:23:10.895 Vendor Specific: Not Supported 00:23:10.895 Reset Timeout: 15000 ms 00:23:10.895 Doorbell Stride: 4 bytes 00:23:10.895 NVM Subsystem Reset: Not Supported 00:23:10.895 Command Sets Supported 00:23:10.895 NVM Command Set: Supported 00:23:10.895 Boot Partition: Not Supported 00:23:10.895 Memory Page Size Minimum: 4096 bytes 00:23:10.895 Memory Page Size Maximum: 4096 bytes 00:23:10.895 Persistent Memory Region: Not Supported 00:23:10.895 Optional Asynchronous Events Supported 00:23:10.895 Namespace Attribute Notices: Not Supported 00:23:10.895 Firmware Activation Notices: Not Supported 00:23:10.895 ANA Change Notices: Not Supported 00:23:10.895 PLE Aggregate Log Change Notices: Not Supported 00:23:10.895 LBA Status Info Alert Notices: Not Supported 00:23:10.895 EGE Aggregate Log Change Notices: Not Supported 00:23:10.895 Normal NVM Subsystem Shutdown event: Not Supported 00:23:10.895 Zone Descriptor Change Notices: Not Supported 00:23:10.895 Discovery Log Change Notices: Supported 00:23:10.895 Controller Attributes 00:23:10.895 128-bit Host Identifier: Not Supported 00:23:10.895 Non-Operational Permissive Mode: Not Supported 00:23:10.895 NVM Sets: Not Supported 00:23:10.895 Read Recovery Levels: Not Supported 00:23:10.895 Endurance Groups: Not Supported 00:23:10.895 Predictable Latency Mode: Not Supported 00:23:10.895 Traffic Based Keep ALive: Not Supported 00:23:10.895 Namespace Granularity: Not Supported 00:23:10.895 SQ Associations: Not Supported 00:23:10.895 UUID List: Not Supported 00:23:10.895 Multi-Domain Subsystem: Not Supported 00:23:10.895 Fixed Capacity Management: Not Supported 00:23:10.895 Variable Capacity Management: Not Supported 00:23:10.895 Delete Endurance Group: Not Supported 00:23:10.895 Delete NVM Set: Not Supported 00:23:10.895 Extended LBA Formats Supported: Not Supported 00:23:10.895 Flexible Data Placement Supported: Not Supported 00:23:10.895 00:23:10.895 Controller Memory Buffer Support 00:23:10.895 ================================ 00:23:10.895 Supported: No 00:23:10.895 00:23:10.895 Persistent Memory Region Support 00:23:10.895 ================================ 00:23:10.895 Supported: No 00:23:10.895 00:23:10.895 Admin Command Set Attributes 00:23:10.895 ============================ 00:23:10.895 Security Send/Receive: Not Supported 00:23:10.895 Format NVM: Not Supported 00:23:10.895 Firmware Activate/Download: Not Supported 00:23:10.895 Namespace Management: Not Supported 00:23:10.895 Device Self-Test: Not Supported 00:23:10.895 Directives: Not Supported 00:23:10.895 NVMe-MI: Not Supported 00:23:10.895 Virtualization Management: Not Supported 00:23:10.895 Doorbell Buffer Config: Not Supported 00:23:10.895 Get LBA Status Capability: Not Supported 00:23:10.896 Command & Feature Lockdown Capability: Not Supported 00:23:10.896 Abort Command Limit: 1 00:23:10.896 Async Event Request Limit: 4 00:23:10.896 Number of Firmware Slots: N/A 00:23:10.896 Firmware Slot 1 Read-Only: N/A 00:23:10.896 Firmware Activation Without Reset: N/A 00:23:10.896 Multiple Update Detection Support: N/A 00:23:10.896 Firmware Update Granularity: No Information Provided 00:23:10.896 Per-Namespace SMART Log: No 00:23:10.896 Asymmetric Namespace Access Log Page: Not Supported 00:23:10.896 Subsystem NQN: nqn.2014-08.org.nvmexpress.discovery 00:23:10.896 Command Effects Log Page: Not Supported 00:23:10.896 Get Log Page Extended Data: Supported 00:23:10.896 Telemetry Log Pages: Not Supported 00:23:10.896 Persistent Event Log Pages: Not Supported 00:23:10.896 Supported Log Pages Log Page: May Support 00:23:10.896 Commands Supported & Effects Log Page: Not Supported 00:23:10.896 Feature Identifiers & Effects Log Page:May Support 00:23:10.896 NVMe-MI Commands & Effects Log Page: May Support 00:23:10.896 Data Area 4 for Telemetry Log: Not Supported 00:23:10.896 Error Log Page Entries Supported: 128 00:23:10.896 Keep Alive: Not Supported 00:23:10.896 00:23:10.896 NVM Command Set Attributes 00:23:10.896 ========================== 00:23:10.896 Submission Queue Entry Size 00:23:10.896 Max: 1 00:23:10.896 Min: 1 00:23:10.896 Completion Queue Entry Size 00:23:10.896 Max: 1 00:23:10.896 Min: 1 00:23:10.896 Number of Namespaces: 0 00:23:10.896 Compare Command: Not Supported 00:23:10.896 Write Uncorrectable Command: Not Supported 00:23:10.896 Dataset Management Command: Not Supported 00:23:10.896 Write Zeroes Command: Not Supported 00:23:10.896 Set Features Save Field: Not Supported 00:23:10.896 Reservations: Not Supported 00:23:10.896 Timestamp: Not Supported 00:23:10.896 Copy: Not Supported 00:23:10.896 Volatile Write Cache: Not Present 00:23:10.896 Atomic Write Unit (Normal): 1 00:23:10.896 Atomic Write Unit (PFail): 1 00:23:10.896 Atomic Compare & Write Unit: 1 00:23:10.896 Fused Compare & Write: Supported 00:23:10.896 Scatter-Gather List 00:23:10.896 SGL Command Set: Supported 00:23:10.896 SGL Keyed: Supported 00:23:10.896 SGL Bit Bucket Descriptor: Not Supported 00:23:10.896 SGL Metadata Pointer: Not Supported 00:23:10.896 Oversized SGL: Not Supported 00:23:10.896 SGL Metadata Address: Not Supported 00:23:10.896 SGL Offset: Supported 00:23:10.896 Transport SGL Data Block: Not Supported 00:23:10.896 Replay Protected Memory Block: Not Supported 00:23:10.896 00:23:10.896 Firmware Slot Information 00:23:10.896 ========================= 00:23:10.896 Active slot: 0 00:23:10.896 00:23:10.896 00:23:10.896 Error Log 00:23:10.896 ========= 00:23:10.896 00:23:10.896 Active Namespaces 00:23:10.896 ================= 00:23:10.896 Discovery Log Page 00:23:10.896 ================== 00:23:10.896 Generation Counter: 2 00:23:10.896 Number of Records: 2 00:23:10.896 Record Format: 0 00:23:10.896 00:23:10.896 Discovery Log Entry 0 00:23:10.896 ---------------------- 00:23:10.896 Transport Type: 3 (TCP) 00:23:10.896 Address Family: 1 (IPv4) 00:23:10.896 Subsystem Type: 3 (Current Discovery Subsystem) 00:23:10.896 Entry Flags: 00:23:10.896 Duplicate Returned Information: 1 00:23:10.896 Explicit Persistent Connection Support for Discovery: 1 00:23:10.896 Transport Requirements: 00:23:10.896 Secure Channel: Not Required 00:23:10.896 Port ID: 0 (0x0000) 00:23:10.896 Controller ID: 65535 (0xffff) 00:23:10.896 Admin Max SQ Size: 128 00:23:10.896 Transport Service Identifier: 4420 00:23:10.896 NVM Subsystem Qualified Name: nqn.2014-08.org.nvmexpress.discovery 00:23:10.896 Transport Address: 10.0.0.2 00:23:10.896 Discovery Log Entry 1 00:23:10.896 ---------------------- 00:23:10.896 Transport Type: 3 (TCP) 00:23:10.896 Address Family: 1 (IPv4) 00:23:10.896 Subsystem Type: 2 (NVM Subsystem) 00:23:10.896 Entry Flags: 00:23:10.896 Duplicate Returned Information: 0 00:23:10.896 Explicit Persistent Connection Support for Discovery: 0 00:23:10.896 Transport Requirements: 00:23:10.896 Secure Channel: Not Required 00:23:10.896 Port ID: 0 (0x0000) 00:23:10.896 Controller ID: 65535 (0xffff) 00:23:10.896 Admin Max SQ Size: 128 00:23:10.896 Transport Service Identifier: 4420 00:23:10.896 NVM Subsystem Qualified Name: nqn.2016-06.io.spdk:cnode1 00:23:10.896 Transport Address: 10.0.0.2 [2024-11-21 03:39:51.354335] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Prepare to destruct SSD 00:23:10.896 [2024-11-21 03:39:51.354360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:10.896 [2024-11-21 03:39:51.354372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:10.896 [2024-11-21 03:39:51.354382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:10.896 [2024-11-21 03:39:51.354391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:10.896 [2024-11-21 03:39:51.354405] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.896 [2024-11-21 03:39:51.354412] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.896 [2024-11-21 03:39:51.354418] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x21d7e10) 00:23:10.896 [2024-11-21 03:39:51.354429] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.896 [2024-11-21 03:39:51.354455] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2257f50, cid 3, qid 0 00:23:10.896 [2024-11-21 03:39:51.354570] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.896 [2024-11-21 03:39:51.354583] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.896 [2024-11-21 03:39:51.354589] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.896 [2024-11-21 03:39:51.354596] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2257f50) on tqpair=0x21d7e10 00:23:10.896 [2024-11-21 03:39:51.354608] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.896 [2024-11-21 03:39:51.354616] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.896 [2024-11-21 03:39:51.354622] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x21d7e10) 00:23:10.896 [2024-11-21 03:39:51.354632] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.896 [2024-11-21 03:39:51.354658] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2257f50, cid 3, qid 0 00:23:10.896 [2024-11-21 03:39:51.354783] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.896 [2024-11-21 03:39:51.354798] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.896 [2024-11-21 03:39:51.354805] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.896 [2024-11-21 03:39:51.354811] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2257f50) on tqpair=0x21d7e10 00:23:10.896 [2024-11-21 03:39:51.354820] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] RTD3E = 0 us 00:23:10.896 [2024-11-21 03:39:51.354828] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown timeout = 10000 ms 00:23:10.896 [2024-11-21 03:39:51.354844] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.896 [2024-11-21 03:39:51.354853] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.896 [2024-11-21 03:39:51.354859] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x21d7e10) 00:23:10.896 [2024-11-21 03:39:51.354870] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.896 [2024-11-21 03:39:51.354890] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2257f50, cid 3, qid 0 00:23:10.896 [2024-11-21 03:39:51.354988] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.896 [2024-11-21 03:39:51.355003] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.896 [2024-11-21 03:39:51.355010] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.896 [2024-11-21 03:39:51.355016] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2257f50) on tqpair=0x21d7e10 00:23:10.896 [2024-11-21 03:39:51.355038] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.896 [2024-11-21 03:39:51.355048] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.896 [2024-11-21 03:39:51.355055] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x21d7e10) 00:23:10.896 [2024-11-21 03:39:51.355065] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.896 [2024-11-21 03:39:51.355097] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2257f50, cid 3, qid 0 00:23:10.896 [2024-11-21 03:39:51.355208] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.896 [2024-11-21 03:39:51.355223] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.896 [2024-11-21 03:39:51.355230] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.896 [2024-11-21 03:39:51.355236] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2257f50) on tqpair=0x21d7e10 00:23:10.896 [2024-11-21 03:39:51.355254] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.896 [2024-11-21 03:39:51.355263] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.896 [2024-11-21 03:39:51.355269] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x21d7e10) 00:23:10.896 [2024-11-21 03:39:51.355280] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.896 [2024-11-21 03:39:51.355301] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2257f50, cid 3, qid 0 00:23:10.896 [2024-11-21 03:39:51.355391] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.897 [2024-11-21 03:39:51.355406] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.897 [2024-11-21 03:39:51.355413] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.897 [2024-11-21 03:39:51.355419] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2257f50) on tqpair=0x21d7e10 00:23:10.897 [2024-11-21 03:39:51.355437] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.897 [2024-11-21 03:39:51.355446] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.897 [2024-11-21 03:39:51.355452] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x21d7e10) 00:23:10.897 [2024-11-21 03:39:51.355463] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.897 [2024-11-21 03:39:51.355483] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2257f50, cid 3, qid 0 00:23:10.897 [2024-11-21 03:39:51.355577] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.897 [2024-11-21 03:39:51.355589] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.897 [2024-11-21 03:39:51.355595] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.897 [2024-11-21 03:39:51.355602] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2257f50) on tqpair=0x21d7e10 00:23:10.897 [2024-11-21 03:39:51.355619] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.897 [2024-11-21 03:39:51.355628] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.897 [2024-11-21 03:39:51.355634] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x21d7e10) 00:23:10.897 [2024-11-21 03:39:51.355645] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.897 [2024-11-21 03:39:51.355665] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2257f50, cid 3, qid 0 00:23:10.897 [2024-11-21 03:39:51.355775] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.897 [2024-11-21 03:39:51.355790] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.897 [2024-11-21 03:39:51.355797] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.897 [2024-11-21 03:39:51.355803] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2257f50) on tqpair=0x21d7e10 00:23:10.897 [2024-11-21 03:39:51.355821] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.897 [2024-11-21 03:39:51.355834] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.897 [2024-11-21 03:39:51.355840] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x21d7e10) 00:23:10.897 [2024-11-21 03:39:51.355851] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.897 [2024-11-21 03:39:51.355872] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2257f50, cid 3, qid 0 00:23:10.897 [2024-11-21 03:39:51.355958] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.897 [2024-11-21 03:39:51.355970] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.897 [2024-11-21 03:39:51.355977] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.897 [2024-11-21 03:39:51.355983] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2257f50) on tqpair=0x21d7e10 00:23:10.897 [2024-11-21 03:39:51.356000] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.897 [2024-11-21 03:39:51.356009] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.897 [2024-11-21 03:39:51.356015] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x21d7e10) 00:23:10.897 [2024-11-21 03:39:51.356026] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.897 [2024-11-21 03:39:51.356046] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2257f50, cid 3, qid 0 00:23:10.897 [2024-11-21 03:39:51.356146] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.897 [2024-11-21 03:39:51.356160] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.897 [2024-11-21 03:39:51.356166] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.897 [2024-11-21 03:39:51.356173] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2257f50) on tqpair=0x21d7e10 00:23:10.897 [2024-11-21 03:39:51.356190] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.897 [2024-11-21 03:39:51.356199] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.897 [2024-11-21 03:39:51.356205] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x21d7e10) 00:23:10.897 [2024-11-21 03:39:51.356216] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.897 [2024-11-21 03:39:51.356237] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2257f50, cid 3, qid 0 00:23:10.897 [2024-11-21 03:39:51.356328] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.897 [2024-11-21 03:39:51.356343] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.897 [2024-11-21 03:39:51.356349] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.897 [2024-11-21 03:39:51.356356] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2257f50) on tqpair=0x21d7e10 00:23:10.897 [2024-11-21 03:39:51.356373] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.897 [2024-11-21 03:39:51.356382] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.897 [2024-11-21 03:39:51.356389] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x21d7e10) 00:23:10.897 [2024-11-21 03:39:51.356399] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.897 [2024-11-21 03:39:51.356420] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2257f50, cid 3, qid 0 00:23:10.897 [2024-11-21 03:39:51.356508] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.897 [2024-11-21 03:39:51.356520] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.897 [2024-11-21 03:39:51.356526] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.897 [2024-11-21 03:39:51.356533] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2257f50) on tqpair=0x21d7e10 00:23:10.897 [2024-11-21 03:39:51.356550] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.897 [2024-11-21 03:39:51.356559] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.897 [2024-11-21 03:39:51.356569] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x21d7e10) 00:23:10.897 [2024-11-21 03:39:51.356580] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.897 [2024-11-21 03:39:51.356601] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2257f50, cid 3, qid 0 00:23:10.897 [2024-11-21 03:39:51.356704] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.897 [2024-11-21 03:39:51.356719] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.897 [2024-11-21 03:39:51.356726] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.897 [2024-11-21 03:39:51.356733] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2257f50) on tqpair=0x21d7e10 00:23:10.897 [2024-11-21 03:39:51.356750] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.897 [2024-11-21 03:39:51.356759] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.897 [2024-11-21 03:39:51.356765] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x21d7e10) 00:23:10.897 [2024-11-21 03:39:51.356776] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.897 [2024-11-21 03:39:51.356796] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2257f50, cid 3, qid 0 00:23:10.897 [2024-11-21 03:39:51.356893] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.897 [2024-11-21 03:39:51.356908] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.897 [2024-11-21 03:39:51.356915] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.897 [2024-11-21 03:39:51.356921] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2257f50) on tqpair=0x21d7e10 00:23:10.897 [2024-11-21 03:39:51.356939] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.897 [2024-11-21 03:39:51.356948] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.897 [2024-11-21 03:39:51.356954] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x21d7e10) 00:23:10.897 [2024-11-21 03:39:51.356964] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.897 [2024-11-21 03:39:51.356985] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2257f50, cid 3, qid 0 00:23:10.897 [2024-11-21 03:39:51.361082] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.897 [2024-11-21 03:39:51.361100] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.897 [2024-11-21 03:39:51.361107] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.897 [2024-11-21 03:39:51.361114] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2257f50) on tqpair=0x21d7e10 00:23:10.897 [2024-11-21 03:39:51.361133] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.897 [2024-11-21 03:39:51.361143] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.897 [2024-11-21 03:39:51.361149] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x21d7e10) 00:23:10.897 [2024-11-21 03:39:51.361160] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.897 [2024-11-21 03:39:51.361182] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2257f50, cid 3, qid 0 00:23:10.897 [2024-11-21 03:39:51.361307] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.897 [2024-11-21 03:39:51.361322] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.897 [2024-11-21 03:39:51.361328] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.897 [2024-11-21 03:39:51.361335] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2257f50) on tqpair=0x21d7e10 00:23:10.897 [2024-11-21 03:39:51.361349] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown complete in 6 milliseconds 00:23:10.897 00:23:10.897 03:39:51 -- host/identify.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -L all 00:23:10.897 [2024-11-21 03:39:51.391529] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:10.897 [2024-11-21 03:39:51.391568] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3128967 ] 00:23:10.897 EAL: No free 2048 kB hugepages reported on node 1 00:23:10.897 [2024-11-21 03:39:51.422858] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to connect adminq (no timeout) 00:23:10.897 [2024-11-21 03:39:51.422908] nvme_tcp.c:2244:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:23:10.897 [2024-11-21 03:39:51.422918] nvme_tcp.c:2248:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:23:10.897 [2024-11-21 03:39:51.422932] nvme_tcp.c:2266:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:23:10.898 [2024-11-21 03:39:51.422944] sock.c: 334:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:23:10.898 [2024-11-21 03:39:51.426106] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for connect adminq (no timeout) 00:23:10.898 [2024-11-21 03:39:51.426156] nvme_tcp.c:1487:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0x1222e10 0 00:23:10.898 [2024-11-21 03:39:51.434086] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:23:10.898 [2024-11-21 03:39:51.434105] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:23:10.898 [2024-11-21 03:39:51.434120] nvme_tcp.c:1533:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:23:10.898 [2024-11-21 03:39:51.434126] nvme_tcp.c:1534:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:23:10.898 [2024-11-21 03:39:51.434164] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.898 [2024-11-21 03:39:51.434176] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.898 [2024-11-21 03:39:51.434183] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1222e10) 00:23:10.898 [2024-11-21 03:39:51.434197] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:23:10.898 [2024-11-21 03:39:51.434223] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x12a2b30, cid 0, qid 0 00:23:10.898 [2024-11-21 03:39:51.442086] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.898 [2024-11-21 03:39:51.442103] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.898 [2024-11-21 03:39:51.442111] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.898 [2024-11-21 03:39:51.442117] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x12a2b30) on tqpair=0x1222e10 00:23:10.898 [2024-11-21 03:39:51.442132] nvme_fabric.c: 620:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:23:10.898 [2024-11-21 03:39:51.442142] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs (no timeout) 00:23:10.898 [2024-11-21 03:39:51.442151] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs wait for vs (no timeout) 00:23:10.898 [2024-11-21 03:39:51.442168] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.898 [2024-11-21 03:39:51.442176] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.898 [2024-11-21 03:39:51.442182] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1222e10) 00:23:10.898 [2024-11-21 03:39:51.442194] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.898 [2024-11-21 03:39:51.442218] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x12a2b30, cid 0, qid 0 00:23:10.898 [2024-11-21 03:39:51.442355] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.898 [2024-11-21 03:39:51.442368] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.898 [2024-11-21 03:39:51.442375] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.898 [2024-11-21 03:39:51.442382] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x12a2b30) on tqpair=0x1222e10 00:23:10.898 [2024-11-21 03:39:51.442391] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap (no timeout) 00:23:10.898 [2024-11-21 03:39:51.442404] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap wait for cap (no timeout) 00:23:10.898 [2024-11-21 03:39:51.442416] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.898 [2024-11-21 03:39:51.442423] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.898 [2024-11-21 03:39:51.442429] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1222e10) 00:23:10.898 [2024-11-21 03:39:51.442440] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.898 [2024-11-21 03:39:51.442461] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x12a2b30, cid 0, qid 0 00:23:10.898 [2024-11-21 03:39:51.442559] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.898 [2024-11-21 03:39:51.442571] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.898 [2024-11-21 03:39:51.442578] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.898 [2024-11-21 03:39:51.442584] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x12a2b30) on tqpair=0x1222e10 00:23:10.898 [2024-11-21 03:39:51.442594] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en (no timeout) 00:23:10.898 [2024-11-21 03:39:51.442607] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en wait for cc (timeout 15000 ms) 00:23:10.898 [2024-11-21 03:39:51.442618] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.898 [2024-11-21 03:39:51.442626] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.898 [2024-11-21 03:39:51.442632] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1222e10) 00:23:10.898 [2024-11-21 03:39:51.442642] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.898 [2024-11-21 03:39:51.442663] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x12a2b30, cid 0, qid 0 00:23:10.898 [2024-11-21 03:39:51.442768] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.898 [2024-11-21 03:39:51.442783] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.898 [2024-11-21 03:39:51.442790] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.898 [2024-11-21 03:39:51.442796] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x12a2b30) on tqpair=0x1222e10 00:23:10.898 [2024-11-21 03:39:51.442806] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:23:10.898 [2024-11-21 03:39:51.442823] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.898 [2024-11-21 03:39:51.442831] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.898 [2024-11-21 03:39:51.442838] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1222e10) 00:23:10.898 [2024-11-21 03:39:51.442848] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.898 [2024-11-21 03:39:51.442869] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x12a2b30, cid 0, qid 0 00:23:10.898 [2024-11-21 03:39:51.442968] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.898 [2024-11-21 03:39:51.442983] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.898 [2024-11-21 03:39:51.442989] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.898 [2024-11-21 03:39:51.443000] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x12a2b30) on tqpair=0x1222e10 00:23:10.898 [2024-11-21 03:39:51.443009] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 0 && CSTS.RDY = 0 00:23:10.898 [2024-11-21 03:39:51.443017] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to controller is disabled (timeout 15000 ms) 00:23:10.898 [2024-11-21 03:39:51.443030] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:23:10.898 [2024-11-21 03:39:51.443140] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Setting CC.EN = 1 00:23:10.898 [2024-11-21 03:39:51.443164] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:23:10.898 [2024-11-21 03:39:51.443176] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.898 [2024-11-21 03:39:51.443183] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.898 [2024-11-21 03:39:51.443189] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1222e10) 00:23:10.898 [2024-11-21 03:39:51.443199] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.898 [2024-11-21 03:39:51.443221] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x12a2b30, cid 0, qid 0 00:23:10.898 [2024-11-21 03:39:51.443361] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.898 [2024-11-21 03:39:51.443376] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.898 [2024-11-21 03:39:51.443383] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.898 [2024-11-21 03:39:51.443390] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x12a2b30) on tqpair=0x1222e10 00:23:10.898 [2024-11-21 03:39:51.443399] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:23:10.898 [2024-11-21 03:39:51.443416] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.898 [2024-11-21 03:39:51.443425] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.898 [2024-11-21 03:39:51.443431] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1222e10) 00:23:10.898 [2024-11-21 03:39:51.443442] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.898 [2024-11-21 03:39:51.443463] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x12a2b30, cid 0, qid 0 00:23:10.898 [2024-11-21 03:39:51.443564] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.898 [2024-11-21 03:39:51.443576] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.898 [2024-11-21 03:39:51.443583] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.898 [2024-11-21 03:39:51.443589] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x12a2b30) on tqpair=0x1222e10 00:23:10.898 [2024-11-21 03:39:51.443598] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:23:10.898 [2024-11-21 03:39:51.443606] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to reset admin queue (timeout 30000 ms) 00:23:10.898 [2024-11-21 03:39:51.443618] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller (no timeout) 00:23:10.898 [2024-11-21 03:39:51.443632] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify controller (timeout 30000 ms) 00:23:10.898 [2024-11-21 03:39:51.443646] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.898 [2024-11-21 03:39:51.443653] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.898 [2024-11-21 03:39:51.443659] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1222e10) 00:23:10.898 [2024-11-21 03:39:51.443673] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.898 [2024-11-21 03:39:51.443695] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x12a2b30, cid 0, qid 0 00:23:10.898 [2024-11-21 03:39:51.443831] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:10.898 [2024-11-21 03:39:51.443846] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:10.898 [2024-11-21 03:39:51.443853] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:10.898 [2024-11-21 03:39:51.443859] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1222e10): datao=0, datal=4096, cccid=0 00:23:10.898 [2024-11-21 03:39:51.443867] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x12a2b30) on tqpair(0x1222e10): expected_datao=0, payload_size=4096 00:23:10.898 [2024-11-21 03:39:51.443878] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:10.898 [2024-11-21 03:39:51.443886] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:10.899 [2024-11-21 03:39:51.443897] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.899 [2024-11-21 03:39:51.443907] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.899 [2024-11-21 03:39:51.443913] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.899 [2024-11-21 03:39:51.443920] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x12a2b30) on tqpair=0x1222e10 00:23:10.899 [2024-11-21 03:39:51.443932] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_xfer_size 4294967295 00:23:10.899 [2024-11-21 03:39:51.443940] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] MDTS max_xfer_size 131072 00:23:10.899 [2024-11-21 03:39:51.443947] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CNTLID 0x0001 00:23:10.899 [2024-11-21 03:39:51.443954] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_sges 16 00:23:10.899 [2024-11-21 03:39:51.443961] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] fuses compare and write: 1 00:23:10.899 [2024-11-21 03:39:51.443968] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to configure AER (timeout 30000 ms) 00:23:10.899 [2024-11-21 03:39:51.443987] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for configure aer (timeout 30000 ms) 00:23:10.899 [2024-11-21 03:39:51.444000] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.899 [2024-11-21 03:39:51.444007] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.899 [2024-11-21 03:39:51.444013] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1222e10) 00:23:10.899 [2024-11-21 03:39:51.444024] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:23:10.899 [2024-11-21 03:39:51.444045] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x12a2b30, cid 0, qid 0 00:23:10.899 [2024-11-21 03:39:51.444161] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.899 [2024-11-21 03:39:51.444177] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.899 [2024-11-21 03:39:51.444184] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.899 [2024-11-21 03:39:51.444190] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x12a2b30) on tqpair=0x1222e10 00:23:10.899 [2024-11-21 03:39:51.444201] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.899 [2024-11-21 03:39:51.444208] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.899 [2024-11-21 03:39:51.444214] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1222e10) 00:23:10.899 [2024-11-21 03:39:51.444224] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:23:10.899 [2024-11-21 03:39:51.444234] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.899 [2024-11-21 03:39:51.444244] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.899 [2024-11-21 03:39:51.444251] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0x1222e10) 00:23:10.899 [2024-11-21 03:39:51.444260] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:23:10.899 [2024-11-21 03:39:51.444270] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.899 [2024-11-21 03:39:51.444276] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.899 [2024-11-21 03:39:51.444282] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0x1222e10) 00:23:10.899 [2024-11-21 03:39:51.444291] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:23:10.899 [2024-11-21 03:39:51.444300] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.899 [2024-11-21 03:39:51.444307] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.899 [2024-11-21 03:39:51.444312] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1222e10) 00:23:10.899 [2024-11-21 03:39:51.444336] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:23:10.899 [2024-11-21 03:39:51.444345] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set keep alive timeout (timeout 30000 ms) 00:23:10.899 [2024-11-21 03:39:51.444364] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:23:10.899 [2024-11-21 03:39:51.444376] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.899 [2024-11-21 03:39:51.444382] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.899 [2024-11-21 03:39:51.444403] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1222e10) 00:23:10.899 [2024-11-21 03:39:51.444413] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.899 [2024-11-21 03:39:51.444435] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x12a2b30, cid 0, qid 0 00:23:10.899 [2024-11-21 03:39:51.444446] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x12a2c90, cid 1, qid 0 00:23:10.899 [2024-11-21 03:39:51.444467] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x12a2df0, cid 2, qid 0 00:23:10.899 [2024-11-21 03:39:51.444475] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x12a2f50, cid 3, qid 0 00:23:10.899 [2024-11-21 03:39:51.444482] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x12a30b0, cid 4, qid 0 00:23:10.899 [2024-11-21 03:39:51.444653] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.899 [2024-11-21 03:39:51.444668] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.899 [2024-11-21 03:39:51.444675] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.899 [2024-11-21 03:39:51.444681] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x12a30b0) on tqpair=0x1222e10 00:23:10.899 [2024-11-21 03:39:51.444690] nvme_ctrlr.c:2890:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Sending keep alive every 5000000 us 00:23:10.899 [2024-11-21 03:39:51.444698] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller iocs specific (timeout 30000 ms) 00:23:10.899 [2024-11-21 03:39:51.444712] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set number of queues (timeout 30000 ms) 00:23:10.899 [2024-11-21 03:39:51.444727] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set number of queues (timeout 30000 ms) 00:23:10.899 [2024-11-21 03:39:51.444739] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.899 [2024-11-21 03:39:51.444746] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.899 [2024-11-21 03:39:51.444768] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1222e10) 00:23:10.899 [2024-11-21 03:39:51.444781] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:4 cdw10:00000007 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:23:10.899 [2024-11-21 03:39:51.444802] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x12a30b0, cid 4, qid 0 00:23:10.899 [2024-11-21 03:39:51.444952] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.899 [2024-11-21 03:39:51.444967] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.899 [2024-11-21 03:39:51.444974] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.899 [2024-11-21 03:39:51.444981] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x12a30b0) on tqpair=0x1222e10 00:23:10.899 [2024-11-21 03:39:51.445046] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify active ns (timeout 30000 ms) 00:23:10.899 [2024-11-21 03:39:51.445065] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify active ns (timeout 30000 ms) 00:23:10.899 [2024-11-21 03:39:51.445087] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.899 [2024-11-21 03:39:51.445095] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.899 [2024-11-21 03:39:51.445101] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1222e10) 00:23:10.899 [2024-11-21 03:39:51.445112] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.899 [2024-11-21 03:39:51.445148] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x12a30b0, cid 4, qid 0 00:23:10.899 [2024-11-21 03:39:51.445340] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:10.899 [2024-11-21 03:39:51.445355] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:10.899 [2024-11-21 03:39:51.445362] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:10.899 [2024-11-21 03:39:51.445368] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1222e10): datao=0, datal=4096, cccid=4 00:23:10.899 [2024-11-21 03:39:51.445376] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x12a30b0) on tqpair(0x1222e10): expected_datao=0, payload_size=4096 00:23:10.899 [2024-11-21 03:39:51.445387] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:10.899 [2024-11-21 03:39:51.445394] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:10.899 [2024-11-21 03:39:51.445406] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.899 [2024-11-21 03:39:51.445415] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.899 [2024-11-21 03:39:51.445422] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.899 [2024-11-21 03:39:51.445428] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x12a30b0) on tqpair=0x1222e10 00:23:10.900 [2024-11-21 03:39:51.445453] nvme_ctrlr.c:4556:spdk_nvme_ctrlr_get_ns: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Namespace 1 was added 00:23:10.900 [2024-11-21 03:39:51.445469] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns (timeout 30000 ms) 00:23:10.900 [2024-11-21 03:39:51.445487] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify ns (timeout 30000 ms) 00:23:10.900 [2024-11-21 03:39:51.445500] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.900 [2024-11-21 03:39:51.445507] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.900 [2024-11-21 03:39:51.445514] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1222e10) 00:23:10.900 [2024-11-21 03:39:51.445524] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000000 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.900 [2024-11-21 03:39:51.445546] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x12a30b0, cid 4, qid 0 00:23:10.900 [2024-11-21 03:39:51.445669] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:10.900 [2024-11-21 03:39:51.445684] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:10.900 [2024-11-21 03:39:51.445695] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:10.900 [2024-11-21 03:39:51.445702] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1222e10): datao=0, datal=4096, cccid=4 00:23:10.900 [2024-11-21 03:39:51.445709] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x12a30b0) on tqpair(0x1222e10): expected_datao=0, payload_size=4096 00:23:10.900 [2024-11-21 03:39:51.445720] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:10.900 [2024-11-21 03:39:51.445727] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:10.900 [2024-11-21 03:39:51.445739] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.900 [2024-11-21 03:39:51.445749] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.900 [2024-11-21 03:39:51.445755] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.900 [2024-11-21 03:39:51.445761] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x12a30b0) on tqpair=0x1222e10 00:23:10.900 [2024-11-21 03:39:51.445784] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify namespace id descriptors (timeout 30000 ms) 00:23:10.900 [2024-11-21 03:39:51.445803] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:23:10.900 [2024-11-21 03:39:51.445816] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.900 [2024-11-21 03:39:51.445824] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.900 [2024-11-21 03:39:51.445830] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1222e10) 00:23:10.900 [2024-11-21 03:39:51.445840] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.900 [2024-11-21 03:39:51.445862] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x12a30b0, cid 4, qid 0 00:23:10.900 [2024-11-21 03:39:51.445980] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:10.900 [2024-11-21 03:39:51.445996] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:10.900 [2024-11-21 03:39:51.446004] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:10.900 [2024-11-21 03:39:51.446010] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1222e10): datao=0, datal=4096, cccid=4 00:23:10.900 [2024-11-21 03:39:51.446017] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x12a30b0) on tqpair(0x1222e10): expected_datao=0, payload_size=4096 00:23:10.900 [2024-11-21 03:39:51.446028] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:10.900 [2024-11-21 03:39:51.446036] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:10.900 [2024-11-21 03:39:51.446047] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.900 [2024-11-21 03:39:51.446057] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.900 [2024-11-21 03:39:51.446063] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.900 [2024-11-21 03:39:51.450078] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x12a30b0) on tqpair=0x1222e10 00:23:10.900 [2024-11-21 03:39:51.450097] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns iocs specific (timeout 30000 ms) 00:23:10.900 [2024-11-21 03:39:51.450114] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported log pages (timeout 30000 ms) 00:23:10.900 [2024-11-21 03:39:51.450129] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported features (timeout 30000 ms) 00:23:10.900 [2024-11-21 03:39:51.450139] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set doorbell buffer config (timeout 30000 ms) 00:23:10.900 [2024-11-21 03:39:51.450147] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set host ID (timeout 30000 ms) 00:23:10.900 [2024-11-21 03:39:51.450155] nvme_ctrlr.c:2978:nvme_ctrlr_set_host_id: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] NVMe-oF transport - not sending Set Features - Host ID 00:23:10.900 [2024-11-21 03:39:51.450166] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to transport ready (timeout 30000 ms) 00:23:10.900 [2024-11-21 03:39:51.450175] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to ready (no timeout) 00:23:10.900 [2024-11-21 03:39:51.450193] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.900 [2024-11-21 03:39:51.450201] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.900 [2024-11-21 03:39:51.450207] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1222e10) 00:23:10.900 [2024-11-21 03:39:51.450218] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:4 cdw10:00000001 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.900 [2024-11-21 03:39:51.450229] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.900 [2024-11-21 03:39:51.450236] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.900 [2024-11-21 03:39:51.450242] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x1222e10) 00:23:10.900 [2024-11-21 03:39:51.450251] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:23:10.900 [2024-11-21 03:39:51.450277] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x12a30b0, cid 4, qid 0 00:23:10.900 [2024-11-21 03:39:51.450289] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x12a3210, cid 5, qid 0 00:23:10.900 [2024-11-21 03:39:51.450433] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.900 [2024-11-21 03:39:51.450445] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.900 [2024-11-21 03:39:51.450452] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.900 [2024-11-21 03:39:51.450458] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x12a30b0) on tqpair=0x1222e10 00:23:10.900 [2024-11-21 03:39:51.450469] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.900 [2024-11-21 03:39:51.450478] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.900 [2024-11-21 03:39:51.450484] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.900 [2024-11-21 03:39:51.450490] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x12a3210) on tqpair=0x1222e10 00:23:10.900 [2024-11-21 03:39:51.450506] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.900 [2024-11-21 03:39:51.450515] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.900 [2024-11-21 03:39:51.450521] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x1222e10) 00:23:10.900 [2024-11-21 03:39:51.450531] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:5 cdw10:00000002 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.900 [2024-11-21 03:39:51.450552] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x12a3210, cid 5, qid 0 00:23:10.900 [2024-11-21 03:39:51.450656] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.900 [2024-11-21 03:39:51.450668] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.900 [2024-11-21 03:39:51.450675] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.900 [2024-11-21 03:39:51.450681] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x12a3210) on tqpair=0x1222e10 00:23:10.900 [2024-11-21 03:39:51.450697] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.900 [2024-11-21 03:39:51.450706] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.900 [2024-11-21 03:39:51.450712] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x1222e10) 00:23:10.900 [2024-11-21 03:39:51.450722] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:5 cdw10:00000004 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.900 [2024-11-21 03:39:51.450742] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x12a3210, cid 5, qid 0 00:23:10.900 [2024-11-21 03:39:51.450840] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.900 [2024-11-21 03:39:51.450853] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.900 [2024-11-21 03:39:51.450859] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.900 [2024-11-21 03:39:51.450866] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x12a3210) on tqpair=0x1222e10 00:23:10.900 [2024-11-21 03:39:51.450882] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.900 [2024-11-21 03:39:51.450891] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.900 [2024-11-21 03:39:51.450897] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x1222e10) 00:23:10.900 [2024-11-21 03:39:51.450907] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:5 cdw10:00000007 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.900 [2024-11-21 03:39:51.450927] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x12a3210, cid 5, qid 0 00:23:10.900 [2024-11-21 03:39:51.451025] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.900 [2024-11-21 03:39:51.451037] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.900 [2024-11-21 03:39:51.451043] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.900 [2024-11-21 03:39:51.451050] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x12a3210) on tqpair=0x1222e10 00:23:10.900 [2024-11-21 03:39:51.451078] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.900 [2024-11-21 03:39:51.451089] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.900 [2024-11-21 03:39:51.451095] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x1222e10) 00:23:10.900 [2024-11-21 03:39:51.451105] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:5 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.900 [2024-11-21 03:39:51.451118] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.900 [2024-11-21 03:39:51.451125] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.900 [2024-11-21 03:39:51.451131] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1222e10) 00:23:10.900 [2024-11-21 03:39:51.451140] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:ffffffff cdw10:007f0002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.900 [2024-11-21 03:39:51.451152] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.900 [2024-11-21 03:39:51.451159] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.900 [2024-11-21 03:39:51.451165] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=6 on tqpair(0x1222e10) 00:23:10.901 [2024-11-21 03:39:51.451174] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:6 nsid:ffffffff cdw10:007f0003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.901 [2024-11-21 03:39:51.451186] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.901 [2024-11-21 03:39:51.451193] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.901 [2024-11-21 03:39:51.451199] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0x1222e10) 00:23:10.901 [2024-11-21 03:39:51.451224] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:7 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.901 [2024-11-21 03:39:51.451246] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x12a3210, cid 5, qid 0 00:23:10.901 [2024-11-21 03:39:51.451257] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x12a30b0, cid 4, qid 0 00:23:10.901 [2024-11-21 03:39:51.451264] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x12a3370, cid 6, qid 0 00:23:10.901 [2024-11-21 03:39:51.451287] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x12a34d0, cid 7, qid 0 00:23:10.901 [2024-11-21 03:39:51.451506] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:10.901 [2024-11-21 03:39:51.451522] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:10.901 [2024-11-21 03:39:51.451532] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:10.901 [2024-11-21 03:39:51.451539] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1222e10): datao=0, datal=8192, cccid=5 00:23:10.901 [2024-11-21 03:39:51.451546] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x12a3210) on tqpair(0x1222e10): expected_datao=0, payload_size=8192 00:23:10.901 [2024-11-21 03:39:51.451572] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:10.901 [2024-11-21 03:39:51.451584] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:10.901 [2024-11-21 03:39:51.451593] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:10.901 [2024-11-21 03:39:51.451601] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:10.901 [2024-11-21 03:39:51.451608] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:10.901 [2024-11-21 03:39:51.451614] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1222e10): datao=0, datal=512, cccid=4 00:23:10.901 [2024-11-21 03:39:51.451621] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x12a30b0) on tqpair(0x1222e10): expected_datao=0, payload_size=512 00:23:10.901 [2024-11-21 03:39:51.451631] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:10.901 [2024-11-21 03:39:51.451637] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:10.901 [2024-11-21 03:39:51.451646] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:10.901 [2024-11-21 03:39:51.451654] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:10.901 [2024-11-21 03:39:51.451660] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:10.901 [2024-11-21 03:39:51.451666] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1222e10): datao=0, datal=512, cccid=6 00:23:10.901 [2024-11-21 03:39:51.451673] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x12a3370) on tqpair(0x1222e10): expected_datao=0, payload_size=512 00:23:10.901 [2024-11-21 03:39:51.451683] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:10.901 [2024-11-21 03:39:51.451690] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:10.901 [2024-11-21 03:39:51.451698] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:10.901 [2024-11-21 03:39:51.451706] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:10.901 [2024-11-21 03:39:51.451712] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:10.901 [2024-11-21 03:39:51.451718] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1222e10): datao=0, datal=4096, cccid=7 00:23:10.901 [2024-11-21 03:39:51.451725] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x12a34d0) on tqpair(0x1222e10): expected_datao=0, payload_size=4096 00:23:10.901 [2024-11-21 03:39:51.451735] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:10.901 [2024-11-21 03:39:51.451742] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:10.901 [2024-11-21 03:39:51.451753] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.901 [2024-11-21 03:39:51.451763] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.901 [2024-11-21 03:39:51.451769] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.901 [2024-11-21 03:39:51.451790] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x12a3210) on tqpair=0x1222e10 00:23:10.901 [2024-11-21 03:39:51.451811] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.901 [2024-11-21 03:39:51.451821] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.901 [2024-11-21 03:39:51.451828] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.901 [2024-11-21 03:39:51.451834] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x12a30b0) on tqpair=0x1222e10 00:23:10.901 [2024-11-21 03:39:51.451863] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.901 [2024-11-21 03:39:51.451872] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.901 [2024-11-21 03:39:51.451878] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.901 [2024-11-21 03:39:51.451884] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x12a3370) on tqpair=0x1222e10 00:23:10.901 [2024-11-21 03:39:51.451898] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.901 [2024-11-21 03:39:51.451907] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.901 [2024-11-21 03:39:51.451913] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.901 [2024-11-21 03:39:51.451919] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x12a34d0) on tqpair=0x1222e10 00:23:10.901 ===================================================== 00:23:10.901 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:10.901 ===================================================== 00:23:10.901 Controller Capabilities/Features 00:23:10.901 ================================ 00:23:10.901 Vendor ID: 8086 00:23:10.901 Subsystem Vendor ID: 8086 00:23:10.901 Serial Number: SPDK00000000000001 00:23:10.901 Model Number: SPDK bdev Controller 00:23:10.901 Firmware Version: 24.01.1 00:23:10.901 Recommended Arb Burst: 6 00:23:10.901 IEEE OUI Identifier: e4 d2 5c 00:23:10.901 Multi-path I/O 00:23:10.901 May have multiple subsystem ports: Yes 00:23:10.901 May have multiple controllers: Yes 00:23:10.901 Associated with SR-IOV VF: No 00:23:10.901 Max Data Transfer Size: 131072 00:23:10.901 Max Number of Namespaces: 32 00:23:10.901 Max Number of I/O Queues: 127 00:23:10.901 NVMe Specification Version (VS): 1.3 00:23:10.901 NVMe Specification Version (Identify): 1.3 00:23:10.901 Maximum Queue Entries: 128 00:23:10.901 Contiguous Queues Required: Yes 00:23:10.901 Arbitration Mechanisms Supported 00:23:10.901 Weighted Round Robin: Not Supported 00:23:10.901 Vendor Specific: Not Supported 00:23:10.901 Reset Timeout: 15000 ms 00:23:10.901 Doorbell Stride: 4 bytes 00:23:10.901 NVM Subsystem Reset: Not Supported 00:23:10.901 Command Sets Supported 00:23:10.901 NVM Command Set: Supported 00:23:10.901 Boot Partition: Not Supported 00:23:10.901 Memory Page Size Minimum: 4096 bytes 00:23:10.901 Memory Page Size Maximum: 4096 bytes 00:23:10.901 Persistent Memory Region: Not Supported 00:23:10.901 Optional Asynchronous Events Supported 00:23:10.901 Namespace Attribute Notices: Supported 00:23:10.901 Firmware Activation Notices: Not Supported 00:23:10.901 ANA Change Notices: Not Supported 00:23:10.901 PLE Aggregate Log Change Notices: Not Supported 00:23:10.901 LBA Status Info Alert Notices: Not Supported 00:23:10.901 EGE Aggregate Log Change Notices: Not Supported 00:23:10.901 Normal NVM Subsystem Shutdown event: Not Supported 00:23:10.901 Zone Descriptor Change Notices: Not Supported 00:23:10.901 Discovery Log Change Notices: Not Supported 00:23:10.901 Controller Attributes 00:23:10.901 128-bit Host Identifier: Supported 00:23:10.901 Non-Operational Permissive Mode: Not Supported 00:23:10.901 NVM Sets: Not Supported 00:23:10.901 Read Recovery Levels: Not Supported 00:23:10.901 Endurance Groups: Not Supported 00:23:10.901 Predictable Latency Mode: Not Supported 00:23:10.901 Traffic Based Keep ALive: Not Supported 00:23:10.901 Namespace Granularity: Not Supported 00:23:10.901 SQ Associations: Not Supported 00:23:10.901 UUID List: Not Supported 00:23:10.901 Multi-Domain Subsystem: Not Supported 00:23:10.901 Fixed Capacity Management: Not Supported 00:23:10.901 Variable Capacity Management: Not Supported 00:23:10.901 Delete Endurance Group: Not Supported 00:23:10.901 Delete NVM Set: Not Supported 00:23:10.901 Extended LBA Formats Supported: Not Supported 00:23:10.901 Flexible Data Placement Supported: Not Supported 00:23:10.901 00:23:10.901 Controller Memory Buffer Support 00:23:10.901 ================================ 00:23:10.901 Supported: No 00:23:10.901 00:23:10.901 Persistent Memory Region Support 00:23:10.901 ================================ 00:23:10.901 Supported: No 00:23:10.901 00:23:10.901 Admin Command Set Attributes 00:23:10.901 ============================ 00:23:10.901 Security Send/Receive: Not Supported 00:23:10.901 Format NVM: Not Supported 00:23:10.901 Firmware Activate/Download: Not Supported 00:23:10.901 Namespace Management: Not Supported 00:23:10.901 Device Self-Test: Not Supported 00:23:10.901 Directives: Not Supported 00:23:10.901 NVMe-MI: Not Supported 00:23:10.901 Virtualization Management: Not Supported 00:23:10.901 Doorbell Buffer Config: Not Supported 00:23:10.901 Get LBA Status Capability: Not Supported 00:23:10.901 Command & Feature Lockdown Capability: Not Supported 00:23:10.901 Abort Command Limit: 4 00:23:10.901 Async Event Request Limit: 4 00:23:10.901 Number of Firmware Slots: N/A 00:23:10.901 Firmware Slot 1 Read-Only: N/A 00:23:10.901 Firmware Activation Without Reset: N/A 00:23:10.901 Multiple Update Detection Support: N/A 00:23:10.901 Firmware Update Granularity: No Information Provided 00:23:10.901 Per-Namespace SMART Log: No 00:23:10.901 Asymmetric Namespace Access Log Page: Not Supported 00:23:10.901 Subsystem NQN: nqn.2016-06.io.spdk:cnode1 00:23:10.901 Command Effects Log Page: Supported 00:23:10.902 Get Log Page Extended Data: Supported 00:23:10.902 Telemetry Log Pages: Not Supported 00:23:10.902 Persistent Event Log Pages: Not Supported 00:23:10.902 Supported Log Pages Log Page: May Support 00:23:10.902 Commands Supported & Effects Log Page: Not Supported 00:23:10.902 Feature Identifiers & Effects Log Page:May Support 00:23:10.902 NVMe-MI Commands & Effects Log Page: May Support 00:23:10.902 Data Area 4 for Telemetry Log: Not Supported 00:23:10.902 Error Log Page Entries Supported: 128 00:23:10.902 Keep Alive: Supported 00:23:10.902 Keep Alive Granularity: 10000 ms 00:23:10.902 00:23:10.902 NVM Command Set Attributes 00:23:10.902 ========================== 00:23:10.902 Submission Queue Entry Size 00:23:10.902 Max: 64 00:23:10.902 Min: 64 00:23:10.902 Completion Queue Entry Size 00:23:10.902 Max: 16 00:23:10.902 Min: 16 00:23:10.902 Number of Namespaces: 32 00:23:10.902 Compare Command: Supported 00:23:10.902 Write Uncorrectable Command: Not Supported 00:23:10.902 Dataset Management Command: Supported 00:23:10.902 Write Zeroes Command: Supported 00:23:10.902 Set Features Save Field: Not Supported 00:23:10.902 Reservations: Supported 00:23:10.902 Timestamp: Not Supported 00:23:10.902 Copy: Supported 00:23:10.902 Volatile Write Cache: Present 00:23:10.902 Atomic Write Unit (Normal): 1 00:23:10.902 Atomic Write Unit (PFail): 1 00:23:10.902 Atomic Compare & Write Unit: 1 00:23:10.902 Fused Compare & Write: Supported 00:23:10.902 Scatter-Gather List 00:23:10.902 SGL Command Set: Supported 00:23:10.902 SGL Keyed: Supported 00:23:10.902 SGL Bit Bucket Descriptor: Not Supported 00:23:10.902 SGL Metadata Pointer: Not Supported 00:23:10.902 Oversized SGL: Not Supported 00:23:10.902 SGL Metadata Address: Not Supported 00:23:10.902 SGL Offset: Supported 00:23:10.902 Transport SGL Data Block: Not Supported 00:23:10.902 Replay Protected Memory Block: Not Supported 00:23:10.902 00:23:10.902 Firmware Slot Information 00:23:10.902 ========================= 00:23:10.902 Active slot: 1 00:23:10.902 Slot 1 Firmware Revision: 24.01.1 00:23:10.902 00:23:10.902 00:23:10.902 Commands Supported and Effects 00:23:10.902 ============================== 00:23:10.902 Admin Commands 00:23:10.902 -------------- 00:23:10.902 Get Log Page (02h): Supported 00:23:10.902 Identify (06h): Supported 00:23:10.902 Abort (08h): Supported 00:23:10.902 Set Features (09h): Supported 00:23:10.902 Get Features (0Ah): Supported 00:23:10.902 Asynchronous Event Request (0Ch): Supported 00:23:10.902 Keep Alive (18h): Supported 00:23:10.902 I/O Commands 00:23:10.902 ------------ 00:23:10.902 Flush (00h): Supported LBA-Change 00:23:10.902 Write (01h): Supported LBA-Change 00:23:10.902 Read (02h): Supported 00:23:10.902 Compare (05h): Supported 00:23:10.902 Write Zeroes (08h): Supported LBA-Change 00:23:10.902 Dataset Management (09h): Supported LBA-Change 00:23:10.902 Copy (19h): Supported LBA-Change 00:23:10.902 Unknown (79h): Supported LBA-Change 00:23:10.902 Unknown (7Ah): Supported 00:23:10.902 00:23:10.902 Error Log 00:23:10.902 ========= 00:23:10.902 00:23:10.902 Arbitration 00:23:10.902 =========== 00:23:10.902 Arbitration Burst: 1 00:23:10.902 00:23:10.902 Power Management 00:23:10.902 ================ 00:23:10.902 Number of Power States: 1 00:23:10.902 Current Power State: Power State #0 00:23:10.902 Power State #0: 00:23:10.902 Max Power: 0.00 W 00:23:10.902 Non-Operational State: Operational 00:23:10.902 Entry Latency: Not Reported 00:23:10.902 Exit Latency: Not Reported 00:23:10.902 Relative Read Throughput: 0 00:23:10.902 Relative Read Latency: 0 00:23:10.902 Relative Write Throughput: 0 00:23:10.902 Relative Write Latency: 0 00:23:10.902 Idle Power: Not Reported 00:23:10.902 Active Power: Not Reported 00:23:10.902 Non-Operational Permissive Mode: Not Supported 00:23:10.902 00:23:10.902 Health Information 00:23:10.902 ================== 00:23:10.902 Critical Warnings: 00:23:10.902 Available Spare Space: OK 00:23:10.902 Temperature: OK 00:23:10.902 Device Reliability: OK 00:23:10.902 Read Only: No 00:23:10.902 Volatile Memory Backup: OK 00:23:10.902 Current Temperature: 0 Kelvin (-273 Celsius) 00:23:10.902 Temperature Threshold: [2024-11-21 03:39:51.452035] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.902 [2024-11-21 03:39:51.452046] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.902 [2024-11-21 03:39:51.452066] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0x1222e10) 00:23:10.902 [2024-11-21 03:39:51.452085] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:7 cdw10:00000005 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.902 [2024-11-21 03:39:51.452108] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x12a34d0, cid 7, qid 0 00:23:10.902 [2024-11-21 03:39:51.452258] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.902 [2024-11-21 03:39:51.452270] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.902 [2024-11-21 03:39:51.452277] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.902 [2024-11-21 03:39:51.452283] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x12a34d0) on tqpair=0x1222e10 00:23:10.902 [2024-11-21 03:39:51.452322] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Prepare to destruct SSD 00:23:10.902 [2024-11-21 03:39:51.452343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:10.902 [2024-11-21 03:39:51.452355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:10.902 [2024-11-21 03:39:51.452364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:10.902 [2024-11-21 03:39:51.452373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:10.902 [2024-11-21 03:39:51.452385] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.902 [2024-11-21 03:39:51.452392] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.902 [2024-11-21 03:39:51.452399] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1222e10) 00:23:10.902 [2024-11-21 03:39:51.452409] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.902 [2024-11-21 03:39:51.452444] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x12a2f50, cid 3, qid 0 00:23:10.902 [2024-11-21 03:39:51.452626] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.902 [2024-11-21 03:39:51.452641] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.902 [2024-11-21 03:39:51.452648] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.902 [2024-11-21 03:39:51.452655] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x12a2f50) on tqpair=0x1222e10 00:23:10.902 [2024-11-21 03:39:51.452667] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.902 [2024-11-21 03:39:51.452675] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.902 [2024-11-21 03:39:51.452681] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1222e10) 00:23:10.902 [2024-11-21 03:39:51.452691] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.902 [2024-11-21 03:39:51.452717] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x12a2f50, cid 3, qid 0 00:23:10.902 [2024-11-21 03:39:51.452830] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.902 [2024-11-21 03:39:51.452842] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.902 [2024-11-21 03:39:51.452849] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.902 [2024-11-21 03:39:51.452859] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x12a2f50) on tqpair=0x1222e10 00:23:10.902 [2024-11-21 03:39:51.452868] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] RTD3E = 0 us 00:23:10.902 [2024-11-21 03:39:51.452876] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown timeout = 10000 ms 00:23:10.902 [2024-11-21 03:39:51.452891] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.902 [2024-11-21 03:39:51.452900] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.902 [2024-11-21 03:39:51.452906] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1222e10) 00:23:10.902 [2024-11-21 03:39:51.452916] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.902 [2024-11-21 03:39:51.452937] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x12a2f50, cid 3, qid 0 00:23:10.902 [2024-11-21 03:39:51.453042] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.902 [2024-11-21 03:39:51.453054] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.902 [2024-11-21 03:39:51.453061] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.902 [2024-11-21 03:39:51.453067] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x12a2f50) on tqpair=0x1222e10 00:23:10.902 [2024-11-21 03:39:51.453094] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.902 [2024-11-21 03:39:51.453104] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.902 [2024-11-21 03:39:51.453110] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1222e10) 00:23:10.902 [2024-11-21 03:39:51.453120] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.902 [2024-11-21 03:39:51.453141] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x12a2f50, cid 3, qid 0 00:23:10.902 [2024-11-21 03:39:51.453236] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.902 [2024-11-21 03:39:51.453248] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.902 [2024-11-21 03:39:51.453255] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.902 [2024-11-21 03:39:51.453261] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x12a2f50) on tqpair=0x1222e10 00:23:10.902 [2024-11-21 03:39:51.453278] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.902 [2024-11-21 03:39:51.453287] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.903 [2024-11-21 03:39:51.453293] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1222e10) 00:23:10.903 [2024-11-21 03:39:51.453303] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.903 [2024-11-21 03:39:51.453323] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x12a2f50, cid 3, qid 0 00:23:10.903 [2024-11-21 03:39:51.453428] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.903 [2024-11-21 03:39:51.453442] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.903 [2024-11-21 03:39:51.453449] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.903 [2024-11-21 03:39:51.453456] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x12a2f50) on tqpair=0x1222e10 00:23:10.903 [2024-11-21 03:39:51.453473] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.903 [2024-11-21 03:39:51.453482] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.903 [2024-11-21 03:39:51.453488] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1222e10) 00:23:10.903 [2024-11-21 03:39:51.453499] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.903 [2024-11-21 03:39:51.453519] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x12a2f50, cid 3, qid 0 00:23:10.903 [2024-11-21 03:39:51.453618] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.903 [2024-11-21 03:39:51.453633] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.903 [2024-11-21 03:39:51.453639] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.903 [2024-11-21 03:39:51.453646] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x12a2f50) on tqpair=0x1222e10 00:23:10.903 [2024-11-21 03:39:51.453663] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.903 [2024-11-21 03:39:51.453672] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.903 [2024-11-21 03:39:51.453678] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1222e10) 00:23:10.903 [2024-11-21 03:39:51.453689] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.903 [2024-11-21 03:39:51.453709] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x12a2f50, cid 3, qid 0 00:23:10.903 [2024-11-21 03:39:51.453807] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.903 [2024-11-21 03:39:51.453819] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.903 [2024-11-21 03:39:51.453826] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.903 [2024-11-21 03:39:51.453832] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x12a2f50) on tqpair=0x1222e10 00:23:10.903 [2024-11-21 03:39:51.453849] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.903 [2024-11-21 03:39:51.453858] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.903 [2024-11-21 03:39:51.453864] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1222e10) 00:23:10.903 [2024-11-21 03:39:51.453874] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.903 [2024-11-21 03:39:51.453895] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x12a2f50, cid 3, qid 0 00:23:10.903 [2024-11-21 03:39:51.453993] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.903 [2024-11-21 03:39:51.454008] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.903 [2024-11-21 03:39:51.454014] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.903 [2024-11-21 03:39:51.454021] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x12a2f50) on tqpair=0x1222e10 00:23:10.903 [2024-11-21 03:39:51.454038] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:10.903 [2024-11-21 03:39:51.454047] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:10.903 [2024-11-21 03:39:51.454054] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1222e10) 00:23:10.903 [2024-11-21 03:39:51.454064] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:10.903 [2024-11-21 03:39:51.458114] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x12a2f50, cid 3, qid 0 00:23:10.903 [2024-11-21 03:39:51.458274] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:10.903 [2024-11-21 03:39:51.458286] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:10.903 [2024-11-21 03:39:51.458293] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:10.903 [2024-11-21 03:39:51.458300] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x12a2f50) on tqpair=0x1222e10 00:23:10.903 [2024-11-21 03:39:51.458314] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown complete in 5 milliseconds 00:23:10.903 0 Kelvin (-273 Celsius) 00:23:10.903 Available Spare: 0% 00:23:10.903 Available Spare Threshold: 0% 00:23:10.903 Life Percentage Used: 0% 00:23:10.903 Data Units Read: 0 00:23:10.903 Data Units Written: 0 00:23:10.903 Host Read Commands: 0 00:23:10.903 Host Write Commands: 0 00:23:10.903 Controller Busy Time: 0 minutes 00:23:10.903 Power Cycles: 0 00:23:10.903 Power On Hours: 0 hours 00:23:10.903 Unsafe Shutdowns: 0 00:23:10.903 Unrecoverable Media Errors: 0 00:23:10.903 Lifetime Error Log Entries: 0 00:23:10.903 Warning Temperature Time: 0 minutes 00:23:10.903 Critical Temperature Time: 0 minutes 00:23:10.903 00:23:10.903 Number of Queues 00:23:10.903 ================ 00:23:10.903 Number of I/O Submission Queues: 127 00:23:10.903 Number of I/O Completion Queues: 127 00:23:10.903 00:23:10.903 Active Namespaces 00:23:10.903 ================= 00:23:10.903 Namespace ID:1 00:23:10.903 Error Recovery Timeout: Unlimited 00:23:10.903 Command Set Identifier: NVM (00h) 00:23:10.903 Deallocate: Supported 00:23:10.903 Deallocated/Unwritten Error: Not Supported 00:23:10.903 Deallocated Read Value: Unknown 00:23:10.903 Deallocate in Write Zeroes: Not Supported 00:23:10.903 Deallocated Guard Field: 0xFFFF 00:23:10.903 Flush: Supported 00:23:10.903 Reservation: Supported 00:23:10.903 Namespace Sharing Capabilities: Multiple Controllers 00:23:10.903 Size (in LBAs): 131072 (0GiB) 00:23:10.903 Capacity (in LBAs): 131072 (0GiB) 00:23:10.903 Utilization (in LBAs): 131072 (0GiB) 00:23:10.903 NGUID: ABCDEF0123456789ABCDEF0123456789 00:23:10.903 EUI64: ABCDEF0123456789 00:23:10.903 UUID: 32f69f56-456c-4cf5-98f2-45f4f6e03170 00:23:10.903 Thin Provisioning: Not Supported 00:23:10.903 Per-NS Atomic Units: Yes 00:23:10.903 Atomic Boundary Size (Normal): 0 00:23:10.903 Atomic Boundary Size (PFail): 0 00:23:10.903 Atomic Boundary Offset: 0 00:23:10.903 Maximum Single Source Range Length: 65535 00:23:10.903 Maximum Copy Length: 65535 00:23:10.903 Maximum Source Range Count: 1 00:23:10.903 NGUID/EUI64 Never Reused: No 00:23:10.903 Namespace Write Protected: No 00:23:10.903 Number of LBA Formats: 1 00:23:10.903 Current LBA Format: LBA Format #00 00:23:10.903 LBA Format #00: Data Size: 512 Metadata Size: 0 00:23:10.903 00:23:10.903 03:39:51 -- host/identify.sh@51 -- # sync 00:23:10.903 03:39:51 -- host/identify.sh@52 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:23:10.903 03:39:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:10.903 03:39:51 -- common/autotest_common.sh@10 -- # set +x 00:23:10.903 03:39:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:10.903 03:39:51 -- host/identify.sh@54 -- # trap - SIGINT SIGTERM EXIT 00:23:10.903 03:39:51 -- host/identify.sh@56 -- # nvmftestfini 00:23:10.903 03:39:51 -- nvmf/common.sh@476 -- # nvmfcleanup 00:23:10.903 03:39:51 -- nvmf/common.sh@116 -- # sync 00:23:10.903 03:39:51 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:23:10.903 03:39:51 -- nvmf/common.sh@119 -- # set +e 00:23:10.903 03:39:51 -- nvmf/common.sh@120 -- # for i in {1..20} 00:23:10.903 03:39:51 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:23:10.903 rmmod nvme_tcp 00:23:10.903 rmmod nvme_fabrics 00:23:10.903 rmmod nvme_keyring 00:23:10.903 03:39:51 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:23:10.903 03:39:51 -- nvmf/common.sh@123 -- # set -e 00:23:10.903 03:39:51 -- nvmf/common.sh@124 -- # return 0 00:23:10.903 03:39:51 -- nvmf/common.sh@477 -- # '[' -n 3128804 ']' 00:23:10.903 03:39:51 -- nvmf/common.sh@478 -- # killprocess 3128804 00:23:10.903 03:39:51 -- common/autotest_common.sh@936 -- # '[' -z 3128804 ']' 00:23:10.903 03:39:51 -- common/autotest_common.sh@940 -- # kill -0 3128804 00:23:10.903 03:39:51 -- common/autotest_common.sh@941 -- # uname 00:23:10.903 03:39:51 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:23:11.162 03:39:51 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3128804 00:23:11.162 03:39:51 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:23:11.162 03:39:51 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:23:11.162 03:39:51 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3128804' 00:23:11.162 killing process with pid 3128804 00:23:11.162 03:39:51 -- common/autotest_common.sh@955 -- # kill 3128804 00:23:11.162 [2024-11-21 03:39:51.574280] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:23:11.162 03:39:51 -- common/autotest_common.sh@960 -- # wait 3128804 00:23:11.421 03:39:51 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:23:11.422 03:39:51 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:23:11.422 03:39:51 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:23:11.422 03:39:51 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:23:11.422 03:39:51 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:23:11.422 03:39:51 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:11.422 03:39:51 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:11.422 03:39:51 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:13.331 03:39:53 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:23:13.331 00:23:13.331 real 0m6.146s 00:23:13.331 user 0m7.156s 00:23:13.331 sys 0m1.928s 00:23:13.331 03:39:53 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:23:13.331 03:39:53 -- common/autotest_common.sh@10 -- # set +x 00:23:13.331 ************************************ 00:23:13.331 END TEST nvmf_identify 00:23:13.331 ************************************ 00:23:13.331 03:39:53 -- nvmf/nvmf.sh@98 -- # run_test nvmf_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:23:13.331 03:39:53 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:23:13.331 03:39:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:13.331 03:39:53 -- common/autotest_common.sh@10 -- # set +x 00:23:13.331 ************************************ 00:23:13.331 START TEST nvmf_perf 00:23:13.331 ************************************ 00:23:13.331 03:39:53 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:23:13.590 * Looking for test storage... 00:23:13.590 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:23:13.590 03:39:54 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:23:13.590 03:39:54 -- common/autotest_common.sh@1690 -- # lcov --version 00:23:13.590 03:39:54 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:23:13.590 03:39:54 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:23:13.590 03:39:54 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:23:13.590 03:39:54 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:23:13.590 03:39:54 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:23:13.590 03:39:54 -- scripts/common.sh@335 -- # IFS=.-: 00:23:13.590 03:39:54 -- scripts/common.sh@335 -- # read -ra ver1 00:23:13.590 03:39:54 -- scripts/common.sh@336 -- # IFS=.-: 00:23:13.590 03:39:54 -- scripts/common.sh@336 -- # read -ra ver2 00:23:13.590 03:39:54 -- scripts/common.sh@337 -- # local 'op=<' 00:23:13.590 03:39:54 -- scripts/common.sh@339 -- # ver1_l=2 00:23:13.590 03:39:54 -- scripts/common.sh@340 -- # ver2_l=1 00:23:13.590 03:39:54 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:23:13.590 03:39:54 -- scripts/common.sh@343 -- # case "$op" in 00:23:13.590 03:39:54 -- scripts/common.sh@344 -- # : 1 00:23:13.590 03:39:54 -- scripts/common.sh@363 -- # (( v = 0 )) 00:23:13.590 03:39:54 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:23:13.590 03:39:54 -- scripts/common.sh@364 -- # decimal 1 00:23:13.590 03:39:54 -- scripts/common.sh@352 -- # local d=1 00:23:13.590 03:39:54 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:23:13.590 03:39:54 -- scripts/common.sh@354 -- # echo 1 00:23:13.590 03:39:54 -- scripts/common.sh@364 -- # ver1[v]=1 00:23:13.590 03:39:54 -- scripts/common.sh@365 -- # decimal 2 00:23:13.590 03:39:54 -- scripts/common.sh@352 -- # local d=2 00:23:13.590 03:39:54 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:23:13.590 03:39:54 -- scripts/common.sh@354 -- # echo 2 00:23:13.590 03:39:54 -- scripts/common.sh@365 -- # ver2[v]=2 00:23:13.590 03:39:54 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:23:13.590 03:39:54 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:23:13.590 03:39:54 -- scripts/common.sh@367 -- # return 0 00:23:13.590 03:39:54 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:23:13.590 03:39:54 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:23:13.590 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:13.590 --rc genhtml_branch_coverage=1 00:23:13.590 --rc genhtml_function_coverage=1 00:23:13.590 --rc genhtml_legend=1 00:23:13.590 --rc geninfo_all_blocks=1 00:23:13.590 --rc geninfo_unexecuted_blocks=1 00:23:13.590 00:23:13.590 ' 00:23:13.590 03:39:54 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:23:13.590 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:13.590 --rc genhtml_branch_coverage=1 00:23:13.590 --rc genhtml_function_coverage=1 00:23:13.590 --rc genhtml_legend=1 00:23:13.590 --rc geninfo_all_blocks=1 00:23:13.590 --rc geninfo_unexecuted_blocks=1 00:23:13.590 00:23:13.590 ' 00:23:13.590 03:39:54 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:23:13.590 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:13.590 --rc genhtml_branch_coverage=1 00:23:13.590 --rc genhtml_function_coverage=1 00:23:13.590 --rc genhtml_legend=1 00:23:13.590 --rc geninfo_all_blocks=1 00:23:13.590 --rc geninfo_unexecuted_blocks=1 00:23:13.590 00:23:13.590 ' 00:23:13.590 03:39:54 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:23:13.590 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:13.590 --rc genhtml_branch_coverage=1 00:23:13.590 --rc genhtml_function_coverage=1 00:23:13.590 --rc genhtml_legend=1 00:23:13.590 --rc geninfo_all_blocks=1 00:23:13.590 --rc geninfo_unexecuted_blocks=1 00:23:13.590 00:23:13.590 ' 00:23:13.590 03:39:54 -- host/perf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:13.590 03:39:54 -- nvmf/common.sh@7 -- # uname -s 00:23:13.590 03:39:54 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:13.590 03:39:54 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:13.590 03:39:54 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:13.590 03:39:54 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:13.590 03:39:54 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:13.590 03:39:54 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:13.590 03:39:54 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:13.590 03:39:54 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:13.590 03:39:54 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:13.590 03:39:54 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:13.590 03:39:54 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:23:13.590 03:39:54 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:23:13.590 03:39:54 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:13.590 03:39:54 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:13.590 03:39:54 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:13.590 03:39:54 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:13.590 03:39:54 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:13.590 03:39:54 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:13.590 03:39:54 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:13.590 03:39:54 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:13.590 03:39:54 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:13.590 03:39:54 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:13.590 03:39:54 -- paths/export.sh@5 -- # export PATH 00:23:13.591 03:39:54 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:13.591 03:39:54 -- nvmf/common.sh@46 -- # : 0 00:23:13.591 03:39:54 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:13.591 03:39:54 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:13.591 03:39:54 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:13.591 03:39:54 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:13.591 03:39:54 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:13.591 03:39:54 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:13.591 03:39:54 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:13.591 03:39:54 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:13.591 03:39:54 -- host/perf.sh@12 -- # MALLOC_BDEV_SIZE=64 00:23:13.591 03:39:54 -- host/perf.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:23:13.591 03:39:54 -- host/perf.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:23:13.591 03:39:54 -- host/perf.sh@17 -- # nvmftestinit 00:23:13.591 03:39:54 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:23:13.591 03:39:54 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:13.591 03:39:54 -- nvmf/common.sh@436 -- # prepare_net_devs 00:23:13.591 03:39:54 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:23:13.591 03:39:54 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:23:13.591 03:39:54 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:13.591 03:39:54 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:13.591 03:39:54 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:13.591 03:39:54 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:23:13.591 03:39:54 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:23:13.591 03:39:54 -- nvmf/common.sh@284 -- # xtrace_disable 00:23:13.591 03:39:54 -- common/autotest_common.sh@10 -- # set +x 00:23:15.496 03:39:56 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:15.496 03:39:56 -- nvmf/common.sh@290 -- # pci_devs=() 00:23:15.496 03:39:56 -- nvmf/common.sh@290 -- # local -a pci_devs 00:23:15.496 03:39:56 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:23:15.496 03:39:56 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:23:15.496 03:39:56 -- nvmf/common.sh@292 -- # pci_drivers=() 00:23:15.496 03:39:56 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:23:15.496 03:39:56 -- nvmf/common.sh@294 -- # net_devs=() 00:23:15.496 03:39:56 -- nvmf/common.sh@294 -- # local -ga net_devs 00:23:15.496 03:39:56 -- nvmf/common.sh@295 -- # e810=() 00:23:15.496 03:39:56 -- nvmf/common.sh@295 -- # local -ga e810 00:23:15.496 03:39:56 -- nvmf/common.sh@296 -- # x722=() 00:23:15.496 03:39:56 -- nvmf/common.sh@296 -- # local -ga x722 00:23:15.496 03:39:56 -- nvmf/common.sh@297 -- # mlx=() 00:23:15.496 03:39:56 -- nvmf/common.sh@297 -- # local -ga mlx 00:23:15.496 03:39:56 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:15.496 03:39:56 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:15.496 03:39:56 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:15.496 03:39:56 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:15.496 03:39:56 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:15.496 03:39:56 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:15.496 03:39:56 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:15.496 03:39:56 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:15.496 03:39:56 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:15.496 03:39:56 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:15.496 03:39:56 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:15.496 03:39:56 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:23:15.496 03:39:56 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:23:15.496 03:39:56 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:23:15.496 03:39:56 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:23:15.496 03:39:56 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:23:15.496 03:39:56 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:23:15.496 03:39:56 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:15.496 03:39:56 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:23:15.496 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:23:15.496 03:39:56 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:15.496 03:39:56 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:15.496 03:39:56 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:15.496 03:39:56 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:15.496 03:39:56 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:15.496 03:39:56 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:15.496 03:39:56 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:23:15.496 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:23:15.496 03:39:56 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:15.496 03:39:56 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:15.496 03:39:56 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:15.496 03:39:56 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:15.496 03:39:56 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:15.496 03:39:56 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:23:15.496 03:39:56 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:23:15.496 03:39:56 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:23:15.496 03:39:56 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:15.496 03:39:56 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:15.496 03:39:56 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:15.496 03:39:56 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:15.496 03:39:56 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:23:15.496 Found net devices under 0000:0a:00.0: cvl_0_0 00:23:15.496 03:39:56 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:15.496 03:39:56 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:15.496 03:39:56 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:15.496 03:39:56 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:15.496 03:39:56 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:15.496 03:39:56 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:23:15.496 Found net devices under 0000:0a:00.1: cvl_0_1 00:23:15.496 03:39:56 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:15.496 03:39:56 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:23:15.496 03:39:56 -- nvmf/common.sh@402 -- # is_hw=yes 00:23:15.496 03:39:56 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:23:15.496 03:39:56 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:23:15.496 03:39:56 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:23:15.496 03:39:56 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:23:15.496 03:39:56 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:23:15.496 03:39:56 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:15.496 03:39:56 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:23:15.496 03:39:56 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:23:15.496 03:39:56 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:23:15.496 03:39:56 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:23:15.496 03:39:56 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:23:15.496 03:39:56 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:23:15.496 03:39:56 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:23:15.496 03:39:56 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:23:15.496 03:39:56 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:23:15.496 03:39:56 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:23:15.822 03:39:56 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:23:15.822 03:39:56 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:23:15.822 03:39:56 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:23:15.822 03:39:56 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:23:15.822 03:39:56 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:23:15.822 03:39:56 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:23:15.822 03:39:56 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:23:15.822 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:23:15.822 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.280 ms 00:23:15.822 00:23:15.822 --- 10.0.0.2 ping statistics --- 00:23:15.822 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:15.822 rtt min/avg/max/mdev = 0.280/0.280/0.280/0.000 ms 00:23:15.822 03:39:56 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:23:15.822 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:23:15.822 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.082 ms 00:23:15.822 00:23:15.822 --- 10.0.0.1 ping statistics --- 00:23:15.822 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:15.822 rtt min/avg/max/mdev = 0.082/0.082/0.082/0.000 ms 00:23:15.822 03:39:56 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:23:15.822 03:39:56 -- nvmf/common.sh@410 -- # return 0 00:23:15.822 03:39:56 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:23:15.822 03:39:56 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:23:15.822 03:39:56 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:23:15.822 03:39:56 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:23:15.822 03:39:56 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:23:15.822 03:39:56 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:23:15.822 03:39:56 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:23:15.822 03:39:56 -- host/perf.sh@18 -- # nvmfappstart -m 0xF 00:23:15.822 03:39:56 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:23:15.822 03:39:56 -- common/autotest_common.sh@722 -- # xtrace_disable 00:23:15.822 03:39:56 -- common/autotest_common.sh@10 -- # set +x 00:23:15.822 03:39:56 -- nvmf/common.sh@469 -- # nvmfpid=3130916 00:23:15.822 03:39:56 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:23:15.822 03:39:56 -- nvmf/common.sh@470 -- # waitforlisten 3130916 00:23:15.822 03:39:56 -- common/autotest_common.sh@829 -- # '[' -z 3130916 ']' 00:23:15.822 03:39:56 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:15.822 03:39:56 -- common/autotest_common.sh@834 -- # local max_retries=100 00:23:15.822 03:39:56 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:15.822 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:15.822 03:39:56 -- common/autotest_common.sh@838 -- # xtrace_disable 00:23:15.822 03:39:56 -- common/autotest_common.sh@10 -- # set +x 00:23:15.822 [2024-11-21 03:39:56.400771] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:15.822 [2024-11-21 03:39:56.400860] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:16.083 EAL: No free 2048 kB hugepages reported on node 1 00:23:16.083 [2024-11-21 03:39:56.474555] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:23:16.083 [2024-11-21 03:39:56.583900] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:23:16.083 [2024-11-21 03:39:56.584063] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:16.083 [2024-11-21 03:39:56.584090] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:16.083 [2024-11-21 03:39:56.584112] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:16.083 [2024-11-21 03:39:56.584195] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:23:16.084 [2024-11-21 03:39:56.584268] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:23:16.084 [2024-11-21 03:39:56.584329] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:23:16.084 [2024-11-21 03:39:56.584332] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:17.021 03:39:57 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:23:17.021 03:39:57 -- common/autotest_common.sh@862 -- # return 0 00:23:17.021 03:39:57 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:23:17.021 03:39:57 -- common/autotest_common.sh@728 -- # xtrace_disable 00:23:17.021 03:39:57 -- common/autotest_common.sh@10 -- # set +x 00:23:17.021 03:39:57 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:23:17.021 03:39:57 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:23:17.021 03:39:57 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_subsystem_config 00:23:20.312 03:40:00 -- host/perf.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_get_config bdev 00:23:20.312 03:40:00 -- host/perf.sh@30 -- # jq -r '.[].params | select(.name=="Nvme0").traddr' 00:23:20.312 03:40:00 -- host/perf.sh@30 -- # local_nvme_trid=0000:88:00.0 00:23:20.312 03:40:00 -- host/perf.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:23:20.570 03:40:01 -- host/perf.sh@31 -- # bdevs=' Malloc0' 00:23:20.570 03:40:01 -- host/perf.sh@33 -- # '[' -n 0000:88:00.0 ']' 00:23:20.570 03:40:01 -- host/perf.sh@34 -- # bdevs=' Malloc0 Nvme0n1' 00:23:20.570 03:40:01 -- host/perf.sh@37 -- # '[' tcp == rdma ']' 00:23:20.570 03:40:01 -- host/perf.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:23:20.828 [2024-11-21 03:40:01.381957] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:20.828 03:40:01 -- host/perf.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:23:21.086 03:40:01 -- host/perf.sh@45 -- # for bdev in $bdevs 00:23:21.086 03:40:01 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:23:21.344 03:40:01 -- host/perf.sh@45 -- # for bdev in $bdevs 00:23:21.344 03:40:01 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:23:21.602 03:40:02 -- host/perf.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:21.860 [2024-11-21 03:40:02.401776] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:21.860 03:40:02 -- host/perf.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:23:22.119 03:40:02 -- host/perf.sh@52 -- # '[' -n 0000:88:00.0 ']' 00:23:22.119 03:40:02 -- host/perf.sh@53 -- # perf_app -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:88:00.0' 00:23:22.119 03:40:02 -- host/perf.sh@21 -- # '[' 0 -eq 1 ']' 00:23:22.119 03:40:02 -- host/perf.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:88:00.0' 00:23:23.499 Initializing NVMe Controllers 00:23:23.499 Attached to NVMe Controller at 0000:88:00.0 [8086:0a54] 00:23:23.499 Associating PCIE (0000:88:00.0) NSID 1 with lcore 0 00:23:23.499 Initialization complete. Launching workers. 00:23:23.499 ======================================================== 00:23:23.499 Latency(us) 00:23:23.499 Device Information : IOPS MiB/s Average min max 00:23:23.499 PCIE (0000:88:00.0) NSID 1 from core 0: 86361.40 337.35 370.17 33.75 6278.56 00:23:23.499 ======================================================== 00:23:23.499 Total : 86361.40 337.35 370.17 33.75 6278.56 00:23:23.499 00:23:23.499 03:40:03 -- host/perf.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:23.499 EAL: No free 2048 kB hugepages reported on node 1 00:23:24.878 Initializing NVMe Controllers 00:23:24.878 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:24.878 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:24.878 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:23:24.878 Initialization complete. Launching workers. 00:23:24.878 ======================================================== 00:23:24.878 Latency(us) 00:23:24.878 Device Information : IOPS MiB/s Average min max 00:23:24.878 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 118.00 0.46 8512.50 152.58 45785.50 00:23:24.878 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 40.00 0.16 26109.55 7950.15 51886.47 00:23:24.878 ======================================================== 00:23:24.878 Total : 158.00 0.62 12967.45 152.58 51886.47 00:23:24.878 00:23:24.878 03:40:05 -- host/perf.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 4096 -w randrw -M 50 -t 1 -HI -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:24.878 EAL: No free 2048 kB hugepages reported on node 1 00:23:26.257 Initializing NVMe Controllers 00:23:26.257 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:26.257 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:26.257 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:23:26.257 Initialization complete. Launching workers. 00:23:26.257 ======================================================== 00:23:26.257 Latency(us) 00:23:26.257 Device Information : IOPS MiB/s Average min max 00:23:26.257 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 8548.73 33.39 3744.00 501.61 7814.78 00:23:26.257 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 3978.98 15.54 8045.21 6227.04 16370.32 00:23:26.257 ======================================================== 00:23:26.257 Total : 12527.71 48.94 5110.12 501.61 16370.32 00:23:26.257 00:23:26.257 03:40:06 -- host/perf.sh@59 -- # [[ e810 == \e\8\1\0 ]] 00:23:26.257 03:40:06 -- host/perf.sh@59 -- # [[ tcp == \r\d\m\a ]] 00:23:26.257 03:40:06 -- host/perf.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -O 16384 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:26.257 EAL: No free 2048 kB hugepages reported on node 1 00:23:28.792 Initializing NVMe Controllers 00:23:28.792 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:28.792 Controller IO queue size 128, less than required. 00:23:28.792 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:28.792 Controller IO queue size 128, less than required. 00:23:28.792 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:28.792 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:28.792 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:23:28.792 Initialization complete. Launching workers. 00:23:28.792 ======================================================== 00:23:28.792 Latency(us) 00:23:28.792 Device Information : IOPS MiB/s Average min max 00:23:28.792 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1475.08 368.77 87848.68 60722.04 142425.41 00:23:28.792 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 571.34 142.83 236446.85 83978.93 346818.73 00:23:28.792 ======================================================== 00:23:28.792 Total : 2046.41 511.60 129335.66 60722.04 346818.73 00:23:28.792 00:23:28.792 03:40:09 -- host/perf.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 36964 -O 4096 -w randrw -M 50 -t 5 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0xf -P 4 00:23:28.792 EAL: No free 2048 kB hugepages reported on node 1 00:23:28.792 No valid NVMe controllers or AIO or URING devices found 00:23:28.792 Initializing NVMe Controllers 00:23:28.792 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:28.792 Controller IO queue size 128, less than required. 00:23:28.792 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:28.792 WARNING: IO size 36964 (-o) is not a multiple of nsid 1 sector size 512. Removing this ns from test 00:23:28.792 Controller IO queue size 128, less than required. 00:23:28.792 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:28.792 WARNING: IO size 36964 (-o) is not a multiple of nsid 2 sector size 512. Removing this ns from test 00:23:28.792 WARNING: Some requested NVMe devices were skipped 00:23:28.792 03:40:09 -- host/perf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' --transport-stat 00:23:28.792 EAL: No free 2048 kB hugepages reported on node 1 00:23:31.326 Initializing NVMe Controllers 00:23:31.326 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:31.326 Controller IO queue size 128, less than required. 00:23:31.326 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:31.326 Controller IO queue size 128, less than required. 00:23:31.326 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:31.326 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:31.326 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:23:31.326 Initialization complete. Launching workers. 00:23:31.326 00:23:31.326 ==================== 00:23:31.326 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 statistics: 00:23:31.326 TCP transport: 00:23:31.326 polls: 10419 00:23:31.326 idle_polls: 5658 00:23:31.326 sock_completions: 4761 00:23:31.326 nvme_completions: 5824 00:23:31.326 submitted_requests: 8802 00:23:31.326 queued_requests: 1 00:23:31.326 00:23:31.326 ==================== 00:23:31.326 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 statistics: 00:23:31.326 TCP transport: 00:23:31.326 polls: 13552 00:23:31.326 idle_polls: 8622 00:23:31.326 sock_completions: 4930 00:23:31.326 nvme_completions: 5441 00:23:31.326 submitted_requests: 8299 00:23:31.326 queued_requests: 1 00:23:31.326 ======================================================== 00:23:31.326 Latency(us) 00:23:31.326 Device Information : IOPS MiB/s Average min max 00:23:31.326 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1519.37 379.84 85783.66 54351.90 129902.58 00:23:31.326 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 1423.87 355.97 91713.85 47612.05 136438.66 00:23:31.326 ======================================================== 00:23:31.326 Total : 2943.24 735.81 88652.55 47612.05 136438.66 00:23:31.326 00:23:31.326 03:40:11 -- host/perf.sh@66 -- # sync 00:23:31.326 03:40:11 -- host/perf.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:23:31.585 03:40:12 -- host/perf.sh@69 -- # '[' 1 -eq 1 ']' 00:23:31.585 03:40:12 -- host/perf.sh@71 -- # '[' -n 0000:88:00.0 ']' 00:23:31.585 03:40:12 -- host/perf.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore Nvme0n1 lvs_0 00:23:34.876 03:40:15 -- host/perf.sh@72 -- # ls_guid=c44da913-9964-4732-939b-04c3aedc0503 00:23:34.876 03:40:15 -- host/perf.sh@73 -- # get_lvs_free_mb c44da913-9964-4732-939b-04c3aedc0503 00:23:34.876 03:40:15 -- common/autotest_common.sh@1353 -- # local lvs_uuid=c44da913-9964-4732-939b-04c3aedc0503 00:23:34.876 03:40:15 -- common/autotest_common.sh@1354 -- # local lvs_info 00:23:34.876 03:40:15 -- common/autotest_common.sh@1355 -- # local fc 00:23:34.876 03:40:15 -- common/autotest_common.sh@1356 -- # local cs 00:23:34.876 03:40:15 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:23:35.134 03:40:15 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:23:35.134 { 00:23:35.134 "uuid": "c44da913-9964-4732-939b-04c3aedc0503", 00:23:35.134 "name": "lvs_0", 00:23:35.134 "base_bdev": "Nvme0n1", 00:23:35.134 "total_data_clusters": 238234, 00:23:35.134 "free_clusters": 238234, 00:23:35.134 "block_size": 512, 00:23:35.134 "cluster_size": 4194304 00:23:35.134 } 00:23:35.134 ]' 00:23:35.134 03:40:15 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="c44da913-9964-4732-939b-04c3aedc0503") .free_clusters' 00:23:35.134 03:40:15 -- common/autotest_common.sh@1358 -- # fc=238234 00:23:35.134 03:40:15 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="c44da913-9964-4732-939b-04c3aedc0503") .cluster_size' 00:23:35.134 03:40:15 -- common/autotest_common.sh@1359 -- # cs=4194304 00:23:35.134 03:40:15 -- common/autotest_common.sh@1362 -- # free_mb=952936 00:23:35.134 03:40:15 -- common/autotest_common.sh@1363 -- # echo 952936 00:23:35.134 952936 00:23:35.134 03:40:15 -- host/perf.sh@77 -- # '[' 952936 -gt 20480 ']' 00:23:35.134 03:40:15 -- host/perf.sh@78 -- # free_mb=20480 00:23:35.134 03:40:15 -- host/perf.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u c44da913-9964-4732-939b-04c3aedc0503 lbd_0 20480 00:23:36.070 03:40:16 -- host/perf.sh@80 -- # lb_guid=9c52b8ac-11a1-437d-96f0-b6de1031ca4b 00:23:36.070 03:40:16 -- host/perf.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore 9c52b8ac-11a1-437d-96f0-b6de1031ca4b lvs_n_0 00:23:36.638 03:40:17 -- host/perf.sh@83 -- # ls_nested_guid=83e162c0-fffe-4ff0-80b6-a7e255353ab2 00:23:36.638 03:40:17 -- host/perf.sh@84 -- # get_lvs_free_mb 83e162c0-fffe-4ff0-80b6-a7e255353ab2 00:23:36.638 03:40:17 -- common/autotest_common.sh@1353 -- # local lvs_uuid=83e162c0-fffe-4ff0-80b6-a7e255353ab2 00:23:36.638 03:40:17 -- common/autotest_common.sh@1354 -- # local lvs_info 00:23:36.638 03:40:17 -- common/autotest_common.sh@1355 -- # local fc 00:23:36.638 03:40:17 -- common/autotest_common.sh@1356 -- # local cs 00:23:36.638 03:40:17 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:23:36.897 03:40:17 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:23:36.897 { 00:23:36.897 "uuid": "c44da913-9964-4732-939b-04c3aedc0503", 00:23:36.897 "name": "lvs_0", 00:23:36.897 "base_bdev": "Nvme0n1", 00:23:36.897 "total_data_clusters": 238234, 00:23:36.897 "free_clusters": 233114, 00:23:36.897 "block_size": 512, 00:23:36.897 "cluster_size": 4194304 00:23:36.897 }, 00:23:36.897 { 00:23:36.897 "uuid": "83e162c0-fffe-4ff0-80b6-a7e255353ab2", 00:23:36.897 "name": "lvs_n_0", 00:23:36.897 "base_bdev": "9c52b8ac-11a1-437d-96f0-b6de1031ca4b", 00:23:36.897 "total_data_clusters": 5114, 00:23:36.897 "free_clusters": 5114, 00:23:36.897 "block_size": 512, 00:23:36.897 "cluster_size": 4194304 00:23:36.897 } 00:23:36.897 ]' 00:23:36.897 03:40:17 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="83e162c0-fffe-4ff0-80b6-a7e255353ab2") .free_clusters' 00:23:36.897 03:40:17 -- common/autotest_common.sh@1358 -- # fc=5114 00:23:36.897 03:40:17 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="83e162c0-fffe-4ff0-80b6-a7e255353ab2") .cluster_size' 00:23:36.897 03:40:17 -- common/autotest_common.sh@1359 -- # cs=4194304 00:23:36.897 03:40:17 -- common/autotest_common.sh@1362 -- # free_mb=20456 00:23:36.897 03:40:17 -- common/autotest_common.sh@1363 -- # echo 20456 00:23:36.897 20456 00:23:36.897 03:40:17 -- host/perf.sh@85 -- # '[' 20456 -gt 20480 ']' 00:23:36.897 03:40:17 -- host/perf.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 83e162c0-fffe-4ff0-80b6-a7e255353ab2 lbd_nest_0 20456 00:23:37.155 03:40:17 -- host/perf.sh@88 -- # lb_nested_guid=d499bfae-83c9-4a72-b6a6-fdab35f2152a 00:23:37.155 03:40:17 -- host/perf.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:23:37.413 03:40:18 -- host/perf.sh@90 -- # for bdev in $lb_nested_guid 00:23:37.413 03:40:18 -- host/perf.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 d499bfae-83c9-4a72-b6a6-fdab35f2152a 00:23:37.671 03:40:18 -- host/perf.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:37.928 03:40:18 -- host/perf.sh@95 -- # qd_depth=("1" "32" "128") 00:23:37.928 03:40:18 -- host/perf.sh@96 -- # io_size=("512" "131072") 00:23:37.928 03:40:18 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:23:37.928 03:40:18 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:23:37.928 03:40:18 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:37.928 EAL: No free 2048 kB hugepages reported on node 1 00:23:50.122 Initializing NVMe Controllers 00:23:50.122 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:50.122 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:50.122 Initialization complete. Launching workers. 00:23:50.122 ======================================================== 00:23:50.122 Latency(us) 00:23:50.122 Device Information : IOPS MiB/s Average min max 00:23:50.122 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 46.80 0.02 21402.64 183.34 48734.96 00:23:50.122 ======================================================== 00:23:50.122 Total : 46.80 0.02 21402.64 183.34 48734.96 00:23:50.122 00:23:50.122 03:40:28 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:23:50.122 03:40:28 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:50.122 EAL: No free 2048 kB hugepages reported on node 1 00:24:00.086 Initializing NVMe Controllers 00:24:00.086 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:00.086 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:00.086 Initialization complete. Launching workers. 00:24:00.086 ======================================================== 00:24:00.086 Latency(us) 00:24:00.086 Device Information : IOPS MiB/s Average min max 00:24:00.086 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 81.27 10.16 12303.82 5725.92 48804.54 00:24:00.086 ======================================================== 00:24:00.086 Total : 81.27 10.16 12303.82 5725.92 48804.54 00:24:00.086 00:24:00.086 03:40:39 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:24:00.086 03:40:39 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:24:00.086 03:40:39 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:24:00.086 EAL: No free 2048 kB hugepages reported on node 1 00:24:10.097 Initializing NVMe Controllers 00:24:10.097 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:10.097 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:10.097 Initialization complete. Launching workers. 00:24:10.097 ======================================================== 00:24:10.097 Latency(us) 00:24:10.097 Device Information : IOPS MiB/s Average min max 00:24:10.097 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7702.93 3.76 4154.79 281.77 11895.60 00:24:10.097 ======================================================== 00:24:10.097 Total : 7702.93 3.76 4154.79 281.77 11895.60 00:24:10.097 00:24:10.097 03:40:49 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:24:10.097 03:40:49 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:24:10.097 EAL: No free 2048 kB hugepages reported on node 1 00:24:20.067 Initializing NVMe Controllers 00:24:20.067 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:20.067 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:20.067 Initialization complete. Launching workers. 00:24:20.067 ======================================================== 00:24:20.067 Latency(us) 00:24:20.067 Device Information : IOPS MiB/s Average min max 00:24:20.067 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 3361.14 420.14 9521.83 1213.80 20495.06 00:24:20.067 ======================================================== 00:24:20.067 Total : 3361.14 420.14 9521.83 1213.80 20495.06 00:24:20.067 00:24:20.068 03:40:59 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:24:20.068 03:40:59 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:24:20.068 03:40:59 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:24:20.068 EAL: No free 2048 kB hugepages reported on node 1 00:24:30.034 Initializing NVMe Controllers 00:24:30.034 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:30.034 Controller IO queue size 128, less than required. 00:24:30.034 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:24:30.034 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:30.034 Initialization complete. Launching workers. 00:24:30.034 ======================================================== 00:24:30.034 Latency(us) 00:24:30.034 Device Information : IOPS MiB/s Average min max 00:24:30.034 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 11966.70 5.84 10702.04 1791.34 26828.38 00:24:30.034 ======================================================== 00:24:30.034 Total : 11966.70 5.84 10702.04 1791.34 26828.38 00:24:30.034 00:24:30.034 03:41:10 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:24:30.034 03:41:10 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:24:30.034 EAL: No free 2048 kB hugepages reported on node 1 00:24:40.014 Initializing NVMe Controllers 00:24:40.014 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:40.014 Controller IO queue size 128, less than required. 00:24:40.014 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:24:40.014 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:40.014 Initialization complete. Launching workers. 00:24:40.014 ======================================================== 00:24:40.014 Latency(us) 00:24:40.014 Device Information : IOPS MiB/s Average min max 00:24:40.014 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1190.90 148.86 108288.84 23220.98 223120.27 00:24:40.014 ======================================================== 00:24:40.014 Total : 1190.90 148.86 108288.84 23220.98 223120.27 00:24:40.014 00:24:40.014 03:41:20 -- host/perf.sh@104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:24:40.273 03:41:20 -- host/perf.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete d499bfae-83c9-4a72-b6a6-fdab35f2152a 00:24:41.210 03:41:21 -- host/perf.sh@106 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_n_0 00:24:41.210 03:41:21 -- host/perf.sh@107 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 9c52b8ac-11a1-437d-96f0-b6de1031ca4b 00:24:41.777 03:41:22 -- host/perf.sh@108 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_0 00:24:41.777 03:41:22 -- host/perf.sh@112 -- # trap - SIGINT SIGTERM EXIT 00:24:41.777 03:41:22 -- host/perf.sh@114 -- # nvmftestfini 00:24:41.777 03:41:22 -- nvmf/common.sh@476 -- # nvmfcleanup 00:24:41.777 03:41:22 -- nvmf/common.sh@116 -- # sync 00:24:41.777 03:41:22 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:24:41.777 03:41:22 -- nvmf/common.sh@119 -- # set +e 00:24:41.777 03:41:22 -- nvmf/common.sh@120 -- # for i in {1..20} 00:24:41.777 03:41:22 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:24:41.777 rmmod nvme_tcp 00:24:41.777 rmmod nvme_fabrics 00:24:42.035 rmmod nvme_keyring 00:24:42.035 03:41:22 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:24:42.035 03:41:22 -- nvmf/common.sh@123 -- # set -e 00:24:42.035 03:41:22 -- nvmf/common.sh@124 -- # return 0 00:24:42.035 03:41:22 -- nvmf/common.sh@477 -- # '[' -n 3130916 ']' 00:24:42.035 03:41:22 -- nvmf/common.sh@478 -- # killprocess 3130916 00:24:42.035 03:41:22 -- common/autotest_common.sh@936 -- # '[' -z 3130916 ']' 00:24:42.035 03:41:22 -- common/autotest_common.sh@940 -- # kill -0 3130916 00:24:42.035 03:41:22 -- common/autotest_common.sh@941 -- # uname 00:24:42.035 03:41:22 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:24:42.035 03:41:22 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3130916 00:24:42.035 03:41:22 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:24:42.035 03:41:22 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:24:42.035 03:41:22 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3130916' 00:24:42.035 killing process with pid 3130916 00:24:42.035 03:41:22 -- common/autotest_common.sh@955 -- # kill 3130916 00:24:42.035 03:41:22 -- common/autotest_common.sh@960 -- # wait 3130916 00:24:43.940 03:41:24 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:24:43.940 03:41:24 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:24:43.940 03:41:24 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:24:43.940 03:41:24 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:24:43.940 03:41:24 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:24:43.940 03:41:24 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:43.940 03:41:24 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:43.940 03:41:24 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:45.848 03:41:26 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:24:45.848 00:24:45.848 real 1m32.263s 00:24:45.848 user 5m37.832s 00:24:45.848 sys 0m15.979s 00:24:45.848 03:41:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:24:45.848 03:41:26 -- common/autotest_common.sh@10 -- # set +x 00:24:45.848 ************************************ 00:24:45.848 END TEST nvmf_perf 00:24:45.848 ************************************ 00:24:45.848 03:41:26 -- nvmf/nvmf.sh@99 -- # run_test nvmf_fio_host /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:24:45.848 03:41:26 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:24:45.848 03:41:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:24:45.848 03:41:26 -- common/autotest_common.sh@10 -- # set +x 00:24:45.848 ************************************ 00:24:45.848 START TEST nvmf_fio_host 00:24:45.848 ************************************ 00:24:45.848 03:41:26 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:24:45.848 * Looking for test storage... 00:24:45.848 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:24:45.848 03:41:26 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:24:45.848 03:41:26 -- common/autotest_common.sh@1690 -- # lcov --version 00:24:45.848 03:41:26 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:24:45.848 03:41:26 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:24:45.848 03:41:26 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:24:45.848 03:41:26 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:24:45.848 03:41:26 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:24:45.848 03:41:26 -- scripts/common.sh@335 -- # IFS=.-: 00:24:45.848 03:41:26 -- scripts/common.sh@335 -- # read -ra ver1 00:24:45.848 03:41:26 -- scripts/common.sh@336 -- # IFS=.-: 00:24:45.848 03:41:26 -- scripts/common.sh@336 -- # read -ra ver2 00:24:45.848 03:41:26 -- scripts/common.sh@337 -- # local 'op=<' 00:24:45.848 03:41:26 -- scripts/common.sh@339 -- # ver1_l=2 00:24:45.848 03:41:26 -- scripts/common.sh@340 -- # ver2_l=1 00:24:45.848 03:41:26 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:24:45.848 03:41:26 -- scripts/common.sh@343 -- # case "$op" in 00:24:45.848 03:41:26 -- scripts/common.sh@344 -- # : 1 00:24:45.848 03:41:26 -- scripts/common.sh@363 -- # (( v = 0 )) 00:24:45.848 03:41:26 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:24:45.848 03:41:26 -- scripts/common.sh@364 -- # decimal 1 00:24:45.848 03:41:26 -- scripts/common.sh@352 -- # local d=1 00:24:45.848 03:41:26 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:24:45.848 03:41:26 -- scripts/common.sh@354 -- # echo 1 00:24:45.848 03:41:26 -- scripts/common.sh@364 -- # ver1[v]=1 00:24:45.848 03:41:26 -- scripts/common.sh@365 -- # decimal 2 00:24:45.848 03:41:26 -- scripts/common.sh@352 -- # local d=2 00:24:45.848 03:41:26 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:24:45.848 03:41:26 -- scripts/common.sh@354 -- # echo 2 00:24:45.848 03:41:26 -- scripts/common.sh@365 -- # ver2[v]=2 00:24:45.848 03:41:26 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:24:45.848 03:41:26 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:24:45.848 03:41:26 -- scripts/common.sh@367 -- # return 0 00:24:45.848 03:41:26 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:24:45.848 03:41:26 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:24:45.848 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:45.848 --rc genhtml_branch_coverage=1 00:24:45.848 --rc genhtml_function_coverage=1 00:24:45.848 --rc genhtml_legend=1 00:24:45.848 --rc geninfo_all_blocks=1 00:24:45.848 --rc geninfo_unexecuted_blocks=1 00:24:45.848 00:24:45.848 ' 00:24:45.848 03:41:26 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:24:45.848 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:45.848 --rc genhtml_branch_coverage=1 00:24:45.848 --rc genhtml_function_coverage=1 00:24:45.848 --rc genhtml_legend=1 00:24:45.848 --rc geninfo_all_blocks=1 00:24:45.848 --rc geninfo_unexecuted_blocks=1 00:24:45.848 00:24:45.848 ' 00:24:45.848 03:41:26 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:24:45.848 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:45.848 --rc genhtml_branch_coverage=1 00:24:45.848 --rc genhtml_function_coverage=1 00:24:45.848 --rc genhtml_legend=1 00:24:45.848 --rc geninfo_all_blocks=1 00:24:45.848 --rc geninfo_unexecuted_blocks=1 00:24:45.848 00:24:45.848 ' 00:24:45.848 03:41:26 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:24:45.848 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:45.848 --rc genhtml_branch_coverage=1 00:24:45.848 --rc genhtml_function_coverage=1 00:24:45.848 --rc genhtml_legend=1 00:24:45.848 --rc geninfo_all_blocks=1 00:24:45.848 --rc geninfo_unexecuted_blocks=1 00:24:45.848 00:24:45.848 ' 00:24:45.848 03:41:26 -- host/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:24:45.848 03:41:26 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:24:45.848 03:41:26 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:24:45.848 03:41:26 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:24:45.848 03:41:26 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:45.849 03:41:26 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:45.849 03:41:26 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:45.849 03:41:26 -- paths/export.sh@5 -- # export PATH 00:24:45.849 03:41:26 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:45.849 03:41:26 -- host/fio.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:24:45.849 03:41:26 -- nvmf/common.sh@7 -- # uname -s 00:24:45.849 03:41:26 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:24:45.849 03:41:26 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:24:45.849 03:41:26 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:24:45.849 03:41:26 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:24:45.849 03:41:26 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:24:45.849 03:41:26 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:24:45.849 03:41:26 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:24:45.849 03:41:26 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:24:45.849 03:41:26 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:24:45.849 03:41:26 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:24:45.849 03:41:26 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:24:45.849 03:41:26 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:24:45.849 03:41:26 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:24:45.849 03:41:26 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:24:45.849 03:41:26 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:24:45.849 03:41:26 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:24:45.849 03:41:26 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:24:45.849 03:41:26 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:24:45.849 03:41:26 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:24:45.849 03:41:26 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:45.849 03:41:26 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:45.849 03:41:26 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:45.849 03:41:26 -- paths/export.sh@5 -- # export PATH 00:24:45.849 03:41:26 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:45.849 03:41:26 -- nvmf/common.sh@46 -- # : 0 00:24:45.849 03:41:26 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:24:45.849 03:41:26 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:24:45.849 03:41:26 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:24:45.849 03:41:26 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:24:45.849 03:41:26 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:24:45.849 03:41:26 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:24:45.849 03:41:26 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:24:45.849 03:41:26 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:24:45.849 03:41:26 -- host/fio.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:24:45.849 03:41:26 -- host/fio.sh@14 -- # nvmftestinit 00:24:45.849 03:41:26 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:24:45.849 03:41:26 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:24:45.849 03:41:26 -- nvmf/common.sh@436 -- # prepare_net_devs 00:24:45.849 03:41:26 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:24:45.849 03:41:26 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:24:45.849 03:41:26 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:45.849 03:41:26 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:45.849 03:41:26 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:45.849 03:41:26 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:24:45.849 03:41:26 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:24:45.849 03:41:26 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:45.849 03:41:26 -- common/autotest_common.sh@10 -- # set +x 00:24:47.751 03:41:28 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:47.751 03:41:28 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:47.751 03:41:28 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:47.751 03:41:28 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:47.751 03:41:28 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:47.751 03:41:28 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:47.751 03:41:28 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:47.751 03:41:28 -- nvmf/common.sh@294 -- # net_devs=() 00:24:47.751 03:41:28 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:47.751 03:41:28 -- nvmf/common.sh@295 -- # e810=() 00:24:47.751 03:41:28 -- nvmf/common.sh@295 -- # local -ga e810 00:24:47.751 03:41:28 -- nvmf/common.sh@296 -- # x722=() 00:24:47.751 03:41:28 -- nvmf/common.sh@296 -- # local -ga x722 00:24:47.751 03:41:28 -- nvmf/common.sh@297 -- # mlx=() 00:24:47.751 03:41:28 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:47.751 03:41:28 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:47.751 03:41:28 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:47.751 03:41:28 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:47.751 03:41:28 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:47.751 03:41:28 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:47.751 03:41:28 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:47.751 03:41:28 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:47.751 03:41:28 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:47.751 03:41:28 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:47.751 03:41:28 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:47.751 03:41:28 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:47.751 03:41:28 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:47.751 03:41:28 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:47.751 03:41:28 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:47.751 03:41:28 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:47.751 03:41:28 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:47.751 03:41:28 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:47.751 03:41:28 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:47.751 03:41:28 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:47.751 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:47.751 03:41:28 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:47.751 03:41:28 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:47.751 03:41:28 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:47.751 03:41:28 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:47.751 03:41:28 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:47.751 03:41:28 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:47.751 03:41:28 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:47.751 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:47.751 03:41:28 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:47.751 03:41:28 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:47.751 03:41:28 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:47.751 03:41:28 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:47.751 03:41:28 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:47.751 03:41:28 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:47.751 03:41:28 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:47.751 03:41:28 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:47.751 03:41:28 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:47.752 03:41:28 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:47.752 03:41:28 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:47.752 03:41:28 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:47.752 03:41:28 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:47.752 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:47.752 03:41:28 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:47.752 03:41:28 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:47.752 03:41:28 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:47.752 03:41:28 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:47.752 03:41:28 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:47.752 03:41:28 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:47.752 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:47.752 03:41:28 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:47.752 03:41:28 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:47.752 03:41:28 -- nvmf/common.sh@402 -- # is_hw=yes 00:24:47.752 03:41:28 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:24:47.752 03:41:28 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:24:47.752 03:41:28 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:24:47.752 03:41:28 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:24:47.752 03:41:28 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:24:47.752 03:41:28 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:47.752 03:41:28 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:24:47.752 03:41:28 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:24:47.752 03:41:28 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:24:47.752 03:41:28 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:24:47.752 03:41:28 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:24:47.752 03:41:28 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:24:47.752 03:41:28 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:24:47.752 03:41:28 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:24:47.752 03:41:28 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:24:47.752 03:41:28 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:24:47.752 03:41:28 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:24:47.752 03:41:28 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:24:47.752 03:41:28 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:24:47.752 03:41:28 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:24:48.011 03:41:28 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:24:48.011 03:41:28 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:24:48.011 03:41:28 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:24:48.011 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:24:48.011 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.250 ms 00:24:48.011 00:24:48.011 --- 10.0.0.2 ping statistics --- 00:24:48.011 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:48.011 rtt min/avg/max/mdev = 0.250/0.250/0.250/0.000 ms 00:24:48.011 03:41:28 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:24:48.011 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:24:48.011 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.103 ms 00:24:48.011 00:24:48.011 --- 10.0.0.1 ping statistics --- 00:24:48.011 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:48.011 rtt min/avg/max/mdev = 0.103/0.103/0.103/0.000 ms 00:24:48.011 03:41:28 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:24:48.011 03:41:28 -- nvmf/common.sh@410 -- # return 0 00:24:48.011 03:41:28 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:24:48.011 03:41:28 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:24:48.011 03:41:28 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:24:48.011 03:41:28 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:24:48.011 03:41:28 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:24:48.011 03:41:28 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:24:48.011 03:41:28 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:24:48.011 03:41:28 -- host/fio.sh@16 -- # [[ y != y ]] 00:24:48.011 03:41:28 -- host/fio.sh@21 -- # timing_enter start_nvmf_tgt 00:24:48.011 03:41:28 -- common/autotest_common.sh@722 -- # xtrace_disable 00:24:48.011 03:41:28 -- common/autotest_common.sh@10 -- # set +x 00:24:48.011 03:41:28 -- host/fio.sh@24 -- # nvmfpid=3143492 00:24:48.011 03:41:28 -- host/fio.sh@23 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:24:48.011 03:41:28 -- host/fio.sh@26 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:24:48.011 03:41:28 -- host/fio.sh@28 -- # waitforlisten 3143492 00:24:48.011 03:41:28 -- common/autotest_common.sh@829 -- # '[' -z 3143492 ']' 00:24:48.011 03:41:28 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:48.011 03:41:28 -- common/autotest_common.sh@834 -- # local max_retries=100 00:24:48.011 03:41:28 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:48.011 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:48.011 03:41:28 -- common/autotest_common.sh@838 -- # xtrace_disable 00:24:48.011 03:41:28 -- common/autotest_common.sh@10 -- # set +x 00:24:48.011 [2024-11-21 03:41:28.485033] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:24:48.011 [2024-11-21 03:41:28.485156] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:48.011 EAL: No free 2048 kB hugepages reported on node 1 00:24:48.011 [2024-11-21 03:41:28.553369] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:24:48.271 [2024-11-21 03:41:28.667941] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:24:48.271 [2024-11-21 03:41:28.668107] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:48.271 [2024-11-21 03:41:28.668135] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:48.271 [2024-11-21 03:41:28.668147] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:48.271 [2024-11-21 03:41:28.668202] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:24:48.271 [2024-11-21 03:41:28.668295] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:24:48.271 [2024-11-21 03:41:28.668389] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:24:48.271 [2024-11-21 03:41:28.668392] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:48.837 03:41:29 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:24:48.837 03:41:29 -- common/autotest_common.sh@862 -- # return 0 00:24:48.837 03:41:29 -- host/fio.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:24:49.094 [2024-11-21 03:41:29.697403] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:24:49.094 03:41:29 -- host/fio.sh@30 -- # timing_exit start_nvmf_tgt 00:24:49.094 03:41:29 -- common/autotest_common.sh@728 -- # xtrace_disable 00:24:49.094 03:41:29 -- common/autotest_common.sh@10 -- # set +x 00:24:49.094 03:41:29 -- host/fio.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:24:49.354 Malloc1 00:24:49.613 03:41:30 -- host/fio.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:24:49.872 03:41:30 -- host/fio.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:24:50.131 03:41:30 -- host/fio.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:24:50.131 [2024-11-21 03:41:30.769945] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:24:50.389 03:41:30 -- host/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:24:50.647 03:41:31 -- host/fio.sh@38 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:24:50.647 03:41:31 -- host/fio.sh@41 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:24:50.647 03:41:31 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:24:50.647 03:41:31 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:24:50.647 03:41:31 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:24:50.647 03:41:31 -- common/autotest_common.sh@1328 -- # local sanitizers 00:24:50.647 03:41:31 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:50.647 03:41:31 -- common/autotest_common.sh@1330 -- # shift 00:24:50.648 03:41:31 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:24:50.648 03:41:31 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:24:50.648 03:41:31 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:50.648 03:41:31 -- common/autotest_common.sh@1334 -- # grep libasan 00:24:50.648 03:41:31 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:24:50.648 03:41:31 -- common/autotest_common.sh@1334 -- # asan_lib= 00:24:50.648 03:41:31 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:24:50.648 03:41:31 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:24:50.648 03:41:31 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:50.648 03:41:31 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:24:50.648 03:41:31 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:24:50.648 03:41:31 -- common/autotest_common.sh@1334 -- # asan_lib= 00:24:50.648 03:41:31 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:24:50.648 03:41:31 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:24:50.648 03:41:31 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:24:50.648 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:24:50.648 fio-3.35 00:24:50.648 Starting 1 thread 00:24:50.648 EAL: No free 2048 kB hugepages reported on node 1 00:24:53.177 00:24:53.177 test: (groupid=0, jobs=1): err= 0: pid=3143869: Thu Nov 21 03:41:33 2024 00:24:53.177 read: IOPS=9336, BW=36.5MiB/s (38.2MB/s)(73.2MiB/2006msec) 00:24:53.177 slat (nsec): min=1831, max=123373, avg=2427.72, stdev=1812.67 00:24:53.177 clat (usec): min=2108, max=13512, avg=7575.63, stdev=573.41 00:24:53.177 lat (usec): min=2127, max=13515, avg=7578.06, stdev=573.31 00:24:53.177 clat percentiles (usec): 00:24:53.177 | 1.00th=[ 6259], 5.00th=[ 6652], 10.00th=[ 6849], 20.00th=[ 7111], 00:24:53.177 | 30.00th=[ 7308], 40.00th=[ 7439], 50.00th=[ 7570], 60.00th=[ 7701], 00:24:53.177 | 70.00th=[ 7898], 80.00th=[ 8029], 90.00th=[ 8225], 95.00th=[ 8455], 00:24:53.177 | 99.00th=[ 8717], 99.50th=[ 8979], 99.90th=[10945], 99.95th=[12518], 00:24:53.177 | 99.99th=[13435] 00:24:53.177 bw ( KiB/s): min=36136, max=38040, per=99.93%, avg=37318.00, stdev=827.64, samples=4 00:24:53.177 iops : min= 9034, max= 9510, avg=9329.50, stdev=206.91, samples=4 00:24:53.177 write: IOPS=9340, BW=36.5MiB/s (38.3MB/s)(73.2MiB/2006msec); 0 zone resets 00:24:53.177 slat (nsec): min=1971, max=117375, avg=2563.09, stdev=1325.08 00:24:53.177 clat (usec): min=1535, max=11143, avg=6093.53, stdev=491.61 00:24:53.177 lat (usec): min=1541, max=11145, avg=6096.10, stdev=491.58 00:24:53.177 clat percentiles (usec): 00:24:53.177 | 1.00th=[ 5014], 5.00th=[ 5342], 10.00th=[ 5538], 20.00th=[ 5735], 00:24:53.177 | 30.00th=[ 5866], 40.00th=[ 5997], 50.00th=[ 6128], 60.00th=[ 6194], 00:24:53.177 | 70.00th=[ 6325], 80.00th=[ 6456], 90.00th=[ 6652], 95.00th=[ 6849], 00:24:53.177 | 99.00th=[ 7111], 99.50th=[ 7242], 99.90th=[ 9503], 99.95th=[10552], 00:24:53.177 | 99.99th=[11076] 00:24:53.177 bw ( KiB/s): min=37120, max=37640, per=99.99%, avg=37360.00, stdev=226.37, samples=4 00:24:53.177 iops : min= 9280, max= 9410, avg=9340.00, stdev=56.59, samples=4 00:24:53.177 lat (msec) : 2=0.02%, 4=0.10%, 10=99.78%, 20=0.10% 00:24:53.177 cpu : usr=61.55%, sys=35.16%, ctx=95, majf=0, minf=37 00:24:53.177 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.8% 00:24:53.177 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:53.177 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:24:53.177 issued rwts: total=18729,18737,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:53.177 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:53.177 00:24:53.177 Run status group 0 (all jobs): 00:24:53.177 READ: bw=36.5MiB/s (38.2MB/s), 36.5MiB/s-36.5MiB/s (38.2MB/s-38.2MB/s), io=73.2MiB (76.7MB), run=2006-2006msec 00:24:53.177 WRITE: bw=36.5MiB/s (38.3MB/s), 36.5MiB/s-36.5MiB/s (38.3MB/s-38.3MB/s), io=73.2MiB (76.7MB), run=2006-2006msec 00:24:53.177 03:41:33 -- host/fio.sh@45 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:24:53.177 03:41:33 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:24:53.177 03:41:33 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:24:53.177 03:41:33 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:24:53.177 03:41:33 -- common/autotest_common.sh@1328 -- # local sanitizers 00:24:53.178 03:41:33 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:53.178 03:41:33 -- common/autotest_common.sh@1330 -- # shift 00:24:53.178 03:41:33 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:24:53.178 03:41:33 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:24:53.178 03:41:33 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:53.178 03:41:33 -- common/autotest_common.sh@1334 -- # grep libasan 00:24:53.178 03:41:33 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:24:53.178 03:41:33 -- common/autotest_common.sh@1334 -- # asan_lib= 00:24:53.178 03:41:33 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:24:53.178 03:41:33 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:24:53.178 03:41:33 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:53.178 03:41:33 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:24:53.178 03:41:33 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:24:53.178 03:41:33 -- common/autotest_common.sh@1334 -- # asan_lib= 00:24:53.178 03:41:33 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:24:53.178 03:41:33 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:24:53.178 03:41:33 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:24:53.178 test: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=spdk, iodepth=128 00:24:53.178 fio-3.35 00:24:53.178 Starting 1 thread 00:24:53.438 EAL: No free 2048 kB hugepages reported on node 1 00:24:56.037 [2024-11-21 03:41:36.106577] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c503e0 is same with the state(5) to be set 00:24:56.037 [2024-11-21 03:41:36.106691] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c503e0 is same with the state(5) to be set 00:24:56.037 00:24:56.037 test: (groupid=0, jobs=1): err= 0: pid=3144333: Thu Nov 21 03:41:36 2024 00:24:56.037 read: IOPS=8743, BW=137MiB/s (143MB/s)(274MiB/2006msec) 00:24:56.037 slat (nsec): min=2903, max=91327, avg=3646.92, stdev=1617.37 00:24:56.037 clat (usec): min=1460, max=53058, avg=8552.75, stdev=3895.23 00:24:56.037 lat (usec): min=1464, max=53061, avg=8556.40, stdev=3895.25 00:24:56.037 clat percentiles (usec): 00:24:56.037 | 1.00th=[ 4424], 5.00th=[ 5276], 10.00th=[ 5932], 20.00th=[ 6587], 00:24:56.037 | 30.00th=[ 7111], 40.00th=[ 7635], 50.00th=[ 8225], 60.00th=[ 8717], 00:24:56.037 | 70.00th=[ 9241], 80.00th=[ 9896], 90.00th=[10814], 95.00th=[11731], 00:24:56.037 | 99.00th=[14091], 99.50th=[45351], 99.90th=[52167], 99.95th=[52691], 00:24:56.037 | 99.99th=[53216] 00:24:56.037 bw ( KiB/s): min=55744, max=82912, per=51.51%, avg=72056.00, stdev=13062.91, samples=4 00:24:56.037 iops : min= 3484, max= 5182, avg=4503.50, stdev=816.43, samples=4 00:24:56.037 write: IOPS=5345, BW=83.5MiB/s (87.6MB/s)(148MiB/1769msec); 0 zone resets 00:24:56.037 slat (usec): min=30, max=189, avg=33.83, stdev= 5.65 00:24:56.037 clat (usec): min=4153, max=18051, avg=10545.56, stdev=1874.67 00:24:56.037 lat (usec): min=4184, max=18083, avg=10579.39, stdev=1875.36 00:24:56.037 clat percentiles (usec): 00:24:56.037 | 1.00th=[ 6783], 5.00th=[ 7635], 10.00th=[ 8291], 20.00th=[ 8979], 00:24:56.037 | 30.00th=[ 9503], 40.00th=[ 9896], 50.00th=[10421], 60.00th=[10814], 00:24:56.037 | 70.00th=[11469], 80.00th=[12125], 90.00th=[13042], 95.00th=[13698], 00:24:56.037 | 99.00th=[15533], 99.50th=[16450], 99.90th=[17695], 99.95th=[17957], 00:24:56.037 | 99.99th=[17957] 00:24:56.037 bw ( KiB/s): min=59200, max=86016, per=87.87%, avg=75152.00, stdev=13187.87, samples=4 00:24:56.037 iops : min= 3700, max= 5376, avg=4697.00, stdev=824.24, samples=4 00:24:56.037 lat (msec) : 2=0.01%, 4=0.17%, 10=67.57%, 20=31.78%, 50=0.30% 00:24:56.037 lat (msec) : 100=0.17% 00:24:56.037 cpu : usr=75.72%, sys=21.98%, ctx=26, majf=0, minf=71 00:24:56.037 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.8% 00:24:56.037 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:56.037 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:24:56.038 issued rwts: total=17540,9456,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:56.038 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:56.038 00:24:56.038 Run status group 0 (all jobs): 00:24:56.038 READ: bw=137MiB/s (143MB/s), 137MiB/s-137MiB/s (143MB/s-143MB/s), io=274MiB (287MB), run=2006-2006msec 00:24:56.038 WRITE: bw=83.5MiB/s (87.6MB/s), 83.5MiB/s-83.5MiB/s (87.6MB/s-87.6MB/s), io=148MiB (155MB), run=1769-1769msec 00:24:56.038 03:41:36 -- host/fio.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:24:56.038 03:41:36 -- host/fio.sh@49 -- # '[' 1 -eq 1 ']' 00:24:56.038 03:41:36 -- host/fio.sh@51 -- # bdfs=($(get_nvme_bdfs)) 00:24:56.038 03:41:36 -- host/fio.sh@51 -- # get_nvme_bdfs 00:24:56.038 03:41:36 -- common/autotest_common.sh@1508 -- # bdfs=() 00:24:56.038 03:41:36 -- common/autotest_common.sh@1508 -- # local bdfs 00:24:56.038 03:41:36 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:24:56.038 03:41:36 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:24:56.038 03:41:36 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:24:56.038 03:41:36 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:24:56.038 03:41:36 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:24:56.038 03:41:36 -- host/fio.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:88:00.0 -i 10.0.0.2 00:24:59.330 Nvme0n1 00:24:59.330 03:41:39 -- host/fio.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore -c 1073741824 Nvme0n1 lvs_0 00:25:01.863 03:41:42 -- host/fio.sh@53 -- # ls_guid=cbe516e6-c373-41bc-bc1d-b83c446cc205 00:25:01.863 03:41:42 -- host/fio.sh@54 -- # get_lvs_free_mb cbe516e6-c373-41bc-bc1d-b83c446cc205 00:25:01.863 03:41:42 -- common/autotest_common.sh@1353 -- # local lvs_uuid=cbe516e6-c373-41bc-bc1d-b83c446cc205 00:25:01.863 03:41:42 -- common/autotest_common.sh@1354 -- # local lvs_info 00:25:01.863 03:41:42 -- common/autotest_common.sh@1355 -- # local fc 00:25:01.863 03:41:42 -- common/autotest_common.sh@1356 -- # local cs 00:25:01.864 03:41:42 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:25:02.121 03:41:42 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:25:02.121 { 00:25:02.121 "uuid": "cbe516e6-c373-41bc-bc1d-b83c446cc205", 00:25:02.121 "name": "lvs_0", 00:25:02.121 "base_bdev": "Nvme0n1", 00:25:02.121 "total_data_clusters": 930, 00:25:02.121 "free_clusters": 930, 00:25:02.121 "block_size": 512, 00:25:02.121 "cluster_size": 1073741824 00:25:02.121 } 00:25:02.121 ]' 00:25:02.121 03:41:42 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="cbe516e6-c373-41bc-bc1d-b83c446cc205") .free_clusters' 00:25:02.379 03:41:42 -- common/autotest_common.sh@1358 -- # fc=930 00:25:02.379 03:41:42 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="cbe516e6-c373-41bc-bc1d-b83c446cc205") .cluster_size' 00:25:02.379 03:41:42 -- common/autotest_common.sh@1359 -- # cs=1073741824 00:25:02.379 03:41:42 -- common/autotest_common.sh@1362 -- # free_mb=952320 00:25:02.379 03:41:42 -- common/autotest_common.sh@1363 -- # echo 952320 00:25:02.379 952320 00:25:02.379 03:41:42 -- host/fio.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -l lvs_0 lbd_0 952320 00:25:02.637 5f52cfb8-bb68-4e61-92ce-0859164296d1 00:25:02.637 03:41:43 -- host/fio.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000001 00:25:02.896 03:41:43 -- host/fio.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 lvs_0/lbd_0 00:25:03.154 03:41:43 -- host/fio.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:25:03.413 03:41:44 -- host/fio.sh@59 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:03.413 03:41:44 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:03.413 03:41:44 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:25:03.413 03:41:44 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:25:03.413 03:41:44 -- common/autotest_common.sh@1328 -- # local sanitizers 00:25:03.413 03:41:44 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:03.413 03:41:44 -- common/autotest_common.sh@1330 -- # shift 00:25:03.413 03:41:44 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:25:03.413 03:41:44 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:25:03.413 03:41:44 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:03.413 03:41:44 -- common/autotest_common.sh@1334 -- # grep libasan 00:25:03.413 03:41:44 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:25:03.413 03:41:44 -- common/autotest_common.sh@1334 -- # asan_lib= 00:25:03.413 03:41:44 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:25:03.413 03:41:44 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:25:03.413 03:41:44 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:03.413 03:41:44 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:25:03.413 03:41:44 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:25:03.413 03:41:44 -- common/autotest_common.sh@1334 -- # asan_lib= 00:25:03.413 03:41:44 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:25:03.413 03:41:44 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:25:03.413 03:41:44 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:03.671 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:25:03.671 fio-3.35 00:25:03.671 Starting 1 thread 00:25:03.671 EAL: No free 2048 kB hugepages reported on node 1 00:25:06.199 00:25:06.199 test: (groupid=0, jobs=1): err= 0: pid=3145655: Thu Nov 21 03:41:46 2024 00:25:06.199 read: IOPS=6488, BW=25.3MiB/s (26.6MB/s)(50.9MiB/2008msec) 00:25:06.199 slat (nsec): min=1933, max=147528, avg=2611.40, stdev=2050.91 00:25:06.199 clat (usec): min=899, max=170760, avg=10874.17, stdev=11234.92 00:25:06.199 lat (usec): min=903, max=170804, avg=10876.78, stdev=11235.18 00:25:06.199 clat percentiles (msec): 00:25:06.199 | 1.00th=[ 9], 5.00th=[ 9], 10.00th=[ 9], 20.00th=[ 10], 00:25:06.199 | 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11], 00:25:06.199 | 70.00th=[ 11], 80.00th=[ 11], 90.00th=[ 12], 95.00th=[ 12], 00:25:06.199 | 99.00th=[ 12], 99.50th=[ 157], 99.90th=[ 171], 99.95th=[ 171], 00:25:06.199 | 99.99th=[ 171] 00:25:06.199 bw ( KiB/s): min=18544, max=28608, per=99.85%, avg=25916.00, stdev=4918.87, samples=4 00:25:06.199 iops : min= 4636, max= 7152, avg=6479.00, stdev=1229.72, samples=4 00:25:06.199 write: IOPS=6496, BW=25.4MiB/s (26.6MB/s)(51.0MiB/2008msec); 0 zone resets 00:25:06.199 slat (usec): min=2, max=100, avg= 2.69, stdev= 1.58 00:25:06.199 clat (usec): min=260, max=169039, avg=8742.54, stdev=10534.38 00:25:06.199 lat (usec): min=264, max=169043, avg=8745.22, stdev=10534.63 00:25:06.199 clat percentiles (msec): 00:25:06.199 | 1.00th=[ 7], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 8], 00:25:06.199 | 30.00th=[ 8], 40.00th=[ 8], 50.00th=[ 9], 60.00th=[ 9], 00:25:06.200 | 70.00th=[ 9], 80.00th=[ 9], 90.00th=[ 9], 95.00th=[ 10], 00:25:06.200 | 99.00th=[ 10], 99.50th=[ 15], 99.90th=[ 169], 99.95th=[ 169], 00:25:06.200 | 99.99th=[ 169] 00:25:06.200 bw ( KiB/s): min=19560, max=28288, per=99.97%, avg=25978.00, stdev=4280.69, samples=4 00:25:06.200 iops : min= 4890, max= 7072, avg=6494.50, stdev=1070.17, samples=4 00:25:06.200 lat (usec) : 500=0.01%, 750=0.01%, 1000=0.01% 00:25:06.200 lat (msec) : 2=0.03%, 4=0.16%, 10=72.33%, 20=26.96%, 250=0.49% 00:25:06.200 cpu : usr=60.64%, sys=36.77%, ctx=108, majf=0, minf=37 00:25:06.200 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.8% 00:25:06.200 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:25:06.200 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:25:06.200 issued rwts: total=13029,13045,0,0 short=0,0,0,0 dropped=0,0,0,0 00:25:06.200 latency : target=0, window=0, percentile=100.00%, depth=128 00:25:06.200 00:25:06.200 Run status group 0 (all jobs): 00:25:06.200 READ: bw=25.3MiB/s (26.6MB/s), 25.3MiB/s-25.3MiB/s (26.6MB/s-26.6MB/s), io=50.9MiB (53.4MB), run=2008-2008msec 00:25:06.200 WRITE: bw=25.4MiB/s (26.6MB/s), 25.4MiB/s-25.4MiB/s (26.6MB/s-26.6MB/s), io=51.0MiB (53.4MB), run=2008-2008msec 00:25:06.200 03:41:46 -- host/fio.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:25:06.459 03:41:46 -- host/fio.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --clear-method none lvs_0/lbd_0 lvs_n_0 00:25:07.395 03:41:47 -- host/fio.sh@64 -- # ls_nested_guid=41fd2286-aaed-47c3-a51c-cf380fdd1584 00:25:07.395 03:41:47 -- host/fio.sh@65 -- # get_lvs_free_mb 41fd2286-aaed-47c3-a51c-cf380fdd1584 00:25:07.395 03:41:47 -- common/autotest_common.sh@1353 -- # local lvs_uuid=41fd2286-aaed-47c3-a51c-cf380fdd1584 00:25:07.395 03:41:47 -- common/autotest_common.sh@1354 -- # local lvs_info 00:25:07.395 03:41:47 -- common/autotest_common.sh@1355 -- # local fc 00:25:07.395 03:41:47 -- common/autotest_common.sh@1356 -- # local cs 00:25:07.395 03:41:47 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:25:07.652 03:41:48 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:25:07.652 { 00:25:07.652 "uuid": "cbe516e6-c373-41bc-bc1d-b83c446cc205", 00:25:07.652 "name": "lvs_0", 00:25:07.652 "base_bdev": "Nvme0n1", 00:25:07.652 "total_data_clusters": 930, 00:25:07.652 "free_clusters": 0, 00:25:07.652 "block_size": 512, 00:25:07.652 "cluster_size": 1073741824 00:25:07.652 }, 00:25:07.652 { 00:25:07.652 "uuid": "41fd2286-aaed-47c3-a51c-cf380fdd1584", 00:25:07.652 "name": "lvs_n_0", 00:25:07.652 "base_bdev": "5f52cfb8-bb68-4e61-92ce-0859164296d1", 00:25:07.652 "total_data_clusters": 237847, 00:25:07.652 "free_clusters": 237847, 00:25:07.652 "block_size": 512, 00:25:07.652 "cluster_size": 4194304 00:25:07.652 } 00:25:07.652 ]' 00:25:07.652 03:41:48 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="41fd2286-aaed-47c3-a51c-cf380fdd1584") .free_clusters' 00:25:07.652 03:41:48 -- common/autotest_common.sh@1358 -- # fc=237847 00:25:07.652 03:41:48 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="41fd2286-aaed-47c3-a51c-cf380fdd1584") .cluster_size' 00:25:07.652 03:41:48 -- common/autotest_common.sh@1359 -- # cs=4194304 00:25:07.652 03:41:48 -- common/autotest_common.sh@1362 -- # free_mb=951388 00:25:07.652 03:41:48 -- common/autotest_common.sh@1363 -- # echo 951388 00:25:07.652 951388 00:25:07.652 03:41:48 -- host/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -l lvs_n_0 lbd_nest_0 951388 00:25:08.586 71b2dbf0-cc8f-433f-90da-a914b2307d8c 00:25:08.586 03:41:48 -- host/fio.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000001 00:25:08.586 03:41:49 -- host/fio.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 lvs_n_0/lbd_nest_0 00:25:08.844 03:41:49 -- host/fio.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:25:09.102 03:41:49 -- host/fio.sh@70 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:09.102 03:41:49 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:09.102 03:41:49 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:25:09.102 03:41:49 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:25:09.102 03:41:49 -- common/autotest_common.sh@1328 -- # local sanitizers 00:25:09.102 03:41:49 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:09.102 03:41:49 -- common/autotest_common.sh@1330 -- # shift 00:25:09.102 03:41:49 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:25:09.102 03:41:49 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:25:09.102 03:41:49 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:09.102 03:41:49 -- common/autotest_common.sh@1334 -- # grep libasan 00:25:09.102 03:41:49 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:25:09.102 03:41:49 -- common/autotest_common.sh@1334 -- # asan_lib= 00:25:09.102 03:41:49 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:25:09.102 03:41:49 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:25:09.102 03:41:49 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:09.102 03:41:49 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:25:09.102 03:41:49 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:25:09.360 03:41:49 -- common/autotest_common.sh@1334 -- # asan_lib= 00:25:09.360 03:41:49 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:25:09.360 03:41:49 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:25:09.360 03:41:49 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:09.360 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:25:09.360 fio-3.35 00:25:09.360 Starting 1 thread 00:25:09.360 EAL: No free 2048 kB hugepages reported on node 1 00:25:11.895 00:25:11.895 test: (groupid=0, jobs=1): err= 0: pid=3146415: Thu Nov 21 03:41:52 2024 00:25:11.895 read: IOPS=6195, BW=24.2MiB/s (25.4MB/s)(48.6MiB/2008msec) 00:25:11.895 slat (nsec): min=1843, max=151322, avg=2467.59, stdev=2180.08 00:25:11.895 clat (usec): min=4416, max=18525, avg=11400.24, stdev=957.60 00:25:11.895 lat (usec): min=4421, max=18528, avg=11402.70, stdev=957.49 00:25:11.895 clat percentiles (usec): 00:25:11.895 | 1.00th=[ 9110], 5.00th=[ 9896], 10.00th=[10290], 20.00th=[10683], 00:25:11.895 | 30.00th=[10945], 40.00th=[11207], 50.00th=[11338], 60.00th=[11600], 00:25:11.895 | 70.00th=[11863], 80.00th=[12125], 90.00th=[12518], 95.00th=[12911], 00:25:11.895 | 99.00th=[13435], 99.50th=[13698], 99.90th=[17171], 99.95th=[18220], 00:25:11.895 | 99.99th=[18482] 00:25:11.895 bw ( KiB/s): min=23304, max=25320, per=99.88%, avg=24750.00, stdev=966.14, samples=4 00:25:11.895 iops : min= 5826, max= 6330, avg=6187.50, stdev=241.54, samples=4 00:25:11.895 write: IOPS=6187, BW=24.2MiB/s (25.3MB/s)(48.5MiB/2008msec); 0 zone resets 00:25:11.895 slat (nsec): min=1962, max=89953, avg=2594.60, stdev=1506.74 00:25:11.895 clat (usec): min=2164, max=17013, avg=9103.01, stdev=827.57 00:25:11.895 lat (usec): min=2170, max=17015, avg=9105.61, stdev=827.52 00:25:11.895 clat percentiles (usec): 00:25:11.895 | 1.00th=[ 7242], 5.00th=[ 7832], 10.00th=[ 8094], 20.00th=[ 8455], 00:25:11.895 | 30.00th=[ 8717], 40.00th=[ 8979], 50.00th=[ 9110], 60.00th=[ 9241], 00:25:11.895 | 70.00th=[ 9503], 80.00th=[ 9765], 90.00th=[10028], 95.00th=[10290], 00:25:11.895 | 99.00th=[10945], 99.50th=[11207], 99.90th=[12911], 99.95th=[15270], 00:25:11.895 | 99.99th=[16909] 00:25:11.895 bw ( KiB/s): min=24472, max=24960, per=99.90%, avg=24726.00, stdev=201.26, samples=4 00:25:11.895 iops : min= 6118, max= 6240, avg=6181.50, stdev=50.32, samples=4 00:25:11.895 lat (msec) : 4=0.04%, 10=46.69%, 20=53.26% 00:25:11.895 cpu : usr=61.39%, sys=36.02%, ctx=110, majf=0, minf=37 00:25:11.895 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.7% 00:25:11.896 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:25:11.896 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:25:11.896 issued rwts: total=12440,12425,0,0 short=0,0,0,0 dropped=0,0,0,0 00:25:11.896 latency : target=0, window=0, percentile=100.00%, depth=128 00:25:11.896 00:25:11.896 Run status group 0 (all jobs): 00:25:11.896 READ: bw=24.2MiB/s (25.4MB/s), 24.2MiB/s-24.2MiB/s (25.4MB/s-25.4MB/s), io=48.6MiB (51.0MB), run=2008-2008msec 00:25:11.896 WRITE: bw=24.2MiB/s (25.3MB/s), 24.2MiB/s-24.2MiB/s (25.3MB/s-25.3MB/s), io=48.5MiB (50.9MB), run=2008-2008msec 00:25:11.896 03:41:52 -- host/fio.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:25:11.896 03:41:52 -- host/fio.sh@74 -- # sync 00:25:11.896 03:41:52 -- host/fio.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -t 120 bdev_lvol_delete lvs_n_0/lbd_nest_0 00:25:16.093 03:41:56 -- host/fio.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_n_0 00:25:16.093 03:41:56 -- host/fio.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete lvs_0/lbd_0 00:25:18.803 03:41:59 -- host/fio.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_0 00:25:19.369 03:41:59 -- host/fio.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_detach_controller Nvme0 00:25:21.271 03:42:01 -- host/fio.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:25:21.271 03:42:01 -- host/fio.sh@85 -- # rm -f ./local-test-0-verify.state 00:25:21.271 03:42:01 -- host/fio.sh@86 -- # nvmftestfini 00:25:21.271 03:42:01 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:21.271 03:42:01 -- nvmf/common.sh@116 -- # sync 00:25:21.271 03:42:01 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:21.271 03:42:01 -- nvmf/common.sh@119 -- # set +e 00:25:21.271 03:42:01 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:21.271 03:42:01 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:21.271 rmmod nvme_tcp 00:25:21.271 rmmod nvme_fabrics 00:25:21.271 rmmod nvme_keyring 00:25:21.271 03:42:01 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:21.271 03:42:01 -- nvmf/common.sh@123 -- # set -e 00:25:21.271 03:42:01 -- nvmf/common.sh@124 -- # return 0 00:25:21.271 03:42:01 -- nvmf/common.sh@477 -- # '[' -n 3143492 ']' 00:25:21.271 03:42:01 -- nvmf/common.sh@478 -- # killprocess 3143492 00:25:21.271 03:42:01 -- common/autotest_common.sh@936 -- # '[' -z 3143492 ']' 00:25:21.271 03:42:01 -- common/autotest_common.sh@940 -- # kill -0 3143492 00:25:21.271 03:42:01 -- common/autotest_common.sh@941 -- # uname 00:25:21.271 03:42:01 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:21.271 03:42:01 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3143492 00:25:21.271 03:42:01 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:21.271 03:42:01 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:21.271 03:42:01 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3143492' 00:25:21.271 killing process with pid 3143492 00:25:21.271 03:42:01 -- common/autotest_common.sh@955 -- # kill 3143492 00:25:21.271 03:42:01 -- common/autotest_common.sh@960 -- # wait 3143492 00:25:21.530 03:42:02 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:21.530 03:42:02 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:21.530 03:42:02 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:21.530 03:42:02 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:21.530 03:42:02 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:21.530 03:42:02 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:21.530 03:42:02 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:21.530 03:42:02 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:24.069 03:42:04 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:24.069 00:25:24.070 real 0m37.894s 00:25:24.070 user 2m25.228s 00:25:24.070 sys 0m7.000s 00:25:24.070 03:42:04 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:24.070 03:42:04 -- common/autotest_common.sh@10 -- # set +x 00:25:24.070 ************************************ 00:25:24.070 END TEST nvmf_fio_host 00:25:24.070 ************************************ 00:25:24.070 03:42:04 -- nvmf/nvmf.sh@100 -- # run_test nvmf_failover /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:25:24.070 03:42:04 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:24.070 03:42:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:24.070 03:42:04 -- common/autotest_common.sh@10 -- # set +x 00:25:24.070 ************************************ 00:25:24.070 START TEST nvmf_failover 00:25:24.070 ************************************ 00:25:24.070 03:42:04 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:25:24.070 * Looking for test storage... 00:25:24.070 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:24.070 03:42:04 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:24.070 03:42:04 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:24.070 03:42:04 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:24.070 03:42:04 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:24.070 03:42:04 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:24.070 03:42:04 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:24.070 03:42:04 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:24.070 03:42:04 -- scripts/common.sh@335 -- # IFS=.-: 00:25:24.070 03:42:04 -- scripts/common.sh@335 -- # read -ra ver1 00:25:24.070 03:42:04 -- scripts/common.sh@336 -- # IFS=.-: 00:25:24.070 03:42:04 -- scripts/common.sh@336 -- # read -ra ver2 00:25:24.070 03:42:04 -- scripts/common.sh@337 -- # local 'op=<' 00:25:24.070 03:42:04 -- scripts/common.sh@339 -- # ver1_l=2 00:25:24.070 03:42:04 -- scripts/common.sh@340 -- # ver2_l=1 00:25:24.070 03:42:04 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:24.070 03:42:04 -- scripts/common.sh@343 -- # case "$op" in 00:25:24.070 03:42:04 -- scripts/common.sh@344 -- # : 1 00:25:24.070 03:42:04 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:24.070 03:42:04 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:24.070 03:42:04 -- scripts/common.sh@364 -- # decimal 1 00:25:24.070 03:42:04 -- scripts/common.sh@352 -- # local d=1 00:25:24.070 03:42:04 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:24.070 03:42:04 -- scripts/common.sh@354 -- # echo 1 00:25:24.070 03:42:04 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:24.070 03:42:04 -- scripts/common.sh@365 -- # decimal 2 00:25:24.070 03:42:04 -- scripts/common.sh@352 -- # local d=2 00:25:24.070 03:42:04 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:24.070 03:42:04 -- scripts/common.sh@354 -- # echo 2 00:25:24.070 03:42:04 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:24.070 03:42:04 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:24.070 03:42:04 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:24.070 03:42:04 -- scripts/common.sh@367 -- # return 0 00:25:24.070 03:42:04 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:24.070 03:42:04 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:24.070 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:24.070 --rc genhtml_branch_coverage=1 00:25:24.070 --rc genhtml_function_coverage=1 00:25:24.070 --rc genhtml_legend=1 00:25:24.070 --rc geninfo_all_blocks=1 00:25:24.070 --rc geninfo_unexecuted_blocks=1 00:25:24.070 00:25:24.070 ' 00:25:24.070 03:42:04 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:24.070 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:24.070 --rc genhtml_branch_coverage=1 00:25:24.070 --rc genhtml_function_coverage=1 00:25:24.070 --rc genhtml_legend=1 00:25:24.070 --rc geninfo_all_blocks=1 00:25:24.070 --rc geninfo_unexecuted_blocks=1 00:25:24.070 00:25:24.070 ' 00:25:24.070 03:42:04 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:24.070 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:24.070 --rc genhtml_branch_coverage=1 00:25:24.070 --rc genhtml_function_coverage=1 00:25:24.070 --rc genhtml_legend=1 00:25:24.070 --rc geninfo_all_blocks=1 00:25:24.070 --rc geninfo_unexecuted_blocks=1 00:25:24.070 00:25:24.070 ' 00:25:24.070 03:42:04 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:24.070 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:24.070 --rc genhtml_branch_coverage=1 00:25:24.070 --rc genhtml_function_coverage=1 00:25:24.070 --rc genhtml_legend=1 00:25:24.070 --rc geninfo_all_blocks=1 00:25:24.070 --rc geninfo_unexecuted_blocks=1 00:25:24.070 00:25:24.070 ' 00:25:24.070 03:42:04 -- host/failover.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:24.070 03:42:04 -- nvmf/common.sh@7 -- # uname -s 00:25:24.070 03:42:04 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:24.070 03:42:04 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:24.070 03:42:04 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:24.070 03:42:04 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:24.070 03:42:04 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:24.070 03:42:04 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:24.070 03:42:04 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:24.070 03:42:04 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:24.070 03:42:04 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:24.070 03:42:04 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:24.070 03:42:04 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:24.070 03:42:04 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:24.070 03:42:04 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:24.070 03:42:04 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:24.070 03:42:04 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:24.070 03:42:04 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:24.070 03:42:04 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:24.070 03:42:04 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:24.070 03:42:04 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:24.070 03:42:04 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:24.070 03:42:04 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:24.070 03:42:04 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:24.070 03:42:04 -- paths/export.sh@5 -- # export PATH 00:25:24.070 03:42:04 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:24.070 03:42:04 -- nvmf/common.sh@46 -- # : 0 00:25:24.070 03:42:04 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:24.070 03:42:04 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:24.070 03:42:04 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:24.070 03:42:04 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:24.071 03:42:04 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:24.071 03:42:04 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:24.071 03:42:04 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:24.071 03:42:04 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:24.071 03:42:04 -- host/failover.sh@11 -- # MALLOC_BDEV_SIZE=64 00:25:24.071 03:42:04 -- host/failover.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:25:24.071 03:42:04 -- host/failover.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:25:24.071 03:42:04 -- host/failover.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:25:24.071 03:42:04 -- host/failover.sh@18 -- # nvmftestinit 00:25:24.071 03:42:04 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:24.071 03:42:04 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:24.071 03:42:04 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:24.071 03:42:04 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:24.071 03:42:04 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:24.071 03:42:04 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:24.071 03:42:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:24.071 03:42:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:24.071 03:42:04 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:24.071 03:42:04 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:24.071 03:42:04 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:24.071 03:42:04 -- common/autotest_common.sh@10 -- # set +x 00:25:25.973 03:42:06 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:25.973 03:42:06 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:25.973 03:42:06 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:25.973 03:42:06 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:25.973 03:42:06 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:25.973 03:42:06 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:25.973 03:42:06 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:25.973 03:42:06 -- nvmf/common.sh@294 -- # net_devs=() 00:25:25.973 03:42:06 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:25.973 03:42:06 -- nvmf/common.sh@295 -- # e810=() 00:25:25.973 03:42:06 -- nvmf/common.sh@295 -- # local -ga e810 00:25:25.973 03:42:06 -- nvmf/common.sh@296 -- # x722=() 00:25:25.973 03:42:06 -- nvmf/common.sh@296 -- # local -ga x722 00:25:25.973 03:42:06 -- nvmf/common.sh@297 -- # mlx=() 00:25:25.973 03:42:06 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:25.973 03:42:06 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:25.973 03:42:06 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:25.973 03:42:06 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:25.973 03:42:06 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:25.973 03:42:06 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:25.973 03:42:06 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:25.973 03:42:06 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:25.973 03:42:06 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:25.973 03:42:06 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:25.973 03:42:06 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:25.973 03:42:06 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:25.973 03:42:06 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:25.973 03:42:06 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:25.973 03:42:06 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:25.973 03:42:06 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:25.973 03:42:06 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:25.973 03:42:06 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:25.973 03:42:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:25.973 03:42:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:25.973 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:25.973 03:42:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:25.973 03:42:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:25.973 03:42:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:25.973 03:42:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:25.973 03:42:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:25.973 03:42:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:25.973 03:42:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:25.973 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:25.973 03:42:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:25.973 03:42:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:25.973 03:42:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:25.973 03:42:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:25.973 03:42:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:25.973 03:42:06 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:25.973 03:42:06 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:25.973 03:42:06 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:25.973 03:42:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:25.973 03:42:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:25.973 03:42:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:25.973 03:42:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:25.973 03:42:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:25.973 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:25.973 03:42:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:25.973 03:42:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:25.973 03:42:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:25.973 03:42:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:25.973 03:42:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:25.973 03:42:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:25.973 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:25.973 03:42:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:25.973 03:42:06 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:25.973 03:42:06 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:25.973 03:42:06 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:25.973 03:42:06 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:25.973 03:42:06 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:25.973 03:42:06 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:25.973 03:42:06 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:25.973 03:42:06 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:25.973 03:42:06 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:25.973 03:42:06 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:25.973 03:42:06 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:25.973 03:42:06 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:25.973 03:42:06 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:25.973 03:42:06 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:25.973 03:42:06 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:25.973 03:42:06 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:25.973 03:42:06 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:25.973 03:42:06 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:25.973 03:42:06 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:25.973 03:42:06 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:25.973 03:42:06 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:25.973 03:42:06 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:25.973 03:42:06 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:25.973 03:42:06 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:25.973 03:42:06 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:25.973 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:25.973 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.312 ms 00:25:25.973 00:25:25.973 --- 10.0.0.2 ping statistics --- 00:25:25.973 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:25.973 rtt min/avg/max/mdev = 0.312/0.312/0.312/0.000 ms 00:25:25.973 03:42:06 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:25.973 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:25.973 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.101 ms 00:25:25.973 00:25:25.973 --- 10.0.0.1 ping statistics --- 00:25:25.973 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:25.974 rtt min/avg/max/mdev = 0.101/0.101/0.101/0.000 ms 00:25:25.974 03:42:06 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:25.974 03:42:06 -- nvmf/common.sh@410 -- # return 0 00:25:25.974 03:42:06 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:25.974 03:42:06 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:25.974 03:42:06 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:25.974 03:42:06 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:25.974 03:42:06 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:25.974 03:42:06 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:25.974 03:42:06 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:25.974 03:42:06 -- host/failover.sh@20 -- # nvmfappstart -m 0xE 00:25:25.974 03:42:06 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:25.974 03:42:06 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:25.974 03:42:06 -- common/autotest_common.sh@10 -- # set +x 00:25:25.974 03:42:06 -- nvmf/common.sh@469 -- # nvmfpid=3149862 00:25:25.974 03:42:06 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:25:25.974 03:42:06 -- nvmf/common.sh@470 -- # waitforlisten 3149862 00:25:25.974 03:42:06 -- common/autotest_common.sh@829 -- # '[' -z 3149862 ']' 00:25:25.974 03:42:06 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:25.974 03:42:06 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:25.974 03:42:06 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:25.974 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:25.974 03:42:06 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:25.974 03:42:06 -- common/autotest_common.sh@10 -- # set +x 00:25:25.974 [2024-11-21 03:42:06.439446] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:25.974 [2024-11-21 03:42:06.439548] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:25.974 EAL: No free 2048 kB hugepages reported on node 1 00:25:25.974 [2024-11-21 03:42:06.510886] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:25:26.234 [2024-11-21 03:42:06.624915] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:26.234 [2024-11-21 03:42:06.625097] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:26.234 [2024-11-21 03:42:06.625119] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:26.234 [2024-11-21 03:42:06.625148] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:26.234 [2024-11-21 03:42:06.625219] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:26.234 [2024-11-21 03:42:06.625279] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:26.234 [2024-11-21 03:42:06.625282] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:26.806 03:42:07 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:26.806 03:42:07 -- common/autotest_common.sh@862 -- # return 0 00:25:26.806 03:42:07 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:26.806 03:42:07 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:26.806 03:42:07 -- common/autotest_common.sh@10 -- # set +x 00:25:26.806 03:42:07 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:26.806 03:42:07 -- host/failover.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:25:27.063 [2024-11-21 03:42:07.705841] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:27.321 03:42:07 -- host/failover.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc0 00:25:27.579 Malloc0 00:25:27.579 03:42:08 -- host/failover.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:25:27.837 03:42:08 -- host/failover.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:25:28.095 03:42:08 -- host/failover.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:28.354 [2024-11-21 03:42:08.797439] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:28.354 03:42:08 -- host/failover.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:25:28.612 [2024-11-21 03:42:09.058159] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:25:28.612 03:42:09 -- host/failover.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:25:28.870 [2024-11-21 03:42:09.314975] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:25:28.870 03:42:09 -- host/failover.sh@31 -- # bdevperf_pid=3150770 00:25:28.870 03:42:09 -- host/failover.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 15 -f 00:25:28.870 03:42:09 -- host/failover.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; cat $testdir/try.txt; rm -f $testdir/try.txt; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:25:28.870 03:42:09 -- host/failover.sh@34 -- # waitforlisten 3150770 /var/tmp/bdevperf.sock 00:25:28.870 03:42:09 -- common/autotest_common.sh@829 -- # '[' -z 3150770 ']' 00:25:28.870 03:42:09 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:28.870 03:42:09 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:28.870 03:42:09 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:28.870 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:28.870 03:42:09 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:28.870 03:42:09 -- common/autotest_common.sh@10 -- # set +x 00:25:29.804 03:42:10 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:29.804 03:42:10 -- common/autotest_common.sh@862 -- # return 0 00:25:29.805 03:42:10 -- host/failover.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:30.373 NVMe0n1 00:25:30.373 03:42:10 -- host/failover.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:30.631 00:25:30.889 03:42:11 -- host/failover.sh@39 -- # run_test_pid=3151042 00:25:30.889 03:42:11 -- host/failover.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:25:30.889 03:42:11 -- host/failover.sh@41 -- # sleep 1 00:25:31.826 03:42:12 -- host/failover.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:32.084 [2024-11-21 03:42:12.511530] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2377cb0 is same with the state(5) to be set 00:25:32.084 [2024-11-21 03:42:12.511607] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2377cb0 is same with the state(5) to be set 00:25:32.084 [2024-11-21 03:42:12.511623] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2377cb0 is same with the state(5) to be set 00:25:32.084 [2024-11-21 03:42:12.511636] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2377cb0 is same with the state(5) to be set 00:25:32.084 [2024-11-21 03:42:12.511648] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2377cb0 is same with the state(5) to be set 00:25:32.084 [2024-11-21 03:42:12.511661] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2377cb0 is same with the state(5) to be set 00:25:32.084 [2024-11-21 03:42:12.511673] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2377cb0 is same with the state(5) to be set 00:25:32.084 [2024-11-21 03:42:12.511685] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2377cb0 is same with the state(5) to be set 00:25:32.084 [2024-11-21 03:42:12.511697] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2377cb0 is same with the state(5) to be set 00:25:32.084 [2024-11-21 03:42:12.511709] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2377cb0 is same with the state(5) to be set 00:25:32.084 [2024-11-21 03:42:12.511736] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2377cb0 is same with the state(5) to be set 00:25:32.084 [2024-11-21 03:42:12.511747] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2377cb0 is same with the state(5) to be set 00:25:32.084 [2024-11-21 03:42:12.511759] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2377cb0 is same with the state(5) to be set 00:25:32.084 [2024-11-21 03:42:12.511770] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2377cb0 is same with the state(5) to be set 00:25:32.084 [2024-11-21 03:42:12.511782] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2377cb0 is same with the state(5) to be set 00:25:32.084 [2024-11-21 03:42:12.511793] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2377cb0 is same with the state(5) to be set 00:25:32.084 [2024-11-21 03:42:12.511814] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2377cb0 is same with the state(5) to be set 00:25:32.084 [2024-11-21 03:42:12.511827] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2377cb0 is same with the state(5) to be set 00:25:32.084 [2024-11-21 03:42:12.511839] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2377cb0 is same with the state(5) to be set 00:25:32.084 [2024-11-21 03:42:12.511850] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2377cb0 is same with the state(5) to be set 00:25:32.084 [2024-11-21 03:42:12.511861] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2377cb0 is same with the state(5) to be set 00:25:32.084 [2024-11-21 03:42:12.511873] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2377cb0 is same with the state(5) to be set 00:25:32.084 [2024-11-21 03:42:12.511884] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2377cb0 is same with the state(5) to be set 00:25:32.084 [2024-11-21 03:42:12.511896] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2377cb0 is same with the state(5) to be set 00:25:32.084 [2024-11-21 03:42:12.511907] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2377cb0 is same with the state(5) to be set 00:25:32.084 [2024-11-21 03:42:12.511918] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2377cb0 is same with the state(5) to be set 00:25:32.084 [2024-11-21 03:42:12.511930] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2377cb0 is same with the state(5) to be set 00:25:32.084 [2024-11-21 03:42:12.511942] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2377cb0 is same with the state(5) to be set 00:25:32.084 [2024-11-21 03:42:12.511953] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2377cb0 is same with the state(5) to be set 00:25:32.084 [2024-11-21 03:42:12.511965] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2377cb0 is same with the state(5) to be set 00:25:32.084 [2024-11-21 03:42:12.511976] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2377cb0 is same with the state(5) to be set 00:25:32.084 [2024-11-21 03:42:12.511987] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2377cb0 is same with the state(5) to be set 00:25:32.084 [2024-11-21 03:42:12.511999] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2377cb0 is same with the state(5) to be set 00:25:32.084 [2024-11-21 03:42:12.512011] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2377cb0 is same with the state(5) to be set 00:25:32.084 [2024-11-21 03:42:12.512024] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2377cb0 is same with the state(5) to be set 00:25:32.084 [2024-11-21 03:42:12.512035] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2377cb0 is same with the state(5) to be set 00:25:32.084 [2024-11-21 03:42:12.512047] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2377cb0 is same with the state(5) to be set 00:25:32.084 [2024-11-21 03:42:12.512083] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2377cb0 is same with the state(5) to be set 00:25:32.084 [2024-11-21 03:42:12.512096] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2377cb0 is same with the state(5) to be set 00:25:32.084 [2024-11-21 03:42:12.512108] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2377cb0 is same with the state(5) to be set 00:25:32.084 [2024-11-21 03:42:12.512120] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2377cb0 is same with the state(5) to be set 00:25:32.084 [2024-11-21 03:42:12.512132] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2377cb0 is same with the state(5) to be set 00:25:32.085 [2024-11-21 03:42:12.512143] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2377cb0 is same with the state(5) to be set 00:25:32.085 [2024-11-21 03:42:12.512159] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2377cb0 is same with the state(5) to be set 00:25:32.085 [2024-11-21 03:42:12.512171] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2377cb0 is same with the state(5) to be set 00:25:32.085 [2024-11-21 03:42:12.512184] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2377cb0 is same with the state(5) to be set 00:25:32.085 [2024-11-21 03:42:12.512196] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2377cb0 is same with the state(5) to be set 00:25:32.085 [2024-11-21 03:42:12.512207] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2377cb0 is same with the state(5) to be set 00:25:32.085 [2024-11-21 03:42:12.512220] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2377cb0 is same with the state(5) to be set 00:25:32.085 [2024-11-21 03:42:12.512233] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2377cb0 is same with the state(5) to be set 00:25:32.085 [2024-11-21 03:42:12.512244] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2377cb0 is same with the state(5) to be set 00:25:32.085 [2024-11-21 03:42:12.512256] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2377cb0 is same with the state(5) to be set 00:25:32.085 [2024-11-21 03:42:12.512267] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2377cb0 is same with the state(5) to be set 00:25:32.085 03:42:12 -- host/failover.sh@45 -- # sleep 3 00:25:35.391 03:42:15 -- host/failover.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:35.391 00:25:35.391 03:42:15 -- host/failover.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:25:35.649 [2024-11-21 03:42:16.118727] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23793a0 is same with the state(5) to be set 00:25:35.649 [2024-11-21 03:42:16.118802] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23793a0 is same with the state(5) to be set 00:25:35.649 [2024-11-21 03:42:16.118833] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23793a0 is same with the state(5) to be set 00:25:35.649 [2024-11-21 03:42:16.118845] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23793a0 is same with the state(5) to be set 00:25:35.649 [2024-11-21 03:42:16.118856] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23793a0 is same with the state(5) to be set 00:25:35.649 [2024-11-21 03:42:16.118868] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23793a0 is same with the state(5) to be set 00:25:35.649 [2024-11-21 03:42:16.118886] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23793a0 is same with the state(5) to be set 00:25:35.649 [2024-11-21 03:42:16.118898] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23793a0 is same with the state(5) to be set 00:25:35.649 [2024-11-21 03:42:16.118909] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23793a0 is same with the state(5) to be set 00:25:35.650 [2024-11-21 03:42:16.118921] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23793a0 is same with the state(5) to be set 00:25:35.650 [2024-11-21 03:42:16.118933] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23793a0 is same with the state(5) to be set 00:25:35.650 [2024-11-21 03:42:16.118951] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23793a0 is same with the state(5) to be set 00:25:35.650 [2024-11-21 03:42:16.118962] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23793a0 is same with the state(5) to be set 00:25:35.650 [2024-11-21 03:42:16.118974] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23793a0 is same with the state(5) to be set 00:25:35.650 [2024-11-21 03:42:16.118998] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23793a0 is same with the state(5) to be set 00:25:35.650 [2024-11-21 03:42:16.119010] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23793a0 is same with the state(5) to be set 00:25:35.650 [2024-11-21 03:42:16.119022] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23793a0 is same with the state(5) to be set 00:25:35.650 [2024-11-21 03:42:16.119034] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23793a0 is same with the state(5) to be set 00:25:35.650 [2024-11-21 03:42:16.119045] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23793a0 is same with the state(5) to be set 00:25:35.650 [2024-11-21 03:42:16.119056] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23793a0 is same with the state(5) to be set 00:25:35.650 [2024-11-21 03:42:16.119092] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23793a0 is same with the state(5) to be set 00:25:35.650 [2024-11-21 03:42:16.119108] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23793a0 is same with the state(5) to be set 00:25:35.650 [2024-11-21 03:42:16.119120] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23793a0 is same with the state(5) to be set 00:25:35.650 [2024-11-21 03:42:16.119132] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23793a0 is same with the state(5) to be set 00:25:35.650 [2024-11-21 03:42:16.119143] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23793a0 is same with the state(5) to be set 00:25:35.650 [2024-11-21 03:42:16.119155] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23793a0 is same with the state(5) to be set 00:25:35.650 [2024-11-21 03:42:16.119167] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23793a0 is same with the state(5) to be set 00:25:35.650 [2024-11-21 03:42:16.119179] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23793a0 is same with the state(5) to be set 00:25:35.650 [2024-11-21 03:42:16.119191] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23793a0 is same with the state(5) to be set 00:25:35.650 [2024-11-21 03:42:16.119203] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23793a0 is same with the state(5) to be set 00:25:35.650 [2024-11-21 03:42:16.119215] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23793a0 is same with the state(5) to be set 00:25:35.650 [2024-11-21 03:42:16.119226] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23793a0 is same with the state(5) to be set 00:25:35.650 [2024-11-21 03:42:16.119238] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23793a0 is same with the state(5) to be set 00:25:35.650 [2024-11-21 03:42:16.119249] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23793a0 is same with the state(5) to be set 00:25:35.650 [2024-11-21 03:42:16.119262] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23793a0 is same with the state(5) to be set 00:25:35.650 [2024-11-21 03:42:16.119274] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23793a0 is same with the state(5) to be set 00:25:35.650 [2024-11-21 03:42:16.119285] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23793a0 is same with the state(5) to be set 00:25:35.650 [2024-11-21 03:42:16.119297] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23793a0 is same with the state(5) to be set 00:25:35.650 [2024-11-21 03:42:16.119309] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23793a0 is same with the state(5) to be set 00:25:35.650 [2024-11-21 03:42:16.119320] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23793a0 is same with the state(5) to be set 00:25:35.650 [2024-11-21 03:42:16.119332] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23793a0 is same with the state(5) to be set 00:25:35.650 [2024-11-21 03:42:16.119347] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23793a0 is same with the state(5) to be set 00:25:35.650 [2024-11-21 03:42:16.119359] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23793a0 is same with the state(5) to be set 00:25:35.650 [2024-11-21 03:42:16.119371] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23793a0 is same with the state(5) to be set 00:25:35.650 [2024-11-21 03:42:16.119397] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23793a0 is same with the state(5) to be set 00:25:35.650 [2024-11-21 03:42:16.119409] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23793a0 is same with the state(5) to be set 00:25:35.650 [2024-11-21 03:42:16.119420] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23793a0 is same with the state(5) to be set 00:25:35.650 [2024-11-21 03:42:16.119431] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23793a0 is same with the state(5) to be set 00:25:35.650 03:42:16 -- host/failover.sh@50 -- # sleep 3 00:25:38.938 03:42:19 -- host/failover.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:38.938 [2024-11-21 03:42:19.423342] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:38.938 03:42:19 -- host/failover.sh@55 -- # sleep 1 00:25:39.874 03:42:20 -- host/failover.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:25:40.134 [2024-11-21 03:42:20.691804] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2379a80 is same with the state(5) to be set 00:25:40.134 [2024-11-21 03:42:20.692090] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2379a80 is same with the state(5) to be set 00:25:40.134 [2024-11-21 03:42:20.692109] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2379a80 is same with the state(5) to be set 00:25:40.134 [2024-11-21 03:42:20.692122] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2379a80 is same with the state(5) to be set 00:25:40.134 [2024-11-21 03:42:20.692135] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2379a80 is same with the state(5) to be set 00:25:40.134 [2024-11-21 03:42:20.692148] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2379a80 is same with the state(5) to be set 00:25:40.134 [2024-11-21 03:42:20.692160] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2379a80 is same with the state(5) to be set 00:25:40.134 [2024-11-21 03:42:20.692172] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2379a80 is same with the state(5) to be set 00:25:40.134 [2024-11-21 03:42:20.692184] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2379a80 is same with the state(5) to be set 00:25:40.134 [2024-11-21 03:42:20.692196] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2379a80 is same with the state(5) to be set 00:25:40.134 [2024-11-21 03:42:20.692208] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2379a80 is same with the state(5) to be set 00:25:40.134 [2024-11-21 03:42:20.692219] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2379a80 is same with the state(5) to be set 00:25:40.135 [2024-11-21 03:42:20.692231] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2379a80 is same with the state(5) to be set 00:25:40.135 [2024-11-21 03:42:20.692243] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2379a80 is same with the state(5) to be set 00:25:40.135 [2024-11-21 03:42:20.692255] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2379a80 is same with the state(5) to be set 00:25:40.135 [2024-11-21 03:42:20.692267] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2379a80 is same with the state(5) to be set 00:25:40.135 [2024-11-21 03:42:20.692280] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2379a80 is same with the state(5) to be set 00:25:40.135 [2024-11-21 03:42:20.692299] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2379a80 is same with the state(5) to be set 00:25:40.135 [2024-11-21 03:42:20.692312] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2379a80 is same with the state(5) to be set 00:25:40.135 [2024-11-21 03:42:20.692324] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2379a80 is same with the state(5) to be set 00:25:40.135 [2024-11-21 03:42:20.692336] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2379a80 is same with the state(5) to be set 00:25:40.135 [2024-11-21 03:42:20.692347] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2379a80 is same with the state(5) to be set 00:25:40.135 [2024-11-21 03:42:20.692359] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2379a80 is same with the state(5) to be set 00:25:40.135 [2024-11-21 03:42:20.692386] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2379a80 is same with the state(5) to be set 00:25:40.135 [2024-11-21 03:42:20.692398] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2379a80 is same with the state(5) to be set 00:25:40.135 [2024-11-21 03:42:20.692410] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2379a80 is same with the state(5) to be set 00:25:40.135 [2024-11-21 03:42:20.692422] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2379a80 is same with the state(5) to be set 00:25:40.135 [2024-11-21 03:42:20.692433] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2379a80 is same with the state(5) to be set 00:25:40.135 [2024-11-21 03:42:20.692444] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2379a80 is same with the state(5) to be set 00:25:40.135 [2024-11-21 03:42:20.692456] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2379a80 is same with the state(5) to be set 00:25:40.135 [2024-11-21 03:42:20.692467] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2379a80 is same with the state(5) to be set 00:25:40.135 [2024-11-21 03:42:20.692478] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2379a80 is same with the state(5) to be set 00:25:40.135 [2024-11-21 03:42:20.692490] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2379a80 is same with the state(5) to be set 00:25:40.135 [2024-11-21 03:42:20.692502] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2379a80 is same with the state(5) to be set 00:25:40.135 [2024-11-21 03:42:20.692513] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2379a80 is same with the state(5) to be set 00:25:40.135 [2024-11-21 03:42:20.692525] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2379a80 is same with the state(5) to be set 00:25:40.135 [2024-11-21 03:42:20.692536] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2379a80 is same with the state(5) to be set 00:25:40.135 [2024-11-21 03:42:20.692548] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2379a80 is same with the state(5) to be set 00:25:40.135 [2024-11-21 03:42:20.692559] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2379a80 is same with the state(5) to be set 00:25:40.135 [2024-11-21 03:42:20.692571] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2379a80 is same with the state(5) to be set 00:25:40.135 [2024-11-21 03:42:20.692582] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2379a80 is same with the state(5) to be set 00:25:40.135 [2024-11-21 03:42:20.692594] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2379a80 is same with the state(5) to be set 00:25:40.135 [2024-11-21 03:42:20.692605] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2379a80 is same with the state(5) to be set 00:25:40.135 [2024-11-21 03:42:20.692617] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2379a80 is same with the state(5) to be set 00:25:40.135 [2024-11-21 03:42:20.692632] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2379a80 is same with the state(5) to be set 00:25:40.135 [2024-11-21 03:42:20.692645] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2379a80 is same with the state(5) to be set 00:25:40.135 03:42:20 -- host/failover.sh@59 -- # wait 3151042 00:25:46.719 0 00:25:46.719 03:42:26 -- host/failover.sh@61 -- # killprocess 3150770 00:25:46.719 03:42:26 -- common/autotest_common.sh@936 -- # '[' -z 3150770 ']' 00:25:46.719 03:42:26 -- common/autotest_common.sh@940 -- # kill -0 3150770 00:25:46.719 03:42:26 -- common/autotest_common.sh@941 -- # uname 00:25:46.719 03:42:26 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:46.719 03:42:26 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3150770 00:25:46.719 03:42:26 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:46.719 03:42:26 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:46.719 03:42:26 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3150770' 00:25:46.719 killing process with pid 3150770 00:25:46.719 03:42:26 -- common/autotest_common.sh@955 -- # kill 3150770 00:25:46.719 03:42:26 -- common/autotest_common.sh@960 -- # wait 3150770 00:25:46.719 03:42:26 -- host/failover.sh@63 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:25:46.719 [2024-11-21 03:42:09.370082] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:46.719 [2024-11-21 03:42:09.370166] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3150770 ] 00:25:46.719 EAL: No free 2048 kB hugepages reported on node 1 00:25:46.719 [2024-11-21 03:42:09.429853] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:46.719 [2024-11-21 03:42:09.536469] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:46.719 Running I/O for 15 seconds... 00:25:46.719 [2024-11-21 03:42:12.512530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:116376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.719 [2024-11-21 03:42:12.512571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.719 [2024-11-21 03:42:12.512601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:116392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.719 [2024-11-21 03:42:12.512617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.719 [2024-11-21 03:42:12.512633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:115744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.719 [2024-11-21 03:42:12.512648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.719 [2024-11-21 03:42:12.512664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:115784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.719 [2024-11-21 03:42:12.512678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.719 [2024-11-21 03:42:12.512693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:115800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.719 [2024-11-21 03:42:12.512707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.719 [2024-11-21 03:42:12.512723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:115808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.719 [2024-11-21 03:42:12.512737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.719 [2024-11-21 03:42:12.512752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:115832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.719 [2024-11-21 03:42:12.512766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.719 [2024-11-21 03:42:12.512781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:115840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.719 [2024-11-21 03:42:12.512795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.719 [2024-11-21 03:42:12.512811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:115848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.719 [2024-11-21 03:42:12.512825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.719 [2024-11-21 03:42:12.512840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:115856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.719 [2024-11-21 03:42:12.512854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.719 [2024-11-21 03:42:12.512869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:116408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.719 [2024-11-21 03:42:12.512898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.719 [2024-11-21 03:42:12.512921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:116416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.719 [2024-11-21 03:42:12.512936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.719 [2024-11-21 03:42:12.512951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:116424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.719 [2024-11-21 03:42:12.512964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.719 [2024-11-21 03:42:12.512979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:115872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.719 [2024-11-21 03:42:12.512992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.719 [2024-11-21 03:42:12.513006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:115880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.719 [2024-11-21 03:42:12.513019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.719 [2024-11-21 03:42:12.513034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:115896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.719 [2024-11-21 03:42:12.513061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.719 [2024-11-21 03:42:12.513087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:115920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.719 [2024-11-21 03:42:12.513102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.719 [2024-11-21 03:42:12.513118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:115928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.719 [2024-11-21 03:42:12.513132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.719 [2024-11-21 03:42:12.513147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:115944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.719 [2024-11-21 03:42:12.513160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.719 [2024-11-21 03:42:12.513175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:115968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.719 [2024-11-21 03:42:12.513189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.719 [2024-11-21 03:42:12.513204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:115976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.719 [2024-11-21 03:42:12.513218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.719 [2024-11-21 03:42:12.513233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:116456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.719 [2024-11-21 03:42:12.513246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.719 [2024-11-21 03:42:12.513261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:116480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.719 [2024-11-21 03:42:12.513275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.719 [2024-11-21 03:42:12.513290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:116488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.719 [2024-11-21 03:42:12.513307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.720 [2024-11-21 03:42:12.513323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:116512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.720 [2024-11-21 03:42:12.513337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.720 [2024-11-21 03:42:12.513352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:116536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.720 [2024-11-21 03:42:12.513375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.720 [2024-11-21 03:42:12.513406] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:116552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.720 [2024-11-21 03:42:12.513419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.720 [2024-11-21 03:42:12.513434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:116560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.720 [2024-11-21 03:42:12.513447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.720 [2024-11-21 03:42:12.513462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:116568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.720 [2024-11-21 03:42:12.513475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.720 [2024-11-21 03:42:12.513490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:115992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.720 [2024-11-21 03:42:12.513503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.720 [2024-11-21 03:42:12.513518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:116008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.720 [2024-11-21 03:42:12.513531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.720 [2024-11-21 03:42:12.513546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:116024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.720 [2024-11-21 03:42:12.513559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.720 [2024-11-21 03:42:12.513573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:116032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.720 [2024-11-21 03:42:12.513587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.720 [2024-11-21 03:42:12.513602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:116040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.720 [2024-11-21 03:42:12.513615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.720 [2024-11-21 03:42:12.513644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:116064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.720 [2024-11-21 03:42:12.513658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.720 [2024-11-21 03:42:12.513674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:116072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.720 [2024-11-21 03:42:12.513687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.720 [2024-11-21 03:42:12.513707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:116088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.720 [2024-11-21 03:42:12.513721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.720 [2024-11-21 03:42:12.513737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:116576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.720 [2024-11-21 03:42:12.513750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.720 [2024-11-21 03:42:12.513767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:116584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.720 [2024-11-21 03:42:12.513781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.720 [2024-11-21 03:42:12.513796] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:116592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.720 [2024-11-21 03:42:12.513810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.720 [2024-11-21 03:42:12.513824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:116600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.720 [2024-11-21 03:42:12.513838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.720 [2024-11-21 03:42:12.513853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:116608 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.720 [2024-11-21 03:42:12.513867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.720 [2024-11-21 03:42:12.513882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:116616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.720 [2024-11-21 03:42:12.513896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.720 [2024-11-21 03:42:12.513911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:116624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.720 [2024-11-21 03:42:12.513925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.720 [2024-11-21 03:42:12.513940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:116632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.720 [2024-11-21 03:42:12.513953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.720 [2024-11-21 03:42:12.513968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:116640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.720 [2024-11-21 03:42:12.513982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.720 [2024-11-21 03:42:12.513998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:116648 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.720 [2024-11-21 03:42:12.514012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.720 [2024-11-21 03:42:12.514027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:116656 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.720 [2024-11-21 03:42:12.514041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.720 [2024-11-21 03:42:12.514056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:116664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.720 [2024-11-21 03:42:12.514082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.720 [2024-11-21 03:42:12.514101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:116672 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.720 [2024-11-21 03:42:12.514115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.720 [2024-11-21 03:42:12.514130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:116680 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.720 [2024-11-21 03:42:12.514144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.720 [2024-11-21 03:42:12.514159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:116688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.720 [2024-11-21 03:42:12.514173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.720 [2024-11-21 03:42:12.514189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:116696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.720 [2024-11-21 03:42:12.514202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.720 [2024-11-21 03:42:12.514217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:116704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.720 [2024-11-21 03:42:12.514231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.720 [2024-11-21 03:42:12.514246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:116712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.720 [2024-11-21 03:42:12.514259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.720 [2024-11-21 03:42:12.514275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:116720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.720 [2024-11-21 03:42:12.514288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.720 [2024-11-21 03:42:12.514303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:116728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.720 [2024-11-21 03:42:12.514317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.720 [2024-11-21 03:42:12.514332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:116736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.720 [2024-11-21 03:42:12.514345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.720 [2024-11-21 03:42:12.514361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:116744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.720 [2024-11-21 03:42:12.514375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.720 [2024-11-21 03:42:12.514390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:116752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.720 [2024-11-21 03:42:12.514403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.720 [2024-11-21 03:42:12.514419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:116112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.720 [2024-11-21 03:42:12.514432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.720 [2024-11-21 03:42:12.514456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:116136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.720 [2024-11-21 03:42:12.514470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.720 [2024-11-21 03:42:12.514486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:116152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.720 [2024-11-21 03:42:12.514500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.720 [2024-11-21 03:42:12.514515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:116176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.720 [2024-11-21 03:42:12.514528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.721 [2024-11-21 03:42:12.514543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:116192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.721 [2024-11-21 03:42:12.514563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.721 [2024-11-21 03:42:12.514579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:116200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.721 [2024-11-21 03:42:12.514592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.721 [2024-11-21 03:42:12.514608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:116216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.721 [2024-11-21 03:42:12.514621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.721 [2024-11-21 03:42:12.514636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:116240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.721 [2024-11-21 03:42:12.514650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.721 [2024-11-21 03:42:12.514665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:116760 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.721 [2024-11-21 03:42:12.514678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.721 [2024-11-21 03:42:12.514693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:116768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.721 [2024-11-21 03:42:12.514707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.721 [2024-11-21 03:42:12.514723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:116776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.721 [2024-11-21 03:42:12.514736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.721 [2024-11-21 03:42:12.514752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:116784 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.721 [2024-11-21 03:42:12.514766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.721 [2024-11-21 03:42:12.514781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:116792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.721 [2024-11-21 03:42:12.514795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.721 [2024-11-21 03:42:12.514810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:116800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.721 [2024-11-21 03:42:12.514827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.721 [2024-11-21 03:42:12.514843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:116808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.721 [2024-11-21 03:42:12.514857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.721 [2024-11-21 03:42:12.514872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:116248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.721 [2024-11-21 03:42:12.514886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.721 [2024-11-21 03:42:12.514901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:116272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.721 [2024-11-21 03:42:12.514914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.721 [2024-11-21 03:42:12.514930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:116280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.721 [2024-11-21 03:42:12.514943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.721 [2024-11-21 03:42:12.514959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:116296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.721 [2024-11-21 03:42:12.514973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.721 [2024-11-21 03:42:12.514988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:116304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.721 [2024-11-21 03:42:12.515001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.721 [2024-11-21 03:42:12.515016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:116312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.721 [2024-11-21 03:42:12.515036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.721 [2024-11-21 03:42:12.515052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:116328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.721 [2024-11-21 03:42:12.515066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.721 [2024-11-21 03:42:12.515091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:116336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.721 [2024-11-21 03:42:12.515106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.721 [2024-11-21 03:42:12.515121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:116816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.721 [2024-11-21 03:42:12.515135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.721 [2024-11-21 03:42:12.515150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:116824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.721 [2024-11-21 03:42:12.515163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.721 [2024-11-21 03:42:12.515178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:116832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.721 [2024-11-21 03:42:12.515192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.721 [2024-11-21 03:42:12.515207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:116840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.721 [2024-11-21 03:42:12.515225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.721 [2024-11-21 03:42:12.515241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:116848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.721 [2024-11-21 03:42:12.515255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.721 [2024-11-21 03:42:12.515270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:116856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.721 [2024-11-21 03:42:12.515284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.721 [2024-11-21 03:42:12.515299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:116864 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.721 [2024-11-21 03:42:12.515313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.721 [2024-11-21 03:42:12.515328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:116872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.721 [2024-11-21 03:42:12.515341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.721 [2024-11-21 03:42:12.515356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:116880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.721 [2024-11-21 03:42:12.515370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.721 [2024-11-21 03:42:12.515385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:116344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.721 [2024-11-21 03:42:12.515399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.721 [2024-11-21 03:42:12.515414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:116352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.721 [2024-11-21 03:42:12.515428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.721 [2024-11-21 03:42:12.515443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:116360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.721 [2024-11-21 03:42:12.515456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.721 [2024-11-21 03:42:12.515471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:116368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.721 [2024-11-21 03:42:12.515485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.721 [2024-11-21 03:42:12.515500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:116384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.721 [2024-11-21 03:42:12.515519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.721 [2024-11-21 03:42:12.515534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:116400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.721 [2024-11-21 03:42:12.515548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.721 [2024-11-21 03:42:12.515563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:116432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.721 [2024-11-21 03:42:12.515577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.721 [2024-11-21 03:42:12.515596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:116440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.721 [2024-11-21 03:42:12.515610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.721 [2024-11-21 03:42:12.515625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:116888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.721 [2024-11-21 03:42:12.515639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.721 [2024-11-21 03:42:12.515654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:116896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.721 [2024-11-21 03:42:12.515668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.721 [2024-11-21 03:42:12.515683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:116904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.721 [2024-11-21 03:42:12.515697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.721 [2024-11-21 03:42:12.515711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:116912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.721 [2024-11-21 03:42:12.515725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.722 [2024-11-21 03:42:12.515740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:116920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.722 [2024-11-21 03:42:12.515753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.722 [2024-11-21 03:42:12.515769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:116928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.722 [2024-11-21 03:42:12.515782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.722 [2024-11-21 03:42:12.515797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:116936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.722 [2024-11-21 03:42:12.515810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.722 [2024-11-21 03:42:12.515825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:116944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.722 [2024-11-21 03:42:12.515839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.722 [2024-11-21 03:42:12.515854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:116952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.722 [2024-11-21 03:42:12.515868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.722 [2024-11-21 03:42:12.515883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:116960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.722 [2024-11-21 03:42:12.515897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.722 [2024-11-21 03:42:12.515912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:116968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.722 [2024-11-21 03:42:12.515925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.722 [2024-11-21 03:42:12.515940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:116976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.722 [2024-11-21 03:42:12.515958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.722 [2024-11-21 03:42:12.515974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:116984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.722 [2024-11-21 03:42:12.515989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.722 [2024-11-21 03:42:12.516004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:116992 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.722 [2024-11-21 03:42:12.516017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.722 [2024-11-21 03:42:12.516032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:117000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.722 [2024-11-21 03:42:12.516045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.722 [2024-11-21 03:42:12.516060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:117008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.722 [2024-11-21 03:42:12.516080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.722 [2024-11-21 03:42:12.516096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:117016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.722 [2024-11-21 03:42:12.516115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.722 [2024-11-21 03:42:12.516131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:117024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.722 [2024-11-21 03:42:12.516145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.722 [2024-11-21 03:42:12.516161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:117032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.722 [2024-11-21 03:42:12.516174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.722 [2024-11-21 03:42:12.516189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:117040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.722 [2024-11-21 03:42:12.516202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.722 [2024-11-21 03:42:12.516217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:116448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.722 [2024-11-21 03:42:12.516231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.722 [2024-11-21 03:42:12.516246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:116464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.722 [2024-11-21 03:42:12.516259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.722 [2024-11-21 03:42:12.516274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:116472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.722 [2024-11-21 03:42:12.516288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.722 [2024-11-21 03:42:12.516303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:116496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.722 [2024-11-21 03:42:12.516316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.722 [2024-11-21 03:42:12.516335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:116504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.722 [2024-11-21 03:42:12.516349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.722 [2024-11-21 03:42:12.516365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:116520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.722 [2024-11-21 03:42:12.516378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.722 [2024-11-21 03:42:12.516393] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:116528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.722 [2024-11-21 03:42:12.516407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.722 [2024-11-21 03:42:12.516421] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f686a0 is same with the state(5) to be set 00:25:46.722 [2024-11-21 03:42:12.516438] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:25:46.722 [2024-11-21 03:42:12.516450] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:25:46.722 [2024-11-21 03:42:12.516461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:116544 len:8 PRP1 0x0 PRP2 0x0 00:25:46.722 [2024-11-21 03:42:12.516475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.722 [2024-11-21 03:42:12.516537] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1f686a0 was disconnected and freed. reset controller. 00:25:46.722 [2024-11-21 03:42:12.516562] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:25:46.722 [2024-11-21 03:42:12.516598] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:46.722 [2024-11-21 03:42:12.516616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.722 [2024-11-21 03:42:12.516631] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:46.722 [2024-11-21 03:42:12.516645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.722 [2024-11-21 03:42:12.516664] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:46.722 [2024-11-21 03:42:12.516678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.722 [2024-11-21 03:42:12.516692] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:46.722 [2024-11-21 03:42:12.516705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.722 [2024-11-21 03:42:12.516718] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:46.722 [2024-11-21 03:42:12.516755] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1f49870 (9): Bad file descriptor 00:25:46.722 [2024-11-21 03:42:12.518949] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:46.722 [2024-11-21 03:42:12.550596] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:25:46.722 [2024-11-21 03:42:16.119578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:78264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.722 [2024-11-21 03:42:16.119621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.722 [2024-11-21 03:42:16.119656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:78272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.722 [2024-11-21 03:42:16.119673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.722 [2024-11-21 03:42:16.119690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:78296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.722 [2024-11-21 03:42:16.119704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.722 [2024-11-21 03:42:16.119720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:78304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.722 [2024-11-21 03:42:16.119734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.722 [2024-11-21 03:42:16.119749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:78320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.722 [2024-11-21 03:42:16.119762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.722 [2024-11-21 03:42:16.119778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:78328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.722 [2024-11-21 03:42:16.119792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.722 [2024-11-21 03:42:16.119807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:77584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.722 [2024-11-21 03:42:16.119835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.723 [2024-11-21 03:42:16.119851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:77592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.723 [2024-11-21 03:42:16.119864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.723 [2024-11-21 03:42:16.119879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:77624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.723 [2024-11-21 03:42:16.119892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.723 [2024-11-21 03:42:16.119907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:77672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.723 [2024-11-21 03:42:16.119921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.723 [2024-11-21 03:42:16.119935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:77704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.723 [2024-11-21 03:42:16.119949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.723 [2024-11-21 03:42:16.119964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:77712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.723 [2024-11-21 03:42:16.119977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.723 [2024-11-21 03:42:16.119991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:77720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.723 [2024-11-21 03:42:16.120005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.723 [2024-11-21 03:42:16.120020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:77728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.723 [2024-11-21 03:42:16.120037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.723 [2024-11-21 03:42:16.120053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:78344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.723 [2024-11-21 03:42:16.120066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.723 [2024-11-21 03:42:16.120110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:78352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.723 [2024-11-21 03:42:16.120124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.723 [2024-11-21 03:42:16.120140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:78360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.723 [2024-11-21 03:42:16.120155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.723 [2024-11-21 03:42:16.120170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:78376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.723 [2024-11-21 03:42:16.120183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.723 [2024-11-21 03:42:16.120199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:78384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.723 [2024-11-21 03:42:16.120212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.723 [2024-11-21 03:42:16.120228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:78408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.723 [2024-11-21 03:42:16.120241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.723 [2024-11-21 03:42:16.120257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:77744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.723 [2024-11-21 03:42:16.120270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.723 [2024-11-21 03:42:16.120285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:77760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.723 [2024-11-21 03:42:16.120299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.723 [2024-11-21 03:42:16.120314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:77768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.723 [2024-11-21 03:42:16.120327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.723 [2024-11-21 03:42:16.120352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:77776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.723 [2024-11-21 03:42:16.120366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.723 [2024-11-21 03:42:16.120395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:77784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.723 [2024-11-21 03:42:16.120410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.723 [2024-11-21 03:42:16.120425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:77792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.723 [2024-11-21 03:42:16.120439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.723 [2024-11-21 03:42:16.120453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:77800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.723 [2024-11-21 03:42:16.120470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.723 [2024-11-21 03:42:16.120486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:77824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.723 [2024-11-21 03:42:16.120499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.723 [2024-11-21 03:42:16.120514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:78424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.723 [2024-11-21 03:42:16.120527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.723 [2024-11-21 03:42:16.120542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:78432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.723 [2024-11-21 03:42:16.120555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.723 [2024-11-21 03:42:16.120569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:78448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.723 [2024-11-21 03:42:16.120583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.723 [2024-11-21 03:42:16.120597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:78456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.723 [2024-11-21 03:42:16.120610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.723 [2024-11-21 03:42:16.120631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:78472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.723 [2024-11-21 03:42:16.120645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.723 [2024-11-21 03:42:16.120660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:78488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.723 [2024-11-21 03:42:16.120673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.723 [2024-11-21 03:42:16.120687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:77840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.723 [2024-11-21 03:42:16.120700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.723 [2024-11-21 03:42:16.120715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:77864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.723 [2024-11-21 03:42:16.120728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.723 [2024-11-21 03:42:16.120742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:77872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.723 [2024-11-21 03:42:16.120756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.723 [2024-11-21 03:42:16.120770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:77896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.723 [2024-11-21 03:42:16.120783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.723 [2024-11-21 03:42:16.120798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:77912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.723 [2024-11-21 03:42:16.120811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.723 [2024-11-21 03:42:16.120837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:77944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.723 [2024-11-21 03:42:16.120851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.723 [2024-11-21 03:42:16.120865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:77952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.724 [2024-11-21 03:42:16.120879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.724 [2024-11-21 03:42:16.120894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:77960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.724 [2024-11-21 03:42:16.120907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.724 [2024-11-21 03:42:16.120922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:78512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.724 [2024-11-21 03:42:16.120935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.724 [2024-11-21 03:42:16.120949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:78520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.724 [2024-11-21 03:42:16.120963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.724 [2024-11-21 03:42:16.120977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:78536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.724 [2024-11-21 03:42:16.120991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.724 [2024-11-21 03:42:16.121005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:78544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.724 [2024-11-21 03:42:16.121018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.724 [2024-11-21 03:42:16.121032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:78552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.724 [2024-11-21 03:42:16.121046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.724 [2024-11-21 03:42:16.121065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:78560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.724 [2024-11-21 03:42:16.121101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.724 [2024-11-21 03:42:16.121118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:78568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.724 [2024-11-21 03:42:16.121132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.724 [2024-11-21 03:42:16.121147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:78576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.724 [2024-11-21 03:42:16.121161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.724 [2024-11-21 03:42:16.121176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:78584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.724 [2024-11-21 03:42:16.121189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.724 [2024-11-21 03:42:16.121204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:78592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.724 [2024-11-21 03:42:16.121221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.724 [2024-11-21 03:42:16.121237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:78600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.724 [2024-11-21 03:42:16.121250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.724 [2024-11-21 03:42:16.121265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:77968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.724 [2024-11-21 03:42:16.121279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.724 [2024-11-21 03:42:16.121294] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:77976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.724 [2024-11-21 03:42:16.121308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.724 [2024-11-21 03:42:16.121322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:77984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.724 [2024-11-21 03:42:16.121336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.724 [2024-11-21 03:42:16.121351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:78008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.724 [2024-11-21 03:42:16.121364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.724 [2024-11-21 03:42:16.121379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:78032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.724 [2024-11-21 03:42:16.121407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.724 [2024-11-21 03:42:16.121422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:78040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.724 [2024-11-21 03:42:16.121434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.724 [2024-11-21 03:42:16.121449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:78048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.724 [2024-11-21 03:42:16.121462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.724 [2024-11-21 03:42:16.121477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:78088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.724 [2024-11-21 03:42:16.121490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.724 [2024-11-21 03:42:16.121504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:78608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.724 [2024-11-21 03:42:16.121517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.724 [2024-11-21 03:42:16.121531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:78616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.724 [2024-11-21 03:42:16.121544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.724 [2024-11-21 03:42:16.121559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:78624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.724 [2024-11-21 03:42:16.121571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.724 [2024-11-21 03:42:16.121590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:78632 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.724 [2024-11-21 03:42:16.121604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.724 [2024-11-21 03:42:16.121619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:78640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.724 [2024-11-21 03:42:16.121633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.724 [2024-11-21 03:42:16.121647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:78648 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.724 [2024-11-21 03:42:16.121661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.724 [2024-11-21 03:42:16.121676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:78656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.724 [2024-11-21 03:42:16.121689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.724 [2024-11-21 03:42:16.121704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:78664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.724 [2024-11-21 03:42:16.121717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.724 [2024-11-21 03:42:16.121731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:78104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.724 [2024-11-21 03:42:16.121744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.724 [2024-11-21 03:42:16.121759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:78136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.724 [2024-11-21 03:42:16.121772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.724 [2024-11-21 03:42:16.121787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:78144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.724 [2024-11-21 03:42:16.121800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.724 [2024-11-21 03:42:16.121814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:78152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.724 [2024-11-21 03:42:16.121827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.724 [2024-11-21 03:42:16.121842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:78176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.724 [2024-11-21 03:42:16.121856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.724 [2024-11-21 03:42:16.121870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:78192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.724 [2024-11-21 03:42:16.121883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.724 [2024-11-21 03:42:16.121898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:78208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.724 [2024-11-21 03:42:16.121912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.724 [2024-11-21 03:42:16.121926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:78240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.724 [2024-11-21 03:42:16.121954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.724 [2024-11-21 03:42:16.121969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:78672 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.724 [2024-11-21 03:42:16.121983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.724 [2024-11-21 03:42:16.121997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:78680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.724 [2024-11-21 03:42:16.122010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.724 [2024-11-21 03:42:16.122025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:78688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.724 [2024-11-21 03:42:16.122038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.724 [2024-11-21 03:42:16.122053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:78696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.725 [2024-11-21 03:42:16.122066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.725 [2024-11-21 03:42:16.122104] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:78704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.725 [2024-11-21 03:42:16.122128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.725 [2024-11-21 03:42:16.122143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:78712 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.725 [2024-11-21 03:42:16.122157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.725 [2024-11-21 03:42:16.122173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:78720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.725 [2024-11-21 03:42:16.122187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.725 [2024-11-21 03:42:16.122202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:78728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.725 [2024-11-21 03:42:16.122216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.725 [2024-11-21 03:42:16.122231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:78736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.725 [2024-11-21 03:42:16.122245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.725 [2024-11-21 03:42:16.122260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:78744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.725 [2024-11-21 03:42:16.122274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.725 [2024-11-21 03:42:16.122289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:78752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.725 [2024-11-21 03:42:16.122302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.725 [2024-11-21 03:42:16.122318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:78760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.725 [2024-11-21 03:42:16.122331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.725 [2024-11-21 03:42:16.122346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:78768 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.725 [2024-11-21 03:42:16.122366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.725 [2024-11-21 03:42:16.122396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:78776 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.725 [2024-11-21 03:42:16.122410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.725 [2024-11-21 03:42:16.122425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:78784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.725 [2024-11-21 03:42:16.122438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.725 [2024-11-21 03:42:16.122453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:78792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.725 [2024-11-21 03:42:16.122466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.725 [2024-11-21 03:42:16.122498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:78800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.725 [2024-11-21 03:42:16.122513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.725 [2024-11-21 03:42:16.122528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:78808 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.725 [2024-11-21 03:42:16.122542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.725 [2024-11-21 03:42:16.122558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:78816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.725 [2024-11-21 03:42:16.122571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.725 [2024-11-21 03:42:16.122587] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:78824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.725 [2024-11-21 03:42:16.122601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.725 [2024-11-21 03:42:16.122616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:78832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.725 [2024-11-21 03:42:16.122629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.725 [2024-11-21 03:42:16.122644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:78840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.725 [2024-11-21 03:42:16.122658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.725 [2024-11-21 03:42:16.122674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:78848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.725 [2024-11-21 03:42:16.122687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.725 [2024-11-21 03:42:16.122703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:78856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.725 [2024-11-21 03:42:16.122721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.725 [2024-11-21 03:42:16.122737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:78864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.725 [2024-11-21 03:42:16.122751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.725 [2024-11-21 03:42:16.122770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:78248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.725 [2024-11-21 03:42:16.122784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.725 [2024-11-21 03:42:16.122799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:78256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.725 [2024-11-21 03:42:16.122813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.725 [2024-11-21 03:42:16.122828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:78280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.725 [2024-11-21 03:42:16.122842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.725 [2024-11-21 03:42:16.122856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:78288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.725 [2024-11-21 03:42:16.122870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.725 [2024-11-21 03:42:16.122885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:78312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.725 [2024-11-21 03:42:16.122899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.725 [2024-11-21 03:42:16.122914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:78336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.725 [2024-11-21 03:42:16.122928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.725 [2024-11-21 03:42:16.122943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:78368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.725 [2024-11-21 03:42:16.122956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.725 [2024-11-21 03:42:16.122971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:78392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.725 [2024-11-21 03:42:16.122985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.725 [2024-11-21 03:42:16.123000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:78872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.725 [2024-11-21 03:42:16.123021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.725 [2024-11-21 03:42:16.123037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:78880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.725 [2024-11-21 03:42:16.123051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.725 [2024-11-21 03:42:16.123067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:78888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.725 [2024-11-21 03:42:16.123089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.725 [2024-11-21 03:42:16.123105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:78896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.725 [2024-11-21 03:42:16.123119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.725 [2024-11-21 03:42:16.123137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:78904 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.725 [2024-11-21 03:42:16.123155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.725 [2024-11-21 03:42:16.123171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:78912 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.725 [2024-11-21 03:42:16.123184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.725 [2024-11-21 03:42:16.123199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:78920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.725 [2024-11-21 03:42:16.123218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.725 [2024-11-21 03:42:16.123234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:78928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.725 [2024-11-21 03:42:16.123248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.725 [2024-11-21 03:42:16.123263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:78936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.725 [2024-11-21 03:42:16.123276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.725 [2024-11-21 03:42:16.123291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:78944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.725 [2024-11-21 03:42:16.123305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.726 [2024-11-21 03:42:16.123321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:78400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.726 [2024-11-21 03:42:16.123334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.726 [2024-11-21 03:42:16.123349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:78416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.726 [2024-11-21 03:42:16.123363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.726 [2024-11-21 03:42:16.123378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:78440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.726 [2024-11-21 03:42:16.123391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.726 [2024-11-21 03:42:16.123406] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:78464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.726 [2024-11-21 03:42:16.123420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.726 [2024-11-21 03:42:16.123435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:78480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.726 [2024-11-21 03:42:16.123449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.726 [2024-11-21 03:42:16.123464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:78496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.726 [2024-11-21 03:42:16.123478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.726 [2024-11-21 03:42:16.123493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:78504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.726 [2024-11-21 03:42:16.123511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.726 [2024-11-21 03:42:16.123530] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f55d10 is same with the state(5) to be set 00:25:46.726 [2024-11-21 03:42:16.123548] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:25:46.726 [2024-11-21 03:42:16.123559] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:25:46.726 [2024-11-21 03:42:16.123571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:78528 len:8 PRP1 0x0 PRP2 0x0 00:25:46.726 [2024-11-21 03:42:16.123583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.726 [2024-11-21 03:42:16.123644] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1f55d10 was disconnected and freed. reset controller. 00:25:46.726 [2024-11-21 03:42:16.123661] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4421 to 10.0.0.2:4422 00:25:46.726 [2024-11-21 03:42:16.123695] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:46.726 [2024-11-21 03:42:16.123713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.726 [2024-11-21 03:42:16.123728] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:46.726 [2024-11-21 03:42:16.123741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.726 [2024-11-21 03:42:16.123766] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:46.726 [2024-11-21 03:42:16.123792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.726 [2024-11-21 03:42:16.123813] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:46.726 [2024-11-21 03:42:16.123827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.726 [2024-11-21 03:42:16.123840] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:46.726 [2024-11-21 03:42:16.126041] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:46.726 [2024-11-21 03:42:16.126098] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1f49870 (9): Bad file descriptor 00:25:46.726 [2024-11-21 03:42:16.235952] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:25:46.726 [2024-11-21 03:42:20.691858] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:46.726 [2024-11-21 03:42:20.691938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.726 [2024-11-21 03:42:20.691957] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:46.726 [2024-11-21 03:42:20.691971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.726 [2024-11-21 03:42:20.691985] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:46.726 [2024-11-21 03:42:20.691999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.726 [2024-11-21 03:42:20.692014] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:46.726 [2024-11-21 03:42:20.692027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.726 [2024-11-21 03:42:20.692055] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f49870 is same with the state(5) to be set 00:25:46.726 [2024-11-21 03:42:20.692775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:64720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.726 [2024-11-21 03:42:20.692799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.726 [2024-11-21 03:42:20.692824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:63896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.726 [2024-11-21 03:42:20.692840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.726 [2024-11-21 03:42:20.692856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:63904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.726 [2024-11-21 03:42:20.692870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.726 [2024-11-21 03:42:20.692885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:63920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.726 [2024-11-21 03:42:20.692898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.726 [2024-11-21 03:42:20.692913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:63928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.726 [2024-11-21 03:42:20.692926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.726 [2024-11-21 03:42:20.692941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:63944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.726 [2024-11-21 03:42:20.692954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.726 [2024-11-21 03:42:20.692969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:63952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.726 [2024-11-21 03:42:20.692982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.726 [2024-11-21 03:42:20.692997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:63968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.726 [2024-11-21 03:42:20.693010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.726 [2024-11-21 03:42:20.693024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:63976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.726 [2024-11-21 03:42:20.693037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.726 [2024-11-21 03:42:20.693052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:64728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.726 [2024-11-21 03:42:20.693064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.726 [2024-11-21 03:42:20.693106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:63984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.726 [2024-11-21 03:42:20.693120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.726 [2024-11-21 03:42:20.693135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:64008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.726 [2024-11-21 03:42:20.693149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.726 [2024-11-21 03:42:20.693164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:64016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.726 [2024-11-21 03:42:20.693183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.726 [2024-11-21 03:42:20.693199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:64032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.726 [2024-11-21 03:42:20.693213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.726 [2024-11-21 03:42:20.693229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:64048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.726 [2024-11-21 03:42:20.693242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.726 [2024-11-21 03:42:20.693258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:64072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.726 [2024-11-21 03:42:20.693271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.726 [2024-11-21 03:42:20.693286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:64080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.726 [2024-11-21 03:42:20.693302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.726 [2024-11-21 03:42:20.693317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:64096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.726 [2024-11-21 03:42:20.693330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.726 [2024-11-21 03:42:20.693345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:64744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.726 [2024-11-21 03:42:20.693359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.726 [2024-11-21 03:42:20.693374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:64768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.726 [2024-11-21 03:42:20.693403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.727 [2024-11-21 03:42:20.693418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:64776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.727 [2024-11-21 03:42:20.693431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.727 [2024-11-21 03:42:20.693445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:64784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.727 [2024-11-21 03:42:20.693458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.727 [2024-11-21 03:42:20.693472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:64120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.727 [2024-11-21 03:42:20.693485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.727 [2024-11-21 03:42:20.693500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:64128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.727 [2024-11-21 03:42:20.693513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.727 [2024-11-21 03:42:20.693528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:64144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.727 [2024-11-21 03:42:20.693540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.727 [2024-11-21 03:42:20.693564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:64160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.727 [2024-11-21 03:42:20.693578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.727 [2024-11-21 03:42:20.693593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:64200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.727 [2024-11-21 03:42:20.693607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.727 [2024-11-21 03:42:20.693622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:64232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.727 [2024-11-21 03:42:20.693635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.727 [2024-11-21 03:42:20.693650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:64256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.727 [2024-11-21 03:42:20.693663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.727 [2024-11-21 03:42:20.693678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:64264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.727 [2024-11-21 03:42:20.693691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.727 [2024-11-21 03:42:20.693705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:64832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.727 [2024-11-21 03:42:20.693719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.727 [2024-11-21 03:42:20.693733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:64848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.727 [2024-11-21 03:42:20.693746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.727 [2024-11-21 03:42:20.693761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:64872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.727 [2024-11-21 03:42:20.693775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.727 [2024-11-21 03:42:20.693790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:64904 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.727 [2024-11-21 03:42:20.693803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.727 [2024-11-21 03:42:20.693817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:64912 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.727 [2024-11-21 03:42:20.693831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.727 [2024-11-21 03:42:20.693845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:64920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.727 [2024-11-21 03:42:20.693858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.727 [2024-11-21 03:42:20.693873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:64928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.727 [2024-11-21 03:42:20.693886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.727 [2024-11-21 03:42:20.693901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:64936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.727 [2024-11-21 03:42:20.693918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.727 [2024-11-21 03:42:20.693933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:64944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.727 [2024-11-21 03:42:20.693947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.727 [2024-11-21 03:42:20.693961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:64288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.727 [2024-11-21 03:42:20.693975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.727 [2024-11-21 03:42:20.693989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:64304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.727 [2024-11-21 03:42:20.694002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.727 [2024-11-21 03:42:20.694017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:64320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.727 [2024-11-21 03:42:20.694030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.727 [2024-11-21 03:42:20.694045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:64328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.727 [2024-11-21 03:42:20.694058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.727 [2024-11-21 03:42:20.694093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:64344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.727 [2024-11-21 03:42:20.694109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.727 [2024-11-21 03:42:20.694125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:64376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.727 [2024-11-21 03:42:20.694138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.727 [2024-11-21 03:42:20.694154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:64384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.727 [2024-11-21 03:42:20.694167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.727 [2024-11-21 03:42:20.694182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:64392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.727 [2024-11-21 03:42:20.694195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.727 [2024-11-21 03:42:20.694210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:64952 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.727 [2024-11-21 03:42:20.694224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.727 [2024-11-21 03:42:20.694240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:64960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.727 [2024-11-21 03:42:20.694254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.727 [2024-11-21 03:42:20.694269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:64968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.727 [2024-11-21 03:42:20.694282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.727 [2024-11-21 03:42:20.694302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:64976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.727 [2024-11-21 03:42:20.694316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.727 [2024-11-21 03:42:20.694331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:64984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.727 [2024-11-21 03:42:20.694352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.727 [2024-11-21 03:42:20.694368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:64992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.727 [2024-11-21 03:42:20.694397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.727 [2024-11-21 03:42:20.694413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:65000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.727 [2024-11-21 03:42:20.694426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.727 [2024-11-21 03:42:20.694441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:65008 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.727 [2024-11-21 03:42:20.694454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.727 [2024-11-21 03:42:20.694468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:65016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.727 [2024-11-21 03:42:20.694482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.727 [2024-11-21 03:42:20.694497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:65024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.727 [2024-11-21 03:42:20.694510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.727 [2024-11-21 03:42:20.694524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:65032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.727 [2024-11-21 03:42:20.694537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.727 [2024-11-21 03:42:20.694552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:65040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.727 [2024-11-21 03:42:20.694565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.727 [2024-11-21 03:42:20.694580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:65048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.728 [2024-11-21 03:42:20.694593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.728 [2024-11-21 03:42:20.694607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:65056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.728 [2024-11-21 03:42:20.694621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.728 [2024-11-21 03:42:20.694635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:65064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.728 [2024-11-21 03:42:20.694648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.728 [2024-11-21 03:42:20.694663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:65072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.728 [2024-11-21 03:42:20.694679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.728 [2024-11-21 03:42:20.694695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:65080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.728 [2024-11-21 03:42:20.694708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.728 [2024-11-21 03:42:20.694723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:65088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.728 [2024-11-21 03:42:20.694737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.728 [2024-11-21 03:42:20.694752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:65096 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.728 [2024-11-21 03:42:20.694765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.728 [2024-11-21 03:42:20.694780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:65104 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.728 [2024-11-21 03:42:20.694793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.728 [2024-11-21 03:42:20.694807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:65112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.728 [2024-11-21 03:42:20.694826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.728 [2024-11-21 03:42:20.694842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:64408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.728 [2024-11-21 03:42:20.694856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.728 [2024-11-21 03:42:20.694870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:64416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.728 [2024-11-21 03:42:20.694884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.728 [2024-11-21 03:42:20.694898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:64432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.728 [2024-11-21 03:42:20.694912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.728 [2024-11-21 03:42:20.694926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:64440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.728 [2024-11-21 03:42:20.694940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.728 [2024-11-21 03:42:20.694954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:64456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.728 [2024-11-21 03:42:20.694968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.728 [2024-11-21 03:42:20.694982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:64464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.728 [2024-11-21 03:42:20.694996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.728 [2024-11-21 03:42:20.695010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:64472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.728 [2024-11-21 03:42:20.695023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.728 [2024-11-21 03:42:20.695038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:64480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.728 [2024-11-21 03:42:20.695076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.728 [2024-11-21 03:42:20.695095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:65120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.728 [2024-11-21 03:42:20.695109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.728 [2024-11-21 03:42:20.695124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:65128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.728 [2024-11-21 03:42:20.695138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.728 [2024-11-21 03:42:20.695153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:65136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.728 [2024-11-21 03:42:20.695167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.728 [2024-11-21 03:42:20.695182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:65144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.728 [2024-11-21 03:42:20.695196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.728 [2024-11-21 03:42:20.695212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:65152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.728 [2024-11-21 03:42:20.695226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.728 [2024-11-21 03:42:20.695241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:65160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.728 [2024-11-21 03:42:20.695255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.728 [2024-11-21 03:42:20.695270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:65168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.728 [2024-11-21 03:42:20.695284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.728 [2024-11-21 03:42:20.695299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:64488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.728 [2024-11-21 03:42:20.695313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.728 [2024-11-21 03:42:20.695328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:64496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.728 [2024-11-21 03:42:20.695342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.728 [2024-11-21 03:42:20.695357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:64512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.728 [2024-11-21 03:42:20.695370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.728 [2024-11-21 03:42:20.695400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:64520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.728 [2024-11-21 03:42:20.695413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.728 [2024-11-21 03:42:20.695428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:64528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.728 [2024-11-21 03:42:20.695441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.728 [2024-11-21 03:42:20.695459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:64552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.728 [2024-11-21 03:42:20.695473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.728 [2024-11-21 03:42:20.695488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:64576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.728 [2024-11-21 03:42:20.695501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.728 [2024-11-21 03:42:20.695515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:64584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.728 [2024-11-21 03:42:20.695528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.728 [2024-11-21 03:42:20.695543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:65176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.728 [2024-11-21 03:42:20.695556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.728 [2024-11-21 03:42:20.695571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:65184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.728 [2024-11-21 03:42:20.695584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.728 [2024-11-21 03:42:20.695598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:64592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.728 [2024-11-21 03:42:20.695611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.728 [2024-11-21 03:42:20.695625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:64608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.728 [2024-11-21 03:42:20.695639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.729 [2024-11-21 03:42:20.695653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:64616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.729 [2024-11-21 03:42:20.695666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.729 [2024-11-21 03:42:20.695681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:64624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.729 [2024-11-21 03:42:20.695695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.729 [2024-11-21 03:42:20.695710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:64656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.729 [2024-11-21 03:42:20.695724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.729 [2024-11-21 03:42:20.695738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:64672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.729 [2024-11-21 03:42:20.695751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.729 [2024-11-21 03:42:20.695766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:64680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.729 [2024-11-21 03:42:20.695780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.729 [2024-11-21 03:42:20.695795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:64688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.729 [2024-11-21 03:42:20.695817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.729 [2024-11-21 03:42:20.695833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:65192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.729 [2024-11-21 03:42:20.695846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.729 [2024-11-21 03:42:20.695861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:65200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.729 [2024-11-21 03:42:20.695875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.729 [2024-11-21 03:42:20.695890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:65208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.729 [2024-11-21 03:42:20.695903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.729 [2024-11-21 03:42:20.695917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:65216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.729 [2024-11-21 03:42:20.695930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.729 [2024-11-21 03:42:20.695945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:65224 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.729 [2024-11-21 03:42:20.695959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.729 [2024-11-21 03:42:20.695973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:64704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.729 [2024-11-21 03:42:20.695986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.729 [2024-11-21 03:42:20.696001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:64712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.729 [2024-11-21 03:42:20.696015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.729 [2024-11-21 03:42:20.696030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:64736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.729 [2024-11-21 03:42:20.696043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.729 [2024-11-21 03:42:20.696057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:64752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.729 [2024-11-21 03:42:20.696093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.729 [2024-11-21 03:42:20.696112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:64760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.729 [2024-11-21 03:42:20.696126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.729 [2024-11-21 03:42:20.696141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:64792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.729 [2024-11-21 03:42:20.696155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.729 [2024-11-21 03:42:20.696170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:64800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.729 [2024-11-21 03:42:20.696184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.729 [2024-11-21 03:42:20.696203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:64808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.729 [2024-11-21 03:42:20.696217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.729 [2024-11-21 03:42:20.696233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:65232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.729 [2024-11-21 03:42:20.696247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.729 [2024-11-21 03:42:20.696262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:65240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.729 [2024-11-21 03:42:20.696276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.729 [2024-11-21 03:42:20.696291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:65248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.729 [2024-11-21 03:42:20.696305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.729 [2024-11-21 03:42:20.696320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:65256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.729 [2024-11-21 03:42:20.696333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.729 [2024-11-21 03:42:20.696348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:65264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.729 [2024-11-21 03:42:20.696361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.729 [2024-11-21 03:42:20.696391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:65272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:46.729 [2024-11-21 03:42:20.696404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.729 [2024-11-21 03:42:20.696418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:64816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.729 [2024-11-21 03:42:20.696431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.729 [2024-11-21 03:42:20.696445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:64824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.729 [2024-11-21 03:42:20.696458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.729 [2024-11-21 03:42:20.696473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:64840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.729 [2024-11-21 03:42:20.696485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.729 [2024-11-21 03:42:20.696499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:64856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.729 [2024-11-21 03:42:20.696512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.729 [2024-11-21 03:42:20.696527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:64864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.729 [2024-11-21 03:42:20.696540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.729 [2024-11-21 03:42:20.696554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:64880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.729 [2024-11-21 03:42:20.696567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.729 [2024-11-21 03:42:20.696585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:64888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:46.729 [2024-11-21 03:42:20.696598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.729 [2024-11-21 03:42:20.696612] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f6c630 is same with the state(5) to be set 00:25:46.729 [2024-11-21 03:42:20.696627] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:25:46.729 [2024-11-21 03:42:20.696643] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:25:46.729 [2024-11-21 03:42:20.696655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:64896 len:8 PRP1 0x0 PRP2 0x0 00:25:46.729 [2024-11-21 03:42:20.696668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:46.729 [2024-11-21 03:42:20.696744] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1f6c630 was disconnected and freed. reset controller. 00:25:46.729 [2024-11-21 03:42:20.696762] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4422 to 10.0.0.2:4420 00:25:46.729 [2024-11-21 03:42:20.696777] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:46.729 [2024-11-21 03:42:20.698932] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:46.729 [2024-11-21 03:42:20.698973] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1f49870 (9): Bad file descriptor 00:25:46.729 [2024-11-21 03:42:20.732508] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:25:46.729 00:25:46.729 Latency(us) 00:25:46.729 [2024-11-21T02:42:27.377Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:46.729 [2024-11-21T02:42:27.377Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:25:46.729 Verification LBA range: start 0x0 length 0x4000 00:25:46.729 NVMe0n1 : 15.01 12505.97 48.85 673.05 0.00 9695.19 628.05 16311.18 00:25:46.729 [2024-11-21T02:42:27.377Z] =================================================================================================================== 00:25:46.729 [2024-11-21T02:42:27.377Z] Total : 12505.97 48.85 673.05 0.00 9695.19 628.05 16311.18 00:25:46.729 Received shutdown signal, test time was about 15.000000 seconds 00:25:46.729 00:25:46.730 Latency(us) 00:25:46.730 [2024-11-21T02:42:27.378Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:46.730 [2024-11-21T02:42:27.378Z] =================================================================================================================== 00:25:46.730 [2024-11-21T02:42:27.378Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:25:46.730 03:42:26 -- host/failover.sh@65 -- # grep -c 'Resetting controller successful' 00:25:46.730 03:42:26 -- host/failover.sh@65 -- # count=3 00:25:46.730 03:42:26 -- host/failover.sh@67 -- # (( count != 3 )) 00:25:46.730 03:42:26 -- host/failover.sh@73 -- # bdevperf_pid=3152876 00:25:46.730 03:42:26 -- host/failover.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 1 -f 00:25:46.730 03:42:26 -- host/failover.sh@75 -- # waitforlisten 3152876 /var/tmp/bdevperf.sock 00:25:46.730 03:42:26 -- common/autotest_common.sh@829 -- # '[' -z 3152876 ']' 00:25:46.730 03:42:26 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:46.730 03:42:26 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:46.730 03:42:26 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:46.730 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:46.730 03:42:26 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:46.730 03:42:26 -- common/autotest_common.sh@10 -- # set +x 00:25:47.295 03:42:27 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:47.295 03:42:27 -- common/autotest_common.sh@862 -- # return 0 00:25:47.295 03:42:27 -- host/failover.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:25:47.553 [2024-11-21 03:42:28.008704] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:25:47.553 03:42:28 -- host/failover.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:25:47.811 [2024-11-21 03:42:28.253460] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:25:47.811 03:42:28 -- host/failover.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:48.069 NVMe0n1 00:25:48.069 03:42:28 -- host/failover.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:48.637 00:25:48.637 03:42:29 -- host/failover.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:48.894 00:25:48.894 03:42:29 -- host/failover.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:48.894 03:42:29 -- host/failover.sh@82 -- # grep -q NVMe0 00:25:49.152 03:42:29 -- host/failover.sh@84 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:49.410 03:42:29 -- host/failover.sh@87 -- # sleep 3 00:25:52.695 03:42:32 -- host/failover.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:52.695 03:42:32 -- host/failover.sh@88 -- # grep -q NVMe0 00:25:52.695 03:42:33 -- host/failover.sh@90 -- # run_test_pid=3153636 00:25:52.695 03:42:33 -- host/failover.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:25:52.695 03:42:33 -- host/failover.sh@92 -- # wait 3153636 00:25:54.066 0 00:25:54.066 03:42:34 -- host/failover.sh@94 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:25:54.066 [2024-11-21 03:42:26.796990] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:54.066 [2024-11-21 03:42:26.797110] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3152876 ] 00:25:54.066 EAL: No free 2048 kB hugepages reported on node 1 00:25:54.066 [2024-11-21 03:42:26.859006] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:54.066 [2024-11-21 03:42:26.963608] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:54.066 [2024-11-21 03:42:29.971438] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:25:54.066 [2024-11-21 03:42:29.971531] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:54.066 [2024-11-21 03:42:29.971554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.066 [2024-11-21 03:42:29.971571] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:54.066 [2024-11-21 03:42:29.971585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.066 [2024-11-21 03:42:29.971599] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:54.067 [2024-11-21 03:42:29.971613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.067 [2024-11-21 03:42:29.971627] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:54.067 [2024-11-21 03:42:29.971642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:54.067 [2024-11-21 03:42:29.971656] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:54.067 [2024-11-21 03:42:29.971691] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:54.067 [2024-11-21 03:42:29.971721] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bf2870 (9): Bad file descriptor 00:25:54.067 [2024-11-21 03:42:30.015708] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:25:54.067 Running I/O for 1 seconds... 00:25:54.067 00:25:54.067 Latency(us) 00:25:54.067 [2024-11-21T02:42:34.715Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:54.067 [2024-11-21T02:42:34.715Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:25:54.067 Verification LBA range: start 0x0 length 0x4000 00:25:54.067 NVMe0n1 : 1.01 12928.87 50.50 0.00 0.00 9857.91 788.86 12524.66 00:25:54.067 [2024-11-21T02:42:34.715Z] =================================================================================================================== 00:25:54.067 [2024-11-21T02:42:34.715Z] Total : 12928.87 50.50 0.00 0.00 9857.91 788.86 12524.66 00:25:54.067 03:42:34 -- host/failover.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:54.067 03:42:34 -- host/failover.sh@95 -- # grep -q NVMe0 00:25:54.324 03:42:34 -- host/failover.sh@98 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:54.324 03:42:34 -- host/failover.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:54.324 03:42:34 -- host/failover.sh@99 -- # grep -q NVMe0 00:25:54.581 03:42:35 -- host/failover.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:54.839 03:42:35 -- host/failover.sh@101 -- # sleep 3 00:25:58.127 03:42:38 -- host/failover.sh@103 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:58.127 03:42:38 -- host/failover.sh@103 -- # grep -q NVMe0 00:25:58.127 03:42:38 -- host/failover.sh@108 -- # killprocess 3152876 00:25:58.127 03:42:38 -- common/autotest_common.sh@936 -- # '[' -z 3152876 ']' 00:25:58.127 03:42:38 -- common/autotest_common.sh@940 -- # kill -0 3152876 00:25:58.127 03:42:38 -- common/autotest_common.sh@941 -- # uname 00:25:58.127 03:42:38 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:58.127 03:42:38 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3152876 00:25:58.387 03:42:38 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:58.387 03:42:38 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:58.387 03:42:38 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3152876' 00:25:58.387 killing process with pid 3152876 00:25:58.387 03:42:38 -- common/autotest_common.sh@955 -- # kill 3152876 00:25:58.387 03:42:38 -- common/autotest_common.sh@960 -- # wait 3152876 00:25:58.656 03:42:39 -- host/failover.sh@110 -- # sync 00:25:58.656 03:42:39 -- host/failover.sh@111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:25:58.921 03:42:39 -- host/failover.sh@113 -- # trap - SIGINT SIGTERM EXIT 00:25:58.921 03:42:39 -- host/failover.sh@115 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:25:58.921 03:42:39 -- host/failover.sh@116 -- # nvmftestfini 00:25:58.921 03:42:39 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:58.921 03:42:39 -- nvmf/common.sh@116 -- # sync 00:25:58.921 03:42:39 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:58.921 03:42:39 -- nvmf/common.sh@119 -- # set +e 00:25:58.921 03:42:39 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:58.921 03:42:39 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:58.921 rmmod nvme_tcp 00:25:58.921 rmmod nvme_fabrics 00:25:58.921 rmmod nvme_keyring 00:25:58.921 03:42:39 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:58.921 03:42:39 -- nvmf/common.sh@123 -- # set -e 00:25:58.921 03:42:39 -- nvmf/common.sh@124 -- # return 0 00:25:58.921 03:42:39 -- nvmf/common.sh@477 -- # '[' -n 3149862 ']' 00:25:58.921 03:42:39 -- nvmf/common.sh@478 -- # killprocess 3149862 00:25:58.921 03:42:39 -- common/autotest_common.sh@936 -- # '[' -z 3149862 ']' 00:25:58.921 03:42:39 -- common/autotest_common.sh@940 -- # kill -0 3149862 00:25:58.921 03:42:39 -- common/autotest_common.sh@941 -- # uname 00:25:58.921 03:42:39 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:58.921 03:42:39 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3149862 00:25:58.921 03:42:39 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:25:58.921 03:42:39 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:25:58.921 03:42:39 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3149862' 00:25:58.921 killing process with pid 3149862 00:25:58.921 03:42:39 -- common/autotest_common.sh@955 -- # kill 3149862 00:25:58.921 03:42:39 -- common/autotest_common.sh@960 -- # wait 3149862 00:25:59.180 03:42:39 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:59.180 03:42:39 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:59.180 03:42:39 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:59.180 03:42:39 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:59.180 03:42:39 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:59.180 03:42:39 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:59.180 03:42:39 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:59.180 03:42:39 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:01.718 03:42:41 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:01.718 00:26:01.718 real 0m37.652s 00:26:01.718 user 2m11.753s 00:26:01.718 sys 0m6.815s 00:26:01.718 03:42:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:01.718 03:42:41 -- common/autotest_common.sh@10 -- # set +x 00:26:01.718 ************************************ 00:26:01.718 END TEST nvmf_failover 00:26:01.718 ************************************ 00:26:01.718 03:42:41 -- nvmf/nvmf.sh@101 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:26:01.718 03:42:41 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:01.718 03:42:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:01.718 03:42:41 -- common/autotest_common.sh@10 -- # set +x 00:26:01.718 ************************************ 00:26:01.718 START TEST nvmf_discovery 00:26:01.718 ************************************ 00:26:01.718 03:42:41 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:26:01.718 * Looking for test storage... 00:26:01.718 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:01.718 03:42:41 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:26:01.718 03:42:41 -- common/autotest_common.sh@1690 -- # lcov --version 00:26:01.718 03:42:41 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:26:01.718 03:42:41 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:26:01.718 03:42:41 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:26:01.718 03:42:41 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:26:01.718 03:42:41 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:26:01.718 03:42:41 -- scripts/common.sh@335 -- # IFS=.-: 00:26:01.718 03:42:41 -- scripts/common.sh@335 -- # read -ra ver1 00:26:01.718 03:42:41 -- scripts/common.sh@336 -- # IFS=.-: 00:26:01.718 03:42:41 -- scripts/common.sh@336 -- # read -ra ver2 00:26:01.718 03:42:41 -- scripts/common.sh@337 -- # local 'op=<' 00:26:01.718 03:42:41 -- scripts/common.sh@339 -- # ver1_l=2 00:26:01.718 03:42:41 -- scripts/common.sh@340 -- # ver2_l=1 00:26:01.718 03:42:41 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:26:01.718 03:42:41 -- scripts/common.sh@343 -- # case "$op" in 00:26:01.718 03:42:41 -- scripts/common.sh@344 -- # : 1 00:26:01.718 03:42:41 -- scripts/common.sh@363 -- # (( v = 0 )) 00:26:01.718 03:42:41 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:26:01.718 03:42:41 -- scripts/common.sh@364 -- # decimal 1 00:26:01.719 03:42:41 -- scripts/common.sh@352 -- # local d=1 00:26:01.719 03:42:41 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:26:01.719 03:42:41 -- scripts/common.sh@354 -- # echo 1 00:26:01.719 03:42:41 -- scripts/common.sh@364 -- # ver1[v]=1 00:26:01.719 03:42:41 -- scripts/common.sh@365 -- # decimal 2 00:26:01.719 03:42:41 -- scripts/common.sh@352 -- # local d=2 00:26:01.719 03:42:41 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:26:01.719 03:42:41 -- scripts/common.sh@354 -- # echo 2 00:26:01.719 03:42:41 -- scripts/common.sh@365 -- # ver2[v]=2 00:26:01.719 03:42:41 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:26:01.719 03:42:41 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:26:01.719 03:42:41 -- scripts/common.sh@367 -- # return 0 00:26:01.719 03:42:41 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:26:01.719 03:42:41 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:26:01.719 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:01.719 --rc genhtml_branch_coverage=1 00:26:01.719 --rc genhtml_function_coverage=1 00:26:01.719 --rc genhtml_legend=1 00:26:01.719 --rc geninfo_all_blocks=1 00:26:01.719 --rc geninfo_unexecuted_blocks=1 00:26:01.719 00:26:01.719 ' 00:26:01.719 03:42:41 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:26:01.719 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:01.719 --rc genhtml_branch_coverage=1 00:26:01.719 --rc genhtml_function_coverage=1 00:26:01.719 --rc genhtml_legend=1 00:26:01.719 --rc geninfo_all_blocks=1 00:26:01.719 --rc geninfo_unexecuted_blocks=1 00:26:01.719 00:26:01.719 ' 00:26:01.719 03:42:41 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:26:01.719 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:01.719 --rc genhtml_branch_coverage=1 00:26:01.719 --rc genhtml_function_coverage=1 00:26:01.719 --rc genhtml_legend=1 00:26:01.719 --rc geninfo_all_blocks=1 00:26:01.719 --rc geninfo_unexecuted_blocks=1 00:26:01.719 00:26:01.719 ' 00:26:01.719 03:42:41 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:26:01.719 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:01.719 --rc genhtml_branch_coverage=1 00:26:01.719 --rc genhtml_function_coverage=1 00:26:01.719 --rc genhtml_legend=1 00:26:01.719 --rc geninfo_all_blocks=1 00:26:01.719 --rc geninfo_unexecuted_blocks=1 00:26:01.719 00:26:01.719 ' 00:26:01.719 03:42:41 -- host/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:01.719 03:42:41 -- nvmf/common.sh@7 -- # uname -s 00:26:01.719 03:42:41 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:01.719 03:42:41 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:01.719 03:42:41 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:01.719 03:42:41 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:01.719 03:42:41 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:01.719 03:42:41 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:01.719 03:42:41 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:01.719 03:42:41 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:01.719 03:42:41 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:01.719 03:42:41 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:01.719 03:42:41 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:01.719 03:42:41 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:01.719 03:42:41 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:01.719 03:42:41 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:01.719 03:42:41 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:01.719 03:42:41 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:01.719 03:42:41 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:01.719 03:42:41 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:01.719 03:42:41 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:01.719 03:42:41 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:01.719 03:42:41 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:01.719 03:42:41 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:01.719 03:42:41 -- paths/export.sh@5 -- # export PATH 00:26:01.719 03:42:41 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:01.719 03:42:41 -- nvmf/common.sh@46 -- # : 0 00:26:01.719 03:42:41 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:01.719 03:42:41 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:01.719 03:42:41 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:01.719 03:42:41 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:01.719 03:42:41 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:01.719 03:42:41 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:01.719 03:42:41 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:01.719 03:42:41 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:01.719 03:42:42 -- host/discovery.sh@11 -- # '[' tcp == rdma ']' 00:26:01.719 03:42:42 -- host/discovery.sh@16 -- # DISCOVERY_PORT=8009 00:26:01.719 03:42:42 -- host/discovery.sh@17 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:26:01.719 03:42:42 -- host/discovery.sh@20 -- # NQN=nqn.2016-06.io.spdk:cnode 00:26:01.719 03:42:42 -- host/discovery.sh@22 -- # HOST_NQN=nqn.2021-12.io.spdk:test 00:26:01.719 03:42:42 -- host/discovery.sh@23 -- # HOST_SOCK=/tmp/host.sock 00:26:01.719 03:42:42 -- host/discovery.sh@25 -- # nvmftestinit 00:26:01.719 03:42:42 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:01.719 03:42:42 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:01.719 03:42:42 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:01.719 03:42:42 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:01.719 03:42:42 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:01.719 03:42:42 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:01.719 03:42:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:01.719 03:42:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:01.719 03:42:42 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:01.719 03:42:42 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:01.719 03:42:42 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:01.719 03:42:42 -- common/autotest_common.sh@10 -- # set +x 00:26:03.624 03:42:43 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:03.624 03:42:43 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:03.624 03:42:43 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:03.624 03:42:43 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:03.624 03:42:43 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:03.624 03:42:43 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:03.624 03:42:43 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:03.624 03:42:43 -- nvmf/common.sh@294 -- # net_devs=() 00:26:03.624 03:42:43 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:03.624 03:42:43 -- nvmf/common.sh@295 -- # e810=() 00:26:03.624 03:42:43 -- nvmf/common.sh@295 -- # local -ga e810 00:26:03.624 03:42:43 -- nvmf/common.sh@296 -- # x722=() 00:26:03.624 03:42:43 -- nvmf/common.sh@296 -- # local -ga x722 00:26:03.624 03:42:43 -- nvmf/common.sh@297 -- # mlx=() 00:26:03.624 03:42:43 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:03.624 03:42:43 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:03.624 03:42:43 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:03.624 03:42:43 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:03.624 03:42:43 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:03.624 03:42:43 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:03.624 03:42:43 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:03.624 03:42:43 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:03.624 03:42:43 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:03.624 03:42:43 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:03.624 03:42:43 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:03.624 03:42:43 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:03.624 03:42:43 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:03.624 03:42:43 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:03.624 03:42:43 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:03.624 03:42:43 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:03.624 03:42:43 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:03.624 03:42:43 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:03.624 03:42:43 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:03.624 03:42:43 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:03.624 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:03.624 03:42:43 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:03.625 03:42:43 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:03.625 03:42:43 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:03.625 03:42:43 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:03.625 03:42:43 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:03.625 03:42:43 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:03.625 03:42:43 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:03.625 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:03.625 03:42:43 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:03.625 03:42:43 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:03.625 03:42:43 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:03.625 03:42:43 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:03.625 03:42:43 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:03.625 03:42:43 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:03.625 03:42:43 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:03.625 03:42:43 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:03.625 03:42:43 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:03.625 03:42:43 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:03.625 03:42:43 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:03.625 03:42:43 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:03.625 03:42:43 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:03.625 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:03.625 03:42:43 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:03.625 03:42:43 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:03.625 03:42:43 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:03.625 03:42:43 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:03.625 03:42:43 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:03.625 03:42:43 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:03.625 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:03.625 03:42:43 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:03.625 03:42:43 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:03.625 03:42:43 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:03.625 03:42:43 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:03.625 03:42:43 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:03.625 03:42:43 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:03.625 03:42:43 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:03.625 03:42:43 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:03.625 03:42:43 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:03.625 03:42:43 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:03.625 03:42:43 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:03.625 03:42:43 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:03.625 03:42:43 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:03.625 03:42:43 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:03.625 03:42:43 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:03.625 03:42:43 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:03.625 03:42:43 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:03.625 03:42:43 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:03.625 03:42:43 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:03.625 03:42:44 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:03.625 03:42:44 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:03.625 03:42:44 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:03.625 03:42:44 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:03.625 03:42:44 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:03.625 03:42:44 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:03.625 03:42:44 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:03.625 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:03.625 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.298 ms 00:26:03.625 00:26:03.625 --- 10.0.0.2 ping statistics --- 00:26:03.625 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:03.625 rtt min/avg/max/mdev = 0.298/0.298/0.298/0.000 ms 00:26:03.625 03:42:44 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:03.625 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:03.625 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.171 ms 00:26:03.625 00:26:03.625 --- 10.0.0.1 ping statistics --- 00:26:03.625 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:03.625 rtt min/avg/max/mdev = 0.171/0.171/0.171/0.000 ms 00:26:03.625 03:42:44 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:03.625 03:42:44 -- nvmf/common.sh@410 -- # return 0 00:26:03.625 03:42:44 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:03.625 03:42:44 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:03.625 03:42:44 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:03.625 03:42:44 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:03.625 03:42:44 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:03.625 03:42:44 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:03.625 03:42:44 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:03.625 03:42:44 -- host/discovery.sh@30 -- # nvmfappstart -m 0x2 00:26:03.625 03:42:44 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:03.625 03:42:44 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:03.625 03:42:44 -- common/autotest_common.sh@10 -- # set +x 00:26:03.625 03:42:44 -- nvmf/common.sh@469 -- # nvmfpid=3156403 00:26:03.625 03:42:44 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:26:03.625 03:42:44 -- nvmf/common.sh@470 -- # waitforlisten 3156403 00:26:03.625 03:42:44 -- common/autotest_common.sh@829 -- # '[' -z 3156403 ']' 00:26:03.625 03:42:44 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:03.625 03:42:44 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:03.625 03:42:44 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:03.625 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:03.625 03:42:44 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:03.625 03:42:44 -- common/autotest_common.sh@10 -- # set +x 00:26:03.625 [2024-11-21 03:42:44.167932] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:03.625 [2024-11-21 03:42:44.168025] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:03.625 EAL: No free 2048 kB hugepages reported on node 1 00:26:03.625 [2024-11-21 03:42:44.235191] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:03.884 [2024-11-21 03:42:44.347765] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:03.884 [2024-11-21 03:42:44.347948] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:03.884 [2024-11-21 03:42:44.347968] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:03.884 [2024-11-21 03:42:44.347983] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:03.884 [2024-11-21 03:42:44.348015] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:04.822 03:42:45 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:04.822 03:42:45 -- common/autotest_common.sh@862 -- # return 0 00:26:04.822 03:42:45 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:04.822 03:42:45 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:04.822 03:42:45 -- common/autotest_common.sh@10 -- # set +x 00:26:04.822 03:42:45 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:04.822 03:42:45 -- host/discovery.sh@32 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:26:04.822 03:42:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:04.822 03:42:45 -- common/autotest_common.sh@10 -- # set +x 00:26:04.822 [2024-11-21 03:42:45.142624] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:04.822 03:42:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:04.822 03:42:45 -- host/discovery.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2014-08.org.nvmexpress.discovery -t tcp -a 10.0.0.2 -s 8009 00:26:04.822 03:42:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:04.822 03:42:45 -- common/autotest_common.sh@10 -- # set +x 00:26:04.822 [2024-11-21 03:42:45.150815] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:26:04.822 03:42:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:04.822 03:42:45 -- host/discovery.sh@35 -- # rpc_cmd bdev_null_create null0 1000 512 00:26:04.822 03:42:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:04.822 03:42:45 -- common/autotest_common.sh@10 -- # set +x 00:26:04.822 null0 00:26:04.822 03:42:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:04.822 03:42:45 -- host/discovery.sh@36 -- # rpc_cmd bdev_null_create null1 1000 512 00:26:04.822 03:42:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:04.822 03:42:45 -- common/autotest_common.sh@10 -- # set +x 00:26:04.822 null1 00:26:04.822 03:42:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:04.822 03:42:45 -- host/discovery.sh@37 -- # rpc_cmd bdev_wait_for_examine 00:26:04.822 03:42:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:04.822 03:42:45 -- common/autotest_common.sh@10 -- # set +x 00:26:04.822 03:42:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:04.822 03:42:45 -- host/discovery.sh@45 -- # hostpid=3156561 00:26:04.822 03:42:45 -- host/discovery.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock 00:26:04.822 03:42:45 -- host/discovery.sh@46 -- # waitforlisten 3156561 /tmp/host.sock 00:26:04.823 03:42:45 -- common/autotest_common.sh@829 -- # '[' -z 3156561 ']' 00:26:04.823 03:42:45 -- common/autotest_common.sh@833 -- # local rpc_addr=/tmp/host.sock 00:26:04.823 03:42:45 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:04.823 03:42:45 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:26:04.823 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:26:04.823 03:42:45 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:04.823 03:42:45 -- common/autotest_common.sh@10 -- # set +x 00:26:04.823 [2024-11-21 03:42:45.221732] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:04.823 [2024-11-21 03:42:45.221810] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3156561 ] 00:26:04.823 EAL: No free 2048 kB hugepages reported on node 1 00:26:04.823 [2024-11-21 03:42:45.288083] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:04.823 [2024-11-21 03:42:45.401248] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:04.823 [2024-11-21 03:42:45.401452] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:05.761 03:42:46 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:05.761 03:42:46 -- common/autotest_common.sh@862 -- # return 0 00:26:05.761 03:42:46 -- host/discovery.sh@48 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:26:05.761 03:42:46 -- host/discovery.sh@50 -- # rpc_cmd -s /tmp/host.sock log_set_flag bdev_nvme 00:26:05.761 03:42:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:05.761 03:42:46 -- common/autotest_common.sh@10 -- # set +x 00:26:05.761 03:42:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:05.761 03:42:46 -- host/discovery.sh@51 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test 00:26:05.761 03:42:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:05.761 03:42:46 -- common/autotest_common.sh@10 -- # set +x 00:26:05.761 03:42:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:05.761 03:42:46 -- host/discovery.sh@72 -- # notify_id=0 00:26:05.761 03:42:46 -- host/discovery.sh@78 -- # get_subsystem_names 00:26:05.761 03:42:46 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:05.761 03:42:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:05.761 03:42:46 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:05.761 03:42:46 -- common/autotest_common.sh@10 -- # set +x 00:26:05.761 03:42:46 -- host/discovery.sh@59 -- # sort 00:26:05.761 03:42:46 -- host/discovery.sh@59 -- # xargs 00:26:05.761 03:42:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:05.761 03:42:46 -- host/discovery.sh@78 -- # [[ '' == '' ]] 00:26:05.761 03:42:46 -- host/discovery.sh@79 -- # get_bdev_list 00:26:05.761 03:42:46 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:05.761 03:42:46 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:05.761 03:42:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:05.761 03:42:46 -- common/autotest_common.sh@10 -- # set +x 00:26:05.761 03:42:46 -- host/discovery.sh@55 -- # sort 00:26:05.761 03:42:46 -- host/discovery.sh@55 -- # xargs 00:26:05.761 03:42:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:05.761 03:42:46 -- host/discovery.sh@79 -- # [[ '' == '' ]] 00:26:05.761 03:42:46 -- host/discovery.sh@81 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 00:26:05.761 03:42:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:05.761 03:42:46 -- common/autotest_common.sh@10 -- # set +x 00:26:05.761 03:42:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:05.761 03:42:46 -- host/discovery.sh@82 -- # get_subsystem_names 00:26:05.761 03:42:46 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:05.761 03:42:46 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:05.761 03:42:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:05.761 03:42:46 -- common/autotest_common.sh@10 -- # set +x 00:26:05.761 03:42:46 -- host/discovery.sh@59 -- # sort 00:26:05.761 03:42:46 -- host/discovery.sh@59 -- # xargs 00:26:05.761 03:42:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:05.761 03:42:46 -- host/discovery.sh@82 -- # [[ '' == '' ]] 00:26:05.761 03:42:46 -- host/discovery.sh@83 -- # get_bdev_list 00:26:05.761 03:42:46 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:05.761 03:42:46 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:05.761 03:42:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:05.761 03:42:46 -- common/autotest_common.sh@10 -- # set +x 00:26:05.761 03:42:46 -- host/discovery.sh@55 -- # sort 00:26:05.761 03:42:46 -- host/discovery.sh@55 -- # xargs 00:26:05.761 03:42:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:05.761 03:42:46 -- host/discovery.sh@83 -- # [[ '' == '' ]] 00:26:05.761 03:42:46 -- host/discovery.sh@85 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 00:26:05.761 03:42:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:05.761 03:42:46 -- common/autotest_common.sh@10 -- # set +x 00:26:05.761 03:42:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:05.761 03:42:46 -- host/discovery.sh@86 -- # get_subsystem_names 00:26:05.761 03:42:46 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:05.761 03:42:46 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:05.761 03:42:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:05.761 03:42:46 -- common/autotest_common.sh@10 -- # set +x 00:26:05.761 03:42:46 -- host/discovery.sh@59 -- # sort 00:26:05.761 03:42:46 -- host/discovery.sh@59 -- # xargs 00:26:05.761 03:42:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:06.021 03:42:46 -- host/discovery.sh@86 -- # [[ '' == '' ]] 00:26:06.021 03:42:46 -- host/discovery.sh@87 -- # get_bdev_list 00:26:06.021 03:42:46 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:06.021 03:42:46 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:06.021 03:42:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:06.021 03:42:46 -- common/autotest_common.sh@10 -- # set +x 00:26:06.021 03:42:46 -- host/discovery.sh@55 -- # sort 00:26:06.021 03:42:46 -- host/discovery.sh@55 -- # xargs 00:26:06.021 03:42:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:06.021 03:42:46 -- host/discovery.sh@87 -- # [[ '' == '' ]] 00:26:06.021 03:42:46 -- host/discovery.sh@91 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:26:06.021 03:42:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:06.021 03:42:46 -- common/autotest_common.sh@10 -- # set +x 00:26:06.021 [2024-11-21 03:42:46.470534] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:06.021 03:42:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:06.021 03:42:46 -- host/discovery.sh@92 -- # get_subsystem_names 00:26:06.021 03:42:46 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:06.021 03:42:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:06.021 03:42:46 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:06.021 03:42:46 -- common/autotest_common.sh@10 -- # set +x 00:26:06.021 03:42:46 -- host/discovery.sh@59 -- # sort 00:26:06.021 03:42:46 -- host/discovery.sh@59 -- # xargs 00:26:06.021 03:42:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:06.021 03:42:46 -- host/discovery.sh@92 -- # [[ '' == '' ]] 00:26:06.021 03:42:46 -- host/discovery.sh@93 -- # get_bdev_list 00:26:06.021 03:42:46 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:06.021 03:42:46 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:06.021 03:42:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:06.021 03:42:46 -- common/autotest_common.sh@10 -- # set +x 00:26:06.021 03:42:46 -- host/discovery.sh@55 -- # sort 00:26:06.021 03:42:46 -- host/discovery.sh@55 -- # xargs 00:26:06.021 03:42:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:06.021 03:42:46 -- host/discovery.sh@93 -- # [[ '' == '' ]] 00:26:06.021 03:42:46 -- host/discovery.sh@94 -- # get_notification_count 00:26:06.021 03:42:46 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:26:06.021 03:42:46 -- host/discovery.sh@74 -- # jq '. | length' 00:26:06.021 03:42:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:06.021 03:42:46 -- common/autotest_common.sh@10 -- # set +x 00:26:06.021 03:42:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:06.021 03:42:46 -- host/discovery.sh@74 -- # notification_count=0 00:26:06.021 03:42:46 -- host/discovery.sh@75 -- # notify_id=0 00:26:06.021 03:42:46 -- host/discovery.sh@95 -- # [[ 0 == 0 ]] 00:26:06.021 03:42:46 -- host/discovery.sh@99 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2021-12.io.spdk:test 00:26:06.021 03:42:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:06.021 03:42:46 -- common/autotest_common.sh@10 -- # set +x 00:26:06.021 03:42:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:06.021 03:42:46 -- host/discovery.sh@100 -- # sleep 1 00:26:06.961 [2024-11-21 03:42:47.252309] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:26:06.961 [2024-11-21 03:42:47.252370] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:26:06.961 [2024-11-21 03:42:47.252412] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:06.961 [2024-11-21 03:42:47.339652] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:26:06.961 [2024-11-21 03:42:47.566061] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:26:06.961 [2024-11-21 03:42:47.566097] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:26:07.221 03:42:47 -- host/discovery.sh@101 -- # get_subsystem_names 00:26:07.221 03:42:47 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:07.221 03:42:47 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:07.221 03:42:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:07.221 03:42:47 -- common/autotest_common.sh@10 -- # set +x 00:26:07.221 03:42:47 -- host/discovery.sh@59 -- # sort 00:26:07.221 03:42:47 -- host/discovery.sh@59 -- # xargs 00:26:07.221 03:42:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:07.221 03:42:47 -- host/discovery.sh@101 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:26:07.221 03:42:47 -- host/discovery.sh@102 -- # get_bdev_list 00:26:07.221 03:42:47 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:07.221 03:42:47 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:07.221 03:42:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:07.221 03:42:47 -- common/autotest_common.sh@10 -- # set +x 00:26:07.221 03:42:47 -- host/discovery.sh@55 -- # sort 00:26:07.221 03:42:47 -- host/discovery.sh@55 -- # xargs 00:26:07.221 03:42:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:07.221 03:42:47 -- host/discovery.sh@102 -- # [[ nvme0n1 == \n\v\m\e\0\n\1 ]] 00:26:07.221 03:42:47 -- host/discovery.sh@103 -- # get_subsystem_paths nvme0 00:26:07.221 03:42:47 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:26:07.221 03:42:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:07.221 03:42:47 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:26:07.221 03:42:47 -- common/autotest_common.sh@10 -- # set +x 00:26:07.221 03:42:47 -- host/discovery.sh@63 -- # sort -n 00:26:07.221 03:42:47 -- host/discovery.sh@63 -- # xargs 00:26:07.221 03:42:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:07.221 03:42:47 -- host/discovery.sh@103 -- # [[ 4420 == \4\4\2\0 ]] 00:26:07.221 03:42:47 -- host/discovery.sh@104 -- # get_notification_count 00:26:07.221 03:42:47 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:26:07.221 03:42:47 -- host/discovery.sh@74 -- # jq '. | length' 00:26:07.221 03:42:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:07.221 03:42:47 -- common/autotest_common.sh@10 -- # set +x 00:26:07.221 03:42:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:07.221 03:42:47 -- host/discovery.sh@74 -- # notification_count=1 00:26:07.221 03:42:47 -- host/discovery.sh@75 -- # notify_id=1 00:26:07.221 03:42:47 -- host/discovery.sh@105 -- # [[ 1 == 1 ]] 00:26:07.221 03:42:47 -- host/discovery.sh@108 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null1 00:26:07.221 03:42:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:07.221 03:42:47 -- common/autotest_common.sh@10 -- # set +x 00:26:07.221 03:42:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:07.221 03:42:47 -- host/discovery.sh@109 -- # sleep 1 00:26:08.162 03:42:48 -- host/discovery.sh@110 -- # get_bdev_list 00:26:08.162 03:42:48 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:08.162 03:42:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:08.162 03:42:48 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:08.162 03:42:48 -- common/autotest_common.sh@10 -- # set +x 00:26:08.162 03:42:48 -- host/discovery.sh@55 -- # sort 00:26:08.162 03:42:48 -- host/discovery.sh@55 -- # xargs 00:26:08.162 03:42:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:08.423 03:42:48 -- host/discovery.sh@110 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:26:08.423 03:42:48 -- host/discovery.sh@111 -- # get_notification_count 00:26:08.423 03:42:48 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 1 00:26:08.423 03:42:48 -- host/discovery.sh@74 -- # jq '. | length' 00:26:08.423 03:42:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:08.423 03:42:48 -- common/autotest_common.sh@10 -- # set +x 00:26:08.423 03:42:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:08.423 03:42:48 -- host/discovery.sh@74 -- # notification_count=1 00:26:08.423 03:42:48 -- host/discovery.sh@75 -- # notify_id=2 00:26:08.423 03:42:48 -- host/discovery.sh@112 -- # [[ 1 == 1 ]] 00:26:08.423 03:42:48 -- host/discovery.sh@116 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 00:26:08.423 03:42:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:08.423 03:42:48 -- common/autotest_common.sh@10 -- # set +x 00:26:08.423 [2024-11-21 03:42:48.873849] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:26:08.423 [2024-11-21 03:42:48.874848] bdev_nvme.c:6741:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:26:08.423 [2024-11-21 03:42:48.874888] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:08.423 03:42:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:08.423 03:42:48 -- host/discovery.sh@117 -- # sleep 1 00:26:08.423 [2024-11-21 03:42:48.962112] bdev_nvme.c:6683:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new path for nvme0 00:26:08.683 [2024-11-21 03:42:49.263590] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:26:08.683 [2024-11-21 03:42:49.263625] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:26:08.683 [2024-11-21 03:42:49.263635] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:26:09.252 03:42:49 -- host/discovery.sh@118 -- # get_subsystem_names 00:26:09.252 03:42:49 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:09.252 03:42:49 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:09.252 03:42:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:09.252 03:42:49 -- common/autotest_common.sh@10 -- # set +x 00:26:09.252 03:42:49 -- host/discovery.sh@59 -- # sort 00:26:09.252 03:42:49 -- host/discovery.sh@59 -- # xargs 00:26:09.252 03:42:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:09.514 03:42:49 -- host/discovery.sh@118 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:26:09.514 03:42:49 -- host/discovery.sh@119 -- # get_bdev_list 00:26:09.514 03:42:49 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:09.514 03:42:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:09.514 03:42:49 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:09.514 03:42:49 -- common/autotest_common.sh@10 -- # set +x 00:26:09.514 03:42:49 -- host/discovery.sh@55 -- # sort 00:26:09.514 03:42:49 -- host/discovery.sh@55 -- # xargs 00:26:09.514 03:42:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:09.514 03:42:49 -- host/discovery.sh@119 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:26:09.514 03:42:49 -- host/discovery.sh@120 -- # get_subsystem_paths nvme0 00:26:09.514 03:42:49 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:26:09.514 03:42:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:09.514 03:42:49 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:26:09.514 03:42:49 -- common/autotest_common.sh@10 -- # set +x 00:26:09.514 03:42:49 -- host/discovery.sh@63 -- # sort -n 00:26:09.514 03:42:49 -- host/discovery.sh@63 -- # xargs 00:26:09.514 03:42:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:09.514 03:42:50 -- host/discovery.sh@120 -- # [[ 4420 4421 == \4\4\2\0\ \4\4\2\1 ]] 00:26:09.514 03:42:50 -- host/discovery.sh@121 -- # get_notification_count 00:26:09.514 03:42:50 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:26:09.514 03:42:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:09.514 03:42:50 -- host/discovery.sh@74 -- # jq '. | length' 00:26:09.514 03:42:50 -- common/autotest_common.sh@10 -- # set +x 00:26:09.514 03:42:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:09.514 03:42:50 -- host/discovery.sh@74 -- # notification_count=0 00:26:09.514 03:42:50 -- host/discovery.sh@75 -- # notify_id=2 00:26:09.514 03:42:50 -- host/discovery.sh@122 -- # [[ 0 == 0 ]] 00:26:09.514 03:42:50 -- host/discovery.sh@126 -- # rpc_cmd nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:26:09.514 03:42:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:09.514 03:42:50 -- common/autotest_common.sh@10 -- # set +x 00:26:09.514 [2024-11-21 03:42:50.053489] bdev_nvme.c:6741:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:26:09.514 [2024-11-21 03:42:50.053531] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:09.514 03:42:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:09.514 03:42:50 -- host/discovery.sh@127 -- # sleep 1 00:26:09.514 [2024-11-21 03:42:50.059167] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:09.514 [2024-11-21 03:42:50.059216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.514 [2024-11-21 03:42:50.059243] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:09.514 [2024-11-21 03:42:50.059257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.514 [2024-11-21 03:42:50.059271] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:09.514 [2024-11-21 03:42:50.059285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.514 [2024-11-21 03:42:50.059299] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:09.514 [2024-11-21 03:42:50.059313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:09.514 [2024-11-21 03:42:50.059326] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d36810 is same with the state(5) to be set 00:26:09.514 [2024-11-21 03:42:50.069183] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d36810 (9): Bad file descriptor 00:26:09.514 [2024-11-21 03:42:50.079230] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:09.514 [2024-11-21 03:42:50.079482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:09.514 [2024-11-21 03:42:50.079680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:09.514 [2024-11-21 03:42:50.079710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d36810 with addr=10.0.0.2, port=4420 00:26:09.514 [2024-11-21 03:42:50.079729] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d36810 is same with the state(5) to be set 00:26:09.514 [2024-11-21 03:42:50.079756] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d36810 (9): Bad file descriptor 00:26:09.514 [2024-11-21 03:42:50.079794] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:09.514 [2024-11-21 03:42:50.079815] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:09.514 [2024-11-21 03:42:50.079834] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:09.514 [2024-11-21 03:42:50.079857] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:09.514 [2024-11-21 03:42:50.089319] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:09.514 [2024-11-21 03:42:50.089548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:09.514 [2024-11-21 03:42:50.089698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:09.514 [2024-11-21 03:42:50.089728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d36810 with addr=10.0.0.2, port=4420 00:26:09.514 [2024-11-21 03:42:50.089746] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d36810 is same with the state(5) to be set 00:26:09.514 [2024-11-21 03:42:50.089772] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d36810 (9): Bad file descriptor 00:26:09.514 [2024-11-21 03:42:50.089818] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:09.514 [2024-11-21 03:42:50.089838] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:09.514 [2024-11-21 03:42:50.089853] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:09.514 [2024-11-21 03:42:50.089888] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:09.514 [2024-11-21 03:42:50.099395] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:09.514 [2024-11-21 03:42:50.099580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:09.514 [2024-11-21 03:42:50.099760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:09.514 [2024-11-21 03:42:50.099791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d36810 with addr=10.0.0.2, port=4420 00:26:09.514 [2024-11-21 03:42:50.099810] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d36810 is same with the state(5) to be set 00:26:09.514 [2024-11-21 03:42:50.099836] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d36810 (9): Bad file descriptor 00:26:09.514 [2024-11-21 03:42:50.099858] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:09.514 [2024-11-21 03:42:50.099873] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:09.514 [2024-11-21 03:42:50.099888] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:09.514 [2024-11-21 03:42:50.099939] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:09.514 [2024-11-21 03:42:50.109479] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:09.514 [2024-11-21 03:42:50.109646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:09.514 [2024-11-21 03:42:50.109814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:09.514 [2024-11-21 03:42:50.109845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d36810 with addr=10.0.0.2, port=4420 00:26:09.514 [2024-11-21 03:42:50.109862] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d36810 is same with the state(5) to be set 00:26:09.514 [2024-11-21 03:42:50.109888] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d36810 (9): Bad file descriptor 00:26:09.514 [2024-11-21 03:42:50.109924] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:09.514 [2024-11-21 03:42:50.109944] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:09.514 [2024-11-21 03:42:50.109960] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:09.514 [2024-11-21 03:42:50.109994] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:09.514 [2024-11-21 03:42:50.119558] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:09.514 [2024-11-21 03:42:50.119708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:09.514 [2024-11-21 03:42:50.119886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:09.514 [2024-11-21 03:42:50.119916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d36810 with addr=10.0.0.2, port=4420 00:26:09.514 [2024-11-21 03:42:50.119934] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d36810 is same with the state(5) to be set 00:26:09.514 [2024-11-21 03:42:50.119959] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d36810 (9): Bad file descriptor 00:26:09.514 [2024-11-21 03:42:50.119982] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:09.514 [2024-11-21 03:42:50.120003] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:09.514 [2024-11-21 03:42:50.120020] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:09.514 [2024-11-21 03:42:50.120056] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:09.514 [2024-11-21 03:42:50.129636] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:09.514 [2024-11-21 03:42:50.129806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:09.514 [2024-11-21 03:42:50.129985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:09.514 [2024-11-21 03:42:50.130015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d36810 with addr=10.0.0.2, port=4420 00:26:09.515 [2024-11-21 03:42:50.130033] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d36810 is same with the state(5) to be set 00:26:09.515 [2024-11-21 03:42:50.130059] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d36810 (9): Bad file descriptor 00:26:09.515 [2024-11-21 03:42:50.130132] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:09.515 [2024-11-21 03:42:50.130154] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:09.515 [2024-11-21 03:42:50.130168] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:09.515 [2024-11-21 03:42:50.130187] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:09.515 [2024-11-21 03:42:50.139713] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:09.515 [2024-11-21 03:42:50.139880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:09.515 [2024-11-21 03:42:50.140038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:09.515 [2024-11-21 03:42:50.140065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d36810 with addr=10.0.0.2, port=4420 00:26:09.515 [2024-11-21 03:42:50.140097] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d36810 is same with the state(5) to be set 00:26:09.515 [2024-11-21 03:42:50.140120] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d36810 (9): Bad file descriptor 00:26:09.515 [2024-11-21 03:42:50.140204] bdev_nvme.c:6546:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 not found 00:26:09.515 [2024-11-21 03:42:50.140232] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:26:09.515 [2024-11-21 03:42:50.140266] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:09.515 [2024-11-21 03:42:50.140285] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:09.515 [2024-11-21 03:42:50.140299] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:09.515 [2024-11-21 03:42:50.140321] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:10.451 03:42:51 -- host/discovery.sh@128 -- # get_subsystem_names 00:26:10.451 03:42:51 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:10.451 03:42:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:10.451 03:42:51 -- common/autotest_common.sh@10 -- # set +x 00:26:10.451 03:42:51 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:10.451 03:42:51 -- host/discovery.sh@59 -- # sort 00:26:10.451 03:42:51 -- host/discovery.sh@59 -- # xargs 00:26:10.451 03:42:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:10.712 03:42:51 -- host/discovery.sh@128 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:26:10.712 03:42:51 -- host/discovery.sh@129 -- # get_bdev_list 00:26:10.712 03:42:51 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:10.712 03:42:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:10.712 03:42:51 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:10.712 03:42:51 -- common/autotest_common.sh@10 -- # set +x 00:26:10.712 03:42:51 -- host/discovery.sh@55 -- # sort 00:26:10.712 03:42:51 -- host/discovery.sh@55 -- # xargs 00:26:10.712 03:42:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:10.712 03:42:51 -- host/discovery.sh@129 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:26:10.712 03:42:51 -- host/discovery.sh@130 -- # get_subsystem_paths nvme0 00:26:10.712 03:42:51 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:26:10.712 03:42:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:10.712 03:42:51 -- common/autotest_common.sh@10 -- # set +x 00:26:10.712 03:42:51 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:26:10.712 03:42:51 -- host/discovery.sh@63 -- # sort -n 00:26:10.712 03:42:51 -- host/discovery.sh@63 -- # xargs 00:26:10.712 03:42:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:10.712 03:42:51 -- host/discovery.sh@130 -- # [[ 4421 == \4\4\2\1 ]] 00:26:10.712 03:42:51 -- host/discovery.sh@131 -- # get_notification_count 00:26:10.712 03:42:51 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:26:10.712 03:42:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:10.712 03:42:51 -- common/autotest_common.sh@10 -- # set +x 00:26:10.712 03:42:51 -- host/discovery.sh@74 -- # jq '. | length' 00:26:10.712 03:42:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:10.712 03:42:51 -- host/discovery.sh@74 -- # notification_count=0 00:26:10.712 03:42:51 -- host/discovery.sh@75 -- # notify_id=2 00:26:10.712 03:42:51 -- host/discovery.sh@132 -- # [[ 0 == 0 ]] 00:26:10.712 03:42:51 -- host/discovery.sh@134 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_stop_discovery -b nvme 00:26:10.712 03:42:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:10.712 03:42:51 -- common/autotest_common.sh@10 -- # set +x 00:26:10.712 03:42:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:10.712 03:42:51 -- host/discovery.sh@135 -- # sleep 1 00:26:11.651 03:42:52 -- host/discovery.sh@136 -- # get_subsystem_names 00:26:11.651 03:42:52 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:11.651 03:42:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:11.651 03:42:52 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:11.651 03:42:52 -- common/autotest_common.sh@10 -- # set +x 00:26:11.651 03:42:52 -- host/discovery.sh@59 -- # sort 00:26:11.651 03:42:52 -- host/discovery.sh@59 -- # xargs 00:26:11.651 03:42:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:11.651 03:42:52 -- host/discovery.sh@136 -- # [[ '' == '' ]] 00:26:11.651 03:42:52 -- host/discovery.sh@137 -- # get_bdev_list 00:26:11.651 03:42:52 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:11.651 03:42:52 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:11.651 03:42:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:11.651 03:42:52 -- common/autotest_common.sh@10 -- # set +x 00:26:11.651 03:42:52 -- host/discovery.sh@55 -- # sort 00:26:11.651 03:42:52 -- host/discovery.sh@55 -- # xargs 00:26:11.651 03:42:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:11.910 03:42:52 -- host/discovery.sh@137 -- # [[ '' == '' ]] 00:26:11.910 03:42:52 -- host/discovery.sh@138 -- # get_notification_count 00:26:11.910 03:42:52 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:26:11.910 03:42:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:11.910 03:42:52 -- host/discovery.sh@74 -- # jq '. | length' 00:26:11.910 03:42:52 -- common/autotest_common.sh@10 -- # set +x 00:26:11.910 03:42:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:11.910 03:42:52 -- host/discovery.sh@74 -- # notification_count=2 00:26:11.910 03:42:52 -- host/discovery.sh@75 -- # notify_id=4 00:26:11.910 03:42:52 -- host/discovery.sh@139 -- # [[ 2 == 2 ]] 00:26:11.910 03:42:52 -- host/discovery.sh@142 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:11.910 03:42:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:11.910 03:42:52 -- common/autotest_common.sh@10 -- # set +x 00:26:12.922 [2024-11-21 03:42:53.409197] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:26:12.923 [2024-11-21 03:42:53.409221] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:26:12.923 [2024-11-21 03:42:53.409242] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:12.923 [2024-11-21 03:42:53.495522] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new subsystem nvme0 00:26:13.203 [2024-11-21 03:42:53.764457] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:26:13.203 [2024-11-21 03:42:53.764501] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:26:13.203 03:42:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:13.203 03:42:53 -- host/discovery.sh@144 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:13.203 03:42:53 -- common/autotest_common.sh@650 -- # local es=0 00:26:13.203 03:42:53 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:13.203 03:42:53 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:26:13.203 03:42:53 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:13.203 03:42:53 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:26:13.203 03:42:53 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:13.203 03:42:53 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:13.203 03:42:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:13.203 03:42:53 -- common/autotest_common.sh@10 -- # set +x 00:26:13.203 request: 00:26:13.203 { 00:26:13.203 "name": "nvme", 00:26:13.203 "trtype": "tcp", 00:26:13.203 "traddr": "10.0.0.2", 00:26:13.203 "hostnqn": "nqn.2021-12.io.spdk:test", 00:26:13.203 "adrfam": "ipv4", 00:26:13.203 "trsvcid": "8009", 00:26:13.203 "wait_for_attach": true, 00:26:13.203 "method": "bdev_nvme_start_discovery", 00:26:13.203 "req_id": 1 00:26:13.203 } 00:26:13.203 Got JSON-RPC error response 00:26:13.203 response: 00:26:13.203 { 00:26:13.203 "code": -17, 00:26:13.203 "message": "File exists" 00:26:13.203 } 00:26:13.203 03:42:53 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:26:13.203 03:42:53 -- common/autotest_common.sh@653 -- # es=1 00:26:13.203 03:42:53 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:26:13.203 03:42:53 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:26:13.203 03:42:53 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:26:13.203 03:42:53 -- host/discovery.sh@146 -- # get_discovery_ctrlrs 00:26:13.203 03:42:53 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:26:13.203 03:42:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:13.203 03:42:53 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:26:13.203 03:42:53 -- common/autotest_common.sh@10 -- # set +x 00:26:13.203 03:42:53 -- host/discovery.sh@67 -- # sort 00:26:13.203 03:42:53 -- host/discovery.sh@67 -- # xargs 00:26:13.203 03:42:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:13.203 03:42:53 -- host/discovery.sh@146 -- # [[ nvme == \n\v\m\e ]] 00:26:13.203 03:42:53 -- host/discovery.sh@147 -- # get_bdev_list 00:26:13.203 03:42:53 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:13.203 03:42:53 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:13.203 03:42:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:13.203 03:42:53 -- common/autotest_common.sh@10 -- # set +x 00:26:13.203 03:42:53 -- host/discovery.sh@55 -- # sort 00:26:13.203 03:42:53 -- host/discovery.sh@55 -- # xargs 00:26:13.203 03:42:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:13.461 03:42:53 -- host/discovery.sh@147 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:26:13.461 03:42:53 -- host/discovery.sh@150 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:13.461 03:42:53 -- common/autotest_common.sh@650 -- # local es=0 00:26:13.461 03:42:53 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:13.461 03:42:53 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:26:13.461 03:42:53 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:13.461 03:42:53 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:26:13.461 03:42:53 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:13.461 03:42:53 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:13.461 03:42:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:13.461 03:42:53 -- common/autotest_common.sh@10 -- # set +x 00:26:13.461 request: 00:26:13.461 { 00:26:13.461 "name": "nvme_second", 00:26:13.461 "trtype": "tcp", 00:26:13.461 "traddr": "10.0.0.2", 00:26:13.461 "hostnqn": "nqn.2021-12.io.spdk:test", 00:26:13.461 "adrfam": "ipv4", 00:26:13.461 "trsvcid": "8009", 00:26:13.461 "wait_for_attach": true, 00:26:13.461 "method": "bdev_nvme_start_discovery", 00:26:13.461 "req_id": 1 00:26:13.461 } 00:26:13.461 Got JSON-RPC error response 00:26:13.461 response: 00:26:13.461 { 00:26:13.461 "code": -17, 00:26:13.461 "message": "File exists" 00:26:13.461 } 00:26:13.461 03:42:53 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:26:13.461 03:42:53 -- common/autotest_common.sh@653 -- # es=1 00:26:13.461 03:42:53 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:26:13.461 03:42:53 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:26:13.461 03:42:53 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:26:13.461 03:42:53 -- host/discovery.sh@152 -- # get_discovery_ctrlrs 00:26:13.461 03:42:53 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:26:13.461 03:42:53 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:26:13.461 03:42:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:13.461 03:42:53 -- common/autotest_common.sh@10 -- # set +x 00:26:13.461 03:42:53 -- host/discovery.sh@67 -- # sort 00:26:13.461 03:42:53 -- host/discovery.sh@67 -- # xargs 00:26:13.461 03:42:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:13.461 03:42:53 -- host/discovery.sh@152 -- # [[ nvme == \n\v\m\e ]] 00:26:13.461 03:42:53 -- host/discovery.sh@153 -- # get_bdev_list 00:26:13.461 03:42:53 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:13.461 03:42:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:13.461 03:42:53 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:13.461 03:42:53 -- common/autotest_common.sh@10 -- # set +x 00:26:13.461 03:42:53 -- host/discovery.sh@55 -- # sort 00:26:13.461 03:42:53 -- host/discovery.sh@55 -- # xargs 00:26:13.461 03:42:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:13.461 03:42:53 -- host/discovery.sh@153 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:26:13.461 03:42:53 -- host/discovery.sh@156 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:26:13.461 03:42:53 -- common/autotest_common.sh@650 -- # local es=0 00:26:13.462 03:42:53 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:26:13.462 03:42:53 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:26:13.462 03:42:53 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:13.462 03:42:53 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:26:13.462 03:42:53 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:13.462 03:42:53 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:26:13.462 03:42:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:13.462 03:42:53 -- common/autotest_common.sh@10 -- # set +x 00:26:14.396 [2024-11-21 03:42:54.968816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:14.396 [2024-11-21 03:42:54.969036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:14.396 [2024-11-21 03:42:54.969067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d5a3d0 with addr=10.0.0.2, port=8010 00:26:14.396 [2024-11-21 03:42:54.969125] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:26:14.396 [2024-11-21 03:42:54.969142] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:26:14.396 [2024-11-21 03:42:54.969154] bdev_nvme.c:6821:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:26:15.336 [2024-11-21 03:42:55.971283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:15.336 [2024-11-21 03:42:55.971421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:15.336 [2024-11-21 03:42:55.971452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d26d30 with addr=10.0.0.2, port=8010 00:26:15.336 [2024-11-21 03:42:55.971474] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:26:15.336 [2024-11-21 03:42:55.971496] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:26:15.336 [2024-11-21 03:42:55.971510] bdev_nvme.c:6821:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:26:16.714 [2024-11-21 03:42:56.973498] bdev_nvme.c:6802:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] timed out while attaching discovery ctrlr 00:26:16.714 request: 00:26:16.714 { 00:26:16.714 "name": "nvme_second", 00:26:16.714 "trtype": "tcp", 00:26:16.714 "traddr": "10.0.0.2", 00:26:16.714 "hostnqn": "nqn.2021-12.io.spdk:test", 00:26:16.714 "adrfam": "ipv4", 00:26:16.714 "trsvcid": "8010", 00:26:16.714 "attach_timeout_ms": 3000, 00:26:16.714 "method": "bdev_nvme_start_discovery", 00:26:16.714 "req_id": 1 00:26:16.714 } 00:26:16.714 Got JSON-RPC error response 00:26:16.714 response: 00:26:16.714 { 00:26:16.714 "code": -110, 00:26:16.714 "message": "Connection timed out" 00:26:16.714 } 00:26:16.714 03:42:56 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:26:16.714 03:42:56 -- common/autotest_common.sh@653 -- # es=1 00:26:16.714 03:42:56 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:26:16.714 03:42:56 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:26:16.714 03:42:56 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:26:16.714 03:42:56 -- host/discovery.sh@158 -- # get_discovery_ctrlrs 00:26:16.714 03:42:56 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:26:16.714 03:42:56 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:26:16.714 03:42:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:16.714 03:42:56 -- host/discovery.sh@67 -- # sort 00:26:16.714 03:42:56 -- common/autotest_common.sh@10 -- # set +x 00:26:16.715 03:42:56 -- host/discovery.sh@67 -- # xargs 00:26:16.715 03:42:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:16.715 03:42:57 -- host/discovery.sh@158 -- # [[ nvme == \n\v\m\e ]] 00:26:16.715 03:42:57 -- host/discovery.sh@160 -- # trap - SIGINT SIGTERM EXIT 00:26:16.715 03:42:57 -- host/discovery.sh@162 -- # kill 3156561 00:26:16.715 03:42:57 -- host/discovery.sh@163 -- # nvmftestfini 00:26:16.715 03:42:57 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:16.715 03:42:57 -- nvmf/common.sh@116 -- # sync 00:26:16.715 03:42:57 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:16.715 03:42:57 -- nvmf/common.sh@119 -- # set +e 00:26:16.715 03:42:57 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:16.715 03:42:57 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:16.715 rmmod nvme_tcp 00:26:16.715 rmmod nvme_fabrics 00:26:16.715 rmmod nvme_keyring 00:26:16.715 03:42:57 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:16.715 03:42:57 -- nvmf/common.sh@123 -- # set -e 00:26:16.715 03:42:57 -- nvmf/common.sh@124 -- # return 0 00:26:16.715 03:42:57 -- nvmf/common.sh@477 -- # '[' -n 3156403 ']' 00:26:16.715 03:42:57 -- nvmf/common.sh@478 -- # killprocess 3156403 00:26:16.715 03:42:57 -- common/autotest_common.sh@936 -- # '[' -z 3156403 ']' 00:26:16.715 03:42:57 -- common/autotest_common.sh@940 -- # kill -0 3156403 00:26:16.715 03:42:57 -- common/autotest_common.sh@941 -- # uname 00:26:16.715 03:42:57 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:16.715 03:42:57 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3156403 00:26:16.715 03:42:57 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:16.715 03:42:57 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:16.715 03:42:57 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3156403' 00:26:16.715 killing process with pid 3156403 00:26:16.715 03:42:57 -- common/autotest_common.sh@955 -- # kill 3156403 00:26:16.715 03:42:57 -- common/autotest_common.sh@960 -- # wait 3156403 00:26:16.973 03:42:57 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:16.973 03:42:57 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:16.973 03:42:57 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:16.973 03:42:57 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:16.973 03:42:57 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:16.973 03:42:57 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:16.973 03:42:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:16.973 03:42:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:18.881 03:42:59 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:18.881 00:26:18.881 real 0m17.639s 00:26:18.881 user 0m27.348s 00:26:18.881 sys 0m2.934s 00:26:18.881 03:42:59 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:18.881 03:42:59 -- common/autotest_common.sh@10 -- # set +x 00:26:18.881 ************************************ 00:26:18.881 END TEST nvmf_discovery 00:26:18.881 ************************************ 00:26:18.881 03:42:59 -- nvmf/nvmf.sh@102 -- # run_test nvmf_discovery_remove_ifc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:26:18.881 03:42:59 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:18.881 03:42:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:18.881 03:42:59 -- common/autotest_common.sh@10 -- # set +x 00:26:18.881 ************************************ 00:26:18.881 START TEST nvmf_discovery_remove_ifc 00:26:18.881 ************************************ 00:26:18.881 03:42:59 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:26:19.140 * Looking for test storage... 00:26:19.140 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:19.140 03:42:59 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:26:19.140 03:42:59 -- common/autotest_common.sh@1690 -- # lcov --version 00:26:19.140 03:42:59 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:26:19.140 03:42:59 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:26:19.140 03:42:59 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:26:19.140 03:42:59 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:26:19.140 03:42:59 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:26:19.140 03:42:59 -- scripts/common.sh@335 -- # IFS=.-: 00:26:19.140 03:42:59 -- scripts/common.sh@335 -- # read -ra ver1 00:26:19.140 03:42:59 -- scripts/common.sh@336 -- # IFS=.-: 00:26:19.140 03:42:59 -- scripts/common.sh@336 -- # read -ra ver2 00:26:19.140 03:42:59 -- scripts/common.sh@337 -- # local 'op=<' 00:26:19.140 03:42:59 -- scripts/common.sh@339 -- # ver1_l=2 00:26:19.140 03:42:59 -- scripts/common.sh@340 -- # ver2_l=1 00:26:19.140 03:42:59 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:26:19.140 03:42:59 -- scripts/common.sh@343 -- # case "$op" in 00:26:19.140 03:42:59 -- scripts/common.sh@344 -- # : 1 00:26:19.140 03:42:59 -- scripts/common.sh@363 -- # (( v = 0 )) 00:26:19.140 03:42:59 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:26:19.140 03:42:59 -- scripts/common.sh@364 -- # decimal 1 00:26:19.140 03:42:59 -- scripts/common.sh@352 -- # local d=1 00:26:19.140 03:42:59 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:26:19.140 03:42:59 -- scripts/common.sh@354 -- # echo 1 00:26:19.140 03:42:59 -- scripts/common.sh@364 -- # ver1[v]=1 00:26:19.140 03:42:59 -- scripts/common.sh@365 -- # decimal 2 00:26:19.140 03:42:59 -- scripts/common.sh@352 -- # local d=2 00:26:19.140 03:42:59 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:26:19.140 03:42:59 -- scripts/common.sh@354 -- # echo 2 00:26:19.140 03:42:59 -- scripts/common.sh@365 -- # ver2[v]=2 00:26:19.140 03:42:59 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:26:19.140 03:42:59 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:26:19.140 03:42:59 -- scripts/common.sh@367 -- # return 0 00:26:19.140 03:42:59 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:26:19.140 03:42:59 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:26:19.140 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:19.140 --rc genhtml_branch_coverage=1 00:26:19.140 --rc genhtml_function_coverage=1 00:26:19.140 --rc genhtml_legend=1 00:26:19.140 --rc geninfo_all_blocks=1 00:26:19.140 --rc geninfo_unexecuted_blocks=1 00:26:19.140 00:26:19.140 ' 00:26:19.140 03:42:59 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:26:19.140 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:19.140 --rc genhtml_branch_coverage=1 00:26:19.140 --rc genhtml_function_coverage=1 00:26:19.140 --rc genhtml_legend=1 00:26:19.140 --rc geninfo_all_blocks=1 00:26:19.140 --rc geninfo_unexecuted_blocks=1 00:26:19.140 00:26:19.140 ' 00:26:19.140 03:42:59 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:26:19.140 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:19.140 --rc genhtml_branch_coverage=1 00:26:19.140 --rc genhtml_function_coverage=1 00:26:19.140 --rc genhtml_legend=1 00:26:19.140 --rc geninfo_all_blocks=1 00:26:19.140 --rc geninfo_unexecuted_blocks=1 00:26:19.140 00:26:19.140 ' 00:26:19.140 03:42:59 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:26:19.140 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:19.140 --rc genhtml_branch_coverage=1 00:26:19.140 --rc genhtml_function_coverage=1 00:26:19.140 --rc genhtml_legend=1 00:26:19.140 --rc geninfo_all_blocks=1 00:26:19.140 --rc geninfo_unexecuted_blocks=1 00:26:19.140 00:26:19.140 ' 00:26:19.140 03:42:59 -- host/discovery_remove_ifc.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:19.140 03:42:59 -- nvmf/common.sh@7 -- # uname -s 00:26:19.140 03:42:59 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:19.140 03:42:59 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:19.140 03:42:59 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:19.140 03:42:59 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:19.140 03:42:59 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:19.140 03:42:59 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:19.140 03:42:59 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:19.140 03:42:59 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:19.140 03:42:59 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:19.140 03:42:59 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:19.140 03:42:59 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:19.140 03:42:59 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:19.140 03:42:59 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:19.140 03:42:59 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:19.140 03:42:59 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:19.140 03:42:59 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:19.140 03:42:59 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:19.140 03:42:59 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:19.140 03:42:59 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:19.140 03:42:59 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:19.140 03:42:59 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:19.140 03:42:59 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:19.140 03:42:59 -- paths/export.sh@5 -- # export PATH 00:26:19.141 03:42:59 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:19.141 03:42:59 -- nvmf/common.sh@46 -- # : 0 00:26:19.141 03:42:59 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:19.141 03:42:59 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:19.141 03:42:59 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:19.141 03:42:59 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:19.141 03:42:59 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:19.141 03:42:59 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:19.141 03:42:59 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:19.141 03:42:59 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:19.141 03:42:59 -- host/discovery_remove_ifc.sh@14 -- # '[' tcp == rdma ']' 00:26:19.141 03:42:59 -- host/discovery_remove_ifc.sh@19 -- # discovery_port=8009 00:26:19.141 03:42:59 -- host/discovery_remove_ifc.sh@20 -- # discovery_nqn=nqn.2014-08.org.nvmexpress.discovery 00:26:19.141 03:42:59 -- host/discovery_remove_ifc.sh@23 -- # nqn=nqn.2016-06.io.spdk:cnode 00:26:19.141 03:42:59 -- host/discovery_remove_ifc.sh@25 -- # host_nqn=nqn.2021-12.io.spdk:test 00:26:19.141 03:42:59 -- host/discovery_remove_ifc.sh@26 -- # host_sock=/tmp/host.sock 00:26:19.141 03:42:59 -- host/discovery_remove_ifc.sh@39 -- # nvmftestinit 00:26:19.141 03:42:59 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:19.141 03:42:59 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:19.141 03:42:59 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:19.141 03:42:59 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:19.141 03:42:59 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:19.141 03:42:59 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:19.141 03:42:59 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:19.141 03:42:59 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:19.141 03:42:59 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:19.141 03:42:59 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:19.141 03:42:59 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:19.141 03:42:59 -- common/autotest_common.sh@10 -- # set +x 00:26:21.048 03:43:01 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:21.048 03:43:01 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:21.048 03:43:01 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:21.048 03:43:01 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:21.048 03:43:01 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:21.048 03:43:01 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:21.048 03:43:01 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:21.048 03:43:01 -- nvmf/common.sh@294 -- # net_devs=() 00:26:21.048 03:43:01 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:21.048 03:43:01 -- nvmf/common.sh@295 -- # e810=() 00:26:21.048 03:43:01 -- nvmf/common.sh@295 -- # local -ga e810 00:26:21.048 03:43:01 -- nvmf/common.sh@296 -- # x722=() 00:26:21.049 03:43:01 -- nvmf/common.sh@296 -- # local -ga x722 00:26:21.049 03:43:01 -- nvmf/common.sh@297 -- # mlx=() 00:26:21.049 03:43:01 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:21.049 03:43:01 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:21.049 03:43:01 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:21.049 03:43:01 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:21.049 03:43:01 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:21.049 03:43:01 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:21.049 03:43:01 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:21.049 03:43:01 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:21.049 03:43:01 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:21.049 03:43:01 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:21.049 03:43:01 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:21.049 03:43:01 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:21.049 03:43:01 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:21.049 03:43:01 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:21.049 03:43:01 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:21.049 03:43:01 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:21.049 03:43:01 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:21.049 03:43:01 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:21.049 03:43:01 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:21.049 03:43:01 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:21.049 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:21.049 03:43:01 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:21.049 03:43:01 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:21.049 03:43:01 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:21.049 03:43:01 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:21.049 03:43:01 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:21.049 03:43:01 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:21.049 03:43:01 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:21.049 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:21.049 03:43:01 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:21.049 03:43:01 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:21.049 03:43:01 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:21.049 03:43:01 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:21.049 03:43:01 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:21.049 03:43:01 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:21.049 03:43:01 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:21.049 03:43:01 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:21.049 03:43:01 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:21.049 03:43:01 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:21.049 03:43:01 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:21.049 03:43:01 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:21.049 03:43:01 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:21.049 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:21.049 03:43:01 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:21.049 03:43:01 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:21.049 03:43:01 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:21.049 03:43:01 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:21.049 03:43:01 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:21.049 03:43:01 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:21.049 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:21.049 03:43:01 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:21.049 03:43:01 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:21.049 03:43:01 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:21.049 03:43:01 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:21.049 03:43:01 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:21.049 03:43:01 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:21.049 03:43:01 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:21.049 03:43:01 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:21.049 03:43:01 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:21.049 03:43:01 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:21.049 03:43:01 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:21.049 03:43:01 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:21.049 03:43:01 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:21.049 03:43:01 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:21.049 03:43:01 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:21.049 03:43:01 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:21.049 03:43:01 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:21.049 03:43:01 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:21.049 03:43:01 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:21.049 03:43:01 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:21.049 03:43:01 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:21.049 03:43:01 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:21.049 03:43:01 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:21.307 03:43:01 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:21.307 03:43:01 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:21.307 03:43:01 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:21.307 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:21.307 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.304 ms 00:26:21.307 00:26:21.307 --- 10.0.0.2 ping statistics --- 00:26:21.307 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:21.307 rtt min/avg/max/mdev = 0.304/0.304/0.304/0.000 ms 00:26:21.307 03:43:01 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:21.307 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:21.307 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.099 ms 00:26:21.307 00:26:21.307 --- 10.0.0.1 ping statistics --- 00:26:21.307 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:21.307 rtt min/avg/max/mdev = 0.099/0.099/0.099/0.000 ms 00:26:21.307 03:43:01 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:21.307 03:43:01 -- nvmf/common.sh@410 -- # return 0 00:26:21.307 03:43:01 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:21.307 03:43:01 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:21.307 03:43:01 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:21.307 03:43:01 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:21.307 03:43:01 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:21.307 03:43:01 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:21.307 03:43:01 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:21.307 03:43:01 -- host/discovery_remove_ifc.sh@40 -- # nvmfappstart -m 0x2 00:26:21.307 03:43:01 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:21.307 03:43:01 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:21.307 03:43:01 -- common/autotest_common.sh@10 -- # set +x 00:26:21.307 03:43:01 -- nvmf/common.sh@469 -- # nvmfpid=3160040 00:26:21.307 03:43:01 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:26:21.307 03:43:01 -- nvmf/common.sh@470 -- # waitforlisten 3160040 00:26:21.307 03:43:01 -- common/autotest_common.sh@829 -- # '[' -z 3160040 ']' 00:26:21.307 03:43:01 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:21.307 03:43:01 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:21.307 03:43:01 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:21.307 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:21.307 03:43:01 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:21.307 03:43:01 -- common/autotest_common.sh@10 -- # set +x 00:26:21.308 [2024-11-21 03:43:01.803012] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:21.308 [2024-11-21 03:43:01.803105] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:21.308 EAL: No free 2048 kB hugepages reported on node 1 00:26:21.308 [2024-11-21 03:43:01.877150] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:21.568 [2024-11-21 03:43:01.997547] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:21.568 [2024-11-21 03:43:01.997711] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:21.568 [2024-11-21 03:43:01.997732] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:21.568 [2024-11-21 03:43:01.997747] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:21.568 [2024-11-21 03:43:01.997776] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:22.138 03:43:02 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:22.138 03:43:02 -- common/autotest_common.sh@862 -- # return 0 00:26:22.138 03:43:02 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:22.138 03:43:02 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:22.138 03:43:02 -- common/autotest_common.sh@10 -- # set +x 00:26:22.397 03:43:02 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:22.397 03:43:02 -- host/discovery_remove_ifc.sh@43 -- # rpc_cmd 00:26:22.397 03:43:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:22.397 03:43:02 -- common/autotest_common.sh@10 -- # set +x 00:26:22.397 [2024-11-21 03:43:02.801836] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:22.397 [2024-11-21 03:43:02.810043] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:26:22.397 null0 00:26:22.397 [2024-11-21 03:43:02.841989] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:22.397 03:43:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:22.397 03:43:02 -- host/discovery_remove_ifc.sh@59 -- # hostpid=3160196 00:26:22.397 03:43:02 -- host/discovery_remove_ifc.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock --wait-for-rpc -L bdev_nvme 00:26:22.397 03:43:02 -- host/discovery_remove_ifc.sh@60 -- # waitforlisten 3160196 /tmp/host.sock 00:26:22.397 03:43:02 -- common/autotest_common.sh@829 -- # '[' -z 3160196 ']' 00:26:22.397 03:43:02 -- common/autotest_common.sh@833 -- # local rpc_addr=/tmp/host.sock 00:26:22.397 03:43:02 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:22.397 03:43:02 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:26:22.397 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:26:22.397 03:43:02 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:22.397 03:43:02 -- common/autotest_common.sh@10 -- # set +x 00:26:22.397 [2024-11-21 03:43:02.905191] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:22.397 [2024-11-21 03:43:02.905267] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3160196 ] 00:26:22.397 EAL: No free 2048 kB hugepages reported on node 1 00:26:22.397 [2024-11-21 03:43:02.972001] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:22.655 [2024-11-21 03:43:03.089747] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:22.655 [2024-11-21 03:43:03.089950] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:22.655 03:43:03 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:22.655 03:43:03 -- common/autotest_common.sh@862 -- # return 0 00:26:22.655 03:43:03 -- host/discovery_remove_ifc.sh@62 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:26:22.655 03:43:03 -- host/discovery_remove_ifc.sh@65 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_set_options -e 1 00:26:22.655 03:43:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:22.655 03:43:03 -- common/autotest_common.sh@10 -- # set +x 00:26:22.655 03:43:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:22.655 03:43:03 -- host/discovery_remove_ifc.sh@66 -- # rpc_cmd -s /tmp/host.sock framework_start_init 00:26:22.655 03:43:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:22.655 03:43:03 -- common/autotest_common.sh@10 -- # set +x 00:26:22.655 03:43:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:22.655 03:43:03 -- host/discovery_remove_ifc.sh@69 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test --ctrlr-loss-timeout-sec 2 --reconnect-delay-sec 1 --fast-io-fail-timeout-sec 1 --wait-for-attach 00:26:22.655 03:43:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:22.655 03:43:03 -- common/autotest_common.sh@10 -- # set +x 00:26:24.032 [2024-11-21 03:43:04.309218] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:26:24.032 [2024-11-21 03:43:04.309247] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:26:24.032 [2024-11-21 03:43:04.309269] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:24.032 [2024-11-21 03:43:04.395539] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:26:24.032 [2024-11-21 03:43:04.573623] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:26:24.032 [2024-11-21 03:43:04.573680] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:26:24.032 [2024-11-21 03:43:04.573725] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:26:24.032 [2024-11-21 03:43:04.573750] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:26:24.032 [2024-11-21 03:43:04.573776] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:26:24.032 03:43:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:24.032 03:43:04 -- host/discovery_remove_ifc.sh@72 -- # wait_for_bdev nvme0n1 00:26:24.032 03:43:04 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:24.032 03:43:04 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:24.032 03:43:04 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:24.032 [2024-11-21 03:43:04.578059] bdev_nvme.c:1595:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0xcd8d40 was disconnected and freed. delete nvme_qpair. 00:26:24.032 03:43:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:24.032 03:43:04 -- common/autotest_common.sh@10 -- # set +x 00:26:24.032 03:43:04 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:24.032 03:43:04 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:24.032 03:43:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:24.032 03:43:04 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != \n\v\m\e\0\n\1 ]] 00:26:24.032 03:43:04 -- host/discovery_remove_ifc.sh@75 -- # ip netns exec cvl_0_0_ns_spdk ip addr del 10.0.0.2/24 dev cvl_0_0 00:26:24.032 03:43:04 -- host/discovery_remove_ifc.sh@76 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 down 00:26:24.032 03:43:04 -- host/discovery_remove_ifc.sh@79 -- # wait_for_bdev '' 00:26:24.032 03:43:04 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:24.032 03:43:04 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:24.032 03:43:04 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:24.032 03:43:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:24.032 03:43:04 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:24.032 03:43:04 -- common/autotest_common.sh@10 -- # set +x 00:26:24.032 03:43:04 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:24.032 03:43:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:24.291 03:43:04 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:24.291 03:43:04 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:25.228 03:43:05 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:25.228 03:43:05 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:25.228 03:43:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:25.228 03:43:05 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:25.228 03:43:05 -- common/autotest_common.sh@10 -- # set +x 00:26:25.228 03:43:05 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:25.228 03:43:05 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:25.228 03:43:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:25.228 03:43:05 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:25.228 03:43:05 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:26.164 03:43:06 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:26.164 03:43:06 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:26.164 03:43:06 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:26.164 03:43:06 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:26.164 03:43:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:26.164 03:43:06 -- common/autotest_common.sh@10 -- # set +x 00:26:26.164 03:43:06 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:26.164 03:43:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:26.164 03:43:06 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:26.164 03:43:06 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:27.543 03:43:07 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:27.543 03:43:07 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:27.543 03:43:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:27.543 03:43:07 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:27.543 03:43:07 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:27.543 03:43:07 -- common/autotest_common.sh@10 -- # set +x 00:26:27.543 03:43:07 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:27.543 03:43:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:27.543 03:43:07 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:27.543 03:43:07 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:28.481 03:43:08 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:28.481 03:43:08 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:28.481 03:43:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:28.481 03:43:08 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:28.481 03:43:08 -- common/autotest_common.sh@10 -- # set +x 00:26:28.481 03:43:08 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:28.481 03:43:08 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:28.481 03:43:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:28.481 03:43:08 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:28.481 03:43:08 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:29.418 03:43:09 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:29.418 03:43:09 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:29.418 03:43:09 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:29.418 03:43:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:29.418 03:43:09 -- common/autotest_common.sh@10 -- # set +x 00:26:29.418 03:43:09 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:29.418 03:43:09 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:29.418 03:43:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:29.418 03:43:09 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:29.418 03:43:09 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:29.418 [2024-11-21 03:43:10.014733] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 110: Connection timed out 00:26:29.418 [2024-11-21 03:43:10.014814] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:29.418 [2024-11-21 03:43:10.014839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:29.418 [2024-11-21 03:43:10.014860] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:29.418 [2024-11-21 03:43:10.014876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:29.418 [2024-11-21 03:43:10.014891] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:29.418 [2024-11-21 03:43:10.014906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:29.418 [2024-11-21 03:43:10.014923] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:29.418 [2024-11-21 03:43:10.014938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:29.418 [2024-11-21 03:43:10.014955] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:26:29.418 [2024-11-21 03:43:10.014971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:29.418 [2024-11-21 03:43:10.014991] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc9f430 is same with the state(5) to be set 00:26:29.418 [2024-11-21 03:43:10.024745] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc9f430 (9): Bad file descriptor 00:26:29.418 [2024-11-21 03:43:10.034800] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:30.354 03:43:10 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:30.354 03:43:10 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:30.354 03:43:10 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:30.354 03:43:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:30.354 03:43:10 -- common/autotest_common.sh@10 -- # set +x 00:26:30.354 03:43:10 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:30.354 03:43:10 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:30.613 [2024-11-21 03:43:11.039125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:26:31.551 [2024-11-21 03:43:12.063133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:26:31.552 [2024-11-21 03:43:12.063201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc9f430 with addr=10.0.0.2, port=4420 00:26:31.552 [2024-11-21 03:43:12.063241] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc9f430 is same with the state(5) to be set 00:26:31.552 [2024-11-21 03:43:12.063274] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:31.552 [2024-11-21 03:43:12.063290] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:31.552 [2024-11-21 03:43:12.063303] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:31.552 [2024-11-21 03:43:12.063316] nvme_ctrlr.c:1017:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] already in failed state 00:26:31.552 [2024-11-21 03:43:12.063717] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc9f430 (9): Bad file descriptor 00:26:31.552 [2024-11-21 03:43:12.063755] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:31.552 [2024-11-21 03:43:12.063789] bdev_nvme.c:6510:remove_discovery_entry: *INFO*: Discovery[10.0.0.2:8009] Remove discovery entry: nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 00:26:31.552 [2024-11-21 03:43:12.063840] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:31.552 [2024-11-21 03:43:12.063866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:31.552 [2024-11-21 03:43:12.063884] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:31.552 [2024-11-21 03:43:12.063897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:31.552 [2024-11-21 03:43:12.063910] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:31.552 [2024-11-21 03:43:12.063922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:31.552 [2024-11-21 03:43:12.063935] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:31.552 [2024-11-21 03:43:12.063947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:31.552 [2024-11-21 03:43:12.063960] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:26:31.552 [2024-11-21 03:43:12.063971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:31.552 [2024-11-21 03:43:12.063984] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] in failed state. 00:26:31.552 [2024-11-21 03:43:12.064275] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc9f840 (9): Bad file descriptor 00:26:31.552 [2024-11-21 03:43:12.065293] nvme_fabric.c: 214:nvme_fabric_prop_get_cmd_async: *ERROR*: Failed to send Property Get fabrics command 00:26:31.552 [2024-11-21 03:43:12.065315] nvme_ctrlr.c:1136:nvme_ctrlr_shutdown_async: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] Failed to read the CC register 00:26:31.552 03:43:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:31.552 03:43:12 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:31.552 03:43:12 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:32.486 03:43:13 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:32.486 03:43:13 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:32.486 03:43:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:32.486 03:43:13 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:32.486 03:43:13 -- common/autotest_common.sh@10 -- # set +x 00:26:32.486 03:43:13 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:32.486 03:43:13 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:32.486 03:43:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:32.486 03:43:13 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != '' ]] 00:26:32.486 03:43:13 -- host/discovery_remove_ifc.sh@82 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:32.486 03:43:13 -- host/discovery_remove_ifc.sh@83 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:32.745 03:43:13 -- host/discovery_remove_ifc.sh@86 -- # wait_for_bdev nvme1n1 00:26:32.745 03:43:13 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:32.745 03:43:13 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:32.745 03:43:13 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:32.745 03:43:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:32.745 03:43:13 -- common/autotest_common.sh@10 -- # set +x 00:26:32.745 03:43:13 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:32.745 03:43:13 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:32.745 03:43:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:32.745 03:43:13 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != \n\v\m\e\1\n\1 ]] 00:26:32.745 03:43:13 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:33.682 [2024-11-21 03:43:14.116785] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:26:33.682 [2024-11-21 03:43:14.116811] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:26:33.682 [2024-11-21 03:43:14.116835] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:33.682 [2024-11-21 03:43:14.245259] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme1 00:26:33.682 03:43:14 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:33.682 03:43:14 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:33.682 03:43:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:33.682 03:43:14 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:33.682 03:43:14 -- common/autotest_common.sh@10 -- # set +x 00:26:33.682 03:43:14 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:33.682 03:43:14 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:33.682 03:43:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:33.940 03:43:14 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != \n\v\m\e\1\n\1 ]] 00:26:33.940 03:43:14 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:33.940 [2024-11-21 03:43:14.346229] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:26:33.940 [2024-11-21 03:43:14.346274] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:26:33.940 [2024-11-21 03:43:14.346305] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:26:33.940 [2024-11-21 03:43:14.346324] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme1 done 00:26:33.940 [2024-11-21 03:43:14.346336] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:26:33.940 [2024-11-21 03:43:14.354392] bdev_nvme.c:1595:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0xcadef0 was disconnected and freed. delete nvme_qpair. 00:26:34.876 03:43:15 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:34.876 03:43:15 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:34.876 03:43:15 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:34.876 03:43:15 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:34.876 03:43:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:34.876 03:43:15 -- common/autotest_common.sh@10 -- # set +x 00:26:34.876 03:43:15 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:34.876 03:43:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:34.876 03:43:15 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme1n1 != \n\v\m\e\1\n\1 ]] 00:26:34.876 03:43:15 -- host/discovery_remove_ifc.sh@88 -- # trap - SIGINT SIGTERM EXIT 00:26:34.876 03:43:15 -- host/discovery_remove_ifc.sh@90 -- # killprocess 3160196 00:26:34.876 03:43:15 -- common/autotest_common.sh@936 -- # '[' -z 3160196 ']' 00:26:34.876 03:43:15 -- common/autotest_common.sh@940 -- # kill -0 3160196 00:26:34.876 03:43:15 -- common/autotest_common.sh@941 -- # uname 00:26:34.876 03:43:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:34.876 03:43:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3160196 00:26:34.876 03:43:15 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:26:34.876 03:43:15 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:26:34.876 03:43:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3160196' 00:26:34.876 killing process with pid 3160196 00:26:34.876 03:43:15 -- common/autotest_common.sh@955 -- # kill 3160196 00:26:34.876 03:43:15 -- common/autotest_common.sh@960 -- # wait 3160196 00:26:35.137 03:43:15 -- host/discovery_remove_ifc.sh@91 -- # nvmftestfini 00:26:35.137 03:43:15 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:35.137 03:43:15 -- nvmf/common.sh@116 -- # sync 00:26:35.137 03:43:15 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:35.137 03:43:15 -- nvmf/common.sh@119 -- # set +e 00:26:35.137 03:43:15 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:35.137 03:43:15 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:35.137 rmmod nvme_tcp 00:26:35.137 rmmod nvme_fabrics 00:26:35.137 rmmod nvme_keyring 00:26:35.137 03:43:15 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:35.137 03:43:15 -- nvmf/common.sh@123 -- # set -e 00:26:35.137 03:43:15 -- nvmf/common.sh@124 -- # return 0 00:26:35.137 03:43:15 -- nvmf/common.sh@477 -- # '[' -n 3160040 ']' 00:26:35.137 03:43:15 -- nvmf/common.sh@478 -- # killprocess 3160040 00:26:35.137 03:43:15 -- common/autotest_common.sh@936 -- # '[' -z 3160040 ']' 00:26:35.137 03:43:15 -- common/autotest_common.sh@940 -- # kill -0 3160040 00:26:35.137 03:43:15 -- common/autotest_common.sh@941 -- # uname 00:26:35.137 03:43:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:35.137 03:43:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3160040 00:26:35.137 03:43:15 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:35.137 03:43:15 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:35.137 03:43:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3160040' 00:26:35.137 killing process with pid 3160040 00:26:35.137 03:43:15 -- common/autotest_common.sh@955 -- # kill 3160040 00:26:35.137 03:43:15 -- common/autotest_common.sh@960 -- # wait 3160040 00:26:35.703 03:43:16 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:35.703 03:43:16 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:35.703 03:43:16 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:35.703 03:43:16 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:35.703 03:43:16 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:35.703 03:43:16 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:35.703 03:43:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:35.703 03:43:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:37.611 03:43:18 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:37.611 00:26:37.611 real 0m18.591s 00:26:37.611 user 0m26.034s 00:26:37.611 sys 0m2.862s 00:26:37.611 03:43:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:37.611 03:43:18 -- common/autotest_common.sh@10 -- # set +x 00:26:37.611 ************************************ 00:26:37.611 END TEST nvmf_discovery_remove_ifc 00:26:37.611 ************************************ 00:26:37.611 03:43:18 -- nvmf/nvmf.sh@106 -- # [[ tcp == \t\c\p ]] 00:26:37.611 03:43:18 -- nvmf/nvmf.sh@107 -- # run_test nvmf_digest /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:26:37.611 03:43:18 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:37.611 03:43:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:37.611 03:43:18 -- common/autotest_common.sh@10 -- # set +x 00:26:37.611 ************************************ 00:26:37.611 START TEST nvmf_digest 00:26:37.611 ************************************ 00:26:37.611 03:43:18 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:26:37.611 * Looking for test storage... 00:26:37.611 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:37.611 03:43:18 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:26:37.611 03:43:18 -- common/autotest_common.sh@1690 -- # lcov --version 00:26:37.611 03:43:18 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:26:37.611 03:43:18 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:26:37.611 03:43:18 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:26:37.611 03:43:18 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:26:37.611 03:43:18 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:26:37.611 03:43:18 -- scripts/common.sh@335 -- # IFS=.-: 00:26:37.611 03:43:18 -- scripts/common.sh@335 -- # read -ra ver1 00:26:37.611 03:43:18 -- scripts/common.sh@336 -- # IFS=.-: 00:26:37.611 03:43:18 -- scripts/common.sh@336 -- # read -ra ver2 00:26:37.611 03:43:18 -- scripts/common.sh@337 -- # local 'op=<' 00:26:37.611 03:43:18 -- scripts/common.sh@339 -- # ver1_l=2 00:26:37.611 03:43:18 -- scripts/common.sh@340 -- # ver2_l=1 00:26:37.611 03:43:18 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:26:37.611 03:43:18 -- scripts/common.sh@343 -- # case "$op" in 00:26:37.611 03:43:18 -- scripts/common.sh@344 -- # : 1 00:26:37.611 03:43:18 -- scripts/common.sh@363 -- # (( v = 0 )) 00:26:37.611 03:43:18 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:26:37.611 03:43:18 -- scripts/common.sh@364 -- # decimal 1 00:26:37.611 03:43:18 -- scripts/common.sh@352 -- # local d=1 00:26:37.611 03:43:18 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:26:37.611 03:43:18 -- scripts/common.sh@354 -- # echo 1 00:26:37.611 03:43:18 -- scripts/common.sh@364 -- # ver1[v]=1 00:26:37.611 03:43:18 -- scripts/common.sh@365 -- # decimal 2 00:26:37.870 03:43:18 -- scripts/common.sh@352 -- # local d=2 00:26:37.870 03:43:18 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:26:37.870 03:43:18 -- scripts/common.sh@354 -- # echo 2 00:26:37.870 03:43:18 -- scripts/common.sh@365 -- # ver2[v]=2 00:26:37.870 03:43:18 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:26:37.870 03:43:18 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:26:37.870 03:43:18 -- scripts/common.sh@367 -- # return 0 00:26:37.870 03:43:18 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:26:37.870 03:43:18 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:26:37.870 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:37.870 --rc genhtml_branch_coverage=1 00:26:37.870 --rc genhtml_function_coverage=1 00:26:37.870 --rc genhtml_legend=1 00:26:37.870 --rc geninfo_all_blocks=1 00:26:37.870 --rc geninfo_unexecuted_blocks=1 00:26:37.870 00:26:37.870 ' 00:26:37.870 03:43:18 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:26:37.870 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:37.870 --rc genhtml_branch_coverage=1 00:26:37.870 --rc genhtml_function_coverage=1 00:26:37.870 --rc genhtml_legend=1 00:26:37.870 --rc geninfo_all_blocks=1 00:26:37.870 --rc geninfo_unexecuted_blocks=1 00:26:37.870 00:26:37.870 ' 00:26:37.870 03:43:18 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:26:37.870 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:37.870 --rc genhtml_branch_coverage=1 00:26:37.870 --rc genhtml_function_coverage=1 00:26:37.870 --rc genhtml_legend=1 00:26:37.870 --rc geninfo_all_blocks=1 00:26:37.870 --rc geninfo_unexecuted_blocks=1 00:26:37.870 00:26:37.870 ' 00:26:37.870 03:43:18 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:26:37.870 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:37.870 --rc genhtml_branch_coverage=1 00:26:37.870 --rc genhtml_function_coverage=1 00:26:37.870 --rc genhtml_legend=1 00:26:37.870 --rc geninfo_all_blocks=1 00:26:37.870 --rc geninfo_unexecuted_blocks=1 00:26:37.870 00:26:37.870 ' 00:26:37.870 03:43:18 -- host/digest.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:37.870 03:43:18 -- nvmf/common.sh@7 -- # uname -s 00:26:37.870 03:43:18 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:37.870 03:43:18 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:37.870 03:43:18 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:37.870 03:43:18 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:37.870 03:43:18 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:37.870 03:43:18 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:37.870 03:43:18 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:37.870 03:43:18 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:37.870 03:43:18 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:37.870 03:43:18 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:37.870 03:43:18 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:37.870 03:43:18 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:37.870 03:43:18 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:37.870 03:43:18 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:37.870 03:43:18 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:37.870 03:43:18 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:37.870 03:43:18 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:37.870 03:43:18 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:37.870 03:43:18 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:37.870 03:43:18 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:37.870 03:43:18 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:37.870 03:43:18 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:37.870 03:43:18 -- paths/export.sh@5 -- # export PATH 00:26:37.870 03:43:18 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:37.870 03:43:18 -- nvmf/common.sh@46 -- # : 0 00:26:37.870 03:43:18 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:37.870 03:43:18 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:37.870 03:43:18 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:37.870 03:43:18 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:37.870 03:43:18 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:37.870 03:43:18 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:37.870 03:43:18 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:37.870 03:43:18 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:37.870 03:43:18 -- host/digest.sh@14 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:26:37.870 03:43:18 -- host/digest.sh@15 -- # bperfsock=/var/tmp/bperf.sock 00:26:37.870 03:43:18 -- host/digest.sh@16 -- # runtime=2 00:26:37.870 03:43:18 -- host/digest.sh@130 -- # [[ tcp != \t\c\p ]] 00:26:37.870 03:43:18 -- host/digest.sh@132 -- # nvmftestinit 00:26:37.870 03:43:18 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:37.870 03:43:18 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:37.870 03:43:18 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:37.870 03:43:18 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:37.870 03:43:18 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:37.870 03:43:18 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:37.870 03:43:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:37.870 03:43:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:37.870 03:43:18 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:37.870 03:43:18 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:37.870 03:43:18 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:37.870 03:43:18 -- common/autotest_common.sh@10 -- # set +x 00:26:39.779 03:43:20 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:39.779 03:43:20 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:39.779 03:43:20 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:39.779 03:43:20 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:39.779 03:43:20 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:39.779 03:43:20 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:39.779 03:43:20 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:39.779 03:43:20 -- nvmf/common.sh@294 -- # net_devs=() 00:26:39.779 03:43:20 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:39.779 03:43:20 -- nvmf/common.sh@295 -- # e810=() 00:26:39.779 03:43:20 -- nvmf/common.sh@295 -- # local -ga e810 00:26:39.779 03:43:20 -- nvmf/common.sh@296 -- # x722=() 00:26:39.779 03:43:20 -- nvmf/common.sh@296 -- # local -ga x722 00:26:39.779 03:43:20 -- nvmf/common.sh@297 -- # mlx=() 00:26:39.779 03:43:20 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:39.779 03:43:20 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:39.779 03:43:20 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:39.779 03:43:20 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:39.779 03:43:20 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:39.779 03:43:20 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:39.779 03:43:20 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:39.779 03:43:20 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:39.779 03:43:20 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:39.779 03:43:20 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:39.779 03:43:20 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:39.779 03:43:20 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:39.779 03:43:20 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:39.779 03:43:20 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:39.779 03:43:20 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:39.779 03:43:20 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:39.779 03:43:20 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:39.779 03:43:20 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:39.780 03:43:20 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:39.780 03:43:20 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:39.780 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:39.780 03:43:20 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:39.780 03:43:20 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:39.780 03:43:20 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:39.780 03:43:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:39.780 03:43:20 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:39.780 03:43:20 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:39.780 03:43:20 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:39.780 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:39.780 03:43:20 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:39.780 03:43:20 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:39.780 03:43:20 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:39.780 03:43:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:39.780 03:43:20 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:39.780 03:43:20 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:39.780 03:43:20 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:39.780 03:43:20 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:39.780 03:43:20 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:39.780 03:43:20 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:39.780 03:43:20 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:39.780 03:43:20 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:39.780 03:43:20 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:39.780 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:39.780 03:43:20 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:39.780 03:43:20 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:39.780 03:43:20 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:39.780 03:43:20 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:39.780 03:43:20 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:39.780 03:43:20 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:39.780 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:39.780 03:43:20 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:39.780 03:43:20 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:39.780 03:43:20 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:39.780 03:43:20 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:39.780 03:43:20 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:39.780 03:43:20 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:39.780 03:43:20 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:39.780 03:43:20 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:39.780 03:43:20 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:39.780 03:43:20 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:39.780 03:43:20 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:39.780 03:43:20 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:39.780 03:43:20 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:39.780 03:43:20 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:39.780 03:43:20 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:39.780 03:43:20 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:39.780 03:43:20 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:39.780 03:43:20 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:39.780 03:43:20 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:39.780 03:43:20 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:39.780 03:43:20 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:39.780 03:43:20 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:39.780 03:43:20 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:39.780 03:43:20 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:39.780 03:43:20 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:39.780 03:43:20 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:39.780 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:39.780 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.362 ms 00:26:39.780 00:26:39.780 --- 10.0.0.2 ping statistics --- 00:26:39.780 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:39.780 rtt min/avg/max/mdev = 0.362/0.362/0.362/0.000 ms 00:26:39.780 03:43:20 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:39.780 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:39.780 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.120 ms 00:26:39.780 00:26:39.780 --- 10.0.0.1 ping statistics --- 00:26:39.780 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:39.780 rtt min/avg/max/mdev = 0.120/0.120/0.120/0.000 ms 00:26:39.780 03:43:20 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:39.780 03:43:20 -- nvmf/common.sh@410 -- # return 0 00:26:39.780 03:43:20 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:39.780 03:43:20 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:39.780 03:43:20 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:39.780 03:43:20 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:39.780 03:43:20 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:39.780 03:43:20 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:39.780 03:43:20 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:39.780 03:43:20 -- host/digest.sh@134 -- # trap cleanup SIGINT SIGTERM EXIT 00:26:39.780 03:43:20 -- host/digest.sh@135 -- # run_test nvmf_digest_clean run_digest 00:26:39.780 03:43:20 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:26:39.780 03:43:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:39.780 03:43:20 -- common/autotest_common.sh@10 -- # set +x 00:26:39.780 ************************************ 00:26:39.780 START TEST nvmf_digest_clean 00:26:39.780 ************************************ 00:26:39.780 03:43:20 -- common/autotest_common.sh@1114 -- # run_digest 00:26:39.780 03:43:20 -- host/digest.sh@119 -- # nvmfappstart --wait-for-rpc 00:26:39.780 03:43:20 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:39.780 03:43:20 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:39.780 03:43:20 -- common/autotest_common.sh@10 -- # set +x 00:26:39.780 03:43:20 -- nvmf/common.sh@469 -- # nvmfpid=3163844 00:26:39.780 03:43:20 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:26:39.780 03:43:20 -- nvmf/common.sh@470 -- # waitforlisten 3163844 00:26:39.780 03:43:20 -- common/autotest_common.sh@829 -- # '[' -z 3163844 ']' 00:26:39.780 03:43:20 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:39.780 03:43:20 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:39.780 03:43:20 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:39.780 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:39.780 03:43:20 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:39.780 03:43:20 -- common/autotest_common.sh@10 -- # set +x 00:26:39.780 [2024-11-21 03:43:20.413012] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:39.780 [2024-11-21 03:43:20.413127] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:40.039 EAL: No free 2048 kB hugepages reported on node 1 00:26:40.039 [2024-11-21 03:43:20.478686] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:40.039 [2024-11-21 03:43:20.587005] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:40.039 [2024-11-21 03:43:20.587168] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:40.039 [2024-11-21 03:43:20.587188] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:40.039 [2024-11-21 03:43:20.587203] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:40.039 [2024-11-21 03:43:20.587243] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:40.039 03:43:20 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:40.039 03:43:20 -- common/autotest_common.sh@862 -- # return 0 00:26:40.039 03:43:20 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:40.039 03:43:20 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:40.039 03:43:20 -- common/autotest_common.sh@10 -- # set +x 00:26:40.039 03:43:20 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:40.039 03:43:20 -- host/digest.sh@120 -- # common_target_config 00:26:40.039 03:43:20 -- host/digest.sh@43 -- # rpc_cmd 00:26:40.039 03:43:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:40.039 03:43:20 -- common/autotest_common.sh@10 -- # set +x 00:26:40.296 null0 00:26:40.296 [2024-11-21 03:43:20.774527] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:40.296 [2024-11-21 03:43:20.798791] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:40.296 03:43:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:40.296 03:43:20 -- host/digest.sh@122 -- # run_bperf randread 4096 128 00:26:40.296 03:43:20 -- host/digest.sh@77 -- # local rw bs qd 00:26:40.296 03:43:20 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:26:40.296 03:43:20 -- host/digest.sh@80 -- # rw=randread 00:26:40.296 03:43:20 -- host/digest.sh@80 -- # bs=4096 00:26:40.296 03:43:20 -- host/digest.sh@80 -- # qd=128 00:26:40.296 03:43:20 -- host/digest.sh@82 -- # bperfpid=3163868 00:26:40.296 03:43:20 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:26:40.296 03:43:20 -- host/digest.sh@83 -- # waitforlisten 3163868 /var/tmp/bperf.sock 00:26:40.296 03:43:20 -- common/autotest_common.sh@829 -- # '[' -z 3163868 ']' 00:26:40.296 03:43:20 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:40.296 03:43:20 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:40.296 03:43:20 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:40.296 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:40.296 03:43:20 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:40.296 03:43:20 -- common/autotest_common.sh@10 -- # set +x 00:26:40.296 [2024-11-21 03:43:20.841866] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:40.296 [2024-11-21 03:43:20.841927] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3163868 ] 00:26:40.296 EAL: No free 2048 kB hugepages reported on node 1 00:26:40.296 [2024-11-21 03:43:20.903146] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:40.600 [2024-11-21 03:43:21.017134] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:40.600 03:43:21 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:40.600 03:43:21 -- common/autotest_common.sh@862 -- # return 0 00:26:40.600 03:43:21 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:26:40.600 03:43:21 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:26:40.600 03:43:21 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:26:40.858 03:43:21 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:40.858 03:43:21 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:41.428 nvme0n1 00:26:41.428 03:43:21 -- host/digest.sh@91 -- # bperf_py perform_tests 00:26:41.428 03:43:21 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:41.428 Running I/O for 2 seconds... 00:26:43.967 00:26:43.967 Latency(us) 00:26:43.967 [2024-11-21T02:43:24.615Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:43.967 [2024-11-21T02:43:24.615Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:26:43.967 nvme0n1 : 2.00 15996.35 62.49 0.00 0.00 7994.87 3470.98 16311.18 00:26:43.967 [2024-11-21T02:43:24.615Z] =================================================================================================================== 00:26:43.967 [2024-11-21T02:43:24.615Z] Total : 15996.35 62.49 0.00 0.00 7994.87 3470.98 16311.18 00:26:43.967 0 00:26:43.967 03:43:24 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:26:43.967 03:43:24 -- host/digest.sh@92 -- # get_accel_stats 00:26:43.967 03:43:24 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:26:43.967 03:43:24 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:26:43.967 03:43:24 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:26:43.967 | select(.opcode=="crc32c") 00:26:43.967 | "\(.module_name) \(.executed)"' 00:26:43.967 03:43:24 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:26:43.967 03:43:24 -- host/digest.sh@93 -- # exp_module=software 00:26:43.967 03:43:24 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:26:43.967 03:43:24 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:26:43.967 03:43:24 -- host/digest.sh@97 -- # killprocess 3163868 00:26:43.967 03:43:24 -- common/autotest_common.sh@936 -- # '[' -z 3163868 ']' 00:26:43.967 03:43:24 -- common/autotest_common.sh@940 -- # kill -0 3163868 00:26:43.967 03:43:24 -- common/autotest_common.sh@941 -- # uname 00:26:43.967 03:43:24 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:43.967 03:43:24 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3163868 00:26:43.967 03:43:24 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:43.967 03:43:24 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:43.967 03:43:24 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3163868' 00:26:43.967 killing process with pid 3163868 00:26:43.967 03:43:24 -- common/autotest_common.sh@955 -- # kill 3163868 00:26:43.967 Received shutdown signal, test time was about 2.000000 seconds 00:26:43.967 00:26:43.967 Latency(us) 00:26:43.967 [2024-11-21T02:43:24.615Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:43.967 [2024-11-21T02:43:24.615Z] =================================================================================================================== 00:26:43.967 [2024-11-21T02:43:24.615Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:43.967 03:43:24 -- common/autotest_common.sh@960 -- # wait 3163868 00:26:43.967 03:43:24 -- host/digest.sh@123 -- # run_bperf randread 131072 16 00:26:43.967 03:43:24 -- host/digest.sh@77 -- # local rw bs qd 00:26:43.967 03:43:24 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:26:43.967 03:43:24 -- host/digest.sh@80 -- # rw=randread 00:26:43.967 03:43:24 -- host/digest.sh@80 -- # bs=131072 00:26:43.967 03:43:24 -- host/digest.sh@80 -- # qd=16 00:26:43.967 03:43:24 -- host/digest.sh@82 -- # bperfpid=3164296 00:26:43.967 03:43:24 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:26:43.967 03:43:24 -- host/digest.sh@83 -- # waitforlisten 3164296 /var/tmp/bperf.sock 00:26:43.967 03:43:24 -- common/autotest_common.sh@829 -- # '[' -z 3164296 ']' 00:26:43.967 03:43:24 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:43.967 03:43:24 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:43.967 03:43:24 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:43.967 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:43.967 03:43:24 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:43.967 03:43:24 -- common/autotest_common.sh@10 -- # set +x 00:26:44.227 [2024-11-21 03:43:24.640872] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:44.227 [2024-11-21 03:43:24.640942] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3164296 ] 00:26:44.227 I/O size of 131072 is greater than zero copy threshold (65536). 00:26:44.227 Zero copy mechanism will not be used. 00:26:44.227 EAL: No free 2048 kB hugepages reported on node 1 00:26:44.227 [2024-11-21 03:43:24.704731] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:44.227 [2024-11-21 03:43:24.819338] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:44.227 03:43:24 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:44.227 03:43:24 -- common/autotest_common.sh@862 -- # return 0 00:26:44.227 03:43:24 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:26:44.227 03:43:24 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:26:44.227 03:43:24 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:26:44.796 03:43:25 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:44.796 03:43:25 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:45.054 nvme0n1 00:26:45.054 03:43:25 -- host/digest.sh@91 -- # bperf_py perform_tests 00:26:45.054 03:43:25 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:45.054 I/O size of 131072 is greater than zero copy threshold (65536). 00:26:45.054 Zero copy mechanism will not be used. 00:26:45.054 Running I/O for 2 seconds... 00:26:47.588 00:26:47.588 Latency(us) 00:26:47.588 [2024-11-21T02:43:28.237Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:47.589 [2024-11-21T02:43:28.237Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:26:47.589 nvme0n1 : 2.00 5149.66 643.71 0.00 0.00 3102.70 1025.52 12330.48 00:26:47.589 [2024-11-21T02:43:28.237Z] =================================================================================================================== 00:26:47.589 [2024-11-21T02:43:28.237Z] Total : 5149.66 643.71 0.00 0.00 3102.70 1025.52 12330.48 00:26:47.589 0 00:26:47.589 03:43:27 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:26:47.589 03:43:27 -- host/digest.sh@92 -- # get_accel_stats 00:26:47.589 03:43:27 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:26:47.589 03:43:27 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:26:47.589 03:43:27 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:26:47.589 | select(.opcode=="crc32c") 00:26:47.589 | "\(.module_name) \(.executed)"' 00:26:47.589 03:43:27 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:26:47.589 03:43:27 -- host/digest.sh@93 -- # exp_module=software 00:26:47.589 03:43:27 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:26:47.589 03:43:27 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:26:47.589 03:43:27 -- host/digest.sh@97 -- # killprocess 3164296 00:26:47.589 03:43:27 -- common/autotest_common.sh@936 -- # '[' -z 3164296 ']' 00:26:47.589 03:43:27 -- common/autotest_common.sh@940 -- # kill -0 3164296 00:26:47.589 03:43:27 -- common/autotest_common.sh@941 -- # uname 00:26:47.589 03:43:27 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:47.589 03:43:27 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3164296 00:26:47.589 03:43:27 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:47.589 03:43:27 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:47.589 03:43:27 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3164296' 00:26:47.589 killing process with pid 3164296 00:26:47.589 03:43:27 -- common/autotest_common.sh@955 -- # kill 3164296 00:26:47.589 Received shutdown signal, test time was about 2.000000 seconds 00:26:47.589 00:26:47.589 Latency(us) 00:26:47.589 [2024-11-21T02:43:28.237Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:47.589 [2024-11-21T02:43:28.237Z] =================================================================================================================== 00:26:47.589 [2024-11-21T02:43:28.237Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:47.589 03:43:27 -- common/autotest_common.sh@960 -- # wait 3164296 00:26:47.589 03:43:28 -- host/digest.sh@124 -- # run_bperf randwrite 4096 128 00:26:47.589 03:43:28 -- host/digest.sh@77 -- # local rw bs qd 00:26:47.589 03:43:28 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:26:47.589 03:43:28 -- host/digest.sh@80 -- # rw=randwrite 00:26:47.589 03:43:28 -- host/digest.sh@80 -- # bs=4096 00:26:47.589 03:43:28 -- host/digest.sh@80 -- # qd=128 00:26:47.589 03:43:28 -- host/digest.sh@82 -- # bperfpid=3164831 00:26:47.589 03:43:28 -- host/digest.sh@83 -- # waitforlisten 3164831 /var/tmp/bperf.sock 00:26:47.589 03:43:28 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:26:47.589 03:43:28 -- common/autotest_common.sh@829 -- # '[' -z 3164831 ']' 00:26:47.589 03:43:28 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:47.589 03:43:28 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:47.589 03:43:28 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:47.589 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:47.589 03:43:28 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:47.589 03:43:28 -- common/autotest_common.sh@10 -- # set +x 00:26:47.847 [2024-11-21 03:43:28.257060] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:47.847 [2024-11-21 03:43:28.257164] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3164831 ] 00:26:47.847 EAL: No free 2048 kB hugepages reported on node 1 00:26:47.847 [2024-11-21 03:43:28.319551] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:47.847 [2024-11-21 03:43:28.430942] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:47.847 03:43:28 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:47.847 03:43:28 -- common/autotest_common.sh@862 -- # return 0 00:26:47.847 03:43:28 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:26:47.847 03:43:28 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:26:47.847 03:43:28 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:26:48.415 03:43:28 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:48.415 03:43:28 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:48.672 nvme0n1 00:26:48.673 03:43:29 -- host/digest.sh@91 -- # bperf_py perform_tests 00:26:48.673 03:43:29 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:48.673 Running I/O for 2 seconds... 00:26:51.202 00:26:51.202 Latency(us) 00:26:51.202 [2024-11-21T02:43:31.850Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:51.202 [2024-11-21T02:43:31.850Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:26:51.202 nvme0n1 : 2.01 18346.85 71.67 0.00 0.00 6961.35 3106.89 11505.21 00:26:51.202 [2024-11-21T02:43:31.850Z] =================================================================================================================== 00:26:51.202 [2024-11-21T02:43:31.850Z] Total : 18346.85 71.67 0.00 0.00 6961.35 3106.89 11505.21 00:26:51.202 0 00:26:51.202 03:43:31 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:26:51.202 03:43:31 -- host/digest.sh@92 -- # get_accel_stats 00:26:51.202 03:43:31 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:26:51.202 03:43:31 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:26:51.202 03:43:31 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:26:51.202 | select(.opcode=="crc32c") 00:26:51.202 | "\(.module_name) \(.executed)"' 00:26:51.202 03:43:31 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:26:51.202 03:43:31 -- host/digest.sh@93 -- # exp_module=software 00:26:51.202 03:43:31 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:26:51.202 03:43:31 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:26:51.202 03:43:31 -- host/digest.sh@97 -- # killprocess 3164831 00:26:51.202 03:43:31 -- common/autotest_common.sh@936 -- # '[' -z 3164831 ']' 00:26:51.202 03:43:31 -- common/autotest_common.sh@940 -- # kill -0 3164831 00:26:51.202 03:43:31 -- common/autotest_common.sh@941 -- # uname 00:26:51.202 03:43:31 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:51.202 03:43:31 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3164831 00:26:51.202 03:43:31 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:51.202 03:43:31 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:51.202 03:43:31 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3164831' 00:26:51.202 killing process with pid 3164831 00:26:51.202 03:43:31 -- common/autotest_common.sh@955 -- # kill 3164831 00:26:51.202 Received shutdown signal, test time was about 2.000000 seconds 00:26:51.202 00:26:51.202 Latency(us) 00:26:51.202 [2024-11-21T02:43:31.850Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:51.202 [2024-11-21T02:43:31.850Z] =================================================================================================================== 00:26:51.202 [2024-11-21T02:43:31.850Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:51.202 03:43:31 -- common/autotest_common.sh@960 -- # wait 3164831 00:26:51.202 03:43:31 -- host/digest.sh@125 -- # run_bperf randwrite 131072 16 00:26:51.202 03:43:31 -- host/digest.sh@77 -- # local rw bs qd 00:26:51.202 03:43:31 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:26:51.202 03:43:31 -- host/digest.sh@80 -- # rw=randwrite 00:26:51.202 03:43:31 -- host/digest.sh@80 -- # bs=131072 00:26:51.202 03:43:31 -- host/digest.sh@80 -- # qd=16 00:26:51.202 03:43:31 -- host/digest.sh@82 -- # bperfpid=3165253 00:26:51.202 03:43:31 -- host/digest.sh@83 -- # waitforlisten 3165253 /var/tmp/bperf.sock 00:26:51.202 03:43:31 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:26:51.202 03:43:31 -- common/autotest_common.sh@829 -- # '[' -z 3165253 ']' 00:26:51.202 03:43:31 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:51.202 03:43:31 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:51.202 03:43:31 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:51.202 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:51.202 03:43:31 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:51.202 03:43:31 -- common/autotest_common.sh@10 -- # set +x 00:26:51.460 [2024-11-21 03:43:31.848664] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:51.460 [2024-11-21 03:43:31.848756] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3165253 ] 00:26:51.460 I/O size of 131072 is greater than zero copy threshold (65536). 00:26:51.460 Zero copy mechanism will not be used. 00:26:51.460 EAL: No free 2048 kB hugepages reported on node 1 00:26:51.460 [2024-11-21 03:43:31.909376] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:51.460 [2024-11-21 03:43:32.019402] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:51.460 03:43:32 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:51.460 03:43:32 -- common/autotest_common.sh@862 -- # return 0 00:26:51.460 03:43:32 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:26:51.460 03:43:32 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:26:51.460 03:43:32 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:26:52.031 03:43:32 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:52.031 03:43:32 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:52.289 nvme0n1 00:26:52.289 03:43:32 -- host/digest.sh@91 -- # bperf_py perform_tests 00:26:52.289 03:43:32 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:52.547 I/O size of 131072 is greater than zero copy threshold (65536). 00:26:52.547 Zero copy mechanism will not be used. 00:26:52.547 Running I/O for 2 seconds... 00:26:54.451 00:26:54.451 Latency(us) 00:26:54.451 [2024-11-21T02:43:35.099Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:54.451 [2024-11-21T02:43:35.099Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:26:54.451 nvme0n1 : 2.00 5695.05 711.88 0.00 0.00 2801.38 1941.81 8641.04 00:26:54.451 [2024-11-21T02:43:35.099Z] =================================================================================================================== 00:26:54.451 [2024-11-21T02:43:35.099Z] Total : 5695.05 711.88 0.00 0.00 2801.38 1941.81 8641.04 00:26:54.451 0 00:26:54.451 03:43:35 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:26:54.451 03:43:35 -- host/digest.sh@92 -- # get_accel_stats 00:26:54.451 03:43:35 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:26:54.451 03:43:35 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:26:54.451 03:43:35 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:26:54.451 | select(.opcode=="crc32c") 00:26:54.451 | "\(.module_name) \(.executed)"' 00:26:54.710 03:43:35 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:26:54.710 03:43:35 -- host/digest.sh@93 -- # exp_module=software 00:26:54.710 03:43:35 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:26:54.710 03:43:35 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:26:54.710 03:43:35 -- host/digest.sh@97 -- # killprocess 3165253 00:26:54.710 03:43:35 -- common/autotest_common.sh@936 -- # '[' -z 3165253 ']' 00:26:54.710 03:43:35 -- common/autotest_common.sh@940 -- # kill -0 3165253 00:26:54.710 03:43:35 -- common/autotest_common.sh@941 -- # uname 00:26:54.710 03:43:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:54.710 03:43:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3165253 00:26:54.710 03:43:35 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:54.710 03:43:35 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:54.710 03:43:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3165253' 00:26:54.710 killing process with pid 3165253 00:26:54.710 03:43:35 -- common/autotest_common.sh@955 -- # kill 3165253 00:26:54.710 Received shutdown signal, test time was about 2.000000 seconds 00:26:54.710 00:26:54.710 Latency(us) 00:26:54.710 [2024-11-21T02:43:35.358Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:54.710 [2024-11-21T02:43:35.358Z] =================================================================================================================== 00:26:54.710 [2024-11-21T02:43:35.358Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:54.710 03:43:35 -- common/autotest_common.sh@960 -- # wait 3165253 00:26:54.969 03:43:35 -- host/digest.sh@126 -- # killprocess 3163844 00:26:54.969 03:43:35 -- common/autotest_common.sh@936 -- # '[' -z 3163844 ']' 00:26:54.969 03:43:35 -- common/autotest_common.sh@940 -- # kill -0 3163844 00:26:54.969 03:43:35 -- common/autotest_common.sh@941 -- # uname 00:26:54.969 03:43:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:54.969 03:43:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3163844 00:26:54.969 03:43:35 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:26:54.969 03:43:35 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:26:54.969 03:43:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3163844' 00:26:54.969 killing process with pid 3163844 00:26:54.969 03:43:35 -- common/autotest_common.sh@955 -- # kill 3163844 00:26:54.969 03:43:35 -- common/autotest_common.sh@960 -- # wait 3163844 00:26:55.539 00:26:55.539 real 0m15.515s 00:26:55.539 user 0m30.447s 00:26:55.539 sys 0m4.445s 00:26:55.539 03:43:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:55.539 03:43:35 -- common/autotest_common.sh@10 -- # set +x 00:26:55.539 ************************************ 00:26:55.539 END TEST nvmf_digest_clean 00:26:55.539 ************************************ 00:26:55.539 03:43:35 -- host/digest.sh@136 -- # run_test nvmf_digest_error run_digest_error 00:26:55.539 03:43:35 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:26:55.539 03:43:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:55.539 03:43:35 -- common/autotest_common.sh@10 -- # set +x 00:26:55.539 ************************************ 00:26:55.539 START TEST nvmf_digest_error 00:26:55.539 ************************************ 00:26:55.539 03:43:35 -- common/autotest_common.sh@1114 -- # run_digest_error 00:26:55.539 03:43:35 -- host/digest.sh@101 -- # nvmfappstart --wait-for-rpc 00:26:55.539 03:43:35 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:55.539 03:43:35 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:55.539 03:43:35 -- common/autotest_common.sh@10 -- # set +x 00:26:55.539 03:43:35 -- nvmf/common.sh@469 -- # nvmfpid=3165718 00:26:55.539 03:43:35 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:26:55.539 03:43:35 -- nvmf/common.sh@470 -- # waitforlisten 3165718 00:26:55.539 03:43:35 -- common/autotest_common.sh@829 -- # '[' -z 3165718 ']' 00:26:55.539 03:43:35 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:55.539 03:43:35 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:55.539 03:43:35 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:55.539 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:55.539 03:43:35 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:55.539 03:43:35 -- common/autotest_common.sh@10 -- # set +x 00:26:55.539 [2024-11-21 03:43:35.964160] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:55.539 [2024-11-21 03:43:35.964259] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:55.539 EAL: No free 2048 kB hugepages reported on node 1 00:26:55.539 [2024-11-21 03:43:36.028165] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:55.539 [2024-11-21 03:43:36.135274] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:55.539 [2024-11-21 03:43:36.135441] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:55.539 [2024-11-21 03:43:36.135458] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:55.539 [2024-11-21 03:43:36.135470] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:55.539 [2024-11-21 03:43:36.135507] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:55.798 03:43:36 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:55.798 03:43:36 -- common/autotest_common.sh@862 -- # return 0 00:26:55.798 03:43:36 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:55.798 03:43:36 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:55.798 03:43:36 -- common/autotest_common.sh@10 -- # set +x 00:26:55.798 03:43:36 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:55.798 03:43:36 -- host/digest.sh@103 -- # rpc_cmd accel_assign_opc -o crc32c -m error 00:26:55.798 03:43:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:55.798 03:43:36 -- common/autotest_common.sh@10 -- # set +x 00:26:55.798 [2024-11-21 03:43:36.216163] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation crc32c will be assigned to module error 00:26:55.798 03:43:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:55.798 03:43:36 -- host/digest.sh@104 -- # common_target_config 00:26:55.798 03:43:36 -- host/digest.sh@43 -- # rpc_cmd 00:26:55.798 03:43:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:55.798 03:43:36 -- common/autotest_common.sh@10 -- # set +x 00:26:55.798 null0 00:26:55.798 [2024-11-21 03:43:36.336854] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:55.798 [2024-11-21 03:43:36.361108] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:55.798 03:43:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:55.798 03:43:36 -- host/digest.sh@107 -- # run_bperf_err randread 4096 128 00:26:55.798 03:43:36 -- host/digest.sh@54 -- # local rw bs qd 00:26:55.798 03:43:36 -- host/digest.sh@56 -- # rw=randread 00:26:55.798 03:43:36 -- host/digest.sh@56 -- # bs=4096 00:26:55.798 03:43:36 -- host/digest.sh@56 -- # qd=128 00:26:55.798 03:43:36 -- host/digest.sh@58 -- # bperfpid=3165853 00:26:55.798 03:43:36 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z 00:26:55.798 03:43:36 -- host/digest.sh@60 -- # waitforlisten 3165853 /var/tmp/bperf.sock 00:26:55.798 03:43:36 -- common/autotest_common.sh@829 -- # '[' -z 3165853 ']' 00:26:55.798 03:43:36 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:55.798 03:43:36 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:55.799 03:43:36 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:55.799 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:55.799 03:43:36 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:55.799 03:43:36 -- common/autotest_common.sh@10 -- # set +x 00:26:55.799 [2024-11-21 03:43:36.404466] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:55.799 [2024-11-21 03:43:36.404526] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3165853 ] 00:26:55.799 EAL: No free 2048 kB hugepages reported on node 1 00:26:56.057 [2024-11-21 03:43:36.464514] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:56.057 [2024-11-21 03:43:36.577573] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:56.992 03:43:37 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:56.992 03:43:37 -- common/autotest_common.sh@862 -- # return 0 00:26:56.992 03:43:37 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:26:56.992 03:43:37 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:26:56.992 03:43:37 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:26:56.992 03:43:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:56.992 03:43:37 -- common/autotest_common.sh@10 -- # set +x 00:26:56.992 03:43:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:56.992 03:43:37 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:56.993 03:43:37 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:57.561 nvme0n1 00:26:57.561 03:43:38 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:26:57.561 03:43:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:57.561 03:43:38 -- common/autotest_common.sh@10 -- # set +x 00:26:57.561 03:43:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:57.561 03:43:38 -- host/digest.sh@69 -- # bperf_py perform_tests 00:26:57.561 03:43:38 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:57.561 Running I/O for 2 seconds... 00:26:57.561 [2024-11-21 03:43:38.188339] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:57.561 [2024-11-21 03:43:38.188402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:21499 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.561 [2024-11-21 03:43:38.188426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:57.561 [2024-11-21 03:43:38.199581] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:57.561 [2024-11-21 03:43:38.199618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:24304 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.561 [2024-11-21 03:43:38.199639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:57.821 [2024-11-21 03:43:38.215785] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:57.821 [2024-11-21 03:43:38.215827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:22396 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.821 [2024-11-21 03:43:38.215848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:111 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:57.821 [2024-11-21 03:43:38.233224] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:57.821 [2024-11-21 03:43:38.233265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:4557 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.821 [2024-11-21 03:43:38.233283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:57.821 [2024-11-21 03:43:38.244296] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:57.821 [2024-11-21 03:43:38.244328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:2943 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.821 [2024-11-21 03:43:38.244345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:57.821 [2024-11-21 03:43:38.260672] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:57.821 [2024-11-21 03:43:38.260707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:19964 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.821 [2024-11-21 03:43:38.260727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:57.821 [2024-11-21 03:43:38.278554] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:57.822 [2024-11-21 03:43:38.278590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:17662 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.822 [2024-11-21 03:43:38.278609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:57.822 [2024-11-21 03:43:38.295407] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:57.822 [2024-11-21 03:43:38.295439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:9634 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.822 [2024-11-21 03:43:38.295475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:57.822 [2024-11-21 03:43:38.306921] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:57.822 [2024-11-21 03:43:38.306956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:16740 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.822 [2024-11-21 03:43:38.306975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:57.822 [2024-11-21 03:43:38.323605] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:57.822 [2024-11-21 03:43:38.323641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:12136 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.822 [2024-11-21 03:43:38.323660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:57.822 [2024-11-21 03:43:38.341180] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:57.822 [2024-11-21 03:43:38.341235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:18802 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.822 [2024-11-21 03:43:38.341253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:57.822 [2024-11-21 03:43:38.356705] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:57.822 [2024-11-21 03:43:38.356743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:21736 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.822 [2024-11-21 03:43:38.356763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:57.822 [2024-11-21 03:43:38.368783] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:57.822 [2024-11-21 03:43:38.368818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:13112 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.822 [2024-11-21 03:43:38.368837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:57.822 [2024-11-21 03:43:38.386908] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:57.822 [2024-11-21 03:43:38.386945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:6176 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.822 [2024-11-21 03:43:38.386964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:57.822 [2024-11-21 03:43:38.404066] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:57.822 [2024-11-21 03:43:38.404113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:14080 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.822 [2024-11-21 03:43:38.404146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:57.822 [2024-11-21 03:43:38.415289] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:57.822 [2024-11-21 03:43:38.415317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:7136 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.822 [2024-11-21 03:43:38.415333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:57.822 [2024-11-21 03:43:38.432191] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:57.822 [2024-11-21 03:43:38.432220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:12093 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.822 [2024-11-21 03:43:38.432236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:57.822 [2024-11-21 03:43:38.449194] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:57.822 [2024-11-21 03:43:38.449226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:829 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.822 [2024-11-21 03:43:38.449243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:57.822 [2024-11-21 03:43:38.467217] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:57.822 [2024-11-21 03:43:38.467265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:12159 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:57.822 [2024-11-21 03:43:38.467284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.083 [2024-11-21 03:43:38.478496] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:58.083 [2024-11-21 03:43:38.478532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:8190 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.083 [2024-11-21 03:43:38.478551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:75 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.083 [2024-11-21 03:43:38.494966] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:58.083 [2024-11-21 03:43:38.495002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:18017 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.083 [2024-11-21 03:43:38.495038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.083 [2024-11-21 03:43:38.512316] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:58.083 [2024-11-21 03:43:38.512345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:1038 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.083 [2024-11-21 03:43:38.512361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:19 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.083 [2024-11-21 03:43:38.523166] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:58.083 [2024-11-21 03:43:38.523195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:23160 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.083 [2024-11-21 03:43:38.523210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.083 [2024-11-21 03:43:38.539638] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:58.083 [2024-11-21 03:43:38.539673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:2537 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.083 [2024-11-21 03:43:38.539691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.083 [2024-11-21 03:43:38.555972] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:58.083 [2024-11-21 03:43:38.556008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:20035 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.083 [2024-11-21 03:43:38.556027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.083 [2024-11-21 03:43:38.574493] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:58.083 [2024-11-21 03:43:38.574528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:3084 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.083 [2024-11-21 03:43:38.574547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:107 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.083 [2024-11-21 03:43:38.590640] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:58.083 [2024-11-21 03:43:38.590674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:2848 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.083 [2024-11-21 03:43:38.590692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:47 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.083 [2024-11-21 03:43:38.608194] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:58.083 [2024-11-21 03:43:38.608239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:9071 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.083 [2024-11-21 03:43:38.608256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:77 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.083 [2024-11-21 03:43:38.625184] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:58.083 [2024-11-21 03:43:38.625215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:12083 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.083 [2024-11-21 03:43:38.625232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.083 [2024-11-21 03:43:38.641494] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:58.083 [2024-11-21 03:43:38.641540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:16613 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.083 [2024-11-21 03:43:38.641560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.083 [2024-11-21 03:43:38.659154] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:58.083 [2024-11-21 03:43:38.659185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:3680 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.083 [2024-11-21 03:43:38.659215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.083 [2024-11-21 03:43:38.676080] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:58.083 [2024-11-21 03:43:38.676114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:2454 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.083 [2024-11-21 03:43:38.676148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.083 [2024-11-21 03:43:38.692867] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:58.083 [2024-11-21 03:43:38.692901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:13873 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.083 [2024-11-21 03:43:38.692921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.083 [2024-11-21 03:43:38.709871] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:58.083 [2024-11-21 03:43:38.709907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:17010 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.083 [2024-11-21 03:43:38.709925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.083 [2024-11-21 03:43:38.726723] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:58.083 [2024-11-21 03:43:38.726758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:7375 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.083 [2024-11-21 03:43:38.726778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:37 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.344 [2024-11-21 03:43:38.743824] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:58.344 [2024-11-21 03:43:38.743859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:13971 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.344 [2024-11-21 03:43:38.743877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:24 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.344 [2024-11-21 03:43:38.761737] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:58.344 [2024-11-21 03:43:38.761773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:18156 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.344 [2024-11-21 03:43:38.761793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.344 [2024-11-21 03:43:38.778205] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:58.344 [2024-11-21 03:43:38.778250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:24767 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.344 [2024-11-21 03:43:38.778267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:111 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.344 [2024-11-21 03:43:38.794472] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:58.344 [2024-11-21 03:43:38.794508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:13493 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.344 [2024-11-21 03:43:38.794527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.344 [2024-11-21 03:43:38.811458] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:58.344 [2024-11-21 03:43:38.811492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:24520 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.344 [2024-11-21 03:43:38.811511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.344 [2024-11-21 03:43:38.828889] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:58.344 [2024-11-21 03:43:38.828923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:451 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.344 [2024-11-21 03:43:38.828942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:104 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.344 [2024-11-21 03:43:38.846101] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:58.344 [2024-11-21 03:43:38.846148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:520 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.344 [2024-11-21 03:43:38.846165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.344 [2024-11-21 03:43:38.863199] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:58.344 [2024-11-21 03:43:38.863229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:11273 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.344 [2024-11-21 03:43:38.863245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.344 [2024-11-21 03:43:38.880322] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:58.344 [2024-11-21 03:43:38.880351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:969 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.344 [2024-11-21 03:43:38.880367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.344 [2024-11-21 03:43:38.896956] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:58.344 [2024-11-21 03:43:38.896992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:25030 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.344 [2024-11-21 03:43:38.897010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.344 [2024-11-21 03:43:38.914258] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:58.344 [2024-11-21 03:43:38.914288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:20665 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.344 [2024-11-21 03:43:38.914304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.344 [2024-11-21 03:43:38.931293] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:58.344 [2024-11-21 03:43:38.931323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:10867 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.344 [2024-11-21 03:43:38.931350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:111 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.344 [2024-11-21 03:43:38.948663] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:58.344 [2024-11-21 03:43:38.948697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:8281 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.344 [2024-11-21 03:43:38.948716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:77 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.344 [2024-11-21 03:43:38.965557] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:58.344 [2024-11-21 03:43:38.965592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:15029 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.345 [2024-11-21 03:43:38.965611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.345 [2024-11-21 03:43:38.982207] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:58.345 [2024-11-21 03:43:38.982236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:19821 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.345 [2024-11-21 03:43:38.982252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:105 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.606 [2024-11-21 03:43:38.999561] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:58.606 [2024-11-21 03:43:38.999596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:21323 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.606 [2024-11-21 03:43:38.999615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.606 [2024-11-21 03:43:39.016453] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:58.606 [2024-11-21 03:43:39.016488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:21611 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.606 [2024-11-21 03:43:39.016508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:24 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.606 [2024-11-21 03:43:39.033128] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:58.606 [2024-11-21 03:43:39.033157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:17151 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.606 [2024-11-21 03:43:39.033174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.606 [2024-11-21 03:43:39.044289] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:58.606 [2024-11-21 03:43:39.044319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:239 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.606 [2024-11-21 03:43:39.044335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.606 [2024-11-21 03:43:39.059966] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:58.606 [2024-11-21 03:43:39.060000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:20375 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.606 [2024-11-21 03:43:39.060018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.606 [2024-11-21 03:43:39.077310] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:58.606 [2024-11-21 03:43:39.077339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:1572 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.606 [2024-11-21 03:43:39.077356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.606 [2024-11-21 03:43:39.094799] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:58.606 [2024-11-21 03:43:39.094834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:7620 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.606 [2024-11-21 03:43:39.094852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.606 [2024-11-21 03:43:39.113208] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:58.606 [2024-11-21 03:43:39.113238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:14906 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.606 [2024-11-21 03:43:39.113255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.606 [2024-11-21 03:43:39.129826] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:58.606 [2024-11-21 03:43:39.129863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:11280 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.606 [2024-11-21 03:43:39.129883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:23 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.606 [2024-11-21 03:43:39.147274] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:58.606 [2024-11-21 03:43:39.147303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:13526 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.606 [2024-11-21 03:43:39.147319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.606 [2024-11-21 03:43:39.163097] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:58.606 [2024-11-21 03:43:39.163128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:11474 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.606 [2024-11-21 03:43:39.163145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.606 [2024-11-21 03:43:39.176078] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:58.606 [2024-11-21 03:43:39.176117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:12411 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.606 [2024-11-21 03:43:39.176148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:32 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.606 [2024-11-21 03:43:39.192745] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:58.606 [2024-11-21 03:43:39.192780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:12060 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.606 [2024-11-21 03:43:39.192799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:89 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.606 [2024-11-21 03:43:39.209510] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:58.606 [2024-11-21 03:43:39.209545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:11013 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.606 [2024-11-21 03:43:39.209574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.606 [2024-11-21 03:43:39.227313] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:58.606 [2024-11-21 03:43:39.227341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:2730 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.606 [2024-11-21 03:43:39.227356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:71 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.606 [2024-11-21 03:43:39.243264] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:58.606 [2024-11-21 03:43:39.243298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:2318 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.606 [2024-11-21 03:43:39.243318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:32 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.866 [2024-11-21 03:43:39.255590] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:58.866 [2024-11-21 03:43:39.255627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:9940 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.866 [2024-11-21 03:43:39.255646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:105 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.866 [2024-11-21 03:43:39.272605] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:58.866 [2024-11-21 03:43:39.272634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:5221 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.866 [2024-11-21 03:43:39.272650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:91 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.866 [2024-11-21 03:43:39.289451] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:58.866 [2024-11-21 03:43:39.289485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:16508 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.866 [2024-11-21 03:43:39.289504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.866 [2024-11-21 03:43:39.300934] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:58.866 [2024-11-21 03:43:39.300969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:16765 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.866 [2024-11-21 03:43:39.300988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.866 [2024-11-21 03:43:39.316483] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:58.866 [2024-11-21 03:43:39.316517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:5886 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.866 [2024-11-21 03:43:39.316537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.867 [2024-11-21 03:43:39.333802] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:58.867 [2024-11-21 03:43:39.333838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:985 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.867 [2024-11-21 03:43:39.333857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:53 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.867 [2024-11-21 03:43:39.350757] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:58.867 [2024-11-21 03:43:39.350805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:5157 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.867 [2024-11-21 03:43:39.350825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:106 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.867 [2024-11-21 03:43:39.368431] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:58.867 [2024-11-21 03:43:39.368472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:9604 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.867 [2024-11-21 03:43:39.368492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:59 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.867 [2024-11-21 03:43:39.384003] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:58.867 [2024-11-21 03:43:39.384038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:18195 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.867 [2024-11-21 03:43:39.384056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:23 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.867 [2024-11-21 03:43:39.395724] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:58.867 [2024-11-21 03:43:39.395759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:20853 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.867 [2024-11-21 03:43:39.395778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:107 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.867 [2024-11-21 03:43:39.412584] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:58.867 [2024-11-21 03:43:39.412619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:14903 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.867 [2024-11-21 03:43:39.412639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:31 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.867 [2024-11-21 03:43:39.429906] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:58.867 [2024-11-21 03:43:39.429951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:11533 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.867 [2024-11-21 03:43:39.429970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:56 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.867 [2024-11-21 03:43:39.447287] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:58.867 [2024-11-21 03:43:39.447315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:18490 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.867 [2024-11-21 03:43:39.447331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.867 [2024-11-21 03:43:39.464169] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:58.867 [2024-11-21 03:43:39.464198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:11389 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.867 [2024-11-21 03:43:39.464214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.867 [2024-11-21 03:43:39.481625] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:58.867 [2024-11-21 03:43:39.481660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:18416 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.867 [2024-11-21 03:43:39.481678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:107 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:58.867 [2024-11-21 03:43:39.498013] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:58.867 [2024-11-21 03:43:39.498048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:22071 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:58.867 [2024-11-21 03:43:39.498067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.128 [2024-11-21 03:43:39.515861] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:59.128 [2024-11-21 03:43:39.515897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:11081 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.128 [2024-11-21 03:43:39.515915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:53 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.128 [2024-11-21 03:43:39.532006] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:59.128 [2024-11-21 03:43:39.532041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:19810 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.128 [2024-11-21 03:43:39.532060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:95 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.128 [2024-11-21 03:43:39.549118] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:59.128 [2024-11-21 03:43:39.549165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:2368 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.128 [2024-11-21 03:43:39.549183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:77 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.128 [2024-11-21 03:43:39.564467] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:59.128 [2024-11-21 03:43:39.564500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:19274 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.128 [2024-11-21 03:43:39.564519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.128 [2024-11-21 03:43:39.577346] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:59.128 [2024-11-21 03:43:39.577390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:23242 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.128 [2024-11-21 03:43:39.577410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.128 [2024-11-21 03:43:39.593640] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:59.128 [2024-11-21 03:43:39.593674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:13257 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.128 [2024-11-21 03:43:39.593693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.128 [2024-11-21 03:43:39.609811] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:59.128 [2024-11-21 03:43:39.609845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:11975 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.128 [2024-11-21 03:43:39.609864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:26 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.128 [2024-11-21 03:43:39.627123] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:59.128 [2024-11-21 03:43:39.627166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:15555 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.128 [2024-11-21 03:43:39.627189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.128 [2024-11-21 03:43:39.644506] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:59.128 [2024-11-21 03:43:39.644541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:23795 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.128 [2024-11-21 03:43:39.644561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.128 [2024-11-21 03:43:39.660150] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:59.128 [2024-11-21 03:43:39.660180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:5255 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.128 [2024-11-21 03:43:39.660204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.128 [2024-11-21 03:43:39.672463] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:59.128 [2024-11-21 03:43:39.672497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:2004 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.128 [2024-11-21 03:43:39.672516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:56 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.128 [2024-11-21 03:43:39.689419] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:59.128 [2024-11-21 03:43:39.689453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:18254 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.128 [2024-11-21 03:43:39.689472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.128 [2024-11-21 03:43:39.706007] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:59.128 [2024-11-21 03:43:39.706042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:19884 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.128 [2024-11-21 03:43:39.706060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:111 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.128 [2024-11-21 03:43:39.723089] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:59.128 [2024-11-21 03:43:39.723124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:1950 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.128 [2024-11-21 03:43:39.723156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:42 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.128 [2024-11-21 03:43:39.740813] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:59.128 [2024-11-21 03:43:39.740847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:8294 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.128 [2024-11-21 03:43:39.740866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.128 [2024-11-21 03:43:39.756232] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:59.128 [2024-11-21 03:43:39.756262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:5573 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.128 [2024-11-21 03:43:39.756278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.128 [2024-11-21 03:43:39.768289] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:59.128 [2024-11-21 03:43:39.768325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:5261 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.128 [2024-11-21 03:43:39.768342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.390 [2024-11-21 03:43:39.785191] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:59.390 [2024-11-21 03:43:39.785220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:14914 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.390 [2024-11-21 03:43:39.785235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.390 [2024-11-21 03:43:39.802807] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:59.390 [2024-11-21 03:43:39.802841] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:21294 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.390 [2024-11-21 03:43:39.802861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.390 [2024-11-21 03:43:39.820096] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:59.390 [2024-11-21 03:43:39.820144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:1845 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.390 [2024-11-21 03:43:39.820160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.390 [2024-11-21 03:43:39.836862] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:59.390 [2024-11-21 03:43:39.836897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:17115 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.390 [2024-11-21 03:43:39.836916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.390 [2024-11-21 03:43:39.847781] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:59.390 [2024-11-21 03:43:39.847814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:13526 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.390 [2024-11-21 03:43:39.847833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.390 [2024-11-21 03:43:39.864319] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:59.390 [2024-11-21 03:43:39.864348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:5003 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.390 [2024-11-21 03:43:39.864363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.390 [2024-11-21 03:43:39.881990] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:59.390 [2024-11-21 03:43:39.882025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:22745 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.390 [2024-11-21 03:43:39.882044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.390 [2024-11-21 03:43:39.899449] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:59.390 [2024-11-21 03:43:39.899483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:24976 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.390 [2024-11-21 03:43:39.899501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.390 [2024-11-21 03:43:39.916001] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:59.390 [2024-11-21 03:43:39.916039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:6381 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.390 [2024-11-21 03:43:39.916059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:119 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.390 [2024-11-21 03:43:39.933524] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:59.390 [2024-11-21 03:43:39.933558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:9098 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.390 [2024-11-21 03:43:39.933577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.390 [2024-11-21 03:43:39.950678] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:59.390 [2024-11-21 03:43:39.950712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:20509 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.390 [2024-11-21 03:43:39.950731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.390 [2024-11-21 03:43:39.961485] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:59.390 [2024-11-21 03:43:39.961519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:9043 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.390 [2024-11-21 03:43:39.961537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.390 [2024-11-21 03:43:39.978543] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:59.390 [2024-11-21 03:43:39.978577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:3915 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.390 [2024-11-21 03:43:39.978596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.390 [2024-11-21 03:43:39.994690] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:59.390 [2024-11-21 03:43:39.994724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:3566 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.390 [2024-11-21 03:43:39.994743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.390 [2024-11-21 03:43:40.011737] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:59.390 [2024-11-21 03:43:40.011775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:9372 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.390 [2024-11-21 03:43:40.011794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.390 [2024-11-21 03:43:40.029716] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:59.390 [2024-11-21 03:43:40.029752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:6779 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.390 [2024-11-21 03:43:40.029771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.649 [2024-11-21 03:43:40.046828] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:59.650 [2024-11-21 03:43:40.046887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:8676 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.650 [2024-11-21 03:43:40.046909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.650 [2024-11-21 03:43:40.064013] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:59.650 [2024-11-21 03:43:40.064047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:18469 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.650 [2024-11-21 03:43:40.064066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.650 [2024-11-21 03:43:40.079602] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:59.650 [2024-11-21 03:43:40.079652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:8736 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.650 [2024-11-21 03:43:40.079669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.650 [2024-11-21 03:43:40.091511] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:59.650 [2024-11-21 03:43:40.091545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:11024 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.650 [2024-11-21 03:43:40.091564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.650 [2024-11-21 03:43:40.109315] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:59.650 [2024-11-21 03:43:40.109361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:2523 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.650 [2024-11-21 03:43:40.109378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.650 [2024-11-21 03:43:40.125759] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:59.650 [2024-11-21 03:43:40.125793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:78 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.650 [2024-11-21 03:43:40.125813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.650 [2024-11-21 03:43:40.143225] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:59.650 [2024-11-21 03:43:40.143256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:678 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.650 [2024-11-21 03:43:40.143274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:119 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.650 [2024-11-21 03:43:40.159277] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:59.650 [2024-11-21 03:43:40.159309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:23754 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.650 [2024-11-21 03:43:40.159326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.650 [2024-11-21 03:43:40.170232] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x8d1bb0) 00:26:59.650 [2024-11-21 03:43:40.170262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:9605 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:59.650 [2024-11-21 03:43:40.170279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:59.650 00:26:59.650 Latency(us) 00:26:59.650 [2024-11-21T02:43:40.298Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:59.650 [2024-11-21T02:43:40.298Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:26:59.650 nvme0n1 : 2.00 15771.86 61.61 0.00 0.00 8106.35 3446.71 24660.95 00:26:59.650 [2024-11-21T02:43:40.298Z] =================================================================================================================== 00:26:59.650 [2024-11-21T02:43:40.298Z] Total : 15771.86 61.61 0.00 0.00 8106.35 3446.71 24660.95 00:26:59.650 0 00:26:59.650 03:43:40 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:26:59.650 03:43:40 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:26:59.650 03:43:40 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:26:59.650 | .driver_specific 00:26:59.650 | .nvme_error 00:26:59.650 | .status_code 00:26:59.650 | .command_transient_transport_error' 00:26:59.650 03:43:40 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:26:59.908 03:43:40 -- host/digest.sh@71 -- # (( 124 > 0 )) 00:26:59.908 03:43:40 -- host/digest.sh@73 -- # killprocess 3165853 00:26:59.908 03:43:40 -- common/autotest_common.sh@936 -- # '[' -z 3165853 ']' 00:26:59.909 03:43:40 -- common/autotest_common.sh@940 -- # kill -0 3165853 00:26:59.909 03:43:40 -- common/autotest_common.sh@941 -- # uname 00:26:59.909 03:43:40 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:59.909 03:43:40 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3165853 00:26:59.909 03:43:40 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:59.909 03:43:40 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:59.909 03:43:40 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3165853' 00:26:59.909 killing process with pid 3165853 00:26:59.909 03:43:40 -- common/autotest_common.sh@955 -- # kill 3165853 00:26:59.909 Received shutdown signal, test time was about 2.000000 seconds 00:26:59.909 00:26:59.909 Latency(us) 00:26:59.909 [2024-11-21T02:43:40.557Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:59.909 [2024-11-21T02:43:40.557Z] =================================================================================================================== 00:26:59.909 [2024-11-21T02:43:40.557Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:59.909 03:43:40 -- common/autotest_common.sh@960 -- # wait 3165853 00:27:00.168 03:43:40 -- host/digest.sh@108 -- # run_bperf_err randread 131072 16 00:27:00.168 03:43:40 -- host/digest.sh@54 -- # local rw bs qd 00:27:00.168 03:43:40 -- host/digest.sh@56 -- # rw=randread 00:27:00.168 03:43:40 -- host/digest.sh@56 -- # bs=131072 00:27:00.168 03:43:40 -- host/digest.sh@56 -- # qd=16 00:27:00.168 03:43:40 -- host/digest.sh@58 -- # bperfpid=3166403 00:27:00.168 03:43:40 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z 00:27:00.168 03:43:40 -- host/digest.sh@60 -- # waitforlisten 3166403 /var/tmp/bperf.sock 00:27:00.168 03:43:40 -- common/autotest_common.sh@829 -- # '[' -z 3166403 ']' 00:27:00.168 03:43:40 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:27:00.168 03:43:40 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:00.168 03:43:40 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:27:00.168 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:27:00.168 03:43:40 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:00.168 03:43:40 -- common/autotest_common.sh@10 -- # set +x 00:27:00.168 [2024-11-21 03:43:40.784971] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:00.168 [2024-11-21 03:43:40.785086] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3166403 ] 00:27:00.168 I/O size of 131072 is greater than zero copy threshold (65536). 00:27:00.168 Zero copy mechanism will not be used. 00:27:00.168 EAL: No free 2048 kB hugepages reported on node 1 00:27:00.428 [2024-11-21 03:43:40.843871] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:00.428 [2024-11-21 03:43:40.949653] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:01.364 03:43:41 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:01.364 03:43:41 -- common/autotest_common.sh@862 -- # return 0 00:27:01.364 03:43:41 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:01.364 03:43:41 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:01.624 03:43:42 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:27:01.624 03:43:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:01.624 03:43:42 -- common/autotest_common.sh@10 -- # set +x 00:27:01.624 03:43:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:01.624 03:43:42 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:01.624 03:43:42 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:01.883 nvme0n1 00:27:01.883 03:43:42 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:27:01.883 03:43:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:01.883 03:43:42 -- common/autotest_common.sh@10 -- # set +x 00:27:01.883 03:43:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:01.883 03:43:42 -- host/digest.sh@69 -- # bperf_py perform_tests 00:27:01.883 03:43:42 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:27:02.142 I/O size of 131072 is greater than zero copy threshold (65536). 00:27:02.142 Zero copy mechanism will not be used. 00:27:02.142 Running I/O for 2 seconds... 00:27:02.143 [2024-11-21 03:43:42.631100] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.143 [2024-11-21 03:43:42.631184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.143 [2024-11-21 03:43:42.631205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:02.143 [2024-11-21 03:43:42.637885] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.143 [2024-11-21 03:43:42.637919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.143 [2024-11-21 03:43:42.637939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:02.143 [2024-11-21 03:43:42.644568] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.143 [2024-11-21 03:43:42.644604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.143 [2024-11-21 03:43:42.644624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:02.143 [2024-11-21 03:43:42.651181] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.143 [2024-11-21 03:43:42.651227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.143 [2024-11-21 03:43:42.651245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:02.143 [2024-11-21 03:43:42.657726] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.143 [2024-11-21 03:43:42.657759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.143 [2024-11-21 03:43:42.657788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:02.143 [2024-11-21 03:43:42.664333] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.143 [2024-11-21 03:43:42.664379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.143 [2024-11-21 03:43:42.664399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:02.143 [2024-11-21 03:43:42.671017] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.143 [2024-11-21 03:43:42.671050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.143 [2024-11-21 03:43:42.671077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:02.143 [2024-11-21 03:43:42.678013] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.143 [2024-11-21 03:43:42.678048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.143 [2024-11-21 03:43:42.678075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:02.143 [2024-11-21 03:43:42.685035] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.143 [2024-11-21 03:43:42.685080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.143 [2024-11-21 03:43:42.685102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:02.143 [2024-11-21 03:43:42.691698] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.143 [2024-11-21 03:43:42.691732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.143 [2024-11-21 03:43:42.691751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:02.143 [2024-11-21 03:43:42.698214] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.143 [2024-11-21 03:43:42.698245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.143 [2024-11-21 03:43:42.698262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:02.143 [2024-11-21 03:43:42.704821] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.143 [2024-11-21 03:43:42.704855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.143 [2024-11-21 03:43:42.704874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:02.143 [2024-11-21 03:43:42.711559] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.143 [2024-11-21 03:43:42.711593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.143 [2024-11-21 03:43:42.711613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:02.143 [2024-11-21 03:43:42.718338] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.143 [2024-11-21 03:43:42.718378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.143 [2024-11-21 03:43:42.718414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:02.143 [2024-11-21 03:43:42.724975] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.143 [2024-11-21 03:43:42.725011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.143 [2024-11-21 03:43:42.725030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:02.143 [2024-11-21 03:43:42.732059] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.143 [2024-11-21 03:43:42.732105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.143 [2024-11-21 03:43:42.732125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:02.143 [2024-11-21 03:43:42.739341] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.143 [2024-11-21 03:43:42.739375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.143 [2024-11-21 03:43:42.739393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:02.143 [2024-11-21 03:43:42.746561] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.143 [2024-11-21 03:43:42.746597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.143 [2024-11-21 03:43:42.746617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:02.143 [2024-11-21 03:43:42.753671] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.143 [2024-11-21 03:43:42.753708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.143 [2024-11-21 03:43:42.753728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:02.143 [2024-11-21 03:43:42.760330] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.143 [2024-11-21 03:43:42.760361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.143 [2024-11-21 03:43:42.760396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:02.143 [2024-11-21 03:43:42.766478] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.143 [2024-11-21 03:43:42.766513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.143 [2024-11-21 03:43:42.766532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:02.143 [2024-11-21 03:43:42.771990] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.143 [2024-11-21 03:43:42.772026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.143 [2024-11-21 03:43:42.772044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:02.143 [2024-11-21 03:43:42.777618] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.143 [2024-11-21 03:43:42.777652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.143 [2024-11-21 03:43:42.777670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:02.143 [2024-11-21 03:43:42.784409] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.143 [2024-11-21 03:43:42.784454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.143 [2024-11-21 03:43:42.784470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:02.404 [2024-11-21 03:43:42.791389] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.404 [2024-11-21 03:43:42.791424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.404 [2024-11-21 03:43:42.791445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:02.404 [2024-11-21 03:43:42.798680] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.404 [2024-11-21 03:43:42.798714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.404 [2024-11-21 03:43:42.798734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:02.404 [2024-11-21 03:43:42.806985] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.404 [2024-11-21 03:43:42.807019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.404 [2024-11-21 03:43:42.807038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:02.404 [2024-11-21 03:43:42.815221] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.404 [2024-11-21 03:43:42.815253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.404 [2024-11-21 03:43:42.815271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:02.404 [2024-11-21 03:43:42.823497] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.404 [2024-11-21 03:43:42.823532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.404 [2024-11-21 03:43:42.823552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:02.404 [2024-11-21 03:43:42.832627] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.404 [2024-11-21 03:43:42.832662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.405 [2024-11-21 03:43:42.832682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:02.405 [2024-11-21 03:43:42.840179] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.405 [2024-11-21 03:43:42.840211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.405 [2024-11-21 03:43:42.840236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:02.405 [2024-11-21 03:43:42.845838] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.405 [2024-11-21 03:43:42.845876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.405 [2024-11-21 03:43:42.845895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:02.405 [2024-11-21 03:43:42.852176] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.405 [2024-11-21 03:43:42.852208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.405 [2024-11-21 03:43:42.852230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:02.405 [2024-11-21 03:43:42.857847] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.405 [2024-11-21 03:43:42.857887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.405 [2024-11-21 03:43:42.857907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:02.405 [2024-11-21 03:43:42.864187] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.405 [2024-11-21 03:43:42.864219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.405 [2024-11-21 03:43:42.864237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:02.405 [2024-11-21 03:43:42.870963] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.405 [2024-11-21 03:43:42.870997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.405 [2024-11-21 03:43:42.871016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:02.405 [2024-11-21 03:43:42.877326] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.405 [2024-11-21 03:43:42.877358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.405 [2024-11-21 03:43:42.877376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:02.405 [2024-11-21 03:43:42.884345] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.405 [2024-11-21 03:43:42.884395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.405 [2024-11-21 03:43:42.884414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:02.405 [2024-11-21 03:43:42.891920] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.405 [2024-11-21 03:43:42.891956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:7808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.405 [2024-11-21 03:43:42.891975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:02.405 [2024-11-21 03:43:42.901193] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.405 [2024-11-21 03:43:42.901240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.405 [2024-11-21 03:43:42.901259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:02.405 [2024-11-21 03:43:42.909946] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.405 [2024-11-21 03:43:42.909982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:11168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.405 [2024-11-21 03:43:42.910002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:02.405 [2024-11-21 03:43:42.918697] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.405 [2024-11-21 03:43:42.918733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:22848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.405 [2024-11-21 03:43:42.918753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:02.405 [2024-11-21 03:43:42.928087] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.405 [2024-11-21 03:43:42.928122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:12672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.405 [2024-11-21 03:43:42.928155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:02.405 [2024-11-21 03:43:42.937479] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.405 [2024-11-21 03:43:42.937515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.405 [2024-11-21 03:43:42.937536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:02.405 [2024-11-21 03:43:42.946188] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.405 [2024-11-21 03:43:42.946219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:11936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.405 [2024-11-21 03:43:42.946251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:02.405 [2024-11-21 03:43:42.954641] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.405 [2024-11-21 03:43:42.954677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.405 [2024-11-21 03:43:42.954697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:02.405 [2024-11-21 03:43:42.963428] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.405 [2024-11-21 03:43:42.963463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:13216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.405 [2024-11-21 03:43:42.963482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:02.405 [2024-11-21 03:43:42.970799] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.405 [2024-11-21 03:43:42.970834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.405 [2024-11-21 03:43:42.970860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:02.405 [2024-11-21 03:43:42.978734] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.405 [2024-11-21 03:43:42.978769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:9568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.405 [2024-11-21 03:43:42.978789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:02.405 [2024-11-21 03:43:42.987237] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.405 [2024-11-21 03:43:42.987268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:16544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.405 [2024-11-21 03:43:42.987286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:02.405 [2024-11-21 03:43:42.996118] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.405 [2024-11-21 03:43:42.996168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.405 [2024-11-21 03:43:42.996187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:02.405 [2024-11-21 03:43:43.002417] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.405 [2024-11-21 03:43:43.002453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:23744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.405 [2024-11-21 03:43:43.002472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:02.405 [2024-11-21 03:43:43.008320] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.405 [2024-11-21 03:43:43.008350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:20768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.405 [2024-11-21 03:43:43.008373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:02.405 [2024-11-21 03:43:43.014724] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.405 [2024-11-21 03:43:43.014759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:8512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.405 [2024-11-21 03:43:43.014778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:02.405 [2024-11-21 03:43:43.022257] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.405 [2024-11-21 03:43:43.022288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.405 [2024-11-21 03:43:43.022305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:02.405 [2024-11-21 03:43:43.029993] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.405 [2024-11-21 03:43:43.030028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.405 [2024-11-21 03:43:43.030047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:02.405 [2024-11-21 03:43:43.037839] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.405 [2024-11-21 03:43:43.037878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:10624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.406 [2024-11-21 03:43:43.037898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:02.406 [2024-11-21 03:43:43.045417] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.406 [2024-11-21 03:43:43.045464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.406 [2024-11-21 03:43:43.045483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:02.667 [2024-11-21 03:43:43.052712] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.667 [2024-11-21 03:43:43.052747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:3936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.667 [2024-11-21 03:43:43.052765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:02.667 [2024-11-21 03:43:43.060228] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.667 [2024-11-21 03:43:43.060258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:10944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.667 [2024-11-21 03:43:43.060274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:02.667 [2024-11-21 03:43:43.067514] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.667 [2024-11-21 03:43:43.067549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:5088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.667 [2024-11-21 03:43:43.067568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:02.667 [2024-11-21 03:43:43.075022] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.667 [2024-11-21 03:43:43.075057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:10976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.667 [2024-11-21 03:43:43.075084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:02.667 [2024-11-21 03:43:43.082125] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.667 [2024-11-21 03:43:43.082171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.667 [2024-11-21 03:43:43.082188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:02.667 [2024-11-21 03:43:43.089617] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.667 [2024-11-21 03:43:43.089652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:17440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.667 [2024-11-21 03:43:43.089671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:02.667 [2024-11-21 03:43:43.096787] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.667 [2024-11-21 03:43:43.096822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:2976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.667 [2024-11-21 03:43:43.096842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:02.668 [2024-11-21 03:43:43.104142] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.668 [2024-11-21 03:43:43.104173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:2016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.668 [2024-11-21 03:43:43.104204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:02.668 [2024-11-21 03:43:43.111483] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.668 [2024-11-21 03:43:43.111518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:7520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.668 [2024-11-21 03:43:43.111538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:02.668 [2024-11-21 03:43:43.120186] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.668 [2024-11-21 03:43:43.120216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:5344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.668 [2024-11-21 03:43:43.120233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:02.668 [2024-11-21 03:43:43.129481] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.668 [2024-11-21 03:43:43.129516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:13920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.668 [2024-11-21 03:43:43.129535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:02.668 [2024-11-21 03:43:43.139317] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.668 [2024-11-21 03:43:43.139363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:10592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.668 [2024-11-21 03:43:43.139380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:02.668 [2024-11-21 03:43:43.148580] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.668 [2024-11-21 03:43:43.148614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.668 [2024-11-21 03:43:43.148634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:02.668 [2024-11-21 03:43:43.157727] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.668 [2024-11-21 03:43:43.157762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.668 [2024-11-21 03:43:43.157781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:02.668 [2024-11-21 03:43:43.166002] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.668 [2024-11-21 03:43:43.166037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:18240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.668 [2024-11-21 03:43:43.166056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:02.668 [2024-11-21 03:43:43.174348] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.668 [2024-11-21 03:43:43.174401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:20128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.668 [2024-11-21 03:43:43.174426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:02.668 [2024-11-21 03:43:43.182553] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.668 [2024-11-21 03:43:43.182588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:5280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.668 [2024-11-21 03:43:43.182608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:02.668 [2024-11-21 03:43:43.191098] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.668 [2024-11-21 03:43:43.191147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:6784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.668 [2024-11-21 03:43:43.191164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:02.668 [2024-11-21 03:43:43.200381] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.668 [2024-11-21 03:43:43.200411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:8192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.668 [2024-11-21 03:43:43.200443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:02.668 [2024-11-21 03:43:43.210001] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.668 [2024-11-21 03:43:43.210036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.668 [2024-11-21 03:43:43.210056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:02.668 [2024-11-21 03:43:43.218993] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.668 [2024-11-21 03:43:43.219027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:20480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.668 [2024-11-21 03:43:43.219046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:02.668 [2024-11-21 03:43:43.226963] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.668 [2024-11-21 03:43:43.226998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:9536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.668 [2024-11-21 03:43:43.227018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:02.668 [2024-11-21 03:43:43.234730] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.668 [2024-11-21 03:43:43.234765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:8160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.668 [2024-11-21 03:43:43.234793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:02.668 [2024-11-21 03:43:43.241763] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.668 [2024-11-21 03:43:43.241797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.668 [2024-11-21 03:43:43.241817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:02.668 [2024-11-21 03:43:43.248717] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.668 [2024-11-21 03:43:43.248756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:8384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.668 [2024-11-21 03:43:43.248776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:02.668 [2024-11-21 03:43:43.255086] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.668 [2024-11-21 03:43:43.255120] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:10016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.668 [2024-11-21 03:43:43.255152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:02.668 [2024-11-21 03:43:43.261853] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.668 [2024-11-21 03:43:43.261886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:22624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.668 [2024-11-21 03:43:43.261905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:02.668 [2024-11-21 03:43:43.268527] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.668 [2024-11-21 03:43:43.268561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:5920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.668 [2024-11-21 03:43:43.268580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:02.668 [2024-11-21 03:43:43.275208] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.668 [2024-11-21 03:43:43.275237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:25344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.668 [2024-11-21 03:43:43.275253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:02.668 [2024-11-21 03:43:43.281978] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.668 [2024-11-21 03:43:43.282011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:6176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.668 [2024-11-21 03:43:43.282031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:02.668 [2024-11-21 03:43:43.288655] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.668 [2024-11-21 03:43:43.288687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:14560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.668 [2024-11-21 03:43:43.288706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:02.668 [2024-11-21 03:43:43.295980] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.668 [2024-11-21 03:43:43.296013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.668 [2024-11-21 03:43:43.296031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:02.668 [2024-11-21 03:43:43.305044] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.668 [2024-11-21 03:43:43.305086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:10560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.668 [2024-11-21 03:43:43.305106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:02.930 [2024-11-21 03:43:43.313735] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.930 [2024-11-21 03:43:43.313770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:21056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.930 [2024-11-21 03:43:43.313790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:02.930 [2024-11-21 03:43:43.320913] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.930 [2024-11-21 03:43:43.320948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:6912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.930 [2024-11-21 03:43:43.320967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:02.930 [2024-11-21 03:43:43.328781] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.931 [2024-11-21 03:43:43.328816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:2400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.931 [2024-11-21 03:43:43.328835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:02.931 [2024-11-21 03:43:43.336870] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.931 [2024-11-21 03:43:43.336904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:21504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.931 [2024-11-21 03:43:43.336924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:02.931 [2024-11-21 03:43:43.346716] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.931 [2024-11-21 03:43:43.346750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:6496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.931 [2024-11-21 03:43:43.346769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:02.931 [2024-11-21 03:43:43.354279] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.931 [2024-11-21 03:43:43.354310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:16896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.931 [2024-11-21 03:43:43.354327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:02.931 [2024-11-21 03:43:43.361575] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.931 [2024-11-21 03:43:43.361609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:10720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.931 [2024-11-21 03:43:43.361627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:02.931 [2024-11-21 03:43:43.369115] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.931 [2024-11-21 03:43:43.369160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:14752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.931 [2024-11-21 03:43:43.369177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:02.931 [2024-11-21 03:43:43.376390] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.931 [2024-11-21 03:43:43.376434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:10112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.931 [2024-11-21 03:43:43.376462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:02.931 [2024-11-21 03:43:43.384026] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.931 [2024-11-21 03:43:43.384062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.931 [2024-11-21 03:43:43.384091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:02.931 [2024-11-21 03:43:43.391614] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.931 [2024-11-21 03:43:43.391648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:15968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.931 [2024-11-21 03:43:43.391667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:02.931 [2024-11-21 03:43:43.398322] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.931 [2024-11-21 03:43:43.398352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:11872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.931 [2024-11-21 03:43:43.398370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:02.931 [2024-11-21 03:43:43.405152] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.931 [2024-11-21 03:43:43.405181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:10368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.931 [2024-11-21 03:43:43.405197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:02.931 [2024-11-21 03:43:43.411942] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.931 [2024-11-21 03:43:43.411977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:7808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.931 [2024-11-21 03:43:43.411996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:02.931 [2024-11-21 03:43:43.418168] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.931 [2024-11-21 03:43:43.418198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:12864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.931 [2024-11-21 03:43:43.418215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:02.931 [2024-11-21 03:43:43.425449] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.931 [2024-11-21 03:43:43.425485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:15648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.931 [2024-11-21 03:43:43.425504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:02.931 [2024-11-21 03:43:43.433883] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.931 [2024-11-21 03:43:43.433916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.931 [2024-11-21 03:43:43.433936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:02.931 [2024-11-21 03:43:43.442298] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.931 [2024-11-21 03:43:43.442335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:17600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.931 [2024-11-21 03:43:43.442352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:02.931 [2024-11-21 03:43:43.449539] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.931 [2024-11-21 03:43:43.449573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:10752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.931 [2024-11-21 03:43:43.449593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:02.931 [2024-11-21 03:43:43.457153] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.931 [2024-11-21 03:43:43.457184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:14848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.931 [2024-11-21 03:43:43.457201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:02.931 [2024-11-21 03:43:43.465644] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.931 [2024-11-21 03:43:43.465680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:4256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.931 [2024-11-21 03:43:43.465699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:02.931 [2024-11-21 03:43:43.472901] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.931 [2024-11-21 03:43:43.472935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:14816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.931 [2024-11-21 03:43:43.472953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:02.931 [2024-11-21 03:43:43.481718] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.931 [2024-11-21 03:43:43.481753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.931 [2024-11-21 03:43:43.481772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:02.931 [2024-11-21 03:43:43.489459] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.931 [2024-11-21 03:43:43.489494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:23456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.931 [2024-11-21 03:43:43.489513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:02.931 [2024-11-21 03:43:43.497687] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.931 [2024-11-21 03:43:43.497721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:11744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.931 [2024-11-21 03:43:43.497740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:02.931 [2024-11-21 03:43:43.506233] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.931 [2024-11-21 03:43:43.506263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:11040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.931 [2024-11-21 03:43:43.506280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:02.931 [2024-11-21 03:43:43.514857] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.931 [2024-11-21 03:43:43.514891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:18272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.931 [2024-11-21 03:43:43.514909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:02.931 [2024-11-21 03:43:43.520651] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.931 [2024-11-21 03:43:43.520686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:13888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.931 [2024-11-21 03:43:43.520714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:02.931 [2024-11-21 03:43:43.527458] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.931 [2024-11-21 03:43:43.527492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:18880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.931 [2024-11-21 03:43:43.527511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:02.932 [2024-11-21 03:43:43.534932] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.932 [2024-11-21 03:43:43.534966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:5056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.932 [2024-11-21 03:43:43.534985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:02.932 [2024-11-21 03:43:43.544008] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.932 [2024-11-21 03:43:43.544042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:7392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.932 [2024-11-21 03:43:43.544061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:02.932 [2024-11-21 03:43:43.552857] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.932 [2024-11-21 03:43:43.552890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:24672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.932 [2024-11-21 03:43:43.552910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:02.932 [2024-11-21 03:43:43.561836] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.932 [2024-11-21 03:43:43.561871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:22048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.932 [2024-11-21 03:43:43.561890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:02.932 [2024-11-21 03:43:43.571192] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:02.932 [2024-11-21 03:43:43.571223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:5504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:02.932 [2024-11-21 03:43:43.571239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.194 [2024-11-21 03:43:43.580651] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.194 [2024-11-21 03:43:43.580687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:13888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.194 [2024-11-21 03:43:43.580717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.194 [2024-11-21 03:43:43.588822] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.194 [2024-11-21 03:43:43.588861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.194 [2024-11-21 03:43:43.588880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.194 [2024-11-21 03:43:43.596729] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.194 [2024-11-21 03:43:43.596765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:25344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.194 [2024-11-21 03:43:43.596786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.194 [2024-11-21 03:43:43.603464] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.194 [2024-11-21 03:43:43.603499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:8096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.194 [2024-11-21 03:43:43.603523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.194 [2024-11-21 03:43:43.612285] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.194 [2024-11-21 03:43:43.612331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:21024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.194 [2024-11-21 03:43:43.612349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.194 [2024-11-21 03:43:43.621695] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.194 [2024-11-21 03:43:43.621730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.194 [2024-11-21 03:43:43.621750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.194 [2024-11-21 03:43:43.630121] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.194 [2024-11-21 03:43:43.630169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:21120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.194 [2024-11-21 03:43:43.630186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.194 [2024-11-21 03:43:43.638329] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.194 [2024-11-21 03:43:43.638360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:12192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.195 [2024-11-21 03:43:43.638395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.195 [2024-11-21 03:43:43.645336] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.195 [2024-11-21 03:43:43.645383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:17888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.195 [2024-11-21 03:43:43.645402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.195 [2024-11-21 03:43:43.652613] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.195 [2024-11-21 03:43:43.652654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:2688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.195 [2024-11-21 03:43:43.652674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.195 [2024-11-21 03:43:43.659460] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.195 [2024-11-21 03:43:43.659494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:7232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.195 [2024-11-21 03:43:43.659513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.195 [2024-11-21 03:43:43.666789] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.195 [2024-11-21 03:43:43.666823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:1280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.195 [2024-11-21 03:43:43.666841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.195 [2024-11-21 03:43:43.673958] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.195 [2024-11-21 03:43:43.673992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:2112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.195 [2024-11-21 03:43:43.674011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.195 [2024-11-21 03:43:43.681366] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.195 [2024-11-21 03:43:43.681414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:23328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.195 [2024-11-21 03:43:43.681433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.195 [2024-11-21 03:43:43.688625] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.195 [2024-11-21 03:43:43.688659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:20032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.195 [2024-11-21 03:43:43.688678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.195 [2024-11-21 03:43:43.695974] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.195 [2024-11-21 03:43:43.696009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:13568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.195 [2024-11-21 03:43:43.696028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.195 [2024-11-21 03:43:43.703025] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.195 [2024-11-21 03:43:43.703059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:10752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.195 [2024-11-21 03:43:43.703089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.195 [2024-11-21 03:43:43.710326] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.195 [2024-11-21 03:43:43.710371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:21856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.195 [2024-11-21 03:43:43.710391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.195 [2024-11-21 03:43:43.717421] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.195 [2024-11-21 03:43:43.717456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.195 [2024-11-21 03:43:43.717475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.195 [2024-11-21 03:43:43.724517] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.195 [2024-11-21 03:43:43.724551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:6976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.195 [2024-11-21 03:43:43.724571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.195 [2024-11-21 03:43:43.731900] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.195 [2024-11-21 03:43:43.731935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:9824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.195 [2024-11-21 03:43:43.731954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.195 [2024-11-21 03:43:43.739176] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.195 [2024-11-21 03:43:43.739207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:24544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.195 [2024-11-21 03:43:43.739224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.195 [2024-11-21 03:43:43.746817] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.195 [2024-11-21 03:43:43.746851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:10496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.195 [2024-11-21 03:43:43.746872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.195 [2024-11-21 03:43:43.754697] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.195 [2024-11-21 03:43:43.754732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:8480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.195 [2024-11-21 03:43:43.754751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.195 [2024-11-21 03:43:43.761968] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.195 [2024-11-21 03:43:43.762002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:17920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.195 [2024-11-21 03:43:43.762021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.195 [2024-11-21 03:43:43.766809] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.195 [2024-11-21 03:43:43.766843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:25312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.195 [2024-11-21 03:43:43.766862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.195 [2024-11-21 03:43:43.775231] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.195 [2024-11-21 03:43:43.775262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:8128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.195 [2024-11-21 03:43:43.775285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.195 [2024-11-21 03:43:43.784708] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.195 [2024-11-21 03:43:43.784742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:1536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.195 [2024-11-21 03:43:43.784761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.195 [2024-11-21 03:43:43.794060] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.195 [2024-11-21 03:43:43.794107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.195 [2024-11-21 03:43:43.794127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.195 [2024-11-21 03:43:43.803187] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.195 [2024-11-21 03:43:43.803232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:12544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.195 [2024-11-21 03:43:43.803248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.195 [2024-11-21 03:43:43.812739] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.195 [2024-11-21 03:43:43.812772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:1664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.195 [2024-11-21 03:43:43.812791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.195 [2024-11-21 03:43:43.821171] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.195 [2024-11-21 03:43:43.821200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.195 [2024-11-21 03:43:43.821216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.195 [2024-11-21 03:43:43.830662] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.195 [2024-11-21 03:43:43.830698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.195 [2024-11-21 03:43:43.830717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.456 [2024-11-21 03:43:43.839877] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.456 [2024-11-21 03:43:43.839913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:21120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.456 [2024-11-21 03:43:43.839933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.456 [2024-11-21 03:43:43.847770] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.456 [2024-11-21 03:43:43.847805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:23840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.456 [2024-11-21 03:43:43.847824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.456 [2024-11-21 03:43:43.855327] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.456 [2024-11-21 03:43:43.855356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:4288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.456 [2024-11-21 03:43:43.855372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.456 [2024-11-21 03:43:43.863578] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.456 [2024-11-21 03:43:43.863613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:10496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.456 [2024-11-21 03:43:43.863632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.456 [2024-11-21 03:43:43.872705] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.456 [2024-11-21 03:43:43.872741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:11776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.456 [2024-11-21 03:43:43.872760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.456 [2024-11-21 03:43:43.880996] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.456 [2024-11-21 03:43:43.881032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:15808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.457 [2024-11-21 03:43:43.881051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.457 [2024-11-21 03:43:43.888924] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.457 [2024-11-21 03:43:43.888959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:15200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.457 [2024-11-21 03:43:43.888978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.457 [2024-11-21 03:43:43.896455] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.457 [2024-11-21 03:43:43.896490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:22464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.457 [2024-11-21 03:43:43.896509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.457 [2024-11-21 03:43:43.903654] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.457 [2024-11-21 03:43:43.903689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:1984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.457 [2024-11-21 03:43:43.903708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.457 [2024-11-21 03:43:43.911022] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.457 [2024-11-21 03:43:43.911056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:5184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.457 [2024-11-21 03:43:43.911086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.457 [2024-11-21 03:43:43.918608] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.457 [2024-11-21 03:43:43.918643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:25312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.457 [2024-11-21 03:43:43.918668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.457 [2024-11-21 03:43:43.926318] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.457 [2024-11-21 03:43:43.926347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:15488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.457 [2024-11-21 03:43:43.926363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.457 [2024-11-21 03:43:43.934263] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.457 [2024-11-21 03:43:43.934295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:9824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.457 [2024-11-21 03:43:43.934327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.457 [2024-11-21 03:43:43.941635] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.457 [2024-11-21 03:43:43.941670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.457 [2024-11-21 03:43:43.941689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.457 [2024-11-21 03:43:43.948933] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.457 [2024-11-21 03:43:43.948968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:5248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.457 [2024-11-21 03:43:43.948988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.457 [2024-11-21 03:43:43.956081] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.457 [2024-11-21 03:43:43.956116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:15456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.457 [2024-11-21 03:43:43.956149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.457 [2024-11-21 03:43:43.963678] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.457 [2024-11-21 03:43:43.963714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:13856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.457 [2024-11-21 03:43:43.963734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.457 [2024-11-21 03:43:43.971188] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.457 [2024-11-21 03:43:43.971220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.457 [2024-11-21 03:43:43.971237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.457 [2024-11-21 03:43:43.978138] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.457 [2024-11-21 03:43:43.978170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:13280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.457 [2024-11-21 03:43:43.978187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.457 [2024-11-21 03:43:43.985508] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.457 [2024-11-21 03:43:43.985549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:4672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.457 [2024-11-21 03:43:43.985569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.457 [2024-11-21 03:43:43.992999] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.457 [2024-11-21 03:43:43.993034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:19840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.457 [2024-11-21 03:43:43.993053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.457 [2024-11-21 03:43:44.000569] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.457 [2024-11-21 03:43:44.000604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:22688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.457 [2024-11-21 03:43:44.000623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.457 [2024-11-21 03:43:44.008152] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.457 [2024-11-21 03:43:44.008183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:23168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.457 [2024-11-21 03:43:44.008201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.457 [2024-11-21 03:43:44.015531] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.457 [2024-11-21 03:43:44.015566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:16128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.457 [2024-11-21 03:43:44.015585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.457 [2024-11-21 03:43:44.022514] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.457 [2024-11-21 03:43:44.022547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:17664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.457 [2024-11-21 03:43:44.022566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.457 [2024-11-21 03:43:44.029164] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.457 [2024-11-21 03:43:44.029194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:7680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.457 [2024-11-21 03:43:44.029210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.457 [2024-11-21 03:43:44.036012] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.457 [2024-11-21 03:43:44.036048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:9120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.457 [2024-11-21 03:43:44.036067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.457 [2024-11-21 03:43:44.043062] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.457 [2024-11-21 03:43:44.043118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:20896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.457 [2024-11-21 03:43:44.043135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.457 [2024-11-21 03:43:44.051280] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.457 [2024-11-21 03:43:44.051309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:22272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.457 [2024-11-21 03:43:44.051326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.457 [2024-11-21 03:43:44.058476] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.457 [2024-11-21 03:43:44.058511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:18176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.457 [2024-11-21 03:43:44.058530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.457 [2024-11-21 03:43:44.066083] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.457 [2024-11-21 03:43:44.066118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:1184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.457 [2024-11-21 03:43:44.066150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.457 [2024-11-21 03:43:44.073393] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.457 [2024-11-21 03:43:44.073428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:13056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.457 [2024-11-21 03:43:44.073447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.457 [2024-11-21 03:43:44.080011] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.458 [2024-11-21 03:43:44.080045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:21504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.458 [2024-11-21 03:43:44.080063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.458 [2024-11-21 03:43:44.086858] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.458 [2024-11-21 03:43:44.086891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:25472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.458 [2024-11-21 03:43:44.086910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.458 [2024-11-21 03:43:44.093694] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.458 [2024-11-21 03:43:44.093728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:17696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.458 [2024-11-21 03:43:44.093747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.458 [2024-11-21 03:43:44.100490] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.458 [2024-11-21 03:43:44.100523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:13856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.458 [2024-11-21 03:43:44.100542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.717 [2024-11-21 03:43:44.107269] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.717 [2024-11-21 03:43:44.107298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:8800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.717 [2024-11-21 03:43:44.107320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.717 [2024-11-21 03:43:44.113924] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.717 [2024-11-21 03:43:44.113957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:14720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.717 [2024-11-21 03:43:44.113975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.717 [2024-11-21 03:43:44.120659] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.717 [2024-11-21 03:43:44.120692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:10848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.717 [2024-11-21 03:43:44.120711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.717 [2024-11-21 03:43:44.127147] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.717 [2024-11-21 03:43:44.127176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:11232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.717 [2024-11-21 03:43:44.127192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.717 [2024-11-21 03:43:44.133665] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.718 [2024-11-21 03:43:44.133698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:1664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.718 [2024-11-21 03:43:44.133717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.718 [2024-11-21 03:43:44.140568] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.718 [2024-11-21 03:43:44.140603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:4320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.718 [2024-11-21 03:43:44.140621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.718 [2024-11-21 03:43:44.147512] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.718 [2024-11-21 03:43:44.147546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:16416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.718 [2024-11-21 03:43:44.147565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.718 [2024-11-21 03:43:44.154039] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.718 [2024-11-21 03:43:44.154082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:15168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.718 [2024-11-21 03:43:44.154103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.718 [2024-11-21 03:43:44.160816] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.718 [2024-11-21 03:43:44.160849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.718 [2024-11-21 03:43:44.160868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.718 [2024-11-21 03:43:44.167710] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.718 [2024-11-21 03:43:44.167750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:25472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.718 [2024-11-21 03:43:44.167769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.718 [2024-11-21 03:43:44.173728] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.718 [2024-11-21 03:43:44.173763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:24448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.718 [2024-11-21 03:43:44.173782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.718 [2024-11-21 03:43:44.180540] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.718 [2024-11-21 03:43:44.180574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:4384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.718 [2024-11-21 03:43:44.180593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.718 [2024-11-21 03:43:44.187355] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.718 [2024-11-21 03:43:44.187403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:6176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.718 [2024-11-21 03:43:44.187422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.718 [2024-11-21 03:43:44.193429] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.718 [2024-11-21 03:43:44.193462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:24960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.718 [2024-11-21 03:43:44.193481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.718 [2024-11-21 03:43:44.198753] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.718 [2024-11-21 03:43:44.198786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:22560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.718 [2024-11-21 03:43:44.198804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.718 [2024-11-21 03:43:44.203936] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.718 [2024-11-21 03:43:44.203969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:18592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.718 [2024-11-21 03:43:44.203988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.718 [2024-11-21 03:43:44.209127] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.718 [2024-11-21 03:43:44.209157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:15488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.718 [2024-11-21 03:43:44.209174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.718 [2024-11-21 03:43:44.214460] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.718 [2024-11-21 03:43:44.214492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:20608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.718 [2024-11-21 03:43:44.214511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.718 [2024-11-21 03:43:44.219697] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.718 [2024-11-21 03:43:44.219731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:23360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.718 [2024-11-21 03:43:44.219750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.718 [2024-11-21 03:43:44.225986] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.718 [2024-11-21 03:43:44.226020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:13920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.718 [2024-11-21 03:43:44.226039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.718 [2024-11-21 03:43:44.232029] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.718 [2024-11-21 03:43:44.232063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:16512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.718 [2024-11-21 03:43:44.232094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.718 [2024-11-21 03:43:44.237832] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.718 [2024-11-21 03:43:44.237865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:10432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.718 [2024-11-21 03:43:44.237885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.718 [2024-11-21 03:43:44.243882] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.718 [2024-11-21 03:43:44.243915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:8320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.718 [2024-11-21 03:43:44.243933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.718 [2024-11-21 03:43:44.249559] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.718 [2024-11-21 03:43:44.249593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:22912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.718 [2024-11-21 03:43:44.249611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.718 [2024-11-21 03:43:44.256017] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.718 [2024-11-21 03:43:44.256051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:23136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.718 [2024-11-21 03:43:44.256078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.718 [2024-11-21 03:43:44.262179] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.718 [2024-11-21 03:43:44.262214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:13312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.718 [2024-11-21 03:43:44.262233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.718 [2024-11-21 03:43:44.269639] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.718 [2024-11-21 03:43:44.269674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:22848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.718 [2024-11-21 03:43:44.269699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.718 [2024-11-21 03:43:44.276008] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.718 [2024-11-21 03:43:44.276042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.718 [2024-11-21 03:43:44.276061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.718 [2024-11-21 03:43:44.281517] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.718 [2024-11-21 03:43:44.281550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:24256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.718 [2024-11-21 03:43:44.281570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.718 [2024-11-21 03:43:44.287730] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.718 [2024-11-21 03:43:44.287764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:23136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.718 [2024-11-21 03:43:44.287784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.718 [2024-11-21 03:43:44.293161] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.718 [2024-11-21 03:43:44.293190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:18656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.719 [2024-11-21 03:43:44.293207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.719 [2024-11-21 03:43:44.301007] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.719 [2024-11-21 03:43:44.301041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:23936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.719 [2024-11-21 03:43:44.301060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.719 [2024-11-21 03:43:44.309284] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.719 [2024-11-21 03:43:44.309313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:2048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.719 [2024-11-21 03:43:44.309329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.719 [2024-11-21 03:43:44.317966] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.719 [2024-11-21 03:43:44.317999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:21920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.719 [2024-11-21 03:43:44.318019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.719 [2024-11-21 03:43:44.325861] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.719 [2024-11-21 03:43:44.325897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:5376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.719 [2024-11-21 03:43:44.325916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.719 [2024-11-21 03:43:44.332896] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.719 [2024-11-21 03:43:44.332936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:11872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.719 [2024-11-21 03:43:44.332956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.719 [2024-11-21 03:43:44.339762] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.719 [2024-11-21 03:43:44.339797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:2752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.719 [2024-11-21 03:43:44.339816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.719 [2024-11-21 03:43:44.348173] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.719 [2024-11-21 03:43:44.348218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:17856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.719 [2024-11-21 03:43:44.348236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.719 [2024-11-21 03:43:44.356608] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.719 [2024-11-21 03:43:44.356642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:15552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.719 [2024-11-21 03:43:44.356662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.978 [2024-11-21 03:43:44.364415] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.978 [2024-11-21 03:43:44.364464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:23648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.978 [2024-11-21 03:43:44.364484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.978 [2024-11-21 03:43:44.372789] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.978 [2024-11-21 03:43:44.372823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:12576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.978 [2024-11-21 03:43:44.372842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.978 [2024-11-21 03:43:44.380738] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.978 [2024-11-21 03:43:44.380773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:13472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.978 [2024-11-21 03:43:44.380793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.978 [2024-11-21 03:43:44.388933] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.978 [2024-11-21 03:43:44.388968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:5600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.978 [2024-11-21 03:43:44.388987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.978 [2024-11-21 03:43:44.396786] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.978 [2024-11-21 03:43:44.396821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:17472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.978 [2024-11-21 03:43:44.396840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.978 [2024-11-21 03:43:44.405515] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.978 [2024-11-21 03:43:44.405550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:15264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.978 [2024-11-21 03:43:44.405569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.978 [2024-11-21 03:43:44.413420] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.978 [2024-11-21 03:43:44.413454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:12896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.978 [2024-11-21 03:43:44.413474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.978 [2024-11-21 03:43:44.421304] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.978 [2024-11-21 03:43:44.421345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:1952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.978 [2024-11-21 03:43:44.421377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.978 [2024-11-21 03:43:44.429344] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.978 [2024-11-21 03:43:44.429390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:23872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.978 [2024-11-21 03:43:44.429406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.978 [2024-11-21 03:43:44.437602] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.978 [2024-11-21 03:43:44.437637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:19680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.978 [2024-11-21 03:43:44.437656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.978 [2024-11-21 03:43:44.445056] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.978 [2024-11-21 03:43:44.445099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:2240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.978 [2024-11-21 03:43:44.445119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.979 [2024-11-21 03:43:44.451757] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.979 [2024-11-21 03:43:44.451791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:17280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.979 [2024-11-21 03:43:44.451810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.979 [2024-11-21 03:43:44.458648] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.979 [2024-11-21 03:43:44.458682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:15392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.979 [2024-11-21 03:43:44.458700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.979 [2024-11-21 03:43:44.465525] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.979 [2024-11-21 03:43:44.465560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:22848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.979 [2024-11-21 03:43:44.465585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.979 [2024-11-21 03:43:44.472839] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.979 [2024-11-21 03:43:44.472874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.979 [2024-11-21 03:43:44.472894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.979 [2024-11-21 03:43:44.479578] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.979 [2024-11-21 03:43:44.479611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:13504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.979 [2024-11-21 03:43:44.479630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.979 [2024-11-21 03:43:44.486454] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.979 [2024-11-21 03:43:44.486488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:21472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.979 [2024-11-21 03:43:44.486506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.979 [2024-11-21 03:43:44.493498] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.979 [2024-11-21 03:43:44.493532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:18176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.979 [2024-11-21 03:43:44.493552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.979 [2024-11-21 03:43:44.500249] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.979 [2024-11-21 03:43:44.500293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:8544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.979 [2024-11-21 03:43:44.500309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.979 [2024-11-21 03:43:44.506922] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.979 [2024-11-21 03:43:44.506955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:18752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.979 [2024-11-21 03:43:44.506973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.979 [2024-11-21 03:43:44.513919] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.979 [2024-11-21 03:43:44.513952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.979 [2024-11-21 03:43:44.513971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.979 [2024-11-21 03:43:44.520735] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.979 [2024-11-21 03:43:44.520768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:25312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.979 [2024-11-21 03:43:44.520787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.979 [2024-11-21 03:43:44.527727] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.979 [2024-11-21 03:43:44.527770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:9600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.979 [2024-11-21 03:43:44.527790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.979 [2024-11-21 03:43:44.534515] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.979 [2024-11-21 03:43:44.534548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:15360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.979 [2024-11-21 03:43:44.534566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.979 [2024-11-21 03:43:44.541462] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.979 [2024-11-21 03:43:44.541495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:16256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.979 [2024-11-21 03:43:44.541514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.979 [2024-11-21 03:43:44.548192] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.979 [2024-11-21 03:43:44.548221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:2848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.979 [2024-11-21 03:43:44.548237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.979 [2024-11-21 03:43:44.554906] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.979 [2024-11-21 03:43:44.554938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:4608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.979 [2024-11-21 03:43:44.554957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.979 [2024-11-21 03:43:44.561664] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.979 [2024-11-21 03:43:44.561697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.979 [2024-11-21 03:43:44.561719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.979 [2024-11-21 03:43:44.566972] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.979 [2024-11-21 03:43:44.567012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:3936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.979 [2024-11-21 03:43:44.567030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.979 [2024-11-21 03:43:44.572303] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.979 [2024-11-21 03:43:44.572332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:23584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.979 [2024-11-21 03:43:44.572347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.979 [2024-11-21 03:43:44.577641] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.979 [2024-11-21 03:43:44.577673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:2816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.979 [2024-11-21 03:43:44.577701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.979 [2024-11-21 03:43:44.582983] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.979 [2024-11-21 03:43:44.583017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:12480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.979 [2024-11-21 03:43:44.583036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.979 [2024-11-21 03:43:44.588350] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.979 [2024-11-21 03:43:44.588397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:25536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.979 [2024-11-21 03:43:44.588415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.979 [2024-11-21 03:43:44.593527] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.979 [2024-11-21 03:43:44.593559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:1120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.979 [2024-11-21 03:43:44.593577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:03.979 [2024-11-21 03:43:44.598850] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.979 [2024-11-21 03:43:44.598882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.979 [2024-11-21 03:43:44.598900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:03.979 [2024-11-21 03:43:44.604184] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.979 [2024-11-21 03:43:44.604213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:15232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.979 [2024-11-21 03:43:44.604229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:03.979 [2024-11-21 03:43:44.610265] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.979 [2024-11-21 03:43:44.610295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:25024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.979 [2024-11-21 03:43:44.610312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:03.979 [2024-11-21 03:43:44.616950] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:03.979 [2024-11-21 03:43:44.616989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:3168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:03.979 [2024-11-21 03:43:44.617008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:04.238 [2024-11-21 03:43:44.623864] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x975bb0) 00:27:04.238 [2024-11-21 03:43:44.623897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:4032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:04.238 [2024-11-21 03:43:44.623916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:04.238 00:27:04.238 Latency(us) 00:27:04.238 [2024-11-21T02:43:44.886Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:04.238 [2024-11-21T02:43:44.886Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:27:04.238 nvme0n1 : 2.00 4210.14 526.27 0.00 0.00 3794.41 1074.06 12087.75 00:27:04.238 [2024-11-21T02:43:44.886Z] =================================================================================================================== 00:27:04.238 [2024-11-21T02:43:44.886Z] Total : 4210.14 526.27 0.00 0.00 3794.41 1074.06 12087.75 00:27:04.238 0 00:27:04.238 03:43:44 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:27:04.238 03:43:44 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:27:04.238 03:43:44 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:27:04.238 03:43:44 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:27:04.238 | .driver_specific 00:27:04.238 | .nvme_error 00:27:04.238 | .status_code 00:27:04.238 | .command_transient_transport_error' 00:27:04.497 03:43:44 -- host/digest.sh@71 -- # (( 272 > 0 )) 00:27:04.497 03:43:44 -- host/digest.sh@73 -- # killprocess 3166403 00:27:04.497 03:43:44 -- common/autotest_common.sh@936 -- # '[' -z 3166403 ']' 00:27:04.497 03:43:44 -- common/autotest_common.sh@940 -- # kill -0 3166403 00:27:04.497 03:43:44 -- common/autotest_common.sh@941 -- # uname 00:27:04.497 03:43:44 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:04.497 03:43:44 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3166403 00:27:04.497 03:43:44 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:04.497 03:43:44 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:04.497 03:43:44 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3166403' 00:27:04.497 killing process with pid 3166403 00:27:04.497 03:43:44 -- common/autotest_common.sh@955 -- # kill 3166403 00:27:04.497 Received shutdown signal, test time was about 2.000000 seconds 00:27:04.497 00:27:04.497 Latency(us) 00:27:04.497 [2024-11-21T02:43:45.145Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:04.497 [2024-11-21T02:43:45.145Z] =================================================================================================================== 00:27:04.497 [2024-11-21T02:43:45.145Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:27:04.497 03:43:44 -- common/autotest_common.sh@960 -- # wait 3166403 00:27:04.756 03:43:45 -- host/digest.sh@113 -- # run_bperf_err randwrite 4096 128 00:27:04.756 03:43:45 -- host/digest.sh@54 -- # local rw bs qd 00:27:04.756 03:43:45 -- host/digest.sh@56 -- # rw=randwrite 00:27:04.756 03:43:45 -- host/digest.sh@56 -- # bs=4096 00:27:04.756 03:43:45 -- host/digest.sh@56 -- # qd=128 00:27:04.756 03:43:45 -- host/digest.sh@58 -- # bperfpid=3166955 00:27:04.756 03:43:45 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z 00:27:04.756 03:43:45 -- host/digest.sh@60 -- # waitforlisten 3166955 /var/tmp/bperf.sock 00:27:04.756 03:43:45 -- common/autotest_common.sh@829 -- # '[' -z 3166955 ']' 00:27:04.756 03:43:45 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:27:04.756 03:43:45 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:04.756 03:43:45 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:27:04.756 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:27:04.756 03:43:45 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:04.756 03:43:45 -- common/autotest_common.sh@10 -- # set +x 00:27:04.756 [2024-11-21 03:43:45.243768] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:04.756 [2024-11-21 03:43:45.243838] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3166955 ] 00:27:04.756 EAL: No free 2048 kB hugepages reported on node 1 00:27:04.756 [2024-11-21 03:43:45.305798] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:05.015 [2024-11-21 03:43:45.417985] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:05.580 03:43:46 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:05.581 03:43:46 -- common/autotest_common.sh@862 -- # return 0 00:27:05.581 03:43:46 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:05.581 03:43:46 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:05.839 03:43:46 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:27:05.839 03:43:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:05.839 03:43:46 -- common/autotest_common.sh@10 -- # set +x 00:27:05.839 03:43:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:05.839 03:43:46 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:05.839 03:43:46 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:06.404 nvme0n1 00:27:06.404 03:43:46 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:27:06.404 03:43:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:06.404 03:43:46 -- common/autotest_common.sh@10 -- # set +x 00:27:06.404 03:43:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:06.404 03:43:46 -- host/digest.sh@69 -- # bperf_py perform_tests 00:27:06.404 03:43:46 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:27:06.662 Running I/O for 2 seconds... 00:27:06.662 [2024-11-21 03:43:47.069529] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190edd58 00:27:06.662 [2024-11-21 03:43:47.070583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:2622 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.662 [2024-11-21 03:43:47.070636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:004a p:0 m:0 dnr:0 00:27:06.662 [2024-11-21 03:43:47.081906] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190e88f8 00:27:06.662 [2024-11-21 03:43:47.083022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:21107 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.662 [2024-11-21 03:43:47.083057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:004b p:0 m:0 dnr:0 00:27:06.662 [2024-11-21 03:43:47.094329] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190df550 00:27:06.662 [2024-11-21 03:43:47.095501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:19369 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.662 [2024-11-21 03:43:47.095550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:004a p:0 m:0 dnr:0 00:27:06.662 [2024-11-21 03:43:47.106741] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190eea00 00:27:06.662 [2024-11-21 03:43:47.107909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:12300 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.662 [2024-11-21 03:43:47.107943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0049 p:0 m:0 dnr:0 00:27:06.662 [2024-11-21 03:43:47.119042] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190eaab8 00:27:06.662 [2024-11-21 03:43:47.120207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:14209 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.662 [2024-11-21 03:43:47.120236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0048 p:0 m:0 dnr:0 00:27:06.662 [2024-11-21 03:43:47.131308] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190e7818 00:27:06.662 [2024-11-21 03:43:47.132513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:141 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.662 [2024-11-21 03:43:47.132572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0047 p:0 m:0 dnr:0 00:27:06.663 [2024-11-21 03:43:47.143554] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190df988 00:27:06.663 [2024-11-21 03:43:47.144787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:3557 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.663 [2024-11-21 03:43:47.144817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:16 cdw0:0 sqhd:0046 p:0 m:0 dnr:0 00:27:06.663 [2024-11-21 03:43:47.156099] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190e4578 00:27:06.663 [2024-11-21 03:43:47.157181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:24998 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.663 [2024-11-21 03:43:47.157210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:0046 p:0 m:0 dnr:0 00:27:06.663 [2024-11-21 03:43:47.168403] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190df988 00:27:06.663 [2024-11-21 03:43:47.169469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:4613 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.663 [2024-11-21 03:43:47.169499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:83 cdw0:0 sqhd:0045 p:0 m:0 dnr:0 00:27:06.663 [2024-11-21 03:43:47.180522] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190ea680 00:27:06.663 [2024-11-21 03:43:47.181671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:5716 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.663 [2024-11-21 03:43:47.181702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:92 cdw0:0 sqhd:0044 p:0 m:0 dnr:0 00:27:06.663 [2024-11-21 03:43:47.192384] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190f0788 00:27:06.663 [2024-11-21 03:43:47.193492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:3665 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.663 [2024-11-21 03:43:47.193537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:91 cdw0:0 sqhd:0043 p:0 m:0 dnr:0 00:27:06.663 [2024-11-21 03:43:47.204705] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190df550 00:27:06.663 [2024-11-21 03:43:47.205812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:5252 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.663 [2024-11-21 03:43:47.205843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:0042 p:0 m:0 dnr:0 00:27:06.663 [2024-11-21 03:43:47.217276] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190e1b48 00:27:06.663 [2024-11-21 03:43:47.218118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:16293 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.663 [2024-11-21 03:43:47.218165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:0052 p:0 m:0 dnr:0 00:27:06.663 [2024-11-21 03:43:47.229775] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190e1b48 00:27:06.663 [2024-11-21 03:43:47.230825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:8654 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.663 [2024-11-21 03:43:47.230854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0063 p:0 m:0 dnr:0 00:27:06.663 [2024-11-21 03:43:47.242247] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190e1b48 00:27:06.663 [2024-11-21 03:43:47.243300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:7038 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.663 [2024-11-21 03:43:47.243329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0064 p:0 m:0 dnr:0 00:27:06.663 [2024-11-21 03:43:47.254688] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190e1b48 00:27:06.663 [2024-11-21 03:43:47.255737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:4897 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.663 [2024-11-21 03:43:47.255766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0065 p:0 m:0 dnr:0 00:27:06.663 [2024-11-21 03:43:47.267041] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190e1b48 00:27:06.663 [2024-11-21 03:43:47.268204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:22824 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.663 [2024-11-21 03:43:47.268233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0066 p:0 m:0 dnr:0 00:27:06.663 [2024-11-21 03:43:47.279433] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190e1b48 00:27:06.663 [2024-11-21 03:43:47.280566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:1905 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.663 [2024-11-21 03:43:47.280594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0067 p:0 m:0 dnr:0 00:27:06.663 [2024-11-21 03:43:47.291823] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190e1b48 00:27:06.663 [2024-11-21 03:43:47.293000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:16878 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.663 [2024-11-21 03:43:47.293030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0068 p:0 m:0 dnr:0 00:27:06.663 [2024-11-21 03:43:47.304156] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190e1b48 00:27:06.663 [2024-11-21 03:43:47.305268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:13676 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.663 [2024-11-21 03:43:47.305311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:0069 p:0 m:0 dnr:0 00:27:06.922 [2024-11-21 03:43:47.316455] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190e1b48 00:27:06.922 [2024-11-21 03:43:47.317612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:12362 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.922 [2024-11-21 03:43:47.317644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:24 cdw0:0 sqhd:006a p:0 m:0 dnr:0 00:27:06.922 [2024-11-21 03:43:47.328743] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190e1b48 00:27:06.922 [2024-11-21 03:43:47.329887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:24611 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.922 [2024-11-21 03:43:47.329917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:23 cdw0:0 sqhd:006b p:0 m:0 dnr:0 00:27:06.922 [2024-11-21 03:43:47.340753] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190e1b48 00:27:06.922 [2024-11-21 03:43:47.341922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:1557 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.922 [2024-11-21 03:43:47.341966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:006c p:0 m:0 dnr:0 00:27:06.922 [2024-11-21 03:43:47.353159] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190e1b48 00:27:06.922 [2024-11-21 03:43:47.354334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:15040 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.922 [2024-11-21 03:43:47.354378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:006d p:0 m:0 dnr:0 00:27:06.922 [2024-11-21 03:43:47.365665] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190e1b48 00:27:06.922 [2024-11-21 03:43:47.366917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:13748 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.922 [2024-11-21 03:43:47.366961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:006e p:0 m:0 dnr:0 00:27:06.922 [2024-11-21 03:43:47.378152] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190e1b48 00:27:06.922 [2024-11-21 03:43:47.379410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:21302 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.922 [2024-11-21 03:43:47.379442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:19 cdw0:0 sqhd:006f p:0 m:0 dnr:0 00:27:06.922 [2024-11-21 03:43:47.390548] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190e1b48 00:27:06.922 [2024-11-21 03:43:47.391699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:16976 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.922 [2024-11-21 03:43:47.391745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:57 cdw0:0 sqhd:0070 p:0 m:0 dnr:0 00:27:06.922 [2024-11-21 03:43:47.402855] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190e1b48 00:27:06.922 [2024-11-21 03:43:47.404090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:8173 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.922 [2024-11-21 03:43:47.404134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:19 cdw0:0 sqhd:0071 p:0 m:0 dnr:0 00:27:06.922 [2024-11-21 03:43:47.414555] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190eea00 00:27:06.922 [2024-11-21 03:43:47.415749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:17151 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.922 [2024-11-21 03:43:47.415778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:56 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:06.922 [2024-11-21 03:43:47.427048] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190e38d0 00:27:06.922 [2024-11-21 03:43:47.427817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:116 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.922 [2024-11-21 03:43:47.427849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:0051 p:0 m:0 dnr:0 00:27:06.922 [2024-11-21 03:43:47.439427] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190e38d0 00:27:06.922 [2024-11-21 03:43:47.440490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:19700 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.922 [2024-11-21 03:43:47.440521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:0062 p:0 m:0 dnr:0 00:27:06.922 [2024-11-21 03:43:47.451832] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190e38d0 00:27:06.922 [2024-11-21 03:43:47.452976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:9520 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.922 [2024-11-21 03:43:47.453011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:23 cdw0:0 sqhd:0063 p:0 m:0 dnr:0 00:27:06.922 [2024-11-21 03:43:47.464490] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190e38d0 00:27:06.922 [2024-11-21 03:43:47.465552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:4276 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.922 [2024-11-21 03:43:47.465581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:24 cdw0:0 sqhd:0064 p:0 m:0 dnr:0 00:27:06.922 [2024-11-21 03:43:47.476866] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190e38d0 00:27:06.922 [2024-11-21 03:43:47.477933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:2575 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.922 [2024-11-21 03:43:47.477962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:0065 p:0 m:0 dnr:0 00:27:06.922 [2024-11-21 03:43:47.489166] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190e38d0 00:27:06.922 [2024-11-21 03:43:47.490228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:19009 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.922 [2024-11-21 03:43:47.490257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0066 p:0 m:0 dnr:0 00:27:06.922 [2024-11-21 03:43:47.501402] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190e38d0 00:27:06.922 [2024-11-21 03:43:47.502482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:6198 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.922 [2024-11-21 03:43:47.502511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0067 p:0 m:0 dnr:0 00:27:06.922 [2024-11-21 03:43:47.513734] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190e38d0 00:27:06.922 [2024-11-21 03:43:47.514863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:4173 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.922 [2024-11-21 03:43:47.514910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0068 p:0 m:0 dnr:0 00:27:06.922 [2024-11-21 03:43:47.526123] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190e38d0 00:27:06.922 [2024-11-21 03:43:47.527278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:20143 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.922 [2024-11-21 03:43:47.527321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0069 p:0 m:0 dnr:0 00:27:06.922 [2024-11-21 03:43:47.538468] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190e38d0 00:27:06.922 [2024-11-21 03:43:47.539658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:10857 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.922 [2024-11-21 03:43:47.539690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:006a p:0 m:0 dnr:0 00:27:06.922 [2024-11-21 03:43:47.550900] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190e38d0 00:27:06.922 [2024-11-21 03:43:47.552052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:15901 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.922 [2024-11-21 03:43:47.552104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:006b p:0 m:0 dnr:0 00:27:06.922 [2024-11-21 03:43:47.563187] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190e38d0 00:27:06.922 [2024-11-21 03:43:47.564355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:10804 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:06.922 [2024-11-21 03:43:47.564383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:006c p:0 m:0 dnr:0 00:27:07.181 [2024-11-21 03:43:47.575557] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190e38d0 00:27:07.181 [2024-11-21 03:43:47.576767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:21352 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.181 [2024-11-21 03:43:47.576810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:006d p:0 m:0 dnr:0 00:27:07.181 [2024-11-21 03:43:47.587872] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190e38d0 00:27:07.181 [2024-11-21 03:43:47.589143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19342 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.181 [2024-11-21 03:43:47.589171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:006e p:0 m:0 dnr:0 00:27:07.181 [2024-11-21 03:43:47.600257] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190e38d0 00:27:07.181 [2024-11-21 03:43:47.601493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:24946 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.181 [2024-11-21 03:43:47.601525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:60 cdw0:0 sqhd:006f p:0 m:0 dnr:0 00:27:07.181 [2024-11-21 03:43:47.612693] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190e38d0 00:27:07.181 [2024-11-21 03:43:47.613906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:6082 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.181 [2024-11-21 03:43:47.613939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:0070 p:0 m:0 dnr:0 00:27:07.181 [2024-11-21 03:43:47.624175] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190e8d30 00:27:07.181 [2024-11-21 03:43:47.624437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:3521 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.181 [2024-11-21 03:43:47.624464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:57 cdw0:0 sqhd:003f p:0 m:0 dnr:0 00:27:07.181 [2024-11-21 03:43:47.636758] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190e99d8 00:27:07.181 [2024-11-21 03:43:47.637749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25536 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.181 [2024-11-21 03:43:47.637780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0060 p:0 m:0 dnr:0 00:27:07.181 [2024-11-21 03:43:47.649114] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190e99d8 00:27:07.181 [2024-11-21 03:43:47.650136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:24627 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.181 [2024-11-21 03:43:47.650165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:07.181 [2024-11-21 03:43:47.661453] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190e99d8 00:27:07.181 [2024-11-21 03:43:47.662495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:20801 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.181 [2024-11-21 03:43:47.662525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:59 cdw0:0 sqhd:0062 p:0 m:0 dnr:0 00:27:07.181 [2024-11-21 03:43:47.673914] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190e99d8 00:27:07.181 [2024-11-21 03:43:47.674963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:11694 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.181 [2024-11-21 03:43:47.674992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:58 cdw0:0 sqhd:0063 p:0 m:0 dnr:0 00:27:07.181 [2024-11-21 03:43:47.686242] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190e99d8 00:27:07.181 [2024-11-21 03:43:47.687277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:11009 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.181 [2024-11-21 03:43:47.687305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:71 cdw0:0 sqhd:0064 p:0 m:0 dnr:0 00:27:07.181 [2024-11-21 03:43:47.698635] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190e99d8 00:27:07.181 [2024-11-21 03:43:47.699730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:13773 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.181 [2024-11-21 03:43:47.699757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:0065 p:0 m:0 dnr:0 00:27:07.181 [2024-11-21 03:43:47.710933] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190e99d8 00:27:07.181 [2024-11-21 03:43:47.712005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:20458 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.181 [2024-11-21 03:43:47.712048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:0066 p:0 m:0 dnr:0 00:27:07.181 [2024-11-21 03:43:47.723301] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190e99d8 00:27:07.181 [2024-11-21 03:43:47.724393] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:1941 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.181 [2024-11-21 03:43:47.724436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:0067 p:0 m:0 dnr:0 00:27:07.181 [2024-11-21 03:43:47.735601] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190e99d8 00:27:07.181 [2024-11-21 03:43:47.736714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:323 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.181 [2024-11-21 03:43:47.736761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:0068 p:0 m:0 dnr:0 00:27:07.181 [2024-11-21 03:43:47.747976] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190e99d8 00:27:07.181 [2024-11-21 03:43:47.749120] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:23838 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.181 [2024-11-21 03:43:47.749158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:0069 p:0 m:0 dnr:0 00:27:07.181 [2024-11-21 03:43:47.760392] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190e99d8 00:27:07.181 [2024-11-21 03:43:47.761548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:13286 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.181 [2024-11-21 03:43:47.761578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:87 cdw0:0 sqhd:006a p:0 m:0 dnr:0 00:27:07.181 [2024-11-21 03:43:47.772813] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190e99d8 00:27:07.181 [2024-11-21 03:43:47.774021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:20043 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.181 [2024-11-21 03:43:47.774078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:006b p:0 m:0 dnr:0 00:27:07.181 [2024-11-21 03:43:47.785255] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190e99d8 00:27:07.181 [2024-11-21 03:43:47.786482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:5225 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.181 [2024-11-21 03:43:47.786514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:89 cdw0:0 sqhd:006c p:0 m:0 dnr:0 00:27:07.181 [2024-11-21 03:43:47.797700] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190e99d8 00:27:07.181 [2024-11-21 03:43:47.798950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:10866 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.181 [2024-11-21 03:43:47.798981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:006d p:0 m:0 dnr:0 00:27:07.181 [2024-11-21 03:43:47.810098] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190e99d8 00:27:07.181 [2024-11-21 03:43:47.811308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:18000 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.181 [2024-11-21 03:43:47.811336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:006e p:0 m:0 dnr:0 00:27:07.181 [2024-11-21 03:43:47.822509] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190e99d8 00:27:07.181 [2024-11-21 03:43:47.823696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:4373 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.181 [2024-11-21 03:43:47.823725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:95 cdw0:0 sqhd:006f p:0 m:0 dnr:0 00:27:07.440 [2024-11-21 03:43:47.834785] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190e99d8 00:27:07.440 [2024-11-21 03:43:47.836033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:11841 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.440 [2024-11-21 03:43:47.836065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0070 p:0 m:0 dnr:0 00:27:07.440 [2024-11-21 03:43:47.847182] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190e99d8 00:27:07.440 [2024-11-21 03:43:47.848453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:4489 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.440 [2024-11-21 03:43:47.848498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:95 cdw0:0 sqhd:0071 p:0 m:0 dnr:0 00:27:07.440 [2024-11-21 03:43:47.858865] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190e0a68 00:27:07.440 [2024-11-21 03:43:47.859196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:15152 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.440 [2024-11-21 03:43:47.859224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:003e p:0 m:0 dnr:0 00:27:07.440 [2024-11-21 03:43:47.871484] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190f2948 00:27:07.440 [2024-11-21 03:43:47.872450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:23979 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.440 [2024-11-21 03:43:47.872479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:005f p:0 m:0 dnr:0 00:27:07.440 [2024-11-21 03:43:47.883881] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190f2948 00:27:07.440 [2024-11-21 03:43:47.884900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:1679 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.440 [2024-11-21 03:43:47.884935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:0060 p:0 m:0 dnr:0 00:27:07.440 [2024-11-21 03:43:47.896272] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190f2948 00:27:07.440 [2024-11-21 03:43:47.897298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:22416 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.440 [2024-11-21 03:43:47.897327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:72 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:07.440 [2024-11-21 03:43:47.908641] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190f2948 00:27:07.440 [2024-11-21 03:43:47.909731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:17281 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.440 [2024-11-21 03:43:47.909760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0062 p:0 m:0 dnr:0 00:27:07.440 [2024-11-21 03:43:47.921079] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190f2948 00:27:07.440 [2024-11-21 03:43:47.922097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:25137 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.440 [2024-11-21 03:43:47.922126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:0063 p:0 m:0 dnr:0 00:27:07.440 [2024-11-21 03:43:47.933477] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190f2948 00:27:07.440 [2024-11-21 03:43:47.934537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:9476 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.440 [2024-11-21 03:43:47.934566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:0064 p:0 m:0 dnr:0 00:27:07.440 [2024-11-21 03:43:47.945910] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190f2948 00:27:07.440 [2024-11-21 03:43:47.946978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:11554 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.440 [2024-11-21 03:43:47.947006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:0065 p:0 m:0 dnr:0 00:27:07.440 [2024-11-21 03:43:47.958320] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190f2948 00:27:07.440 [2024-11-21 03:43:47.959425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:1834 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.440 [2024-11-21 03:43:47.959453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:0066 p:0 m:0 dnr:0 00:27:07.440 [2024-11-21 03:43:47.970714] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190f2948 00:27:07.440 [2024-11-21 03:43:47.971799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:20285 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.440 [2024-11-21 03:43:47.971842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:103 cdw0:0 sqhd:0067 p:0 m:0 dnr:0 00:27:07.440 [2024-11-21 03:43:47.983105] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190f2948 00:27:07.440 [2024-11-21 03:43:47.984279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:10050 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.440 [2024-11-21 03:43:47.984306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:104 cdw0:0 sqhd:0068 p:0 m:0 dnr:0 00:27:07.440 [2024-11-21 03:43:47.995577] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190f2948 00:27:07.440 [2024-11-21 03:43:47.996711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:12367 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.440 [2024-11-21 03:43:47.996760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:105 cdw0:0 sqhd:0069 p:0 m:0 dnr:0 00:27:07.440 [2024-11-21 03:43:48.007985] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190f2948 00:27:07.440 [2024-11-21 03:43:48.009208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:9992 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.440 [2024-11-21 03:43:48.009236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:106 cdw0:0 sqhd:006a p:0 m:0 dnr:0 00:27:07.440 [2024-11-21 03:43:48.020617] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190f2948 00:27:07.440 [2024-11-21 03:43:48.021816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:1490 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.440 [2024-11-21 03:43:48.021861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:107 cdw0:0 sqhd:006b p:0 m:0 dnr:0 00:27:07.440 [2024-11-21 03:43:48.033015] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190f2948 00:27:07.440 [2024-11-21 03:43:48.034199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:15065 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.440 [2024-11-21 03:43:48.034227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:006c p:0 m:0 dnr:0 00:27:07.440 [2024-11-21 03:43:48.045423] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190f2948 00:27:07.440 [2024-11-21 03:43:48.046675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:24212 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.440 [2024-11-21 03:43:48.046706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:109 cdw0:0 sqhd:006d p:0 m:0 dnr:0 00:27:07.440 [2024-11-21 03:43:48.057920] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190f2948 00:27:07.440 [2024-11-21 03:43:48.059160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:21217 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.440 [2024-11-21 03:43:48.059203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:006e p:0 m:0 dnr:0 00:27:07.440 [2024-11-21 03:43:48.069648] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190f4b08 00:27:07.440 [2024-11-21 03:43:48.070831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:23913 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.440 [2024-11-21 03:43:48.070863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:111 cdw0:0 sqhd:003e p:0 m:0 dnr:0 00:27:07.440 [2024-11-21 03:43:48.082243] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190f4b08 00:27:07.440 [2024-11-21 03:43:48.083009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:11083 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.440 [2024-11-21 03:43:48.083041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:004e p:0 m:0 dnr:0 00:27:07.699 [2024-11-21 03:43:48.094694] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190f4b08 00:27:07.699 [2024-11-21 03:43:48.095691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:21214 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.699 [2024-11-21 03:43:48.095725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:005f p:0 m:0 dnr:0 00:27:07.699 [2024-11-21 03:43:48.107100] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190f4b08 00:27:07.699 [2024-11-21 03:43:48.108135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:22385 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.699 [2024-11-21 03:43:48.108164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:95 cdw0:0 sqhd:0060 p:0 m:0 dnr:0 00:27:07.699 [2024-11-21 03:43:48.119288] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190f4b08 00:27:07.699 [2024-11-21 03:43:48.120299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:23014 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.699 [2024-11-21 03:43:48.120328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:106 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:07.699 [2024-11-21 03:43:48.131579] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190f4b08 00:27:07.699 [2024-11-21 03:43:48.132658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:3082 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.699 [2024-11-21 03:43:48.132687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:105 cdw0:0 sqhd:0062 p:0 m:0 dnr:0 00:27:07.699 [2024-11-21 03:43:48.144036] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190f4b08 00:27:07.699 [2024-11-21 03:43:48.145144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:3979 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.699 [2024-11-21 03:43:48.145187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:104 cdw0:0 sqhd:0063 p:0 m:0 dnr:0 00:27:07.699 [2024-11-21 03:43:48.156486] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190f4b08 00:27:07.699 [2024-11-21 03:43:48.157610] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:23648 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.699 [2024-11-21 03:43:48.157639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:103 cdw0:0 sqhd:0064 p:0 m:0 dnr:0 00:27:07.699 [2024-11-21 03:43:48.168970] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190f4b08 00:27:07.699 [2024-11-21 03:43:48.170040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:13726 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.699 [2024-11-21 03:43:48.170093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:0065 p:0 m:0 dnr:0 00:27:07.699 [2024-11-21 03:43:48.181345] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190f4b08 00:27:07.699 [2024-11-21 03:43:48.182443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:5752 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.699 [2024-11-21 03:43:48.182472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:0066 p:0 m:0 dnr:0 00:27:07.699 [2024-11-21 03:43:48.193775] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190f4b08 00:27:07.699 [2024-11-21 03:43:48.194908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:19559 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.699 [2024-11-21 03:43:48.194936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:0067 p:0 m:0 dnr:0 00:27:07.699 [2024-11-21 03:43:48.206157] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190f4b08 00:27:07.699 [2024-11-21 03:43:48.207299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:20041 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.699 [2024-11-21 03:43:48.207346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:0068 p:0 m:0 dnr:0 00:27:07.699 [2024-11-21 03:43:48.218603] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190f4b08 00:27:07.699 [2024-11-21 03:43:48.219744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:8023 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.699 [2024-11-21 03:43:48.219772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0069 p:0 m:0 dnr:0 00:27:07.699 [2024-11-21 03:43:48.231009] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190f4b08 00:27:07.699 [2024-11-21 03:43:48.232201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:9189 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.699 [2024-11-21 03:43:48.232228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:72 cdw0:0 sqhd:006a p:0 m:0 dnr:0 00:27:07.699 [2024-11-21 03:43:48.243384] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190f4b08 00:27:07.699 [2024-11-21 03:43:48.244576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:11442 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.699 [2024-11-21 03:43:48.244605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:006b p:0 m:0 dnr:0 00:27:07.699 [2024-11-21 03:43:48.255800] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190f4b08 00:27:07.699 [2024-11-21 03:43:48.257017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:179 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.699 [2024-11-21 03:43:48.257049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:006c p:0 m:0 dnr:0 00:27:07.699 [2024-11-21 03:43:48.268297] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190f4b08 00:27:07.699 [2024-11-21 03:43:48.269517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:13383 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.699 [2024-11-21 03:43:48.269549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:006d p:0 m:0 dnr:0 00:27:07.699 [2024-11-21 03:43:48.279805] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190f35f0 00:27:07.699 [2024-11-21 03:43:48.280085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:18325 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.699 [2024-11-21 03:43:48.280112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:003c p:0 m:0 dnr:0 00:27:07.699 [2024-11-21 03:43:48.292448] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190f2948 00:27:07.699 [2024-11-21 03:43:48.293462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:10520 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.700 [2024-11-21 03:43:48.293492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:005d p:0 m:0 dnr:0 00:27:07.700 [2024-11-21 03:43:48.304850] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190f0350 00:27:07.700 [2024-11-21 03:43:48.305836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:1051 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.700 [2024-11-21 03:43:48.305865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:19 cdw0:0 sqhd:005e p:0 m:0 dnr:0 00:27:07.700 [2024-11-21 03:43:48.317157] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190f0350 00:27:07.700 [2024-11-21 03:43:48.318172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:16914 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.700 [2024-11-21 03:43:48.318201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:005f p:0 m:0 dnr:0 00:27:07.700 [2024-11-21 03:43:48.329607] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190f0350 00:27:07.700 [2024-11-21 03:43:48.330637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:6326 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.700 [2024-11-21 03:43:48.330665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:0060 p:0 m:0 dnr:0 00:27:07.700 [2024-11-21 03:43:48.342102] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190f0350 00:27:07.700 [2024-11-21 03:43:48.343119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:13750 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.700 [2024-11-21 03:43:48.343149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:07.958 [2024-11-21 03:43:48.354500] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190f0350 00:27:07.958 [2024-11-21 03:43:48.355543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:12264 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.958 [2024-11-21 03:43:48.355572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0062 p:0 m:0 dnr:0 00:27:07.958 [2024-11-21 03:43:48.366932] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190f0350 00:27:07.958 [2024-11-21 03:43:48.368060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:19663 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.958 [2024-11-21 03:43:48.368098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:0063 p:0 m:0 dnr:0 00:27:07.958 [2024-11-21 03:43:48.379194] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190f0350 00:27:07.958 [2024-11-21 03:43:48.380239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:20588 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.958 [2024-11-21 03:43:48.380282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:0064 p:0 m:0 dnr:0 00:27:07.958 [2024-11-21 03:43:48.391437] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190f0350 00:27:07.958 [2024-11-21 03:43:48.392554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:3100 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.958 [2024-11-21 03:43:48.392586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0065 p:0 m:0 dnr:0 00:27:07.958 [2024-11-21 03:43:48.403986] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190f0350 00:27:07.958 [2024-11-21 03:43:48.405157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:13427 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.958 [2024-11-21 03:43:48.405186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:57 cdw0:0 sqhd:0066 p:0 m:0 dnr:0 00:27:07.958 [2024-11-21 03:43:48.416435] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190f0350 00:27:07.959 [2024-11-21 03:43:48.417570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:11523 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.959 [2024-11-21 03:43:48.417599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:0067 p:0 m:0 dnr:0 00:27:07.959 [2024-11-21 03:43:48.428902] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190f0350 00:27:07.959 [2024-11-21 03:43:48.430027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:14280 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.959 [2024-11-21 03:43:48.430081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:0068 p:0 m:0 dnr:0 00:27:07.959 [2024-11-21 03:43:48.441239] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190f0350 00:27:07.959 [2024-11-21 03:43:48.442380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:14660 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.959 [2024-11-21 03:43:48.442427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:0069 p:0 m:0 dnr:0 00:27:07.959 [2024-11-21 03:43:48.453581] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190f0350 00:27:07.959 [2024-11-21 03:43:48.454654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:12552 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.959 [2024-11-21 03:43:48.454697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:006a p:0 m:0 dnr:0 00:27:07.959 [2024-11-21 03:43:48.465835] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190f0350 00:27:07.959 [2024-11-21 03:43:48.467019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:23971 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.959 [2024-11-21 03:43:48.467062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:119 cdw0:0 sqhd:006b p:0 m:0 dnr:0 00:27:07.959 [2024-11-21 03:43:48.478392] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190f0350 00:27:07.959 [2024-11-21 03:43:48.479606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:25036 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.959 [2024-11-21 03:43:48.479639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:006c p:0 m:0 dnr:0 00:27:07.959 [2024-11-21 03:43:48.490778] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190f0350 00:27:07.959 [2024-11-21 03:43:48.492008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:18334 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.959 [2024-11-21 03:43:48.492043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:006d p:0 m:0 dnr:0 00:27:07.959 [2024-11-21 03:43:48.502635] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190f3e60 00:27:07.959 [2024-11-21 03:43:48.503808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:16863 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.959 [2024-11-21 03:43:48.503837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:003c p:0 m:0 dnr:0 00:27:07.959 [2024-11-21 03:43:48.515064] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190f4298 00:27:07.959 [2024-11-21 03:43:48.515829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:19990 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.959 [2024-11-21 03:43:48.515861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:004c p:0 m:0 dnr:0 00:27:07.959 [2024-11-21 03:43:48.527618] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190eb760 00:27:07.959 [2024-11-21 03:43:48.528658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:23912 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.959 [2024-11-21 03:43:48.528699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:109 cdw0:0 sqhd:005d p:0 m:0 dnr:0 00:27:07.959 [2024-11-21 03:43:48.540225] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190eb760 00:27:07.959 [2024-11-21 03:43:48.541235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:24838 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.959 [2024-11-21 03:43:48.541267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:005e p:0 m:0 dnr:0 00:27:07.959 [2024-11-21 03:43:48.552725] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190eb760 00:27:07.959 [2024-11-21 03:43:48.553740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:5664 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.959 [2024-11-21 03:43:48.553770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:005f p:0 m:0 dnr:0 00:27:07.959 [2024-11-21 03:43:48.565113] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190eb760 00:27:07.959 [2024-11-21 03:43:48.566118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:7216 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.959 [2024-11-21 03:43:48.566148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:0060 p:0 m:0 dnr:0 00:27:07.959 [2024-11-21 03:43:48.577597] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190eb760 00:27:07.959 [2024-11-21 03:43:48.578678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:895 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.959 [2024-11-21 03:43:48.578710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:07.959 [2024-11-21 03:43:48.590127] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190eb760 00:27:07.959 [2024-11-21 03:43:48.591156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:4299 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.959 [2024-11-21 03:43:48.591184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:0062 p:0 m:0 dnr:0 00:27:07.959 [2024-11-21 03:43:48.602477] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190eb760 00:27:07.959 [2024-11-21 03:43:48.603528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:20968 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:07.959 [2024-11-21 03:43:48.603557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:57 cdw0:0 sqhd:0063 p:0 m:0 dnr:0 00:27:08.217 [2024-11-21 03:43:48.614879] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190eb760 00:27:08.217 [2024-11-21 03:43:48.615971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:567 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.217 [2024-11-21 03:43:48.616014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0064 p:0 m:0 dnr:0 00:27:08.217 [2024-11-21 03:43:48.627250] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190eb760 00:27:08.217 [2024-11-21 03:43:48.628354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:16609 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.217 [2024-11-21 03:43:48.628383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:0065 p:0 m:0 dnr:0 00:27:08.217 [2024-11-21 03:43:48.639701] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190eb760 00:27:08.217 [2024-11-21 03:43:48.640775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:12713 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.217 [2024-11-21 03:43:48.640804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:0066 p:0 m:0 dnr:0 00:27:08.217 [2024-11-21 03:43:48.652011] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190eb760 00:27:08.217 [2024-11-21 03:43:48.653154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:23614 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.217 [2024-11-21 03:43:48.653198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0067 p:0 m:0 dnr:0 00:27:08.217 [2024-11-21 03:43:48.664494] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190eb760 00:27:08.217 [2024-11-21 03:43:48.665653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:16608 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.217 [2024-11-21 03:43:48.665697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:0068 p:0 m:0 dnr:0 00:27:08.217 [2024-11-21 03:43:48.676950] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190eb760 00:27:08.217 [2024-11-21 03:43:48.678141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:80 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.217 [2024-11-21 03:43:48.678168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:0069 p:0 m:0 dnr:0 00:27:08.217 [2024-11-21 03:43:48.689333] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190eb760 00:27:08.217 [2024-11-21 03:43:48.690544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:12239 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.217 [2024-11-21 03:43:48.690572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:006a p:0 m:0 dnr:0 00:27:08.217 [2024-11-21 03:43:48.701811] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190eb760 00:27:08.217 [2024-11-21 03:43:48.703033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:24860 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.217 [2024-11-21 03:43:48.703065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:19 cdw0:0 sqhd:006b p:0 m:0 dnr:0 00:27:08.217 [2024-11-21 03:43:48.713620] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190e6b70 00:27:08.217 [2024-11-21 03:43:48.714755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:22865 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.217 [2024-11-21 03:43:48.714784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:003b p:0 m:0 dnr:0 00:27:08.217 [2024-11-21 03:43:48.726003] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190e49b0 00:27:08.217 [2024-11-21 03:43:48.726718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:8320 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.217 [2024-11-21 03:43:48.726751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:004b p:0 m:0 dnr:0 00:27:08.217 [2024-11-21 03:43:48.738538] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190ea248 00:27:08.217 [2024-11-21 03:43:48.739499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:5850 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.217 [2024-11-21 03:43:48.739528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:005c p:0 m:0 dnr:0 00:27:08.217 [2024-11-21 03:43:48.750946] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190e8d30 00:27:08.217 [2024-11-21 03:43:48.751918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:7019 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.217 [2024-11-21 03:43:48.751947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:005d p:0 m:0 dnr:0 00:27:08.217 [2024-11-21 03:43:48.763269] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190e8d30 00:27:08.217 [2024-11-21 03:43:48.764266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:4897 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.217 [2024-11-21 03:43:48.764295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:005e p:0 m:0 dnr:0 00:27:08.218 [2024-11-21 03:43:48.775648] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190e8d30 00:27:08.218 [2024-11-21 03:43:48.776671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:16910 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.218 [2024-11-21 03:43:48.776700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:005f p:0 m:0 dnr:0 00:27:08.218 [2024-11-21 03:43:48.788079] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190e8d30 00:27:08.218 [2024-11-21 03:43:48.789092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:18390 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.218 [2024-11-21 03:43:48.789130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0060 p:0 m:0 dnr:0 00:27:08.218 [2024-11-21 03:43:48.800433] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190e8d30 00:27:08.218 [2024-11-21 03:43:48.801482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:22278 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.218 [2024-11-21 03:43:48.801526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:08.218 [2024-11-21 03:43:48.812850] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190e8d30 00:27:08.218 [2024-11-21 03:43:48.813946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:9811 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.218 [2024-11-21 03:43:48.813989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:0062 p:0 m:0 dnr:0 00:27:08.218 [2024-11-21 03:43:48.825266] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190e8d30 00:27:08.218 [2024-11-21 03:43:48.826313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:1424 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.218 [2024-11-21 03:43:48.826341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:0063 p:0 m:0 dnr:0 00:27:08.218 [2024-11-21 03:43:48.837713] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190e8d30 00:27:08.218 [2024-11-21 03:43:48.838805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:1859 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.218 [2024-11-21 03:43:48.838833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0064 p:0 m:0 dnr:0 00:27:08.218 [2024-11-21 03:43:48.850205] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190e8d30 00:27:08.218 [2024-11-21 03:43:48.851297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:5813 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.218 [2024-11-21 03:43:48.851344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:57 cdw0:0 sqhd:0065 p:0 m:0 dnr:0 00:27:08.218 [2024-11-21 03:43:48.862486] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190e8d30 00:27:08.475 [2024-11-21 03:43:48.863583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:11613 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.476 [2024-11-21 03:43:48.863612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:0066 p:0 m:0 dnr:0 00:27:08.476 [2024-11-21 03:43:48.874814] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190e8d30 00:27:08.476 [2024-11-21 03:43:48.875969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:21892 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.476 [2024-11-21 03:43:48.876017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:0067 p:0 m:0 dnr:0 00:27:08.476 [2024-11-21 03:43:48.887243] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190e8d30 00:27:08.476 [2024-11-21 03:43:48.888404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:781 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.476 [2024-11-21 03:43:48.888451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:0068 p:0 m:0 dnr:0 00:27:08.476 [2024-11-21 03:43:48.899611] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190e8d30 00:27:08.476 [2024-11-21 03:43:48.900787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:21043 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.476 [2024-11-21 03:43:48.900819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:0069 p:0 m:0 dnr:0 00:27:08.476 [2024-11-21 03:43:48.912042] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190e8d30 00:27:08.476 [2024-11-21 03:43:48.913314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:17190 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.476 [2024-11-21 03:43:48.913340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:006a p:0 m:0 dnr:0 00:27:08.476 [2024-11-21 03:43:48.923785] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190ee5c8 00:27:08.476 [2024-11-21 03:43:48.924026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:22621 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.476 [2024-11-21 03:43:48.924052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:0039 p:0 m:0 dnr:0 00:27:08.476 [2024-11-21 03:43:48.936341] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190df988 00:27:08.476 [2024-11-21 03:43:48.937329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:9361 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.476 [2024-11-21 03:43:48.937358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:005a p:0 m:0 dnr:0 00:27:08.476 [2024-11-21 03:43:48.948707] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190efae0 00:27:08.476 [2024-11-21 03:43:48.949693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:21544 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.476 [2024-11-21 03:43:48.949722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:005b p:0 m:0 dnr:0 00:27:08.476 [2024-11-21 03:43:48.961166] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190ebfd0 00:27:08.476 [2024-11-21 03:43:48.962112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:15618 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.476 [2024-11-21 03:43:48.962140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:111 cdw0:0 sqhd:005c p:0 m:0 dnr:0 00:27:08.476 [2024-11-21 03:43:48.973517] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190ebfd0 00:27:08.476 [2024-11-21 03:43:48.974516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:11900 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.476 [2024-11-21 03:43:48.974545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:16 cdw0:0 sqhd:005d p:0 m:0 dnr:0 00:27:08.476 [2024-11-21 03:43:48.985905] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190ebfd0 00:27:08.476 [2024-11-21 03:43:48.986895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:15005 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.476 [2024-11-21 03:43:48.986924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:89 cdw0:0 sqhd:005e p:0 m:0 dnr:0 00:27:08.476 [2024-11-21 03:43:48.998289] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190ebfd0 00:27:08.476 [2024-11-21 03:43:48.999303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:11311 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.476 [2024-11-21 03:43:48.999348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:005f p:0 m:0 dnr:0 00:27:08.476 [2024-11-21 03:43:49.010639] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190ebfd0 00:27:08.476 [2024-11-21 03:43:49.011707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:24758 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.476 [2024-11-21 03:43:49.011751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:0060 p:0 m:0 dnr:0 00:27:08.476 [2024-11-21 03:43:49.023060] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190ebfd0 00:27:08.476 [2024-11-21 03:43:49.024110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:4147 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.476 [2024-11-21 03:43:49.024154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:08.476 [2024-11-21 03:43:49.035451] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190ebfd0 00:27:08.476 [2024-11-21 03:43:49.036492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:2928 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.476 [2024-11-21 03:43:49.036536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:0062 p:0 m:0 dnr:0 00:27:08.476 [2024-11-21 03:43:49.047821] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135ad0) with pdu=0x2000190ebfd0 00:27:08.476 [2024-11-21 03:43:49.048950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:16591 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:08.476 [2024-11-21 03:43:49.048978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:0063 p:0 m:0 dnr:0 00:27:08.476 00:27:08.476 Latency(us) 00:27:08.476 [2024-11-21T02:43:49.124Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:08.476 [2024-11-21T02:43:49.124Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:27:08.476 nvme0n1 : 2.00 20605.80 80.49 0.00 0.00 6204.20 2961.26 14854.83 00:27:08.476 [2024-11-21T02:43:49.124Z] =================================================================================================================== 00:27:08.476 [2024-11-21T02:43:49.124Z] Total : 20605.80 80.49 0.00 0.00 6204.20 2961.26 14854.83 00:27:08.476 0 00:27:08.476 03:43:49 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:27:08.476 03:43:49 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:27:08.476 03:43:49 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:27:08.476 03:43:49 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:27:08.476 | .driver_specific 00:27:08.476 | .nvme_error 00:27:08.476 | .status_code 00:27:08.476 | .command_transient_transport_error' 00:27:08.737 03:43:49 -- host/digest.sh@71 -- # (( 161 > 0 )) 00:27:08.737 03:43:49 -- host/digest.sh@73 -- # killprocess 3166955 00:27:08.737 03:43:49 -- common/autotest_common.sh@936 -- # '[' -z 3166955 ']' 00:27:08.737 03:43:49 -- common/autotest_common.sh@940 -- # kill -0 3166955 00:27:08.737 03:43:49 -- common/autotest_common.sh@941 -- # uname 00:27:08.737 03:43:49 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:08.737 03:43:49 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3166955 00:27:08.737 03:43:49 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:08.737 03:43:49 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:08.737 03:43:49 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3166955' 00:27:08.737 killing process with pid 3166955 00:27:08.737 03:43:49 -- common/autotest_common.sh@955 -- # kill 3166955 00:27:08.737 Received shutdown signal, test time was about 2.000000 seconds 00:27:08.737 00:27:08.738 Latency(us) 00:27:08.738 [2024-11-21T02:43:49.386Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:08.738 [2024-11-21T02:43:49.386Z] =================================================================================================================== 00:27:08.738 [2024-11-21T02:43:49.386Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:27:08.738 03:43:49 -- common/autotest_common.sh@960 -- # wait 3166955 00:27:08.999 03:43:49 -- host/digest.sh@114 -- # run_bperf_err randwrite 131072 16 00:27:08.999 03:43:49 -- host/digest.sh@54 -- # local rw bs qd 00:27:08.999 03:43:49 -- host/digest.sh@56 -- # rw=randwrite 00:27:08.999 03:43:49 -- host/digest.sh@56 -- # bs=131072 00:27:08.999 03:43:49 -- host/digest.sh@56 -- # qd=16 00:27:08.999 03:43:49 -- host/digest.sh@58 -- # bperfpid=3167459 00:27:08.999 03:43:49 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z 00:27:08.999 03:43:49 -- host/digest.sh@60 -- # waitforlisten 3167459 /var/tmp/bperf.sock 00:27:08.999 03:43:49 -- common/autotest_common.sh@829 -- # '[' -z 3167459 ']' 00:27:08.999 03:43:49 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:27:08.999 03:43:49 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:08.999 03:43:49 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:27:08.999 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:27:08.999 03:43:49 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:08.999 03:43:49 -- common/autotest_common.sh@10 -- # set +x 00:27:09.258 [2024-11-21 03:43:49.674209] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:09.258 [2024-11-21 03:43:49.674292] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3167459 ] 00:27:09.258 I/O size of 131072 is greater than zero copy threshold (65536). 00:27:09.258 Zero copy mechanism will not be used. 00:27:09.258 EAL: No free 2048 kB hugepages reported on node 1 00:27:09.258 [2024-11-21 03:43:49.740481] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:09.258 [2024-11-21 03:43:49.856029] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:10.192 03:43:50 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:10.192 03:43:50 -- common/autotest_common.sh@862 -- # return 0 00:27:10.192 03:43:50 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:10.192 03:43:50 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:10.450 03:43:50 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:27:10.450 03:43:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:10.450 03:43:50 -- common/autotest_common.sh@10 -- # set +x 00:27:10.450 03:43:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:10.450 03:43:50 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:10.450 03:43:50 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:11.016 nvme0n1 00:27:11.016 03:43:51 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:27:11.016 03:43:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:11.016 03:43:51 -- common/autotest_common.sh@10 -- # set +x 00:27:11.016 03:43:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:11.016 03:43:51 -- host/digest.sh@69 -- # bperf_py perform_tests 00:27:11.016 03:43:51 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:27:11.016 I/O size of 131072 is greater than zero copy threshold (65536). 00:27:11.016 Zero copy mechanism will not be used. 00:27:11.016 Running I/O for 2 seconds... 00:27:11.016 [2024-11-21 03:43:51.614719] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.016 [2024-11-21 03:43:51.615251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.016 [2024-11-21 03:43:51.615385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.016 [2024-11-21 03:43:51.621622] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.016 [2024-11-21 03:43:51.621972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.016 [2024-11-21 03:43:51.622009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.016 [2024-11-21 03:43:51.628481] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.016 [2024-11-21 03:43:51.628778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.016 [2024-11-21 03:43:51.628829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.016 [2024-11-21 03:43:51.635579] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.016 [2024-11-21 03:43:51.635821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.016 [2024-11-21 03:43:51.635849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.016 [2024-11-21 03:43:51.642470] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.016 [2024-11-21 03:43:51.642629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.016 [2024-11-21 03:43:51.642763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.016 [2024-11-21 03:43:51.647634] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.016 [2024-11-21 03:43:51.647784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.016 [2024-11-21 03:43:51.647888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.016 [2024-11-21 03:43:51.652511] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.016 [2024-11-21 03:43:51.652895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.016 [2024-11-21 03:43:51.652943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.016 [2024-11-21 03:43:51.657321] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.017 [2024-11-21 03:43:51.657780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.017 [2024-11-21 03:43:51.657810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.017 [2024-11-21 03:43:51.662331] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.276 [2024-11-21 03:43:51.662591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.276 [2024-11-21 03:43:51.662621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.276 [2024-11-21 03:43:51.667457] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.276 [2024-11-21 03:43:51.667749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.276 [2024-11-21 03:43:51.667777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.276 [2024-11-21 03:43:51.672268] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.276 [2024-11-21 03:43:51.672855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.276 [2024-11-21 03:43:51.672895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.276 [2024-11-21 03:43:51.676962] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.276 [2024-11-21 03:43:51.677284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.276 [2024-11-21 03:43:51.677315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.276 [2024-11-21 03:43:51.682542] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.276 [2024-11-21 03:43:51.682658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.276 [2024-11-21 03:43:51.682714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.276 [2024-11-21 03:43:51.687558] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.276 [2024-11-21 03:43:51.687827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:4320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.276 [2024-11-21 03:43:51.687916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.276 [2024-11-21 03:43:51.692357] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.276 [2024-11-21 03:43:51.692516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:16448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.276 [2024-11-21 03:43:51.692545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.276 [2024-11-21 03:43:51.696935] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.276 [2024-11-21 03:43:51.697284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:3296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.276 [2024-11-21 03:43:51.697352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.276 [2024-11-21 03:43:51.701906] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.276 [2024-11-21 03:43:51.702057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.276 [2024-11-21 03:43:51.702137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.276 [2024-11-21 03:43:51.706571] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.276 [2024-11-21 03:43:51.706807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.276 [2024-11-21 03:43:51.706853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.276 [2024-11-21 03:43:51.711491] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.276 [2024-11-21 03:43:51.711732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.276 [2024-11-21 03:43:51.711761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.276 [2024-11-21 03:43:51.716365] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.276 [2024-11-21 03:43:51.716678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.276 [2024-11-21 03:43:51.716708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.276 [2024-11-21 03:43:51.721086] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.276 [2024-11-21 03:43:51.721327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.276 [2024-11-21 03:43:51.721379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.276 [2024-11-21 03:43:51.725825] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.276 [2024-11-21 03:43:51.726127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.277 [2024-11-21 03:43:51.726196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.277 [2024-11-21 03:43:51.730364] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.277 [2024-11-21 03:43:51.730648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.277 [2024-11-21 03:43:51.730678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.277 [2024-11-21 03:43:51.735009] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.277 [2024-11-21 03:43:51.735269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.277 [2024-11-21 03:43:51.735299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.277 [2024-11-21 03:43:51.739628] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.277 [2024-11-21 03:43:51.739895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.277 [2024-11-21 03:43:51.739924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.277 [2024-11-21 03:43:51.744262] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.277 [2024-11-21 03:43:51.744639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.277 [2024-11-21 03:43:51.744729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.277 [2024-11-21 03:43:51.749034] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.277 [2024-11-21 03:43:51.749354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.277 [2024-11-21 03:43:51.749439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.277 [2024-11-21 03:43:51.754037] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.277 [2024-11-21 03:43:51.754230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:15904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.277 [2024-11-21 03:43:51.754306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.277 [2024-11-21 03:43:51.759571] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.277 [2024-11-21 03:43:51.759835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:15904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.277 [2024-11-21 03:43:51.759908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.277 [2024-11-21 03:43:51.764297] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.277 [2024-11-21 03:43:51.764668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:18208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.277 [2024-11-21 03:43:51.764697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.277 [2024-11-21 03:43:51.769089] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.277 [2024-11-21 03:43:51.769375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:13440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.277 [2024-11-21 03:43:51.769447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.277 [2024-11-21 03:43:51.773914] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.277 [2024-11-21 03:43:51.774138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.277 [2024-11-21 03:43:51.774192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.277 [2024-11-21 03:43:51.778724] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.277 [2024-11-21 03:43:51.779128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:15104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.277 [2024-11-21 03:43:51.779199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.277 [2024-11-21 03:43:51.783309] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.277 [2024-11-21 03:43:51.783609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.277 [2024-11-21 03:43:51.783693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.277 [2024-11-21 03:43:51.787759] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.277 [2024-11-21 03:43:51.787888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.277 [2024-11-21 03:43:51.787957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.277 [2024-11-21 03:43:51.792501] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.277 [2024-11-21 03:43:51.792622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.277 [2024-11-21 03:43:51.792650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.277 [2024-11-21 03:43:51.797213] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.277 [2024-11-21 03:43:51.797448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.277 [2024-11-21 03:43:51.797482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.277 [2024-11-21 03:43:51.802145] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.277 [2024-11-21 03:43:51.802517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.277 [2024-11-21 03:43:51.802547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.277 [2024-11-21 03:43:51.807137] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.277 [2024-11-21 03:43:51.807221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.277 [2024-11-21 03:43:51.807250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.277 [2024-11-21 03:43:51.812570] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.277 [2024-11-21 03:43:51.812684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.277 [2024-11-21 03:43:51.812748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.277 [2024-11-21 03:43:51.817442] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.277 [2024-11-21 03:43:51.817795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.277 [2024-11-21 03:43:51.817825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.277 [2024-11-21 03:43:51.822141] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.277 [2024-11-21 03:43:51.822322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.277 [2024-11-21 03:43:51.822350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.277 [2024-11-21 03:43:51.826941] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.277 [2024-11-21 03:43:51.827243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.277 [2024-11-21 03:43:51.827273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.277 [2024-11-21 03:43:51.831771] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.277 [2024-11-21 03:43:51.832103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.277 [2024-11-21 03:43:51.832172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.277 [2024-11-21 03:43:51.836465] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.277 [2024-11-21 03:43:51.836721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.277 [2024-11-21 03:43:51.836801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.277 [2024-11-21 03:43:51.841329] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.277 [2024-11-21 03:43:51.841736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.277 [2024-11-21 03:43:51.841765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.277 [2024-11-21 03:43:51.846149] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.277 [2024-11-21 03:43:51.846496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:25312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.277 [2024-11-21 03:43:51.846548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.277 [2024-11-21 03:43:51.850980] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.277 [2024-11-21 03:43:51.851129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:11136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.277 [2024-11-21 03:43:51.851187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.277 [2024-11-21 03:43:51.855804] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.277 [2024-11-21 03:43:51.856225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:6912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.277 [2024-11-21 03:43:51.856279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.278 [2024-11-21 03:43:51.860631] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.278 [2024-11-21 03:43:51.860828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.278 [2024-11-21 03:43:51.860941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.278 [2024-11-21 03:43:51.865307] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.278 [2024-11-21 03:43:51.865416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.278 [2024-11-21 03:43:51.865509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.278 [2024-11-21 03:43:51.870082] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.278 [2024-11-21 03:43:51.870406] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.278 [2024-11-21 03:43:51.870473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.278 [2024-11-21 03:43:51.874689] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.278 [2024-11-21 03:43:51.874886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.278 [2024-11-21 03:43:51.874947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.278 [2024-11-21 03:43:51.879811] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.278 [2024-11-21 03:43:51.880052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.278 [2024-11-21 03:43:51.880100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.278 [2024-11-21 03:43:51.885291] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.278 [2024-11-21 03:43:51.885545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.278 [2024-11-21 03:43:51.885575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.278 [2024-11-21 03:43:51.890684] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.278 [2024-11-21 03:43:51.890916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.278 [2024-11-21 03:43:51.890946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.278 [2024-11-21 03:43:51.896193] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.278 [2024-11-21 03:43:51.896296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.278 [2024-11-21 03:43:51.896329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.278 [2024-11-21 03:43:51.901608] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.278 [2024-11-21 03:43:51.901725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.278 [2024-11-21 03:43:51.901758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.278 [2024-11-21 03:43:51.906799] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.278 [2024-11-21 03:43:51.906935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.278 [2024-11-21 03:43:51.906963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.278 [2024-11-21 03:43:51.912468] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.278 [2024-11-21 03:43:51.912623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.278 [2024-11-21 03:43:51.912651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.278 [2024-11-21 03:43:51.918112] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.278 [2024-11-21 03:43:51.918221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.278 [2024-11-21 03:43:51.918251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.537 [2024-11-21 03:43:51.923908] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.537 [2024-11-21 03:43:51.924176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.537 [2024-11-21 03:43:51.924205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.537 [2024-11-21 03:43:51.929597] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.537 [2024-11-21 03:43:51.929776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.537 [2024-11-21 03:43:51.929806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.537 [2024-11-21 03:43:51.935042] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.537 [2024-11-21 03:43:51.935274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.537 [2024-11-21 03:43:51.935356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.537 [2024-11-21 03:43:51.940572] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.537 [2024-11-21 03:43:51.940746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.537 [2024-11-21 03:43:51.940775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.537 [2024-11-21 03:43:51.945957] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.537 [2024-11-21 03:43:51.946151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.537 [2024-11-21 03:43:51.946181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.537 [2024-11-21 03:43:51.951305] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.537 [2024-11-21 03:43:51.951433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.537 [2024-11-21 03:43:51.951461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.537 [2024-11-21 03:43:51.956794] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.537 [2024-11-21 03:43:51.956928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.537 [2024-11-21 03:43:51.956957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.537 [2024-11-21 03:43:51.962215] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.537 [2024-11-21 03:43:51.962314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.537 [2024-11-21 03:43:51.962341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.537 [2024-11-21 03:43:51.967775] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.537 [2024-11-21 03:43:51.968096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.537 [2024-11-21 03:43:51.968125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.537 [2024-11-21 03:43:51.973140] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.537 [2024-11-21 03:43:51.973331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.538 [2024-11-21 03:43:51.973361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.538 [2024-11-21 03:43:51.978692] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.538 [2024-11-21 03:43:51.978806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.538 [2024-11-21 03:43:51.978861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.538 [2024-11-21 03:43:51.984027] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.538 [2024-11-21 03:43:51.984176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.538 [2024-11-21 03:43:51.984205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.538 [2024-11-21 03:43:51.989619] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.538 [2024-11-21 03:43:51.989737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.538 [2024-11-21 03:43:51.989765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.538 [2024-11-21 03:43:51.995039] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.538 [2024-11-21 03:43:51.995177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.538 [2024-11-21 03:43:51.995214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.538 [2024-11-21 03:43:52.000356] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.538 [2024-11-21 03:43:52.000472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.538 [2024-11-21 03:43:52.000501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.538 [2024-11-21 03:43:52.005668] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.538 [2024-11-21 03:43:52.005951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.538 [2024-11-21 03:43:52.005980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.538 [2024-11-21 03:43:52.011131] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.538 [2024-11-21 03:43:52.011384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:19616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.538 [2024-11-21 03:43:52.011413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.538 [2024-11-21 03:43:52.016555] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.538 [2024-11-21 03:43:52.016830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:19040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.538 [2024-11-21 03:43:52.016860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.538 [2024-11-21 03:43:52.021759] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.538 [2024-11-21 03:43:52.021913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:3648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.538 [2024-11-21 03:43:52.021942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.538 [2024-11-21 03:43:52.027131] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.538 [2024-11-21 03:43:52.027257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:9760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.538 [2024-11-21 03:43:52.027285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.538 [2024-11-21 03:43:52.032684] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.538 [2024-11-21 03:43:52.032883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:22048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.538 [2024-11-21 03:43:52.032912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.538 [2024-11-21 03:43:52.038076] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.538 [2024-11-21 03:43:52.038263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:4544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.538 [2024-11-21 03:43:52.038291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.538 [2024-11-21 03:43:52.043517] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.538 [2024-11-21 03:43:52.043662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:19072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.538 [2024-11-21 03:43:52.043728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.538 [2024-11-21 03:43:52.048993] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.538 [2024-11-21 03:43:52.049163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:8160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.538 [2024-11-21 03:43:52.049220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.538 [2024-11-21 03:43:52.054220] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.538 [2024-11-21 03:43:52.054378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:1120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.538 [2024-11-21 03:43:52.054457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.538 [2024-11-21 03:43:52.059594] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.538 [2024-11-21 03:43:52.059718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:15712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.538 [2024-11-21 03:43:52.059751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.538 [2024-11-21 03:43:52.065008] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.538 [2024-11-21 03:43:52.065243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:20928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.538 [2024-11-21 03:43:52.065287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.538 [2024-11-21 03:43:52.070209] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.538 [2024-11-21 03:43:52.070444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:19072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.538 [2024-11-21 03:43:52.070473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.538 [2024-11-21 03:43:52.075755] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.538 [2024-11-21 03:43:52.075862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:10112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.538 [2024-11-21 03:43:52.075897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.538 [2024-11-21 03:43:52.081388] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.538 [2024-11-21 03:43:52.081512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:6688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.538 [2024-11-21 03:43:52.081585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.538 [2024-11-21 03:43:52.086552] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.538 [2024-11-21 03:43:52.086716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:4832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.538 [2024-11-21 03:43:52.086800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.538 [2024-11-21 03:43:52.091804] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.538 [2024-11-21 03:43:52.091923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:20064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.538 [2024-11-21 03:43:52.091951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.538 [2024-11-21 03:43:52.097129] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.538 [2024-11-21 03:43:52.097232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:6336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.538 [2024-11-21 03:43:52.097261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.538 [2024-11-21 03:43:52.102649] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.538 [2024-11-21 03:43:52.102848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:25440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.538 [2024-11-21 03:43:52.102877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.538 [2024-11-21 03:43:52.108284] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.538 [2024-11-21 03:43:52.108634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:16000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.538 [2024-11-21 03:43:52.108664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.538 [2024-11-21 03:43:52.113789] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.538 [2024-11-21 03:43:52.113999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:11616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.538 [2024-11-21 03:43:52.114028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.538 [2024-11-21 03:43:52.119276] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.538 [2024-11-21 03:43:52.119367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:23584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.538 [2024-11-21 03:43:52.119395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.539 [2024-11-21 03:43:52.125292] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.539 [2024-11-21 03:43:52.125526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:17984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.539 [2024-11-21 03:43:52.125556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.539 [2024-11-21 03:43:52.131218] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.539 [2024-11-21 03:43:52.131382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:14112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.539 [2024-11-21 03:43:52.131410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.539 [2024-11-21 03:43:52.136644] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.539 [2024-11-21 03:43:52.136810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:17376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.539 [2024-11-21 03:43:52.136879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.539 [2024-11-21 03:43:52.141960] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.539 [2024-11-21 03:43:52.142121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:15168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.539 [2024-11-21 03:43:52.142197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.539 [2024-11-21 03:43:52.147281] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.539 [2024-11-21 03:43:52.147586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:13824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.539 [2024-11-21 03:43:52.147632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.539 [2024-11-21 03:43:52.152688] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.539 [2024-11-21 03:43:52.152789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:18816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.539 [2024-11-21 03:43:52.152820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.539 [2024-11-21 03:43:52.158211] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.539 [2024-11-21 03:43:52.158379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:2048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.539 [2024-11-21 03:43:52.158407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.539 [2024-11-21 03:43:52.163691] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.539 [2024-11-21 03:43:52.163895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:19904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.539 [2024-11-21 03:43:52.163923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.539 [2024-11-21 03:43:52.169006] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.539 [2024-11-21 03:43:52.169110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:8128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.539 [2024-11-21 03:43:52.169137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.539 [2024-11-21 03:43:52.174611] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.539 [2024-11-21 03:43:52.174718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:9376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.539 [2024-11-21 03:43:52.174762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.539 [2024-11-21 03:43:52.180163] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.539 [2024-11-21 03:43:52.180460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:12832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.539 [2024-11-21 03:43:52.180516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.798 [2024-11-21 03:43:52.185726] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.798 [2024-11-21 03:43:52.185854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:15712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.798 [2024-11-21 03:43:52.185883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.798 [2024-11-21 03:43:52.191064] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.798 [2024-11-21 03:43:52.191180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:16000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.798 [2024-11-21 03:43:52.191212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.798 [2024-11-21 03:43:52.196386] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.798 [2024-11-21 03:43:52.196518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:12480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.798 [2024-11-21 03:43:52.196546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.798 [2024-11-21 03:43:52.201679] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.798 [2024-11-21 03:43:52.201876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:19520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.798 [2024-11-21 03:43:52.201952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.798 [2024-11-21 03:43:52.207018] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.798 [2024-11-21 03:43:52.207224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:14784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.798 [2024-11-21 03:43:52.207313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.798 [2024-11-21 03:43:52.212657] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.798 [2024-11-21 03:43:52.212937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:3072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.798 [2024-11-21 03:43:52.212966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.798 [2024-11-21 03:43:52.218196] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.798 [2024-11-21 03:43:52.218329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:9408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.798 [2024-11-21 03:43:52.218359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.798 [2024-11-21 03:43:52.223618] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.798 [2024-11-21 03:43:52.223774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:19072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.798 [2024-11-21 03:43:52.223802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.798 [2024-11-21 03:43:52.229584] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.798 [2024-11-21 03:43:52.229808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:7328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.798 [2024-11-21 03:43:52.229863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.798 [2024-11-21 03:43:52.236338] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.798 [2024-11-21 03:43:52.236530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:1728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.798 [2024-11-21 03:43:52.236560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.798 [2024-11-21 03:43:52.243368] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.798 [2024-11-21 03:43:52.243556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:18784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.798 [2024-11-21 03:43:52.243584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.798 [2024-11-21 03:43:52.250238] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.798 [2024-11-21 03:43:52.250400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:8032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.798 [2024-11-21 03:43:52.250441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.799 [2024-11-21 03:43:52.257169] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.799 [2024-11-21 03:43:52.257614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:7584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.799 [2024-11-21 03:43:52.257643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.799 [2024-11-21 03:43:52.264182] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.799 [2024-11-21 03:43:52.264371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:11360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.799 [2024-11-21 03:43:52.264401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.799 [2024-11-21 03:43:52.271282] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.799 [2024-11-21 03:43:52.271484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:14624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.799 [2024-11-21 03:43:52.271531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.799 [2024-11-21 03:43:52.278544] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.799 [2024-11-21 03:43:52.278760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:6816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.799 [2024-11-21 03:43:52.278789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.799 [2024-11-21 03:43:52.285465] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.799 [2024-11-21 03:43:52.285631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.799 [2024-11-21 03:43:52.285680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.799 [2024-11-21 03:43:52.292666] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.799 [2024-11-21 03:43:52.292875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.799 [2024-11-21 03:43:52.292909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.799 [2024-11-21 03:43:52.299528] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.799 [2024-11-21 03:43:52.299752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:15584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.799 [2024-11-21 03:43:52.299781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.799 [2024-11-21 03:43:52.306842] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.799 [2024-11-21 03:43:52.307139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.799 [2024-11-21 03:43:52.307168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.799 [2024-11-21 03:43:52.313233] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.799 [2024-11-21 03:43:52.313578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:7904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.799 [2024-11-21 03:43:52.313607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.799 [2024-11-21 03:43:52.320309] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.799 [2024-11-21 03:43:52.320573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:19168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.799 [2024-11-21 03:43:52.320656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.799 [2024-11-21 03:43:52.327567] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.799 [2024-11-21 03:43:52.327737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:12096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.799 [2024-11-21 03:43:52.327767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.799 [2024-11-21 03:43:52.333276] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.799 [2024-11-21 03:43:52.333524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.799 [2024-11-21 03:43:52.333553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.799 [2024-11-21 03:43:52.337974] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.799 [2024-11-21 03:43:52.338375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:10336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.799 [2024-11-21 03:43:52.338433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.799 [2024-11-21 03:43:52.342810] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.799 [2024-11-21 03:43:52.343114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:6144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.799 [2024-11-21 03:43:52.343144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.799 [2024-11-21 03:43:52.347384] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.799 [2024-11-21 03:43:52.347773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:23808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.799 [2024-11-21 03:43:52.347857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.799 [2024-11-21 03:43:52.351999] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.799 [2024-11-21 03:43:52.352228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.799 [2024-11-21 03:43:52.352258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.799 [2024-11-21 03:43:52.356656] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.799 [2024-11-21 03:43:52.357140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.799 [2024-11-21 03:43:52.357193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.799 [2024-11-21 03:43:52.361477] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.799 [2024-11-21 03:43:52.361819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.799 [2024-11-21 03:43:52.361850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.799 [2024-11-21 03:43:52.366061] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.799 [2024-11-21 03:43:52.366534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.799 [2024-11-21 03:43:52.366562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.799 [2024-11-21 03:43:52.370463] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.799 [2024-11-21 03:43:52.370616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:7168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.799 [2024-11-21 03:43:52.370678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.799 [2024-11-21 03:43:52.375207] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.799 [2024-11-21 03:43:52.375354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:14336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.799 [2024-11-21 03:43:52.375425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.799 [2024-11-21 03:43:52.379792] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.799 [2024-11-21 03:43:52.379958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:6080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.799 [2024-11-21 03:43:52.379988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.799 [2024-11-21 03:43:52.384474] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.799 [2024-11-21 03:43:52.384916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:12064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.799 [2024-11-21 03:43:52.385004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.799 [2024-11-21 03:43:52.389141] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.799 [2024-11-21 03:43:52.389260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.799 [2024-11-21 03:43:52.389325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.799 [2024-11-21 03:43:52.393712] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.799 [2024-11-21 03:43:52.394026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.799 [2024-11-21 03:43:52.394078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.799 [2024-11-21 03:43:52.398328] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.799 [2024-11-21 03:43:52.398673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.799 [2024-11-21 03:43:52.398751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.799 [2024-11-21 03:43:52.402996] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.799 [2024-11-21 03:43:52.403310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.799 [2024-11-21 03:43:52.403391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.799 [2024-11-21 03:43:52.407725] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.800 [2024-11-21 03:43:52.408036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.800 [2024-11-21 03:43:52.408089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.800 [2024-11-21 03:43:52.412335] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.800 [2024-11-21 03:43:52.412735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.800 [2024-11-21 03:43:52.412829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.800 [2024-11-21 03:43:52.417021] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.800 [2024-11-21 03:43:52.417248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.800 [2024-11-21 03:43:52.417277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.800 [2024-11-21 03:43:52.421493] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.800 [2024-11-21 03:43:52.421686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.800 [2024-11-21 03:43:52.421722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.800 [2024-11-21 03:43:52.426057] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.800 [2024-11-21 03:43:52.426610] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.800 [2024-11-21 03:43:52.426698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.800 [2024-11-21 03:43:52.430671] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.800 [2024-11-21 03:43:52.431127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.800 [2024-11-21 03:43:52.431156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.800 [2024-11-21 03:43:52.435439] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.800 [2024-11-21 03:43:52.435754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:1984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.800 [2024-11-21 03:43:52.435803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.800 [2024-11-21 03:43:52.439968] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:11.800 [2024-11-21 03:43:52.440203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.800 [2024-11-21 03:43:52.440288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.059 [2024-11-21 03:43:52.445210] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.059 [2024-11-21 03:43:52.445514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.059 [2024-11-21 03:43:52.445634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.059 [2024-11-21 03:43:52.450198] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.059 [2024-11-21 03:43:52.450450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.059 [2024-11-21 03:43:52.450503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.059 [2024-11-21 03:43:52.455217] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.059 [2024-11-21 03:43:52.455741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.059 [2024-11-21 03:43:52.455773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.059 [2024-11-21 03:43:52.460370] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.059 [2024-11-21 03:43:52.460782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.059 [2024-11-21 03:43:52.460826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.059 [2024-11-21 03:43:52.466034] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.059 [2024-11-21 03:43:52.466330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.059 [2024-11-21 03:43:52.466398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.059 [2024-11-21 03:43:52.472611] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.059 [2024-11-21 03:43:52.473002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.059 [2024-11-21 03:43:52.473090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.059 [2024-11-21 03:43:52.479009] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.059 [2024-11-21 03:43:52.479291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.059 [2024-11-21 03:43:52.479352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.060 [2024-11-21 03:43:52.485749] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.060 [2024-11-21 03:43:52.485892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.060 [2024-11-21 03:43:52.485920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.060 [2024-11-21 03:43:52.492716] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.060 [2024-11-21 03:43:52.492951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.060 [2024-11-21 03:43:52.492996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.060 [2024-11-21 03:43:52.499283] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.060 [2024-11-21 03:43:52.499413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.060 [2024-11-21 03:43:52.499448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.060 [2024-11-21 03:43:52.506028] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.060 [2024-11-21 03:43:52.506325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.060 [2024-11-21 03:43:52.506357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.060 [2024-11-21 03:43:52.513197] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.060 [2024-11-21 03:43:52.513407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.060 [2024-11-21 03:43:52.513435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.060 [2024-11-21 03:43:52.520095] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.060 [2024-11-21 03:43:52.520331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.060 [2024-11-21 03:43:52.520414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.060 [2024-11-21 03:43:52.526884] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.060 [2024-11-21 03:43:52.527036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.060 [2024-11-21 03:43:52.527065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.060 [2024-11-21 03:43:52.533575] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.060 [2024-11-21 03:43:52.533736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.060 [2024-11-21 03:43:52.533765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.060 [2024-11-21 03:43:52.540652] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.060 [2024-11-21 03:43:52.540922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.060 [2024-11-21 03:43:52.540952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.060 [2024-11-21 03:43:52.547897] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.060 [2024-11-21 03:43:52.548167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.060 [2024-11-21 03:43:52.548196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.060 [2024-11-21 03:43:52.555321] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.060 [2024-11-21 03:43:52.555540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.060 [2024-11-21 03:43:52.555568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.060 [2024-11-21 03:43:52.562186] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.060 [2024-11-21 03:43:52.562430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.060 [2024-11-21 03:43:52.562463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.060 [2024-11-21 03:43:52.569371] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.060 [2024-11-21 03:43:52.569614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.060 [2024-11-21 03:43:52.569642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.060 [2024-11-21 03:43:52.576336] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.060 [2024-11-21 03:43:52.576539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.060 [2024-11-21 03:43:52.576620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.060 [2024-11-21 03:43:52.584109] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.060 [2024-11-21 03:43:52.584284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.060 [2024-11-21 03:43:52.584335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.060 [2024-11-21 03:43:52.591467] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.060 [2024-11-21 03:43:52.591660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.060 [2024-11-21 03:43:52.591710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.060 [2024-11-21 03:43:52.597805] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.060 [2024-11-21 03:43:52.598006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.060 [2024-11-21 03:43:52.598034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.060 [2024-11-21 03:43:52.603103] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.060 [2024-11-21 03:43:52.603317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.060 [2024-11-21 03:43:52.603369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.060 [2024-11-21 03:43:52.607983] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.060 [2024-11-21 03:43:52.608201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.060 [2024-11-21 03:43:52.608264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.060 [2024-11-21 03:43:52.612578] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.060 [2024-11-21 03:43:52.612800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.060 [2024-11-21 03:43:52.612829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.060 [2024-11-21 03:43:52.617254] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.060 [2024-11-21 03:43:52.617627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.060 [2024-11-21 03:43:52.617682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.060 [2024-11-21 03:43:52.621842] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.060 [2024-11-21 03:43:52.622231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.060 [2024-11-21 03:43:52.622290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.060 [2024-11-21 03:43:52.627148] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.060 [2024-11-21 03:43:52.627419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.060 [2024-11-21 03:43:52.627449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.060 [2024-11-21 03:43:52.631787] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.060 [2024-11-21 03:43:52.632133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.060 [2024-11-21 03:43:52.632200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.060 [2024-11-21 03:43:52.636570] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.060 [2024-11-21 03:43:52.636795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.060 [2024-11-21 03:43:52.636871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.060 [2024-11-21 03:43:52.641658] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.060 [2024-11-21 03:43:52.641780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.060 [2024-11-21 03:43:52.641864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.060 [2024-11-21 03:43:52.646672] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.060 [2024-11-21 03:43:52.646901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.061 [2024-11-21 03:43:52.646977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.061 [2024-11-21 03:43:52.651758] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.061 [2024-11-21 03:43:52.651959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.061 [2024-11-21 03:43:52.652033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.061 [2024-11-21 03:43:52.656954] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.061 [2024-11-21 03:43:52.657128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.061 [2024-11-21 03:43:52.657172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.061 [2024-11-21 03:43:52.662202] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.061 [2024-11-21 03:43:52.662463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.061 [2024-11-21 03:43:52.662492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.061 [2024-11-21 03:43:52.666931] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.061 [2024-11-21 03:43:52.667445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:19872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.061 [2024-11-21 03:43:52.667548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.061 [2024-11-21 03:43:52.671879] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.061 [2024-11-21 03:43:52.672193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.061 [2024-11-21 03:43:52.672260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.061 [2024-11-21 03:43:52.676416] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.061 [2024-11-21 03:43:52.676696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:8000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.061 [2024-11-21 03:43:52.676730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.061 [2024-11-21 03:43:52.681040] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.061 [2024-11-21 03:43:52.681249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:18624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.061 [2024-11-21 03:43:52.681279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.061 [2024-11-21 03:43:52.685663] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.061 [2024-11-21 03:43:52.685970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:10304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.061 [2024-11-21 03:43:52.686050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.061 [2024-11-21 03:43:52.690292] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.061 [2024-11-21 03:43:52.690506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.061 [2024-11-21 03:43:52.690582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.061 [2024-11-21 03:43:52.694977] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.061 [2024-11-21 03:43:52.695318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.061 [2024-11-21 03:43:52.695356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.061 [2024-11-21 03:43:52.699662] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.061 [2024-11-21 03:43:52.700003] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.061 [2024-11-21 03:43:52.700033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.061 [2024-11-21 03:43:52.704518] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.320 [2024-11-21 03:43:52.704792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:6816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.320 [2024-11-21 03:43:52.704858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.320 [2024-11-21 03:43:52.709548] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.320 [2024-11-21 03:43:52.709691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:4288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.320 [2024-11-21 03:43:52.709721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.320 [2024-11-21 03:43:52.714308] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.320 [2024-11-21 03:43:52.714602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:23712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.320 [2024-11-21 03:43:52.714689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.320 [2024-11-21 03:43:52.719011] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.320 [2024-11-21 03:43:52.719459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:8256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.320 [2024-11-21 03:43:52.719507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.320 [2024-11-21 03:43:52.723886] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.320 [2024-11-21 03:43:52.724367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.320 [2024-11-21 03:43:52.724397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.320 [2024-11-21 03:43:52.728683] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.320 [2024-11-21 03:43:52.728866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.320 [2024-11-21 03:43:52.728941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.320 [2024-11-21 03:43:52.733932] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.320 [2024-11-21 03:43:52.734143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.320 [2024-11-21 03:43:52.734227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.320 [2024-11-21 03:43:52.738665] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.320 [2024-11-21 03:43:52.739033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.320 [2024-11-21 03:43:52.739149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.320 [2024-11-21 03:43:52.743731] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.320 [2024-11-21 03:43:52.743838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.320 [2024-11-21 03:43:52.743866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.320 [2024-11-21 03:43:52.748803] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.321 [2024-11-21 03:43:52.749088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.321 [2024-11-21 03:43:52.749117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.321 [2024-11-21 03:43:52.754571] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.321 [2024-11-21 03:43:52.754714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.321 [2024-11-21 03:43:52.754744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.321 [2024-11-21 03:43:52.759990] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.321 [2024-11-21 03:43:52.760172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.321 [2024-11-21 03:43:52.760263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.321 [2024-11-21 03:43:52.766331] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.321 [2024-11-21 03:43:52.766586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.321 [2024-11-21 03:43:52.766615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.321 [2024-11-21 03:43:52.772936] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.321 [2024-11-21 03:43:52.773266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.321 [2024-11-21 03:43:52.773296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.321 [2024-11-21 03:43:52.779605] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.321 [2024-11-21 03:43:52.780128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.321 [2024-11-21 03:43:52.780156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.321 [2024-11-21 03:43:52.786038] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.321 [2024-11-21 03:43:52.786266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:2784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.321 [2024-11-21 03:43:52.786305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.321 [2024-11-21 03:43:52.793238] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.321 [2024-11-21 03:43:52.793483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:2912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.321 [2024-11-21 03:43:52.793512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.321 [2024-11-21 03:43:52.800101] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.321 [2024-11-21 03:43:52.800308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:14560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.321 [2024-11-21 03:43:52.800340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.321 [2024-11-21 03:43:52.806933] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.321 [2024-11-21 03:43:52.807189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:9984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.321 [2024-11-21 03:43:52.807256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.321 [2024-11-21 03:43:52.814013] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.321 [2024-11-21 03:43:52.814227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:22784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.321 [2024-11-21 03:43:52.814276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.321 [2024-11-21 03:43:52.821274] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.321 [2024-11-21 03:43:52.821463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:13984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.321 [2024-11-21 03:43:52.821497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.321 [2024-11-21 03:43:52.828355] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.321 [2024-11-21 03:43:52.828566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:13184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.321 [2024-11-21 03:43:52.828647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.321 [2024-11-21 03:43:52.835320] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.321 [2024-11-21 03:43:52.835753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:15232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.321 [2024-11-21 03:43:52.835817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.321 [2024-11-21 03:43:52.842088] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.321 [2024-11-21 03:43:52.842254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.321 [2024-11-21 03:43:52.842284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.321 [2024-11-21 03:43:52.849262] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.321 [2024-11-21 03:43:52.849551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.321 [2024-11-21 03:43:52.849580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.321 [2024-11-21 03:43:52.855134] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.321 [2024-11-21 03:43:52.855336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.321 [2024-11-21 03:43:52.855365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.321 [2024-11-21 03:43:52.861928] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.321 [2024-11-21 03:43:52.862223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.321 [2024-11-21 03:43:52.862266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.321 [2024-11-21 03:43:52.868837] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.321 [2024-11-21 03:43:52.869009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.321 [2024-11-21 03:43:52.869038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.321 [2024-11-21 03:43:52.875761] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.321 [2024-11-21 03:43:52.875982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.321 [2024-11-21 03:43:52.876016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.321 [2024-11-21 03:43:52.883535] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.321 [2024-11-21 03:43:52.883857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.321 [2024-11-21 03:43:52.883913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.321 [2024-11-21 03:43:52.891202] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.321 [2024-11-21 03:43:52.891466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.321 [2024-11-21 03:43:52.891495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.321 [2024-11-21 03:43:52.897846] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.321 [2024-11-21 03:43:52.898239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.321 [2024-11-21 03:43:52.898333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.321 [2024-11-21 03:43:52.902969] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.321 [2024-11-21 03:43:52.903473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:18816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.321 [2024-11-21 03:43:52.903504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.321 [2024-11-21 03:43:52.908343] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.321 [2024-11-21 03:43:52.908603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.321 [2024-11-21 03:43:52.908666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.321 [2024-11-21 03:43:52.913494] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.321 [2024-11-21 03:43:52.913812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.321 [2024-11-21 03:43:52.913870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.321 [2024-11-21 03:43:52.918881] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.321 [2024-11-21 03:43:52.919058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.321 [2024-11-21 03:43:52.919147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.321 [2024-11-21 03:43:52.924465] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.321 [2024-11-21 03:43:52.924602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.322 [2024-11-21 03:43:52.924632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.322 [2024-11-21 03:43:52.929681] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.322 [2024-11-21 03:43:52.929877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.322 [2024-11-21 03:43:52.929953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.322 [2024-11-21 03:43:52.935107] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.322 [2024-11-21 03:43:52.935350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.322 [2024-11-21 03:43:52.935380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.322 [2024-11-21 03:43:52.940410] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.322 [2024-11-21 03:43:52.940781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.322 [2024-11-21 03:43:52.940867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.322 [2024-11-21 03:43:52.945699] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.322 [2024-11-21 03:43:52.945972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.322 [2024-11-21 03:43:52.946029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.322 [2024-11-21 03:43:52.950827] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.322 [2024-11-21 03:43:52.951096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.322 [2024-11-21 03:43:52.951125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.322 [2024-11-21 03:43:52.956219] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.322 [2024-11-21 03:43:52.956494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.322 [2024-11-21 03:43:52.956558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.322 [2024-11-21 03:43:52.961598] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.322 [2024-11-21 03:43:52.961756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:4608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.322 [2024-11-21 03:43:52.961802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.582 [2024-11-21 03:43:52.967097] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.582 [2024-11-21 03:43:52.967379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:1056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.582 [2024-11-21 03:43:52.967428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.582 [2024-11-21 03:43:52.972345] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.582 [2024-11-21 03:43:52.972732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:19904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.582 [2024-11-21 03:43:52.972829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.582 [2024-11-21 03:43:52.977621] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.582 [2024-11-21 03:43:52.977837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.582 [2024-11-21 03:43:52.977873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.582 [2024-11-21 03:43:52.983085] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.582 [2024-11-21 03:43:52.983362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.582 [2024-11-21 03:43:52.983418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.582 [2024-11-21 03:43:52.988186] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.582 [2024-11-21 03:43:52.988514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.582 [2024-11-21 03:43:52.988543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.582 [2024-11-21 03:43:52.993339] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.582 [2024-11-21 03:43:52.993596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.582 [2024-11-21 03:43:52.993626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.582 [2024-11-21 03:43:52.998622] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.582 [2024-11-21 03:43:52.998950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.582 [2024-11-21 03:43:52.998980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.582 [2024-11-21 03:43:53.003549] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.582 [2024-11-21 03:43:53.003747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.582 [2024-11-21 03:43:53.003778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.582 [2024-11-21 03:43:53.009804] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.582 [2024-11-21 03:43:53.010119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.582 [2024-11-21 03:43:53.010148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.582 [2024-11-21 03:43:53.016825] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.582 [2024-11-21 03:43:53.017163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.582 [2024-11-21 03:43:53.017193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.582 [2024-11-21 03:43:53.023437] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.582 [2024-11-21 03:43:53.023810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.582 [2024-11-21 03:43:53.023913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.582 [2024-11-21 03:43:53.028403] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.582 [2024-11-21 03:43:53.028720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:18816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.582 [2024-11-21 03:43:53.028791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.582 [2024-11-21 03:43:53.033727] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.582 [2024-11-21 03:43:53.033855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:12288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.582 [2024-11-21 03:43:53.033890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.582 [2024-11-21 03:43:53.039355] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.582 [2024-11-21 03:43:53.039520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:17920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.582 [2024-11-21 03:43:53.039550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.582 [2024-11-21 03:43:53.045539] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.582 [2024-11-21 03:43:53.045727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:5824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.582 [2024-11-21 03:43:53.045756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.582 [2024-11-21 03:43:53.052644] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.582 [2024-11-21 03:43:53.052869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:22816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.582 [2024-11-21 03:43:53.052920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.582 [2024-11-21 03:43:53.057893] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.583 [2024-11-21 03:43:53.058256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:12192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.583 [2024-11-21 03:43:53.058355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.583 [2024-11-21 03:43:53.063364] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.583 [2024-11-21 03:43:53.063626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.583 [2024-11-21 03:43:53.063681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.583 [2024-11-21 03:43:53.068243] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.583 [2024-11-21 03:43:53.068598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.583 [2024-11-21 03:43:53.068630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.583 [2024-11-21 03:43:53.072805] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.583 [2024-11-21 03:43:53.072986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:11744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.583 [2024-11-21 03:43:53.073017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.583 [2024-11-21 03:43:53.077998] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.583 [2024-11-21 03:43:53.078179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:19968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.583 [2024-11-21 03:43:53.078253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.583 [2024-11-21 03:43:53.083156] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.583 [2024-11-21 03:43:53.083325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:15520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.583 [2024-11-21 03:43:53.083399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.583 [2024-11-21 03:43:53.088116] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.583 [2024-11-21 03:43:53.088364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:16384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.583 [2024-11-21 03:43:53.088396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.583 [2024-11-21 03:43:53.093269] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.583 [2024-11-21 03:43:53.093599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:12288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.583 [2024-11-21 03:43:53.093629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.583 [2024-11-21 03:43:53.098546] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.583 [2024-11-21 03:43:53.098842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:19712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.583 [2024-11-21 03:43:53.098871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.583 [2024-11-21 03:43:53.103529] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.583 [2024-11-21 03:43:53.103754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:7520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.583 [2024-11-21 03:43:53.103788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.583 [2024-11-21 03:43:53.108537] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.583 [2024-11-21 03:43:53.108684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:12128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.583 [2024-11-21 03:43:53.108769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.583 [2024-11-21 03:43:53.113478] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.583 [2024-11-21 03:43:53.113850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:22912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.583 [2024-11-21 03:43:53.113930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.583 [2024-11-21 03:43:53.118440] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.583 [2024-11-21 03:43:53.118625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:10304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.583 [2024-11-21 03:43:53.118659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.583 [2024-11-21 03:43:53.123701] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.583 [2024-11-21 03:43:53.123800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:3040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.583 [2024-11-21 03:43:53.123827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.583 [2024-11-21 03:43:53.128588] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.583 [2024-11-21 03:43:53.128782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:9728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.583 [2024-11-21 03:43:53.128818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.583 [2024-11-21 03:43:53.133577] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.583 [2024-11-21 03:43:53.133933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.583 [2024-11-21 03:43:53.133987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.583 [2024-11-21 03:43:53.138317] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.583 [2024-11-21 03:43:53.138794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:1440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.583 [2024-11-21 03:43:53.138826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.583 [2024-11-21 03:43:53.143296] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.583 [2024-11-21 03:43:53.143531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.583 [2024-11-21 03:43:53.143564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.583 [2024-11-21 03:43:53.148388] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.583 [2024-11-21 03:43:53.148563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.583 [2024-11-21 03:43:53.148641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.583 [2024-11-21 03:43:53.153349] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.583 [2024-11-21 03:43:53.153489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.583 [2024-11-21 03:43:53.153561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.583 [2024-11-21 03:43:53.157967] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.583 [2024-11-21 03:43:53.158114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.583 [2024-11-21 03:43:53.158181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.583 [2024-11-21 03:43:53.163085] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.583 [2024-11-21 03:43:53.163446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.583 [2024-11-21 03:43:53.163476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.583 [2024-11-21 03:43:53.167894] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.583 [2024-11-21 03:43:53.168150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:21056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.583 [2024-11-21 03:43:53.168233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.583 [2024-11-21 03:43:53.172579] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.583 [2024-11-21 03:43:53.172744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:18336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.583 [2024-11-21 03:43:53.172821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.583 [2024-11-21 03:43:53.177060] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.583 [2024-11-21 03:43:53.177501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:20160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.583 [2024-11-21 03:43:53.177530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.583 [2024-11-21 03:43:53.181747] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.583 [2024-11-21 03:43:53.182127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.583 [2024-11-21 03:43:53.182163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.583 [2024-11-21 03:43:53.186627] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.583 [2024-11-21 03:43:53.186817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.583 [2024-11-21 03:43:53.186901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.583 [2024-11-21 03:43:53.191905] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.584 [2024-11-21 03:43:53.192025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.584 [2024-11-21 03:43:53.192053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.584 [2024-11-21 03:43:53.197893] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.584 [2024-11-21 03:43:53.198169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.584 [2024-11-21 03:43:53.198218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.584 [2024-11-21 03:43:53.204458] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.584 [2024-11-21 03:43:53.204628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.584 [2024-11-21 03:43:53.204675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.584 [2024-11-21 03:43:53.210272] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.584 [2024-11-21 03:43:53.210628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.584 [2024-11-21 03:43:53.210657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.584 [2024-11-21 03:43:53.215459] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.584 [2024-11-21 03:43:53.215829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.584 [2024-11-21 03:43:53.215878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.584 [2024-11-21 03:43:53.220944] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.584 [2024-11-21 03:43:53.221236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:12800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.584 [2024-11-21 03:43:53.221308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.584 [2024-11-21 03:43:53.226921] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.845 [2024-11-21 03:43:53.227238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:14048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.845 [2024-11-21 03:43:53.227268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.845 [2024-11-21 03:43:53.233907] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.845 [2024-11-21 03:43:53.234113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.845 [2024-11-21 03:43:53.234192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.845 [2024-11-21 03:43:53.240635] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.845 [2024-11-21 03:43:53.240836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:2144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.845 [2024-11-21 03:43:53.240880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.845 [2024-11-21 03:43:53.247484] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.845 [2024-11-21 03:43:53.247804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:5248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.845 [2024-11-21 03:43:53.247902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.845 [2024-11-21 03:43:53.254090] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.845 [2024-11-21 03:43:53.254351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:1472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.845 [2024-11-21 03:43:53.254401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.845 [2024-11-21 03:43:53.260930] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.845 [2024-11-21 03:43:53.261299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:14240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.845 [2024-11-21 03:43:53.261354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.845 [2024-11-21 03:43:53.266062] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.845 [2024-11-21 03:43:53.266399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:19488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.845 [2024-11-21 03:43:53.266486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.845 [2024-11-21 03:43:53.271235] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.845 [2024-11-21 03:43:53.271401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.845 [2024-11-21 03:43:53.271430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.845 [2024-11-21 03:43:53.276892] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.845 [2024-11-21 03:43:53.277027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.845 [2024-11-21 03:43:53.277056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.845 [2024-11-21 03:43:53.282623] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.845 [2024-11-21 03:43:53.282794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.845 [2024-11-21 03:43:53.282884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.845 [2024-11-21 03:43:53.288176] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.845 [2024-11-21 03:43:53.288446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.845 [2024-11-21 03:43:53.288475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.845 [2024-11-21 03:43:53.294825] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.845 [2024-11-21 03:43:53.295050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.845 [2024-11-21 03:43:53.295107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.845 [2024-11-21 03:43:53.300931] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.845 [2024-11-21 03:43:53.301124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.845 [2024-11-21 03:43:53.301154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.845 [2024-11-21 03:43:53.306941] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.845 [2024-11-21 03:43:53.307088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.845 [2024-11-21 03:43:53.307149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.845 [2024-11-21 03:43:53.311380] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.845 [2024-11-21 03:43:53.311848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.845 [2024-11-21 03:43:53.311883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.845 [2024-11-21 03:43:53.316137] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.845 [2024-11-21 03:43:53.316463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.845 [2024-11-21 03:43:53.316492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.845 [2024-11-21 03:43:53.320697] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.846 [2024-11-21 03:43:53.320939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:13920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.846 [2024-11-21 03:43:53.321015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.846 [2024-11-21 03:43:53.325320] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.846 [2024-11-21 03:43:53.325538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:22400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.846 [2024-11-21 03:43:53.325589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.846 [2024-11-21 03:43:53.329922] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.846 [2024-11-21 03:43:53.330167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:6208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.846 [2024-11-21 03:43:53.330204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.846 [2024-11-21 03:43:53.334431] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.846 [2024-11-21 03:43:53.334668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:5632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.846 [2024-11-21 03:43:53.334745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.846 [2024-11-21 03:43:53.338926] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.846 [2024-11-21 03:43:53.339307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:20768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.846 [2024-11-21 03:43:53.339409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.846 [2024-11-21 03:43:53.343448] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.846 [2024-11-21 03:43:53.343568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.846 [2024-11-21 03:43:53.343649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.846 [2024-11-21 03:43:53.348133] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.846 [2024-11-21 03:43:53.348381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.846 [2024-11-21 03:43:53.348410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.846 [2024-11-21 03:43:53.352637] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.846 [2024-11-21 03:43:53.352920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.846 [2024-11-21 03:43:53.352975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.846 [2024-11-21 03:43:53.357231] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.846 [2024-11-21 03:43:53.357684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.846 [2024-11-21 03:43:53.357712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.846 [2024-11-21 03:43:53.362133] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.846 [2024-11-21 03:43:53.362501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.846 [2024-11-21 03:43:53.362578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.846 [2024-11-21 03:43:53.366684] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.846 [2024-11-21 03:43:53.366961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.846 [2024-11-21 03:43:53.366991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.846 [2024-11-21 03:43:53.371256] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.846 [2024-11-21 03:43:53.371405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.846 [2024-11-21 03:43:53.371490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.846 [2024-11-21 03:43:53.375884] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.846 [2024-11-21 03:43:53.376179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.846 [2024-11-21 03:43:53.376261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.846 [2024-11-21 03:43:53.380409] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.846 [2024-11-21 03:43:53.380729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.846 [2024-11-21 03:43:53.380759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.846 [2024-11-21 03:43:53.385336] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.846 [2024-11-21 03:43:53.385449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.846 [2024-11-21 03:43:53.385478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.846 [2024-11-21 03:43:53.391342] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.846 [2024-11-21 03:43:53.391672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.846 [2024-11-21 03:43:53.391702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.846 [2024-11-21 03:43:53.397824] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.846 [2024-11-21 03:43:53.398012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.846 [2024-11-21 03:43:53.398046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.846 [2024-11-21 03:43:53.404257] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.846 [2024-11-21 03:43:53.404591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.846 [2024-11-21 03:43:53.404620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.846 [2024-11-21 03:43:53.411167] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.846 [2024-11-21 03:43:53.411472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.846 [2024-11-21 03:43:53.411501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.846 [2024-11-21 03:43:53.418378] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.846 [2024-11-21 03:43:53.418560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.846 [2024-11-21 03:43:53.418636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.846 [2024-11-21 03:43:53.425200] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.846 [2024-11-21 03:43:53.425471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.846 [2024-11-21 03:43:53.425556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.846 [2024-11-21 03:43:53.432186] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.846 [2024-11-21 03:43:53.432379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.846 [2024-11-21 03:43:53.432432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.846 [2024-11-21 03:43:53.439016] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.846 [2024-11-21 03:43:53.439190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.846 [2024-11-21 03:43:53.439219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.847 [2024-11-21 03:43:53.446463] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.847 [2024-11-21 03:43:53.446639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.847 [2024-11-21 03:43:53.446668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.847 [2024-11-21 03:43:53.453551] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.847 [2024-11-21 03:43:53.453771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.847 [2024-11-21 03:43:53.453807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.847 [2024-11-21 03:43:53.460175] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.847 [2024-11-21 03:43:53.460373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.847 [2024-11-21 03:43:53.460402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.847 [2024-11-21 03:43:53.467038] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.847 [2024-11-21 03:43:53.467563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.847 [2024-11-21 03:43:53.467597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.847 [2024-11-21 03:43:53.473985] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.847 [2024-11-21 03:43:53.474283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.847 [2024-11-21 03:43:53.474328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.847 [2024-11-21 03:43:53.480718] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.847 [2024-11-21 03:43:53.480963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:8064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.847 [2024-11-21 03:43:53.480992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.847 [2024-11-21 03:43:53.487924] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:12.847 [2024-11-21 03:43:53.488136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:1280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.847 [2024-11-21 03:43:53.488165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.166 [2024-11-21 03:43:53.494057] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:13.166 [2024-11-21 03:43:53.494221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:2464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.166 [2024-11-21 03:43:53.494253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.166 [2024-11-21 03:43:53.501027] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:13.166 [2024-11-21 03:43:53.501339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:7776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.166 [2024-11-21 03:43:53.501372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.166 [2024-11-21 03:43:53.507815] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:13.166 [2024-11-21 03:43:53.508108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:2592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.166 [2024-11-21 03:43:53.508189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.166 [2024-11-21 03:43:53.514598] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:13.166 [2024-11-21 03:43:53.514959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:10784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.166 [2024-11-21 03:43:53.515006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.166 [2024-11-21 03:43:53.521632] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:13.166 [2024-11-21 03:43:53.522087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.166 [2024-11-21 03:43:53.522135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.166 [2024-11-21 03:43:53.528855] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:13.166 [2024-11-21 03:43:53.529035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:2336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.166 [2024-11-21 03:43:53.529077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.166 [2024-11-21 03:43:53.536066] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:13.166 [2024-11-21 03:43:53.536330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:5568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.166 [2024-11-21 03:43:53.536370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.166 [2024-11-21 03:43:53.543081] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:13.166 [2024-11-21 03:43:53.543281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:6432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.166 [2024-11-21 03:43:53.543310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.166 [2024-11-21 03:43:53.550055] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:13.166 [2024-11-21 03:43:53.550257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:21984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.166 [2024-11-21 03:43:53.550285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.166 [2024-11-21 03:43:53.557082] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:13.166 [2024-11-21 03:43:53.557365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:14944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.166 [2024-11-21 03:43:53.557414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.166 [2024-11-21 03:43:53.563761] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:13.166 [2024-11-21 03:43:53.564103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:1472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.166 [2024-11-21 03:43:53.564144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.166 [2024-11-21 03:43:53.570359] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:13.166 [2024-11-21 03:43:53.570665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:9856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.166 [2024-11-21 03:43:53.570694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.166 [2024-11-21 03:43:53.577531] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:13.166 [2024-11-21 03:43:53.577877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:14784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.166 [2024-11-21 03:43:53.577906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.166 [2024-11-21 03:43:53.583010] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:13.166 [2024-11-21 03:43:53.583393] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:21952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.166 [2024-11-21 03:43:53.583505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.166 [2024-11-21 03:43:53.587763] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:13.166 [2024-11-21 03:43:53.588141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:8096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.166 [2024-11-21 03:43:53.588213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.166 [2024-11-21 03:43:53.592548] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:13.166 [2024-11-21 03:43:53.592848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.166 [2024-11-21 03:43:53.592885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.166 [2024-11-21 03:43:53.597625] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:13.166 [2024-11-21 03:43:53.597824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:19776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.166 [2024-11-21 03:43:53.597853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.166 [2024-11-21 03:43:53.602698] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1135fb0) with pdu=0x2000190fef90 00:27:13.166 [2024-11-21 03:43:53.602826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:18592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.166 [2024-11-21 03:43:53.602854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.166 00:27:13.166 Latency(us) 00:27:13.166 [2024-11-21T02:43:53.814Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:13.166 [2024-11-21T02:43:53.814Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:27:13.167 nvme0n1 : 2.00 5557.09 694.64 0.00 0.00 2869.51 1771.90 12087.75 00:27:13.167 [2024-11-21T02:43:53.815Z] =================================================================================================================== 00:27:13.167 [2024-11-21T02:43:53.815Z] Total : 5557.09 694.64 0.00 0.00 2869.51 1771.90 12087.75 00:27:13.167 0 00:27:13.167 03:43:53 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:27:13.167 03:43:53 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:27:13.167 03:43:53 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:27:13.167 03:43:53 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:27:13.167 | .driver_specific 00:27:13.167 | .nvme_error 00:27:13.167 | .status_code 00:27:13.167 | .command_transient_transport_error' 00:27:13.431 03:43:53 -- host/digest.sh@71 -- # (( 358 > 0 )) 00:27:13.431 03:43:53 -- host/digest.sh@73 -- # killprocess 3167459 00:27:13.431 03:43:53 -- common/autotest_common.sh@936 -- # '[' -z 3167459 ']' 00:27:13.431 03:43:53 -- common/autotest_common.sh@940 -- # kill -0 3167459 00:27:13.431 03:43:53 -- common/autotest_common.sh@941 -- # uname 00:27:13.431 03:43:53 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:13.431 03:43:53 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3167459 00:27:13.431 03:43:53 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:13.431 03:43:53 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:13.431 03:43:53 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3167459' 00:27:13.431 killing process with pid 3167459 00:27:13.431 03:43:53 -- common/autotest_common.sh@955 -- # kill 3167459 00:27:13.431 Received shutdown signal, test time was about 2.000000 seconds 00:27:13.431 00:27:13.431 Latency(us) 00:27:13.431 [2024-11-21T02:43:54.079Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:13.431 [2024-11-21T02:43:54.079Z] =================================================================================================================== 00:27:13.431 [2024-11-21T02:43:54.079Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:27:13.431 03:43:53 -- common/autotest_common.sh@960 -- # wait 3167459 00:27:13.689 03:43:54 -- host/digest.sh@115 -- # killprocess 3165718 00:27:13.689 03:43:54 -- common/autotest_common.sh@936 -- # '[' -z 3165718 ']' 00:27:13.689 03:43:54 -- common/autotest_common.sh@940 -- # kill -0 3165718 00:27:13.689 03:43:54 -- common/autotest_common.sh@941 -- # uname 00:27:13.689 03:43:54 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:13.689 03:43:54 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3165718 00:27:13.689 03:43:54 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:27:13.689 03:43:54 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:27:13.689 03:43:54 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3165718' 00:27:13.689 killing process with pid 3165718 00:27:13.689 03:43:54 -- common/autotest_common.sh@955 -- # kill 3165718 00:27:13.689 03:43:54 -- common/autotest_common.sh@960 -- # wait 3165718 00:27:13.949 00:27:13.949 real 0m18.579s 00:27:13.949 user 0m36.767s 00:27:13.949 sys 0m4.666s 00:27:13.949 03:43:54 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:13.949 03:43:54 -- common/autotest_common.sh@10 -- # set +x 00:27:13.949 ************************************ 00:27:13.949 END TEST nvmf_digest_error 00:27:13.949 ************************************ 00:27:13.949 03:43:54 -- host/digest.sh@138 -- # trap - SIGINT SIGTERM EXIT 00:27:13.949 03:43:54 -- host/digest.sh@139 -- # nvmftestfini 00:27:13.949 03:43:54 -- nvmf/common.sh@476 -- # nvmfcleanup 00:27:13.949 03:43:54 -- nvmf/common.sh@116 -- # sync 00:27:13.949 03:43:54 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:27:13.949 03:43:54 -- nvmf/common.sh@119 -- # set +e 00:27:13.949 03:43:54 -- nvmf/common.sh@120 -- # for i in {1..20} 00:27:13.949 03:43:54 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:27:13.949 rmmod nvme_tcp 00:27:13.949 rmmod nvme_fabrics 00:27:13.949 rmmod nvme_keyring 00:27:13.949 03:43:54 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:27:13.949 03:43:54 -- nvmf/common.sh@123 -- # set -e 00:27:13.949 03:43:54 -- nvmf/common.sh@124 -- # return 0 00:27:13.949 03:43:54 -- nvmf/common.sh@477 -- # '[' -n 3165718 ']' 00:27:13.949 03:43:54 -- nvmf/common.sh@478 -- # killprocess 3165718 00:27:13.949 03:43:54 -- common/autotest_common.sh@936 -- # '[' -z 3165718 ']' 00:27:13.949 03:43:54 -- common/autotest_common.sh@940 -- # kill -0 3165718 00:27:13.949 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (3165718) - No such process 00:27:13.949 03:43:54 -- common/autotest_common.sh@963 -- # echo 'Process with pid 3165718 is not found' 00:27:13.949 Process with pid 3165718 is not found 00:27:13.949 03:43:54 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:27:13.949 03:43:54 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:27:13.949 03:43:54 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:27:13.949 03:43:54 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:27:13.949 03:43:54 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:27:13.949 03:43:54 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:13.949 03:43:54 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:13.949 03:43:54 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:16.485 03:43:56 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:27:16.485 00:27:16.485 real 0m38.485s 00:27:16.485 user 1m8.005s 00:27:16.485 sys 0m10.590s 00:27:16.485 03:43:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:16.485 03:43:56 -- common/autotest_common.sh@10 -- # set +x 00:27:16.485 ************************************ 00:27:16.485 END TEST nvmf_digest 00:27:16.485 ************************************ 00:27:16.485 03:43:56 -- nvmf/nvmf.sh@110 -- # [[ 0 -eq 1 ]] 00:27:16.485 03:43:56 -- nvmf/nvmf.sh@115 -- # [[ 0 -eq 1 ]] 00:27:16.485 03:43:56 -- nvmf/nvmf.sh@120 -- # [[ phy == phy ]] 00:27:16.485 03:43:56 -- nvmf/nvmf.sh@122 -- # run_test nvmf_bdevperf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:27:16.485 03:43:56 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:27:16.485 03:43:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:16.485 03:43:56 -- common/autotest_common.sh@10 -- # set +x 00:27:16.485 ************************************ 00:27:16.485 START TEST nvmf_bdevperf 00:27:16.485 ************************************ 00:27:16.485 03:43:56 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:27:16.485 * Looking for test storage... 00:27:16.485 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:27:16.485 03:43:56 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:27:16.485 03:43:56 -- common/autotest_common.sh@1690 -- # lcov --version 00:27:16.485 03:43:56 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:27:16.485 03:43:56 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:27:16.485 03:43:56 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:27:16.485 03:43:56 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:27:16.485 03:43:56 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:27:16.485 03:43:56 -- scripts/common.sh@335 -- # IFS=.-: 00:27:16.485 03:43:56 -- scripts/common.sh@335 -- # read -ra ver1 00:27:16.485 03:43:56 -- scripts/common.sh@336 -- # IFS=.-: 00:27:16.485 03:43:56 -- scripts/common.sh@336 -- # read -ra ver2 00:27:16.485 03:43:56 -- scripts/common.sh@337 -- # local 'op=<' 00:27:16.485 03:43:56 -- scripts/common.sh@339 -- # ver1_l=2 00:27:16.485 03:43:56 -- scripts/common.sh@340 -- # ver2_l=1 00:27:16.485 03:43:56 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:27:16.485 03:43:56 -- scripts/common.sh@343 -- # case "$op" in 00:27:16.485 03:43:56 -- scripts/common.sh@344 -- # : 1 00:27:16.485 03:43:56 -- scripts/common.sh@363 -- # (( v = 0 )) 00:27:16.485 03:43:56 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:27:16.485 03:43:56 -- scripts/common.sh@364 -- # decimal 1 00:27:16.485 03:43:56 -- scripts/common.sh@352 -- # local d=1 00:27:16.485 03:43:56 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:27:16.485 03:43:56 -- scripts/common.sh@354 -- # echo 1 00:27:16.485 03:43:56 -- scripts/common.sh@364 -- # ver1[v]=1 00:27:16.485 03:43:56 -- scripts/common.sh@365 -- # decimal 2 00:27:16.485 03:43:56 -- scripts/common.sh@352 -- # local d=2 00:27:16.485 03:43:56 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:27:16.485 03:43:56 -- scripts/common.sh@354 -- # echo 2 00:27:16.485 03:43:56 -- scripts/common.sh@365 -- # ver2[v]=2 00:27:16.485 03:43:56 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:27:16.485 03:43:56 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:27:16.485 03:43:56 -- scripts/common.sh@367 -- # return 0 00:27:16.485 03:43:56 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:27:16.485 03:43:56 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:27:16.485 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:16.485 --rc genhtml_branch_coverage=1 00:27:16.485 --rc genhtml_function_coverage=1 00:27:16.485 --rc genhtml_legend=1 00:27:16.486 --rc geninfo_all_blocks=1 00:27:16.486 --rc geninfo_unexecuted_blocks=1 00:27:16.486 00:27:16.486 ' 00:27:16.486 03:43:56 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:27:16.486 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:16.486 --rc genhtml_branch_coverage=1 00:27:16.486 --rc genhtml_function_coverage=1 00:27:16.486 --rc genhtml_legend=1 00:27:16.486 --rc geninfo_all_blocks=1 00:27:16.486 --rc geninfo_unexecuted_blocks=1 00:27:16.486 00:27:16.486 ' 00:27:16.486 03:43:56 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:27:16.486 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:16.486 --rc genhtml_branch_coverage=1 00:27:16.486 --rc genhtml_function_coverage=1 00:27:16.486 --rc genhtml_legend=1 00:27:16.486 --rc geninfo_all_blocks=1 00:27:16.486 --rc geninfo_unexecuted_blocks=1 00:27:16.486 00:27:16.486 ' 00:27:16.486 03:43:56 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:27:16.486 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:16.486 --rc genhtml_branch_coverage=1 00:27:16.486 --rc genhtml_function_coverage=1 00:27:16.486 --rc genhtml_legend=1 00:27:16.486 --rc geninfo_all_blocks=1 00:27:16.486 --rc geninfo_unexecuted_blocks=1 00:27:16.486 00:27:16.486 ' 00:27:16.486 03:43:56 -- host/bdevperf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:27:16.486 03:43:56 -- nvmf/common.sh@7 -- # uname -s 00:27:16.486 03:43:56 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:16.486 03:43:56 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:16.486 03:43:56 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:16.486 03:43:56 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:16.486 03:43:56 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:16.486 03:43:56 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:16.486 03:43:56 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:16.486 03:43:56 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:16.486 03:43:56 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:16.486 03:43:56 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:16.486 03:43:56 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:27:16.486 03:43:56 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:27:16.486 03:43:56 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:16.486 03:43:56 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:16.486 03:43:56 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:16.486 03:43:56 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:16.486 03:43:56 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:16.486 03:43:56 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:16.486 03:43:56 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:16.486 03:43:56 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:16.486 03:43:56 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:16.486 03:43:56 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:16.486 03:43:56 -- paths/export.sh@5 -- # export PATH 00:27:16.486 03:43:56 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:16.486 03:43:56 -- nvmf/common.sh@46 -- # : 0 00:27:16.486 03:43:56 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:27:16.486 03:43:56 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:27:16.486 03:43:56 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:27:16.486 03:43:56 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:16.486 03:43:56 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:16.486 03:43:56 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:27:16.486 03:43:56 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:27:16.486 03:43:56 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:27:16.486 03:43:56 -- host/bdevperf.sh@11 -- # MALLOC_BDEV_SIZE=64 00:27:16.486 03:43:56 -- host/bdevperf.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:27:16.486 03:43:56 -- host/bdevperf.sh@24 -- # nvmftestinit 00:27:16.486 03:43:56 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:27:16.486 03:43:56 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:27:16.486 03:43:56 -- nvmf/common.sh@436 -- # prepare_net_devs 00:27:16.486 03:43:56 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:27:16.486 03:43:56 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:27:16.486 03:43:56 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:16.486 03:43:56 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:16.486 03:43:56 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:16.486 03:43:56 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:27:16.486 03:43:56 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:27:16.486 03:43:56 -- nvmf/common.sh@284 -- # xtrace_disable 00:27:16.486 03:43:56 -- common/autotest_common.sh@10 -- # set +x 00:27:18.392 03:43:58 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:27:18.392 03:43:58 -- nvmf/common.sh@290 -- # pci_devs=() 00:27:18.392 03:43:58 -- nvmf/common.sh@290 -- # local -a pci_devs 00:27:18.392 03:43:58 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:27:18.392 03:43:58 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:27:18.392 03:43:58 -- nvmf/common.sh@292 -- # pci_drivers=() 00:27:18.392 03:43:58 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:27:18.392 03:43:58 -- nvmf/common.sh@294 -- # net_devs=() 00:27:18.392 03:43:58 -- nvmf/common.sh@294 -- # local -ga net_devs 00:27:18.392 03:43:58 -- nvmf/common.sh@295 -- # e810=() 00:27:18.392 03:43:58 -- nvmf/common.sh@295 -- # local -ga e810 00:27:18.392 03:43:58 -- nvmf/common.sh@296 -- # x722=() 00:27:18.392 03:43:58 -- nvmf/common.sh@296 -- # local -ga x722 00:27:18.392 03:43:58 -- nvmf/common.sh@297 -- # mlx=() 00:27:18.392 03:43:58 -- nvmf/common.sh@297 -- # local -ga mlx 00:27:18.392 03:43:58 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:27:18.392 03:43:58 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:27:18.392 03:43:58 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:27:18.392 03:43:58 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:27:18.392 03:43:58 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:27:18.392 03:43:58 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:27:18.392 03:43:58 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:27:18.392 03:43:58 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:27:18.392 03:43:58 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:27:18.392 03:43:58 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:27:18.392 03:43:58 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:27:18.392 03:43:58 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:27:18.392 03:43:58 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:27:18.392 03:43:58 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:27:18.392 03:43:58 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:27:18.392 03:43:58 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:27:18.392 03:43:58 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:27:18.392 03:43:58 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:18.392 03:43:58 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:27:18.392 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:27:18.392 03:43:58 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:18.392 03:43:58 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:18.392 03:43:58 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:18.392 03:43:58 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:18.392 03:43:58 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:18.392 03:43:58 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:18.392 03:43:58 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:27:18.392 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:27:18.392 03:43:58 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:18.392 03:43:58 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:18.392 03:43:58 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:18.392 03:43:58 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:18.392 03:43:58 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:18.393 03:43:58 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:27:18.393 03:43:58 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:27:18.393 03:43:58 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:27:18.393 03:43:58 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:18.393 03:43:58 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:18.393 03:43:58 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:18.393 03:43:58 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:18.393 03:43:58 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:27:18.393 Found net devices under 0000:0a:00.0: cvl_0_0 00:27:18.393 03:43:58 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:18.393 03:43:58 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:18.393 03:43:58 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:18.393 03:43:58 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:18.393 03:43:58 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:18.393 03:43:58 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:27:18.393 Found net devices under 0000:0a:00.1: cvl_0_1 00:27:18.393 03:43:58 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:18.393 03:43:58 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:27:18.393 03:43:58 -- nvmf/common.sh@402 -- # is_hw=yes 00:27:18.393 03:43:58 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:27:18.393 03:43:58 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:27:18.393 03:43:58 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:27:18.393 03:43:58 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:27:18.393 03:43:58 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:27:18.393 03:43:58 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:27:18.393 03:43:58 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:27:18.393 03:43:58 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:27:18.393 03:43:58 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:27:18.393 03:43:58 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:27:18.393 03:43:58 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:27:18.393 03:43:58 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:27:18.393 03:43:58 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:27:18.393 03:43:58 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:27:18.393 03:43:58 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:27:18.393 03:43:58 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:27:18.393 03:43:58 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:27:18.393 03:43:58 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:27:18.393 03:43:58 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:27:18.393 03:43:58 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:27:18.393 03:43:58 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:27:18.393 03:43:58 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:27:18.393 03:43:58 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:27:18.393 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:27:18.393 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.267 ms 00:27:18.393 00:27:18.393 --- 10.0.0.2 ping statistics --- 00:27:18.393 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:18.393 rtt min/avg/max/mdev = 0.267/0.267/0.267/0.000 ms 00:27:18.393 03:43:58 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:27:18.393 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:27:18.393 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.155 ms 00:27:18.393 00:27:18.393 --- 10.0.0.1 ping statistics --- 00:27:18.393 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:18.393 rtt min/avg/max/mdev = 0.155/0.155/0.155/0.000 ms 00:27:18.393 03:43:58 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:27:18.393 03:43:58 -- nvmf/common.sh@410 -- # return 0 00:27:18.393 03:43:58 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:27:18.393 03:43:58 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:27:18.393 03:43:58 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:27:18.393 03:43:58 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:27:18.393 03:43:58 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:27:18.393 03:43:58 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:27:18.393 03:43:58 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:27:18.393 03:43:58 -- host/bdevperf.sh@25 -- # tgt_init 00:27:18.393 03:43:58 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:27:18.393 03:43:58 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:18.393 03:43:58 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:18.393 03:43:58 -- common/autotest_common.sh@10 -- # set +x 00:27:18.393 03:43:58 -- nvmf/common.sh@469 -- # nvmfpid=3170047 00:27:18.393 03:43:58 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:27:18.393 03:43:58 -- nvmf/common.sh@470 -- # waitforlisten 3170047 00:27:18.393 03:43:58 -- common/autotest_common.sh@829 -- # '[' -z 3170047 ']' 00:27:18.393 03:43:58 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:18.393 03:43:58 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:18.393 03:43:58 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:18.393 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:18.393 03:43:58 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:18.393 03:43:58 -- common/autotest_common.sh@10 -- # set +x 00:27:18.393 [2024-11-21 03:43:59.013243] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:18.393 [2024-11-21 03:43:59.013311] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:18.652 EAL: No free 2048 kB hugepages reported on node 1 00:27:18.652 [2024-11-21 03:43:59.079255] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:27:18.652 [2024-11-21 03:43:59.194910] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:18.652 [2024-11-21 03:43:59.195091] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:18.652 [2024-11-21 03:43:59.195123] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:18.652 [2024-11-21 03:43:59.195136] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:18.652 [2024-11-21 03:43:59.195418] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:27:18.652 [2024-11-21 03:43:59.195507] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:27:18.652 [2024-11-21 03:43:59.195511] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:19.584 03:44:00 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:19.584 03:44:00 -- common/autotest_common.sh@862 -- # return 0 00:27:19.584 03:44:00 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:19.584 03:44:00 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:19.584 03:44:00 -- common/autotest_common.sh@10 -- # set +x 00:27:19.584 03:44:00 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:19.584 03:44:00 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:27:19.584 03:44:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:19.584 03:44:00 -- common/autotest_common.sh@10 -- # set +x 00:27:19.584 [2024-11-21 03:44:00.056318] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:19.584 03:44:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:19.584 03:44:00 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:27:19.584 03:44:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:19.584 03:44:00 -- common/autotest_common.sh@10 -- # set +x 00:27:19.584 Malloc0 00:27:19.584 03:44:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:19.584 03:44:00 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:19.584 03:44:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:19.584 03:44:00 -- common/autotest_common.sh@10 -- # set +x 00:27:19.584 03:44:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:19.584 03:44:00 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:27:19.584 03:44:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:19.584 03:44:00 -- common/autotest_common.sh@10 -- # set +x 00:27:19.585 03:44:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:19.585 03:44:00 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:19.585 03:44:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:19.585 03:44:00 -- common/autotest_common.sh@10 -- # set +x 00:27:19.585 [2024-11-21 03:44:00.131273] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:19.585 03:44:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:19.585 03:44:00 -- host/bdevperf.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -q 128 -o 4096 -w verify -t 1 00:27:19.585 03:44:00 -- host/bdevperf.sh@27 -- # gen_nvmf_target_json 00:27:19.585 03:44:00 -- nvmf/common.sh@520 -- # config=() 00:27:19.585 03:44:00 -- nvmf/common.sh@520 -- # local subsystem config 00:27:19.585 03:44:00 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:27:19.585 03:44:00 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:27:19.585 { 00:27:19.585 "params": { 00:27:19.585 "name": "Nvme$subsystem", 00:27:19.585 "trtype": "$TEST_TRANSPORT", 00:27:19.585 "traddr": "$NVMF_FIRST_TARGET_IP", 00:27:19.585 "adrfam": "ipv4", 00:27:19.585 "trsvcid": "$NVMF_PORT", 00:27:19.585 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:27:19.585 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:27:19.585 "hdgst": ${hdgst:-false}, 00:27:19.585 "ddgst": ${ddgst:-false} 00:27:19.585 }, 00:27:19.585 "method": "bdev_nvme_attach_controller" 00:27:19.585 } 00:27:19.585 EOF 00:27:19.585 )") 00:27:19.585 03:44:00 -- nvmf/common.sh@542 -- # cat 00:27:19.585 03:44:00 -- nvmf/common.sh@544 -- # jq . 00:27:19.585 03:44:00 -- nvmf/common.sh@545 -- # IFS=, 00:27:19.585 03:44:00 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:27:19.585 "params": { 00:27:19.585 "name": "Nvme1", 00:27:19.585 "trtype": "tcp", 00:27:19.585 "traddr": "10.0.0.2", 00:27:19.585 "adrfam": "ipv4", 00:27:19.585 "trsvcid": "4420", 00:27:19.585 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:27:19.585 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:27:19.585 "hdgst": false, 00:27:19.585 "ddgst": false 00:27:19.585 }, 00:27:19.585 "method": "bdev_nvme_attach_controller" 00:27:19.585 }' 00:27:19.585 [2024-11-21 03:44:00.175677] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:19.585 [2024-11-21 03:44:00.175744] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3170206 ] 00:27:19.585 EAL: No free 2048 kB hugepages reported on node 1 00:27:19.843 [2024-11-21 03:44:00.236207] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:19.843 [2024-11-21 03:44:00.350024] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:20.101 Running I/O for 1 seconds... 00:27:21.034 00:27:21.035 Latency(us) 00:27:21.035 [2024-11-21T02:44:01.683Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:21.035 [2024-11-21T02:44:01.683Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:27:21.035 Verification LBA range: start 0x0 length 0x4000 00:27:21.035 Nvme1n1 : 1.01 10882.62 42.51 0.00 0.00 11702.15 1256.11 17185.00 00:27:21.035 [2024-11-21T02:44:01.683Z] =================================================================================================================== 00:27:21.035 [2024-11-21T02:44:01.683Z] Total : 10882.62 42.51 0.00 0.00 11702.15 1256.11 17185.00 00:27:21.293 03:44:01 -- host/bdevperf.sh@30 -- # bdevperfpid=3170353 00:27:21.293 03:44:01 -- host/bdevperf.sh@32 -- # sleep 3 00:27:21.293 03:44:01 -- host/bdevperf.sh@29 -- # gen_nvmf_target_json 00:27:21.293 03:44:01 -- host/bdevperf.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -q 128 -o 4096 -w verify -t 15 -f 00:27:21.293 03:44:01 -- nvmf/common.sh@520 -- # config=() 00:27:21.293 03:44:01 -- nvmf/common.sh@520 -- # local subsystem config 00:27:21.293 03:44:01 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:27:21.293 03:44:01 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:27:21.293 { 00:27:21.293 "params": { 00:27:21.293 "name": "Nvme$subsystem", 00:27:21.293 "trtype": "$TEST_TRANSPORT", 00:27:21.293 "traddr": "$NVMF_FIRST_TARGET_IP", 00:27:21.293 "adrfam": "ipv4", 00:27:21.293 "trsvcid": "$NVMF_PORT", 00:27:21.293 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:27:21.293 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:27:21.293 "hdgst": ${hdgst:-false}, 00:27:21.293 "ddgst": ${ddgst:-false} 00:27:21.293 }, 00:27:21.293 "method": "bdev_nvme_attach_controller" 00:27:21.293 } 00:27:21.293 EOF 00:27:21.293 )") 00:27:21.551 03:44:01 -- nvmf/common.sh@542 -- # cat 00:27:21.551 03:44:01 -- nvmf/common.sh@544 -- # jq . 00:27:21.551 03:44:01 -- nvmf/common.sh@545 -- # IFS=, 00:27:21.551 03:44:01 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:27:21.551 "params": { 00:27:21.551 "name": "Nvme1", 00:27:21.551 "trtype": "tcp", 00:27:21.551 "traddr": "10.0.0.2", 00:27:21.551 "adrfam": "ipv4", 00:27:21.551 "trsvcid": "4420", 00:27:21.551 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:27:21.551 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:27:21.551 "hdgst": false, 00:27:21.551 "ddgst": false 00:27:21.551 }, 00:27:21.551 "method": "bdev_nvme_attach_controller" 00:27:21.551 }' 00:27:21.551 [2024-11-21 03:44:01.978311] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:21.551 [2024-11-21 03:44:01.978402] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3170353 ] 00:27:21.551 EAL: No free 2048 kB hugepages reported on node 1 00:27:21.551 [2024-11-21 03:44:02.039944] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:21.551 [2024-11-21 03:44:02.146063] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:21.810 Running I/O for 15 seconds... 00:27:24.342 03:44:04 -- host/bdevperf.sh@33 -- # kill -9 3170047 00:27:24.342 03:44:04 -- host/bdevperf.sh@35 -- # sleep 3 00:27:24.342 [2024-11-21 03:44:04.948470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:127624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.342 [2024-11-21 03:44:04.948523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.342 [2024-11-21 03:44:04.948554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:127632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.342 [2024-11-21 03:44:04.948574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.342 [2024-11-21 03:44:04.948594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:127664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.342 [2024-11-21 03:44:04.948612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.342 [2024-11-21 03:44:04.948630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:127688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.342 [2024-11-21 03:44:04.948647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.342 [2024-11-21 03:44:04.948666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:127696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.342 [2024-11-21 03:44:04.948682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.342 [2024-11-21 03:44:04.948699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:127704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.342 [2024-11-21 03:44:04.948716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.342 [2024-11-21 03:44:04.948734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:127720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.342 [2024-11-21 03:44:04.948750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.342 [2024-11-21 03:44:04.948769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:127104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.342 [2024-11-21 03:44:04.948785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.342 [2024-11-21 03:44:04.948804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:127112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.342 [2024-11-21 03:44:04.948831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.342 [2024-11-21 03:44:04.948851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:127120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.342 [2024-11-21 03:44:04.948869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.342 [2024-11-21 03:44:04.948887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:127168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.342 [2024-11-21 03:44:04.948904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.342 [2024-11-21 03:44:04.948923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:127176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.343 [2024-11-21 03:44:04.948940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.343 [2024-11-21 03:44:04.948958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:127200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.343 [2024-11-21 03:44:04.948975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.343 [2024-11-21 03:44:04.948992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:127208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.343 [2024-11-21 03:44:04.949006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.343 [2024-11-21 03:44:04.949023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:127216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.343 [2024-11-21 03:44:04.949038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.343 [2024-11-21 03:44:04.949064] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:127728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.343 [2024-11-21 03:44:04.949088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.343 [2024-11-21 03:44:04.949106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:127736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.343 [2024-11-21 03:44:04.949135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.343 [2024-11-21 03:44:04.949152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:127752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.343 [2024-11-21 03:44:04.949166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.343 [2024-11-21 03:44:04.949181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:127760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.343 [2024-11-21 03:44:04.949195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.343 [2024-11-21 03:44:04.949210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:127784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.343 [2024-11-21 03:44:04.949224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.343 [2024-11-21 03:44:04.949239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:127808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.343 [2024-11-21 03:44:04.949253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.343 [2024-11-21 03:44:04.949271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:127816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.343 [2024-11-21 03:44:04.949286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.343 [2024-11-21 03:44:04.949301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:127824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.343 [2024-11-21 03:44:04.949315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.343 [2024-11-21 03:44:04.949330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:127848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.343 [2024-11-21 03:44:04.949344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.343 [2024-11-21 03:44:04.949382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:127224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.343 [2024-11-21 03:44:04.949396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.343 [2024-11-21 03:44:04.949410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:127272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.343 [2024-11-21 03:44:04.949423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.343 [2024-11-21 03:44:04.949456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:127280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.343 [2024-11-21 03:44:04.949470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.343 [2024-11-21 03:44:04.949487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:127352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.343 [2024-11-21 03:44:04.949502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.343 [2024-11-21 03:44:04.949519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:127368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.343 [2024-11-21 03:44:04.949534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.343 [2024-11-21 03:44:04.949550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:127384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.343 [2024-11-21 03:44:04.949565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.343 [2024-11-21 03:44:04.949582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:127392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.343 [2024-11-21 03:44:04.949597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.343 [2024-11-21 03:44:04.949614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:127400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.343 [2024-11-21 03:44:04.949629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.343 [2024-11-21 03:44:04.949646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:127872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.343 [2024-11-21 03:44:04.949661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.343 [2024-11-21 03:44:04.949679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:127880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.343 [2024-11-21 03:44:04.949698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.343 [2024-11-21 03:44:04.949716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:127888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.343 [2024-11-21 03:44:04.949732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.343 [2024-11-21 03:44:04.949748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:127896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.343 [2024-11-21 03:44:04.949764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.343 [2024-11-21 03:44:04.949781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:127904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.343 [2024-11-21 03:44:04.949795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.343 [2024-11-21 03:44:04.949812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:127912 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.343 [2024-11-21 03:44:04.949827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.343 [2024-11-21 03:44:04.949844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:127920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.343 [2024-11-21 03:44:04.949859] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.343 [2024-11-21 03:44:04.949876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:127928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.343 [2024-11-21 03:44:04.949891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.343 [2024-11-21 03:44:04.949908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:127936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.343 [2024-11-21 03:44:04.949923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.343 [2024-11-21 03:44:04.949940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:127944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.343 [2024-11-21 03:44:04.949955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.343 [2024-11-21 03:44:04.949971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:127952 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.343 [2024-11-21 03:44:04.949986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.343 [2024-11-21 03:44:04.950003] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:127960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.343 [2024-11-21 03:44:04.950018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.343 [2024-11-21 03:44:04.950035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:127968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.343 [2024-11-21 03:44:04.950049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.343 [2024-11-21 03:44:04.950067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:127976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.343 [2024-11-21 03:44:04.950090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.343 [2024-11-21 03:44:04.950108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:127984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.343 [2024-11-21 03:44:04.950143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.343 [2024-11-21 03:44:04.950159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:127408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.344 [2024-11-21 03:44:04.950173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.344 [2024-11-21 03:44:04.950188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:127424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.344 [2024-11-21 03:44:04.950201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.344 [2024-11-21 03:44:04.950217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:127448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.344 [2024-11-21 03:44:04.950231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.344 [2024-11-21 03:44:04.950246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:127456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.344 [2024-11-21 03:44:04.950260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.344 [2024-11-21 03:44:04.950275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:127480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.344 [2024-11-21 03:44:04.950288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.344 [2024-11-21 03:44:04.950303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:127488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.344 [2024-11-21 03:44:04.950317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.344 [2024-11-21 03:44:04.950332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:127520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.344 [2024-11-21 03:44:04.950350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.344 [2024-11-21 03:44:04.950383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:127576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.344 [2024-11-21 03:44:04.950398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.344 [2024-11-21 03:44:04.950418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:127992 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.344 [2024-11-21 03:44:04.950433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.344 [2024-11-21 03:44:04.950449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:128000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.344 [2024-11-21 03:44:04.950464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.344 [2024-11-21 03:44:04.950481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:128008 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.344 [2024-11-21 03:44:04.950497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.344 [2024-11-21 03:44:04.950513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:128016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.344 [2024-11-21 03:44:04.950529] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.344 [2024-11-21 03:44:04.950550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:128024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.344 [2024-11-21 03:44:04.950567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.344 [2024-11-21 03:44:04.950583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:128032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.344 [2024-11-21 03:44:04.950598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.344 [2024-11-21 03:44:04.950615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:128040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.344 [2024-11-21 03:44:04.950629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.344 [2024-11-21 03:44:04.950646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:128048 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.344 [2024-11-21 03:44:04.950662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.344 [2024-11-21 03:44:04.950678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:128056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.344 [2024-11-21 03:44:04.950693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.344 [2024-11-21 03:44:04.950709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:128064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.344 [2024-11-21 03:44:04.950724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.344 [2024-11-21 03:44:04.950742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:128072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.344 [2024-11-21 03:44:04.950757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.344 [2024-11-21 03:44:04.950774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:128080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.344 [2024-11-21 03:44:04.950789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.344 [2024-11-21 03:44:04.950805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:128088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.344 [2024-11-21 03:44:04.950820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.344 [2024-11-21 03:44:04.950837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:128096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.344 [2024-11-21 03:44:04.950852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.344 [2024-11-21 03:44:04.950868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:128104 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.344 [2024-11-21 03:44:04.950882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.344 [2024-11-21 03:44:04.950899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:128112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.344 [2024-11-21 03:44:04.950914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.344 [2024-11-21 03:44:04.950931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:128120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.344 [2024-11-21 03:44:04.950950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.344 [2024-11-21 03:44:04.950967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:128128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.344 [2024-11-21 03:44:04.950983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.344 [2024-11-21 03:44:04.950999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:128136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.344 [2024-11-21 03:44:04.951014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.344 [2024-11-21 03:44:04.951031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:128144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.344 [2024-11-21 03:44:04.951046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.344 [2024-11-21 03:44:04.951067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:128152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.344 [2024-11-21 03:44:04.951091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.344 [2024-11-21 03:44:04.951108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:128160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.344 [2024-11-21 03:44:04.951137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.344 [2024-11-21 03:44:04.951153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:128168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.344 [2024-11-21 03:44:04.951167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.344 [2024-11-21 03:44:04.951182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:128176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.344 [2024-11-21 03:44:04.951195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.344 [2024-11-21 03:44:04.951210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:128184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.344 [2024-11-21 03:44:04.951224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.344 [2024-11-21 03:44:04.951239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:128192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.344 [2024-11-21 03:44:04.951252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.344 [2024-11-21 03:44:04.951268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:128200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.344 [2024-11-21 03:44:04.951281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.344 [2024-11-21 03:44:04.951296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:128208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.344 [2024-11-21 03:44:04.951310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.344 [2024-11-21 03:44:04.951325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:128216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.344 [2024-11-21 03:44:04.951339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.344 [2024-11-21 03:44:04.951386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:128224 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.344 [2024-11-21 03:44:04.951400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.344 [2024-11-21 03:44:04.951414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:128232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.344 [2024-11-21 03:44:04.951441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.344 [2024-11-21 03:44:04.951458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:128240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.344 [2024-11-21 03:44:04.951473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.345 [2024-11-21 03:44:04.951490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:128248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.345 [2024-11-21 03:44:04.951505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.345 [2024-11-21 03:44:04.951522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:128256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.345 [2024-11-21 03:44:04.951537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.345 [2024-11-21 03:44:04.951553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:128264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.345 [2024-11-21 03:44:04.951567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.345 [2024-11-21 03:44:04.951584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:128272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.345 [2024-11-21 03:44:04.951599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.345 [2024-11-21 03:44:04.951616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:128280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.345 [2024-11-21 03:44:04.951631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.345 [2024-11-21 03:44:04.951647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:128288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.345 [2024-11-21 03:44:04.951662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.345 [2024-11-21 03:44:04.951678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:128296 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.345 [2024-11-21 03:44:04.951694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.345 [2024-11-21 03:44:04.951710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:128304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.345 [2024-11-21 03:44:04.951725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.345 [2024-11-21 03:44:04.951742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:128312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.345 [2024-11-21 03:44:04.951756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.345 [2024-11-21 03:44:04.951773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:128320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.345 [2024-11-21 03:44:04.951793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.345 [2024-11-21 03:44:04.951811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:128328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.345 [2024-11-21 03:44:04.951827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.345 [2024-11-21 03:44:04.951843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:128336 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.345 [2024-11-21 03:44:04.951859] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.345 [2024-11-21 03:44:04.951876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:127616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.345 [2024-11-21 03:44:04.951891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.345 [2024-11-21 03:44:04.951908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:127640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.345 [2024-11-21 03:44:04.951922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.345 [2024-11-21 03:44:04.951939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:127648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.345 [2024-11-21 03:44:04.951954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.345 [2024-11-21 03:44:04.951971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:127656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.345 [2024-11-21 03:44:04.951985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.345 [2024-11-21 03:44:04.952002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:127672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.345 [2024-11-21 03:44:04.952017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.345 [2024-11-21 03:44:04.952034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:127680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.345 [2024-11-21 03:44:04.952049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.345 [2024-11-21 03:44:04.952067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:127712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.345 [2024-11-21 03:44:04.952090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.345 [2024-11-21 03:44:04.952107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:127744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.345 [2024-11-21 03:44:04.952138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.345 [2024-11-21 03:44:04.952154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:128344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.345 [2024-11-21 03:44:04.952167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.345 [2024-11-21 03:44:04.952182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:128352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.345 [2024-11-21 03:44:04.952196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.345 [2024-11-21 03:44:04.952215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:128360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.345 [2024-11-21 03:44:04.952229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.345 [2024-11-21 03:44:04.952245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:128368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.345 [2024-11-21 03:44:04.952258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.345 [2024-11-21 03:44:04.952273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:128376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.345 [2024-11-21 03:44:04.952286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.345 [2024-11-21 03:44:04.952301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:128384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.345 [2024-11-21 03:44:04.952315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.345 [2024-11-21 03:44:04.952330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:128392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.345 [2024-11-21 03:44:04.952344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.345 [2024-11-21 03:44:04.952375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:128400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.345 [2024-11-21 03:44:04.952390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.345 [2024-11-21 03:44:04.952406] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:128408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.345 [2024-11-21 03:44:04.952421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.345 [2024-11-21 03:44:04.952437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:128416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.345 [2024-11-21 03:44:04.952451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.345 [2024-11-21 03:44:04.952468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:128424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.345 [2024-11-21 03:44:04.952483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.345 [2024-11-21 03:44:04.952500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:128432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.345 [2024-11-21 03:44:04.952515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.345 [2024-11-21 03:44:04.952531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:128440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.345 [2024-11-21 03:44:04.952546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.345 [2024-11-21 03:44:04.952562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:127768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.345 [2024-11-21 03:44:04.952577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.345 [2024-11-21 03:44:04.952593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:127776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.345 [2024-11-21 03:44:04.952611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.345 [2024-11-21 03:44:04.952629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:127792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.346 [2024-11-21 03:44:04.952644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.346 [2024-11-21 03:44:04.952661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:127800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.346 [2024-11-21 03:44:04.952676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.346 [2024-11-21 03:44:04.952693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:127832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.346 [2024-11-21 03:44:04.952708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.346 [2024-11-21 03:44:04.952725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:127840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.346 [2024-11-21 03:44:04.952740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.346 [2024-11-21 03:44:04.952756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:127856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:24.346 [2024-11-21 03:44:04.952771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.346 [2024-11-21 03:44:04.952787] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b5a740 is same with the state(5) to be set 00:27:24.346 [2024-11-21 03:44:04.952804] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:24.346 [2024-11-21 03:44:04.952816] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:24.346 [2024-11-21 03:44:04.952829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:127864 len:8 PRP1 0x0 PRP2 0x0 00:27:24.346 [2024-11-21 03:44:04.952843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.346 [2024-11-21 03:44:04.952906] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1b5a740 was disconnected and freed. reset controller. 00:27:24.346 [2024-11-21 03:44:04.952980] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:27:24.346 [2024-11-21 03:44:04.953004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.346 [2024-11-21 03:44:04.953020] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:27:24.346 [2024-11-21 03:44:04.953035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.346 [2024-11-21 03:44:04.953050] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:27:24.346 [2024-11-21 03:44:04.953064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.346 [2024-11-21 03:44:04.953088] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:27:24.346 [2024-11-21 03:44:04.953118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:24.346 [2024-11-21 03:44:04.953131] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:24.346 [2024-11-21 03:44:04.955674] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.346 [2024-11-21 03:44:04.955719] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:24.346 [2024-11-21 03:44:04.956198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.346 [2024-11-21 03:44:04.956319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.346 [2024-11-21 03:44:04.956345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:24.346 [2024-11-21 03:44:04.956377] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:24.346 [2024-11-21 03:44:04.956579] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:24.346 [2024-11-21 03:44:04.956730] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.346 [2024-11-21 03:44:04.956753] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.346 [2024-11-21 03:44:04.956771] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.346 [2024-11-21 03:44:04.959274] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.346 [2024-11-21 03:44:04.968524] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.346 [2024-11-21 03:44:04.968899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.346 [2024-11-21 03:44:04.969081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.346 [2024-11-21 03:44:04.969111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:24.346 [2024-11-21 03:44:04.969129] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:24.346 [2024-11-21 03:44:04.969295] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:24.346 [2024-11-21 03:44:04.969466] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.346 [2024-11-21 03:44:04.969490] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.346 [2024-11-21 03:44:04.969505] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.346 [2024-11-21 03:44:04.971879] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.346 [2024-11-21 03:44:04.981263] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.346 [2024-11-21 03:44:04.981592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.346 [2024-11-21 03:44:04.981842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.346 [2024-11-21 03:44:04.981871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:24.346 [2024-11-21 03:44:04.981888] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:24.346 [2024-11-21 03:44:04.982082] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:24.346 [2024-11-21 03:44:04.982271] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.346 [2024-11-21 03:44:04.982296] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.346 [2024-11-21 03:44:04.982311] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.346 [2024-11-21 03:44:04.984606] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.606 [2024-11-21 03:44:04.993864] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.606 [2024-11-21 03:44:04.994164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.606 [2024-11-21 03:44:04.994296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.606 [2024-11-21 03:44:04.994324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:24.606 [2024-11-21 03:44:04.994340] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:24.606 [2024-11-21 03:44:04.994500] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:24.606 [2024-11-21 03:44:04.994616] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.606 [2024-11-21 03:44:04.994640] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.606 [2024-11-21 03:44:04.994655] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.606 [2024-11-21 03:44:04.997170] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.606 [2024-11-21 03:44:05.006580] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.606 [2024-11-21 03:44:05.006878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.606 [2024-11-21 03:44:05.007058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.606 [2024-11-21 03:44:05.007096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:24.606 [2024-11-21 03:44:05.007114] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:24.606 [2024-11-21 03:44:05.007280] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:24.606 [2024-11-21 03:44:05.007468] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.606 [2024-11-21 03:44:05.007492] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.606 [2024-11-21 03:44:05.007508] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.606 [2024-11-21 03:44:05.009749] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.606 [2024-11-21 03:44:05.019036] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.606 [2024-11-21 03:44:05.019428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.606 [2024-11-21 03:44:05.019547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.606 [2024-11-21 03:44:05.019576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:24.606 [2024-11-21 03:44:05.019593] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:24.606 [2024-11-21 03:44:05.019794] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:24.606 [2024-11-21 03:44:05.019947] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.606 [2024-11-21 03:44:05.019971] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.606 [2024-11-21 03:44:05.019987] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.606 [2024-11-21 03:44:05.022309] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.606 [2024-11-21 03:44:05.031539] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.606 [2024-11-21 03:44:05.031838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.606 [2024-11-21 03:44:05.031986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.606 [2024-11-21 03:44:05.032015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:24.606 [2024-11-21 03:44:05.032032] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:24.606 [2024-11-21 03:44:05.032209] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:24.606 [2024-11-21 03:44:05.032362] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.606 [2024-11-21 03:44:05.032385] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.606 [2024-11-21 03:44:05.032401] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.606 [2024-11-21 03:44:05.034660] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.606 [2024-11-21 03:44:05.043941] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.606 [2024-11-21 03:44:05.044271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.606 [2024-11-21 03:44:05.044407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.606 [2024-11-21 03:44:05.044433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:24.606 [2024-11-21 03:44:05.044449] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:24.606 [2024-11-21 03:44:05.044550] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:24.606 [2024-11-21 03:44:05.044676] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.606 [2024-11-21 03:44:05.044700] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.606 [2024-11-21 03:44:05.044715] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.606 [2024-11-21 03:44:05.047186] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.606 [2024-11-21 03:44:05.056770] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.606 [2024-11-21 03:44:05.057104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.606 [2024-11-21 03:44:05.057276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.606 [2024-11-21 03:44:05.057305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:24.606 [2024-11-21 03:44:05.057323] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:24.606 [2024-11-21 03:44:05.057470] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:24.606 [2024-11-21 03:44:05.057622] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.606 [2024-11-21 03:44:05.057645] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.606 [2024-11-21 03:44:05.057661] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.606 [2024-11-21 03:44:05.059905] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.606 [2024-11-21 03:44:05.069419] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.606 [2024-11-21 03:44:05.069758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.606 [2024-11-21 03:44:05.069927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.606 [2024-11-21 03:44:05.069958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:24.607 [2024-11-21 03:44:05.069974] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:24.607 [2024-11-21 03:44:05.070148] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:24.607 [2024-11-21 03:44:05.070351] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.607 [2024-11-21 03:44:05.070374] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.607 [2024-11-21 03:44:05.070390] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.607 [2024-11-21 03:44:05.072722] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.607 [2024-11-21 03:44:05.081854] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.607 [2024-11-21 03:44:05.082140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.607 [2024-11-21 03:44:05.082311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.607 [2024-11-21 03:44:05.082339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:24.607 [2024-11-21 03:44:05.082356] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:24.607 [2024-11-21 03:44:05.082521] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:24.607 [2024-11-21 03:44:05.082709] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.607 [2024-11-21 03:44:05.082733] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.607 [2024-11-21 03:44:05.082749] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.607 [2024-11-21 03:44:05.085029] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.607 [2024-11-21 03:44:05.094327] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.607 [2024-11-21 03:44:05.094684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.607 [2024-11-21 03:44:05.094825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.607 [2024-11-21 03:44:05.094866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:24.607 [2024-11-21 03:44:05.094881] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:24.607 [2024-11-21 03:44:05.094997] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:24.607 [2024-11-21 03:44:05.095168] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.607 [2024-11-21 03:44:05.095189] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.607 [2024-11-21 03:44:05.095202] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.607 [2024-11-21 03:44:05.097460] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.607 [2024-11-21 03:44:05.106997] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.607 [2024-11-21 03:44:05.107310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.607 [2024-11-21 03:44:05.107465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.607 [2024-11-21 03:44:05.107493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:24.607 [2024-11-21 03:44:05.107515] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:24.607 [2024-11-21 03:44:05.107627] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:24.607 [2024-11-21 03:44:05.107797] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.607 [2024-11-21 03:44:05.107820] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.607 [2024-11-21 03:44:05.107836] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.607 [2024-11-21 03:44:05.110273] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.607 [2024-11-21 03:44:05.119667] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.607 [2024-11-21 03:44:05.119973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.607 [2024-11-21 03:44:05.120146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.607 [2024-11-21 03:44:05.120172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:24.607 [2024-11-21 03:44:05.120188] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:24.607 [2024-11-21 03:44:05.120367] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:24.607 [2024-11-21 03:44:05.120520] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.607 [2024-11-21 03:44:05.120544] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.607 [2024-11-21 03:44:05.120559] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.607 [2024-11-21 03:44:05.123085] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.607 [2024-11-21 03:44:05.132241] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.607 [2024-11-21 03:44:05.132549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.607 [2024-11-21 03:44:05.132697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.607 [2024-11-21 03:44:05.132726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:24.607 [2024-11-21 03:44:05.132742] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:24.607 [2024-11-21 03:44:05.132890] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:24.607 [2024-11-21 03:44:05.133041] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.607 [2024-11-21 03:44:05.133065] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.607 [2024-11-21 03:44:05.133094] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.607 [2024-11-21 03:44:05.135431] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.607 [2024-11-21 03:44:05.145167] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.607 [2024-11-21 03:44:05.145508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.607 [2024-11-21 03:44:05.145684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.607 [2024-11-21 03:44:05.145712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:24.607 [2024-11-21 03:44:05.145729] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:24.607 [2024-11-21 03:44:05.145882] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:24.607 [2024-11-21 03:44:05.146081] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.607 [2024-11-21 03:44:05.146106] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.607 [2024-11-21 03:44:05.146122] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.607 [2024-11-21 03:44:05.148455] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.607 [2024-11-21 03:44:05.157819] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.607 [2024-11-21 03:44:05.158079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.607 [2024-11-21 03:44:05.158264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.607 [2024-11-21 03:44:05.158290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:24.607 [2024-11-21 03:44:05.158305] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:24.607 [2024-11-21 03:44:05.158451] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:24.607 [2024-11-21 03:44:05.158650] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.607 [2024-11-21 03:44:05.158674] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.607 [2024-11-21 03:44:05.158690] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.607 [2024-11-21 03:44:05.160917] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.607 [2024-11-21 03:44:05.170425] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.607 [2024-11-21 03:44:05.170710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.607 [2024-11-21 03:44:05.170877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.607 [2024-11-21 03:44:05.170903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:24.607 [2024-11-21 03:44:05.170918] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:24.607 [2024-11-21 03:44:05.171090] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:24.607 [2024-11-21 03:44:05.171207] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.607 [2024-11-21 03:44:05.171231] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.607 [2024-11-21 03:44:05.171246] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.607 [2024-11-21 03:44:05.173778] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.607 [2024-11-21 03:44:05.182987] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.607 [2024-11-21 03:44:05.183346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.607 [2024-11-21 03:44:05.183462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.607 [2024-11-21 03:44:05.183493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:24.607 [2024-11-21 03:44:05.183510] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:24.607 [2024-11-21 03:44:05.183621] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:24.608 [2024-11-21 03:44:05.183851] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.608 [2024-11-21 03:44:05.183876] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.608 [2024-11-21 03:44:05.183891] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.608 [2024-11-21 03:44:05.186452] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.608 [2024-11-21 03:44:05.195405] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.608 [2024-11-21 03:44:05.195673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.608 [2024-11-21 03:44:05.195847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.608 [2024-11-21 03:44:05.195876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:24.608 [2024-11-21 03:44:05.195893] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:24.608 [2024-11-21 03:44:05.196058] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:24.608 [2024-11-21 03:44:05.196259] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.608 [2024-11-21 03:44:05.196283] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.608 [2024-11-21 03:44:05.196299] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.608 [2024-11-21 03:44:05.198524] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.608 [2024-11-21 03:44:05.208047] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.608 [2024-11-21 03:44:05.208367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.608 [2024-11-21 03:44:05.208602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.608 [2024-11-21 03:44:05.208669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:24.608 [2024-11-21 03:44:05.208687] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:24.608 [2024-11-21 03:44:05.208870] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:24.608 [2024-11-21 03:44:05.209023] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.608 [2024-11-21 03:44:05.209047] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.608 [2024-11-21 03:44:05.209062] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.608 [2024-11-21 03:44:05.211519] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.608 [2024-11-21 03:44:05.220536] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.608 [2024-11-21 03:44:05.220842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.608 [2024-11-21 03:44:05.220952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.608 [2024-11-21 03:44:05.220980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:24.608 [2024-11-21 03:44:05.220997] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:24.608 [2024-11-21 03:44:05.221210] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:24.608 [2024-11-21 03:44:05.221364] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.608 [2024-11-21 03:44:05.221393] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.608 [2024-11-21 03:44:05.221409] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.608 [2024-11-21 03:44:05.223729] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.608 [2024-11-21 03:44:05.233013] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.608 [2024-11-21 03:44:05.233324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.608 [2024-11-21 03:44:05.233542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.608 [2024-11-21 03:44:05.233600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:24.608 [2024-11-21 03:44:05.233617] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:24.608 [2024-11-21 03:44:05.233817] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:24.608 [2024-11-21 03:44:05.233969] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.608 [2024-11-21 03:44:05.233992] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.608 [2024-11-21 03:44:05.234007] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.608 [2024-11-21 03:44:05.236224] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.608 [2024-11-21 03:44:05.245589] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.608 [2024-11-21 03:44:05.245900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.608 [2024-11-21 03:44:05.246021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.608 [2024-11-21 03:44:05.246049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:24.608 [2024-11-21 03:44:05.246066] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:24.608 [2024-11-21 03:44:05.246265] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:24.608 [2024-11-21 03:44:05.246435] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.608 [2024-11-21 03:44:05.246458] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.608 [2024-11-21 03:44:05.246474] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.608 [2024-11-21 03:44:05.248846] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.869 [2024-11-21 03:44:05.258323] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.870 [2024-11-21 03:44:05.258625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.870 [2024-11-21 03:44:05.258772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.870 [2024-11-21 03:44:05.258800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:24.870 [2024-11-21 03:44:05.258817] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:24.870 [2024-11-21 03:44:05.258982] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:24.870 [2024-11-21 03:44:05.259183] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.870 [2024-11-21 03:44:05.259208] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.870 [2024-11-21 03:44:05.259229] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.870 [2024-11-21 03:44:05.261563] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.870 [2024-11-21 03:44:05.270776] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.870 [2024-11-21 03:44:05.271083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.870 [2024-11-21 03:44:05.271260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.870 [2024-11-21 03:44:05.271288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:24.870 [2024-11-21 03:44:05.271306] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:24.870 [2024-11-21 03:44:05.271490] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:24.870 [2024-11-21 03:44:05.271695] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.870 [2024-11-21 03:44:05.271719] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.870 [2024-11-21 03:44:05.271734] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.870 [2024-11-21 03:44:05.274054] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.870 [2024-11-21 03:44:05.283287] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.870 [2024-11-21 03:44:05.283554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.870 [2024-11-21 03:44:05.283700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.870 [2024-11-21 03:44:05.283729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:24.870 [2024-11-21 03:44:05.283745] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:24.870 [2024-11-21 03:44:05.283910] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:24.870 [2024-11-21 03:44:05.284045] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.870 [2024-11-21 03:44:05.284079] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.870 [2024-11-21 03:44:05.284098] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.870 [2024-11-21 03:44:05.286509] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.870 [2024-11-21 03:44:05.296027] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.870 [2024-11-21 03:44:05.296308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.870 [2024-11-21 03:44:05.296502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.870 [2024-11-21 03:44:05.296527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:24.870 [2024-11-21 03:44:05.296543] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:24.870 [2024-11-21 03:44:05.296719] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:24.870 [2024-11-21 03:44:05.296896] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.870 [2024-11-21 03:44:05.296920] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.870 [2024-11-21 03:44:05.296935] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.870 [2024-11-21 03:44:05.299199] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.870 [2024-11-21 03:44:05.308572] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.870 [2024-11-21 03:44:05.308867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.870 [2024-11-21 03:44:05.309053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.870 [2024-11-21 03:44:05.309092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:24.870 [2024-11-21 03:44:05.309111] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:24.870 [2024-11-21 03:44:05.309259] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:24.870 [2024-11-21 03:44:05.309411] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.870 [2024-11-21 03:44:05.309434] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.870 [2024-11-21 03:44:05.309450] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.870 [2024-11-21 03:44:05.311786] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.870 [2024-11-21 03:44:05.321248] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.870 [2024-11-21 03:44:05.321661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.870 [2024-11-21 03:44:05.321954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.870 [2024-11-21 03:44:05.322006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:24.870 [2024-11-21 03:44:05.322023] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:24.870 [2024-11-21 03:44:05.322218] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:24.870 [2024-11-21 03:44:05.322371] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.870 [2024-11-21 03:44:05.322395] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.870 [2024-11-21 03:44:05.322410] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.870 [2024-11-21 03:44:05.324673] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.870 [2024-11-21 03:44:05.333637] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.870 [2024-11-21 03:44:05.333942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.870 [2024-11-21 03:44:05.334093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.870 [2024-11-21 03:44:05.334123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:24.870 [2024-11-21 03:44:05.334140] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:24.870 [2024-11-21 03:44:05.334342] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:24.870 [2024-11-21 03:44:05.334566] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.870 [2024-11-21 03:44:05.334590] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.870 [2024-11-21 03:44:05.334606] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.870 [2024-11-21 03:44:05.337048] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.870 [2024-11-21 03:44:05.346123] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.870 [2024-11-21 03:44:05.346525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.870 [2024-11-21 03:44:05.346756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.870 [2024-11-21 03:44:05.346781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:24.870 [2024-11-21 03:44:05.346811] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:24.870 [2024-11-21 03:44:05.346954] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:24.870 [2024-11-21 03:44:05.347152] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.870 [2024-11-21 03:44:05.347177] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.870 [2024-11-21 03:44:05.347193] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.870 [2024-11-21 03:44:05.349526] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.870 [2024-11-21 03:44:05.358900] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.870 [2024-11-21 03:44:05.359184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.870 [2024-11-21 03:44:05.359356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.870 [2024-11-21 03:44:05.359384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:24.871 [2024-11-21 03:44:05.359401] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:24.871 [2024-11-21 03:44:05.359565] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:24.871 [2024-11-21 03:44:05.359736] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.871 [2024-11-21 03:44:05.359760] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.871 [2024-11-21 03:44:05.359776] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.871 [2024-11-21 03:44:05.362090] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.871 [2024-11-21 03:44:05.371399] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.871 [2024-11-21 03:44:05.371732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.871 [2024-11-21 03:44:05.371881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.871 [2024-11-21 03:44:05.371909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:24.871 [2024-11-21 03:44:05.371926] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:24.871 [2024-11-21 03:44:05.372158] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:24.871 [2024-11-21 03:44:05.372329] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.871 [2024-11-21 03:44:05.372363] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.871 [2024-11-21 03:44:05.372378] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.871 [2024-11-21 03:44:05.374762] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.871 [2024-11-21 03:44:05.383895] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.871 [2024-11-21 03:44:05.384160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.871 [2024-11-21 03:44:05.384344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.871 [2024-11-21 03:44:05.384370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:24.871 [2024-11-21 03:44:05.384386] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:24.871 [2024-11-21 03:44:05.384550] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:24.871 [2024-11-21 03:44:05.384706] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.871 [2024-11-21 03:44:05.384731] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.871 [2024-11-21 03:44:05.384747] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.871 [2024-11-21 03:44:05.387048] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.871 [2024-11-21 03:44:05.396540] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.871 [2024-11-21 03:44:05.396887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.871 [2024-11-21 03:44:05.397024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.871 [2024-11-21 03:44:05.397052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:24.871 [2024-11-21 03:44:05.397077] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:24.871 [2024-11-21 03:44:05.397263] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:24.871 [2024-11-21 03:44:05.397455] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.871 [2024-11-21 03:44:05.397479] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.871 [2024-11-21 03:44:05.397495] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.871 [2024-11-21 03:44:05.399779] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.871 [2024-11-21 03:44:05.409156] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.871 [2024-11-21 03:44:05.409469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.871 [2024-11-21 03:44:05.409641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.871 [2024-11-21 03:44:05.409670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:24.871 [2024-11-21 03:44:05.409687] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:24.871 [2024-11-21 03:44:05.409799] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:24.871 [2024-11-21 03:44:05.409933] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.871 [2024-11-21 03:44:05.409956] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.871 [2024-11-21 03:44:05.409972] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.871 [2024-11-21 03:44:05.412205] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.871 [2024-11-21 03:44:05.421585] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.871 [2024-11-21 03:44:05.421891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.871 [2024-11-21 03:44:05.422054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.871 [2024-11-21 03:44:05.422092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:24.871 [2024-11-21 03:44:05.422109] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:24.871 [2024-11-21 03:44:05.422305] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:24.871 [2024-11-21 03:44:05.422457] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.871 [2024-11-21 03:44:05.422481] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.871 [2024-11-21 03:44:05.422496] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.871 [2024-11-21 03:44:05.424780] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.871 [2024-11-21 03:44:05.434261] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.871 [2024-11-21 03:44:05.434752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.871 [2024-11-21 03:44:05.434918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.871 [2024-11-21 03:44:05.434947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:24.871 [2024-11-21 03:44:05.434964] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:24.871 [2024-11-21 03:44:05.435140] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:24.871 [2024-11-21 03:44:05.435312] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.871 [2024-11-21 03:44:05.435336] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.871 [2024-11-21 03:44:05.435351] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.871 [2024-11-21 03:44:05.437545] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.871 [2024-11-21 03:44:05.446944] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.871 [2024-11-21 03:44:05.447329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.871 [2024-11-21 03:44:05.447489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.871 [2024-11-21 03:44:05.447518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:24.871 [2024-11-21 03:44:05.447535] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:24.871 [2024-11-21 03:44:05.447719] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:24.871 [2024-11-21 03:44:05.447889] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.871 [2024-11-21 03:44:05.447914] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.871 [2024-11-21 03:44:05.447930] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.871 [2024-11-21 03:44:05.450261] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.871 [2024-11-21 03:44:05.459375] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.871 [2024-11-21 03:44:05.459805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.871 [2024-11-21 03:44:05.459973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.871 [2024-11-21 03:44:05.459998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:24.871 [2024-11-21 03:44:05.460021] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:24.871 [2024-11-21 03:44:05.460181] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:24.871 [2024-11-21 03:44:05.460318] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.871 [2024-11-21 03:44:05.460340] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.871 [2024-11-21 03:44:05.460354] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.871 [2024-11-21 03:44:05.462547] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.871 [2024-11-21 03:44:05.471974] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.871 [2024-11-21 03:44:05.472313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.871 [2024-11-21 03:44:05.472426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.871 [2024-11-21 03:44:05.472452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:24.871 [2024-11-21 03:44:05.472468] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:24.872 [2024-11-21 03:44:05.472627] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:24.872 [2024-11-21 03:44:05.472833] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.872 [2024-11-21 03:44:05.472857] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.872 [2024-11-21 03:44:05.472872] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.872 [2024-11-21 03:44:05.475234] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.872 [2024-11-21 03:44:05.484526] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.872 [2024-11-21 03:44:05.484889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.872 [2024-11-21 03:44:05.485049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.872 [2024-11-21 03:44:05.485085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:24.872 [2024-11-21 03:44:05.485104] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:24.872 [2024-11-21 03:44:05.485236] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:24.872 [2024-11-21 03:44:05.485390] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.872 [2024-11-21 03:44:05.485411] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.872 [2024-11-21 03:44:05.485442] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.872 [2024-11-21 03:44:05.487605] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.872 [2024-11-21 03:44:05.497179] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.872 [2024-11-21 03:44:05.497460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.872 [2024-11-21 03:44:05.497585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.872 [2024-11-21 03:44:05.497614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:24.872 [2024-11-21 03:44:05.497631] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:24.872 [2024-11-21 03:44:05.497820] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:24.872 [2024-11-21 03:44:05.498027] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.872 [2024-11-21 03:44:05.498051] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.872 [2024-11-21 03:44:05.498067] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.872 [2024-11-21 03:44:05.500385] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:24.872 [2024-11-21 03:44:05.509848] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:24.872 [2024-11-21 03:44:05.510218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.872 [2024-11-21 03:44:05.510335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:24.872 [2024-11-21 03:44:05.510361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:24.872 [2024-11-21 03:44:05.510376] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:24.872 [2024-11-21 03:44:05.510541] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:24.872 [2024-11-21 03:44:05.510725] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:24.872 [2024-11-21 03:44:05.510749] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:24.872 [2024-11-21 03:44:05.510765] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:24.872 [2024-11-21 03:44:05.513164] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.133 [2024-11-21 03:44:05.522517] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.133 [2024-11-21 03:44:05.522815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.133 [2024-11-21 03:44:05.522962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.133 [2024-11-21 03:44:05.522987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:25.133 [2024-11-21 03:44:05.523003] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:25.133 [2024-11-21 03:44:05.523187] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:25.133 [2024-11-21 03:44:05.523359] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.133 [2024-11-21 03:44:05.523383] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.133 [2024-11-21 03:44:05.523398] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.133 [2024-11-21 03:44:05.525682] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.133 [2024-11-21 03:44:05.535001] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.133 [2024-11-21 03:44:05.535361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.133 [2024-11-21 03:44:05.535502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.133 [2024-11-21 03:44:05.535531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:25.133 [2024-11-21 03:44:05.535548] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:25.133 [2024-11-21 03:44:05.535731] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:25.133 [2024-11-21 03:44:05.535908] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.133 [2024-11-21 03:44:05.535932] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.133 [2024-11-21 03:44:05.535948] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.133 [2024-11-21 03:44:05.538279] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.133 [2024-11-21 03:44:05.547587] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.133 [2024-11-21 03:44:05.547901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.133 [2024-11-21 03:44:05.548054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.133 [2024-11-21 03:44:05.548088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:25.133 [2024-11-21 03:44:05.548105] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:25.133 [2024-11-21 03:44:05.548257] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:25.133 [2024-11-21 03:44:05.548421] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.133 [2024-11-21 03:44:05.548446] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.133 [2024-11-21 03:44:05.548461] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.133 [2024-11-21 03:44:05.550942] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.133 [2024-11-21 03:44:05.560034] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.133 [2024-11-21 03:44:05.560308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.133 [2024-11-21 03:44:05.560442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.133 [2024-11-21 03:44:05.560468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:25.133 [2024-11-21 03:44:05.560483] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:25.133 [2024-11-21 03:44:05.560677] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:25.133 [2024-11-21 03:44:05.560847] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.133 [2024-11-21 03:44:05.560871] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.133 [2024-11-21 03:44:05.560886] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.133 [2024-11-21 03:44:05.563158] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.133 [2024-11-21 03:44:05.572653] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.133 [2024-11-21 03:44:05.572953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.134 [2024-11-21 03:44:05.573104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.134 [2024-11-21 03:44:05.573135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:25.134 [2024-11-21 03:44:05.573152] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:25.134 [2024-11-21 03:44:05.573353] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:25.134 [2024-11-21 03:44:05.573506] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.134 [2024-11-21 03:44:05.573536] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.134 [2024-11-21 03:44:05.573552] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.134 [2024-11-21 03:44:05.575887] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.134 [2024-11-21 03:44:05.585397] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.134 [2024-11-21 03:44:05.585840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.134 [2024-11-21 03:44:05.586006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.134 [2024-11-21 03:44:05.586035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:25.134 [2024-11-21 03:44:05.586052] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:25.134 [2024-11-21 03:44:05.586266] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:25.134 [2024-11-21 03:44:05.586438] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.134 [2024-11-21 03:44:05.586461] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.134 [2024-11-21 03:44:05.586477] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.134 [2024-11-21 03:44:05.588832] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.134 [2024-11-21 03:44:05.597840] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.134 [2024-11-21 03:44:05.598138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.134 [2024-11-21 03:44:05.598376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.134 [2024-11-21 03:44:05.598426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:25.134 [2024-11-21 03:44:05.598442] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:25.134 [2024-11-21 03:44:05.598607] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:25.134 [2024-11-21 03:44:05.598742] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.134 [2024-11-21 03:44:05.598765] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.134 [2024-11-21 03:44:05.598781] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.134 [2024-11-21 03:44:05.600991] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.134 [2024-11-21 03:44:05.610289] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.134 [2024-11-21 03:44:05.610570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.134 [2024-11-21 03:44:05.610763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.134 [2024-11-21 03:44:05.610811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:25.134 [2024-11-21 03:44:05.610828] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:25.134 [2024-11-21 03:44:05.610957] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:25.134 [2024-11-21 03:44:05.611139] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.134 [2024-11-21 03:44:05.611163] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.134 [2024-11-21 03:44:05.611185] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.134 [2024-11-21 03:44:05.613520] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.134 [2024-11-21 03:44:05.622917] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.134 [2024-11-21 03:44:05.623217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.134 [2024-11-21 03:44:05.623379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.134 [2024-11-21 03:44:05.623405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:25.134 [2024-11-21 03:44:05.623420] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:25.134 [2024-11-21 03:44:05.623636] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:25.134 [2024-11-21 03:44:05.623788] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.134 [2024-11-21 03:44:05.623811] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.134 [2024-11-21 03:44:05.623827] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.134 [2024-11-21 03:44:05.626370] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.134 [2024-11-21 03:44:05.635600] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.134 [2024-11-21 03:44:05.635921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.134 [2024-11-21 03:44:05.636093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.134 [2024-11-21 03:44:05.636122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:25.134 [2024-11-21 03:44:05.636139] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:25.134 [2024-11-21 03:44:05.636269] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:25.134 [2024-11-21 03:44:05.636457] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.134 [2024-11-21 03:44:05.636481] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.134 [2024-11-21 03:44:05.636497] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.134 [2024-11-21 03:44:05.639107] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.134 [2024-11-21 03:44:05.648204] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.134 [2024-11-21 03:44:05.648547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.134 [2024-11-21 03:44:05.648825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.134 [2024-11-21 03:44:05.648879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:25.134 [2024-11-21 03:44:05.648896] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:25.134 [2024-11-21 03:44:05.649091] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:25.134 [2024-11-21 03:44:05.649316] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.134 [2024-11-21 03:44:05.649340] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.134 [2024-11-21 03:44:05.649356] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.134 [2024-11-21 03:44:05.651732] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.134 [2024-11-21 03:44:05.660783] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.134 [2024-11-21 03:44:05.661065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.134 [2024-11-21 03:44:05.661226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.134 [2024-11-21 03:44:05.661252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:25.134 [2024-11-21 03:44:05.661268] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:25.134 [2024-11-21 03:44:05.661466] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:25.134 [2024-11-21 03:44:05.661618] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.134 [2024-11-21 03:44:05.661643] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.134 [2024-11-21 03:44:05.661658] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.134 [2024-11-21 03:44:05.664048] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.134 [2024-11-21 03:44:05.673404] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.134 [2024-11-21 03:44:05.673696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.134 [2024-11-21 03:44:05.673969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.134 [2024-11-21 03:44:05.674019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:25.134 [2024-11-21 03:44:05.674037] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:25.134 [2024-11-21 03:44:05.674159] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:25.134 [2024-11-21 03:44:05.674366] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.134 [2024-11-21 03:44:05.674391] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.134 [2024-11-21 03:44:05.674407] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.134 [2024-11-21 03:44:05.676955] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.134 [2024-11-21 03:44:05.685816] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.134 [2024-11-21 03:44:05.686099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.134 [2024-11-21 03:44:05.686220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.135 [2024-11-21 03:44:05.686248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:25.135 [2024-11-21 03:44:05.686265] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:25.135 [2024-11-21 03:44:05.686430] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:25.135 [2024-11-21 03:44:05.686619] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.135 [2024-11-21 03:44:05.686643] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.135 [2024-11-21 03:44:05.686658] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.135 [2024-11-21 03:44:05.689033] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.135 [2024-11-21 03:44:05.698237] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.135 [2024-11-21 03:44:05.698550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.135 [2024-11-21 03:44:05.698734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.135 [2024-11-21 03:44:05.698760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:25.135 [2024-11-21 03:44:05.698775] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:25.135 [2024-11-21 03:44:05.698906] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:25.135 [2024-11-21 03:44:05.699120] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.135 [2024-11-21 03:44:05.699146] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.135 [2024-11-21 03:44:05.699162] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.135 [2024-11-21 03:44:05.701602] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.135 [2024-11-21 03:44:05.710788] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.135 [2024-11-21 03:44:05.711134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.135 [2024-11-21 03:44:05.711244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.135 [2024-11-21 03:44:05.711270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:25.135 [2024-11-21 03:44:05.711285] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:25.135 [2024-11-21 03:44:05.711478] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:25.135 [2024-11-21 03:44:05.711649] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.135 [2024-11-21 03:44:05.711673] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.135 [2024-11-21 03:44:05.711689] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.135 [2024-11-21 03:44:05.714088] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.135 [2024-11-21 03:44:05.723450] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.135 [2024-11-21 03:44:05.723922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.135 [2024-11-21 03:44:05.724102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.135 [2024-11-21 03:44:05.724130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:25.135 [2024-11-21 03:44:05.724147] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:25.135 [2024-11-21 03:44:05.724294] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:25.135 [2024-11-21 03:44:05.724465] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.135 [2024-11-21 03:44:05.724489] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.135 [2024-11-21 03:44:05.724505] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.135 [2024-11-21 03:44:05.726912] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.135 [2024-11-21 03:44:05.736130] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.135 [2024-11-21 03:44:05.736494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.135 [2024-11-21 03:44:05.736663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.135 [2024-11-21 03:44:05.736692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:25.135 [2024-11-21 03:44:05.736709] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:25.135 [2024-11-21 03:44:05.736873] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:25.135 [2024-11-21 03:44:05.737025] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.135 [2024-11-21 03:44:05.737049] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.135 [2024-11-21 03:44:05.737065] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.135 [2024-11-21 03:44:05.739266] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.135 [2024-11-21 03:44:05.748631] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.135 [2024-11-21 03:44:05.748933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.135 [2024-11-21 03:44:05.749055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.135 [2024-11-21 03:44:05.749094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:25.135 [2024-11-21 03:44:05.749112] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:25.135 [2024-11-21 03:44:05.749260] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:25.135 [2024-11-21 03:44:05.749394] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.135 [2024-11-21 03:44:05.749418] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.135 [2024-11-21 03:44:05.749435] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.135 [2024-11-21 03:44:05.751803] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.135 [2024-11-21 03:44:05.761098] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.135 [2024-11-21 03:44:05.761418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.135 [2024-11-21 03:44:05.761624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.135 [2024-11-21 03:44:05.761649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:25.135 [2024-11-21 03:44:05.761665] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:25.135 [2024-11-21 03:44:05.761857] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:25.135 [2024-11-21 03:44:05.762037] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.135 [2024-11-21 03:44:05.762061] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.135 [2024-11-21 03:44:05.762088] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.135 [2024-11-21 03:44:05.764549] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.135 [2024-11-21 03:44:05.773740] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.135 [2024-11-21 03:44:05.774067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.135 [2024-11-21 03:44:05.774270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.135 [2024-11-21 03:44:05.774304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:25.135 [2024-11-21 03:44:05.774321] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:25.135 [2024-11-21 03:44:05.774486] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:25.135 [2024-11-21 03:44:05.774674] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.135 [2024-11-21 03:44:05.774698] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.135 [2024-11-21 03:44:05.774714] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.135 [2024-11-21 03:44:05.777152] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.397 [2024-11-21 03:44:05.786201] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.397 [2024-11-21 03:44:05.786466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.397 [2024-11-21 03:44:05.786680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.397 [2024-11-21 03:44:05.786741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:25.397 [2024-11-21 03:44:05.786758] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:25.397 [2024-11-21 03:44:05.786941] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:25.397 [2024-11-21 03:44:05.787130] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.397 [2024-11-21 03:44:05.787156] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.397 [2024-11-21 03:44:05.787171] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.397 [2024-11-21 03:44:05.789566] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.397 [2024-11-21 03:44:05.798740] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.397 [2024-11-21 03:44:05.799083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.397 [2024-11-21 03:44:05.799222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.397 [2024-11-21 03:44:05.799250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:25.397 [2024-11-21 03:44:05.799267] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:25.397 [2024-11-21 03:44:05.799414] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:25.397 [2024-11-21 03:44:05.799566] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.397 [2024-11-21 03:44:05.799590] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.397 [2024-11-21 03:44:05.799605] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.397 [2024-11-21 03:44:05.801933] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.397 [2024-11-21 03:44:05.811502] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.397 [2024-11-21 03:44:05.811842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.397 [2024-11-21 03:44:05.812062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.398 [2024-11-21 03:44:05.812112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:25.398 [2024-11-21 03:44:05.812137] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:25.398 [2024-11-21 03:44:05.812321] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:25.398 [2024-11-21 03:44:05.812510] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.398 [2024-11-21 03:44:05.812533] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.398 [2024-11-21 03:44:05.812549] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.398 [2024-11-21 03:44:05.814817] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.398 [2024-11-21 03:44:05.824102] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.398 [2024-11-21 03:44:05.824454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.398 [2024-11-21 03:44:05.824589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.398 [2024-11-21 03:44:05.824614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:25.398 [2024-11-21 03:44:05.824630] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:25.398 [2024-11-21 03:44:05.824772] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:25.398 [2024-11-21 03:44:05.824961] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.398 [2024-11-21 03:44:05.824984] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.398 [2024-11-21 03:44:05.825000] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.398 [2024-11-21 03:44:05.827129] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.398 [2024-11-21 03:44:05.836584] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.398 [2024-11-21 03:44:05.836906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.398 [2024-11-21 03:44:05.837086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.398 [2024-11-21 03:44:05.837115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:25.398 [2024-11-21 03:44:05.837131] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:25.398 [2024-11-21 03:44:05.837315] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:25.398 [2024-11-21 03:44:05.837448] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.398 [2024-11-21 03:44:05.837472] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.398 [2024-11-21 03:44:05.837487] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.398 [2024-11-21 03:44:05.839694] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.398 [2024-11-21 03:44:05.849382] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.398 [2024-11-21 03:44:05.849827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.398 [2024-11-21 03:44:05.849990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.398 [2024-11-21 03:44:05.850019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:25.398 [2024-11-21 03:44:05.850035] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:25.398 [2024-11-21 03:44:05.850237] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:25.398 [2024-11-21 03:44:05.850390] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.398 [2024-11-21 03:44:05.850414] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.398 [2024-11-21 03:44:05.850431] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.398 [2024-11-21 03:44:05.852945] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.398 [2024-11-21 03:44:05.861977] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.398 [2024-11-21 03:44:05.862363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.398 [2024-11-21 03:44:05.862547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.398 [2024-11-21 03:44:05.862575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:25.398 [2024-11-21 03:44:05.862592] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:25.398 [2024-11-21 03:44:05.862739] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:25.398 [2024-11-21 03:44:05.862909] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.398 [2024-11-21 03:44:05.862933] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.398 [2024-11-21 03:44:05.862949] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.398 [2024-11-21 03:44:05.865314] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.398 [2024-11-21 03:44:05.874514] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.398 [2024-11-21 03:44:05.874820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.398 [2024-11-21 03:44:05.874992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.398 [2024-11-21 03:44:05.875020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:25.398 [2024-11-21 03:44:05.875037] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:25.398 [2024-11-21 03:44:05.875195] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:25.398 [2024-11-21 03:44:05.875366] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.398 [2024-11-21 03:44:05.875390] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.398 [2024-11-21 03:44:05.875406] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.398 [2024-11-21 03:44:05.877579] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.398 [2024-11-21 03:44:05.887031] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.398 [2024-11-21 03:44:05.887353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.398 [2024-11-21 03:44:05.887565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.398 [2024-11-21 03:44:05.887617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:25.398 [2024-11-21 03:44:05.887634] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:25.398 [2024-11-21 03:44:05.887781] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:25.398 [2024-11-21 03:44:05.888033] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.398 [2024-11-21 03:44:05.888058] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.398 [2024-11-21 03:44:05.888084] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.398 [2024-11-21 03:44:05.890386] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.398 [2024-11-21 03:44:05.899548] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.398 [2024-11-21 03:44:05.899843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.398 [2024-11-21 03:44:05.900020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.398 [2024-11-21 03:44:05.900049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:25.398 [2024-11-21 03:44:05.900065] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:25.398 [2024-11-21 03:44:05.900264] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:25.398 [2024-11-21 03:44:05.900452] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.398 [2024-11-21 03:44:05.900477] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.398 [2024-11-21 03:44:05.900492] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.398 [2024-11-21 03:44:05.902919] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.398 [2024-11-21 03:44:05.912325] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.398 [2024-11-21 03:44:05.912647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.398 [2024-11-21 03:44:05.912874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.398 [2024-11-21 03:44:05.912929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:25.398 [2024-11-21 03:44:05.912946] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:25.398 [2024-11-21 03:44:05.913123] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:25.398 [2024-11-21 03:44:05.913276] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.399 [2024-11-21 03:44:05.913300] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.399 [2024-11-21 03:44:05.913316] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.399 [2024-11-21 03:44:05.915669] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.399 [2024-11-21 03:44:05.925167] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.399 [2024-11-21 03:44:05.925517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.399 [2024-11-21 03:44:05.925676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.399 [2024-11-21 03:44:05.925702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:25.399 [2024-11-21 03:44:05.925717] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:25.399 [2024-11-21 03:44:05.925833] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:25.399 [2024-11-21 03:44:05.925992] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.399 [2024-11-21 03:44:05.926022] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.399 [2024-11-21 03:44:05.926039] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.399 [2024-11-21 03:44:05.928329] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.399 [2024-11-21 03:44:05.937534] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.399 [2024-11-21 03:44:05.937834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.399 [2024-11-21 03:44:05.937970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.399 [2024-11-21 03:44:05.937996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:25.399 [2024-11-21 03:44:05.938012] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:25.399 [2024-11-21 03:44:05.938199] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:25.399 [2024-11-21 03:44:05.938352] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.399 [2024-11-21 03:44:05.938376] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.399 [2024-11-21 03:44:05.938392] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.399 [2024-11-21 03:44:05.940652] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.399 [2024-11-21 03:44:05.949908] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.399 [2024-11-21 03:44:05.950242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.399 [2024-11-21 03:44:05.950394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.399 [2024-11-21 03:44:05.950422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:25.399 [2024-11-21 03:44:05.950437] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:25.399 [2024-11-21 03:44:05.950580] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:25.399 [2024-11-21 03:44:05.950751] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.399 [2024-11-21 03:44:05.950775] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.399 [2024-11-21 03:44:05.950790] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.399 [2024-11-21 03:44:05.953107] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.399 [2024-11-21 03:44:05.962625] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.399 [2024-11-21 03:44:05.962929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.399 [2024-11-21 03:44:05.963113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.399 [2024-11-21 03:44:05.963143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:25.399 [2024-11-21 03:44:05.963160] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:25.399 [2024-11-21 03:44:05.963289] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:25.399 [2024-11-21 03:44:05.963461] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.399 [2024-11-21 03:44:05.963485] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.399 [2024-11-21 03:44:05.963506] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.399 [2024-11-21 03:44:05.965804] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.399 [2024-11-21 03:44:05.975362] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.399 [2024-11-21 03:44:05.975673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.399 [2024-11-21 03:44:05.975832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.399 [2024-11-21 03:44:05.975858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:25.399 [2024-11-21 03:44:05.975873] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:25.399 [2024-11-21 03:44:05.976047] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:25.399 [2024-11-21 03:44:05.976247] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.399 [2024-11-21 03:44:05.976272] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.399 [2024-11-21 03:44:05.976287] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.399 [2024-11-21 03:44:05.978728] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.399 [2024-11-21 03:44:05.988039] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.399 [2024-11-21 03:44:05.988395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.399 [2024-11-21 03:44:05.988581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.399 [2024-11-21 03:44:05.988633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:25.399 [2024-11-21 03:44:05.988650] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:25.399 [2024-11-21 03:44:05.988815] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:25.399 [2024-11-21 03:44:05.988986] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.399 [2024-11-21 03:44:05.989009] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.399 [2024-11-21 03:44:05.989025] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.399 [2024-11-21 03:44:05.991420] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.399 [2024-11-21 03:44:06.000657] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.399 [2024-11-21 03:44:06.000981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.399 [2024-11-21 03:44:06.001169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.399 [2024-11-21 03:44:06.001196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:25.399 [2024-11-21 03:44:06.001212] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:25.399 [2024-11-21 03:44:06.001373] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:25.399 [2024-11-21 03:44:06.001525] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.399 [2024-11-21 03:44:06.001549] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.399 [2024-11-21 03:44:06.001564] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.399 [2024-11-21 03:44:06.003850] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.399 [2024-11-21 03:44:06.013126] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.399 [2024-11-21 03:44:06.013485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.399 [2024-11-21 03:44:06.013644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.399 [2024-11-21 03:44:06.013672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:25.399 [2024-11-21 03:44:06.013689] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:25.399 [2024-11-21 03:44:06.013855] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:25.399 [2024-11-21 03:44:06.014007] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.399 [2024-11-21 03:44:06.014031] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.399 [2024-11-21 03:44:06.014047] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.399 [2024-11-21 03:44:06.016460] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.399 [2024-11-21 03:44:06.025754] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.399 [2024-11-21 03:44:06.026067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.399 [2024-11-21 03:44:06.026184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.399 [2024-11-21 03:44:06.026212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:25.399 [2024-11-21 03:44:06.026229] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:25.399 [2024-11-21 03:44:06.026359] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:25.399 [2024-11-21 03:44:06.026547] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.399 [2024-11-21 03:44:06.026571] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.399 [2024-11-21 03:44:06.026586] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.399 [2024-11-21 03:44:06.028831] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.399 [2024-11-21 03:44:06.038174] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.400 [2024-11-21 03:44:06.038471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.400 [2024-11-21 03:44:06.038710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.400 [2024-11-21 03:44:06.038736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:25.400 [2024-11-21 03:44:06.038751] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:25.400 [2024-11-21 03:44:06.038961] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:25.400 [2024-11-21 03:44:06.039135] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.400 [2024-11-21 03:44:06.039160] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.400 [2024-11-21 03:44:06.039176] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.400 [2024-11-21 03:44:06.041531] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.660 [2024-11-21 03:44:06.050728] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.660 [2024-11-21 03:44:06.051161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.660 [2024-11-21 03:44:06.051344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.660 [2024-11-21 03:44:06.051372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:25.660 [2024-11-21 03:44:06.051390] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:25.660 [2024-11-21 03:44:06.051538] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:25.660 [2024-11-21 03:44:06.051708] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.660 [2024-11-21 03:44:06.051732] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.660 [2024-11-21 03:44:06.051747] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.660 [2024-11-21 03:44:06.053957] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.660 [2024-11-21 03:44:06.063459] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.660 [2024-11-21 03:44:06.063771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.660 [2024-11-21 03:44:06.063931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.660 [2024-11-21 03:44:06.063956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:25.660 [2024-11-21 03:44:06.063972] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:25.660 [2024-11-21 03:44:06.064129] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:25.660 [2024-11-21 03:44:06.064339] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.660 [2024-11-21 03:44:06.064364] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.660 [2024-11-21 03:44:06.064379] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.660 [2024-11-21 03:44:06.066713] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.660 [2024-11-21 03:44:06.076099] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.660 [2024-11-21 03:44:06.076507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.660 [2024-11-21 03:44:06.076761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.660 [2024-11-21 03:44:06.076816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:25.660 [2024-11-21 03:44:06.076834] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:25.660 [2024-11-21 03:44:06.077053] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:25.660 [2024-11-21 03:44:06.077302] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.660 [2024-11-21 03:44:06.077327] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.660 [2024-11-21 03:44:06.077343] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.660 [2024-11-21 03:44:06.079680] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.660 [2024-11-21 03:44:06.088628] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.660 [2024-11-21 03:44:06.089004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.660 [2024-11-21 03:44:06.089116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.660 [2024-11-21 03:44:06.089144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:25.660 [2024-11-21 03:44:06.089160] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:25.660 [2024-11-21 03:44:06.089309] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:25.660 [2024-11-21 03:44:06.089504] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.660 [2024-11-21 03:44:06.089528] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.660 [2024-11-21 03:44:06.089544] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.660 [2024-11-21 03:44:06.091896] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.660 [2024-11-21 03:44:06.101214] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.660 [2024-11-21 03:44:06.101577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.660 [2024-11-21 03:44:06.101845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.660 [2024-11-21 03:44:06.101892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:25.660 [2024-11-21 03:44:06.101910] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:25.660 [2024-11-21 03:44:06.102040] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:25.660 [2024-11-21 03:44:06.102219] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.661 [2024-11-21 03:44:06.102244] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.661 [2024-11-21 03:44:06.102259] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.661 [2024-11-21 03:44:06.104575] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.661 [2024-11-21 03:44:06.113671] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.661 [2024-11-21 03:44:06.114033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.661 [2024-11-21 03:44:06.114160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.661 [2024-11-21 03:44:06.114186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:25.661 [2024-11-21 03:44:06.114202] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:25.661 [2024-11-21 03:44:06.114382] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:25.661 [2024-11-21 03:44:06.114516] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.661 [2024-11-21 03:44:06.114540] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.661 [2024-11-21 03:44:06.114556] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.661 [2024-11-21 03:44:06.116985] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.661 [2024-11-21 03:44:06.126285] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.661 [2024-11-21 03:44:06.126557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.661 [2024-11-21 03:44:06.126743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.661 [2024-11-21 03:44:06.126773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:25.661 [2024-11-21 03:44:06.126790] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:25.661 [2024-11-21 03:44:06.126966] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:25.661 [2024-11-21 03:44:06.127120] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.661 [2024-11-21 03:44:06.127145] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.661 [2024-11-21 03:44:06.127161] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.661 [2024-11-21 03:44:06.129529] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.661 [2024-11-21 03:44:06.138846] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.661 [2024-11-21 03:44:06.139169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.661 [2024-11-21 03:44:06.139291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.661 [2024-11-21 03:44:06.139320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:25.661 [2024-11-21 03:44:06.139337] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:25.661 [2024-11-21 03:44:06.139502] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:25.661 [2024-11-21 03:44:06.139673] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.661 [2024-11-21 03:44:06.139697] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.661 [2024-11-21 03:44:06.139713] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.661 [2024-11-21 03:44:06.141958] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.661 [2024-11-21 03:44:06.151459] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.661 [2024-11-21 03:44:06.151805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.661 [2024-11-21 03:44:06.151968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.661 [2024-11-21 03:44:06.151993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:25.661 [2024-11-21 03:44:06.152008] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:25.661 [2024-11-21 03:44:06.152212] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:25.661 [2024-11-21 03:44:06.152365] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.661 [2024-11-21 03:44:06.152389] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.661 [2024-11-21 03:44:06.152405] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.661 [2024-11-21 03:44:06.154648] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.661 [2024-11-21 03:44:06.164198] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.661 [2024-11-21 03:44:06.164507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.661 [2024-11-21 03:44:06.164623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.661 [2024-11-21 03:44:06.164651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:25.661 [2024-11-21 03:44:06.164673] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:25.661 [2024-11-21 03:44:06.164840] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:25.661 [2024-11-21 03:44:06.165011] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.661 [2024-11-21 03:44:06.165034] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.661 [2024-11-21 03:44:06.165050] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.661 [2024-11-21 03:44:06.167592] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.661 [2024-11-21 03:44:06.176882] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.661 [2024-11-21 03:44:06.177224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.661 [2024-11-21 03:44:06.177371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.661 [2024-11-21 03:44:06.177400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:25.661 [2024-11-21 03:44:06.177416] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:25.661 [2024-11-21 03:44:06.177582] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:25.661 [2024-11-21 03:44:06.177769] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.661 [2024-11-21 03:44:06.177794] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.661 [2024-11-21 03:44:06.177809] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.661 [2024-11-21 03:44:06.179927] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.661 [2024-11-21 03:44:06.189522] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.661 [2024-11-21 03:44:06.189962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.661 [2024-11-21 03:44:06.190160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.661 [2024-11-21 03:44:06.190190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:25.661 [2024-11-21 03:44:06.190207] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:25.661 [2024-11-21 03:44:06.190336] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:25.661 [2024-11-21 03:44:06.190489] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.661 [2024-11-21 03:44:06.190513] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.661 [2024-11-21 03:44:06.190529] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.661 [2024-11-21 03:44:06.192789] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.662 [2024-11-21 03:44:06.202135] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.662 [2024-11-21 03:44:06.202468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.662 [2024-11-21 03:44:06.202605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.662 [2024-11-21 03:44:06.202648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:25.662 [2024-11-21 03:44:06.202663] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:25.662 [2024-11-21 03:44:06.202847] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:25.662 [2024-11-21 03:44:06.203103] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.662 [2024-11-21 03:44:06.203128] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.662 [2024-11-21 03:44:06.203143] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.662 [2024-11-21 03:44:06.205530] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.662 [2024-11-21 03:44:06.214532] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.662 [2024-11-21 03:44:06.214898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.662 [2024-11-21 03:44:06.215016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.662 [2024-11-21 03:44:06.215044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:25.662 [2024-11-21 03:44:06.215061] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:25.662 [2024-11-21 03:44:06.215217] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:25.662 [2024-11-21 03:44:06.215387] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.662 [2024-11-21 03:44:06.215411] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.662 [2024-11-21 03:44:06.215427] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.662 [2024-11-21 03:44:06.217689] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.662 [2024-11-21 03:44:06.226995] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.662 [2024-11-21 03:44:06.227373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.662 [2024-11-21 03:44:06.227511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.662 [2024-11-21 03:44:06.227538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:25.662 [2024-11-21 03:44:06.227554] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:25.662 [2024-11-21 03:44:06.227705] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:25.662 [2024-11-21 03:44:06.227911] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.662 [2024-11-21 03:44:06.227936] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.662 [2024-11-21 03:44:06.227951] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.662 [2024-11-21 03:44:06.230367] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.662 [2024-11-21 03:44:06.239486] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.662 [2024-11-21 03:44:06.239813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.662 [2024-11-21 03:44:06.239923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.662 [2024-11-21 03:44:06.239948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:25.662 [2024-11-21 03:44:06.239963] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:25.662 [2024-11-21 03:44:06.240137] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:25.662 [2024-11-21 03:44:06.240281] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.662 [2024-11-21 03:44:06.240305] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.662 [2024-11-21 03:44:06.240320] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.662 [2024-11-21 03:44:06.242741] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.662 [2024-11-21 03:44:06.252179] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.662 [2024-11-21 03:44:06.252473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.662 [2024-11-21 03:44:06.252580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.662 [2024-11-21 03:44:06.252606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:25.662 [2024-11-21 03:44:06.252621] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:25.662 [2024-11-21 03:44:06.252779] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:25.662 [2024-11-21 03:44:06.252950] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.662 [2024-11-21 03:44:06.252974] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.662 [2024-11-21 03:44:06.252989] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.662 [2024-11-21 03:44:06.255496] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.662 [2024-11-21 03:44:06.264795] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.662 [2024-11-21 03:44:06.265108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.662 [2024-11-21 03:44:06.265332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.662 [2024-11-21 03:44:06.265361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:25.662 [2024-11-21 03:44:06.265378] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:25.662 [2024-11-21 03:44:06.265508] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:25.662 [2024-11-21 03:44:06.265750] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.662 [2024-11-21 03:44:06.265774] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.662 [2024-11-21 03:44:06.265789] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.662 [2024-11-21 03:44:06.268052] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.662 [2024-11-21 03:44:06.277272] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.662 [2024-11-21 03:44:06.277540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.662 [2024-11-21 03:44:06.277671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.662 [2024-11-21 03:44:06.277699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:25.662 [2024-11-21 03:44:06.277716] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:25.662 [2024-11-21 03:44:06.277900] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:25.662 [2024-11-21 03:44:06.278080] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.662 [2024-11-21 03:44:06.278110] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.662 [2024-11-21 03:44:06.278126] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.662 [2024-11-21 03:44:06.280477] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.662 [2024-11-21 03:44:06.289821] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.662 [2024-11-21 03:44:06.290147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.662 [2024-11-21 03:44:06.290327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.662 [2024-11-21 03:44:06.290352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:25.662 [2024-11-21 03:44:06.290368] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:25.662 [2024-11-21 03:44:06.290584] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:25.663 [2024-11-21 03:44:06.290791] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.663 [2024-11-21 03:44:06.290815] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.663 [2024-11-21 03:44:06.290830] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.663 [2024-11-21 03:44:06.293190] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.663 [2024-11-21 03:44:06.302252] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.663 [2024-11-21 03:44:06.302586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.663 [2024-11-21 03:44:06.302736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.663 [2024-11-21 03:44:06.302764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:25.663 [2024-11-21 03:44:06.302781] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:25.663 [2024-11-21 03:44:06.302964] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:25.663 [2024-11-21 03:44:06.303164] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.663 [2024-11-21 03:44:06.303189] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.663 [2024-11-21 03:44:06.303204] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.922 [2024-11-21 03:44:06.305501] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.922 [2024-11-21 03:44:06.314698] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.922 [2024-11-21 03:44:06.315060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.922 [2024-11-21 03:44:06.315186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.922 [2024-11-21 03:44:06.315215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:25.922 [2024-11-21 03:44:06.315232] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:25.922 [2024-11-21 03:44:06.315398] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:25.922 [2024-11-21 03:44:06.315568] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.922 [2024-11-21 03:44:06.315591] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.922 [2024-11-21 03:44:06.315613] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.922 [2024-11-21 03:44:06.317951] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.922 [2024-11-21 03:44:06.327113] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.922 [2024-11-21 03:44:06.327412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.922 [2024-11-21 03:44:06.327604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.922 [2024-11-21 03:44:06.327666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:25.923 [2024-11-21 03:44:06.327683] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:25.923 [2024-11-21 03:44:06.327849] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:25.923 [2024-11-21 03:44:06.328000] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.923 [2024-11-21 03:44:06.328024] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.923 [2024-11-21 03:44:06.328039] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.923 [2024-11-21 03:44:06.330275] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.923 [2024-11-21 03:44:06.339546] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.923 [2024-11-21 03:44:06.339891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.923 [2024-11-21 03:44:06.340005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.923 [2024-11-21 03:44:06.340035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:25.923 [2024-11-21 03:44:06.340053] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:25.923 [2024-11-21 03:44:06.340210] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:25.923 [2024-11-21 03:44:06.340417] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.923 [2024-11-21 03:44:06.340441] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.923 [2024-11-21 03:44:06.340456] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.923 [2024-11-21 03:44:06.342970] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.923 [2024-11-21 03:44:06.352117] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.923 [2024-11-21 03:44:06.352366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.923 [2024-11-21 03:44:06.352510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.923 [2024-11-21 03:44:06.352538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:25.923 [2024-11-21 03:44:06.352556] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:25.923 [2024-11-21 03:44:06.352740] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:25.923 [2024-11-21 03:44:06.352928] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.923 [2024-11-21 03:44:06.352952] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.923 [2024-11-21 03:44:06.352967] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.923 [2024-11-21 03:44:06.355298] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.923 [2024-11-21 03:44:06.364628] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.923 [2024-11-21 03:44:06.364959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.923 [2024-11-21 03:44:06.365110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.923 [2024-11-21 03:44:06.365148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:25.923 [2024-11-21 03:44:06.365166] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:25.923 [2024-11-21 03:44:06.365332] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:25.923 [2024-11-21 03:44:06.365467] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.923 [2024-11-21 03:44:06.365490] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.923 [2024-11-21 03:44:06.365505] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.923 [2024-11-21 03:44:06.367675] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.923 [2024-11-21 03:44:06.377260] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.923 [2024-11-21 03:44:06.377596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.923 [2024-11-21 03:44:06.377736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.923 [2024-11-21 03:44:06.377761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:25.923 [2024-11-21 03:44:06.377776] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:25.923 [2024-11-21 03:44:06.377967] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:25.923 [2024-11-21 03:44:06.378184] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.923 [2024-11-21 03:44:06.378209] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.923 [2024-11-21 03:44:06.378224] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.923 [2024-11-21 03:44:06.380592] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.923 [2024-11-21 03:44:06.389741] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.923 [2024-11-21 03:44:06.390037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.923 [2024-11-21 03:44:06.390198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.923 [2024-11-21 03:44:06.390240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:25.923 [2024-11-21 03:44:06.390255] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:25.923 [2024-11-21 03:44:06.390451] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:25.923 [2024-11-21 03:44:06.390653] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.923 [2024-11-21 03:44:06.390677] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.923 [2024-11-21 03:44:06.390693] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.923 [2024-11-21 03:44:06.392918] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.923 [2024-11-21 03:44:06.402274] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.923 [2024-11-21 03:44:06.402599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.923 [2024-11-21 03:44:06.402744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.923 [2024-11-21 03:44:06.402787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:25.923 [2024-11-21 03:44:06.402802] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:25.923 [2024-11-21 03:44:06.402948] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:25.923 [2024-11-21 03:44:06.403167] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.923 [2024-11-21 03:44:06.403193] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.923 [2024-11-21 03:44:06.403209] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.923 [2024-11-21 03:44:06.405668] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.923 [2024-11-21 03:44:06.414725] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.923 [2024-11-21 03:44:06.415014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.923 [2024-11-21 03:44:06.415173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.923 [2024-11-21 03:44:06.415199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:25.923 [2024-11-21 03:44:06.415214] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:25.923 [2024-11-21 03:44:06.415331] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:25.923 [2024-11-21 03:44:06.415540] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.923 [2024-11-21 03:44:06.415564] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.923 [2024-11-21 03:44:06.415580] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.923 [2024-11-21 03:44:06.417786] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.923 [2024-11-21 03:44:06.427198] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.923 [2024-11-21 03:44:06.427563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.923 [2024-11-21 03:44:06.427746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.923 [2024-11-21 03:44:06.427772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:25.923 [2024-11-21 03:44:06.427787] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:25.923 [2024-11-21 03:44:06.427934] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:25.923 [2024-11-21 03:44:06.428116] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.923 [2024-11-21 03:44:06.428141] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.923 [2024-11-21 03:44:06.428157] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.923 [2024-11-21 03:44:06.430545] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.923 [2024-11-21 03:44:06.439657] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.923 [2024-11-21 03:44:06.440028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.923 [2024-11-21 03:44:06.440187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.923 [2024-11-21 03:44:06.440214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:25.923 [2024-11-21 03:44:06.440229] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:25.923 [2024-11-21 03:44:06.440423] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:25.923 [2024-11-21 03:44:06.440611] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.923 [2024-11-21 03:44:06.440635] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.923 [2024-11-21 03:44:06.440650] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.923 [2024-11-21 03:44:06.442911] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.923 [2024-11-21 03:44:06.452304] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.923 [2024-11-21 03:44:06.452566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.923 [2024-11-21 03:44:06.452713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.923 [2024-11-21 03:44:06.452742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:25.923 [2024-11-21 03:44:06.452759] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:25.924 [2024-11-21 03:44:06.452942] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:25.924 [2024-11-21 03:44:06.453105] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.924 [2024-11-21 03:44:06.453131] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.924 [2024-11-21 03:44:06.453146] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.924 [2024-11-21 03:44:06.455479] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.924 [2024-11-21 03:44:06.464906] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.924 [2024-11-21 03:44:06.465246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.924 [2024-11-21 03:44:06.465393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.924 [2024-11-21 03:44:06.465419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:25.924 [2024-11-21 03:44:06.465435] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:25.924 [2024-11-21 03:44:06.465627] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:25.924 [2024-11-21 03:44:06.465761] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.924 [2024-11-21 03:44:06.465785] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.924 [2024-11-21 03:44:06.465801] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.924 [2024-11-21 03:44:06.468086] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.924 [2024-11-21 03:44:06.477368] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.924 [2024-11-21 03:44:06.477709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.924 [2024-11-21 03:44:06.477881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.924 [2024-11-21 03:44:06.477919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:25.924 [2024-11-21 03:44:06.477938] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:25.924 [2024-11-21 03:44:06.478138] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:25.924 [2024-11-21 03:44:06.478256] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.924 [2024-11-21 03:44:06.478280] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.924 [2024-11-21 03:44:06.478295] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.924 [2024-11-21 03:44:06.480519] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.924 [2024-11-21 03:44:06.490045] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.924 [2024-11-21 03:44:06.490377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.924 [2024-11-21 03:44:06.490549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.924 [2024-11-21 03:44:06.490579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:25.924 [2024-11-21 03:44:06.490596] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:25.924 [2024-11-21 03:44:06.490762] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:25.924 [2024-11-21 03:44:06.490951] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.924 [2024-11-21 03:44:06.490975] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.924 [2024-11-21 03:44:06.490991] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.924 [2024-11-21 03:44:06.493261] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.924 [2024-11-21 03:44:06.502760] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.924 [2024-11-21 03:44:06.503111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.924 [2024-11-21 03:44:06.503383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.924 [2024-11-21 03:44:06.503434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:25.924 [2024-11-21 03:44:06.503451] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:25.924 [2024-11-21 03:44:06.503633] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:25.924 [2024-11-21 03:44:06.503786] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.924 [2024-11-21 03:44:06.503810] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.924 [2024-11-21 03:44:06.503826] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.924 [2024-11-21 03:44:06.506241] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.924 [2024-11-21 03:44:06.515331] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.924 [2024-11-21 03:44:06.515613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.924 [2024-11-21 03:44:06.515764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.924 [2024-11-21 03:44:06.515793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:25.924 [2024-11-21 03:44:06.515817] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:25.924 [2024-11-21 03:44:06.516001] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:25.924 [2024-11-21 03:44:06.516184] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.924 [2024-11-21 03:44:06.516209] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.924 [2024-11-21 03:44:06.516224] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.924 [2024-11-21 03:44:06.518593] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.924 [2024-11-21 03:44:06.527981] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.924 [2024-11-21 03:44:06.528332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.924 [2024-11-21 03:44:06.528460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.924 [2024-11-21 03:44:06.528485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:25.924 [2024-11-21 03:44:06.528501] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:25.924 [2024-11-21 03:44:06.528708] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:25.924 [2024-11-21 03:44:06.528879] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.924 [2024-11-21 03:44:06.528903] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.924 [2024-11-21 03:44:06.528918] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.924 [2024-11-21 03:44:06.531300] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.924 [2024-11-21 03:44:06.540617] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.924 [2024-11-21 03:44:06.540929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.924 [2024-11-21 03:44:06.541060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.924 [2024-11-21 03:44:06.541113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:25.924 [2024-11-21 03:44:06.541130] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:25.924 [2024-11-21 03:44:06.541306] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:25.924 [2024-11-21 03:44:06.541544] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.924 [2024-11-21 03:44:06.541568] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.924 [2024-11-21 03:44:06.541584] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.924 [2024-11-21 03:44:06.543958] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.924 [2024-11-21 03:44:06.553112] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.924 [2024-11-21 03:44:06.553467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.924 [2024-11-21 03:44:06.553645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.924 [2024-11-21 03:44:06.553674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:25.924 [2024-11-21 03:44:06.553704] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:25.924 [2024-11-21 03:44:06.553905] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:25.924 [2024-11-21 03:44:06.554076] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.924 [2024-11-21 03:44:06.554099] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.924 [2024-11-21 03:44:06.554113] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:25.924 [2024-11-21 03:44:06.556388] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:25.924 [2024-11-21 03:44:06.565705] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:25.924 [2024-11-21 03:44:06.566066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.924 [2024-11-21 03:44:06.566206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:25.924 [2024-11-21 03:44:06.566232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:25.924 [2024-11-21 03:44:06.566247] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:25.924 [2024-11-21 03:44:06.566364] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:25.924 [2024-11-21 03:44:06.566527] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:25.924 [2024-11-21 03:44:06.566547] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:25.924 [2024-11-21 03:44:06.566561] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.184 [2024-11-21 03:44:06.568963] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.184 [2024-11-21 03:44:06.578283] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.184 [2024-11-21 03:44:06.578704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.184 [2024-11-21 03:44:06.578835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.184 [2024-11-21 03:44:06.578860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:26.184 [2024-11-21 03:44:06.578876] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:26.184 [2024-11-21 03:44:06.579007] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:26.184 [2024-11-21 03:44:06.579154] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.184 [2024-11-21 03:44:06.579176] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.184 [2024-11-21 03:44:06.579190] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.184 [2024-11-21 03:44:06.581446] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.184 [2024-11-21 03:44:06.591082] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.184 [2024-11-21 03:44:06.591327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.184 [2024-11-21 03:44:06.591487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.184 [2024-11-21 03:44:06.591513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:26.184 [2024-11-21 03:44:06.591528] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:26.184 [2024-11-21 03:44:06.591697] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:26.184 [2024-11-21 03:44:06.591892] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.184 [2024-11-21 03:44:06.591912] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.184 [2024-11-21 03:44:06.591925] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.184 [2024-11-21 03:44:06.593918] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.184 [2024-11-21 03:44:06.603673] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.184 [2024-11-21 03:44:06.604041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.184 [2024-11-21 03:44:06.604188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.184 [2024-11-21 03:44:06.604214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:26.184 [2024-11-21 03:44:06.604230] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:26.184 [2024-11-21 03:44:06.604362] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:26.184 [2024-11-21 03:44:06.604577] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.184 [2024-11-21 03:44:06.604599] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.184 [2024-11-21 03:44:06.604630] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.184 [2024-11-21 03:44:06.607029] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.184 [2024-11-21 03:44:06.616338] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.184 [2024-11-21 03:44:06.616654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.184 [2024-11-21 03:44:06.616767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.184 [2024-11-21 03:44:06.616796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:26.184 [2024-11-21 03:44:06.616813] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:26.184 [2024-11-21 03:44:06.616989] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:26.184 [2024-11-21 03:44:06.617136] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.184 [2024-11-21 03:44:06.617158] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.184 [2024-11-21 03:44:06.617173] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.184 [2024-11-21 03:44:06.619470] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.184 [2024-11-21 03:44:06.629030] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.184 [2024-11-21 03:44:06.629312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.184 [2024-11-21 03:44:06.629458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.184 [2024-11-21 03:44:06.629485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:26.184 [2024-11-21 03:44:06.629500] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:26.184 [2024-11-21 03:44:06.629650] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:26.185 [2024-11-21 03:44:06.629857] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.185 [2024-11-21 03:44:06.629883] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.185 [2024-11-21 03:44:06.629897] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.185 [2024-11-21 03:44:06.631988] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.185 [2024-11-21 03:44:06.641629] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.185 [2024-11-21 03:44:06.641971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.185 [2024-11-21 03:44:06.642138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.185 [2024-11-21 03:44:06.642165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:26.185 [2024-11-21 03:44:06.642181] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:26.185 [2024-11-21 03:44:06.642330] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:26.185 [2024-11-21 03:44:06.642516] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.185 [2024-11-21 03:44:06.642541] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.185 [2024-11-21 03:44:06.642557] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.185 [2024-11-21 03:44:06.644844] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.185 [2024-11-21 03:44:06.654163] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.185 [2024-11-21 03:44:06.654461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.185 [2024-11-21 03:44:06.654580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.185 [2024-11-21 03:44:06.654609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:26.185 [2024-11-21 03:44:06.654626] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:26.185 [2024-11-21 03:44:06.654791] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:26.185 [2024-11-21 03:44:06.654963] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.185 [2024-11-21 03:44:06.654987] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.185 [2024-11-21 03:44:06.655003] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.185 [2024-11-21 03:44:06.657240] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.185 [2024-11-21 03:44:06.666667] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.185 [2024-11-21 03:44:06.666999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.185 [2024-11-21 03:44:06.667172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.185 [2024-11-21 03:44:06.667199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:26.185 [2024-11-21 03:44:06.667214] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:26.185 [2024-11-21 03:44:06.667417] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:26.185 [2024-11-21 03:44:06.667606] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.185 [2024-11-21 03:44:06.667630] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.185 [2024-11-21 03:44:06.667651] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.185 [2024-11-21 03:44:06.670096] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.185 [2024-11-21 03:44:06.679303] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.185 [2024-11-21 03:44:06.679702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.185 [2024-11-21 03:44:06.679827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.185 [2024-11-21 03:44:06.679855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:26.185 [2024-11-21 03:44:06.679872] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:26.185 [2024-11-21 03:44:06.680001] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:26.185 [2024-11-21 03:44:06.680216] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.185 [2024-11-21 03:44:06.680237] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.185 [2024-11-21 03:44:06.680250] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.185 [2024-11-21 03:44:06.682467] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.185 [2024-11-21 03:44:06.691898] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.185 [2024-11-21 03:44:06.692244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.185 [2024-11-21 03:44:06.692421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.185 [2024-11-21 03:44:06.692467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:26.185 [2024-11-21 03:44:06.692485] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:26.185 [2024-11-21 03:44:06.692650] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:26.185 [2024-11-21 03:44:06.692820] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.185 [2024-11-21 03:44:06.692843] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.185 [2024-11-21 03:44:06.692859] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.185 [2024-11-21 03:44:06.695093] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.185 [2024-11-21 03:44:06.704418] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.185 [2024-11-21 03:44:06.704788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.185 [2024-11-21 03:44:06.704945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.185 [2024-11-21 03:44:06.704973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:26.185 [2024-11-21 03:44:06.704990] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:26.185 [2024-11-21 03:44:06.705148] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:26.185 [2024-11-21 03:44:06.705355] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.185 [2024-11-21 03:44:06.705387] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.185 [2024-11-21 03:44:06.705403] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.185 [2024-11-21 03:44:06.707942] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.185 [2024-11-21 03:44:06.717047] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.185 [2024-11-21 03:44:06.717380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.185 [2024-11-21 03:44:06.717501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.185 [2024-11-21 03:44:06.717529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:26.185 [2024-11-21 03:44:06.717547] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:26.185 [2024-11-21 03:44:06.717730] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:26.185 [2024-11-21 03:44:06.717882] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.185 [2024-11-21 03:44:06.717906] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.185 [2024-11-21 03:44:06.717922] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.185 [2024-11-21 03:44:06.720244] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.185 [2024-11-21 03:44:06.729526] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.185 [2024-11-21 03:44:06.729907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.185 [2024-11-21 03:44:06.730041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.186 [2024-11-21 03:44:06.730067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:26.186 [2024-11-21 03:44:06.730095] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:26.186 [2024-11-21 03:44:06.730211] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:26.186 [2024-11-21 03:44:06.730432] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.186 [2024-11-21 03:44:06.730457] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.186 [2024-11-21 03:44:06.730473] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.186 [2024-11-21 03:44:06.732696] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.186 [2024-11-21 03:44:06.742115] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.186 [2024-11-21 03:44:06.742423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.186 [2024-11-21 03:44:06.742571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.186 [2024-11-21 03:44:06.742600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:26.186 [2024-11-21 03:44:06.742617] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:26.186 [2024-11-21 03:44:06.742782] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:26.186 [2024-11-21 03:44:06.742969] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.186 [2024-11-21 03:44:06.742994] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.186 [2024-11-21 03:44:06.743010] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.186 [2024-11-21 03:44:06.745353] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.186 [2024-11-21 03:44:06.754685] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.186 [2024-11-21 03:44:06.755013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.186 [2024-11-21 03:44:06.755134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.186 [2024-11-21 03:44:06.755163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:26.186 [2024-11-21 03:44:06.755181] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:26.186 [2024-11-21 03:44:06.755328] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:26.186 [2024-11-21 03:44:06.755553] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.186 [2024-11-21 03:44:06.755577] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.186 [2024-11-21 03:44:06.755592] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.186 [2024-11-21 03:44:06.757898] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.186 [2024-11-21 03:44:06.767062] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.186 [2024-11-21 03:44:06.767432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.186 [2024-11-21 03:44:06.767585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.186 [2024-11-21 03:44:06.767614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:26.186 [2024-11-21 03:44:06.767638] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:26.186 [2024-11-21 03:44:06.767820] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:26.186 [2024-11-21 03:44:06.767973] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.186 [2024-11-21 03:44:06.767996] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.186 [2024-11-21 03:44:06.768012] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.186 [2024-11-21 03:44:06.770088] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.186 [2024-11-21 03:44:06.779283] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.186 [2024-11-21 03:44:06.779664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.186 [2024-11-21 03:44:06.779812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.186 [2024-11-21 03:44:06.779840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:26.186 [2024-11-21 03:44:06.779857] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:26.186 [2024-11-21 03:44:06.780004] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:26.186 [2024-11-21 03:44:06.780175] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.186 [2024-11-21 03:44:06.780198] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.186 [2024-11-21 03:44:06.780211] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.186 [2024-11-21 03:44:06.782689] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.186 [2024-11-21 03:44:06.791740] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.186 [2024-11-21 03:44:06.792085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.186 [2024-11-21 03:44:06.792220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.186 [2024-11-21 03:44:06.792246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:26.186 [2024-11-21 03:44:06.792261] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:26.186 [2024-11-21 03:44:06.792416] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:26.186 [2024-11-21 03:44:06.792550] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.186 [2024-11-21 03:44:06.792573] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.186 [2024-11-21 03:44:06.792588] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.186 [2024-11-21 03:44:06.794775] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.186 [2024-11-21 03:44:06.804305] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.186 [2024-11-21 03:44:06.804659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.186 [2024-11-21 03:44:06.804801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.186 [2024-11-21 03:44:06.804848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:26.186 [2024-11-21 03:44:06.804865] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:26.186 [2024-11-21 03:44:06.805048] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:26.186 [2024-11-21 03:44:06.805225] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.186 [2024-11-21 03:44:06.805246] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.186 [2024-11-21 03:44:06.805259] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.186 [2024-11-21 03:44:06.807443] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.186 [2024-11-21 03:44:06.816840] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.186 [2024-11-21 03:44:06.817110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.186 [2024-11-21 03:44:06.817235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.186 [2024-11-21 03:44:06.817263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:26.186 [2024-11-21 03:44:06.817280] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:26.186 [2024-11-21 03:44:06.817446] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:26.186 [2024-11-21 03:44:06.817616] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.186 [2024-11-21 03:44:06.817640] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.186 [2024-11-21 03:44:06.817656] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.186 [2024-11-21 03:44:06.820024] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.448 [2024-11-21 03:44:06.829440] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.448 [2024-11-21 03:44:06.829794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.448 [2024-11-21 03:44:06.829906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.448 [2024-11-21 03:44:06.829937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:26.448 [2024-11-21 03:44:06.829953] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:26.448 [2024-11-21 03:44:06.830176] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:26.448 [2024-11-21 03:44:06.830329] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.448 [2024-11-21 03:44:06.830353] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.448 [2024-11-21 03:44:06.830368] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.448 [2024-11-21 03:44:06.832592] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.448 [2024-11-21 03:44:06.841923] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.448 [2024-11-21 03:44:06.842282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.448 [2024-11-21 03:44:06.842454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.448 [2024-11-21 03:44:06.842482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:26.448 [2024-11-21 03:44:06.842500] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:26.448 [2024-11-21 03:44:06.842629] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:26.448 [2024-11-21 03:44:06.842835] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.448 [2024-11-21 03:44:06.842859] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.448 [2024-11-21 03:44:06.842874] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.448 [2024-11-21 03:44:06.845107] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.448 [2024-11-21 03:44:06.854580] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.448 [2024-11-21 03:44:06.854911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.448 [2024-11-21 03:44:06.855126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.448 [2024-11-21 03:44:06.855153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:26.448 [2024-11-21 03:44:06.855169] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:26.448 [2024-11-21 03:44:06.855385] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:26.448 [2024-11-21 03:44:06.855538] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.448 [2024-11-21 03:44:06.855561] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.448 [2024-11-21 03:44:06.855576] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.448 [2024-11-21 03:44:06.857792] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.448 [2024-11-21 03:44:06.867202] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.448 [2024-11-21 03:44:06.867542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.448 [2024-11-21 03:44:06.867714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.448 [2024-11-21 03:44:06.867760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:26.448 [2024-11-21 03:44:06.867783] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:26.448 [2024-11-21 03:44:06.867912] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:26.449 [2024-11-21 03:44:06.868129] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.449 [2024-11-21 03:44:06.868154] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.449 [2024-11-21 03:44:06.868169] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.449 [2024-11-21 03:44:06.870537] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.449 [2024-11-21 03:44:06.879771] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.449 [2024-11-21 03:44:06.880113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.449 [2024-11-21 03:44:06.880285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.449 [2024-11-21 03:44:06.880313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:26.449 [2024-11-21 03:44:06.880331] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:26.449 [2024-11-21 03:44:06.880533] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:26.449 [2024-11-21 03:44:06.880721] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.449 [2024-11-21 03:44:06.880745] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.449 [2024-11-21 03:44:06.880760] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.449 [2024-11-21 03:44:06.883158] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.449 [2024-11-21 03:44:06.892267] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.449 [2024-11-21 03:44:06.892674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.449 [2024-11-21 03:44:06.892819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.449 [2024-11-21 03:44:06.892848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:26.449 [2024-11-21 03:44:06.892866] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:26.449 [2024-11-21 03:44:06.892995] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:26.449 [2024-11-21 03:44:06.893195] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.449 [2024-11-21 03:44:06.893220] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.449 [2024-11-21 03:44:06.893235] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.449 [2024-11-21 03:44:06.895692] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.449 [2024-11-21 03:44:06.904883] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.449 [2024-11-21 03:44:06.905223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.449 [2024-11-21 03:44:06.905417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.449 [2024-11-21 03:44:06.905463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:26.449 [2024-11-21 03:44:06.905482] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:26.449 [2024-11-21 03:44:06.905652] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:26.449 [2024-11-21 03:44:06.905769] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.449 [2024-11-21 03:44:06.905792] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.449 [2024-11-21 03:44:06.905807] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.449 [2024-11-21 03:44:06.908152] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.449 [2024-11-21 03:44:06.917555] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.449 [2024-11-21 03:44:06.917894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.449 [2024-11-21 03:44:06.918037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.449 [2024-11-21 03:44:06.918063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:26.449 [2024-11-21 03:44:06.918091] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:26.449 [2024-11-21 03:44:06.918271] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:26.449 [2024-11-21 03:44:06.918460] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.449 [2024-11-21 03:44:06.918483] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.449 [2024-11-21 03:44:06.918500] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.449 [2024-11-21 03:44:06.920845] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.449 [2024-11-21 03:44:06.930350] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.449 [2024-11-21 03:44:06.930637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.449 [2024-11-21 03:44:06.930805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.449 [2024-11-21 03:44:06.930831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:26.449 [2024-11-21 03:44:06.930846] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:26.449 [2024-11-21 03:44:06.931043] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:26.449 [2024-11-21 03:44:06.931226] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.449 [2024-11-21 03:44:06.931250] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.449 [2024-11-21 03:44:06.931266] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.449 [2024-11-21 03:44:06.933455] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.449 [2024-11-21 03:44:06.942904] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.449 [2024-11-21 03:44:06.943205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.449 [2024-11-21 03:44:06.943346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.449 [2024-11-21 03:44:06.943374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:26.449 [2024-11-21 03:44:06.943391] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:26.449 [2024-11-21 03:44:06.943574] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:26.449 [2024-11-21 03:44:06.943715] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.449 [2024-11-21 03:44:06.943740] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.449 [2024-11-21 03:44:06.943755] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.449 [2024-11-21 03:44:06.946188] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.449 [2024-11-21 03:44:06.955520] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.449 [2024-11-21 03:44:06.955776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.449 [2024-11-21 03:44:06.955946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.449 [2024-11-21 03:44:06.955974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:26.449 [2024-11-21 03:44:06.955991] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:26.449 [2024-11-21 03:44:06.956184] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:26.449 [2024-11-21 03:44:06.956346] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.449 [2024-11-21 03:44:06.956379] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.449 [2024-11-21 03:44:06.956395] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.449 [2024-11-21 03:44:06.958872] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.449 [2024-11-21 03:44:06.968082] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.449 [2024-11-21 03:44:06.968411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.449 [2024-11-21 03:44:06.968566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.449 [2024-11-21 03:44:06.968611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:26.449 [2024-11-21 03:44:06.968629] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:26.449 [2024-11-21 03:44:06.968794] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:26.449 [2024-11-21 03:44:06.968999] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.449 [2024-11-21 03:44:06.969023] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.449 [2024-11-21 03:44:06.969038] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.450 [2024-11-21 03:44:06.971469] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.450 [2024-11-21 03:44:06.980487] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.450 [2024-11-21 03:44:06.980847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.450 [2024-11-21 03:44:06.981030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.450 [2024-11-21 03:44:06.981058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:26.450 [2024-11-21 03:44:06.981085] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:26.450 [2024-11-21 03:44:06.981255] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:26.450 [2024-11-21 03:44:06.981425] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.450 [2024-11-21 03:44:06.981454] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.450 [2024-11-21 03:44:06.981470] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.450 [2024-11-21 03:44:06.983908] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.450 [2024-11-21 03:44:06.992896] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.450 [2024-11-21 03:44:06.993263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.450 [2024-11-21 03:44:06.993427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.450 [2024-11-21 03:44:06.993469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:26.450 [2024-11-21 03:44:06.993486] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:26.450 [2024-11-21 03:44:06.993671] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:26.450 [2024-11-21 03:44:06.993841] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.450 [2024-11-21 03:44:06.993865] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.450 [2024-11-21 03:44:06.993880] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.450 [2024-11-21 03:44:06.996100] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.450 [2024-11-21 03:44:07.005410] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.450 [2024-11-21 03:44:07.005749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.450 [2024-11-21 03:44:07.005897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.450 [2024-11-21 03:44:07.005923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:26.450 [2024-11-21 03:44:07.005938] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:26.450 [2024-11-21 03:44:07.006146] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:26.450 [2024-11-21 03:44:07.006335] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.450 [2024-11-21 03:44:07.006359] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.450 [2024-11-21 03:44:07.006375] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.450 [2024-11-21 03:44:07.008798] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.450 [2024-11-21 03:44:07.017918] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.450 [2024-11-21 03:44:07.018346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.450 [2024-11-21 03:44:07.018597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.450 [2024-11-21 03:44:07.018622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:26.450 [2024-11-21 03:44:07.018638] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:26.450 [2024-11-21 03:44:07.018814] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:26.450 [2024-11-21 03:44:07.019018] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.450 [2024-11-21 03:44:07.019042] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.450 [2024-11-21 03:44:07.019064] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.450 [2024-11-21 03:44:07.021486] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.450 [2024-11-21 03:44:07.030586] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.450 [2024-11-21 03:44:07.031002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.450 [2024-11-21 03:44:07.031188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.450 [2024-11-21 03:44:07.031215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:26.450 [2024-11-21 03:44:07.031230] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:26.450 [2024-11-21 03:44:07.031331] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:26.450 [2024-11-21 03:44:07.031542] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.450 [2024-11-21 03:44:07.031567] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.450 [2024-11-21 03:44:07.031582] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.450 [2024-11-21 03:44:07.033952] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.450 [2024-11-21 03:44:07.043015] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.450 [2024-11-21 03:44:07.043310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.450 [2024-11-21 03:44:07.043503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.450 [2024-11-21 03:44:07.043529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:26.450 [2024-11-21 03:44:07.043544] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:26.450 [2024-11-21 03:44:07.043705] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:26.450 [2024-11-21 03:44:07.043894] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.450 [2024-11-21 03:44:07.043917] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.450 [2024-11-21 03:44:07.043933] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.450 [2024-11-21 03:44:07.045997] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.450 [2024-11-21 03:44:07.055615] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.450 [2024-11-21 03:44:07.056003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.450 [2024-11-21 03:44:07.056194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.450 [2024-11-21 03:44:07.056224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:26.450 [2024-11-21 03:44:07.056241] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:26.450 [2024-11-21 03:44:07.056370] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:26.450 [2024-11-21 03:44:07.056542] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.450 [2024-11-21 03:44:07.056566] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.450 [2024-11-21 03:44:07.056582] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.450 [2024-11-21 03:44:07.058817] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.450 [2024-11-21 03:44:07.068446] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.451 [2024-11-21 03:44:07.068844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.451 [2024-11-21 03:44:07.069006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.451 [2024-11-21 03:44:07.069034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:26.451 [2024-11-21 03:44:07.069051] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:26.451 [2024-11-21 03:44:07.069227] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:26.451 [2024-11-21 03:44:07.069362] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.451 [2024-11-21 03:44:07.069387] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.451 [2024-11-21 03:44:07.069402] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.451 [2024-11-21 03:44:07.071662] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.451 [2024-11-21 03:44:07.080986] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.451 [2024-11-21 03:44:07.081284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.451 [2024-11-21 03:44:07.081435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.451 [2024-11-21 03:44:07.081463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:26.451 [2024-11-21 03:44:07.081480] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:26.451 [2024-11-21 03:44:07.081628] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:26.451 [2024-11-21 03:44:07.081798] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.451 [2024-11-21 03:44:07.081822] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.451 [2024-11-21 03:44:07.081838] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.451 [2024-11-21 03:44:07.084131] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.713 [2024-11-21 03:44:07.093633] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.713 [2024-11-21 03:44:07.094062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.713 [2024-11-21 03:44:07.094239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.713 [2024-11-21 03:44:07.094268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:26.713 [2024-11-21 03:44:07.094285] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:26.713 [2024-11-21 03:44:07.094451] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:26.713 [2024-11-21 03:44:07.094622] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.713 [2024-11-21 03:44:07.094645] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.713 [2024-11-21 03:44:07.094661] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.713 [2024-11-21 03:44:07.097169] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.713 [2024-11-21 03:44:07.106234] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.713 [2024-11-21 03:44:07.106568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.713 [2024-11-21 03:44:07.106734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.713 [2024-11-21 03:44:07.106759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:26.713 [2024-11-21 03:44:07.106775] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:26.713 [2024-11-21 03:44:07.106919] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:26.713 [2024-11-21 03:44:07.107053] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.713 [2024-11-21 03:44:07.107088] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.713 [2024-11-21 03:44:07.107105] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.713 [2024-11-21 03:44:07.109401] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.713 [2024-11-21 03:44:07.118835] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.713 [2024-11-21 03:44:07.119298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.713 [2024-11-21 03:44:07.119519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.713 [2024-11-21 03:44:07.119548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:26.713 [2024-11-21 03:44:07.119565] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:26.713 [2024-11-21 03:44:07.119731] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:26.713 [2024-11-21 03:44:07.119900] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.713 [2024-11-21 03:44:07.119924] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.713 [2024-11-21 03:44:07.119939] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.713 [2024-11-21 03:44:07.122283] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.713 [2024-11-21 03:44:07.131456] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.713 [2024-11-21 03:44:07.131705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.713 [2024-11-21 03:44:07.131891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.713 [2024-11-21 03:44:07.131917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:26.713 [2024-11-21 03:44:07.131933] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:26.713 [2024-11-21 03:44:07.132107] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:26.713 [2024-11-21 03:44:07.132272] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.713 [2024-11-21 03:44:07.132296] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.713 [2024-11-21 03:44:07.132312] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.713 [2024-11-21 03:44:07.134520] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.713 [2024-11-21 03:44:07.143905] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.713 [2024-11-21 03:44:07.144187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.713 [2024-11-21 03:44:07.144371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.713 [2024-11-21 03:44:07.144396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:26.713 [2024-11-21 03:44:07.144412] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:26.713 [2024-11-21 03:44:07.144542] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:26.713 [2024-11-21 03:44:07.144723] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.713 [2024-11-21 03:44:07.144747] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.713 [2024-11-21 03:44:07.144763] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.713 [2024-11-21 03:44:07.147179] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.713 [2024-11-21 03:44:07.156568] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.713 [2024-11-21 03:44:07.156910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.713 [2024-11-21 03:44:07.157126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.713 [2024-11-21 03:44:07.157161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:26.714 [2024-11-21 03:44:07.157195] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:26.714 [2024-11-21 03:44:07.157396] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:26.714 [2024-11-21 03:44:07.157567] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.714 [2024-11-21 03:44:07.157591] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.714 [2024-11-21 03:44:07.157606] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.714 [2024-11-21 03:44:07.160017] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.714 [2024-11-21 03:44:07.169006] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.714 [2024-11-21 03:44:07.169344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.714 [2024-11-21 03:44:07.169478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.714 [2024-11-21 03:44:07.169504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:26.714 [2024-11-21 03:44:07.169519] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:26.714 [2024-11-21 03:44:07.169667] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:26.714 [2024-11-21 03:44:07.169863] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.714 [2024-11-21 03:44:07.169886] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.714 [2024-11-21 03:44:07.169902] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.714 [2024-11-21 03:44:07.172245] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.714 [2024-11-21 03:44:07.181544] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.714 [2024-11-21 03:44:07.181977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.714 [2024-11-21 03:44:07.182152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.714 [2024-11-21 03:44:07.182181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:26.714 [2024-11-21 03:44:07.182198] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:26.714 [2024-11-21 03:44:07.182345] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:26.714 [2024-11-21 03:44:07.182479] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.714 [2024-11-21 03:44:07.182503] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.714 [2024-11-21 03:44:07.182518] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.714 [2024-11-21 03:44:07.184763] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.714 [2024-11-21 03:44:07.194153] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.714 [2024-11-21 03:44:07.194584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.714 [2024-11-21 03:44:07.194778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.714 [2024-11-21 03:44:07.194806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:26.714 [2024-11-21 03:44:07.194822] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:26.714 [2024-11-21 03:44:07.194987] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:26.714 [2024-11-21 03:44:07.195187] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.714 [2024-11-21 03:44:07.195212] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.714 [2024-11-21 03:44:07.195228] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.714 [2024-11-21 03:44:07.197416] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.714 [2024-11-21 03:44:07.206847] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.714 [2024-11-21 03:44:07.207165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.714 [2024-11-21 03:44:07.207315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.714 [2024-11-21 03:44:07.207343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:26.714 [2024-11-21 03:44:07.207360] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:26.714 [2024-11-21 03:44:07.207561] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:26.714 [2024-11-21 03:44:07.207767] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.714 [2024-11-21 03:44:07.207791] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.714 [2024-11-21 03:44:07.207807] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.714 [2024-11-21 03:44:07.210190] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.714 [2024-11-21 03:44:07.219528] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.714 [2024-11-21 03:44:07.219840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.714 [2024-11-21 03:44:07.220027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.714 [2024-11-21 03:44:07.220055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:26.714 [2024-11-21 03:44:07.220088] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:26.714 [2024-11-21 03:44:07.220256] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:26.714 [2024-11-21 03:44:07.220390] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.714 [2024-11-21 03:44:07.220414] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.714 [2024-11-21 03:44:07.220430] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.714 [2024-11-21 03:44:07.222769] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.714 [2024-11-21 03:44:07.232081] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.714 [2024-11-21 03:44:07.232493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.714 [2024-11-21 03:44:07.232665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.714 [2024-11-21 03:44:07.232707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:26.714 [2024-11-21 03:44:07.232725] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:26.714 [2024-11-21 03:44:07.232872] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:26.714 [2024-11-21 03:44:07.232988] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.714 [2024-11-21 03:44:07.233011] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.714 [2024-11-21 03:44:07.233026] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.714 [2024-11-21 03:44:07.235403] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.714 [2024-11-21 03:44:07.244738] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.714 [2024-11-21 03:44:07.245085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.714 [2024-11-21 03:44:07.245211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.714 [2024-11-21 03:44:07.245239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:26.714 [2024-11-21 03:44:07.245256] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:26.714 [2024-11-21 03:44:07.245458] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:26.714 [2024-11-21 03:44:07.245610] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.714 [2024-11-21 03:44:07.245634] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.714 [2024-11-21 03:44:07.245649] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.714 [2024-11-21 03:44:07.247862] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.714 [2024-11-21 03:44:07.257306] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.714 [2024-11-21 03:44:07.257596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.714 [2024-11-21 03:44:07.257779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.714 [2024-11-21 03:44:07.257805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:26.714 [2024-11-21 03:44:07.257834] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:26.714 [2024-11-21 03:44:07.258013] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:26.714 [2024-11-21 03:44:07.258253] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.714 [2024-11-21 03:44:07.258279] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.714 [2024-11-21 03:44:07.258294] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.714 [2024-11-21 03:44:07.260647] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.714 [2024-11-21 03:44:07.270167] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.714 [2024-11-21 03:44:07.270621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.714 [2024-11-21 03:44:07.270754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.714 [2024-11-21 03:44:07.270780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:26.714 [2024-11-21 03:44:07.270795] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:26.714 [2024-11-21 03:44:07.270928] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:26.714 [2024-11-21 03:44:07.271145] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.714 [2024-11-21 03:44:07.271171] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.715 [2024-11-21 03:44:07.271187] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.715 [2024-11-21 03:44:07.273555] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.715 [2024-11-21 03:44:07.282791] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.715 [2024-11-21 03:44:07.283114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.715 [2024-11-21 03:44:07.283262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.715 [2024-11-21 03:44:07.283309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:26.715 [2024-11-21 03:44:07.283327] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:26.715 [2024-11-21 03:44:07.283493] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:26.715 [2024-11-21 03:44:07.283627] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.715 [2024-11-21 03:44:07.283651] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.715 [2024-11-21 03:44:07.283666] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.715 [2024-11-21 03:44:07.285984] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.715 [2024-11-21 03:44:07.295605] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.715 [2024-11-21 03:44:07.295967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.715 [2024-11-21 03:44:07.296114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.715 [2024-11-21 03:44:07.296144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:26.715 [2024-11-21 03:44:07.296161] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:26.715 [2024-11-21 03:44:07.296326] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:26.715 [2024-11-21 03:44:07.296467] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.715 [2024-11-21 03:44:07.296491] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.715 [2024-11-21 03:44:07.296507] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.715 [2024-11-21 03:44:07.298880] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.715 [2024-11-21 03:44:07.308076] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.715 [2024-11-21 03:44:07.308351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.715 [2024-11-21 03:44:07.308492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.715 [2024-11-21 03:44:07.308517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:26.715 [2024-11-21 03:44:07.308533] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:26.715 [2024-11-21 03:44:07.308744] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:26.715 [2024-11-21 03:44:07.308897] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.715 [2024-11-21 03:44:07.308921] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.715 [2024-11-21 03:44:07.308937] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.715 [2024-11-21 03:44:07.311444] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.715 [2024-11-21 03:44:07.320663] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.715 [2024-11-21 03:44:07.320969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.715 [2024-11-21 03:44:07.321122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.715 [2024-11-21 03:44:07.321152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:26.715 [2024-11-21 03:44:07.321169] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:26.715 [2024-11-21 03:44:07.321316] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:26.715 [2024-11-21 03:44:07.321487] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.715 [2024-11-21 03:44:07.321511] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.715 [2024-11-21 03:44:07.321527] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.715 [2024-11-21 03:44:07.323679] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.715 [2024-11-21 03:44:07.333183] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.715 [2024-11-21 03:44:07.333510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.715 [2024-11-21 03:44:07.333662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.715 [2024-11-21 03:44:07.333691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:26.715 [2024-11-21 03:44:07.333708] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:26.715 [2024-11-21 03:44:07.333891] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:26.715 [2024-11-21 03:44:07.334092] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.715 [2024-11-21 03:44:07.334122] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.715 [2024-11-21 03:44:07.334138] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.715 [2024-11-21 03:44:07.336399] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.715 [2024-11-21 03:44:07.345823] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.715 [2024-11-21 03:44:07.346153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.715 [2024-11-21 03:44:07.346338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.715 [2024-11-21 03:44:07.346364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:26.715 [2024-11-21 03:44:07.346379] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:26.715 [2024-11-21 03:44:07.346611] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:26.715 [2024-11-21 03:44:07.346764] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.715 [2024-11-21 03:44:07.346787] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.715 [2024-11-21 03:44:07.346802] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.715 [2024-11-21 03:44:07.349256] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.977 [2024-11-21 03:44:07.358373] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.977 [2024-11-21 03:44:07.358699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.977 [2024-11-21 03:44:07.358844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.977 [2024-11-21 03:44:07.358873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:26.977 [2024-11-21 03:44:07.358890] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:26.977 [2024-11-21 03:44:07.359002] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:26.977 [2024-11-21 03:44:07.359184] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.977 [2024-11-21 03:44:07.359209] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.977 [2024-11-21 03:44:07.359225] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.977 [2024-11-21 03:44:07.361252] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.977 [2024-11-21 03:44:07.371013] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.977 [2024-11-21 03:44:07.371378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.977 [2024-11-21 03:44:07.371523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.977 [2024-11-21 03:44:07.371548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:26.977 [2024-11-21 03:44:07.371578] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:26.977 [2024-11-21 03:44:07.371733] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:26.977 [2024-11-21 03:44:07.371922] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.977 [2024-11-21 03:44:07.371946] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.977 [2024-11-21 03:44:07.371967] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.977 [2024-11-21 03:44:07.374257] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.977 [2024-11-21 03:44:07.383523] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.977 [2024-11-21 03:44:07.383846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.977 [2024-11-21 03:44:07.384025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.977 [2024-11-21 03:44:07.384051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:26.977 [2024-11-21 03:44:07.384067] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:26.977 [2024-11-21 03:44:07.384292] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:26.977 [2024-11-21 03:44:07.384481] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.977 [2024-11-21 03:44:07.384505] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.977 [2024-11-21 03:44:07.384520] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.977 [2024-11-21 03:44:07.386855] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.977 [2024-11-21 03:44:07.396170] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.977 [2024-11-21 03:44:07.396490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.977 [2024-11-21 03:44:07.396660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.977 [2024-11-21 03:44:07.396686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:26.977 [2024-11-21 03:44:07.396701] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:26.977 [2024-11-21 03:44:07.396882] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:26.977 [2024-11-21 03:44:07.397100] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.977 [2024-11-21 03:44:07.397125] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.977 [2024-11-21 03:44:07.397140] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.977 [2024-11-21 03:44:07.399525] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.977 [2024-11-21 03:44:07.408599] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.977 [2024-11-21 03:44:07.409009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.977 [2024-11-21 03:44:07.409190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.977 [2024-11-21 03:44:07.409219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:26.977 [2024-11-21 03:44:07.409236] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:26.977 [2024-11-21 03:44:07.409401] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:26.977 [2024-11-21 03:44:07.409517] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.977 [2024-11-21 03:44:07.409541] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.977 [2024-11-21 03:44:07.409556] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.978 [2024-11-21 03:44:07.411861] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.978 [2024-11-21 03:44:07.420894] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.978 [2024-11-21 03:44:07.421345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.978 [2024-11-21 03:44:07.421480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.978 [2024-11-21 03:44:07.421523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:26.978 [2024-11-21 03:44:07.421541] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:26.978 [2024-11-21 03:44:07.421688] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:26.978 [2024-11-21 03:44:07.421858] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.978 [2024-11-21 03:44:07.421881] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.978 [2024-11-21 03:44:07.421897] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.978 [2024-11-21 03:44:07.424260] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.978 [2024-11-21 03:44:07.433458] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.978 [2024-11-21 03:44:07.433691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.978 [2024-11-21 03:44:07.433864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.978 [2024-11-21 03:44:07.433892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:26.978 [2024-11-21 03:44:07.433909] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:26.978 [2024-11-21 03:44:07.434140] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:26.978 [2024-11-21 03:44:07.434311] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.978 [2024-11-21 03:44:07.434335] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.978 [2024-11-21 03:44:07.434350] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.978 [2024-11-21 03:44:07.436829] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.978 [2024-11-21 03:44:07.446139] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.978 [2024-11-21 03:44:07.446468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.978 [2024-11-21 03:44:07.446687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.978 [2024-11-21 03:44:07.446731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:26.978 [2024-11-21 03:44:07.446748] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:26.978 [2024-11-21 03:44:07.446895] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:26.978 [2024-11-21 03:44:07.447064] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.978 [2024-11-21 03:44:07.447100] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.978 [2024-11-21 03:44:07.447116] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.978 [2024-11-21 03:44:07.449380] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.978 [2024-11-21 03:44:07.458494] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.978 [2024-11-21 03:44:07.458744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.978 [2024-11-21 03:44:07.458897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.978 [2024-11-21 03:44:07.458925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:26.978 [2024-11-21 03:44:07.458942] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:26.978 [2024-11-21 03:44:07.459103] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:26.978 [2024-11-21 03:44:07.459274] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.978 [2024-11-21 03:44:07.459298] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.978 [2024-11-21 03:44:07.459314] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.978 [2024-11-21 03:44:07.461903] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.978 [2024-11-21 03:44:07.471006] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.978 [2024-11-21 03:44:07.471355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.978 [2024-11-21 03:44:07.471518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.978 [2024-11-21 03:44:07.471544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:26.978 [2024-11-21 03:44:07.471559] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:26.978 [2024-11-21 03:44:07.471691] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:26.978 [2024-11-21 03:44:07.471889] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.978 [2024-11-21 03:44:07.471912] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.978 [2024-11-21 03:44:07.471928] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.978 [2024-11-21 03:44:07.474382] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.978 [2024-11-21 03:44:07.483625] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.978 [2024-11-21 03:44:07.483950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.978 [2024-11-21 03:44:07.484092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.978 [2024-11-21 03:44:07.484118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:26.978 [2024-11-21 03:44:07.484134] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:26.978 [2024-11-21 03:44:07.484294] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:26.978 [2024-11-21 03:44:07.484465] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.978 [2024-11-21 03:44:07.484488] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.978 [2024-11-21 03:44:07.484504] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.978 [2024-11-21 03:44:07.486903] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.978 [2024-11-21 03:44:07.496354] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.978 [2024-11-21 03:44:07.496759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.978 [2024-11-21 03:44:07.496962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.978 [2024-11-21 03:44:07.496990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:26.978 [2024-11-21 03:44:07.497007] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:26.978 [2024-11-21 03:44:07.497148] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:26.978 [2024-11-21 03:44:07.497265] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.978 [2024-11-21 03:44:07.497289] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.978 [2024-11-21 03:44:07.497305] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.978 [2024-11-21 03:44:07.499566] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.978 [2024-11-21 03:44:07.508786] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.978 [2024-11-21 03:44:07.509188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.978 [2024-11-21 03:44:07.509337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.978 [2024-11-21 03:44:07.509385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:26.978 [2024-11-21 03:44:07.509402] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:26.978 [2024-11-21 03:44:07.509603] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:26.978 [2024-11-21 03:44:07.509774] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.978 [2024-11-21 03:44:07.509798] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.978 [2024-11-21 03:44:07.509813] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.978 [2024-11-21 03:44:07.512354] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.978 [2024-11-21 03:44:07.521388] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.978 [2024-11-21 03:44:07.521703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.978 [2024-11-21 03:44:07.521883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.978 [2024-11-21 03:44:07.521908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:26.978 [2024-11-21 03:44:07.521923] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:26.978 [2024-11-21 03:44:07.522126] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:26.978 [2024-11-21 03:44:07.522297] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.978 [2024-11-21 03:44:07.522322] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.978 [2024-11-21 03:44:07.522337] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.978 [2024-11-21 03:44:07.524708] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.978 [2024-11-21 03:44:07.534075] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.978 [2024-11-21 03:44:07.534394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.978 [2024-11-21 03:44:07.534540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.979 [2024-11-21 03:44:07.534569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:26.979 [2024-11-21 03:44:07.534586] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:26.979 [2024-11-21 03:44:07.534752] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:26.979 [2024-11-21 03:44:07.534903] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.979 [2024-11-21 03:44:07.534928] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.979 [2024-11-21 03:44:07.534943] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.979 [2024-11-21 03:44:07.537522] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.979 [2024-11-21 03:44:07.546653] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.979 [2024-11-21 03:44:07.547003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.979 [2024-11-21 03:44:07.547161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.979 [2024-11-21 03:44:07.547188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:26.979 [2024-11-21 03:44:07.547221] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:26.979 [2024-11-21 03:44:07.547332] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:26.979 [2024-11-21 03:44:07.547519] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.979 [2024-11-21 03:44:07.547544] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.979 [2024-11-21 03:44:07.547559] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.979 [2024-11-21 03:44:07.549966] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.979 [2024-11-21 03:44:07.559301] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.979 [2024-11-21 03:44:07.559625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.979 [2024-11-21 03:44:07.559875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.979 [2024-11-21 03:44:07.559901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:26.979 [2024-11-21 03:44:07.559916] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:26.979 [2024-11-21 03:44:07.560060] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:26.979 [2024-11-21 03:44:07.560262] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.979 [2024-11-21 03:44:07.560287] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.979 [2024-11-21 03:44:07.560302] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.979 [2024-11-21 03:44:07.562726] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.979 [2024-11-21 03:44:07.571798] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.979 [2024-11-21 03:44:07.572115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.979 [2024-11-21 03:44:07.572255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.979 [2024-11-21 03:44:07.572281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:26.979 [2024-11-21 03:44:07.572301] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:26.979 [2024-11-21 03:44:07.572478] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:26.979 [2024-11-21 03:44:07.572649] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.979 [2024-11-21 03:44:07.572673] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.979 [2024-11-21 03:44:07.572688] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.979 [2024-11-21 03:44:07.575005] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.979 [2024-11-21 03:44:07.584378] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.979 [2024-11-21 03:44:07.584674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.979 [2024-11-21 03:44:07.584822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.979 [2024-11-21 03:44:07.584850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:26.979 [2024-11-21 03:44:07.584867] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:26.979 [2024-11-21 03:44:07.585014] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:26.979 [2024-11-21 03:44:07.585179] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.979 [2024-11-21 03:44:07.585203] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.979 [2024-11-21 03:44:07.585219] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.979 [2024-11-21 03:44:07.587535] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.979 [2024-11-21 03:44:07.597026] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.979 [2024-11-21 03:44:07.597367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.979 [2024-11-21 03:44:07.597504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.979 [2024-11-21 03:44:07.597533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:26.979 [2024-11-21 03:44:07.597550] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:26.979 [2024-11-21 03:44:07.597697] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:26.979 [2024-11-21 03:44:07.597903] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.979 [2024-11-21 03:44:07.597928] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.979 [2024-11-21 03:44:07.597943] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.979 [2024-11-21 03:44:07.600414] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:26.979 [2024-11-21 03:44:07.609680] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:26.979 [2024-11-21 03:44:07.610044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.979 [2024-11-21 03:44:07.610226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:26.979 [2024-11-21 03:44:07.610252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:26.979 [2024-11-21 03:44:07.610267] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:26.979 [2024-11-21 03:44:07.610414] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:26.979 [2024-11-21 03:44:07.610549] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:26.979 [2024-11-21 03:44:07.610572] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:26.979 [2024-11-21 03:44:07.610587] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:26.979 [2024-11-21 03:44:07.612884] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.241 [2024-11-21 03:44:07.622303] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.241 [2024-11-21 03:44:07.622605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.241 [2024-11-21 03:44:07.622775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.241 [2024-11-21 03:44:07.622804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:27.241 [2024-11-21 03:44:07.622821] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:27.241 [2024-11-21 03:44:07.622969] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:27.241 [2024-11-21 03:44:07.623151] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.241 [2024-11-21 03:44:07.623176] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.241 [2024-11-21 03:44:07.623191] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.241 [2024-11-21 03:44:07.625634] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.241 [2024-11-21 03:44:07.634900] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.241 [2024-11-21 03:44:07.635215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.241 [2024-11-21 03:44:07.635368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.241 [2024-11-21 03:44:07.635397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:27.241 [2024-11-21 03:44:07.635414] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:27.241 [2024-11-21 03:44:07.635615] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:27.241 [2024-11-21 03:44:07.635785] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.241 [2024-11-21 03:44:07.635809] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.241 [2024-11-21 03:44:07.635824] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.241 [2024-11-21 03:44:07.637944] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.241 [2024-11-21 03:44:07.647527] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.241 [2024-11-21 03:44:07.647813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.241 [2024-11-21 03:44:07.647968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.241 [2024-11-21 03:44:07.648009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:27.241 [2024-11-21 03:44:07.648026] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:27.241 [2024-11-21 03:44:07.648177] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:27.241 [2024-11-21 03:44:07.648373] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.241 [2024-11-21 03:44:07.648398] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.241 [2024-11-21 03:44:07.648413] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.241 [2024-11-21 03:44:07.650710] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.241 [2024-11-21 03:44:07.660019] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.241 [2024-11-21 03:44:07.660329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.241 [2024-11-21 03:44:07.660491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.241 [2024-11-21 03:44:07.660519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:27.241 [2024-11-21 03:44:07.660536] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:27.241 [2024-11-21 03:44:07.660701] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:27.241 [2024-11-21 03:44:07.660853] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.241 [2024-11-21 03:44:07.660877] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.241 [2024-11-21 03:44:07.660893] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.241 [2024-11-21 03:44:07.663185] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.241 [2024-11-21 03:44:07.672411] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.241 [2024-11-21 03:44:07.672698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.241 [2024-11-21 03:44:07.672883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.241 [2024-11-21 03:44:07.672909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:27.241 [2024-11-21 03:44:07.672942] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:27.241 [2024-11-21 03:44:07.673116] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:27.241 [2024-11-21 03:44:07.673270] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.241 [2024-11-21 03:44:07.673292] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.241 [2024-11-21 03:44:07.673306] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.241 [2024-11-21 03:44:07.675837] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.241 [2024-11-21 03:44:07.684956] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.241 [2024-11-21 03:44:07.685279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.241 [2024-11-21 03:44:07.685398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.242 [2024-11-21 03:44:07.685424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:27.242 [2024-11-21 03:44:07.685440] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:27.242 [2024-11-21 03:44:07.685598] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:27.242 [2024-11-21 03:44:07.685768] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.242 [2024-11-21 03:44:07.685798] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.242 [2024-11-21 03:44:07.685815] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.242 [2024-11-21 03:44:07.688257] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.242 [2024-11-21 03:44:07.697447] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.242 [2024-11-21 03:44:07.697768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.242 [2024-11-21 03:44:07.697941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.242 [2024-11-21 03:44:07.697969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:27.242 [2024-11-21 03:44:07.697986] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:27.242 [2024-11-21 03:44:07.698173] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:27.242 [2024-11-21 03:44:07.698343] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.242 [2024-11-21 03:44:07.698382] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.242 [2024-11-21 03:44:07.698397] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.242 [2024-11-21 03:44:07.700729] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.242 [2024-11-21 03:44:07.709859] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.242 [2024-11-21 03:44:07.710198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.242 [2024-11-21 03:44:07.710311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.242 [2024-11-21 03:44:07.710342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:27.242 [2024-11-21 03:44:07.710357] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:27.242 [2024-11-21 03:44:07.710552] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:27.242 [2024-11-21 03:44:07.710742] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.242 [2024-11-21 03:44:07.710766] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.242 [2024-11-21 03:44:07.710781] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.242 [2024-11-21 03:44:07.713215] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.242 [2024-11-21 03:44:07.722161] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.242 [2024-11-21 03:44:07.722487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.242 [2024-11-21 03:44:07.722619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.242 [2024-11-21 03:44:07.722645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:27.242 [2024-11-21 03:44:07.722660] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:27.242 [2024-11-21 03:44:07.722792] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:27.242 [2024-11-21 03:44:07.722946] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.242 [2024-11-21 03:44:07.722967] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.242 [2024-11-21 03:44:07.722987] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.242 [2024-11-21 03:44:07.724913] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.242 [2024-11-21 03:44:07.734498] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.242 [2024-11-21 03:44:07.734813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.242 [2024-11-21 03:44:07.734951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.242 [2024-11-21 03:44:07.734976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:27.242 [2024-11-21 03:44:07.734991] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:27.242 [2024-11-21 03:44:07.735102] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:27.242 [2024-11-21 03:44:07.735265] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.242 [2024-11-21 03:44:07.735287] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.242 [2024-11-21 03:44:07.735300] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.242 [2024-11-21 03:44:07.737584] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.242 [2024-11-21 03:44:07.747077] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.242 [2024-11-21 03:44:07.747386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.242 [2024-11-21 03:44:07.747530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.242 [2024-11-21 03:44:07.747555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:27.242 [2024-11-21 03:44:07.747570] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:27.242 [2024-11-21 03:44:07.747747] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:27.242 [2024-11-21 03:44:07.747940] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.242 [2024-11-21 03:44:07.747964] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.242 [2024-11-21 03:44:07.747979] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.242 [2024-11-21 03:44:07.750367] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.242 [2024-11-21 03:44:07.759770] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.242 [2024-11-21 03:44:07.760064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.242 [2024-11-21 03:44:07.760225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.242 [2024-11-21 03:44:07.760254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:27.242 [2024-11-21 03:44:07.760271] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:27.242 [2024-11-21 03:44:07.760436] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:27.242 [2024-11-21 03:44:07.760579] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.242 [2024-11-21 03:44:07.760603] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.242 [2024-11-21 03:44:07.760619] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.242 [2024-11-21 03:44:07.763039] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.242 [2024-11-21 03:44:07.772477] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.242 [2024-11-21 03:44:07.772841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.242 [2024-11-21 03:44:07.772988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.242 [2024-11-21 03:44:07.773015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:27.242 [2024-11-21 03:44:07.773032] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:27.242 [2024-11-21 03:44:07.773209] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:27.242 [2024-11-21 03:44:07.773345] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.242 [2024-11-21 03:44:07.773368] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.242 [2024-11-21 03:44:07.773383] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.242 [2024-11-21 03:44:07.775756] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.242 [2024-11-21 03:44:07.784838] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.242 [2024-11-21 03:44:07.785199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.242 [2024-11-21 03:44:07.785357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.242 [2024-11-21 03:44:07.785383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:27.242 [2024-11-21 03:44:07.785398] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:27.242 [2024-11-21 03:44:07.785615] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:27.242 [2024-11-21 03:44:07.785803] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.242 [2024-11-21 03:44:07.785827] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.242 [2024-11-21 03:44:07.785842] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.242 [2024-11-21 03:44:07.788166] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.242 [2024-11-21 03:44:07.797342] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.242 [2024-11-21 03:44:07.797701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.242 [2024-11-21 03:44:07.797849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.242 [2024-11-21 03:44:07.797878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:27.242 [2024-11-21 03:44:07.797895] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:27.243 [2024-11-21 03:44:07.798060] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:27.243 [2024-11-21 03:44:07.798230] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.243 [2024-11-21 03:44:07.798252] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.243 [2024-11-21 03:44:07.798266] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.243 [2024-11-21 03:44:07.800563] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.243 [2024-11-21 03:44:07.809859] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.243 [2024-11-21 03:44:07.810210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.243 [2024-11-21 03:44:07.810365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.243 [2024-11-21 03:44:07.810391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:27.243 [2024-11-21 03:44:07.810407] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:27.243 [2024-11-21 03:44:07.810565] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:27.243 [2024-11-21 03:44:07.810736] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.243 [2024-11-21 03:44:07.810760] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.243 [2024-11-21 03:44:07.810776] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.243 [2024-11-21 03:44:07.813041] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.243 [2024-11-21 03:44:07.822528] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.243 [2024-11-21 03:44:07.822908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.243 [2024-11-21 03:44:07.823051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.243 [2024-11-21 03:44:07.823085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:27.243 [2024-11-21 03:44:07.823104] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:27.243 [2024-11-21 03:44:07.823280] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:27.243 [2024-11-21 03:44:07.823487] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.243 [2024-11-21 03:44:07.823511] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.243 [2024-11-21 03:44:07.823527] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.243 [2024-11-21 03:44:07.825791] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.243 [2024-11-21 03:44:07.835321] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.243 [2024-11-21 03:44:07.835622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.243 [2024-11-21 03:44:07.835763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.243 [2024-11-21 03:44:07.835788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:27.243 [2024-11-21 03:44:07.835804] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:27.243 [2024-11-21 03:44:07.836002] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:27.243 [2024-11-21 03:44:07.836183] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.243 [2024-11-21 03:44:07.836208] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.243 [2024-11-21 03:44:07.836223] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.243 [2024-11-21 03:44:07.838581] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.243 [2024-11-21 03:44:07.847705] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.243 [2024-11-21 03:44:07.848000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.243 [2024-11-21 03:44:07.848147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.243 [2024-11-21 03:44:07.848176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:27.243 [2024-11-21 03:44:07.848193] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:27.243 [2024-11-21 03:44:07.848340] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:27.243 [2024-11-21 03:44:07.848529] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.243 [2024-11-21 03:44:07.848553] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.243 [2024-11-21 03:44:07.848568] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.243 [2024-11-21 03:44:07.850996] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.243 [2024-11-21 03:44:07.860247] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.243 [2024-11-21 03:44:07.860624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.243 [2024-11-21 03:44:07.860760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.243 [2024-11-21 03:44:07.860786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:27.243 [2024-11-21 03:44:07.860801] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:27.243 [2024-11-21 03:44:07.860980] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:27.243 [2024-11-21 03:44:07.861129] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.243 [2024-11-21 03:44:07.861154] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.243 [2024-11-21 03:44:07.861170] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.243 [2024-11-21 03:44:07.863328] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.243 [2024-11-21 03:44:07.873014] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.243 [2024-11-21 03:44:07.873353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.243 [2024-11-21 03:44:07.873492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.243 [2024-11-21 03:44:07.873521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:27.243 [2024-11-21 03:44:07.873538] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:27.243 [2024-11-21 03:44:07.873667] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:27.243 [2024-11-21 03:44:07.873838] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.243 [2024-11-21 03:44:07.873862] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.243 [2024-11-21 03:44:07.873877] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.243 [2024-11-21 03:44:07.876173] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.243 [2024-11-21 03:44:07.885712] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.503 [2024-11-21 03:44:07.886024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-11-21 03:44:07.886205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-11-21 03:44:07.886235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:27.504 [2024-11-21 03:44:07.886252] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:27.504 [2024-11-21 03:44:07.886400] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:27.504 [2024-11-21 03:44:07.886552] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.504 [2024-11-21 03:44:07.886575] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.504 [2024-11-21 03:44:07.886590] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.504 [2024-11-21 03:44:07.889060] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.504 [2024-11-21 03:44:07.898487] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.504 [2024-11-21 03:44:07.898797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-11-21 03:44:07.898972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-11-21 03:44:07.899000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:27.504 [2024-11-21 03:44:07.899017] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:27.504 [2024-11-21 03:44:07.899193] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:27.504 [2024-11-21 03:44:07.899364] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.504 [2024-11-21 03:44:07.899388] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.504 [2024-11-21 03:44:07.899404] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.504 [2024-11-21 03:44:07.901581] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.504 [2024-11-21 03:44:07.911127] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.504 [2024-11-21 03:44:07.911495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-11-21 03:44:07.911646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-11-21 03:44:07.911675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:27.504 [2024-11-21 03:44:07.911691] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:27.504 [2024-11-21 03:44:07.911910] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:27.504 [2024-11-21 03:44:07.912143] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.504 [2024-11-21 03:44:07.912168] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.504 [2024-11-21 03:44:07.912184] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.504 [2024-11-21 03:44:07.914500] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.504 [2024-11-21 03:44:07.923710] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.504 [2024-11-21 03:44:07.924078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-11-21 03:44:07.924214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-11-21 03:44:07.924239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:27.504 [2024-11-21 03:44:07.924259] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:27.504 [2024-11-21 03:44:07.924439] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:27.504 [2024-11-21 03:44:07.924602] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.504 [2024-11-21 03:44:07.924626] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.504 [2024-11-21 03:44:07.924642] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.504 [2024-11-21 03:44:07.927050] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.504 [2024-11-21 03:44:07.936328] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.504 [2024-11-21 03:44:07.936685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-11-21 03:44:07.936808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-11-21 03:44:07.936833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:27.504 [2024-11-21 03:44:07.936849] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:27.504 [2024-11-21 03:44:07.937042] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:27.504 [2024-11-21 03:44:07.937231] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.504 [2024-11-21 03:44:07.937256] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.504 [2024-11-21 03:44:07.937272] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.504 [2024-11-21 03:44:07.939677] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.504 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh: line 35: 3170047 Killed "${NVMF_APP[@]}" "$@" 00:27:27.504 03:44:07 -- host/bdevperf.sh@36 -- # tgt_init 00:27:27.504 03:44:07 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:27:27.504 03:44:07 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:27.504 03:44:07 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:27.504 03:44:07 -- common/autotest_common.sh@10 -- # set +x 00:27:27.504 03:44:07 -- nvmf/common.sh@469 -- # nvmfpid=3171164 00:27:27.504 03:44:07 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:27:27.504 03:44:07 -- nvmf/common.sh@470 -- # waitforlisten 3171164 00:27:27.504 03:44:07 -- common/autotest_common.sh@829 -- # '[' -z 3171164 ']' 00:27:27.504 03:44:07 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:27.504 03:44:07 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:27.504 03:44:07 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:27.504 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:27.504 03:44:07 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:27.504 03:44:07 -- common/autotest_common.sh@10 -- # set +x 00:27:27.504 [2024-11-21 03:44:07.948716] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.504 [2024-11-21 03:44:07.949062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-11-21 03:44:07.949220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.504 [2024-11-21 03:44:07.949247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:27.504 [2024-11-21 03:44:07.949263] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:27.504 [2024-11-21 03:44:07.949470] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:27.504 [2024-11-21 03:44:07.949605] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.505 [2024-11-21 03:44:07.949629] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.505 [2024-11-21 03:44:07.949644] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.505 [2024-11-21 03:44:07.951926] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.505 [2024-11-21 03:44:07.961341] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.505 [2024-11-21 03:44:07.961732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-11-21 03:44:07.961860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-11-21 03:44:07.961889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:27.505 [2024-11-21 03:44:07.961907] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:27.505 [2024-11-21 03:44:07.962054] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:27.505 [2024-11-21 03:44:07.962272] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.505 [2024-11-21 03:44:07.962297] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.505 [2024-11-21 03:44:07.962313] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.505 [2024-11-21 03:44:07.964680] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.505 [2024-11-21 03:44:07.973616] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.505 [2024-11-21 03:44:07.973929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-11-21 03:44:07.974065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-11-21 03:44:07.974102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:27.505 [2024-11-21 03:44:07.974118] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:27.505 [2024-11-21 03:44:07.974268] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:27.505 [2024-11-21 03:44:07.974435] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.505 [2024-11-21 03:44:07.974456] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.505 [2024-11-21 03:44:07.974469] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.505 [2024-11-21 03:44:07.976487] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.505 [2024-11-21 03:44:07.985967] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.505 [2024-11-21 03:44:07.986283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-11-21 03:44:07.986410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-11-21 03:44:07.986437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:27.505 [2024-11-21 03:44:07.986453] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:27.505 [2024-11-21 03:44:07.986619] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:27.505 [2024-11-21 03:44:07.986790] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.505 [2024-11-21 03:44:07.986810] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.505 [2024-11-21 03:44:07.986824] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.505 [2024-11-21 03:44:07.988922] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:27.505 [2024-11-21 03:44:07.988939] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.505 [2024-11-21 03:44:07.988993] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:27.505 [2024-11-21 03:44:07.998162] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.505 [2024-11-21 03:44:07.998456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-11-21 03:44:07.998601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-11-21 03:44:07.998626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:27.505 [2024-11-21 03:44:07.998642] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:27.505 [2024-11-21 03:44:07.998774] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:27.505 [2024-11-21 03:44:07.998943] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.505 [2024-11-21 03:44:07.998980] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.505 [2024-11-21 03:44:07.998996] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.505 [2024-11-21 03:44:08.001005] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.505 [2024-11-21 03:44:08.010402] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.505 [2024-11-21 03:44:08.010709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-11-21 03:44:08.010848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-11-21 03:44:08.010873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:27.505 [2024-11-21 03:44:08.010889] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:27.505 [2024-11-21 03:44:08.011053] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:27.505 [2024-11-21 03:44:08.011183] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.505 [2024-11-21 03:44:08.011205] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.505 [2024-11-21 03:44:08.011220] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.505 [2024-11-21 03:44:08.013261] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.505 [2024-11-21 03:44:08.022515] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.505 [2024-11-21 03:44:08.022841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-11-21 03:44:08.022976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.505 [2024-11-21 03:44:08.023002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:27.505 [2024-11-21 03:44:08.023018] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:27.505 [2024-11-21 03:44:08.023230] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:27.505 [2024-11-21 03:44:08.023395] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.505 [2024-11-21 03:44:08.023416] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.505 [2024-11-21 03:44:08.023429] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.505 EAL: No free 2048 kB hugepages reported on node 1 00:27:27.505 [2024-11-21 03:44:08.025541] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.506 [2024-11-21 03:44:08.035171] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.506 [2024-11-21 03:44:08.035454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-11-21 03:44:08.035609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-11-21 03:44:08.035638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:27.506 [2024-11-21 03:44:08.035655] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:27.506 [2024-11-21 03:44:08.035802] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:27.506 [2024-11-21 03:44:08.035972] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.506 [2024-11-21 03:44:08.035996] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.506 [2024-11-21 03:44:08.036012] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.506 [2024-11-21 03:44:08.038746] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.506 [2024-11-21 03:44:08.047748] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.506 [2024-11-21 03:44:08.048085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-11-21 03:44:08.048254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-11-21 03:44:08.048280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:27.506 [2024-11-21 03:44:08.048296] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:27.506 [2024-11-21 03:44:08.048435] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:27.506 [2024-11-21 03:44:08.048641] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.506 [2024-11-21 03:44:08.048665] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.506 [2024-11-21 03:44:08.048680] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.506 [2024-11-21 03:44:08.051201] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.506 [2024-11-21 03:44:08.060311] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.506 [2024-11-21 03:44:08.060683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-11-21 03:44:08.060851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-11-21 03:44:08.060876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:27.506 [2024-11-21 03:44:08.060892] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:27.506 [2024-11-21 03:44:08.061062] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:27.506 [2024-11-21 03:44:08.061079] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:27:27.506 [2024-11-21 03:44:08.061204] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.506 [2024-11-21 03:44:08.061225] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.506 [2024-11-21 03:44:08.061239] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.506 [2024-11-21 03:44:08.063639] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.506 [2024-11-21 03:44:08.072980] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.506 [2024-11-21 03:44:08.073507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-11-21 03:44:08.073700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-11-21 03:44:08.073729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:27.506 [2024-11-21 03:44:08.073749] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:27.506 [2024-11-21 03:44:08.073921] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:27.506 [2024-11-21 03:44:08.074086] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.506 [2024-11-21 03:44:08.074125] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.506 [2024-11-21 03:44:08.074142] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.506 [2024-11-21 03:44:08.076361] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.506 [2024-11-21 03:44:08.085545] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.506 [2024-11-21 03:44:08.085881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-11-21 03:44:08.086032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-11-21 03:44:08.086061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:27.506 [2024-11-21 03:44:08.086089] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:27.506 [2024-11-21 03:44:08.086275] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:27.506 [2024-11-21 03:44:08.086433] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.506 [2024-11-21 03:44:08.086458] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.506 [2024-11-21 03:44:08.086473] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.506 [2024-11-21 03:44:08.088892] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.506 [2024-11-21 03:44:08.098192] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.506 [2024-11-21 03:44:08.098477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-11-21 03:44:08.098655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-11-21 03:44:08.098684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:27.506 [2024-11-21 03:44:08.098702] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:27.506 [2024-11-21 03:44:08.098886] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:27.506 [2024-11-21 03:44:08.099097] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.506 [2024-11-21 03:44:08.099135] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.506 [2024-11-21 03:44:08.099148] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.506 [2024-11-21 03:44:08.101482] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.506 [2024-11-21 03:44:08.110891] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.506 [2024-11-21 03:44:08.111238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-11-21 03:44:08.111374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.506 [2024-11-21 03:44:08.111400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:27.506 [2024-11-21 03:44:08.111416] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:27.506 [2024-11-21 03:44:08.111577] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:27.506 [2024-11-21 03:44:08.111765] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.507 [2024-11-21 03:44:08.111790] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.507 [2024-11-21 03:44:08.111805] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.507 [2024-11-21 03:44:08.114238] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.507 [2024-11-21 03:44:08.123437] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.507 [2024-11-21 03:44:08.123835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-11-21 03:44:08.123988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-11-21 03:44:08.124017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:27.507 [2024-11-21 03:44:08.124036] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:27.507 [2024-11-21 03:44:08.124255] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:27.507 [2024-11-21 03:44:08.124435] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.507 [2024-11-21 03:44:08.124460] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.507 [2024-11-21 03:44:08.124478] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.507 [2024-11-21 03:44:08.126607] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.507 [2024-11-21 03:44:08.136093] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.507 [2024-11-21 03:44:08.136589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-11-21 03:44:08.136739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.507 [2024-11-21 03:44:08.136768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:27.507 [2024-11-21 03:44:08.136788] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:27.507 [2024-11-21 03:44:08.136961] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:27.507 [2024-11-21 03:44:08.137152] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.507 [2024-11-21 03:44:08.137175] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.507 [2024-11-21 03:44:08.137190] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.507 [2024-11-21 03:44:08.139302] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.769 [2024-11-21 03:44:08.148782] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.769 [2024-11-21 03:44:08.149124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.769 [2024-11-21 03:44:08.149276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.769 [2024-11-21 03:44:08.149302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:27.769 [2024-11-21 03:44:08.149318] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:27.769 [2024-11-21 03:44:08.149468] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:27.769 [2024-11-21 03:44:08.149659] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.769 [2024-11-21 03:44:08.149684] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.769 [2024-11-21 03:44:08.149700] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.769 [2024-11-21 03:44:08.151978] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.769 [2024-11-21 03:44:08.161375] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.769 [2024-11-21 03:44:08.161681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.769 [2024-11-21 03:44:08.161807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.769 [2024-11-21 03:44:08.161836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:27.769 [2024-11-21 03:44:08.161854] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:27.769 [2024-11-21 03:44:08.162059] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:27.769 [2024-11-21 03:44:08.162261] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.769 [2024-11-21 03:44:08.162283] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.769 [2024-11-21 03:44:08.162297] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.769 [2024-11-21 03:44:08.164733] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.769 [2024-11-21 03:44:08.173836] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.769 [2024-11-21 03:44:08.174180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.769 [2024-11-21 03:44:08.174319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.769 [2024-11-21 03:44:08.174361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:27.769 [2024-11-21 03:44:08.174379] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:27.769 [2024-11-21 03:44:08.174545] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:27.769 [2024-11-21 03:44:08.174696] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.769 [2024-11-21 03:44:08.174720] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.769 [2024-11-21 03:44:08.174746] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.769 [2024-11-21 03:44:08.177055] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.769 [2024-11-21 03:44:08.177323] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:27.769 [2024-11-21 03:44:08.177439] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:27.769 [2024-11-21 03:44:08.177456] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:27.769 [2024-11-21 03:44:08.177469] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:27.769 [2024-11-21 03:44:08.177524] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:27:27.769 [2024-11-21 03:44:08.180088] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:27:27.769 [2024-11-21 03:44:08.180100] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:27.769 [2024-11-21 03:44:08.186121] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.769 [2024-11-21 03:44:08.186474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.769 [2024-11-21 03:44:08.186588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.769 [2024-11-21 03:44:08.186615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:27.769 [2024-11-21 03:44:08.186632] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:27.769 [2024-11-21 03:44:08.186739] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:27.769 [2024-11-21 03:44:08.186878] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.769 [2024-11-21 03:44:08.186900] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.769 [2024-11-21 03:44:08.186917] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.769 [2024-11-21 03:44:08.189135] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.769 [2024-11-21 03:44:08.198421] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.769 [2024-11-21 03:44:08.198932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.769 [2024-11-21 03:44:08.199093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.769 [2024-11-21 03:44:08.199128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:27.769 [2024-11-21 03:44:08.199147] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:27.769 [2024-11-21 03:44:08.199303] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:27.769 [2024-11-21 03:44:08.199460] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.769 [2024-11-21 03:44:08.199483] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.769 [2024-11-21 03:44:08.199500] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.769 [2024-11-21 03:44:08.201757] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.769 [2024-11-21 03:44:08.210767] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.769 [2024-11-21 03:44:08.211176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.769 [2024-11-21 03:44:08.211314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.769 [2024-11-21 03:44:08.211359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:27.769 [2024-11-21 03:44:08.211378] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:27.769 [2024-11-21 03:44:08.211553] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:27.769 [2024-11-21 03:44:08.211678] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.769 [2024-11-21 03:44:08.211700] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.769 [2024-11-21 03:44:08.211717] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.769 [2024-11-21 03:44:08.213761] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.769 [2024-11-21 03:44:08.222956] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.769 [2024-11-21 03:44:08.223323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.769 [2024-11-21 03:44:08.223495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.769 [2024-11-21 03:44:08.223521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:27.769 [2024-11-21 03:44:08.223540] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:27.769 [2024-11-21 03:44:08.223699] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:27.769 [2024-11-21 03:44:08.223841] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.769 [2024-11-21 03:44:08.223864] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.769 [2024-11-21 03:44:08.223881] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.769 [2024-11-21 03:44:08.226024] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.769 [2024-11-21 03:44:08.235480] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.769 [2024-11-21 03:44:08.235937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.769 [2024-11-21 03:44:08.236099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.769 [2024-11-21 03:44:08.236126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:27.769 [2024-11-21 03:44:08.236145] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:27.769 [2024-11-21 03:44:08.236318] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:27.769 [2024-11-21 03:44:08.236443] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.769 [2024-11-21 03:44:08.236465] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.769 [2024-11-21 03:44:08.236482] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.769 [2024-11-21 03:44:08.238696] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.769 [2024-11-21 03:44:08.247821] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.769 [2024-11-21 03:44:08.248295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.769 [2024-11-21 03:44:08.248427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.769 [2024-11-21 03:44:08.248453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:27.770 [2024-11-21 03:44:08.248483] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:27.770 [2024-11-21 03:44:08.248642] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:27.770 [2024-11-21 03:44:08.248815] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.770 [2024-11-21 03:44:08.248837] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.770 [2024-11-21 03:44:08.248854] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.770 [2024-11-21 03:44:08.250917] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.770 [2024-11-21 03:44:08.260236] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.770 [2024-11-21 03:44:08.260679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.770 [2024-11-21 03:44:08.260843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.770 [2024-11-21 03:44:08.260870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:27.770 [2024-11-21 03:44:08.260889] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:27.770 [2024-11-21 03:44:08.261032] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:27.770 [2024-11-21 03:44:08.261182] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.770 [2024-11-21 03:44:08.261205] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.770 [2024-11-21 03:44:08.261222] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.770 [2024-11-21 03:44:08.263324] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.770 [2024-11-21 03:44:08.272570] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.770 [2024-11-21 03:44:08.272914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.770 [2024-11-21 03:44:08.273028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.770 [2024-11-21 03:44:08.273054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:27.770 [2024-11-21 03:44:08.273077] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:27.770 [2024-11-21 03:44:08.273229] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:27.770 [2024-11-21 03:44:08.273350] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.770 [2024-11-21 03:44:08.273372] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.770 [2024-11-21 03:44:08.273386] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.770 [2024-11-21 03:44:08.275624] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.770 [2024-11-21 03:44:08.284822] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.770 [2024-11-21 03:44:08.285091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.770 [2024-11-21 03:44:08.285209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.770 [2024-11-21 03:44:08.285235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:27.770 [2024-11-21 03:44:08.285251] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:27.770 [2024-11-21 03:44:08.285411] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:27.770 [2024-11-21 03:44:08.285549] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.770 [2024-11-21 03:44:08.285571] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.770 [2024-11-21 03:44:08.285585] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.770 [2024-11-21 03:44:08.287597] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.770 [2024-11-21 03:44:08.297303] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.770 [2024-11-21 03:44:08.297532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.770 [2024-11-21 03:44:08.297703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.770 [2024-11-21 03:44:08.297729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:27.770 [2024-11-21 03:44:08.297745] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:27.770 [2024-11-21 03:44:08.297926] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:27.770 [2024-11-21 03:44:08.298089] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.770 [2024-11-21 03:44:08.298112] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.770 [2024-11-21 03:44:08.298126] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.770 [2024-11-21 03:44:08.300103] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.770 [2024-11-21 03:44:08.309662] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.770 [2024-11-21 03:44:08.309963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.770 [2024-11-21 03:44:08.310116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.770 [2024-11-21 03:44:08.310143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:27.770 [2024-11-21 03:44:08.310159] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:27.770 [2024-11-21 03:44:08.310277] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:27.770 [2024-11-21 03:44:08.310462] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.770 [2024-11-21 03:44:08.310484] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.770 [2024-11-21 03:44:08.310498] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.770 [2024-11-21 03:44:08.312591] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.770 [2024-11-21 03:44:08.321941] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.770 [2024-11-21 03:44:08.322228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.770 [2024-11-21 03:44:08.322370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.770 [2024-11-21 03:44:08.322396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:27.770 [2024-11-21 03:44:08.322412] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:27.770 [2024-11-21 03:44:08.322577] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:27.770 [2024-11-21 03:44:08.322753] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.770 [2024-11-21 03:44:08.322775] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.770 [2024-11-21 03:44:08.322789] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.770 [2024-11-21 03:44:08.324865] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.770 [2024-11-21 03:44:08.334501] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.770 [2024-11-21 03:44:08.334816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.770 [2024-11-21 03:44:08.334930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.770 [2024-11-21 03:44:08.334956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:27.770 [2024-11-21 03:44:08.334971] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:27.770 [2024-11-21 03:44:08.335147] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:27.770 [2024-11-21 03:44:08.335302] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.770 [2024-11-21 03:44:08.335324] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.770 [2024-11-21 03:44:08.335337] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.770 [2024-11-21 03:44:08.337463] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.770 [2024-11-21 03:44:08.346744] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.770 [2024-11-21 03:44:08.347090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.770 [2024-11-21 03:44:08.347236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.770 [2024-11-21 03:44:08.347261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:27.770 [2024-11-21 03:44:08.347277] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:27.770 [2024-11-21 03:44:08.347425] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:27.770 [2024-11-21 03:44:08.347562] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.770 [2024-11-21 03:44:08.347584] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.770 [2024-11-21 03:44:08.347598] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.770 [2024-11-21 03:44:08.349755] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.770 [2024-11-21 03:44:08.359206] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.770 [2024-11-21 03:44:08.359499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.770 [2024-11-21 03:44:08.359615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.770 [2024-11-21 03:44:08.359642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:27.770 [2024-11-21 03:44:08.359658] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:27.770 [2024-11-21 03:44:08.359791] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:27.770 [2024-11-21 03:44:08.359977] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.771 [2024-11-21 03:44:08.360004] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.771 [2024-11-21 03:44:08.360019] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.771 [2024-11-21 03:44:08.362055] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.771 [2024-11-21 03:44:08.371587] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.771 [2024-11-21 03:44:08.371921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.771 [2024-11-21 03:44:08.372038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.771 [2024-11-21 03:44:08.372064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:27.771 [2024-11-21 03:44:08.372088] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:27.771 [2024-11-21 03:44:08.372255] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:27.771 [2024-11-21 03:44:08.372393] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.771 [2024-11-21 03:44:08.372414] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.771 [2024-11-21 03:44:08.372428] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.771 [2024-11-21 03:44:08.374535] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.771 [2024-11-21 03:44:08.383973] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.771 [2024-11-21 03:44:08.384282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.771 [2024-11-21 03:44:08.384389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.771 [2024-11-21 03:44:08.384415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:27.771 [2024-11-21 03:44:08.384430] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:27.771 [2024-11-21 03:44:08.384579] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:27.771 [2024-11-21 03:44:08.384717] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.771 [2024-11-21 03:44:08.384738] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.771 [2024-11-21 03:44:08.384752] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.771 [2024-11-21 03:44:08.386720] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.771 [2024-11-21 03:44:08.396361] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.771 [2024-11-21 03:44:08.396572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.771 [2024-11-21 03:44:08.396711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.771 [2024-11-21 03:44:08.396737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:27.771 [2024-11-21 03:44:08.396752] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:27.771 [2024-11-21 03:44:08.396901] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:27.771 [2024-11-21 03:44:08.397054] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.771 [2024-11-21 03:44:08.397085] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.771 [2024-11-21 03:44:08.397105] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.771 [2024-11-21 03:44:08.399218] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:27.771 [2024-11-21 03:44:08.408699] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:27.771 [2024-11-21 03:44:08.408981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.771 [2024-11-21 03:44:08.409088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:27.771 [2024-11-21 03:44:08.409115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:27.771 [2024-11-21 03:44:08.409130] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:27.771 [2024-11-21 03:44:08.409279] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:27.771 [2024-11-21 03:44:08.409416] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:27.771 [2024-11-21 03:44:08.409437] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:27.771 [2024-11-21 03:44:08.409451] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:27.771 [2024-11-21 03:44:08.411517] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.033 [2024-11-21 03:44:08.420972] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.033 [2024-11-21 03:44:08.421283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.033 [2024-11-21 03:44:08.421387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.033 [2024-11-21 03:44:08.421413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:28.033 [2024-11-21 03:44:08.421428] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:28.033 [2024-11-21 03:44:08.421561] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:28.033 [2024-11-21 03:44:08.421681] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.033 [2024-11-21 03:44:08.421702] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.033 [2024-11-21 03:44:08.421717] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.033 [2024-11-21 03:44:08.423775] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.033 [2024-11-21 03:44:08.433342] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.033 [2024-11-21 03:44:08.433654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.033 [2024-11-21 03:44:08.433760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.033 [2024-11-21 03:44:08.433786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:28.033 [2024-11-21 03:44:08.433802] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:28.033 [2024-11-21 03:44:08.433934] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:28.033 [2024-11-21 03:44:08.434055] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.033 [2024-11-21 03:44:08.434086] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.033 [2024-11-21 03:44:08.434100] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.033 [2024-11-21 03:44:08.436211] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.033 [2024-11-21 03:44:08.445737] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.033 [2024-11-21 03:44:08.446048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.033 [2024-11-21 03:44:08.446168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.033 [2024-11-21 03:44:08.446195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:28.033 [2024-11-21 03:44:08.446211] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:28.033 [2024-11-21 03:44:08.446376] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:28.033 [2024-11-21 03:44:08.446497] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.033 [2024-11-21 03:44:08.446518] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.034 [2024-11-21 03:44:08.446533] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.034 [2024-11-21 03:44:08.448819] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.034 [2024-11-21 03:44:08.458025] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.034 [2024-11-21 03:44:08.458288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.034 [2024-11-21 03:44:08.458428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.034 [2024-11-21 03:44:08.458453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:28.034 [2024-11-21 03:44:08.458469] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:28.034 [2024-11-21 03:44:08.458650] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:28.034 [2024-11-21 03:44:08.458771] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.034 [2024-11-21 03:44:08.458793] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.034 [2024-11-21 03:44:08.458806] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.034 [2024-11-21 03:44:08.460855] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.034 [2024-11-21 03:44:08.470250] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.034 [2024-11-21 03:44:08.470500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.034 [2024-11-21 03:44:08.470603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.034 [2024-11-21 03:44:08.470630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:28.034 [2024-11-21 03:44:08.470646] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:28.034 [2024-11-21 03:44:08.470811] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:28.034 [2024-11-21 03:44:08.470964] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.034 [2024-11-21 03:44:08.470986] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.034 [2024-11-21 03:44:08.471000] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.034 [2024-11-21 03:44:08.473201] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.034 [2024-11-21 03:44:08.482508] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.034 [2024-11-21 03:44:08.482782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.034 [2024-11-21 03:44:08.482896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.034 [2024-11-21 03:44:08.482921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:28.034 [2024-11-21 03:44:08.482936] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:28.034 [2024-11-21 03:44:08.483127] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:28.034 [2024-11-21 03:44:08.483265] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.034 [2024-11-21 03:44:08.483286] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.034 [2024-11-21 03:44:08.483300] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.034 [2024-11-21 03:44:08.485554] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.034 [2024-11-21 03:44:08.494870] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.034 [2024-11-21 03:44:08.495186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.034 [2024-11-21 03:44:08.495352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.034 [2024-11-21 03:44:08.495377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:28.034 [2024-11-21 03:44:08.495392] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:28.034 [2024-11-21 03:44:08.495557] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:28.034 [2024-11-21 03:44:08.495710] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.034 [2024-11-21 03:44:08.495732] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.034 [2024-11-21 03:44:08.495746] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.034 [2024-11-21 03:44:08.497852] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.034 [2024-11-21 03:44:08.507440] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.034 [2024-11-21 03:44:08.507676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.034 [2024-11-21 03:44:08.507799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.034 [2024-11-21 03:44:08.507825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:28.034 [2024-11-21 03:44:08.507840] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:28.034 [2024-11-21 03:44:08.508004] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:28.034 [2024-11-21 03:44:08.508136] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.034 [2024-11-21 03:44:08.508159] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.034 [2024-11-21 03:44:08.508173] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.034 [2024-11-21 03:44:08.510247] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.034 [2024-11-21 03:44:08.519828] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.034 [2024-11-21 03:44:08.520150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.034 [2024-11-21 03:44:08.520292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.034 [2024-11-21 03:44:08.520318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:28.034 [2024-11-21 03:44:08.520333] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:28.034 [2024-11-21 03:44:08.520466] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:28.034 [2024-11-21 03:44:08.520652] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.034 [2024-11-21 03:44:08.520674] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.034 [2024-11-21 03:44:08.520689] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.034 [2024-11-21 03:44:08.522780] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.034 [2024-11-21 03:44:08.531993] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.034 [2024-11-21 03:44:08.532317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.034 [2024-11-21 03:44:08.532454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.034 [2024-11-21 03:44:08.532479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:28.034 [2024-11-21 03:44:08.532495] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:28.034 [2024-11-21 03:44:08.532660] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:28.034 [2024-11-21 03:44:08.532796] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.034 [2024-11-21 03:44:08.532817] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.034 [2024-11-21 03:44:08.532831] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.034 [2024-11-21 03:44:08.535004] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.034 [2024-11-21 03:44:08.544370] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.035 [2024-11-21 03:44:08.544688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.035 [2024-11-21 03:44:08.544833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.035 [2024-11-21 03:44:08.544858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:28.035 [2024-11-21 03:44:08.544873] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:28.035 [2024-11-21 03:44:08.545038] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:28.035 [2024-11-21 03:44:08.545199] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.035 [2024-11-21 03:44:08.545222] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.035 [2024-11-21 03:44:08.545236] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.035 [2024-11-21 03:44:08.547295] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.035 [2024-11-21 03:44:08.556712] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.035 [2024-11-21 03:44:08.557016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.035 [2024-11-21 03:44:08.557159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.035 [2024-11-21 03:44:08.557192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:28.035 [2024-11-21 03:44:08.557208] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:28.035 [2024-11-21 03:44:08.557309] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:28.035 [2024-11-21 03:44:08.557527] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.035 [2024-11-21 03:44:08.557549] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.035 [2024-11-21 03:44:08.557562] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.035 [2024-11-21 03:44:08.559611] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.035 [2024-11-21 03:44:08.569143] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.035 [2024-11-21 03:44:08.569468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.035 [2024-11-21 03:44:08.569590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.035 [2024-11-21 03:44:08.569616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:28.035 [2024-11-21 03:44:08.569631] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:28.035 [2024-11-21 03:44:08.569796] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:28.035 [2024-11-21 03:44:08.569950] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.035 [2024-11-21 03:44:08.569972] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.035 [2024-11-21 03:44:08.569986] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.035 [2024-11-21 03:44:08.572224] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.035 [2024-11-21 03:44:08.581511] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.035 [2024-11-21 03:44:08.581795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.035 [2024-11-21 03:44:08.581900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.035 [2024-11-21 03:44:08.581925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:28.035 [2024-11-21 03:44:08.581942] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:28.035 [2024-11-21 03:44:08.582082] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:28.035 [2024-11-21 03:44:08.582268] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.035 [2024-11-21 03:44:08.582290] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.035 [2024-11-21 03:44:08.582303] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.035 [2024-11-21 03:44:08.584474] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.035 [2024-11-21 03:44:08.594038] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.035 [2024-11-21 03:44:08.594303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.035 [2024-11-21 03:44:08.594434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.035 [2024-11-21 03:44:08.594459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:28.035 [2024-11-21 03:44:08.594480] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:28.035 [2024-11-21 03:44:08.594613] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:28.035 [2024-11-21 03:44:08.594767] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.035 [2024-11-21 03:44:08.594789] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.035 [2024-11-21 03:44:08.594803] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.035 [2024-11-21 03:44:08.596966] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.035 [2024-11-21 03:44:08.606396] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.035 [2024-11-21 03:44:08.606667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.035 [2024-11-21 03:44:08.606782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.035 [2024-11-21 03:44:08.606808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:28.035 [2024-11-21 03:44:08.606823] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:28.035 [2024-11-21 03:44:08.606956] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:28.035 [2024-11-21 03:44:08.607136] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.035 [2024-11-21 03:44:08.607158] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.035 [2024-11-21 03:44:08.607172] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.035 [2024-11-21 03:44:08.609140] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.035 [2024-11-21 03:44:08.618695] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.035 [2024-11-21 03:44:08.618918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.035 [2024-11-21 03:44:08.619081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.035 [2024-11-21 03:44:08.619108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:28.035 [2024-11-21 03:44:08.619123] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:28.035 [2024-11-21 03:44:08.619272] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:28.035 [2024-11-21 03:44:08.619378] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.035 [2024-11-21 03:44:08.619399] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.035 [2024-11-21 03:44:08.619413] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.035 [2024-11-21 03:44:08.621474] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.035 [2024-11-21 03:44:08.631161] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.035 [2024-11-21 03:44:08.631406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.036 [2024-11-21 03:44:08.631542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.036 [2024-11-21 03:44:08.631567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:28.036 [2024-11-21 03:44:08.631582] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:28.036 [2024-11-21 03:44:08.631800] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:28.036 [2024-11-21 03:44:08.631937] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.036 [2024-11-21 03:44:08.631959] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.036 [2024-11-21 03:44:08.631973] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.036 [2024-11-21 03:44:08.634225] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.036 [2024-11-21 03:44:08.643578] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.036 [2024-11-21 03:44:08.643883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.036 [2024-11-21 03:44:08.643996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.036 [2024-11-21 03:44:08.644022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:28.036 [2024-11-21 03:44:08.644037] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:28.036 [2024-11-21 03:44:08.644211] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:28.036 [2024-11-21 03:44:08.644413] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.036 [2024-11-21 03:44:08.644435] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.036 [2024-11-21 03:44:08.644448] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.036 [2024-11-21 03:44:08.646591] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.036 [2024-11-21 03:44:08.656036] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.036 [2024-11-21 03:44:08.656384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.036 [2024-11-21 03:44:08.656523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.036 [2024-11-21 03:44:08.656548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:28.036 [2024-11-21 03:44:08.656564] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:28.036 [2024-11-21 03:44:08.656713] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:28.036 [2024-11-21 03:44:08.656883] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.036 [2024-11-21 03:44:08.656905] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.036 [2024-11-21 03:44:08.656919] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.036 [2024-11-21 03:44:08.659008] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.036 [2024-11-21 03:44:08.668261] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.036 [2024-11-21 03:44:08.668551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.036 [2024-11-21 03:44:08.668658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.036 [2024-11-21 03:44:08.668685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:28.036 [2024-11-21 03:44:08.668701] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:28.036 [2024-11-21 03:44:08.668866] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:28.036 [2024-11-21 03:44:08.669009] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.036 [2024-11-21 03:44:08.669031] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.036 [2024-11-21 03:44:08.669046] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.036 [2024-11-21 03:44:08.671205] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.296 [2024-11-21 03:44:08.680844] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.296 [2024-11-21 03:44:08.681181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.296 [2024-11-21 03:44:08.681310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.296 [2024-11-21 03:44:08.681336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:28.296 [2024-11-21 03:44:08.681351] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:28.296 [2024-11-21 03:44:08.681500] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:28.296 [2024-11-21 03:44:08.681670] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.296 [2024-11-21 03:44:08.681692] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.296 [2024-11-21 03:44:08.681706] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.296 [2024-11-21 03:44:08.683843] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.296 [2024-11-21 03:44:08.693111] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.296 [2024-11-21 03:44:08.693415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.296 [2024-11-21 03:44:08.693578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.296 [2024-11-21 03:44:08.693603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:28.296 [2024-11-21 03:44:08.693619] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:28.296 [2024-11-21 03:44:08.693785] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:28.296 [2024-11-21 03:44:08.693906] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.296 [2024-11-21 03:44:08.693927] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.296 [2024-11-21 03:44:08.693941] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.296 [2024-11-21 03:44:08.696009] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.296 [2024-11-21 03:44:08.705502] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.296 [2024-11-21 03:44:08.705825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.296 [2024-11-21 03:44:08.705933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.296 [2024-11-21 03:44:08.705959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:28.296 [2024-11-21 03:44:08.705975] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:28.296 [2024-11-21 03:44:08.706150] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:28.296 [2024-11-21 03:44:08.706288] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.296 [2024-11-21 03:44:08.706316] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.296 [2024-11-21 03:44:08.706330] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.296 [2024-11-21 03:44:08.708445] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.296 [2024-11-21 03:44:08.717583] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.296 [2024-11-21 03:44:08.717817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.296 [2024-11-21 03:44:08.717977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.297 [2024-11-21 03:44:08.718003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:28.297 [2024-11-21 03:44:08.718018] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:28.297 [2024-11-21 03:44:08.718144] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:28.297 [2024-11-21 03:44:08.718314] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.297 [2024-11-21 03:44:08.718336] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.297 [2024-11-21 03:44:08.718350] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.297 [2024-11-21 03:44:08.720424] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.297 [2024-11-21 03:44:08.729951] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.297 [2024-11-21 03:44:08.730249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.297 [2024-11-21 03:44:08.730357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.297 [2024-11-21 03:44:08.730383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:28.297 [2024-11-21 03:44:08.730398] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:28.297 [2024-11-21 03:44:08.730530] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:28.297 [2024-11-21 03:44:08.730668] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.297 [2024-11-21 03:44:08.730689] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.297 [2024-11-21 03:44:08.730703] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.297 [2024-11-21 03:44:08.732691] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.297 [2024-11-21 03:44:08.742114] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.297 [2024-11-21 03:44:08.742442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.297 [2024-11-21 03:44:08.742581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.297 [2024-11-21 03:44:08.742607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:28.297 [2024-11-21 03:44:08.742622] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:28.297 [2024-11-21 03:44:08.742786] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:28.297 [2024-11-21 03:44:08.742956] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.297 [2024-11-21 03:44:08.742978] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.297 [2024-11-21 03:44:08.742998] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.297 [2024-11-21 03:44:08.745167] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.297 [2024-11-21 03:44:08.754496] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.297 [2024-11-21 03:44:08.754752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.297 [2024-11-21 03:44:08.754878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.297 [2024-11-21 03:44:08.754904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:28.297 [2024-11-21 03:44:08.754919] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:28.297 [2024-11-21 03:44:08.755052] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:28.297 [2024-11-21 03:44:08.755215] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.297 [2024-11-21 03:44:08.755237] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.297 [2024-11-21 03:44:08.755252] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.297 [2024-11-21 03:44:08.757233] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.297 [2024-11-21 03:44:08.766736] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.297 [2024-11-21 03:44:08.767034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.297 [2024-11-21 03:44:08.767188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.297 [2024-11-21 03:44:08.767214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:28.297 [2024-11-21 03:44:08.767229] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:28.297 [2024-11-21 03:44:08.767379] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:28.297 [2024-11-21 03:44:08.767516] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.297 [2024-11-21 03:44:08.767538] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.297 [2024-11-21 03:44:08.767552] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.297 [2024-11-21 03:44:08.769589] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.297 [2024-11-21 03:44:08.779248] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.297 [2024-11-21 03:44:08.779560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.297 [2024-11-21 03:44:08.779658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.297 [2024-11-21 03:44:08.779684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:28.297 [2024-11-21 03:44:08.779699] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:28.297 [2024-11-21 03:44:08.779831] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:28.297 [2024-11-21 03:44:08.779952] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.297 [2024-11-21 03:44:08.779973] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.297 [2024-11-21 03:44:08.779987] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.297 [2024-11-21 03:44:08.782164] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.297 [2024-11-21 03:44:08.791736] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.297 [2024-11-21 03:44:08.792059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.297 [2024-11-21 03:44:08.792165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.297 [2024-11-21 03:44:08.792191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:28.297 [2024-11-21 03:44:08.792206] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:28.297 [2024-11-21 03:44:08.792371] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:28.297 [2024-11-21 03:44:08.792525] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.297 [2024-11-21 03:44:08.792547] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.297 [2024-11-21 03:44:08.792562] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.297 [2024-11-21 03:44:08.794701] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.297 [2024-11-21 03:44:08.804199] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.297 [2024-11-21 03:44:08.804473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.297 [2024-11-21 03:44:08.804582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.297 [2024-11-21 03:44:08.804608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:28.297 [2024-11-21 03:44:08.804623] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:28.297 [2024-11-21 03:44:08.804772] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:28.298 [2024-11-21 03:44:08.804941] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.298 [2024-11-21 03:44:08.804963] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.298 [2024-11-21 03:44:08.804976] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.298 [2024-11-21 03:44:08.807029] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.298 [2024-11-21 03:44:08.816632] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.298 [2024-11-21 03:44:08.816967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.298 [2024-11-21 03:44:08.817080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.298 [2024-11-21 03:44:08.817107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:28.298 [2024-11-21 03:44:08.817123] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:28.298 [2024-11-21 03:44:08.817273] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:28.298 [2024-11-21 03:44:08.817442] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.298 [2024-11-21 03:44:08.817464] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.298 [2024-11-21 03:44:08.817479] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.298 [2024-11-21 03:44:08.819626] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.298 [2024-11-21 03:44:08.829145] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.298 [2024-11-21 03:44:08.829397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.298 [2024-11-21 03:44:08.829505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.298 [2024-11-21 03:44:08.829530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:28.298 [2024-11-21 03:44:08.829546] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:28.298 [2024-11-21 03:44:08.829678] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:28.298 [2024-11-21 03:44:08.829815] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.298 [2024-11-21 03:44:08.829837] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.298 [2024-11-21 03:44:08.829851] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.298 [2024-11-21 03:44:08.831905] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.298 [2024-11-21 03:44:08.841520] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.298 [2024-11-21 03:44:08.841844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.298 [2024-11-21 03:44:08.842006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.298 [2024-11-21 03:44:08.842032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:28.298 [2024-11-21 03:44:08.842048] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:28.298 [2024-11-21 03:44:08.842220] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:28.298 [2024-11-21 03:44:08.842375] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.298 [2024-11-21 03:44:08.842397] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.298 [2024-11-21 03:44:08.842411] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.298 [2024-11-21 03:44:08.844512] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.298 [2024-11-21 03:44:08.853965] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.298 [2024-11-21 03:44:08.854201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.298 [2024-11-21 03:44:08.854319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.298 [2024-11-21 03:44:08.854344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:28.298 [2024-11-21 03:44:08.854360] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:28.298 [2024-11-21 03:44:08.854493] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:28.298 [2024-11-21 03:44:08.854662] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.298 [2024-11-21 03:44:08.854684] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.298 [2024-11-21 03:44:08.854698] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.298 [2024-11-21 03:44:08.856873] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.298 [2024-11-21 03:44:08.866437] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.298 [2024-11-21 03:44:08.866722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.298 [2024-11-21 03:44:08.866820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.298 [2024-11-21 03:44:08.866845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:28.298 [2024-11-21 03:44:08.866861] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:28.298 [2024-11-21 03:44:08.867042] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:28.298 [2024-11-21 03:44:08.867203] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.298 [2024-11-21 03:44:08.867226] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.298 [2024-11-21 03:44:08.867240] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.298 [2024-11-21 03:44:08.869431] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.298 [2024-11-21 03:44:08.878835] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.298 [2024-11-21 03:44:08.879127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.298 [2024-11-21 03:44:08.879267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.298 [2024-11-21 03:44:08.879293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:28.298 [2024-11-21 03:44:08.879308] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:28.298 [2024-11-21 03:44:08.879458] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:28.298 [2024-11-21 03:44:08.879628] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.298 [2024-11-21 03:44:08.879651] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.298 [2024-11-21 03:44:08.879665] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.298 [2024-11-21 03:44:08.881763] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.298 [2024-11-21 03:44:08.891028] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.298 [2024-11-21 03:44:08.891300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.298 [2024-11-21 03:44:08.891429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.298 [2024-11-21 03:44:08.891455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:28.298 [2024-11-21 03:44:08.891471] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:28.298 [2024-11-21 03:44:08.891636] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:28.298 [2024-11-21 03:44:08.891774] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.298 [2024-11-21 03:44:08.891796] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.298 [2024-11-21 03:44:08.891810] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.298 [2024-11-21 03:44:08.893779] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.298 [2024-11-21 03:44:08.903370] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.298 [2024-11-21 03:44:08.903674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.298 [2024-11-21 03:44:08.903782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.298 [2024-11-21 03:44:08.903813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:28.299 [2024-11-21 03:44:08.903829] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:28.299 [2024-11-21 03:44:08.904026] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:28.299 [2024-11-21 03:44:08.904238] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.299 [2024-11-21 03:44:08.904261] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.299 [2024-11-21 03:44:08.904275] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.299 [2024-11-21 03:44:08.906489] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.299 [2024-11-21 03:44:08.915687] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.299 [2024-11-21 03:44:08.915970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.299 [2024-11-21 03:44:08.916111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.299 [2024-11-21 03:44:08.916137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:28.299 [2024-11-21 03:44:08.916153] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:28.299 [2024-11-21 03:44:08.916302] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:28.299 [2024-11-21 03:44:08.916456] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.299 [2024-11-21 03:44:08.916477] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.299 [2024-11-21 03:44:08.916492] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.299 [2024-11-21 03:44:08.918462] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.299 [2024-11-21 03:44:08.927878] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.299 [2024-11-21 03:44:08.928201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.299 [2024-11-21 03:44:08.928301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.299 [2024-11-21 03:44:08.928327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:28.299 [2024-11-21 03:44:08.928342] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:28.299 [2024-11-21 03:44:08.928491] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:28.299 [2024-11-21 03:44:08.928628] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.299 [2024-11-21 03:44:08.928649] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.299 [2024-11-21 03:44:08.928663] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.299 [2024-11-21 03:44:08.930705] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.299 [2024-11-21 03:44:08.940214] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.299 [2024-11-21 03:44:08.940530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.299 [2024-11-21 03:44:08.940661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.299 [2024-11-21 03:44:08.940686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:28.299 [2024-11-21 03:44:08.940707] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:28.299 [2024-11-21 03:44:08.940823] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:28.299 [2024-11-21 03:44:08.940977] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.299 [2024-11-21 03:44:08.940998] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.299 [2024-11-21 03:44:08.941014] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.560 [2024-11-21 03:44:08.943043] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.560 [2024-11-21 03:44:08.952791] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.560 [2024-11-21 03:44:08.953100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.560 [2024-11-21 03:44:08.953207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.560 [2024-11-21 03:44:08.953233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:28.560 [2024-11-21 03:44:08.953249] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:28.560 [2024-11-21 03:44:08.953430] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:28.560 [2024-11-21 03:44:08.953616] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.560 [2024-11-21 03:44:08.953638] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.560 [2024-11-21 03:44:08.953652] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.560 [2024-11-21 03:44:08.955970] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.560 [2024-11-21 03:44:08.965200] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.560 [2024-11-21 03:44:08.965538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.560 [2024-11-21 03:44:08.965687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.560 [2024-11-21 03:44:08.965713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:28.560 [2024-11-21 03:44:08.965728] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:28.560 [2024-11-21 03:44:08.965861] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:28.560 [2024-11-21 03:44:08.965982] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.560 [2024-11-21 03:44:08.966004] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.560 [2024-11-21 03:44:08.966019] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.560 [2024-11-21 03:44:08.968039] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.560 [2024-11-21 03:44:08.977650] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.560 [2024-11-21 03:44:08.977954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.560 [2024-11-21 03:44:08.978094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.560 [2024-11-21 03:44:08.978124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:28.560 [2024-11-21 03:44:08.978139] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:28.560 [2024-11-21 03:44:08.978326] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:28.560 [2024-11-21 03:44:08.978432] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.560 [2024-11-21 03:44:08.978454] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.560 [2024-11-21 03:44:08.978468] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.560 03:44:08 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:28.560 03:44:08 -- common/autotest_common.sh@862 -- # return 0 00:27:28.560 03:44:08 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:28.560 03:44:08 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:28.560 03:44:08 -- common/autotest_common.sh@10 -- # set +x 00:27:28.560 [2024-11-21 03:44:08.980521] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.560 [2024-11-21 03:44:08.989926] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.560 [2024-11-21 03:44:08.990251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.560 [2024-11-21 03:44:08.990380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.560 [2024-11-21 03:44:08.990406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:28.560 [2024-11-21 03:44:08.990422] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:28.560 [2024-11-21 03:44:08.990603] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:28.560 [2024-11-21 03:44:08.990801] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.560 [2024-11-21 03:44:08.990823] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.560 [2024-11-21 03:44:08.990837] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.560 [2024-11-21 03:44:08.992953] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.560 03:44:08 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:28.560 03:44:08 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:27:28.560 03:44:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:28.560 03:44:09 -- common/autotest_common.sh@10 -- # set +x 00:27:28.560 [2024-11-21 03:44:09.002332] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.560 [2024-11-21 03:44:09.002626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.560 [2024-11-21 03:44:09.002737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.560 [2024-11-21 03:44:09.002762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:28.560 [2024-11-21 03:44:09.002778] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:28.560 [2024-11-21 03:44:09.002927] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:28.560 [2024-11-21 03:44:09.003102] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.561 [2024-11-21 03:44:09.003124] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.561 [2024-11-21 03:44:09.003138] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.561 [2024-11-21 03:44:09.005279] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.561 [2024-11-21 03:44:09.006236] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:28.561 03:44:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:28.561 03:44:09 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:27:28.561 03:44:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:28.561 03:44:09 -- common/autotest_common.sh@10 -- # set +x 00:27:28.561 [2024-11-21 03:44:09.014759] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.561 [2024-11-21 03:44:09.015017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.561 [2024-11-21 03:44:09.015159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.561 [2024-11-21 03:44:09.015186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:28.561 [2024-11-21 03:44:09.015201] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:28.561 [2024-11-21 03:44:09.015367] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:28.561 [2024-11-21 03:44:09.015565] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.561 [2024-11-21 03:44:09.015587] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.561 [2024-11-21 03:44:09.015600] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.561 [2024-11-21 03:44:09.017871] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.561 [2024-11-21 03:44:09.027028] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.561 [2024-11-21 03:44:09.027373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.561 [2024-11-21 03:44:09.027484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.561 [2024-11-21 03:44:09.027509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:28.561 [2024-11-21 03:44:09.027524] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:28.561 [2024-11-21 03:44:09.027689] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:28.561 [2024-11-21 03:44:09.027886] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.561 [2024-11-21 03:44:09.027908] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.561 [2024-11-21 03:44:09.027922] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.561 [2024-11-21 03:44:09.030091] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.561 [2024-11-21 03:44:09.039258] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.561 [2024-11-21 03:44:09.039770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.561 [2024-11-21 03:44:09.039934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.561 [2024-11-21 03:44:09.039960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:28.561 [2024-11-21 03:44:09.039979] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:28.561 [2024-11-21 03:44:09.040162] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:28.561 [2024-11-21 03:44:09.040337] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.561 [2024-11-21 03:44:09.040359] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.561 [2024-11-21 03:44:09.040392] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.561 [2024-11-21 03:44:09.042488] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.561 Malloc0 00:27:28.561 03:44:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:28.561 03:44:09 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:28.561 03:44:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:28.561 03:44:09 -- common/autotest_common.sh@10 -- # set +x 00:27:28.561 [2024-11-21 03:44:09.051649] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.561 [2024-11-21 03:44:09.051926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.561 [2024-11-21 03:44:09.052096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.561 [2024-11-21 03:44:09.052123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:28.561 [2024-11-21 03:44:09.052139] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:28.561 [2024-11-21 03:44:09.052306] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:28.561 [2024-11-21 03:44:09.052472] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.561 [2024-11-21 03:44:09.052494] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.561 [2024-11-21 03:44:09.052507] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.561 03:44:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:28.561 [2024-11-21 03:44:09.054666] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.561 03:44:09 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:27:28.561 03:44:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:28.561 03:44:09 -- common/autotest_common.sh@10 -- # set +x 00:27:28.561 03:44:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:28.561 03:44:09 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:28.561 03:44:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:28.561 03:44:09 -- common/autotest_common.sh@10 -- # set +x 00:27:28.561 [2024-11-21 03:44:09.064101] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.561 [2024-11-21 03:44:09.064333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.561 [2024-11-21 03:44:09.064472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:28.561 [2024-11-21 03:44:09.064497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b3b160 with addr=10.0.0.2, port=4420 00:27:28.561 [2024-11-21 03:44:09.064513] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b3b160 is same with the state(5) to be set 00:27:28.561 [2024-11-21 03:44:09.064679] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b3b160 (9): Bad file descriptor 00:27:28.561 [2024-11-21 03:44:09.064846] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:28.561 [2024-11-21 03:44:09.064867] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:28.561 [2024-11-21 03:44:09.064880] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:28.561 [2024-11-21 03:44:09.066609] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:28.561 [2024-11-21 03:44:09.067024] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:28.561 03:44:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:28.561 03:44:09 -- host/bdevperf.sh@38 -- # wait 3170353 00:27:28.561 [2024-11-21 03:44:09.076483] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:28.561 [2024-11-21 03:44:09.152933] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:27:38.540 00:27:38.540 Latency(us) 00:27:38.540 [2024-11-21T02:44:19.188Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:38.540 [2024-11-21T02:44:19.188Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:27:38.540 Verification LBA range: start 0x0 length 0x4000 00:27:38.540 Nvme1n1 : 15.01 9248.17 36.13 16027.18 0.00 5049.56 752.45 18932.62 00:27:38.540 [2024-11-21T02:44:19.188Z] =================================================================================================================== 00:27:38.540 [2024-11-21T02:44:19.188Z] Total : 9248.17 36.13 16027.18 0.00 5049.56 752.45 18932.62 00:27:38.540 03:44:17 -- host/bdevperf.sh@39 -- # sync 00:27:38.540 03:44:17 -- host/bdevperf.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:27:38.540 03:44:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:38.540 03:44:17 -- common/autotest_common.sh@10 -- # set +x 00:27:38.540 03:44:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:38.540 03:44:17 -- host/bdevperf.sh@42 -- # trap - SIGINT SIGTERM EXIT 00:27:38.540 03:44:17 -- host/bdevperf.sh@44 -- # nvmftestfini 00:27:38.540 03:44:17 -- nvmf/common.sh@476 -- # nvmfcleanup 00:27:38.540 03:44:17 -- nvmf/common.sh@116 -- # sync 00:27:38.540 03:44:17 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:27:38.540 03:44:17 -- nvmf/common.sh@119 -- # set +e 00:27:38.540 03:44:17 -- nvmf/common.sh@120 -- # for i in {1..20} 00:27:38.540 03:44:17 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:27:38.540 rmmod nvme_tcp 00:27:38.540 rmmod nvme_fabrics 00:27:38.540 rmmod nvme_keyring 00:27:38.540 03:44:17 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:27:38.540 03:44:17 -- nvmf/common.sh@123 -- # set -e 00:27:38.540 03:44:17 -- nvmf/common.sh@124 -- # return 0 00:27:38.540 03:44:17 -- nvmf/common.sh@477 -- # '[' -n 3171164 ']' 00:27:38.540 03:44:17 -- nvmf/common.sh@478 -- # killprocess 3171164 00:27:38.540 03:44:17 -- common/autotest_common.sh@936 -- # '[' -z 3171164 ']' 00:27:38.540 03:44:17 -- common/autotest_common.sh@940 -- # kill -0 3171164 00:27:38.540 03:44:17 -- common/autotest_common.sh@941 -- # uname 00:27:38.540 03:44:17 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:38.540 03:44:17 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3171164 00:27:38.540 03:44:17 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:38.540 03:44:17 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:38.540 03:44:17 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3171164' 00:27:38.540 killing process with pid 3171164 00:27:38.540 03:44:17 -- common/autotest_common.sh@955 -- # kill 3171164 00:27:38.540 03:44:17 -- common/autotest_common.sh@960 -- # wait 3171164 00:27:38.540 03:44:18 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:27:38.540 03:44:18 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:27:38.540 03:44:18 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:27:38.540 03:44:18 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:27:38.540 03:44:18 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:27:38.540 03:44:18 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:38.540 03:44:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:38.540 03:44:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:39.916 03:44:20 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:27:39.916 00:27:39.916 real 0m23.478s 00:27:39.916 user 1m3.217s 00:27:39.916 sys 0m4.326s 00:27:39.916 03:44:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:39.916 03:44:20 -- common/autotest_common.sh@10 -- # set +x 00:27:39.916 ************************************ 00:27:39.916 END TEST nvmf_bdevperf 00:27:39.916 ************************************ 00:27:39.916 03:44:20 -- nvmf/nvmf.sh@124 -- # run_test nvmf_target_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:27:39.916 03:44:20 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:27:39.916 03:44:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:39.916 03:44:20 -- common/autotest_common.sh@10 -- # set +x 00:27:39.916 ************************************ 00:27:39.916 START TEST nvmf_target_disconnect 00:27:39.916 ************************************ 00:27:39.916 03:44:20 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:27:39.916 * Looking for test storage... 00:27:39.916 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:27:39.916 03:44:20 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:27:39.916 03:44:20 -- common/autotest_common.sh@1690 -- # lcov --version 00:27:39.916 03:44:20 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:27:39.916 03:44:20 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:27:39.916 03:44:20 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:27:39.916 03:44:20 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:27:39.916 03:44:20 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:27:39.916 03:44:20 -- scripts/common.sh@335 -- # IFS=.-: 00:27:39.916 03:44:20 -- scripts/common.sh@335 -- # read -ra ver1 00:27:39.916 03:44:20 -- scripts/common.sh@336 -- # IFS=.-: 00:27:39.916 03:44:20 -- scripts/common.sh@336 -- # read -ra ver2 00:27:39.916 03:44:20 -- scripts/common.sh@337 -- # local 'op=<' 00:27:39.916 03:44:20 -- scripts/common.sh@339 -- # ver1_l=2 00:27:39.916 03:44:20 -- scripts/common.sh@340 -- # ver2_l=1 00:27:39.916 03:44:20 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:27:39.916 03:44:20 -- scripts/common.sh@343 -- # case "$op" in 00:27:39.916 03:44:20 -- scripts/common.sh@344 -- # : 1 00:27:39.916 03:44:20 -- scripts/common.sh@363 -- # (( v = 0 )) 00:27:39.916 03:44:20 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:27:39.916 03:44:20 -- scripts/common.sh@364 -- # decimal 1 00:27:39.916 03:44:20 -- scripts/common.sh@352 -- # local d=1 00:27:39.916 03:44:20 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:27:39.916 03:44:20 -- scripts/common.sh@354 -- # echo 1 00:27:39.916 03:44:20 -- scripts/common.sh@364 -- # ver1[v]=1 00:27:39.916 03:44:20 -- scripts/common.sh@365 -- # decimal 2 00:27:39.916 03:44:20 -- scripts/common.sh@352 -- # local d=2 00:27:39.916 03:44:20 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:27:39.916 03:44:20 -- scripts/common.sh@354 -- # echo 2 00:27:39.916 03:44:20 -- scripts/common.sh@365 -- # ver2[v]=2 00:27:39.916 03:44:20 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:27:39.916 03:44:20 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:27:39.916 03:44:20 -- scripts/common.sh@367 -- # return 0 00:27:39.916 03:44:20 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:27:39.916 03:44:20 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:27:39.916 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:39.916 --rc genhtml_branch_coverage=1 00:27:39.916 --rc genhtml_function_coverage=1 00:27:39.916 --rc genhtml_legend=1 00:27:39.916 --rc geninfo_all_blocks=1 00:27:39.916 --rc geninfo_unexecuted_blocks=1 00:27:39.916 00:27:39.916 ' 00:27:39.916 03:44:20 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:27:39.916 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:39.916 --rc genhtml_branch_coverage=1 00:27:39.916 --rc genhtml_function_coverage=1 00:27:39.916 --rc genhtml_legend=1 00:27:39.916 --rc geninfo_all_blocks=1 00:27:39.916 --rc geninfo_unexecuted_blocks=1 00:27:39.916 00:27:39.916 ' 00:27:39.916 03:44:20 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:27:39.916 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:39.916 --rc genhtml_branch_coverage=1 00:27:39.916 --rc genhtml_function_coverage=1 00:27:39.916 --rc genhtml_legend=1 00:27:39.916 --rc geninfo_all_blocks=1 00:27:39.916 --rc geninfo_unexecuted_blocks=1 00:27:39.916 00:27:39.916 ' 00:27:39.916 03:44:20 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:27:39.916 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:39.916 --rc genhtml_branch_coverage=1 00:27:39.916 --rc genhtml_function_coverage=1 00:27:39.916 --rc genhtml_legend=1 00:27:39.916 --rc geninfo_all_blocks=1 00:27:39.916 --rc geninfo_unexecuted_blocks=1 00:27:39.916 00:27:39.916 ' 00:27:39.916 03:44:20 -- host/target_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:27:39.916 03:44:20 -- nvmf/common.sh@7 -- # uname -s 00:27:39.916 03:44:20 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:39.916 03:44:20 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:39.916 03:44:20 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:39.916 03:44:20 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:39.916 03:44:20 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:39.916 03:44:20 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:39.916 03:44:20 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:39.916 03:44:20 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:39.916 03:44:20 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:39.916 03:44:20 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:39.916 03:44:20 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:27:39.916 03:44:20 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:27:39.916 03:44:20 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:39.916 03:44:20 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:39.916 03:44:20 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:39.916 03:44:20 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:39.916 03:44:20 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:39.916 03:44:20 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:39.916 03:44:20 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:39.916 03:44:20 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:39.916 03:44:20 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:39.916 03:44:20 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:39.916 03:44:20 -- paths/export.sh@5 -- # export PATH 00:27:39.916 03:44:20 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:39.916 03:44:20 -- nvmf/common.sh@46 -- # : 0 00:27:39.916 03:44:20 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:27:39.916 03:44:20 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:27:39.916 03:44:20 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:27:39.916 03:44:20 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:39.916 03:44:20 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:39.916 03:44:20 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:27:39.916 03:44:20 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:27:39.916 03:44:20 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:27:39.916 03:44:20 -- host/target_disconnect.sh@11 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:27:39.916 03:44:20 -- host/target_disconnect.sh@13 -- # MALLOC_BDEV_SIZE=64 00:27:39.916 03:44:20 -- host/target_disconnect.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:27:39.916 03:44:20 -- host/target_disconnect.sh@77 -- # nvmftestinit 00:27:39.916 03:44:20 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:27:39.916 03:44:20 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:27:39.916 03:44:20 -- nvmf/common.sh@436 -- # prepare_net_devs 00:27:39.916 03:44:20 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:27:39.916 03:44:20 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:27:39.916 03:44:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:39.916 03:44:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:39.916 03:44:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:39.916 03:44:20 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:27:39.916 03:44:20 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:27:39.916 03:44:20 -- nvmf/common.sh@284 -- # xtrace_disable 00:27:39.916 03:44:20 -- common/autotest_common.sh@10 -- # set +x 00:27:41.825 03:44:22 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:27:41.825 03:44:22 -- nvmf/common.sh@290 -- # pci_devs=() 00:27:41.825 03:44:22 -- nvmf/common.sh@290 -- # local -a pci_devs 00:27:41.825 03:44:22 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:27:41.825 03:44:22 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:27:41.825 03:44:22 -- nvmf/common.sh@292 -- # pci_drivers=() 00:27:41.825 03:44:22 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:27:41.825 03:44:22 -- nvmf/common.sh@294 -- # net_devs=() 00:27:41.825 03:44:22 -- nvmf/common.sh@294 -- # local -ga net_devs 00:27:41.825 03:44:22 -- nvmf/common.sh@295 -- # e810=() 00:27:41.825 03:44:22 -- nvmf/common.sh@295 -- # local -ga e810 00:27:41.825 03:44:22 -- nvmf/common.sh@296 -- # x722=() 00:27:41.825 03:44:22 -- nvmf/common.sh@296 -- # local -ga x722 00:27:41.825 03:44:22 -- nvmf/common.sh@297 -- # mlx=() 00:27:41.825 03:44:22 -- nvmf/common.sh@297 -- # local -ga mlx 00:27:41.825 03:44:22 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:27:41.825 03:44:22 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:27:41.825 03:44:22 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:27:41.825 03:44:22 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:27:41.825 03:44:22 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:27:41.825 03:44:22 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:27:41.825 03:44:22 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:27:41.825 03:44:22 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:27:41.825 03:44:22 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:27:41.825 03:44:22 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:27:41.825 03:44:22 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:27:41.825 03:44:22 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:27:41.825 03:44:22 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:27:41.825 03:44:22 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:27:41.825 03:44:22 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:27:41.825 03:44:22 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:27:41.825 03:44:22 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:27:41.825 03:44:22 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:41.825 03:44:22 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:27:41.825 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:27:41.825 03:44:22 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:41.825 03:44:22 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:41.825 03:44:22 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:41.825 03:44:22 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:41.825 03:44:22 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:41.825 03:44:22 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:41.825 03:44:22 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:27:41.825 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:27:41.825 03:44:22 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:41.825 03:44:22 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:41.825 03:44:22 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:41.825 03:44:22 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:41.825 03:44:22 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:41.825 03:44:22 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:27:41.825 03:44:22 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:27:41.825 03:44:22 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:27:41.825 03:44:22 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:41.825 03:44:22 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:41.825 03:44:22 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:41.825 03:44:22 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:41.825 03:44:22 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:27:41.825 Found net devices under 0000:0a:00.0: cvl_0_0 00:27:41.825 03:44:22 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:41.825 03:44:22 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:41.825 03:44:22 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:41.825 03:44:22 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:41.825 03:44:22 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:41.825 03:44:22 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:27:41.825 Found net devices under 0000:0a:00.1: cvl_0_1 00:27:41.825 03:44:22 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:41.825 03:44:22 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:27:41.825 03:44:22 -- nvmf/common.sh@402 -- # is_hw=yes 00:27:41.825 03:44:22 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:27:41.825 03:44:22 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:27:41.825 03:44:22 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:27:41.825 03:44:22 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:27:41.825 03:44:22 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:27:41.825 03:44:22 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:27:41.825 03:44:22 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:27:41.825 03:44:22 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:27:41.825 03:44:22 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:27:41.825 03:44:22 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:27:41.825 03:44:22 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:27:41.825 03:44:22 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:27:41.825 03:44:22 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:27:41.825 03:44:22 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:27:41.825 03:44:22 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:27:41.825 03:44:22 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:27:41.825 03:44:22 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:27:41.825 03:44:22 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:27:41.825 03:44:22 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:27:41.825 03:44:22 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:27:41.825 03:44:22 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:27:41.825 03:44:22 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:27:41.825 03:44:22 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:27:41.825 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:27:41.825 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.359 ms 00:27:41.825 00:27:41.825 --- 10.0.0.2 ping statistics --- 00:27:41.825 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:41.825 rtt min/avg/max/mdev = 0.359/0.359/0.359/0.000 ms 00:27:41.825 03:44:22 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:27:41.825 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:27:41.825 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.095 ms 00:27:41.825 00:27:41.825 --- 10.0.0.1 ping statistics --- 00:27:41.825 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:41.825 rtt min/avg/max/mdev = 0.095/0.095/0.095/0.000 ms 00:27:41.825 03:44:22 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:27:41.825 03:44:22 -- nvmf/common.sh@410 -- # return 0 00:27:41.825 03:44:22 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:27:41.825 03:44:22 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:27:41.825 03:44:22 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:27:41.825 03:44:22 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:27:41.825 03:44:22 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:27:41.825 03:44:22 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:27:41.825 03:44:22 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:27:41.825 03:44:22 -- host/target_disconnect.sh@78 -- # run_test nvmf_target_disconnect_tc1 nvmf_target_disconnect_tc1 00:27:41.825 03:44:22 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:27:41.825 03:44:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:41.825 03:44:22 -- common/autotest_common.sh@10 -- # set +x 00:27:41.825 ************************************ 00:27:41.825 START TEST nvmf_target_disconnect_tc1 00:27:41.825 ************************************ 00:27:41.825 03:44:22 -- common/autotest_common.sh@1114 -- # nvmf_target_disconnect_tc1 00:27:41.825 03:44:22 -- host/target_disconnect.sh@32 -- # set +e 00:27:41.825 03:44:22 -- host/target_disconnect.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:41.825 EAL: No free 2048 kB hugepages reported on node 1 00:27:42.084 [2024-11-21 03:44:22.493136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.084 [2024-11-21 03:44:22.493302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.084 [2024-11-21 03:44:22.493331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1399b40 with addr=10.0.0.2, port=4420 00:27:42.084 [2024-11-21 03:44:22.493365] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:27:42.084 [2024-11-21 03:44:22.493393] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:27:42.084 [2024-11-21 03:44:22.493407] nvme.c: 898:spdk_nvme_probe: *ERROR*: Create probe context failed 00:27:42.084 spdk_nvme_probe() failed for transport address '10.0.0.2' 00:27:42.085 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect: errors occurred 00:27:42.085 Initializing NVMe Controllers 00:27:42.085 03:44:22 -- host/target_disconnect.sh@33 -- # trap - ERR 00:27:42.085 03:44:22 -- host/target_disconnect.sh@33 -- # print_backtrace 00:27:42.085 03:44:22 -- common/autotest_common.sh@1142 -- # [[ hxBET =~ e ]] 00:27:42.085 03:44:22 -- common/autotest_common.sh@1142 -- # return 0 00:27:42.085 03:44:22 -- host/target_disconnect.sh@37 -- # '[' 1 '!=' 1 ']' 00:27:42.085 03:44:22 -- host/target_disconnect.sh@41 -- # set -e 00:27:42.085 00:27:42.085 real 0m0.097s 00:27:42.085 user 0m0.035s 00:27:42.085 sys 0m0.061s 00:27:42.085 03:44:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:42.085 03:44:22 -- common/autotest_common.sh@10 -- # set +x 00:27:42.085 ************************************ 00:27:42.085 END TEST nvmf_target_disconnect_tc1 00:27:42.085 ************************************ 00:27:42.085 03:44:22 -- host/target_disconnect.sh@79 -- # run_test nvmf_target_disconnect_tc2 nvmf_target_disconnect_tc2 00:27:42.085 03:44:22 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:27:42.085 03:44:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:42.085 03:44:22 -- common/autotest_common.sh@10 -- # set +x 00:27:42.085 ************************************ 00:27:42.085 START TEST nvmf_target_disconnect_tc2 00:27:42.085 ************************************ 00:27:42.085 03:44:22 -- common/autotest_common.sh@1114 -- # nvmf_target_disconnect_tc2 00:27:42.085 03:44:22 -- host/target_disconnect.sh@45 -- # disconnect_init 10.0.0.2 00:27:42.085 03:44:22 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:27:42.085 03:44:22 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:42.085 03:44:22 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:42.085 03:44:22 -- common/autotest_common.sh@10 -- # set +x 00:27:42.085 03:44:22 -- nvmf/common.sh@469 -- # nvmfpid=3174358 00:27:42.085 03:44:22 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:27:42.085 03:44:22 -- nvmf/common.sh@470 -- # waitforlisten 3174358 00:27:42.085 03:44:22 -- common/autotest_common.sh@829 -- # '[' -z 3174358 ']' 00:27:42.085 03:44:22 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:42.085 03:44:22 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:42.085 03:44:22 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:42.085 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:42.085 03:44:22 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:42.085 03:44:22 -- common/autotest_common.sh@10 -- # set +x 00:27:42.085 [2024-11-21 03:44:22.577813] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:42.085 [2024-11-21 03:44:22.577890] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:42.085 EAL: No free 2048 kB hugepages reported on node 1 00:27:42.085 [2024-11-21 03:44:22.639624] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:27:42.344 [2024-11-21 03:44:22.743515] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:42.344 [2024-11-21 03:44:22.743670] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:42.344 [2024-11-21 03:44:22.743688] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:42.344 [2024-11-21 03:44:22.743701] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:42.344 [2024-11-21 03:44:22.743894] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:27:42.344 [2024-11-21 03:44:22.743968] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:27:42.344 [2024-11-21 03:44:22.744120] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:27:42.344 [2024-11-21 03:44:22.744108] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:27:42.911 03:44:23 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:42.911 03:44:23 -- common/autotest_common.sh@862 -- # return 0 00:27:42.911 03:44:23 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:42.911 03:44:23 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:42.911 03:44:23 -- common/autotest_common.sh@10 -- # set +x 00:27:42.911 03:44:23 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:42.911 03:44:23 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:27:42.911 03:44:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:42.911 03:44:23 -- common/autotest_common.sh@10 -- # set +x 00:27:43.169 Malloc0 00:27:43.169 03:44:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:43.169 03:44:23 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:27:43.169 03:44:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:43.169 03:44:23 -- common/autotest_common.sh@10 -- # set +x 00:27:43.169 [2024-11-21 03:44:23.582730] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:43.169 03:44:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:43.169 03:44:23 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:43.169 03:44:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:43.169 03:44:23 -- common/autotest_common.sh@10 -- # set +x 00:27:43.169 03:44:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:43.169 03:44:23 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:27:43.169 03:44:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:43.169 03:44:23 -- common/autotest_common.sh@10 -- # set +x 00:27:43.169 03:44:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:43.170 03:44:23 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:43.170 03:44:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:43.170 03:44:23 -- common/autotest_common.sh@10 -- # set +x 00:27:43.170 [2024-11-21 03:44:23.611022] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:43.170 03:44:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:43.170 03:44:23 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:27:43.170 03:44:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:43.170 03:44:23 -- common/autotest_common.sh@10 -- # set +x 00:27:43.170 03:44:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:43.170 03:44:23 -- host/target_disconnect.sh@50 -- # reconnectpid=3174481 00:27:43.170 03:44:23 -- host/target_disconnect.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:43.170 03:44:23 -- host/target_disconnect.sh@52 -- # sleep 2 00:27:43.170 EAL: No free 2048 kB hugepages reported on node 1 00:27:45.086 03:44:25 -- host/target_disconnect.sh@53 -- # kill -9 3174358 00:27:45.086 03:44:25 -- host/target_disconnect.sh@55 -- # sleep 2 00:27:45.086 Read completed with error (sct=0, sc=8) 00:27:45.086 starting I/O failed 00:27:45.086 Read completed with error (sct=0, sc=8) 00:27:45.086 starting I/O failed 00:27:45.086 Read completed with error (sct=0, sc=8) 00:27:45.086 starting I/O failed 00:27:45.086 Read completed with error (sct=0, sc=8) 00:27:45.086 starting I/O failed 00:27:45.086 Read completed with error (sct=0, sc=8) 00:27:45.086 starting I/O failed 00:27:45.086 Read completed with error (sct=0, sc=8) 00:27:45.086 starting I/O failed 00:27:45.086 Read completed with error (sct=0, sc=8) 00:27:45.086 starting I/O failed 00:27:45.086 Read completed with error (sct=0, sc=8) 00:27:45.086 starting I/O failed 00:27:45.086 Write completed with error (sct=0, sc=8) 00:27:45.086 starting I/O failed 00:27:45.086 Read completed with error (sct=0, sc=8) 00:27:45.086 starting I/O failed 00:27:45.086 Write completed with error (sct=0, sc=8) 00:27:45.086 starting I/O failed 00:27:45.086 Read completed with error (sct=0, sc=8) 00:27:45.086 starting I/O failed 00:27:45.086 Write completed with error (sct=0, sc=8) 00:27:45.086 starting I/O failed 00:27:45.086 Write completed with error (sct=0, sc=8) 00:27:45.086 starting I/O failed 00:27:45.086 Read completed with error (sct=0, sc=8) 00:27:45.086 starting I/O failed 00:27:45.086 Read completed with error (sct=0, sc=8) 00:27:45.086 starting I/O failed 00:27:45.086 Read completed with error (sct=0, sc=8) 00:27:45.086 starting I/O failed 00:27:45.086 Read completed with error (sct=0, sc=8) 00:27:45.086 starting I/O failed 00:27:45.086 Read completed with error (sct=0, sc=8) 00:27:45.086 starting I/O failed 00:27:45.086 Read completed with error (sct=0, sc=8) 00:27:45.086 starting I/O failed 00:27:45.086 Write completed with error (sct=0, sc=8) 00:27:45.086 starting I/O failed 00:27:45.086 Read completed with error (sct=0, sc=8) 00:27:45.086 starting I/O failed 00:27:45.086 Read completed with error (sct=0, sc=8) 00:27:45.086 starting I/O failed 00:27:45.086 Read completed with error (sct=0, sc=8) 00:27:45.086 starting I/O failed 00:27:45.086 Write completed with error (sct=0, sc=8) 00:27:45.086 starting I/O failed 00:27:45.086 Write completed with error (sct=0, sc=8) 00:27:45.086 starting I/O failed 00:27:45.086 Read completed with error (sct=0, sc=8) 00:27:45.086 starting I/O failed 00:27:45.086 Write completed with error (sct=0, sc=8) 00:27:45.086 starting I/O failed 00:27:45.086 Read completed with error (sct=0, sc=8) 00:27:45.086 starting I/O failed 00:27:45.086 Read completed with error (sct=0, sc=8) 00:27:45.086 starting I/O failed 00:27:45.086 Write completed with error (sct=0, sc=8) 00:27:45.086 starting I/O failed 00:27:45.086 Read completed with error (sct=0, sc=8) 00:27:45.086 starting I/O failed 00:27:45.086 Read completed with error (sct=0, sc=8) 00:27:45.086 starting I/O failed 00:27:45.086 Read completed with error (sct=0, sc=8) 00:27:45.086 starting I/O failed 00:27:45.086 Read completed with error (sct=0, sc=8) 00:27:45.086 starting I/O failed 00:27:45.086 Read completed with error (sct=0, sc=8) 00:27:45.086 starting I/O failed 00:27:45.086 [2024-11-21 03:44:25.635469] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:45.086 Read completed with error (sct=0, sc=8) 00:27:45.086 starting I/O failed 00:27:45.086 Read completed with error (sct=0, sc=8) 00:27:45.086 starting I/O failed 00:27:45.086 Write completed with error (sct=0, sc=8) 00:27:45.086 starting I/O failed 00:27:45.086 Write completed with error (sct=0, sc=8) 00:27:45.086 starting I/O failed 00:27:45.086 Write completed with error (sct=0, sc=8) 00:27:45.086 starting I/O failed 00:27:45.086 Read completed with error (sct=0, sc=8) 00:27:45.086 starting I/O failed 00:27:45.086 Write completed with error (sct=0, sc=8) 00:27:45.086 starting I/O failed 00:27:45.086 Read completed with error (sct=0, sc=8) 00:27:45.086 starting I/O failed 00:27:45.086 Read completed with error (sct=0, sc=8) 00:27:45.086 starting I/O failed 00:27:45.086 Read completed with error (sct=0, sc=8) 00:27:45.086 starting I/O failed 00:27:45.086 Write completed with error (sct=0, sc=8) 00:27:45.086 starting I/O failed 00:27:45.086 Read completed with error (sct=0, sc=8) 00:27:45.086 starting I/O failed 00:27:45.086 Read completed with error (sct=0, sc=8) 00:27:45.086 starting I/O failed 00:27:45.086 Write completed with error (sct=0, sc=8) 00:27:45.086 starting I/O failed 00:27:45.086 Write completed with error (sct=0, sc=8) 00:27:45.086 starting I/O failed 00:27:45.086 Read completed with error (sct=0, sc=8) 00:27:45.086 starting I/O failed 00:27:45.086 Write completed with error (sct=0, sc=8) 00:27:45.086 starting I/O failed 00:27:45.086 Write completed with error (sct=0, sc=8) 00:27:45.086 starting I/O failed 00:27:45.086 Write completed with error (sct=0, sc=8) 00:27:45.086 starting I/O failed 00:27:45.086 Read completed with error (sct=0, sc=8) 00:27:45.086 starting I/O failed 00:27:45.086 Write completed with error (sct=0, sc=8) 00:27:45.086 starting I/O failed 00:27:45.086 Write completed with error (sct=0, sc=8) 00:27:45.086 starting I/O failed 00:27:45.086 Read completed with error (sct=0, sc=8) 00:27:45.086 starting I/O failed 00:27:45.086 Read completed with error (sct=0, sc=8) 00:27:45.086 starting I/O failed 00:27:45.086 Read completed with error (sct=0, sc=8) 00:27:45.086 starting I/O failed 00:27:45.086 Write completed with error (sct=0, sc=8) 00:27:45.086 starting I/O failed 00:27:45.086 Read completed with error (sct=0, sc=8) 00:27:45.086 starting I/O failed 00:27:45.086 Write completed with error (sct=0, sc=8) 00:27:45.086 starting I/O failed 00:27:45.086 [2024-11-21 03:44:25.635788] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:45.086 Read completed with error (sct=0, sc=8) 00:27:45.086 starting I/O failed 00:27:45.086 Read completed with error (sct=0, sc=8) 00:27:45.086 starting I/O failed 00:27:45.086 Read completed with error (sct=0, sc=8) 00:27:45.086 starting I/O failed 00:27:45.086 Read completed with error (sct=0, sc=8) 00:27:45.086 starting I/O failed 00:27:45.086 Read completed with error (sct=0, sc=8) 00:27:45.086 starting I/O failed 00:27:45.086 Read completed with error (sct=0, sc=8) 00:27:45.086 starting I/O failed 00:27:45.086 Read completed with error (sct=0, sc=8) 00:27:45.086 starting I/O failed 00:27:45.086 Read completed with error (sct=0, sc=8) 00:27:45.086 starting I/O failed 00:27:45.086 Read completed with error (sct=0, sc=8) 00:27:45.086 starting I/O failed 00:27:45.086 Read completed with error (sct=0, sc=8) 00:27:45.086 starting I/O failed 00:27:45.086 Write completed with error (sct=0, sc=8) 00:27:45.086 starting I/O failed 00:27:45.086 Write completed with error (sct=0, sc=8) 00:27:45.086 starting I/O failed 00:27:45.086 Write completed with error (sct=0, sc=8) 00:27:45.086 starting I/O failed 00:27:45.086 Read completed with error (sct=0, sc=8) 00:27:45.086 starting I/O failed 00:27:45.086 Read completed with error (sct=0, sc=8) 00:27:45.086 starting I/O failed 00:27:45.086 Read completed with error (sct=0, sc=8) 00:27:45.086 starting I/O failed 00:27:45.086 Read completed with error (sct=0, sc=8) 00:27:45.087 starting I/O failed 00:27:45.087 Read completed with error (sct=0, sc=8) 00:27:45.087 starting I/O failed 00:27:45.087 Write completed with error (sct=0, sc=8) 00:27:45.087 starting I/O failed 00:27:45.087 Read completed with error (sct=0, sc=8) 00:27:45.087 starting I/O failed 00:27:45.087 Read completed with error (sct=0, sc=8) 00:27:45.087 starting I/O failed 00:27:45.087 Write completed with error (sct=0, sc=8) 00:27:45.087 starting I/O failed 00:27:45.087 Read completed with error (sct=0, sc=8) 00:27:45.087 starting I/O failed 00:27:45.087 Write completed with error (sct=0, sc=8) 00:27:45.087 starting I/O failed 00:27:45.087 Write completed with error (sct=0, sc=8) 00:27:45.087 starting I/O failed 00:27:45.087 Write completed with error (sct=0, sc=8) 00:27:45.087 starting I/O failed 00:27:45.087 Read completed with error (sct=0, sc=8) 00:27:45.087 starting I/O failed 00:27:45.087 Write completed with error (sct=0, sc=8) 00:27:45.087 starting I/O failed 00:27:45.087 Read completed with error (sct=0, sc=8) 00:27:45.087 starting I/O failed 00:27:45.087 Read completed with error (sct=0, sc=8) 00:27:45.087 starting I/O failed 00:27:45.087 Write completed with error (sct=0, sc=8) 00:27:45.087 starting I/O failed 00:27:45.087 Read completed with error (sct=0, sc=8) 00:27:45.087 starting I/O failed 00:27:45.087 [2024-11-21 03:44:25.636122] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:45.087 [2024-11-21 03:44:25.636289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.087 [2024-11-21 03:44:25.636474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.087 [2024-11-21 03:44:25.636502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:45.087 qpair failed and we were unable to recover it. 00:27:45.087 [2024-11-21 03:44:25.636600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.087 [2024-11-21 03:44:25.636733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.087 [2024-11-21 03:44:25.636760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:45.087 qpair failed and we were unable to recover it. 00:27:45.087 [2024-11-21 03:44:25.636860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.087 [2024-11-21 03:44:25.637003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.087 [2024-11-21 03:44:25.637028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:45.087 qpair failed and we were unable to recover it. 00:27:45.087 [2024-11-21 03:44:25.637144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.087 [2024-11-21 03:44:25.637237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.087 [2024-11-21 03:44:25.637263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:45.087 qpair failed and we were unable to recover it. 00:27:45.087 [2024-11-21 03:44:25.637408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.087 [2024-11-21 03:44:25.637574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.087 [2024-11-21 03:44:25.637599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:45.087 qpair failed and we were unable to recover it. 00:27:45.087 [2024-11-21 03:44:25.637731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.087 [2024-11-21 03:44:25.637864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.087 [2024-11-21 03:44:25.637889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:45.087 qpair failed and we were unable to recover it. 00:27:45.087 [2024-11-21 03:44:25.638104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.087 [2024-11-21 03:44:25.638205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.087 [2024-11-21 03:44:25.638231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:45.087 qpair failed and we were unable to recover it. 00:27:45.087 [2024-11-21 03:44:25.638377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.087 [2024-11-21 03:44:25.638553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.087 [2024-11-21 03:44:25.638578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:45.087 qpair failed and we were unable to recover it. 00:27:45.087 [2024-11-21 03:44:25.638709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.087 [2024-11-21 03:44:25.638873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.087 [2024-11-21 03:44:25.638898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:45.087 qpair failed and we were unable to recover it. 00:27:45.087 [2024-11-21 03:44:25.639034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.087 [2024-11-21 03:44:25.639157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.087 [2024-11-21 03:44:25.639184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:45.087 qpair failed and we were unable to recover it. 00:27:45.087 [2024-11-21 03:44:25.639290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.087 [2024-11-21 03:44:25.639503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.087 [2024-11-21 03:44:25.639546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:45.087 qpair failed and we were unable to recover it. 00:27:45.087 [2024-11-21 03:44:25.639701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.087 [2024-11-21 03:44:25.639880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.087 [2024-11-21 03:44:25.639907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:45.087 qpair failed and we were unable to recover it. 00:27:45.087 [2024-11-21 03:44:25.640039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.087 [2024-11-21 03:44:25.640197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.087 [2024-11-21 03:44:25.640223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:45.087 qpair failed and we were unable to recover it. 00:27:45.087 [2024-11-21 03:44:25.640333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.087 [2024-11-21 03:44:25.640478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.087 [2024-11-21 03:44:25.640525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:45.087 qpair failed and we were unable to recover it. 00:27:45.087 [2024-11-21 03:44:25.640682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.087 [2024-11-21 03:44:25.640816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.087 [2024-11-21 03:44:25.640842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:45.087 qpair failed and we were unable to recover it. 00:27:45.087 [2024-11-21 03:44:25.640976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.087 [2024-11-21 03:44:25.641149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.087 [2024-11-21 03:44:25.641176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:45.087 qpair failed and we were unable to recover it. 00:27:45.087 [2024-11-21 03:44:25.641304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.087 [2024-11-21 03:44:25.641435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.087 [2024-11-21 03:44:25.641460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:45.087 qpair failed and we were unable to recover it. 00:27:45.087 [2024-11-21 03:44:25.641683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.087 [2024-11-21 03:44:25.641997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.087 [2024-11-21 03:44:25.642037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:45.087 qpair failed and we were unable to recover it. 00:27:45.087 [2024-11-21 03:44:25.642159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.087 [2024-11-21 03:44:25.642288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.087 [2024-11-21 03:44:25.642315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:45.087 qpair failed and we were unable to recover it. 00:27:45.087 [2024-11-21 03:44:25.642434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.087 [2024-11-21 03:44:25.642593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.087 [2024-11-21 03:44:25.642619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:45.087 qpair failed and we were unable to recover it. 00:27:45.087 [2024-11-21 03:44:25.642751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.087 [2024-11-21 03:44:25.642854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.087 [2024-11-21 03:44:25.642881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:45.087 qpair failed and we were unable to recover it. 00:27:45.087 [2024-11-21 03:44:25.642994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.087 [2024-11-21 03:44:25.643120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.087 [2024-11-21 03:44:25.643147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:45.087 qpair failed and we were unable to recover it. 00:27:45.088 [2024-11-21 03:44:25.643279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.088 [2024-11-21 03:44:25.643444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.088 [2024-11-21 03:44:25.643470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:45.088 qpair failed and we were unable to recover it. 00:27:45.088 [2024-11-21 03:44:25.643626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.088 [2024-11-21 03:44:25.643781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.088 [2024-11-21 03:44:25.643806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:45.088 qpair failed and we were unable to recover it. 00:27:45.088 [2024-11-21 03:44:25.643953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.088 [2024-11-21 03:44:25.644113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.088 [2024-11-21 03:44:25.644139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:45.088 qpair failed and we were unable to recover it. 00:27:45.088 [2024-11-21 03:44:25.644246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.088 [2024-11-21 03:44:25.644347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.088 [2024-11-21 03:44:25.644373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:45.088 qpair failed and we were unable to recover it. 00:27:45.088 [2024-11-21 03:44:25.644507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.088 [2024-11-21 03:44:25.644609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.088 [2024-11-21 03:44:25.644635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:45.088 qpair failed and we were unable to recover it. 00:27:45.088 [2024-11-21 03:44:25.644765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.088 [2024-11-21 03:44:25.644877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.088 [2024-11-21 03:44:25.644903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:45.088 qpair failed and we were unable to recover it. 00:27:45.088 [2024-11-21 03:44:25.645034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.088 [2024-11-21 03:44:25.645173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.088 [2024-11-21 03:44:25.645199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:45.088 qpair failed and we were unable to recover it. 00:27:45.088 [2024-11-21 03:44:25.645301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.088 [2024-11-21 03:44:25.645466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.088 [2024-11-21 03:44:25.645492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:45.088 qpair failed and we were unable to recover it. 00:27:45.088 [2024-11-21 03:44:25.645657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.088 [2024-11-21 03:44:25.645758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.088 [2024-11-21 03:44:25.645785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:45.088 qpair failed and we were unable to recover it. 00:27:45.088 [2024-11-21 03:44:25.645917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.088 [2024-11-21 03:44:25.646052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.088 [2024-11-21 03:44:25.646087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:45.088 qpair failed and we were unable to recover it. 00:27:45.088 [2024-11-21 03:44:25.646188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.088 [2024-11-21 03:44:25.646299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.088 [2024-11-21 03:44:25.646324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:45.088 qpair failed and we were unable to recover it. 00:27:45.088 [2024-11-21 03:44:25.646483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.088 [2024-11-21 03:44:25.646618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.088 [2024-11-21 03:44:25.646643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:45.088 qpair failed and we were unable to recover it. 00:27:45.088 [2024-11-21 03:44:25.646751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.088 [2024-11-21 03:44:25.646880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.088 [2024-11-21 03:44:25.646905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:45.088 qpair failed and we were unable to recover it. 00:27:45.088 [2024-11-21 03:44:25.647080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.088 [2024-11-21 03:44:25.647194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.088 [2024-11-21 03:44:25.647223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.088 qpair failed and we were unable to recover it. 00:27:45.088 [2024-11-21 03:44:25.647328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.088 [2024-11-21 03:44:25.647477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.088 [2024-11-21 03:44:25.647503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.088 qpair failed and we were unable to recover it. 00:27:45.088 [2024-11-21 03:44:25.647604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.088 [2024-11-21 03:44:25.647741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.088 [2024-11-21 03:44:25.647767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.088 qpair failed and we were unable to recover it. 00:27:45.088 [2024-11-21 03:44:25.647897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.088 [2024-11-21 03:44:25.648026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.088 [2024-11-21 03:44:25.648051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.088 qpair failed and we were unable to recover it. 00:27:45.088 [2024-11-21 03:44:25.648167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.088 [2024-11-21 03:44:25.648264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.088 [2024-11-21 03:44:25.648289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.088 qpair failed and we were unable to recover it. 00:27:45.088 [2024-11-21 03:44:25.648416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.088 [2024-11-21 03:44:25.648535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.088 [2024-11-21 03:44:25.648569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.088 qpair failed and we were unable to recover it. 00:27:45.088 [2024-11-21 03:44:25.648725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.088 [2024-11-21 03:44:25.648866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.088 [2024-11-21 03:44:25.648891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.088 qpair failed and we were unable to recover it. 00:27:45.088 [2024-11-21 03:44:25.649027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.088 [2024-11-21 03:44:25.649199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.088 [2024-11-21 03:44:25.649225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.088 qpair failed and we were unable to recover it. 00:27:45.088 [2024-11-21 03:44:25.649322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.088 [2024-11-21 03:44:25.649468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.088 [2024-11-21 03:44:25.649494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.088 qpair failed and we were unable to recover it. 00:27:45.088 [2024-11-21 03:44:25.649629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.088 [2024-11-21 03:44:25.649748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.088 [2024-11-21 03:44:25.649776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.088 qpair failed and we were unable to recover it. 00:27:45.088 [2024-11-21 03:44:25.649905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.088 [2024-11-21 03:44:25.650035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.088 [2024-11-21 03:44:25.650067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.088 qpair failed and we were unable to recover it. 00:27:45.088 [2024-11-21 03:44:25.650210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.088 [2024-11-21 03:44:25.650323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.088 [2024-11-21 03:44:25.650349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.088 qpair failed and we were unable to recover it. 00:27:45.088 [2024-11-21 03:44:25.650486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.088 [2024-11-21 03:44:25.650609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.088 [2024-11-21 03:44:25.650643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.088 qpair failed and we were unable to recover it. 00:27:45.088 [2024-11-21 03:44:25.650779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.088 [2024-11-21 03:44:25.650971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.088 [2024-11-21 03:44:25.650996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.088 qpair failed and we were unable to recover it. 00:27:45.088 [2024-11-21 03:44:25.651123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.088 [2024-11-21 03:44:25.651230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.089 [2024-11-21 03:44:25.651255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.089 qpair failed and we were unable to recover it. 00:27:45.089 [2024-11-21 03:44:25.651361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.089 [2024-11-21 03:44:25.651512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.089 [2024-11-21 03:44:25.651537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.089 qpair failed and we were unable to recover it. 00:27:45.089 [2024-11-21 03:44:25.651665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.089 [2024-11-21 03:44:25.651818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.089 [2024-11-21 03:44:25.651843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.089 qpair failed and we were unable to recover it. 00:27:45.089 [2024-11-21 03:44:25.651966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.089 [2024-11-21 03:44:25.652092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.089 [2024-11-21 03:44:25.652119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.089 qpair failed and we were unable to recover it. 00:27:45.089 [2024-11-21 03:44:25.652249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.089 [2024-11-21 03:44:25.652413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.089 [2024-11-21 03:44:25.652438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.089 qpair failed and we were unable to recover it. 00:27:45.089 [2024-11-21 03:44:25.652578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.089 [2024-11-21 03:44:25.652711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.089 [2024-11-21 03:44:25.652736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.089 qpair failed and we were unable to recover it. 00:27:45.089 [2024-11-21 03:44:25.652833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.089 [2024-11-21 03:44:25.652965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.089 [2024-11-21 03:44:25.652990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.089 qpair failed and we were unable to recover it. 00:27:45.089 [2024-11-21 03:44:25.653122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.089 [2024-11-21 03:44:25.653223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.089 [2024-11-21 03:44:25.653248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.089 qpair failed and we were unable to recover it. 00:27:45.089 [2024-11-21 03:44:25.653357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.089 [2024-11-21 03:44:25.653486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.089 [2024-11-21 03:44:25.653511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.089 qpair failed and we were unable to recover it. 00:27:45.089 [2024-11-21 03:44:25.653672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.089 [2024-11-21 03:44:25.653837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.089 [2024-11-21 03:44:25.653862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.089 qpair failed and we were unable to recover it. 00:27:45.089 [2024-11-21 03:44:25.653956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.089 [2024-11-21 03:44:25.654057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.089 [2024-11-21 03:44:25.654089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.089 qpair failed and we were unable to recover it. 00:27:45.089 [2024-11-21 03:44:25.654220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.089 [2024-11-21 03:44:25.654316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.089 [2024-11-21 03:44:25.654342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.089 qpair failed and we were unable to recover it. 00:27:45.089 [2024-11-21 03:44:25.654436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.089 [2024-11-21 03:44:25.654561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.089 [2024-11-21 03:44:25.654586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.089 qpair failed and we were unable to recover it. 00:27:45.089 [2024-11-21 03:44:25.654739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.089 [2024-11-21 03:44:25.654895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.089 [2024-11-21 03:44:25.654920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.089 qpair failed and we were unable to recover it. 00:27:45.089 [2024-11-21 03:44:25.655088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.089 [2024-11-21 03:44:25.655222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.089 [2024-11-21 03:44:25.655247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.089 qpair failed and we were unable to recover it. 00:27:45.089 [2024-11-21 03:44:25.655377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.089 [2024-11-21 03:44:25.655470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.089 [2024-11-21 03:44:25.655495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.089 qpair failed and we were unable to recover it. 00:27:45.089 [2024-11-21 03:44:25.655625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.089 [2024-11-21 03:44:25.655749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.089 [2024-11-21 03:44:25.655774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.089 qpair failed and we were unable to recover it. 00:27:45.089 [2024-11-21 03:44:25.655874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.089 [2024-11-21 03:44:25.655992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.089 [2024-11-21 03:44:25.656018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.089 qpair failed and we were unable to recover it. 00:27:45.089 [2024-11-21 03:44:25.656176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.089 [2024-11-21 03:44:25.656287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.089 [2024-11-21 03:44:25.656314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.089 qpair failed and we were unable to recover it. 00:27:45.089 [2024-11-21 03:44:25.656455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.089 [2024-11-21 03:44:25.656581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.089 [2024-11-21 03:44:25.656607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.089 qpair failed and we were unable to recover it. 00:27:45.089 [2024-11-21 03:44:25.656740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.089 [2024-11-21 03:44:25.656836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.089 [2024-11-21 03:44:25.656861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.089 qpair failed and we were unable to recover it. 00:27:45.089 [2024-11-21 03:44:25.656958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.089 [2024-11-21 03:44:25.657113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.089 [2024-11-21 03:44:25.657139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.089 qpair failed and we were unable to recover it. 00:27:45.089 [2024-11-21 03:44:25.657291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.089 [2024-11-21 03:44:25.657422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.089 [2024-11-21 03:44:25.657447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.089 qpair failed and we were unable to recover it. 00:27:45.089 [2024-11-21 03:44:25.657551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.089 [2024-11-21 03:44:25.657705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.089 [2024-11-21 03:44:25.657730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.089 qpair failed and we were unable to recover it. 00:27:45.089 [2024-11-21 03:44:25.657836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.089 [2024-11-21 03:44:25.657928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.089 [2024-11-21 03:44:25.657952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.089 qpair failed and we were unable to recover it. 00:27:45.089 [2024-11-21 03:44:25.658108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.089 [2024-11-21 03:44:25.658201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.089 [2024-11-21 03:44:25.658226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.089 qpair failed and we were unable to recover it. 00:27:45.089 [2024-11-21 03:44:25.658351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.089 [2024-11-21 03:44:25.658448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.089 [2024-11-21 03:44:25.658473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.089 qpair failed and we were unable to recover it. 00:27:45.089 [2024-11-21 03:44:25.658569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.089 [2024-11-21 03:44:25.658700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.089 [2024-11-21 03:44:25.658726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.089 qpair failed and we were unable to recover it. 00:27:45.089 [2024-11-21 03:44:25.658856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.089 [2024-11-21 03:44:25.659010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.089 [2024-11-21 03:44:25.659036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.089 qpair failed and we were unable to recover it. 00:27:45.090 [2024-11-21 03:44:25.659173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.090 [2024-11-21 03:44:25.659279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.090 [2024-11-21 03:44:25.659304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.090 qpair failed and we were unable to recover it. 00:27:45.090 [2024-11-21 03:44:25.659410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.090 [2024-11-21 03:44:25.659513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.090 [2024-11-21 03:44:25.659540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.090 qpair failed and we were unable to recover it. 00:27:45.090 [2024-11-21 03:44:25.659639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.090 [2024-11-21 03:44:25.659771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.090 [2024-11-21 03:44:25.659796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.090 qpair failed and we were unable to recover it. 00:27:45.090 [2024-11-21 03:44:25.659920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.090 [2024-11-21 03:44:25.660049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.090 [2024-11-21 03:44:25.660082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.090 qpair failed and we were unable to recover it. 00:27:45.090 [2024-11-21 03:44:25.660215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.090 [2024-11-21 03:44:25.660336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.090 [2024-11-21 03:44:25.660361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.090 qpair failed and we were unable to recover it. 00:27:45.090 [2024-11-21 03:44:25.660464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.090 [2024-11-21 03:44:25.660591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.090 [2024-11-21 03:44:25.660618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.090 qpair failed and we were unable to recover it. 00:27:45.090 [2024-11-21 03:44:25.660747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.090 [2024-11-21 03:44:25.660844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.090 [2024-11-21 03:44:25.660869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.090 qpair failed and we were unable to recover it. 00:27:45.090 [2024-11-21 03:44:25.660968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.090 [2024-11-21 03:44:25.661110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.090 [2024-11-21 03:44:25.661136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.090 qpair failed and we were unable to recover it. 00:27:45.090 [2024-11-21 03:44:25.661291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.090 [2024-11-21 03:44:25.661388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.090 [2024-11-21 03:44:25.661414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.090 qpair failed and we were unable to recover it. 00:27:45.090 [2024-11-21 03:44:25.661520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.090 [2024-11-21 03:44:25.661650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.090 [2024-11-21 03:44:25.661675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.090 qpair failed and we were unable to recover it. 00:27:45.090 [2024-11-21 03:44:25.661842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.090 [2024-11-21 03:44:25.661988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.090 [2024-11-21 03:44:25.662013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.090 qpair failed and we were unable to recover it. 00:27:45.090 [2024-11-21 03:44:25.662170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.090 [2024-11-21 03:44:25.662327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.090 [2024-11-21 03:44:25.662352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.090 qpair failed and we were unable to recover it. 00:27:45.090 [2024-11-21 03:44:25.662475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.090 [2024-11-21 03:44:25.662611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.090 [2024-11-21 03:44:25.662651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.090 qpair failed and we were unable to recover it. 00:27:45.090 [2024-11-21 03:44:25.662760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.090 [2024-11-21 03:44:25.662889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.090 [2024-11-21 03:44:25.662914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.090 qpair failed and we were unable to recover it. 00:27:45.090 [2024-11-21 03:44:25.663085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.090 [2024-11-21 03:44:25.663241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.090 [2024-11-21 03:44:25.663267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.090 qpair failed and we were unable to recover it. 00:27:45.090 [2024-11-21 03:44:25.663378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.090 [2024-11-21 03:44:25.663506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.090 [2024-11-21 03:44:25.663531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.090 qpair failed and we were unable to recover it. 00:27:45.090 [2024-11-21 03:44:25.663688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.090 [2024-11-21 03:44:25.663784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.090 [2024-11-21 03:44:25.663809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.090 qpair failed and we were unable to recover it. 00:27:45.090 [2024-11-21 03:44:25.663936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.090 [2024-11-21 03:44:25.664035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.090 [2024-11-21 03:44:25.664060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.090 qpair failed and we were unable to recover it. 00:27:45.090 [2024-11-21 03:44:25.664221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.090 [2024-11-21 03:44:25.664380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.090 [2024-11-21 03:44:25.664405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.090 qpair failed and we were unable to recover it. 00:27:45.090 [2024-11-21 03:44:25.664494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.090 [2024-11-21 03:44:25.664620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.090 [2024-11-21 03:44:25.664645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.090 qpair failed and we were unable to recover it. 00:27:45.090 [2024-11-21 03:44:25.664773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.090 [2024-11-21 03:44:25.664899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.090 [2024-11-21 03:44:25.664928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.090 qpair failed and we were unable to recover it. 00:27:45.090 [2024-11-21 03:44:25.665037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.090 [2024-11-21 03:44:25.665200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.090 [2024-11-21 03:44:25.665226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.090 qpair failed and we were unable to recover it. 00:27:45.090 [2024-11-21 03:44:25.665319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.090 [2024-11-21 03:44:25.665453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.090 [2024-11-21 03:44:25.665478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.090 qpair failed and we were unable to recover it. 00:27:45.090 [2024-11-21 03:44:25.665582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.090 [2024-11-21 03:44:25.665684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.090 [2024-11-21 03:44:25.665709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.090 qpair failed and we were unable to recover it. 00:27:45.090 [2024-11-21 03:44:25.665839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.090 [2024-11-21 03:44:25.665969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.090 [2024-11-21 03:44:25.665994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.090 qpair failed and we were unable to recover it. 00:27:45.090 [2024-11-21 03:44:25.666113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.090 [2024-11-21 03:44:25.666208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.090 [2024-11-21 03:44:25.666233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.090 qpair failed and we were unable to recover it. 00:27:45.090 [2024-11-21 03:44:25.666330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.090 [2024-11-21 03:44:25.666459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.090 [2024-11-21 03:44:25.666484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.090 qpair failed and we were unable to recover it. 00:27:45.090 [2024-11-21 03:44:25.666642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.091 [2024-11-21 03:44:25.666801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.091 [2024-11-21 03:44:25.666827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.091 qpair failed and we were unable to recover it. 00:27:45.091 [2024-11-21 03:44:25.666932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.091 [2024-11-21 03:44:25.667085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.091 [2024-11-21 03:44:25.667111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.091 qpair failed and we were unable to recover it. 00:27:45.091 [2024-11-21 03:44:25.667248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.091 [2024-11-21 03:44:25.667376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.091 [2024-11-21 03:44:25.667401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.091 qpair failed and we were unable to recover it. 00:27:45.091 [2024-11-21 03:44:25.667532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.091 [2024-11-21 03:44:25.667661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.091 [2024-11-21 03:44:25.667687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.091 qpair failed and we were unable to recover it. 00:27:45.091 [2024-11-21 03:44:25.667793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.091 [2024-11-21 03:44:25.667924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.091 [2024-11-21 03:44:25.667949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.091 qpair failed and we were unable to recover it. 00:27:45.091 [2024-11-21 03:44:25.668079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.091 [2024-11-21 03:44:25.668215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.091 [2024-11-21 03:44:25.668240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.091 qpair failed and we were unable to recover it. 00:27:45.091 [2024-11-21 03:44:25.668343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.091 [2024-11-21 03:44:25.668471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.091 [2024-11-21 03:44:25.668496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.091 qpair failed and we were unable to recover it. 00:27:45.091 [2024-11-21 03:44:25.668587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.091 [2024-11-21 03:44:25.668693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.091 [2024-11-21 03:44:25.668717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.091 qpair failed and we were unable to recover it. 00:27:45.091 [2024-11-21 03:44:25.668876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.091 [2024-11-21 03:44:25.668986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.091 [2024-11-21 03:44:25.669011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.091 qpair failed and we were unable to recover it. 00:27:45.091 [2024-11-21 03:44:25.669121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.091 [2024-11-21 03:44:25.669266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.091 [2024-11-21 03:44:25.669295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.091 qpair failed and we were unable to recover it. 00:27:45.091 [2024-11-21 03:44:25.669429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.091 [2024-11-21 03:44:25.669587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.091 [2024-11-21 03:44:25.669612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.091 qpair failed and we were unable to recover it. 00:27:45.091 [2024-11-21 03:44:25.669768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.091 [2024-11-21 03:44:25.669873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.091 [2024-11-21 03:44:25.669897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.091 qpair failed and we were unable to recover it. 00:27:45.091 [2024-11-21 03:44:25.670025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.091 [2024-11-21 03:44:25.670132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.091 [2024-11-21 03:44:25.670157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.091 qpair failed and we were unable to recover it. 00:27:45.091 [2024-11-21 03:44:25.670272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.091 [2024-11-21 03:44:25.670402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.091 [2024-11-21 03:44:25.670427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.091 qpair failed and we were unable to recover it. 00:27:45.091 [2024-11-21 03:44:25.670537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.091 [2024-11-21 03:44:25.670644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.091 [2024-11-21 03:44:25.670669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.091 qpair failed and we were unable to recover it. 00:27:45.091 [2024-11-21 03:44:25.670801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.091 [2024-11-21 03:44:25.670990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.091 [2024-11-21 03:44:25.671015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.091 qpair failed and we were unable to recover it. 00:27:45.091 [2024-11-21 03:44:25.671157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.091 [2024-11-21 03:44:25.671258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.091 [2024-11-21 03:44:25.671283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.091 qpair failed and we were unable to recover it. 00:27:45.091 [2024-11-21 03:44:25.671405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.091 [2024-11-21 03:44:25.671532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.091 [2024-11-21 03:44:25.671557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.091 qpair failed and we were unable to recover it. 00:27:45.091 [2024-11-21 03:44:25.671685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.091 [2024-11-21 03:44:25.671817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.091 [2024-11-21 03:44:25.671841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.091 qpair failed and we were unable to recover it. 00:27:45.091 [2024-11-21 03:44:25.671972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.091 [2024-11-21 03:44:25.672080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.091 [2024-11-21 03:44:25.672106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.091 qpair failed and we were unable to recover it. 00:27:45.091 [2024-11-21 03:44:25.672206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.091 [2024-11-21 03:44:25.672333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.091 [2024-11-21 03:44:25.672359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.091 qpair failed and we were unable to recover it. 00:27:45.091 [2024-11-21 03:44:25.672518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.091 [2024-11-21 03:44:25.672651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.091 [2024-11-21 03:44:25.672676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.091 qpair failed and we were unable to recover it. 00:27:45.091 [2024-11-21 03:44:25.672805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.091 [2024-11-21 03:44:25.672900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.091 [2024-11-21 03:44:25.672925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.091 qpair failed and we were unable to recover it. 00:27:45.091 [2024-11-21 03:44:25.673056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.091 [2024-11-21 03:44:25.673195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.091 [2024-11-21 03:44:25.673220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.091 qpair failed and we were unable to recover it. 00:27:45.091 [2024-11-21 03:44:25.673379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.091 [2024-11-21 03:44:25.673558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.091 [2024-11-21 03:44:25.673583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.091 qpair failed and we were unable to recover it. 00:27:45.091 [2024-11-21 03:44:25.673716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.092 [2024-11-21 03:44:25.673873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.092 [2024-11-21 03:44:25.673897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.092 qpair failed and we were unable to recover it. 00:27:45.092 [2024-11-21 03:44:25.674032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.092 [2024-11-21 03:44:25.674142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.092 [2024-11-21 03:44:25.674169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.092 qpair failed and we were unable to recover it. 00:27:45.092 [2024-11-21 03:44:25.674277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.092 [2024-11-21 03:44:25.674411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.092 [2024-11-21 03:44:25.674435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.092 qpair failed and we were unable to recover it. 00:27:45.092 [2024-11-21 03:44:25.674530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.092 [2024-11-21 03:44:25.674720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.092 [2024-11-21 03:44:25.674746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.092 qpair failed and we were unable to recover it. 00:27:45.092 [2024-11-21 03:44:25.674900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.092 [2024-11-21 03:44:25.675027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.092 [2024-11-21 03:44:25.675052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.092 qpair failed and we were unable to recover it. 00:27:45.092 [2024-11-21 03:44:25.675248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.092 [2024-11-21 03:44:25.675369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.092 [2024-11-21 03:44:25.675394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.092 qpair failed and we were unable to recover it. 00:27:45.092 [2024-11-21 03:44:25.675487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.092 [2024-11-21 03:44:25.675618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.092 [2024-11-21 03:44:25.675643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.092 qpair failed and we were unable to recover it. 00:27:45.092 [2024-11-21 03:44:25.675771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.092 [2024-11-21 03:44:25.675890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.092 [2024-11-21 03:44:25.675916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.092 qpair failed and we were unable to recover it. 00:27:45.092 [2024-11-21 03:44:25.676075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.092 [2024-11-21 03:44:25.676236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.092 [2024-11-21 03:44:25.676262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.092 qpair failed and we were unable to recover it. 00:27:45.092 [2024-11-21 03:44:25.676412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.092 [2024-11-21 03:44:25.676553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.092 [2024-11-21 03:44:25.676578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.092 qpair failed and we were unable to recover it. 00:27:45.092 [2024-11-21 03:44:25.676706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.092 [2024-11-21 03:44:25.676843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.092 [2024-11-21 03:44:25.676868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.092 qpair failed and we were unable to recover it. 00:27:45.092 [2024-11-21 03:44:25.676961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.092 [2024-11-21 03:44:25.677054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.092 [2024-11-21 03:44:25.677087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.092 qpair failed and we were unable to recover it. 00:27:45.092 [2024-11-21 03:44:25.677221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.092 [2024-11-21 03:44:25.677345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.092 [2024-11-21 03:44:25.677370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.092 qpair failed and we were unable to recover it. 00:27:45.092 [2024-11-21 03:44:25.677468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.092 [2024-11-21 03:44:25.677603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.092 [2024-11-21 03:44:25.677628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.092 qpair failed and we were unable to recover it. 00:27:45.092 [2024-11-21 03:44:25.677820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.092 [2024-11-21 03:44:25.677950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.092 [2024-11-21 03:44:25.677974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.092 qpair failed and we were unable to recover it. 00:27:45.092 [2024-11-21 03:44:25.678127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.092 [2024-11-21 03:44:25.678286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.092 [2024-11-21 03:44:25.678310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.092 qpair failed and we were unable to recover it. 00:27:45.092 [2024-11-21 03:44:25.678438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.092 [2024-11-21 03:44:25.678592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.092 [2024-11-21 03:44:25.678617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.092 qpair failed and we were unable to recover it. 00:27:45.092 [2024-11-21 03:44:25.678773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.092 [2024-11-21 03:44:25.678927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.092 [2024-11-21 03:44:25.678952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.092 qpair failed and we were unable to recover it. 00:27:45.092 [2024-11-21 03:44:25.679052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.092 [2024-11-21 03:44:25.679199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.092 [2024-11-21 03:44:25.679224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.092 qpair failed and we were unable to recover it. 00:27:45.092 [2024-11-21 03:44:25.679324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.092 [2024-11-21 03:44:25.679444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.092 [2024-11-21 03:44:25.679473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.092 qpair failed and we were unable to recover it. 00:27:45.092 [2024-11-21 03:44:25.679579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.092 [2024-11-21 03:44:25.679677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.092 [2024-11-21 03:44:25.679702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.092 qpair failed and we were unable to recover it. 00:27:45.092 [2024-11-21 03:44:25.679828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.092 [2024-11-21 03:44:25.679958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.092 [2024-11-21 03:44:25.679983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.092 qpair failed and we were unable to recover it. 00:27:45.092 [2024-11-21 03:44:25.680079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.092 [2024-11-21 03:44:25.680204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.092 [2024-11-21 03:44:25.680230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.092 qpair failed and we were unable to recover it. 00:27:45.092 [2024-11-21 03:44:25.680383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.092 [2024-11-21 03:44:25.680505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.092 [2024-11-21 03:44:25.680530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.092 qpair failed and we were unable to recover it. 00:27:45.092 [2024-11-21 03:44:25.680631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.092 [2024-11-21 03:44:25.680760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.092 [2024-11-21 03:44:25.680803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.092 qpair failed and we were unable to recover it. 00:27:45.092 [2024-11-21 03:44:25.680919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.092 [2024-11-21 03:44:25.681052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.092 [2024-11-21 03:44:25.681083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.092 qpair failed and we were unable to recover it. 00:27:45.092 [2024-11-21 03:44:25.681226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.092 [2024-11-21 03:44:25.681328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.092 [2024-11-21 03:44:25.681353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.092 qpair failed and we were unable to recover it. 00:27:45.092 [2024-11-21 03:44:25.681460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.092 [2024-11-21 03:44:25.681562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.092 [2024-11-21 03:44:25.681587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.092 qpair failed and we were unable to recover it. 00:27:45.092 [2024-11-21 03:44:25.681715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.092 [2024-11-21 03:44:25.681809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.092 [2024-11-21 03:44:25.681834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.092 qpair failed and we were unable to recover it. 00:27:45.092 [2024-11-21 03:44:25.681968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.093 [2024-11-21 03:44:25.682094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.093 [2024-11-21 03:44:25.682125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.093 qpair failed and we were unable to recover it. 00:27:45.093 [2024-11-21 03:44:25.682258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.093 [2024-11-21 03:44:25.682354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.093 [2024-11-21 03:44:25.682378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.093 qpair failed and we were unable to recover it. 00:27:45.093 [2024-11-21 03:44:25.682504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.093 [2024-11-21 03:44:25.682660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.093 [2024-11-21 03:44:25.682685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.093 qpair failed and we were unable to recover it. 00:27:45.093 [2024-11-21 03:44:25.682807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.093 [2024-11-21 03:44:25.682978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.093 [2024-11-21 03:44:25.683003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.093 qpair failed and we were unable to recover it. 00:27:45.093 [2024-11-21 03:44:25.683161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.093 [2024-11-21 03:44:25.683297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.093 [2024-11-21 03:44:25.683322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.093 qpair failed and we were unable to recover it. 00:27:45.093 [2024-11-21 03:44:25.683483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.093 [2024-11-21 03:44:25.683585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.093 [2024-11-21 03:44:25.683610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.093 qpair failed and we were unable to recover it. 00:27:45.093 [2024-11-21 03:44:25.683743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.093 [2024-11-21 03:44:25.683863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.093 [2024-11-21 03:44:25.683888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.093 qpair failed and we were unable to recover it. 00:27:45.093 [2024-11-21 03:44:25.683994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.093 [2024-11-21 03:44:25.684172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.093 [2024-11-21 03:44:25.684197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.093 qpair failed and we were unable to recover it. 00:27:45.093 [2024-11-21 03:44:25.684330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.093 [2024-11-21 03:44:25.684481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.093 [2024-11-21 03:44:25.684506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.093 qpair failed and we were unable to recover it. 00:27:45.093 [2024-11-21 03:44:25.684604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.093 [2024-11-21 03:44:25.684757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.093 [2024-11-21 03:44:25.684782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.093 qpair failed and we were unable to recover it. 00:27:45.093 [2024-11-21 03:44:25.684888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.093 [2024-11-21 03:44:25.685026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.093 [2024-11-21 03:44:25.685052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.093 qpair failed and we were unable to recover it. 00:27:45.093 [2024-11-21 03:44:25.685163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.093 [2024-11-21 03:44:25.685283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.093 [2024-11-21 03:44:25.685309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.093 qpair failed and we were unable to recover it. 00:27:45.093 [2024-11-21 03:44:25.685472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.093 [2024-11-21 03:44:25.685601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.093 [2024-11-21 03:44:25.685626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.093 qpair failed and we were unable to recover it. 00:27:45.093 [2024-11-21 03:44:25.685787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.093 [2024-11-21 03:44:25.685922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.093 [2024-11-21 03:44:25.685947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.093 qpair failed and we were unable to recover it. 00:27:45.093 [2024-11-21 03:44:25.686076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.093 [2024-11-21 03:44:25.686206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.093 [2024-11-21 03:44:25.686232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.093 qpair failed and we were unable to recover it. 00:27:45.093 [2024-11-21 03:44:25.686352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.093 [2024-11-21 03:44:25.686479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.093 [2024-11-21 03:44:25.686504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.093 qpair failed and we were unable to recover it. 00:27:45.093 [2024-11-21 03:44:25.686656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.093 [2024-11-21 03:44:25.686784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.093 [2024-11-21 03:44:25.686809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.093 qpair failed and we were unable to recover it. 00:27:45.093 [2024-11-21 03:44:25.686950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.093 [2024-11-21 03:44:25.687082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.093 [2024-11-21 03:44:25.687108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.093 qpair failed and we were unable to recover it. 00:27:45.093 [2024-11-21 03:44:25.687228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.093 [2024-11-21 03:44:25.687370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.093 [2024-11-21 03:44:25.687395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.093 qpair failed and we were unable to recover it. 00:27:45.093 [2024-11-21 03:44:25.687487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.093 [2024-11-21 03:44:25.687642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.093 [2024-11-21 03:44:25.687667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.093 qpair failed and we were unable to recover it. 00:27:45.093 [2024-11-21 03:44:25.687798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.093 [2024-11-21 03:44:25.687957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.093 [2024-11-21 03:44:25.687982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.093 qpair failed and we were unable to recover it. 00:27:45.093 [2024-11-21 03:44:25.688112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.093 [2024-11-21 03:44:25.688238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.093 [2024-11-21 03:44:25.688264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.093 qpair failed and we were unable to recover it. 00:27:45.093 [2024-11-21 03:44:25.688370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.093 [2024-11-21 03:44:25.688526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.093 [2024-11-21 03:44:25.688551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.093 qpair failed and we were unable to recover it. 00:27:45.093 [2024-11-21 03:44:25.688682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.093 [2024-11-21 03:44:25.688834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.093 [2024-11-21 03:44:25.688859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.093 qpair failed and we were unable to recover it. 00:27:45.093 [2024-11-21 03:44:25.688995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.093 [2024-11-21 03:44:25.689124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.093 [2024-11-21 03:44:25.689149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.093 qpair failed and we were unable to recover it. 00:27:45.093 [2024-11-21 03:44:25.689253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.093 [2024-11-21 03:44:25.689354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.093 [2024-11-21 03:44:25.689378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.093 qpair failed and we were unable to recover it. 00:27:45.093 [2024-11-21 03:44:25.689501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.093 [2024-11-21 03:44:25.689625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.093 [2024-11-21 03:44:25.689650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.093 qpair failed and we were unable to recover it. 00:27:45.093 [2024-11-21 03:44:25.689775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.093 [2024-11-21 03:44:25.689881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.093 [2024-11-21 03:44:25.689906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.093 qpair failed and we were unable to recover it. 00:27:45.093 [2024-11-21 03:44:25.690064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.093 [2024-11-21 03:44:25.690194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.093 [2024-11-21 03:44:25.690219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.093 qpair failed and we were unable to recover it. 00:27:45.093 [2024-11-21 03:44:25.690324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.094 [2024-11-21 03:44:25.690424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.094 [2024-11-21 03:44:25.690449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.094 qpair failed and we were unable to recover it. 00:27:45.094 [2024-11-21 03:44:25.690569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.094 [2024-11-21 03:44:25.690699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.094 [2024-11-21 03:44:25.690725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.094 qpair failed and we were unable to recover it. 00:27:45.094 [2024-11-21 03:44:25.690852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.094 [2024-11-21 03:44:25.690986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.094 [2024-11-21 03:44:25.691012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.094 qpair failed and we were unable to recover it. 00:27:45.094 [2024-11-21 03:44:25.691112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.094 [2024-11-21 03:44:25.691234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.094 [2024-11-21 03:44:25.691258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.094 qpair failed and we were unable to recover it. 00:27:45.094 [2024-11-21 03:44:25.691352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.094 [2024-11-21 03:44:25.691479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.094 [2024-11-21 03:44:25.691504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.094 qpair failed and we were unable to recover it. 00:27:45.094 [2024-11-21 03:44:25.691653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.094 [2024-11-21 03:44:25.691821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.094 [2024-11-21 03:44:25.691846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.094 qpair failed and we were unable to recover it. 00:27:45.094 [2024-11-21 03:44:25.691968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.094 [2024-11-21 03:44:25.692099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.094 [2024-11-21 03:44:25.692125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.094 qpair failed and we were unable to recover it. 00:27:45.094 [2024-11-21 03:44:25.692294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.094 [2024-11-21 03:44:25.692428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.094 [2024-11-21 03:44:25.692453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.094 qpair failed and we were unable to recover it. 00:27:45.094 [2024-11-21 03:44:25.692614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.094 [2024-11-21 03:44:25.692721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.094 [2024-11-21 03:44:25.692746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.094 qpair failed and we were unable to recover it. 00:27:45.094 [2024-11-21 03:44:25.692876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.094 [2024-11-21 03:44:25.693003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.094 [2024-11-21 03:44:25.693027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.094 qpair failed and we were unable to recover it. 00:27:45.094 [2024-11-21 03:44:25.693166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.094 [2024-11-21 03:44:25.693297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.094 [2024-11-21 03:44:25.693322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.094 qpair failed and we were unable to recover it. 00:27:45.094 [2024-11-21 03:44:25.693454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.094 [2024-11-21 03:44:25.693610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.094 [2024-11-21 03:44:25.693635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.094 qpair failed and we were unable to recover it. 00:27:45.094 [2024-11-21 03:44:25.693739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.094 [2024-11-21 03:44:25.693900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.094 [2024-11-21 03:44:25.693927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.094 qpair failed and we were unable to recover it. 00:27:45.094 [2024-11-21 03:44:25.694035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.094 [2024-11-21 03:44:25.694211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.094 [2024-11-21 03:44:25.694237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.094 qpair failed and we were unable to recover it. 00:27:45.094 [2024-11-21 03:44:25.694396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.094 [2024-11-21 03:44:25.694492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.094 [2024-11-21 03:44:25.694517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.094 qpair failed and we were unable to recover it. 00:27:45.094 [2024-11-21 03:44:25.694659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.094 [2024-11-21 03:44:25.694763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.094 [2024-11-21 03:44:25.694787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.094 qpair failed and we were unable to recover it. 00:27:45.094 [2024-11-21 03:44:25.694876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.094 [2024-11-21 03:44:25.695009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.094 [2024-11-21 03:44:25.695034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.094 qpair failed and we were unable to recover it. 00:27:45.094 [2024-11-21 03:44:25.695196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.094 [2024-11-21 03:44:25.695324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.094 [2024-11-21 03:44:25.695348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.094 qpair failed and we were unable to recover it. 00:27:45.094 [2024-11-21 03:44:25.695478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.094 [2024-11-21 03:44:25.695577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.094 [2024-11-21 03:44:25.695602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.094 qpair failed and we were unable to recover it. 00:27:45.094 [2024-11-21 03:44:25.695702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.094 [2024-11-21 03:44:25.695829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.094 [2024-11-21 03:44:25.695854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.094 qpair failed and we were unable to recover it. 00:27:45.094 [2024-11-21 03:44:25.695989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.094 [2024-11-21 03:44:25.696099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.094 [2024-11-21 03:44:25.696127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.094 qpair failed and we were unable to recover it. 00:27:45.094 [2024-11-21 03:44:25.696247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.094 [2024-11-21 03:44:25.696376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.094 [2024-11-21 03:44:25.696400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.094 qpair failed and we were unable to recover it. 00:27:45.094 [2024-11-21 03:44:25.696505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.094 [2024-11-21 03:44:25.696599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.094 [2024-11-21 03:44:25.696627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.094 qpair failed and we were unable to recover it. 00:27:45.094 [2024-11-21 03:44:25.696758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.094 [2024-11-21 03:44:25.696905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.094 [2024-11-21 03:44:25.696932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.094 qpair failed and we were unable to recover it. 00:27:45.094 [2024-11-21 03:44:25.697088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.094 [2024-11-21 03:44:25.697212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.094 [2024-11-21 03:44:25.697237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.094 qpair failed and we were unable to recover it. 00:27:45.094 [2024-11-21 03:44:25.697412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.094 [2024-11-21 03:44:25.697593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.094 [2024-11-21 03:44:25.697618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.094 qpair failed and we were unable to recover it. 00:27:45.094 [2024-11-21 03:44:25.697715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.094 [2024-11-21 03:44:25.697868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.094 [2024-11-21 03:44:25.697893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.094 qpair failed and we were unable to recover it. 00:27:45.094 [2024-11-21 03:44:25.698017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.094 [2024-11-21 03:44:25.698145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.094 [2024-11-21 03:44:25.698170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.094 qpair failed and we were unable to recover it. 00:27:45.094 [2024-11-21 03:44:25.698302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.094 [2024-11-21 03:44:25.698412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.094 [2024-11-21 03:44:25.698437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.094 qpair failed and we were unable to recover it. 00:27:45.094 [2024-11-21 03:44:25.698588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.095 [2024-11-21 03:44:25.698729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.095 [2024-11-21 03:44:25.698753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.095 qpair failed and we were unable to recover it. 00:27:45.095 [2024-11-21 03:44:25.698911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.095 [2024-11-21 03:44:25.699039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.095 [2024-11-21 03:44:25.699089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.095 qpair failed and we were unable to recover it. 00:27:45.095 [2024-11-21 03:44:25.699247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.095 [2024-11-21 03:44:25.699346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.095 [2024-11-21 03:44:25.699370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.095 qpair failed and we were unable to recover it. 00:27:45.095 [2024-11-21 03:44:25.699499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.095 [2024-11-21 03:44:25.699604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.095 [2024-11-21 03:44:25.699628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.095 qpair failed and we were unable to recover it. 00:27:45.095 [2024-11-21 03:44:25.699763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.095 [2024-11-21 03:44:25.699918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.095 [2024-11-21 03:44:25.699943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.095 qpair failed and we were unable to recover it. 00:27:45.095 [2024-11-21 03:44:25.700098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.095 [2024-11-21 03:44:25.700230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.095 [2024-11-21 03:44:25.700255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.095 qpair failed and we were unable to recover it. 00:27:45.095 [2024-11-21 03:44:25.700415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.095 [2024-11-21 03:44:25.700522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.095 [2024-11-21 03:44:25.700547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.095 qpair failed and we were unable to recover it. 00:27:45.095 [2024-11-21 03:44:25.700675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.095 [2024-11-21 03:44:25.700799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.095 [2024-11-21 03:44:25.700822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.095 qpair failed and we were unable to recover it. 00:27:45.095 [2024-11-21 03:44:25.700960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.095 [2024-11-21 03:44:25.701081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.095 [2024-11-21 03:44:25.701124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.095 qpair failed and we were unable to recover it. 00:27:45.095 [2024-11-21 03:44:25.701250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.095 [2024-11-21 03:44:25.701371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.095 [2024-11-21 03:44:25.701398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.095 qpair failed and we were unable to recover it. 00:27:45.095 [2024-11-21 03:44:25.701557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.095 [2024-11-21 03:44:25.701684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.095 [2024-11-21 03:44:25.701708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.095 qpair failed and we were unable to recover it. 00:27:45.095 [2024-11-21 03:44:25.701846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.095 [2024-11-21 03:44:25.701971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.095 [2024-11-21 03:44:25.701995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.095 qpair failed and we were unable to recover it. 00:27:45.095 [2024-11-21 03:44:25.702099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.095 [2024-11-21 03:44:25.702230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.095 [2024-11-21 03:44:25.702254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.095 qpair failed and we were unable to recover it. 00:27:45.095 [2024-11-21 03:44:25.702385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.095 [2024-11-21 03:44:25.702490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.095 [2024-11-21 03:44:25.702516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.095 qpair failed and we were unable to recover it. 00:27:45.095 [2024-11-21 03:44:25.702677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.095 [2024-11-21 03:44:25.702826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.095 [2024-11-21 03:44:25.702854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.095 qpair failed and we were unable to recover it. 00:27:45.095 [2024-11-21 03:44:25.702998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.095 [2024-11-21 03:44:25.703160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.095 [2024-11-21 03:44:25.703186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.095 qpair failed and we were unable to recover it. 00:27:45.095 [2024-11-21 03:44:25.703315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.095 [2024-11-21 03:44:25.703468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.095 [2024-11-21 03:44:25.703493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.095 qpair failed and we were unable to recover it. 00:27:45.095 [2024-11-21 03:44:25.703593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.095 [2024-11-21 03:44:25.703698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.095 [2024-11-21 03:44:25.703722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.095 qpair failed and we were unable to recover it. 00:27:45.095 [2024-11-21 03:44:25.703880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.095 [2024-11-21 03:44:25.704040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.095 [2024-11-21 03:44:25.704064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.095 qpair failed and we were unable to recover it. 00:27:45.095 [2024-11-21 03:44:25.704211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.095 [2024-11-21 03:44:25.704319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.095 [2024-11-21 03:44:25.704343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.095 qpair failed and we were unable to recover it. 00:27:45.095 [2024-11-21 03:44:25.704474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.095 [2024-11-21 03:44:25.704576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.095 [2024-11-21 03:44:25.704600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.095 qpair failed and we were unable to recover it. 00:27:45.095 [2024-11-21 03:44:25.704734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.095 [2024-11-21 03:44:25.704834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.095 [2024-11-21 03:44:25.704859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.095 qpair failed and we were unable to recover it. 00:27:45.095 [2024-11-21 03:44:25.704975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.095 [2024-11-21 03:44:25.705132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.095 [2024-11-21 03:44:25.705157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.095 qpair failed and we were unable to recover it. 00:27:45.095 [2024-11-21 03:44:25.705326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.095 [2024-11-21 03:44:25.705463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.095 [2024-11-21 03:44:25.705489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.095 qpair failed and we were unable to recover it. 00:27:45.095 [2024-11-21 03:44:25.705624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.095 [2024-11-21 03:44:25.705771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.095 [2024-11-21 03:44:25.705800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.095 qpair failed and we were unable to recover it. 00:27:45.096 [2024-11-21 03:44:25.705948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.096 [2024-11-21 03:44:25.706103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.096 [2024-11-21 03:44:25.706128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.096 qpair failed and we were unable to recover it. 00:27:45.096 [2024-11-21 03:44:25.706262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.096 [2024-11-21 03:44:25.706387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.096 [2024-11-21 03:44:25.706412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.096 qpair failed and we were unable to recover it. 00:27:45.096 [2024-11-21 03:44:25.706589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.096 [2024-11-21 03:44:25.706697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.096 [2024-11-21 03:44:25.706725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.096 qpair failed and we were unable to recover it. 00:27:45.096 [2024-11-21 03:44:25.706869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.096 [2024-11-21 03:44:25.707025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.096 [2024-11-21 03:44:25.707051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.096 qpair failed and we were unable to recover it. 00:27:45.096 [2024-11-21 03:44:25.707262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.096 [2024-11-21 03:44:25.707364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.096 [2024-11-21 03:44:25.707388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.096 qpair failed and we were unable to recover it. 00:27:45.096 [2024-11-21 03:44:25.707517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.096 [2024-11-21 03:44:25.707647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.096 [2024-11-21 03:44:25.707671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.096 qpair failed and we were unable to recover it. 00:27:45.096 [2024-11-21 03:44:25.707783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.096 [2024-11-21 03:44:25.707910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.096 [2024-11-21 03:44:25.707934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.096 qpair failed and we were unable to recover it. 00:27:45.096 [2024-11-21 03:44:25.708031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.096 [2024-11-21 03:44:25.708200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.096 [2024-11-21 03:44:25.708226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.096 qpair failed and we were unable to recover it. 00:27:45.096 [2024-11-21 03:44:25.708387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.096 [2024-11-21 03:44:25.708513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.096 [2024-11-21 03:44:25.708538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.096 qpair failed and we were unable to recover it. 00:27:45.096 [2024-11-21 03:44:25.708666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.096 [2024-11-21 03:44:25.708814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.096 [2024-11-21 03:44:25.708840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.096 qpair failed and we were unable to recover it. 00:27:45.096 [2024-11-21 03:44:25.709001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.096 [2024-11-21 03:44:25.709117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.096 [2024-11-21 03:44:25.709155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.096 qpair failed and we were unable to recover it. 00:27:45.096 [2024-11-21 03:44:25.709288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.096 [2024-11-21 03:44:25.709413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.096 [2024-11-21 03:44:25.709437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.096 qpair failed and we were unable to recover it. 00:27:45.096 [2024-11-21 03:44:25.709592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.096 [2024-11-21 03:44:25.709713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.096 [2024-11-21 03:44:25.709737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.096 qpair failed and we were unable to recover it. 00:27:45.096 [2024-11-21 03:44:25.709869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.096 [2024-11-21 03:44:25.709999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.096 [2024-11-21 03:44:25.710023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.096 qpair failed and we were unable to recover it. 00:27:45.096 [2024-11-21 03:44:25.710141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.096 [2024-11-21 03:44:25.710237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.096 [2024-11-21 03:44:25.710262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.096 qpair failed and we were unable to recover it. 00:27:45.096 [2024-11-21 03:44:25.710359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.096 [2024-11-21 03:44:25.710485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.096 [2024-11-21 03:44:25.710510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.096 qpair failed and we were unable to recover it. 00:27:45.096 [2024-11-21 03:44:25.710647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.096 [2024-11-21 03:44:25.710810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.096 [2024-11-21 03:44:25.710834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.096 qpair failed and we were unable to recover it. 00:27:45.096 [2024-11-21 03:44:25.710966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.096 [2024-11-21 03:44:25.711092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.096 [2024-11-21 03:44:25.711117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.096 qpair failed and we were unable to recover it. 00:27:45.096 [2024-11-21 03:44:25.711245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.096 [2024-11-21 03:44:25.711372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.096 [2024-11-21 03:44:25.711397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.096 qpair failed and we were unable to recover it. 00:27:45.096 [2024-11-21 03:44:25.711520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.096 [2024-11-21 03:44:25.711693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.096 [2024-11-21 03:44:25.711728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.096 qpair failed and we were unable to recover it. 00:27:45.096 [2024-11-21 03:44:25.711872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.096 [2024-11-21 03:44:25.712053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.096 [2024-11-21 03:44:25.712094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.096 qpair failed and we were unable to recover it. 00:27:45.096 [2024-11-21 03:44:25.712205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.096 [2024-11-21 03:44:25.712333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.096 [2024-11-21 03:44:25.712358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.096 qpair failed and we were unable to recover it. 00:27:45.096 [2024-11-21 03:44:25.712457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.096 [2024-11-21 03:44:25.712586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.096 [2024-11-21 03:44:25.712610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.096 qpair failed and we were unable to recover it. 00:27:45.096 [2024-11-21 03:44:25.712765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.096 [2024-11-21 03:44:25.712890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.096 [2024-11-21 03:44:25.712914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.096 qpair failed and we were unable to recover it. 00:27:45.096 [2024-11-21 03:44:25.713019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.096 [2024-11-21 03:44:25.713128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.096 [2024-11-21 03:44:25.713154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.096 qpair failed and we were unable to recover it. 00:27:45.096 [2024-11-21 03:44:25.713284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.096 [2024-11-21 03:44:25.713451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.096 [2024-11-21 03:44:25.713476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.096 qpair failed and we were unable to recover it. 00:27:45.096 [2024-11-21 03:44:25.713607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.096 [2024-11-21 03:44:25.713741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.096 [2024-11-21 03:44:25.713768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.096 qpair failed and we were unable to recover it. 00:27:45.096 [2024-11-21 03:44:25.713891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.096 [2024-11-21 03:44:25.714048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.096 [2024-11-21 03:44:25.714083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.096 qpair failed and we were unable to recover it. 00:27:45.096 [2024-11-21 03:44:25.714237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.096 [2024-11-21 03:44:25.714389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.096 [2024-11-21 03:44:25.714414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.096 qpair failed and we were unable to recover it. 00:27:45.097 [2024-11-21 03:44:25.714537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.097 [2024-11-21 03:44:25.714703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.097 [2024-11-21 03:44:25.714730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.097 qpair failed and we were unable to recover it. 00:27:45.097 [2024-11-21 03:44:25.714859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.097 [2024-11-21 03:44:25.714955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.097 [2024-11-21 03:44:25.714979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.097 qpair failed and we were unable to recover it. 00:27:45.097 [2024-11-21 03:44:25.715133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.097 [2024-11-21 03:44:25.715270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.097 [2024-11-21 03:44:25.715297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.097 qpair failed and we were unable to recover it. 00:27:45.097 [2024-11-21 03:44:25.715427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.097 [2024-11-21 03:44:25.715558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.097 [2024-11-21 03:44:25.715583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.097 qpair failed and we were unable to recover it. 00:27:45.097 [2024-11-21 03:44:25.715683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.097 [2024-11-21 03:44:25.715790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.097 [2024-11-21 03:44:25.715814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.097 qpair failed and we were unable to recover it. 00:27:45.097 [2024-11-21 03:44:25.715958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.097 [2024-11-21 03:44:25.716067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.097 [2024-11-21 03:44:25.716102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.097 qpair failed and we were unable to recover it. 00:27:45.097 [2024-11-21 03:44:25.716262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.097 [2024-11-21 03:44:25.716394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.097 [2024-11-21 03:44:25.716418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.097 qpair failed and we were unable to recover it. 00:27:45.097 [2024-11-21 03:44:25.716543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.097 [2024-11-21 03:44:25.716644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.097 [2024-11-21 03:44:25.716669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.097 qpair failed and we were unable to recover it. 00:27:45.097 [2024-11-21 03:44:25.716771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.097 [2024-11-21 03:44:25.716867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.097 [2024-11-21 03:44:25.716891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.097 qpair failed and we were unable to recover it. 00:27:45.097 [2024-11-21 03:44:25.716981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.097 [2024-11-21 03:44:25.717108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.097 [2024-11-21 03:44:25.717133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.097 qpair failed and we were unable to recover it. 00:27:45.097 [2024-11-21 03:44:25.717280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.097 [2024-11-21 03:44:25.717450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.097 [2024-11-21 03:44:25.717478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.097 qpair failed and we were unable to recover it. 00:27:45.097 [2024-11-21 03:44:25.717622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.097 [2024-11-21 03:44:25.717771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.097 [2024-11-21 03:44:25.717796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.097 qpair failed and we were unable to recover it. 00:27:45.097 [2024-11-21 03:44:25.717921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.097 [2024-11-21 03:44:25.718026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.097 [2024-11-21 03:44:25.718051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.097 qpair failed and we were unable to recover it. 00:27:45.097 [2024-11-21 03:44:25.718185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.097 [2024-11-21 03:44:25.718342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.097 [2024-11-21 03:44:25.718384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.097 qpair failed and we were unable to recover it. 00:27:45.097 [2024-11-21 03:44:25.718541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.097 [2024-11-21 03:44:25.718647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.097 [2024-11-21 03:44:25.718671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.097 qpair failed and we were unable to recover it. 00:27:45.097 [2024-11-21 03:44:25.718795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.097 [2024-11-21 03:44:25.718932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.097 [2024-11-21 03:44:25.718956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.097 qpair failed and we were unable to recover it. 00:27:45.097 [2024-11-21 03:44:25.719085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.097 [2024-11-21 03:44:25.719191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.097 [2024-11-21 03:44:25.719217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.097 qpair failed and we were unable to recover it. 00:27:45.097 [2024-11-21 03:44:25.719326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.097 [2024-11-21 03:44:25.719479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.097 [2024-11-21 03:44:25.719503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.097 qpair failed and we were unable to recover it. 00:27:45.097 [2024-11-21 03:44:25.719650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.097 [2024-11-21 03:44:25.719806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.097 [2024-11-21 03:44:25.719832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.097 qpair failed and we were unable to recover it. 00:27:45.097 [2024-11-21 03:44:25.719933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.097 [2024-11-21 03:44:25.720065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.097 [2024-11-21 03:44:25.720116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.097 qpair failed and we were unable to recover it. 00:27:45.097 [2024-11-21 03:44:25.720247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.097 [2024-11-21 03:44:25.720421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.097 [2024-11-21 03:44:25.720449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.097 qpair failed and we were unable to recover it. 00:27:45.097 [2024-11-21 03:44:25.720566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.097 [2024-11-21 03:44:25.720678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.097 [2024-11-21 03:44:25.720719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.097 qpair failed and we were unable to recover it. 00:27:45.097 [2024-11-21 03:44:25.720873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.097 [2024-11-21 03:44:25.720976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.097 [2024-11-21 03:44:25.721001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.097 qpair failed and we were unable to recover it. 00:27:45.097 [2024-11-21 03:44:25.721127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.097 [2024-11-21 03:44:25.721237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.097 [2024-11-21 03:44:25.721264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.097 qpair failed and we were unable to recover it. 00:27:45.097 [2024-11-21 03:44:25.721403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.097 [2024-11-21 03:44:25.721530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.097 [2024-11-21 03:44:25.721554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.097 qpair failed and we were unable to recover it. 00:27:45.097 [2024-11-21 03:44:25.721685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.097 [2024-11-21 03:44:25.721793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.097 [2024-11-21 03:44:25.721817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.097 qpair failed and we were unable to recover it. 00:27:45.097 [2024-11-21 03:44:25.721928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.097 [2024-11-21 03:44:25.722022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.097 [2024-11-21 03:44:25.722046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.097 qpair failed and we were unable to recover it. 00:27:45.097 [2024-11-21 03:44:25.722158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.097 [2024-11-21 03:44:25.722279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.097 [2024-11-21 03:44:25.722304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.097 qpair failed and we were unable to recover it. 00:27:45.097 [2024-11-21 03:44:25.722407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.097 [2024-11-21 03:44:25.722564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.097 [2024-11-21 03:44:25.722589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.097 qpair failed and we were unable to recover it. 00:27:45.097 [2024-11-21 03:44:25.722775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.098 [2024-11-21 03:44:25.722869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.098 [2024-11-21 03:44:25.722893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.098 qpair failed and we were unable to recover it. 00:27:45.098 [2024-11-21 03:44:25.723035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.098 [2024-11-21 03:44:25.723152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.098 [2024-11-21 03:44:25.723177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.098 qpair failed and we were unable to recover it. 00:27:45.098 [2024-11-21 03:44:25.723289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.098 [2024-11-21 03:44:25.723402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.098 [2024-11-21 03:44:25.723427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.098 qpair failed and we were unable to recover it. 00:27:45.098 [2024-11-21 03:44:25.723534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.098 [2024-11-21 03:44:25.723660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.098 [2024-11-21 03:44:25.723684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.098 qpair failed and we were unable to recover it. 00:27:45.098 [2024-11-21 03:44:25.723780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.098 [2024-11-21 03:44:25.723901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.098 [2024-11-21 03:44:25.723926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.098 qpair failed and we were unable to recover it. 00:27:45.098 [2024-11-21 03:44:25.724020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.098 [2024-11-21 03:44:25.724143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.098 [2024-11-21 03:44:25.724168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.098 qpair failed and we were unable to recover it. 00:27:45.098 [2024-11-21 03:44:25.724297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.098 [2024-11-21 03:44:25.724397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.098 [2024-11-21 03:44:25.724422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.098 qpair failed and we were unable to recover it. 00:27:45.098 [2024-11-21 03:44:25.724578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.098 [2024-11-21 03:44:25.724754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.098 [2024-11-21 03:44:25.724779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.098 qpair failed and we were unable to recover it. 00:27:45.098 [2024-11-21 03:44:25.724902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.098 [2024-11-21 03:44:25.725027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.098 [2024-11-21 03:44:25.725051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.098 qpair failed and we were unable to recover it. 00:27:45.098 [2024-11-21 03:44:25.725226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.098 [2024-11-21 03:44:25.725335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.098 [2024-11-21 03:44:25.725360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.383 qpair failed and we were unable to recover it. 00:27:45.383 [2024-11-21 03:44:25.725526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.383 [2024-11-21 03:44:25.725625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.383 [2024-11-21 03:44:25.725652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.383 qpair failed and we were unable to recover it. 00:27:45.383 [2024-11-21 03:44:25.725772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.383 [2024-11-21 03:44:25.725923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.383 [2024-11-21 03:44:25.725950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.383 qpair failed and we were unable to recover it. 00:27:45.383 [2024-11-21 03:44:25.726131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.383 [2024-11-21 03:44:25.726237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.383 [2024-11-21 03:44:25.726267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.383 qpair failed and we were unable to recover it. 00:27:45.383 [2024-11-21 03:44:25.726373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.383 [2024-11-21 03:44:25.726524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.383 [2024-11-21 03:44:25.726550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.383 qpair failed and we were unable to recover it. 00:27:45.383 [2024-11-21 03:44:25.726658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.383 [2024-11-21 03:44:25.726783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.383 [2024-11-21 03:44:25.726808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.383 qpair failed and we were unable to recover it. 00:27:45.383 [2024-11-21 03:44:25.726946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.383 [2024-11-21 03:44:25.727091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.383 [2024-11-21 03:44:25.727119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.383 qpair failed and we were unable to recover it. 00:27:45.383 [2024-11-21 03:44:25.727254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.383 [2024-11-21 03:44:25.727361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.383 [2024-11-21 03:44:25.727385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.383 qpair failed and we were unable to recover it. 00:27:45.383 [2024-11-21 03:44:25.727537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.383 [2024-11-21 03:44:25.727658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.383 [2024-11-21 03:44:25.727683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.383 qpair failed and we were unable to recover it. 00:27:45.383 [2024-11-21 03:44:25.727786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.383 [2024-11-21 03:44:25.727930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.383 [2024-11-21 03:44:25.727958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.383 qpair failed and we were unable to recover it. 00:27:45.383 [2024-11-21 03:44:25.728100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.383 [2024-11-21 03:44:25.728252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.383 [2024-11-21 03:44:25.728281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.383 qpair failed and we were unable to recover it. 00:27:45.383 [2024-11-21 03:44:25.728413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.383 [2024-11-21 03:44:25.728515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.383 [2024-11-21 03:44:25.728539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.383 qpair failed and we were unable to recover it. 00:27:45.383 [2024-11-21 03:44:25.728646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.383 [2024-11-21 03:44:25.728765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.383 [2024-11-21 03:44:25.728791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.383 qpair failed and we were unable to recover it. 00:27:45.383 [2024-11-21 03:44:25.728940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.383 [2024-11-21 03:44:25.729091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.383 [2024-11-21 03:44:25.729121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.383 qpair failed and we were unable to recover it. 00:27:45.383 [2024-11-21 03:44:25.729251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.383 [2024-11-21 03:44:25.729405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.383 [2024-11-21 03:44:25.729447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.383 qpair failed and we were unable to recover it. 00:27:45.383 [2024-11-21 03:44:25.729589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.383 [2024-11-21 03:44:25.729694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.383 [2024-11-21 03:44:25.729722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.383 qpair failed and we were unable to recover it. 00:27:45.383 [2024-11-21 03:44:25.729888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.383 [2024-11-21 03:44:25.730028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.383 [2024-11-21 03:44:25.730056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.383 qpair failed and we were unable to recover it. 00:27:45.383 [2024-11-21 03:44:25.730306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.383 [2024-11-21 03:44:25.730407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.384 [2024-11-21 03:44:25.730432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.384 qpair failed and we were unable to recover it. 00:27:45.384 [2024-11-21 03:44:25.730585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.384 [2024-11-21 03:44:25.730742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.384 [2024-11-21 03:44:25.730767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.384 qpair failed and we were unable to recover it. 00:27:45.384 [2024-11-21 03:44:25.730866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.384 [2024-11-21 03:44:25.731019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.384 [2024-11-21 03:44:25.731045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.384 qpair failed and we were unable to recover it. 00:27:45.384 [2024-11-21 03:44:25.731161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.384 [2024-11-21 03:44:25.731264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.384 [2024-11-21 03:44:25.731289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.384 qpair failed and we were unable to recover it. 00:27:45.384 [2024-11-21 03:44:25.731444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.384 [2024-11-21 03:44:25.731562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.384 [2024-11-21 03:44:25.731590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.384 qpair failed and we were unable to recover it. 00:27:45.384 [2024-11-21 03:44:25.731703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.384 [2024-11-21 03:44:25.731815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.384 [2024-11-21 03:44:25.731843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.384 qpair failed and we were unable to recover it. 00:27:45.384 [2024-11-21 03:44:25.731977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.384 [2024-11-21 03:44:25.732109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.384 [2024-11-21 03:44:25.732135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.384 qpair failed and we were unable to recover it. 00:27:45.384 [2024-11-21 03:44:25.732269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.384 [2024-11-21 03:44:25.732390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.384 [2024-11-21 03:44:25.732417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.384 qpair failed and we were unable to recover it. 00:27:45.384 [2024-11-21 03:44:25.732517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.384 [2024-11-21 03:44:25.732657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.384 [2024-11-21 03:44:25.732697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.384 qpair failed and we were unable to recover it. 00:27:45.384 [2024-11-21 03:44:25.732833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.384 [2024-11-21 03:44:25.733019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.384 [2024-11-21 03:44:25.733046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.384 qpair failed and we were unable to recover it. 00:27:45.384 [2024-11-21 03:44:25.733212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.384 [2024-11-21 03:44:25.733344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.384 [2024-11-21 03:44:25.733369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.384 qpair failed and we were unable to recover it. 00:27:45.384 [2024-11-21 03:44:25.733462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.384 [2024-11-21 03:44:25.733595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.384 [2024-11-21 03:44:25.733619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.384 qpair failed and we were unable to recover it. 00:27:45.384 [2024-11-21 03:44:25.733745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.384 [2024-11-21 03:44:25.733886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.384 [2024-11-21 03:44:25.733911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.384 qpair failed and we were unable to recover it. 00:27:45.384 [2024-11-21 03:44:25.734090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.384 [2024-11-21 03:44:25.734240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.384 [2024-11-21 03:44:25.734264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.384 qpair failed and we were unable to recover it. 00:27:45.384 [2024-11-21 03:44:25.734394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.384 [2024-11-21 03:44:25.734494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.384 [2024-11-21 03:44:25.734535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.384 qpair failed and we were unable to recover it. 00:27:45.384 [2024-11-21 03:44:25.734707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.384 [2024-11-21 03:44:25.734861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.384 [2024-11-21 03:44:25.734886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.384 qpair failed and we were unable to recover it. 00:27:45.384 [2024-11-21 03:44:25.735075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.384 [2024-11-21 03:44:25.735219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.384 [2024-11-21 03:44:25.735247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.384 qpair failed and we were unable to recover it. 00:27:45.384 [2024-11-21 03:44:25.735361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.384 [2024-11-21 03:44:25.735512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.384 [2024-11-21 03:44:25.735536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.384 qpair failed and we were unable to recover it. 00:27:45.384 [2024-11-21 03:44:25.735666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.384 [2024-11-21 03:44:25.735798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.384 [2024-11-21 03:44:25.735822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.384 qpair failed and we were unable to recover it. 00:27:45.384 [2024-11-21 03:44:25.735954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.384 [2024-11-21 03:44:25.736060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.384 [2024-11-21 03:44:25.736095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.384 qpair failed and we were unable to recover it. 00:27:45.384 [2024-11-21 03:44:25.736208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.384 [2024-11-21 03:44:25.736358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.384 [2024-11-21 03:44:25.736383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.384 qpair failed and we were unable to recover it. 00:27:45.384 [2024-11-21 03:44:25.736510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.384 [2024-11-21 03:44:25.736637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.384 [2024-11-21 03:44:25.736661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.384 qpair failed and we were unable to recover it. 00:27:45.384 [2024-11-21 03:44:25.736839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.384 [2024-11-21 03:44:25.736989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.384 [2024-11-21 03:44:25.737014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.384 qpair failed and we were unable to recover it. 00:27:45.384 [2024-11-21 03:44:25.737113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.384 [2024-11-21 03:44:25.737245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.384 [2024-11-21 03:44:25.737287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.384 qpair failed and we were unable to recover it. 00:27:45.384 [2024-11-21 03:44:25.737408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.384 [2024-11-21 03:44:25.737566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.384 [2024-11-21 03:44:25.737591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.384 qpair failed and we were unable to recover it. 00:27:45.384 [2024-11-21 03:44:25.737721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.384 [2024-11-21 03:44:25.737859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.384 [2024-11-21 03:44:25.737886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.384 qpair failed and we were unable to recover it. 00:27:45.384 [2024-11-21 03:44:25.738022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.384 [2024-11-21 03:44:25.738167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.384 [2024-11-21 03:44:25.738195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.384 qpair failed and we were unable to recover it. 00:27:45.384 [2024-11-21 03:44:25.738316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.384 [2024-11-21 03:44:25.738453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.384 [2024-11-21 03:44:25.738479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.384 qpair failed and we were unable to recover it. 00:27:45.384 [2024-11-21 03:44:25.738624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.384 [2024-11-21 03:44:25.738800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.384 [2024-11-21 03:44:25.738825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.384 qpair failed and we were unable to recover it. 00:27:45.384 [2024-11-21 03:44:25.738952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.384 [2024-11-21 03:44:25.739078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.385 [2024-11-21 03:44:25.739119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.385 qpair failed and we were unable to recover it. 00:27:45.385 [2024-11-21 03:44:25.739226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.385 [2024-11-21 03:44:25.739324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.385 [2024-11-21 03:44:25.739349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.385 qpair failed and we were unable to recover it. 00:27:45.385 [2024-11-21 03:44:25.739454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.385 [2024-11-21 03:44:25.739597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.385 [2024-11-21 03:44:25.739625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.385 qpair failed and we were unable to recover it. 00:27:45.385 [2024-11-21 03:44:25.739745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.385 [2024-11-21 03:44:25.739887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.385 [2024-11-21 03:44:25.739913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.385 qpair failed and we were unable to recover it. 00:27:45.385 [2024-11-21 03:44:25.740033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.385 [2024-11-21 03:44:25.740165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.385 [2024-11-21 03:44:25.740190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.385 qpair failed and we were unable to recover it. 00:27:45.385 [2024-11-21 03:44:25.740344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.385 [2024-11-21 03:44:25.740502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.385 [2024-11-21 03:44:25.740530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.385 qpair failed and we were unable to recover it. 00:27:45.385 [2024-11-21 03:44:25.740698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.385 [2024-11-21 03:44:25.740849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.385 [2024-11-21 03:44:25.740874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.385 qpair failed and we were unable to recover it. 00:27:45.385 [2024-11-21 03:44:25.741014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.385 [2024-11-21 03:44:25.741124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.385 [2024-11-21 03:44:25.741150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.385 qpair failed and we were unable to recover it. 00:27:45.385 [2024-11-21 03:44:25.741280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.385 [2024-11-21 03:44:25.741434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.385 [2024-11-21 03:44:25.741461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.385 qpair failed and we were unable to recover it. 00:27:45.385 [2024-11-21 03:44:25.741635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.385 [2024-11-21 03:44:25.741768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.385 [2024-11-21 03:44:25.741793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.385 qpair failed and we were unable to recover it. 00:27:45.385 [2024-11-21 03:44:25.741920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.385 [2024-11-21 03:44:25.742019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.385 [2024-11-21 03:44:25.742044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.385 qpair failed and we were unable to recover it. 00:27:45.385 [2024-11-21 03:44:25.742216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.385 [2024-11-21 03:44:25.742364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.385 [2024-11-21 03:44:25.742392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.385 qpair failed and we were unable to recover it. 00:27:45.385 [2024-11-21 03:44:25.742511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.385 [2024-11-21 03:44:25.742642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.385 [2024-11-21 03:44:25.742670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.385 qpair failed and we were unable to recover it. 00:27:45.385 [2024-11-21 03:44:25.742797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.385 [2024-11-21 03:44:25.742902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.385 [2024-11-21 03:44:25.742928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.385 qpair failed and we were unable to recover it. 00:27:45.385 [2024-11-21 03:44:25.743082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.385 [2024-11-21 03:44:25.743232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.385 [2024-11-21 03:44:25.743257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.385 qpair failed and we were unable to recover it. 00:27:45.385 [2024-11-21 03:44:25.743406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.385 [2024-11-21 03:44:25.743549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.385 [2024-11-21 03:44:25.743577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.385 qpair failed and we were unable to recover it. 00:27:45.385 [2024-11-21 03:44:25.743701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.385 [2024-11-21 03:44:25.743807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.385 [2024-11-21 03:44:25.743831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.385 qpair failed and we were unable to recover it. 00:27:45.385 [2024-11-21 03:44:25.743982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.385 [2024-11-21 03:44:25.744123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.385 [2024-11-21 03:44:25.744153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.385 qpair failed and we were unable to recover it. 00:27:45.385 [2024-11-21 03:44:25.744276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.385 [2024-11-21 03:44:25.744423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.385 [2024-11-21 03:44:25.744456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.385 qpair failed and we were unable to recover it. 00:27:45.385 [2024-11-21 03:44:25.744580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.385 [2024-11-21 03:44:25.744700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.385 [2024-11-21 03:44:25.744726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.385 qpair failed and we were unable to recover it. 00:27:45.385 [2024-11-21 03:44:25.744868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.385 [2024-11-21 03:44:25.745008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.385 [2024-11-21 03:44:25.745036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.385 qpair failed and we were unable to recover it. 00:27:45.385 [2024-11-21 03:44:25.745195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.385 [2024-11-21 03:44:25.745323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.385 [2024-11-21 03:44:25.745347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.385 qpair failed and we were unable to recover it. 00:27:45.385 [2024-11-21 03:44:25.745500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.385 [2024-11-21 03:44:25.745620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.385 [2024-11-21 03:44:25.745645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.385 qpair failed and we were unable to recover it. 00:27:45.385 [2024-11-21 03:44:25.745754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.385 [2024-11-21 03:44:25.745875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.385 [2024-11-21 03:44:25.745904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.385 qpair failed and we were unable to recover it. 00:27:45.385 [2024-11-21 03:44:25.746009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.385 [2024-11-21 03:44:25.746164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.385 [2024-11-21 03:44:25.746189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.385 qpair failed and we were unable to recover it. 00:27:45.385 [2024-11-21 03:44:25.746320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.385 [2024-11-21 03:44:25.746475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.385 [2024-11-21 03:44:25.746499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.385 qpair failed and we were unable to recover it. 00:27:45.385 [2024-11-21 03:44:25.746656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.385 [2024-11-21 03:44:25.746765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.385 [2024-11-21 03:44:25.746793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.385 qpair failed and we were unable to recover it. 00:27:45.385 [2024-11-21 03:44:25.746931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.385 [2024-11-21 03:44:25.747084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.385 [2024-11-21 03:44:25.747113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.385 qpair failed and we were unable to recover it. 00:27:45.385 [2024-11-21 03:44:25.747266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.385 [2024-11-21 03:44:25.747417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.385 [2024-11-21 03:44:25.747441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.386 qpair failed and we were unable to recover it. 00:27:45.386 [2024-11-21 03:44:25.747620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.386 [2024-11-21 03:44:25.747752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.386 [2024-11-21 03:44:25.747776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.386 qpair failed and we were unable to recover it. 00:27:45.386 [2024-11-21 03:44:25.747925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.386 [2024-11-21 03:44:25.748088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.386 [2024-11-21 03:44:25.748133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.386 qpair failed and we were unable to recover it. 00:27:45.386 [2024-11-21 03:44:25.748239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.386 [2024-11-21 03:44:25.748367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.386 [2024-11-21 03:44:25.748393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.386 qpair failed and we were unable to recover it. 00:27:45.386 [2024-11-21 03:44:25.748545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.386 [2024-11-21 03:44:25.748703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.386 [2024-11-21 03:44:25.748727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.386 qpair failed and we were unable to recover it. 00:27:45.386 [2024-11-21 03:44:25.748878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.386 [2024-11-21 03:44:25.749067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.386 [2024-11-21 03:44:25.749103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.386 qpair failed and we were unable to recover it. 00:27:45.386 [2024-11-21 03:44:25.749227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.386 [2024-11-21 03:44:25.749360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.386 [2024-11-21 03:44:25.749385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.386 qpair failed and we were unable to recover it. 00:27:45.386 [2024-11-21 03:44:25.749513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.386 [2024-11-21 03:44:25.749692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.386 [2024-11-21 03:44:25.749717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.386 qpair failed and we were unable to recover it. 00:27:45.386 [2024-11-21 03:44:25.749818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.386 [2024-11-21 03:44:25.749969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.386 [2024-11-21 03:44:25.749997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.386 qpair failed and we were unable to recover it. 00:27:45.386 [2024-11-21 03:44:25.750179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.386 [2024-11-21 03:44:25.750283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.386 [2024-11-21 03:44:25.750309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.386 qpair failed and we were unable to recover it. 00:27:45.386 [2024-11-21 03:44:25.750470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.386 [2024-11-21 03:44:25.750642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.386 [2024-11-21 03:44:25.750667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.386 qpair failed and we were unable to recover it. 00:27:45.386 [2024-11-21 03:44:25.750828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.386 [2024-11-21 03:44:25.750981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.386 [2024-11-21 03:44:25.751009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.386 qpair failed and we were unable to recover it. 00:27:45.386 [2024-11-21 03:44:25.751168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.386 [2024-11-21 03:44:25.751324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.386 [2024-11-21 03:44:25.751349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.386 qpair failed and we were unable to recover it. 00:27:45.386 [2024-11-21 03:44:25.751508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.386 [2024-11-21 03:44:25.751637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.386 [2024-11-21 03:44:25.751662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.386 qpair failed and we were unable to recover it. 00:27:45.386 [2024-11-21 03:44:25.751790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.386 [2024-11-21 03:44:25.751922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.386 [2024-11-21 03:44:25.751947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.386 qpair failed and we were unable to recover it. 00:27:45.386 [2024-11-21 03:44:25.752084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.386 [2024-11-21 03:44:25.752189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.386 [2024-11-21 03:44:25.752215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.386 qpair failed and we were unable to recover it. 00:27:45.386 [2024-11-21 03:44:25.752336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.386 [2024-11-21 03:44:25.752476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.386 [2024-11-21 03:44:25.752503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.386 qpair failed and we were unable to recover it. 00:27:45.386 [2024-11-21 03:44:25.752619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.386 [2024-11-21 03:44:25.752730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.386 [2024-11-21 03:44:25.752760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.386 qpair failed and we were unable to recover it. 00:27:45.386 [2024-11-21 03:44:25.752908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.386 [2024-11-21 03:44:25.753033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.386 [2024-11-21 03:44:25.753057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.386 qpair failed and we were unable to recover it. 00:27:45.386 [2024-11-21 03:44:25.753184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.386 [2024-11-21 03:44:25.753301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.386 [2024-11-21 03:44:25.753342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.386 qpair failed and we were unable to recover it. 00:27:45.386 [2024-11-21 03:44:25.753474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.386 [2024-11-21 03:44:25.753618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.386 [2024-11-21 03:44:25.753658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.386 qpair failed and we were unable to recover it. 00:27:45.386 [2024-11-21 03:44:25.753821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.386 [2024-11-21 03:44:25.753943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.386 [2024-11-21 03:44:25.753986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.386 qpair failed and we were unable to recover it. 00:27:45.386 [2024-11-21 03:44:25.754126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.386 [2024-11-21 03:44:25.754248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.386 [2024-11-21 03:44:25.754273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.386 qpair failed and we were unable to recover it. 00:27:45.386 [2024-11-21 03:44:25.754379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.386 [2024-11-21 03:44:25.754554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.386 [2024-11-21 03:44:25.754582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.386 qpair failed and we were unable to recover it. 00:27:45.386 [2024-11-21 03:44:25.754731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.386 [2024-11-21 03:44:25.754834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.386 [2024-11-21 03:44:25.754859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.386 qpair failed and we were unable to recover it. 00:27:45.386 [2024-11-21 03:44:25.755015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.386 [2024-11-21 03:44:25.755169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.386 [2024-11-21 03:44:25.755197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.386 qpair failed and we were unable to recover it. 00:27:45.386 [2024-11-21 03:44:25.755311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.386 [2024-11-21 03:44:25.755462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.386 [2024-11-21 03:44:25.755487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.386 qpair failed and we were unable to recover it. 00:27:45.386 [2024-11-21 03:44:25.755641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.386 [2024-11-21 03:44:25.755770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.386 [2024-11-21 03:44:25.755795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.386 qpair failed and we were unable to recover it. 00:27:45.386 [2024-11-21 03:44:25.755936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.386 [2024-11-21 03:44:25.756118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.386 [2024-11-21 03:44:25.756145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.386 qpair failed and we were unable to recover it. 00:27:45.386 [2024-11-21 03:44:25.756276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.387 [2024-11-21 03:44:25.756456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.387 [2024-11-21 03:44:25.756483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.387 qpair failed and we were unable to recover it. 00:27:45.387 [2024-11-21 03:44:25.756603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.387 [2024-11-21 03:44:25.756757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.387 [2024-11-21 03:44:25.756781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.387 qpair failed and we were unable to recover it. 00:27:45.387 [2024-11-21 03:44:25.756904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.387 [2024-11-21 03:44:25.757049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.387 [2024-11-21 03:44:25.757083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.387 qpair failed and we were unable to recover it. 00:27:45.387 [2024-11-21 03:44:25.757258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.387 [2024-11-21 03:44:25.757406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.387 [2024-11-21 03:44:25.757434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.387 qpair failed and we were unable to recover it. 00:27:45.387 [2024-11-21 03:44:25.757602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.387 [2024-11-21 03:44:25.757703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.387 [2024-11-21 03:44:25.757727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.387 qpair failed and we were unable to recover it. 00:27:45.387 [2024-11-21 03:44:25.757881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.387 [2024-11-21 03:44:25.758003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.387 [2024-11-21 03:44:25.758030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.387 qpair failed and we were unable to recover it. 00:27:45.387 [2024-11-21 03:44:25.758186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.387 [2024-11-21 03:44:25.758354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.387 [2024-11-21 03:44:25.758381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.387 qpair failed and we were unable to recover it. 00:27:45.387 [2024-11-21 03:44:25.758552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.387 [2024-11-21 03:44:25.758679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.387 [2024-11-21 03:44:25.758704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.387 qpair failed and we were unable to recover it. 00:27:45.387 [2024-11-21 03:44:25.758828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.387 [2024-11-21 03:44:25.758974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.387 [2024-11-21 03:44:25.759002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.387 qpair failed and we were unable to recover it. 00:27:45.387 [2024-11-21 03:44:25.759177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.387 [2024-11-21 03:44:25.759304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.387 [2024-11-21 03:44:25.759330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.387 qpair failed and we were unable to recover it. 00:27:45.387 [2024-11-21 03:44:25.759456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.387 [2024-11-21 03:44:25.759583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.387 [2024-11-21 03:44:25.759610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.387 qpair failed and we were unable to recover it. 00:27:45.387 [2024-11-21 03:44:25.759750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.387 [2024-11-21 03:44:25.759916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.387 [2024-11-21 03:44:25.759944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.387 qpair failed and we were unable to recover it. 00:27:45.387 [2024-11-21 03:44:25.760057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.387 [2024-11-21 03:44:25.760207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.387 [2024-11-21 03:44:25.760240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.387 qpair failed and we were unable to recover it. 00:27:45.387 [2024-11-21 03:44:25.760418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.387 [2024-11-21 03:44:25.760524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.387 [2024-11-21 03:44:25.760549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.387 qpair failed and we were unable to recover it. 00:27:45.387 [2024-11-21 03:44:25.760725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.387 [2024-11-21 03:44:25.760893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.387 [2024-11-21 03:44:25.760921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.387 qpair failed and we were unable to recover it. 00:27:45.387 [2024-11-21 03:44:25.761061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.387 [2024-11-21 03:44:25.761216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.387 [2024-11-21 03:44:25.761244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.387 qpair failed and we were unable to recover it. 00:27:45.387 [2024-11-21 03:44:25.761372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.387 [2024-11-21 03:44:25.761503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.387 [2024-11-21 03:44:25.761527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.387 qpair failed and we were unable to recover it. 00:27:45.387 [2024-11-21 03:44:25.761700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.387 [2024-11-21 03:44:25.761846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.387 [2024-11-21 03:44:25.761870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.387 qpair failed and we were unable to recover it. 00:27:45.387 [2024-11-21 03:44:25.762012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.387 [2024-11-21 03:44:25.762184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.387 [2024-11-21 03:44:25.762214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.387 qpair failed and we were unable to recover it. 00:27:45.387 [2024-11-21 03:44:25.762390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.387 [2024-11-21 03:44:25.762544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.387 [2024-11-21 03:44:25.762586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.387 qpair failed and we were unable to recover it. 00:27:45.387 [2024-11-21 03:44:25.762718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.387 [2024-11-21 03:44:25.762885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.387 [2024-11-21 03:44:25.762909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.387 qpair failed and we were unable to recover it. 00:27:45.387 [2024-11-21 03:44:25.763040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.387 [2024-11-21 03:44:25.763201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.387 [2024-11-21 03:44:25.763229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.387 qpair failed and we were unable to recover it. 00:27:45.387 [2024-11-21 03:44:25.763354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.387 [2024-11-21 03:44:25.763451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.387 [2024-11-21 03:44:25.763477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.387 qpair failed and we were unable to recover it. 00:27:45.387 [2024-11-21 03:44:25.763610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.387 [2024-11-21 03:44:25.763720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.387 [2024-11-21 03:44:25.763746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.387 qpair failed and we were unable to recover it. 00:27:45.387 [2024-11-21 03:44:25.763872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.387 [2024-11-21 03:44:25.764005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.387 [2024-11-21 03:44:25.764033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.387 qpair failed and we were unable to recover it. 00:27:45.387 [2024-11-21 03:44:25.764194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.387 [2024-11-21 03:44:25.764295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.387 [2024-11-21 03:44:25.764319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.387 qpair failed and we were unable to recover it. 00:27:45.387 [2024-11-21 03:44:25.764465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.387 [2024-11-21 03:44:25.764580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.388 [2024-11-21 03:44:25.764607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.388 qpair failed and we were unable to recover it. 00:27:45.388 [2024-11-21 03:44:25.764723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.388 [2024-11-21 03:44:25.764859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.388 [2024-11-21 03:44:25.764887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.388 qpair failed and we were unable to recover it. 00:27:45.388 [2024-11-21 03:44:25.765055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.388 [2024-11-21 03:44:25.765206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.388 [2024-11-21 03:44:25.765231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.388 qpair failed and we were unable to recover it. 00:27:45.388 [2024-11-21 03:44:25.765335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.388 [2024-11-21 03:44:25.765487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.388 [2024-11-21 03:44:25.765514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.388 qpair failed and we were unable to recover it. 00:27:45.388 [2024-11-21 03:44:25.765654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.388 [2024-11-21 03:44:25.765798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.388 [2024-11-21 03:44:25.765823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.388 qpair failed and we were unable to recover it. 00:27:45.388 [2024-11-21 03:44:25.765951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.388 [2024-11-21 03:44:25.766092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.388 [2024-11-21 03:44:25.766118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.388 qpair failed and we were unable to recover it. 00:27:45.388 [2024-11-21 03:44:25.766246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.388 [2024-11-21 03:44:25.766357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.388 [2024-11-21 03:44:25.766383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.388 qpair failed and we were unable to recover it. 00:27:45.388 [2024-11-21 03:44:25.766546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.388 [2024-11-21 03:44:25.766678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.388 [2024-11-21 03:44:25.766703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.388 qpair failed and we were unable to recover it. 00:27:45.388 [2024-11-21 03:44:25.766830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.388 [2024-11-21 03:44:25.766933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.388 [2024-11-21 03:44:25.766958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.388 qpair failed and we were unable to recover it. 00:27:45.388 [2024-11-21 03:44:25.767105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.388 [2024-11-21 03:44:25.767210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.388 [2024-11-21 03:44:25.767237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.388 qpair failed and we were unable to recover it. 00:27:45.388 [2024-11-21 03:44:25.767346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.388 [2024-11-21 03:44:25.767530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.388 [2024-11-21 03:44:25.767555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.388 qpair failed and we were unable to recover it. 00:27:45.388 [2024-11-21 03:44:25.767685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.388 [2024-11-21 03:44:25.767788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.388 [2024-11-21 03:44:25.767812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.388 qpair failed and we were unable to recover it. 00:27:45.388 [2024-11-21 03:44:25.767934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.388 [2024-11-21 03:44:25.768077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.388 [2024-11-21 03:44:25.768105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.388 qpair failed and we were unable to recover it. 00:27:45.388 [2024-11-21 03:44:25.768222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.388 [2024-11-21 03:44:25.768379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.388 [2024-11-21 03:44:25.768404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.388 qpair failed and we were unable to recover it. 00:27:45.388 [2024-11-21 03:44:25.768559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.388 [2024-11-21 03:44:25.768655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.388 [2024-11-21 03:44:25.768680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.388 qpair failed and we were unable to recover it. 00:27:45.388 [2024-11-21 03:44:25.768867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.388 [2024-11-21 03:44:25.769008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.388 [2024-11-21 03:44:25.769036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.388 qpair failed and we were unable to recover it. 00:27:45.388 [2024-11-21 03:44:25.769160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.388 [2024-11-21 03:44:25.769279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.388 [2024-11-21 03:44:25.769307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.388 qpair failed and we were unable to recover it. 00:27:45.388 [2024-11-21 03:44:25.769461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.388 [2024-11-21 03:44:25.769593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.388 [2024-11-21 03:44:25.769618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.388 qpair failed and we were unable to recover it. 00:27:45.388 [2024-11-21 03:44:25.769780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.388 [2024-11-21 03:44:25.769935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.388 [2024-11-21 03:44:25.769960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.388 qpair failed and we were unable to recover it. 00:27:45.388 [2024-11-21 03:44:25.770096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.388 [2024-11-21 03:44:25.770244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.388 [2024-11-21 03:44:25.770272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.388 qpair failed and we were unable to recover it. 00:27:45.388 [2024-11-21 03:44:25.770432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.388 [2024-11-21 03:44:25.770562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.388 [2024-11-21 03:44:25.770589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.388 qpair failed and we were unable to recover it. 00:27:45.388 [2024-11-21 03:44:25.770716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.388 [2024-11-21 03:44:25.770856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.388 [2024-11-21 03:44:25.770884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.388 qpair failed and we were unable to recover it. 00:27:45.388 [2024-11-21 03:44:25.771063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.388 [2024-11-21 03:44:25.771224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.388 [2024-11-21 03:44:25.771265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.388 qpair failed and we were unable to recover it. 00:27:45.388 [2024-11-21 03:44:25.771397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.388 [2024-11-21 03:44:25.771524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.388 [2024-11-21 03:44:25.771549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.388 qpair failed and we were unable to recover it. 00:27:45.388 [2024-11-21 03:44:25.771710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.388 [2024-11-21 03:44:25.771805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.389 [2024-11-21 03:44:25.771831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.389 qpair failed and we were unable to recover it. 00:27:45.389 [2024-11-21 03:44:25.771983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.389 [2024-11-21 03:44:25.772132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.389 [2024-11-21 03:44:25.772163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.389 qpair failed and we were unable to recover it. 00:27:45.389 [2024-11-21 03:44:25.772311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.389 [2024-11-21 03:44:25.772447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.389 [2024-11-21 03:44:25.772471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.389 qpair failed and we were unable to recover it. 00:27:45.389 [2024-11-21 03:44:25.772628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.389 [2024-11-21 03:44:25.772771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.389 [2024-11-21 03:44:25.772799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.389 qpair failed and we were unable to recover it. 00:27:45.389 [2024-11-21 03:44:25.772937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.389 [2024-11-21 03:44:25.773047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.389 [2024-11-21 03:44:25.773080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.389 qpair failed and we were unable to recover it. 00:27:45.389 [2024-11-21 03:44:25.773226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.389 [2024-11-21 03:44:25.773316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.389 [2024-11-21 03:44:25.773340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.389 qpair failed and we were unable to recover it. 00:27:45.389 [2024-11-21 03:44:25.773489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.389 [2024-11-21 03:44:25.773621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.389 [2024-11-21 03:44:25.773650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.389 qpair failed and we were unable to recover it. 00:27:45.389 [2024-11-21 03:44:25.773757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.389 [2024-11-21 03:44:25.773876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.389 [2024-11-21 03:44:25.773904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.389 qpair failed and we were unable to recover it. 00:27:45.389 [2024-11-21 03:44:25.774090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.389 [2024-11-21 03:44:25.774222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.389 [2024-11-21 03:44:25.774264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.389 qpair failed and we were unable to recover it. 00:27:45.389 [2024-11-21 03:44:25.774386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.389 [2024-11-21 03:44:25.774499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.389 [2024-11-21 03:44:25.774528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.389 qpair failed and we were unable to recover it. 00:27:45.389 [2024-11-21 03:44:25.774686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.389 [2024-11-21 03:44:25.774817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.389 [2024-11-21 03:44:25.774841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.389 qpair failed and we were unable to recover it. 00:27:45.389 [2024-11-21 03:44:25.774961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.389 [2024-11-21 03:44:25.775093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.389 [2024-11-21 03:44:25.775118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.389 qpair failed and we were unable to recover it. 00:27:45.389 [2024-11-21 03:44:25.775228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.389 [2024-11-21 03:44:25.775352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.389 [2024-11-21 03:44:25.775377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.389 qpair failed and we were unable to recover it. 00:27:45.389 [2024-11-21 03:44:25.775512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.389 [2024-11-21 03:44:25.775666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.389 [2024-11-21 03:44:25.775695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.389 qpair failed and we were unable to recover it. 00:27:45.389 [2024-11-21 03:44:25.775802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.389 [2024-11-21 03:44:25.775930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.389 [2024-11-21 03:44:25.775955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.389 qpair failed and we were unable to recover it. 00:27:45.389 [2024-11-21 03:44:25.776111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.389 [2024-11-21 03:44:25.776227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.389 [2024-11-21 03:44:25.776254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.389 qpair failed and we were unable to recover it. 00:27:45.389 [2024-11-21 03:44:25.776399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.389 [2024-11-21 03:44:25.776515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.389 [2024-11-21 03:44:25.776543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.389 qpair failed and we were unable to recover it. 00:27:45.389 [2024-11-21 03:44:25.776722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.389 [2024-11-21 03:44:25.776848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.389 [2024-11-21 03:44:25.776873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.389 qpair failed and we were unable to recover it. 00:27:45.389 [2024-11-21 03:44:25.777000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.389 [2024-11-21 03:44:25.777130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.389 [2024-11-21 03:44:25.777158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.389 qpair failed and we were unable to recover it. 00:27:45.389 [2024-11-21 03:44:25.777275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.389 [2024-11-21 03:44:25.777417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.389 [2024-11-21 03:44:25.777444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.389 qpair failed and we were unable to recover it. 00:27:45.389 [2024-11-21 03:44:25.777578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.389 [2024-11-21 03:44:25.777706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.389 [2024-11-21 03:44:25.777730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.389 qpair failed and we were unable to recover it. 00:27:45.389 [2024-11-21 03:44:25.777833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.389 [2024-11-21 03:44:25.777938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.389 [2024-11-21 03:44:25.777962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.389 qpair failed and we were unable to recover it. 00:27:45.389 [2024-11-21 03:44:25.778110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.389 [2024-11-21 03:44:25.778226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.389 [2024-11-21 03:44:25.778253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.389 qpair failed and we were unable to recover it. 00:27:45.389 [2024-11-21 03:44:25.778402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.389 [2024-11-21 03:44:25.778506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.389 [2024-11-21 03:44:25.778530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.389 qpair failed and we were unable to recover it. 00:27:45.389 [2024-11-21 03:44:25.778650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.389 [2024-11-21 03:44:25.778780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.389 [2024-11-21 03:44:25.778805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.389 qpair failed and we were unable to recover it. 00:27:45.389 [2024-11-21 03:44:25.778909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.389 [2024-11-21 03:44:25.779043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.389 [2024-11-21 03:44:25.779074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.389 qpair failed and we were unable to recover it. 00:27:45.389 [2024-11-21 03:44:25.779204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.389 [2024-11-21 03:44:25.779309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.389 [2024-11-21 03:44:25.779333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.389 qpair failed and we were unable to recover it. 00:27:45.389 [2024-11-21 03:44:25.779479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.389 [2024-11-21 03:44:25.779600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.389 [2024-11-21 03:44:25.779625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.389 qpair failed and we were unable to recover it. 00:27:45.389 [2024-11-21 03:44:25.779760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.389 [2024-11-21 03:44:25.779906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.390 [2024-11-21 03:44:25.779933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.390 qpair failed and we were unable to recover it. 00:27:45.390 [2024-11-21 03:44:25.780111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.390 [2024-11-21 03:44:25.780266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.390 [2024-11-21 03:44:25.780291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.390 qpair failed and we were unable to recover it. 00:27:45.390 [2024-11-21 03:44:25.780461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.390 [2024-11-21 03:44:25.780569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.390 [2024-11-21 03:44:25.780595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.390 qpair failed and we were unable to recover it. 00:27:45.390 [2024-11-21 03:44:25.780730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.390 [2024-11-21 03:44:25.780873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.390 [2024-11-21 03:44:25.780901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.390 qpair failed and we were unable to recover it. 00:27:45.390 [2024-11-21 03:44:25.781021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.390 [2024-11-21 03:44:25.781119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.390 [2024-11-21 03:44:25.781144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.390 qpair failed and we were unable to recover it. 00:27:45.390 [2024-11-21 03:44:25.781269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.390 [2024-11-21 03:44:25.781423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.390 [2024-11-21 03:44:25.781448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.390 qpair failed and we were unable to recover it. 00:27:45.390 [2024-11-21 03:44:25.781611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.390 [2024-11-21 03:44:25.781765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.390 [2024-11-21 03:44:25.781792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.390 qpair failed and we were unable to recover it. 00:27:45.390 [2024-11-21 03:44:25.781932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.390 [2024-11-21 03:44:25.782055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.390 [2024-11-21 03:44:25.782096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.390 qpair failed and we were unable to recover it. 00:27:45.390 [2024-11-21 03:44:25.782227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.390 [2024-11-21 03:44:25.782402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.390 [2024-11-21 03:44:25.782430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.390 qpair failed and we were unable to recover it. 00:27:45.390 [2024-11-21 03:44:25.782555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.390 [2024-11-21 03:44:25.782683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.390 [2024-11-21 03:44:25.782708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.390 qpair failed and we were unable to recover it. 00:27:45.390 [2024-11-21 03:44:25.782806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.390 [2024-11-21 03:44:25.782901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.390 [2024-11-21 03:44:25.782926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.390 qpair failed and we were unable to recover it. 00:27:45.390 [2024-11-21 03:44:25.783082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.390 [2024-11-21 03:44:25.783226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.390 [2024-11-21 03:44:25.783254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.390 qpair failed and we were unable to recover it. 00:27:45.390 [2024-11-21 03:44:25.783370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.390 [2024-11-21 03:44:25.783488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.390 [2024-11-21 03:44:25.783517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.390 qpair failed and we were unable to recover it. 00:27:45.390 [2024-11-21 03:44:25.783659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.390 [2024-11-21 03:44:25.783760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.390 [2024-11-21 03:44:25.783784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.390 qpair failed and we were unable to recover it. 00:27:45.390 [2024-11-21 03:44:25.783904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.390 [2024-11-21 03:44:25.784078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.390 [2024-11-21 03:44:25.784103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.390 qpair failed and we were unable to recover it. 00:27:45.390 [2024-11-21 03:44:25.784267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.390 [2024-11-21 03:44:25.784420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.390 [2024-11-21 03:44:25.784447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.390 qpair failed and we were unable to recover it. 00:27:45.390 [2024-11-21 03:44:25.784607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.390 [2024-11-21 03:44:25.784739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.390 [2024-11-21 03:44:25.784764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.390 qpair failed and we were unable to recover it. 00:27:45.390 [2024-11-21 03:44:25.784924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.390 [2024-11-21 03:44:25.785028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.390 [2024-11-21 03:44:25.785053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.390 qpair failed and we were unable to recover it. 00:27:45.390 [2024-11-21 03:44:25.785167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.390 [2024-11-21 03:44:25.785345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.390 [2024-11-21 03:44:25.785372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.390 qpair failed and we were unable to recover it. 00:27:45.390 [2024-11-21 03:44:25.785527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.390 [2024-11-21 03:44:25.785657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.390 [2024-11-21 03:44:25.785682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.390 qpair failed and we were unable to recover it. 00:27:45.390 [2024-11-21 03:44:25.785839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.390 [2024-11-21 03:44:25.785978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.390 [2024-11-21 03:44:25.786004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.390 qpair failed and we were unable to recover it. 00:27:45.390 [2024-11-21 03:44:25.786106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.390 [2024-11-21 03:44:25.786247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.390 [2024-11-21 03:44:25.786274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.390 qpair failed and we were unable to recover it. 00:27:45.390 [2024-11-21 03:44:25.786401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.390 [2024-11-21 03:44:25.786533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.390 [2024-11-21 03:44:25.786557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.390 qpair failed and we were unable to recover it. 00:27:45.390 [2024-11-21 03:44:25.786657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.390 [2024-11-21 03:44:25.786755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.390 [2024-11-21 03:44:25.786779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.390 qpair failed and we were unable to recover it. 00:27:45.390 [2024-11-21 03:44:25.786911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.390 [2024-11-21 03:44:25.787038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.390 [2024-11-21 03:44:25.787066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.390 qpair failed and we were unable to recover it. 00:27:45.390 [2024-11-21 03:44:25.787231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.390 [2024-11-21 03:44:25.787390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.390 [2024-11-21 03:44:25.787431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.390 qpair failed and we were unable to recover it. 00:27:45.390 [2024-11-21 03:44:25.787583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.390 [2024-11-21 03:44:25.787737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.390 [2024-11-21 03:44:25.787765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.390 qpair failed and we were unable to recover it. 00:27:45.390 [2024-11-21 03:44:25.787884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.390 [2024-11-21 03:44:25.788031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.390 [2024-11-21 03:44:25.788059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.390 qpair failed and we were unable to recover it. 00:27:45.390 [2024-11-21 03:44:25.788236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.390 [2024-11-21 03:44:25.788371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.390 [2024-11-21 03:44:25.788396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.390 qpair failed and we were unable to recover it. 00:27:45.390 [2024-11-21 03:44:25.788573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.390 [2024-11-21 03:44:25.788713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.391 [2024-11-21 03:44:25.788741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.391 qpair failed and we were unable to recover it. 00:27:45.391 [2024-11-21 03:44:25.788891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.391 [2024-11-21 03:44:25.788997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.391 [2024-11-21 03:44:25.789023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.391 qpair failed and we were unable to recover it. 00:27:45.391 [2024-11-21 03:44:25.789125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.391 [2024-11-21 03:44:25.789256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.391 [2024-11-21 03:44:25.789283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.391 qpair failed and we were unable to recover it. 00:27:45.391 [2024-11-21 03:44:25.789403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.391 [2024-11-21 03:44:25.789546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.391 [2024-11-21 03:44:25.789574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.391 qpair failed and we were unable to recover it. 00:27:45.391 [2024-11-21 03:44:25.789742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.391 [2024-11-21 03:44:25.789897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.391 [2024-11-21 03:44:25.789924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.391 qpair failed and we were unable to recover it. 00:27:45.391 [2024-11-21 03:44:25.790048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.391 [2024-11-21 03:44:25.790191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.391 [2024-11-21 03:44:25.790216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.391 qpair failed and we were unable to recover it. 00:27:45.391 [2024-11-21 03:44:25.790325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.391 [2024-11-21 03:44:25.790420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.391 [2024-11-21 03:44:25.790445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.391 qpair failed and we were unable to recover it. 00:27:45.391 [2024-11-21 03:44:25.790596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.391 [2024-11-21 03:44:25.790742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.391 [2024-11-21 03:44:25.790774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.391 qpair failed and we were unable to recover it. 00:27:45.391 [2024-11-21 03:44:25.790910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.391 [2024-11-21 03:44:25.791041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.391 [2024-11-21 03:44:25.791066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.391 qpair failed and we were unable to recover it. 00:27:45.391 [2024-11-21 03:44:25.791228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.391 [2024-11-21 03:44:25.791370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.391 [2024-11-21 03:44:25.791398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.391 qpair failed and we were unable to recover it. 00:27:45.391 [2024-11-21 03:44:25.791564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.391 [2024-11-21 03:44:25.791713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.391 [2024-11-21 03:44:25.791740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.391 qpair failed and we were unable to recover it. 00:27:45.391 [2024-11-21 03:44:25.791888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.391 [2024-11-21 03:44:25.791983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.391 [2024-11-21 03:44:25.792007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.391 qpair failed and we were unable to recover it. 00:27:45.391 [2024-11-21 03:44:25.792159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.391 [2024-11-21 03:44:25.792293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.391 [2024-11-21 03:44:25.792317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.391 qpair failed and we were unable to recover it. 00:27:45.391 [2024-11-21 03:44:25.792453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.391 [2024-11-21 03:44:25.792561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.391 [2024-11-21 03:44:25.792586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.391 qpair failed and we were unable to recover it. 00:27:45.391 [2024-11-21 03:44:25.792741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.391 [2024-11-21 03:44:25.792873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.391 [2024-11-21 03:44:25.792915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.391 qpair failed and we were unable to recover it. 00:27:45.391 [2024-11-21 03:44:25.793058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.391 [2024-11-21 03:44:25.793213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.391 [2024-11-21 03:44:25.793238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.391 qpair failed and we were unable to recover it. 00:27:45.391 [2024-11-21 03:44:25.793356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.391 [2024-11-21 03:44:25.793495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.391 [2024-11-21 03:44:25.793522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.391 qpair failed and we were unable to recover it. 00:27:45.391 [2024-11-21 03:44:25.793648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.391 [2024-11-21 03:44:25.793748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.391 [2024-11-21 03:44:25.793777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.391 qpair failed and we were unable to recover it. 00:27:45.391 [2024-11-21 03:44:25.793888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.391 [2024-11-21 03:44:25.793992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.391 [2024-11-21 03:44:25.794016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.391 qpair failed and we were unable to recover it. 00:27:45.391 [2024-11-21 03:44:25.794139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.391 [2024-11-21 03:44:25.794285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.391 [2024-11-21 03:44:25.794312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.391 qpair failed and we were unable to recover it. 00:27:45.391 [2024-11-21 03:44:25.794496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.391 [2024-11-21 03:44:25.794597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.391 [2024-11-21 03:44:25.794621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.391 qpair failed and we were unable to recover it. 00:27:45.391 [2024-11-21 03:44:25.794802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.391 [2024-11-21 03:44:25.794937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.391 [2024-11-21 03:44:25.794965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.391 qpair failed and we were unable to recover it. 00:27:45.391 [2024-11-21 03:44:25.795104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.391 [2024-11-21 03:44:25.795239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.391 [2024-11-21 03:44:25.795266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.391 qpair failed and we were unable to recover it. 00:27:45.391 [2024-11-21 03:44:25.795415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.391 [2024-11-21 03:44:25.795521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.391 [2024-11-21 03:44:25.795545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.391 qpair failed and we were unable to recover it. 00:27:45.391 [2024-11-21 03:44:25.795651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.391 [2024-11-21 03:44:25.795797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.391 [2024-11-21 03:44:25.795824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.391 qpair failed and we were unable to recover it. 00:27:45.391 [2024-11-21 03:44:25.795945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.391 [2024-11-21 03:44:25.796136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.391 [2024-11-21 03:44:25.796161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.391 qpair failed and we were unable to recover it. 00:27:45.391 [2024-11-21 03:44:25.796322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.391 [2024-11-21 03:44:25.796422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.391 [2024-11-21 03:44:25.796446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.391 qpair failed and we were unable to recover it. 00:27:45.391 [2024-11-21 03:44:25.796570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.391 [2024-11-21 03:44:25.796697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.391 [2024-11-21 03:44:25.796722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.391 qpair failed and we were unable to recover it. 00:27:45.391 [2024-11-21 03:44:25.796835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.391 [2024-11-21 03:44:25.796942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.391 [2024-11-21 03:44:25.796981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.391 qpair failed and we were unable to recover it. 00:27:45.392 [2024-11-21 03:44:25.797138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.392 [2024-11-21 03:44:25.797271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.392 [2024-11-21 03:44:25.797296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.392 qpair failed and we were unable to recover it. 00:27:45.392 [2024-11-21 03:44:25.797448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.392 [2024-11-21 03:44:25.797616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.392 [2024-11-21 03:44:25.797643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.392 qpair failed and we were unable to recover it. 00:27:45.392 [2024-11-21 03:44:25.797783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.392 [2024-11-21 03:44:25.797959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.392 [2024-11-21 03:44:25.797986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.392 qpair failed and we were unable to recover it. 00:27:45.392 [2024-11-21 03:44:25.798108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.392 [2024-11-21 03:44:25.798213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.392 [2024-11-21 03:44:25.798239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.392 qpair failed and we were unable to recover it. 00:27:45.392 [2024-11-21 03:44:25.798350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.392 [2024-11-21 03:44:25.798480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.392 [2024-11-21 03:44:25.798504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.392 qpair failed and we were unable to recover it. 00:27:45.392 [2024-11-21 03:44:25.798655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.392 [2024-11-21 03:44:25.798784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.392 [2024-11-21 03:44:25.798811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.392 qpair failed and we were unable to recover it. 00:27:45.392 [2024-11-21 03:44:25.798957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.392 [2024-11-21 03:44:25.799126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.392 [2024-11-21 03:44:25.799156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.392 qpair failed and we were unable to recover it. 00:27:45.392 [2024-11-21 03:44:25.799328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.392 [2024-11-21 03:44:25.799498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.392 [2024-11-21 03:44:25.799525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.392 qpair failed and we were unable to recover it. 00:27:45.392 [2024-11-21 03:44:25.799667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.392 [2024-11-21 03:44:25.799813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.392 [2024-11-21 03:44:25.799854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.392 qpair failed and we were unable to recover it. 00:27:45.392 [2024-11-21 03:44:25.799992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.392 [2024-11-21 03:44:25.800097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.392 [2024-11-21 03:44:25.800122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.392 qpair failed and we were unable to recover it. 00:27:45.392 [2024-11-21 03:44:25.800240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.392 [2024-11-21 03:44:25.800403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.392 [2024-11-21 03:44:25.800430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.392 qpair failed and we were unable to recover it. 00:27:45.392 [2024-11-21 03:44:25.800597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.392 [2024-11-21 03:44:25.800736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.392 [2024-11-21 03:44:25.800763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.392 qpair failed and we were unable to recover it. 00:27:45.392 [2024-11-21 03:44:25.800940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.392 [2024-11-21 03:44:25.801045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.392 [2024-11-21 03:44:25.801074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.392 qpair failed and we were unable to recover it. 00:27:45.392 [2024-11-21 03:44:25.801180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.392 [2024-11-21 03:44:25.801324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.392 [2024-11-21 03:44:25.801352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.392 qpair failed and we were unable to recover it. 00:27:45.392 [2024-11-21 03:44:25.801519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.392 [2024-11-21 03:44:25.801650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.392 [2024-11-21 03:44:25.801676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.392 qpair failed and we were unable to recover it. 00:27:45.392 [2024-11-21 03:44:25.801804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.392 [2024-11-21 03:44:25.801928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.392 [2024-11-21 03:44:25.801952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.392 qpair failed and we were unable to recover it. 00:27:45.392 [2024-11-21 03:44:25.802122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.392 [2024-11-21 03:44:25.802252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.392 [2024-11-21 03:44:25.802276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.392 qpair failed and we were unable to recover it. 00:27:45.392 [2024-11-21 03:44:25.802432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.392 [2024-11-21 03:44:25.802545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.392 [2024-11-21 03:44:25.802573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.392 qpair failed and we were unable to recover it. 00:27:45.392 [2024-11-21 03:44:25.802701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.392 [2024-11-21 03:44:25.802826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.392 [2024-11-21 03:44:25.802850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.392 qpair failed and we were unable to recover it. 00:27:45.392 [2024-11-21 03:44:25.802981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.392 [2024-11-21 03:44:25.803118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.392 [2024-11-21 03:44:25.803145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.392 qpair failed and we were unable to recover it. 00:27:45.392 [2024-11-21 03:44:25.803297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.392 [2024-11-21 03:44:25.803434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.392 [2024-11-21 03:44:25.803461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.392 qpair failed and we were unable to recover it. 00:27:45.392 [2024-11-21 03:44:25.803616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.392 [2024-11-21 03:44:25.803788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.392 [2024-11-21 03:44:25.803815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.392 qpair failed and we were unable to recover it. 00:27:45.392 [2024-11-21 03:44:25.803955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.392 [2024-11-21 03:44:25.804065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.392 [2024-11-21 03:44:25.804115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.392 qpair failed and we were unable to recover it. 00:27:45.392 [2024-11-21 03:44:25.804220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.392 [2024-11-21 03:44:25.804389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.392 [2024-11-21 03:44:25.804417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.392 qpair failed and we were unable to recover it. 00:27:45.393 [2024-11-21 03:44:25.804571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.393 [2024-11-21 03:44:25.804699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.393 [2024-11-21 03:44:25.804723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.393 qpair failed and we were unable to recover it. 00:27:45.393 [2024-11-21 03:44:25.804879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.393 [2024-11-21 03:44:25.805014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.393 [2024-11-21 03:44:25.805041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.393 qpair failed and we were unable to recover it. 00:27:45.393 [2024-11-21 03:44:25.805174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.393 [2024-11-21 03:44:25.805296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.393 [2024-11-21 03:44:25.805320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.393 qpair failed and we were unable to recover it. 00:27:45.393 [2024-11-21 03:44:25.805424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.393 [2024-11-21 03:44:25.805551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.393 [2024-11-21 03:44:25.805575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.393 qpair failed and we were unable to recover it. 00:27:45.393 [2024-11-21 03:44:25.805680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.393 [2024-11-21 03:44:25.805781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.393 [2024-11-21 03:44:25.805805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.393 qpair failed and we were unable to recover it. 00:27:45.393 [2024-11-21 03:44:25.805960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.393 [2024-11-21 03:44:25.806125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.393 [2024-11-21 03:44:25.806155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.393 qpair failed and we were unable to recover it. 00:27:45.393 [2024-11-21 03:44:25.806310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.393 [2024-11-21 03:44:25.806469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.393 [2024-11-21 03:44:25.806511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.393 qpair failed and we were unable to recover it. 00:27:45.393 [2024-11-21 03:44:25.806654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.393 [2024-11-21 03:44:25.806808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.393 [2024-11-21 03:44:25.806832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.393 qpair failed and we were unable to recover it. 00:27:45.393 [2024-11-21 03:44:25.806933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.393 [2024-11-21 03:44:25.807063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.393 [2024-11-21 03:44:25.807118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.393 qpair failed and we were unable to recover it. 00:27:45.393 [2024-11-21 03:44:25.807277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.393 [2024-11-21 03:44:25.807405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.393 [2024-11-21 03:44:25.807430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.393 qpair failed and we were unable to recover it. 00:27:45.393 [2024-11-21 03:44:25.807556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.393 [2024-11-21 03:44:25.807697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.393 [2024-11-21 03:44:25.807724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.393 qpair failed and we were unable to recover it. 00:27:45.393 [2024-11-21 03:44:25.807891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.393 [2024-11-21 03:44:25.808047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.393 [2024-11-21 03:44:25.808082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.393 qpair failed and we were unable to recover it. 00:27:45.393 [2024-11-21 03:44:25.808216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.393 [2024-11-21 03:44:25.808324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.393 [2024-11-21 03:44:25.808348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.393 qpair failed and we were unable to recover it. 00:27:45.393 [2024-11-21 03:44:25.808475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.393 [2024-11-21 03:44:25.808621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.393 [2024-11-21 03:44:25.808648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.393 qpair failed and we were unable to recover it. 00:27:45.393 [2024-11-21 03:44:25.808755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.393 [2024-11-21 03:44:25.808933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.393 [2024-11-21 03:44:25.808958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.393 qpair failed and we were unable to recover it. 00:27:45.393 [2024-11-21 03:44:25.809091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.393 [2024-11-21 03:44:25.809227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.393 [2024-11-21 03:44:25.809257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.393 qpair failed and we were unable to recover it. 00:27:45.393 [2024-11-21 03:44:25.809379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.393 [2024-11-21 03:44:25.809499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.393 [2024-11-21 03:44:25.809526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.393 qpair failed and we were unable to recover it. 00:27:45.393 [2024-11-21 03:44:25.809639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.393 [2024-11-21 03:44:25.809809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.393 [2024-11-21 03:44:25.809837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.393 qpair failed and we were unable to recover it. 00:27:45.393 [2024-11-21 03:44:25.809986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.393 [2024-11-21 03:44:25.810081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.393 [2024-11-21 03:44:25.810107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.393 qpair failed and we were unable to recover it. 00:27:45.393 [2024-11-21 03:44:25.810235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.393 [2024-11-21 03:44:25.810381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.393 [2024-11-21 03:44:25.810405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.393 qpair failed and we were unable to recover it. 00:27:45.393 [2024-11-21 03:44:25.810506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.393 [2024-11-21 03:44:25.810632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.393 [2024-11-21 03:44:25.810673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.393 qpair failed and we were unable to recover it. 00:27:45.393 [2024-11-21 03:44:25.810833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.393 [2024-11-21 03:44:25.810932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.393 [2024-11-21 03:44:25.810956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.393 qpair failed and we were unable to recover it. 00:27:45.393 [2024-11-21 03:44:25.811114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.393 [2024-11-21 03:44:25.811220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.393 [2024-11-21 03:44:25.811244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.393 qpair failed and we were unable to recover it. 00:27:45.393 [2024-11-21 03:44:25.811347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.393 [2024-11-21 03:44:25.811443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.393 [2024-11-21 03:44:25.811468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.393 qpair failed and we were unable to recover it. 00:27:45.393 [2024-11-21 03:44:25.811598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.393 [2024-11-21 03:44:25.811727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.393 [2024-11-21 03:44:25.811751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.393 qpair failed and we were unable to recover it. 00:27:45.393 [2024-11-21 03:44:25.811912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.393 [2024-11-21 03:44:25.812052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.393 [2024-11-21 03:44:25.812086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.393 qpair failed and we were unable to recover it. 00:27:45.393 [2024-11-21 03:44:25.812236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.393 [2024-11-21 03:44:25.812345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.393 [2024-11-21 03:44:25.812372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.393 qpair failed and we were unable to recover it. 00:27:45.393 [2024-11-21 03:44:25.812554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.393 [2024-11-21 03:44:25.812687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.393 [2024-11-21 03:44:25.812729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.393 qpair failed and we were unable to recover it. 00:27:45.393 [2024-11-21 03:44:25.812891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.393 [2024-11-21 03:44:25.813023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.394 [2024-11-21 03:44:25.813047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.394 qpair failed and we were unable to recover it. 00:27:45.394 [2024-11-21 03:44:25.813208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.394 [2024-11-21 03:44:25.813320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.394 [2024-11-21 03:44:25.813347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.394 qpair failed and we were unable to recover it. 00:27:45.394 [2024-11-21 03:44:25.813508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.394 [2024-11-21 03:44:25.813633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.394 [2024-11-21 03:44:25.813659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.394 qpair failed and we were unable to recover it. 00:27:45.394 [2024-11-21 03:44:25.813851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.394 [2024-11-21 03:44:25.813955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.394 [2024-11-21 03:44:25.813979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.394 qpair failed and we were unable to recover it. 00:27:45.394 [2024-11-21 03:44:25.814115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.394 [2024-11-21 03:44:25.814267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.394 [2024-11-21 03:44:25.814294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.394 qpair failed and we were unable to recover it. 00:27:45.394 [2024-11-21 03:44:25.814421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.394 [2024-11-21 03:44:25.814527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.394 [2024-11-21 03:44:25.814551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.394 qpair failed and we were unable to recover it. 00:27:45.394 [2024-11-21 03:44:25.814695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.394 [2024-11-21 03:44:25.814836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.394 [2024-11-21 03:44:25.814863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.394 qpair failed and we were unable to recover it. 00:27:45.394 [2024-11-21 03:44:25.815037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.394 [2024-11-21 03:44:25.815173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.394 [2024-11-21 03:44:25.815199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.394 qpair failed and we were unable to recover it. 00:27:45.394 [2024-11-21 03:44:25.815379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.394 [2024-11-21 03:44:25.815538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.394 [2024-11-21 03:44:25.815580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.394 qpair failed and we were unable to recover it. 00:27:45.394 [2024-11-21 03:44:25.815713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.394 [2024-11-21 03:44:25.815857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.394 [2024-11-21 03:44:25.815890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.394 qpair failed and we were unable to recover it. 00:27:45.394 [2024-11-21 03:44:25.816036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.394 [2024-11-21 03:44:25.816191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.394 [2024-11-21 03:44:25.816220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.394 qpair failed and we were unable to recover it. 00:27:45.394 [2024-11-21 03:44:25.816340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.394 [2024-11-21 03:44:25.816439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.394 [2024-11-21 03:44:25.816464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.394 qpair failed and we were unable to recover it. 00:27:45.394 [2024-11-21 03:44:25.816617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.394 [2024-11-21 03:44:25.816758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.394 [2024-11-21 03:44:25.816785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.394 qpair failed and we were unable to recover it. 00:27:45.394 [2024-11-21 03:44:25.816929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.394 [2024-11-21 03:44:25.817101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.394 [2024-11-21 03:44:25.817127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.394 qpair failed and we were unable to recover it. 00:27:45.394 [2024-11-21 03:44:25.817227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.394 [2024-11-21 03:44:25.817328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.394 [2024-11-21 03:44:25.817353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.394 qpair failed and we were unable to recover it. 00:27:45.394 [2024-11-21 03:44:25.817476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.394 [2024-11-21 03:44:25.817580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.394 [2024-11-21 03:44:25.817622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.394 qpair failed and we were unable to recover it. 00:27:45.394 [2024-11-21 03:44:25.817744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.394 [2024-11-21 03:44:25.817860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.394 [2024-11-21 03:44:25.817887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.394 qpair failed and we were unable to recover it. 00:27:45.394 [2024-11-21 03:44:25.818005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.394 [2024-11-21 03:44:25.818111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.394 [2024-11-21 03:44:25.818137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.394 qpair failed and we were unable to recover it. 00:27:45.394 [2024-11-21 03:44:25.818250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.394 [2024-11-21 03:44:25.818380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.394 [2024-11-21 03:44:25.818405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.394 qpair failed and we were unable to recover it. 00:27:45.394 [2024-11-21 03:44:25.818528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.394 [2024-11-21 03:44:25.818627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.394 [2024-11-21 03:44:25.818654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.394 qpair failed and we were unable to recover it. 00:27:45.394 [2024-11-21 03:44:25.818783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.394 [2024-11-21 03:44:25.818945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.394 [2024-11-21 03:44:25.818969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.394 qpair failed and we were unable to recover it. 00:27:45.394 [2024-11-21 03:44:25.819101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.394 [2024-11-21 03:44:25.819238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.394 [2024-11-21 03:44:25.819266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.394 qpair failed and we were unable to recover it. 00:27:45.394 [2024-11-21 03:44:25.819405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.394 [2024-11-21 03:44:25.819582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.394 [2024-11-21 03:44:25.819610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.394 qpair failed and we were unable to recover it. 00:27:45.395 [2024-11-21 03:44:25.819732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.395 [2024-11-21 03:44:25.819841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.395 [2024-11-21 03:44:25.819866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.395 qpair failed and we were unable to recover it. 00:27:45.395 [2024-11-21 03:44:25.819993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.395 [2024-11-21 03:44:25.820153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.395 [2024-11-21 03:44:25.820180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.395 qpair failed and we were unable to recover it. 00:27:45.395 [2024-11-21 03:44:25.820314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.395 [2024-11-21 03:44:25.820442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.395 [2024-11-21 03:44:25.820467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.395 qpair failed and we were unable to recover it. 00:27:45.395 [2024-11-21 03:44:25.820591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.395 [2024-11-21 03:44:25.820745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.395 [2024-11-21 03:44:25.820789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.395 qpair failed and we were unable to recover it. 00:27:45.395 [2024-11-21 03:44:25.820955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.395 [2024-11-21 03:44:25.821062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.395 [2024-11-21 03:44:25.821095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.395 qpair failed and we were unable to recover it. 00:27:45.395 [2024-11-21 03:44:25.821215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.395 [2024-11-21 03:44:25.821338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.395 [2024-11-21 03:44:25.821366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.395 qpair failed and we were unable to recover it. 00:27:45.395 [2024-11-21 03:44:25.821549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.395 [2024-11-21 03:44:25.821680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.395 [2024-11-21 03:44:25.821720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.395 qpair failed and we were unable to recover it. 00:27:45.395 [2024-11-21 03:44:25.821823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.395 [2024-11-21 03:44:25.821936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.395 [2024-11-21 03:44:25.821963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.395 qpair failed and we were unable to recover it. 00:27:45.395 [2024-11-21 03:44:25.822087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.395 [2024-11-21 03:44:25.822228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.395 [2024-11-21 03:44:25.822256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.395 qpair failed and we were unable to recover it. 00:27:45.395 [2024-11-21 03:44:25.822412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.395 [2024-11-21 03:44:25.822551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.395 [2024-11-21 03:44:25.822577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.395 qpair failed and we were unable to recover it. 00:27:45.395 [2024-11-21 03:44:25.822709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.395 [2024-11-21 03:44:25.822896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.395 [2024-11-21 03:44:25.822921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.395 qpair failed and we were unable to recover it. 00:27:45.395 [2024-11-21 03:44:25.823106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.395 [2024-11-21 03:44:25.823263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.395 [2024-11-21 03:44:25.823288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.395 qpair failed and we were unable to recover it. 00:27:45.395 [2024-11-21 03:44:25.823422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.395 [2024-11-21 03:44:25.823580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.395 [2024-11-21 03:44:25.823605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.395 qpair failed and we were unable to recover it. 00:27:45.395 [2024-11-21 03:44:25.823732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.395 [2024-11-21 03:44:25.823889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.395 [2024-11-21 03:44:25.823914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.395 qpair failed and we were unable to recover it. 00:27:45.395 [2024-11-21 03:44:25.824046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.395 [2024-11-21 03:44:25.824198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.395 [2024-11-21 03:44:25.824227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.395 qpair failed and we were unable to recover it. 00:27:45.395 [2024-11-21 03:44:25.824372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.395 [2024-11-21 03:44:25.824459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.395 [2024-11-21 03:44:25.824488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.395 qpair failed and we were unable to recover it. 00:27:45.395 [2024-11-21 03:44:25.824666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.395 [2024-11-21 03:44:25.824834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.395 [2024-11-21 03:44:25.824861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.395 qpair failed and we were unable to recover it. 00:27:45.395 [2024-11-21 03:44:25.825003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.395 [2024-11-21 03:44:25.825143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.395 [2024-11-21 03:44:25.825168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.395 qpair failed and we were unable to recover it. 00:27:45.395 [2024-11-21 03:44:25.825297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.395 [2024-11-21 03:44:25.825402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.395 [2024-11-21 03:44:25.825428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.395 qpair failed and we were unable to recover it. 00:27:45.395 [2024-11-21 03:44:25.825569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.395 [2024-11-21 03:44:25.825748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.395 [2024-11-21 03:44:25.825775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.395 qpair failed and we were unable to recover it. 00:27:45.396 [2024-11-21 03:44:25.825917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.396 [2024-11-21 03:44:25.826030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.396 [2024-11-21 03:44:25.826058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.396 qpair failed and we were unable to recover it. 00:27:45.396 [2024-11-21 03:44:25.826223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.396 [2024-11-21 03:44:25.826361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.396 [2024-11-21 03:44:25.826387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.396 qpair failed and we were unable to recover it. 00:27:45.396 [2024-11-21 03:44:25.826539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.396 [2024-11-21 03:44:25.826709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.396 [2024-11-21 03:44:25.826736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.396 qpair failed and we were unable to recover it. 00:27:45.396 [2024-11-21 03:44:25.826889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.396 [2024-11-21 03:44:25.827021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.396 [2024-11-21 03:44:25.827061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.396 qpair failed and we were unable to recover it. 00:27:45.396 [2024-11-21 03:44:25.827203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.396 [2024-11-21 03:44:25.827331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.396 [2024-11-21 03:44:25.827355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.396 qpair failed and we were unable to recover it. 00:27:45.396 [2024-11-21 03:44:25.827491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.396 [2024-11-21 03:44:25.827657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.396 [2024-11-21 03:44:25.827686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.396 qpair failed and we were unable to recover it. 00:27:45.396 [2024-11-21 03:44:25.827829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.396 [2024-11-21 03:44:25.827968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.396 [2024-11-21 03:44:25.827996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.396 qpair failed and we were unable to recover it. 00:27:45.396 [2024-11-21 03:44:25.828173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.396 [2024-11-21 03:44:25.828273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.396 [2024-11-21 03:44:25.828297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.396 qpair failed and we were unable to recover it. 00:27:45.396 [2024-11-21 03:44:25.828449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.396 [2024-11-21 03:44:25.828565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.396 [2024-11-21 03:44:25.828592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.396 qpair failed and we were unable to recover it. 00:27:45.396 [2024-11-21 03:44:25.828735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.396 [2024-11-21 03:44:25.828869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.396 [2024-11-21 03:44:25.828896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.396 qpair failed and we were unable to recover it. 00:27:45.396 [2024-11-21 03:44:25.829080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.396 [2024-11-21 03:44:25.829220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.396 [2024-11-21 03:44:25.829264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.396 qpair failed and we were unable to recover it. 00:27:45.396 [2024-11-21 03:44:25.829374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.396 [2024-11-21 03:44:25.829540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.396 [2024-11-21 03:44:25.829568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.396 qpair failed and we were unable to recover it. 00:27:45.396 [2024-11-21 03:44:25.829711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.396 [2024-11-21 03:44:25.829849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.396 [2024-11-21 03:44:25.829876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.396 qpair failed and we were unable to recover it. 00:27:45.396 [2024-11-21 03:44:25.830021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.396 [2024-11-21 03:44:25.830187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.396 [2024-11-21 03:44:25.830213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.396 qpair failed and we were unable to recover it. 00:27:45.396 [2024-11-21 03:44:25.830370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.396 [2024-11-21 03:44:25.830537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.396 [2024-11-21 03:44:25.830566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.396 qpair failed and we were unable to recover it. 00:27:45.396 [2024-11-21 03:44:25.830738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.396 [2024-11-21 03:44:25.830919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.396 [2024-11-21 03:44:25.830943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.396 qpair failed and we were unable to recover it. 00:27:45.396 [2024-11-21 03:44:25.831083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.396 [2024-11-21 03:44:25.831217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.396 [2024-11-21 03:44:25.831243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.396 qpair failed and we were unable to recover it. 00:27:45.396 [2024-11-21 03:44:25.831423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.396 [2024-11-21 03:44:25.831588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.396 [2024-11-21 03:44:25.831617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.396 qpair failed and we were unable to recover it. 00:27:45.396 [2024-11-21 03:44:25.831770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.396 [2024-11-21 03:44:25.831893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.396 [2024-11-21 03:44:25.831918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.396 qpair failed and we were unable to recover it. 00:27:45.397 [2024-11-21 03:44:25.832080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.397 [2024-11-21 03:44:25.832179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.397 [2024-11-21 03:44:25.832204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.397 qpair failed and we were unable to recover it. 00:27:45.397 [2024-11-21 03:44:25.832331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.397 [2024-11-21 03:44:25.832473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.397 [2024-11-21 03:44:25.832515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.397 qpair failed and we were unable to recover it. 00:27:45.397 [2024-11-21 03:44:25.832647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.397 [2024-11-21 03:44:25.832801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.397 [2024-11-21 03:44:25.832825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.397 qpair failed and we were unable to recover it. 00:27:45.397 [2024-11-21 03:44:25.832989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.397 [2024-11-21 03:44:25.833115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.397 [2024-11-21 03:44:25.833140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.397 qpair failed and we were unable to recover it. 00:27:45.397 [2024-11-21 03:44:25.833286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.397 [2024-11-21 03:44:25.833396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.397 [2024-11-21 03:44:25.833422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.397 qpair failed and we were unable to recover it. 00:27:45.397 [2024-11-21 03:44:25.833559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.397 [2024-11-21 03:44:25.833701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.397 [2024-11-21 03:44:25.833727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.397 qpair failed and we were unable to recover it. 00:27:45.397 [2024-11-21 03:44:25.833901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.397 [2024-11-21 03:44:25.834030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.397 [2024-11-21 03:44:25.834055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.397 qpair failed and we were unable to recover it. 00:27:45.397 [2024-11-21 03:44:25.834227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.397 [2024-11-21 03:44:25.834336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.397 [2024-11-21 03:44:25.834365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.397 qpair failed and we were unable to recover it. 00:27:45.397 [2024-11-21 03:44:25.834474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.397 [2024-11-21 03:44:25.834584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.397 [2024-11-21 03:44:25.834611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.397 qpair failed and we were unable to recover it. 00:27:45.397 [2024-11-21 03:44:25.834763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.397 [2024-11-21 03:44:25.834887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.397 [2024-11-21 03:44:25.834911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.397 qpair failed and we were unable to recover it. 00:27:45.397 [2024-11-21 03:44:25.835087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.397 [2024-11-21 03:44:25.835200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.397 [2024-11-21 03:44:25.835229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.397 qpair failed and we were unable to recover it. 00:27:45.397 [2024-11-21 03:44:25.835373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.397 [2024-11-21 03:44:25.835516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.397 [2024-11-21 03:44:25.835557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.397 qpair failed and we were unable to recover it. 00:27:45.397 [2024-11-21 03:44:25.835662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.397 [2024-11-21 03:44:25.835792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.397 [2024-11-21 03:44:25.835817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.397 qpair failed and we were unable to recover it. 00:27:45.397 [2024-11-21 03:44:25.835970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.397 [2024-11-21 03:44:25.836082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.397 [2024-11-21 03:44:25.836110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.397 qpair failed and we were unable to recover it. 00:27:45.397 [2024-11-21 03:44:25.836246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.397 [2024-11-21 03:44:25.836369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.397 [2024-11-21 03:44:25.836396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.397 qpair failed and we were unable to recover it. 00:27:45.397 [2024-11-21 03:44:25.836520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.397 [2024-11-21 03:44:25.836650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.397 [2024-11-21 03:44:25.836674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.397 qpair failed and we were unable to recover it. 00:27:45.397 [2024-11-21 03:44:25.836816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.397 [2024-11-21 03:44:25.837008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.397 [2024-11-21 03:44:25.837036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.397 qpair failed and we were unable to recover it. 00:27:45.397 [2024-11-21 03:44:25.837258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.397 [2024-11-21 03:44:25.837371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.397 [2024-11-21 03:44:25.837396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.397 qpair failed and we were unable to recover it. 00:27:45.397 [2024-11-21 03:44:25.837498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.397 [2024-11-21 03:44:25.837622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.398 [2024-11-21 03:44:25.837647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.398 qpair failed and we were unable to recover it. 00:27:45.398 [2024-11-21 03:44:25.837747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.398 [2024-11-21 03:44:25.837878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.398 [2024-11-21 03:44:25.837919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.398 qpair failed and we were unable to recover it. 00:27:45.398 [2024-11-21 03:44:25.838056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.398 [2024-11-21 03:44:25.838230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.398 [2024-11-21 03:44:25.838255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.398 qpair failed and we were unable to recover it. 00:27:45.398 [2024-11-21 03:44:25.838410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.398 [2024-11-21 03:44:25.838538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.398 [2024-11-21 03:44:25.838580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.398 qpair failed and we were unable to recover it. 00:27:45.398 [2024-11-21 03:44:25.838749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.398 [2024-11-21 03:44:25.838857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.398 [2024-11-21 03:44:25.838884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.398 qpair failed and we were unable to recover it. 00:27:45.398 [2024-11-21 03:44:25.839028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.398 [2024-11-21 03:44:25.839180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.398 [2024-11-21 03:44:25.839208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.398 qpair failed and we were unable to recover it. 00:27:45.398 [2024-11-21 03:44:25.839385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.398 [2024-11-21 03:44:25.839518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.398 [2024-11-21 03:44:25.839560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.398 qpair failed and we were unable to recover it. 00:27:45.398 [2024-11-21 03:44:25.839699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.398 [2024-11-21 03:44:25.839881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.398 [2024-11-21 03:44:25.839906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.398 qpair failed and we were unable to recover it. 00:27:45.398 [2024-11-21 03:44:25.840037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.398 [2024-11-21 03:44:25.840199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.398 [2024-11-21 03:44:25.840224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.398 qpair failed and we were unable to recover it. 00:27:45.398 [2024-11-21 03:44:25.840379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.398 [2024-11-21 03:44:25.840485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.398 [2024-11-21 03:44:25.840513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.398 qpair failed and we were unable to recover it. 00:27:45.398 [2024-11-21 03:44:25.840670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.398 [2024-11-21 03:44:25.840850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.398 [2024-11-21 03:44:25.840874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.398 qpair failed and we were unable to recover it. 00:27:45.398 [2024-11-21 03:44:25.840982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.398 [2024-11-21 03:44:25.841115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.398 [2024-11-21 03:44:25.841141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.398 qpair failed and we were unable to recover it. 00:27:45.398 [2024-11-21 03:44:25.841250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.398 [2024-11-21 03:44:25.841355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.398 [2024-11-21 03:44:25.841380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.398 qpair failed and we were unable to recover it. 00:27:45.398 [2024-11-21 03:44:25.841524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.398 [2024-11-21 03:44:25.841673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.398 [2024-11-21 03:44:25.841698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.398 qpair failed and we were unable to recover it. 00:27:45.398 [2024-11-21 03:44:25.841801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.398 [2024-11-21 03:44:25.841902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.398 [2024-11-21 03:44:25.841926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.398 qpair failed and we were unable to recover it. 00:27:45.398 [2024-11-21 03:44:25.842085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.398 [2024-11-21 03:44:25.842253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.399 [2024-11-21 03:44:25.842294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.399 qpair failed and we were unable to recover it. 00:27:45.399 [2024-11-21 03:44:25.842413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.399 [2024-11-21 03:44:25.842542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.399 [2024-11-21 03:44:25.842567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.399 qpair failed and we were unable to recover it. 00:27:45.399 [2024-11-21 03:44:25.842677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.399 [2024-11-21 03:44:25.842869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.399 [2024-11-21 03:44:25.842894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.399 qpair failed and we were unable to recover it. 00:27:45.399 [2024-11-21 03:44:25.843075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.399 [2024-11-21 03:44:25.843245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.399 [2024-11-21 03:44:25.843270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.399 qpair failed and we were unable to recover it. 00:27:45.399 [2024-11-21 03:44:25.843392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.399 [2024-11-21 03:44:25.843533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.399 [2024-11-21 03:44:25.843565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.399 qpair failed and we were unable to recover it. 00:27:45.399 [2024-11-21 03:44:25.843737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.399 [2024-11-21 03:44:25.843875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.399 [2024-11-21 03:44:25.843905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.399 qpair failed and we were unable to recover it. 00:27:45.399 [2024-11-21 03:44:25.844057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.399 [2024-11-21 03:44:25.844215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.399 [2024-11-21 03:44:25.844240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.399 qpair failed and we were unable to recover it. 00:27:45.399 [2024-11-21 03:44:25.844385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.399 [2024-11-21 03:44:25.844525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.399 [2024-11-21 03:44:25.844551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.399 qpair failed and we were unable to recover it. 00:27:45.399 [2024-11-21 03:44:25.844708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.399 [2024-11-21 03:44:25.844831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.399 [2024-11-21 03:44:25.844856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.399 qpair failed and we were unable to recover it. 00:27:45.399 [2024-11-21 03:44:25.844982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.399 [2024-11-21 03:44:25.845081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.399 [2024-11-21 03:44:25.845106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.399 qpair failed and we were unable to recover it. 00:27:45.399 [2024-11-21 03:44:25.845272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.399 [2024-11-21 03:44:25.845371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.399 [2024-11-21 03:44:25.845399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.399 qpair failed and we were unable to recover it. 00:27:45.399 [2024-11-21 03:44:25.845507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.399 [2024-11-21 03:44:25.845632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.399 [2024-11-21 03:44:25.845659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.399 qpair failed and we were unable to recover it. 00:27:45.399 [2024-11-21 03:44:25.845809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.399 [2024-11-21 03:44:25.845937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.399 [2024-11-21 03:44:25.845961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.399 qpair failed and we were unable to recover it. 00:27:45.399 [2024-11-21 03:44:25.846059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.399 [2024-11-21 03:44:25.846184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.399 [2024-11-21 03:44:25.846227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.399 qpair failed and we were unable to recover it. 00:27:45.399 [2024-11-21 03:44:25.846371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.399 [2024-11-21 03:44:25.846521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.399 [2024-11-21 03:44:25.846548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.399 qpair failed and we were unable to recover it. 00:27:45.399 [2024-11-21 03:44:25.846671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.399 [2024-11-21 03:44:25.846827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.399 [2024-11-21 03:44:25.846851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.399 qpair failed and we were unable to recover it. 00:27:45.399 [2024-11-21 03:44:25.847006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.399 [2024-11-21 03:44:25.847112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.399 [2024-11-21 03:44:25.847140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.399 qpair failed and we were unable to recover it. 00:27:45.399 [2024-11-21 03:44:25.847253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.399 [2024-11-21 03:44:25.847359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.399 [2024-11-21 03:44:25.847386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.399 qpair failed and we were unable to recover it. 00:27:45.399 [2024-11-21 03:44:25.847516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.399 [2024-11-21 03:44:25.847622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.399 [2024-11-21 03:44:25.847647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.399 qpair failed and we were unable to recover it. 00:27:45.399 [2024-11-21 03:44:25.847822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.399 [2024-11-21 03:44:25.847968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.399 [2024-11-21 03:44:25.847995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.399 qpair failed and we were unable to recover it. 00:27:45.399 [2024-11-21 03:44:25.848133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.400 [2024-11-21 03:44:25.848246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.400 [2024-11-21 03:44:25.848274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.400 qpair failed and we were unable to recover it. 00:27:45.400 [2024-11-21 03:44:25.848428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.400 [2024-11-21 03:44:25.848526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.400 [2024-11-21 03:44:25.848551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.400 qpair failed and we were unable to recover it. 00:27:45.400 [2024-11-21 03:44:25.848676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.400 [2024-11-21 03:44:25.848853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.400 [2024-11-21 03:44:25.848880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.400 qpair failed and we were unable to recover it. 00:27:45.400 [2024-11-21 03:44:25.848987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.400 [2024-11-21 03:44:25.849159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.400 [2024-11-21 03:44:25.849187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.400 qpair failed and we were unable to recover it. 00:27:45.400 [2024-11-21 03:44:25.849353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.400 [2024-11-21 03:44:25.849477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.400 [2024-11-21 03:44:25.849511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.400 qpair failed and we were unable to recover it. 00:27:45.400 [2024-11-21 03:44:25.849673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.400 [2024-11-21 03:44:25.849857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.400 [2024-11-21 03:44:25.849881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.400 qpair failed and we were unable to recover it. 00:27:45.400 [2024-11-21 03:44:25.849991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.400 [2024-11-21 03:44:25.850148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.400 [2024-11-21 03:44:25.850173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.400 qpair failed and we were unable to recover it. 00:27:45.400 [2024-11-21 03:44:25.850305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.400 [2024-11-21 03:44:25.850434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.400 [2024-11-21 03:44:25.850459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.400 qpair failed and we were unable to recover it. 00:27:45.400 [2024-11-21 03:44:25.850577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.400 [2024-11-21 03:44:25.850697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.400 [2024-11-21 03:44:25.850721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.400 qpair failed and we were unable to recover it. 00:27:45.400 [2024-11-21 03:44:25.850888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.400 [2024-11-21 03:44:25.851042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.400 [2024-11-21 03:44:25.851080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.400 qpair failed and we were unable to recover it. 00:27:45.400 [2024-11-21 03:44:25.851238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.400 [2024-11-21 03:44:25.851410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.400 [2024-11-21 03:44:25.851437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.400 qpair failed and we were unable to recover it. 00:27:45.400 [2024-11-21 03:44:25.851585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.400 [2024-11-21 03:44:25.851739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.400 [2024-11-21 03:44:25.851764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.400 qpair failed and we were unable to recover it. 00:27:45.400 [2024-11-21 03:44:25.851871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.400 [2024-11-21 03:44:25.851974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.400 [2024-11-21 03:44:25.851999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.400 qpair failed and we were unable to recover it. 00:27:45.400 [2024-11-21 03:44:25.852154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.400 [2024-11-21 03:44:25.852263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.400 [2024-11-21 03:44:25.852288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.400 qpair failed and we were unable to recover it. 00:27:45.400 [2024-11-21 03:44:25.852433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.400 [2024-11-21 03:44:25.852571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.400 [2024-11-21 03:44:25.852599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.400 qpair failed and we were unable to recover it. 00:27:45.400 [2024-11-21 03:44:25.852734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.400 [2024-11-21 03:44:25.852924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.400 [2024-11-21 03:44:25.852948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.400 qpair failed and we were unable to recover it. 00:27:45.400 [2024-11-21 03:44:25.853048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.400 [2024-11-21 03:44:25.853189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.400 [2024-11-21 03:44:25.853214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.400 qpair failed and we were unable to recover it. 00:27:45.400 [2024-11-21 03:44:25.853317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.400 [2024-11-21 03:44:25.853460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.400 [2024-11-21 03:44:25.853486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.400 qpair failed and we were unable to recover it. 00:27:45.400 [2024-11-21 03:44:25.853607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.400 [2024-11-21 03:44:25.853774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.400 [2024-11-21 03:44:25.853802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.400 qpair failed and we were unable to recover it. 00:27:45.400 [2024-11-21 03:44:25.853927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.401 [2024-11-21 03:44:25.854060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.401 [2024-11-21 03:44:25.854105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.401 qpair failed and we were unable to recover it. 00:27:45.401 [2024-11-21 03:44:25.854262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.401 [2024-11-21 03:44:25.854441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.401 [2024-11-21 03:44:25.854465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.401 qpair failed and we were unable to recover it. 00:27:45.401 [2024-11-21 03:44:25.854562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.401 [2024-11-21 03:44:25.854714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.401 [2024-11-21 03:44:25.854739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.401 qpair failed and we were unable to recover it. 00:27:45.401 [2024-11-21 03:44:25.854861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.401 [2024-11-21 03:44:25.855015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.401 [2024-11-21 03:44:25.855039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.401 qpair failed and we were unable to recover it. 00:27:45.401 [2024-11-21 03:44:25.855167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.401 [2024-11-21 03:44:25.855270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.401 [2024-11-21 03:44:25.855295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.401 qpair failed and we were unable to recover it. 00:27:45.401 [2024-11-21 03:44:25.855408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.401 [2024-11-21 03:44:25.855570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.401 [2024-11-21 03:44:25.855598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.401 qpair failed and we were unable to recover it. 00:27:45.401 [2024-11-21 03:44:25.855740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.401 [2024-11-21 03:44:25.855893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.401 [2024-11-21 03:44:25.855918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.401 qpair failed and we were unable to recover it. 00:27:45.401 [2024-11-21 03:44:25.856066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.401 [2024-11-21 03:44:25.856254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.401 [2024-11-21 03:44:25.856279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.401 qpair failed and we were unable to recover it. 00:27:45.401 [2024-11-21 03:44:25.856372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.401 [2024-11-21 03:44:25.856502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.401 [2024-11-21 03:44:25.856526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.401 qpair failed and we were unable to recover it. 00:27:45.401 [2024-11-21 03:44:25.856650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.401 [2024-11-21 03:44:25.856782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.401 [2024-11-21 03:44:25.856806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.401 qpair failed and we were unable to recover it. 00:27:45.401 [2024-11-21 03:44:25.857003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.401 [2024-11-21 03:44:25.857151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.401 [2024-11-21 03:44:25.857177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.401 qpair failed and we were unable to recover it. 00:27:45.401 [2024-11-21 03:44:25.857303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.401 [2024-11-21 03:44:25.857396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.401 [2024-11-21 03:44:25.857420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.401 qpair failed and we were unable to recover it. 00:27:45.401 [2024-11-21 03:44:25.857552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.401 [2024-11-21 03:44:25.857681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.401 [2024-11-21 03:44:25.857705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.401 qpair failed and we were unable to recover it. 00:27:45.401 [2024-11-21 03:44:25.857856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.401 [2024-11-21 03:44:25.857993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.401 [2024-11-21 03:44:25.858020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.401 qpair failed and we were unable to recover it. 00:27:45.401 [2024-11-21 03:44:25.858160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.401 [2024-11-21 03:44:25.858328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.401 [2024-11-21 03:44:25.858355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.401 qpair failed and we were unable to recover it. 00:27:45.401 [2024-11-21 03:44:25.858501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.401 [2024-11-21 03:44:25.858657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.401 [2024-11-21 03:44:25.858682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.401 qpair failed and we were unable to recover it. 00:27:45.401 [2024-11-21 03:44:25.858801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.401 [2024-11-21 03:44:25.858915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.401 [2024-11-21 03:44:25.858962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.401 qpair failed and we were unable to recover it. 00:27:45.401 [2024-11-21 03:44:25.859066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.401 [2024-11-21 03:44:25.859193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.401 [2024-11-21 03:44:25.859238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.401 qpair failed and we were unable to recover it. 00:27:45.401 [2024-11-21 03:44:25.859388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.401 [2024-11-21 03:44:25.859541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.401 [2024-11-21 03:44:25.859565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.401 qpair failed and we were unable to recover it. 00:27:45.401 [2024-11-21 03:44:25.859723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.401 [2024-11-21 03:44:25.859890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.401 [2024-11-21 03:44:25.859917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.401 qpair failed and we were unable to recover it. 00:27:45.401 [2024-11-21 03:44:25.860022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.401 [2024-11-21 03:44:25.860156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.401 [2024-11-21 03:44:25.860181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.401 qpair failed and we were unable to recover it. 00:27:45.401 [2024-11-21 03:44:25.860282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.401 [2024-11-21 03:44:25.860394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.401 [2024-11-21 03:44:25.860420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.401 qpair failed and we were unable to recover it. 00:27:45.401 [2024-11-21 03:44:25.860552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.401 [2024-11-21 03:44:25.860706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.401 [2024-11-21 03:44:25.860731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.401 qpair failed and we were unable to recover it. 00:27:45.401 [2024-11-21 03:44:25.860834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.401 [2024-11-21 03:44:25.860969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.402 [2024-11-21 03:44:25.860994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.402 qpair failed and we were unable to recover it. 00:27:45.402 [2024-11-21 03:44:25.861123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.402 [2024-11-21 03:44:25.861228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.402 [2024-11-21 03:44:25.861253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.402 qpair failed and we were unable to recover it. 00:27:45.402 [2024-11-21 03:44:25.861412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.402 [2024-11-21 03:44:25.861551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.402 [2024-11-21 03:44:25.861576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.402 qpair failed and we were unable to recover it. 00:27:45.402 [2024-11-21 03:44:25.861729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.402 [2024-11-21 03:44:25.861870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.402 [2024-11-21 03:44:25.861898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.402 qpair failed and we were unable to recover it. 00:27:45.402 [2024-11-21 03:44:25.862079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.402 [2024-11-21 03:44:25.862248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.402 [2024-11-21 03:44:25.862275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.402 qpair failed and we were unable to recover it. 00:27:45.402 [2024-11-21 03:44:25.862420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.402 [2024-11-21 03:44:25.862564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.402 [2024-11-21 03:44:25.862592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.402 qpair failed and we were unable to recover it. 00:27:45.402 [2024-11-21 03:44:25.862747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.402 [2024-11-21 03:44:25.862872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.402 [2024-11-21 03:44:25.862896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.402 qpair failed and we were unable to recover it. 00:27:45.402 [2024-11-21 03:44:25.863030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.402 [2024-11-21 03:44:25.863152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.402 [2024-11-21 03:44:25.863177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.402 qpair failed and we were unable to recover it. 00:27:45.402 [2024-11-21 03:44:25.863325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.402 [2024-11-21 03:44:25.863450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.402 [2024-11-21 03:44:25.863478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.402 qpair failed and we were unable to recover it. 00:27:45.402 [2024-11-21 03:44:25.863623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.402 [2024-11-21 03:44:25.863762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.402 [2024-11-21 03:44:25.863789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.402 qpair failed and we were unable to recover it. 00:27:45.402 [2024-11-21 03:44:25.863916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.402 [2024-11-21 03:44:25.864049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.402 [2024-11-21 03:44:25.864079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.402 qpair failed and we were unable to recover it. 00:27:45.402 [2024-11-21 03:44:25.864211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.402 [2024-11-21 03:44:25.864304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.402 [2024-11-21 03:44:25.864345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.402 qpair failed and we were unable to recover it. 00:27:45.402 [2024-11-21 03:44:25.864490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.402 [2024-11-21 03:44:25.864658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.402 [2024-11-21 03:44:25.864684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.402 qpair failed and we were unable to recover it. 00:27:45.402 [2024-11-21 03:44:25.864809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.402 [2024-11-21 03:44:25.864936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.402 [2024-11-21 03:44:25.864960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.402 qpair failed and we were unable to recover it. 00:27:45.402 [2024-11-21 03:44:25.865118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.402 [2024-11-21 03:44:25.865247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.402 [2024-11-21 03:44:25.865272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.402 qpair failed and we were unable to recover it. 00:27:45.402 [2024-11-21 03:44:25.865419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.402 [2024-11-21 03:44:25.865528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.402 [2024-11-21 03:44:25.865556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.402 qpair failed and we were unable to recover it. 00:27:45.402 [2024-11-21 03:44:25.865693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.402 [2024-11-21 03:44:25.865828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.402 [2024-11-21 03:44:25.865853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.402 qpair failed and we were unable to recover it. 00:27:45.402 [2024-11-21 03:44:25.865976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.402 [2024-11-21 03:44:25.866099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.402 [2024-11-21 03:44:25.866141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.402 qpair failed and we were unable to recover it. 00:27:45.402 [2024-11-21 03:44:25.866244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.402 [2024-11-21 03:44:25.866347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.402 [2024-11-21 03:44:25.866390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.402 qpair failed and we were unable to recover it. 00:27:45.402 [2024-11-21 03:44:25.866575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.402 [2024-11-21 03:44:25.866683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.402 [2024-11-21 03:44:25.866709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.402 qpair failed and we were unable to recover it. 00:27:45.402 [2024-11-21 03:44:25.866811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.402 [2024-11-21 03:44:25.866937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.402 [2024-11-21 03:44:25.866962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.402 qpair failed and we were unable to recover it. 00:27:45.402 [2024-11-21 03:44:25.867099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.402 [2024-11-21 03:44:25.867243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.402 [2024-11-21 03:44:25.867272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.402 qpair failed and we were unable to recover it. 00:27:45.402 [2024-11-21 03:44:25.867435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.402 [2024-11-21 03:44:25.867603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.402 [2024-11-21 03:44:25.867628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.402 qpair failed and we were unable to recover it. 00:27:45.402 [2024-11-21 03:44:25.867780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.402 [2024-11-21 03:44:25.867918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.402 [2024-11-21 03:44:25.867946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.402 qpair failed and we were unable to recover it. 00:27:45.402 [2024-11-21 03:44:25.868083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.402 [2024-11-21 03:44:25.868243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.402 [2024-11-21 03:44:25.868268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.402 qpair failed and we were unable to recover it. 00:27:45.403 [2024-11-21 03:44:25.868398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.403 [2024-11-21 03:44:25.868553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.403 [2024-11-21 03:44:25.868594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.403 qpair failed and we were unable to recover it. 00:27:45.403 [2024-11-21 03:44:25.868764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.403 [2024-11-21 03:44:25.868930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.403 [2024-11-21 03:44:25.868958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.403 qpair failed and we were unable to recover it. 00:27:45.403 [2024-11-21 03:44:25.869077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.403 [2024-11-21 03:44:25.869253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.403 [2024-11-21 03:44:25.869281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.403 qpair failed and we were unable to recover it. 00:27:45.403 [2024-11-21 03:44:25.869414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.403 [2024-11-21 03:44:25.869516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.403 [2024-11-21 03:44:25.869543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.403 qpair failed and we were unable to recover it. 00:27:45.403 [2024-11-21 03:44:25.869692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.403 [2024-11-21 03:44:25.869859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.403 [2024-11-21 03:44:25.869887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.403 qpair failed and we were unable to recover it. 00:27:45.403 [2024-11-21 03:44:25.870090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.403 [2024-11-21 03:44:25.870220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.403 [2024-11-21 03:44:25.870245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.403 qpair failed and we were unable to recover it. 00:27:45.403 [2024-11-21 03:44:25.870399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.403 [2024-11-21 03:44:25.870526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.403 [2024-11-21 03:44:25.870552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.403 qpair failed and we were unable to recover it. 00:27:45.403 [2024-11-21 03:44:25.870649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.403 [2024-11-21 03:44:25.870825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.403 [2024-11-21 03:44:25.870853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.403 qpair failed and we were unable to recover it. 00:27:45.403 [2024-11-21 03:44:25.871017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.403 [2024-11-21 03:44:25.871163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.403 [2024-11-21 03:44:25.871192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.403 qpair failed and we were unable to recover it. 00:27:45.403 [2024-11-21 03:44:25.871329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.403 [2024-11-21 03:44:25.871461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.403 [2024-11-21 03:44:25.871486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.403 qpair failed and we were unable to recover it. 00:27:45.403 [2024-11-21 03:44:25.871658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.403 [2024-11-21 03:44:25.871753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.403 [2024-11-21 03:44:25.871778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.403 qpair failed and we were unable to recover it. 00:27:45.403 [2024-11-21 03:44:25.871882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.403 [2024-11-21 03:44:25.872039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.403 [2024-11-21 03:44:25.872064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.403 qpair failed and we were unable to recover it. 00:27:45.403 [2024-11-21 03:44:25.872210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.403 [2024-11-21 03:44:25.872342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.403 [2024-11-21 03:44:25.872367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.403 qpair failed and we were unable to recover it. 00:27:45.403 [2024-11-21 03:44:25.872545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.403 [2024-11-21 03:44:25.872651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.403 [2024-11-21 03:44:25.872679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.403 qpair failed and we were unable to recover it. 00:27:45.403 [2024-11-21 03:44:25.872827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.403 [2024-11-21 03:44:25.872944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.403 [2024-11-21 03:44:25.872972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.403 qpair failed and we were unable to recover it. 00:27:45.403 [2024-11-21 03:44:25.873150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.403 [2024-11-21 03:44:25.873252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.403 [2024-11-21 03:44:25.873277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.403 qpair failed and we were unable to recover it. 00:27:45.403 [2024-11-21 03:44:25.873396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.403 [2024-11-21 03:44:25.873561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.403 [2024-11-21 03:44:25.873589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.403 qpair failed and we were unable to recover it. 00:27:45.403 [2024-11-21 03:44:25.873733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.403 [2024-11-21 03:44:25.873896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.403 [2024-11-21 03:44:25.873923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.403 qpair failed and we were unable to recover it. 00:27:45.403 [2024-11-21 03:44:25.874038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.403 [2024-11-21 03:44:25.874179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.403 [2024-11-21 03:44:25.874204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.403 qpair failed and we were unable to recover it. 00:27:45.403 [2024-11-21 03:44:25.874328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.403 [2024-11-21 03:44:25.874471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.403 [2024-11-21 03:44:25.874504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.403 qpair failed and we were unable to recover it. 00:27:45.403 [2024-11-21 03:44:25.874671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.403 [2024-11-21 03:44:25.874780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.403 [2024-11-21 03:44:25.874808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.403 qpair failed and we were unable to recover it. 00:27:45.403 [2024-11-21 03:44:25.874936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.403 [2024-11-21 03:44:25.875067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.403 [2024-11-21 03:44:25.875102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.403 qpair failed and we were unable to recover it. 00:27:45.403 [2024-11-21 03:44:25.875249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.403 [2024-11-21 03:44:25.875412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.403 [2024-11-21 03:44:25.875437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.403 qpair failed and we were unable to recover it. 00:27:45.403 [2024-11-21 03:44:25.875564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.403 [2024-11-21 03:44:25.875737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.403 [2024-11-21 03:44:25.875766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.403 qpair failed and we were unable to recover it. 00:27:45.403 [2024-11-21 03:44:25.875913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.403 [2024-11-21 03:44:25.876020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.403 [2024-11-21 03:44:25.876045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.403 qpair failed and we were unable to recover it. 00:27:45.403 [2024-11-21 03:44:25.876211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.403 [2024-11-21 03:44:25.876360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.403 [2024-11-21 03:44:25.876385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.403 qpair failed and we were unable to recover it. 00:27:45.403 [2024-11-21 03:44:25.876514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.403 [2024-11-21 03:44:25.876667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.403 [2024-11-21 03:44:25.876692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.403 qpair failed and we were unable to recover it. 00:27:45.403 [2024-11-21 03:44:25.876798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.403 [2024-11-21 03:44:25.876961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.404 [2024-11-21 03:44:25.876985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.404 qpair failed and we were unable to recover it. 00:27:45.404 [2024-11-21 03:44:25.877109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.404 [2024-11-21 03:44:25.877259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.404 [2024-11-21 03:44:25.877283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.404 qpair failed and we were unable to recover it. 00:27:45.404 [2024-11-21 03:44:25.877409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.404 [2024-11-21 03:44:25.877564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.404 [2024-11-21 03:44:25.877589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.404 qpair failed and we were unable to recover it. 00:27:45.404 [2024-11-21 03:44:25.877721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.404 [2024-11-21 03:44:25.877873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.404 [2024-11-21 03:44:25.877914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.404 qpair failed and we were unable to recover it. 00:27:45.404 [2024-11-21 03:44:25.878094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.404 [2024-11-21 03:44:25.878225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.404 [2024-11-21 03:44:25.878249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.404 qpair failed and we were unable to recover it. 00:27:45.404 [2024-11-21 03:44:25.878381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.404 [2024-11-21 03:44:25.878523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.404 [2024-11-21 03:44:25.878551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.404 qpair failed and we were unable to recover it. 00:27:45.404 [2024-11-21 03:44:25.878696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.404 [2024-11-21 03:44:25.878803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.404 [2024-11-21 03:44:25.878828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.404 qpair failed and we were unable to recover it. 00:27:45.404 [2024-11-21 03:44:25.878925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.404 [2024-11-21 03:44:25.879055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.404 [2024-11-21 03:44:25.879088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.404 qpair failed and we were unable to recover it. 00:27:45.404 [2024-11-21 03:44:25.879185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.404 [2024-11-21 03:44:25.879314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.404 [2024-11-21 03:44:25.879338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.404 qpair failed and we were unable to recover it. 00:27:45.404 [2024-11-21 03:44:25.879433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.404 [2024-11-21 03:44:25.879553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.404 [2024-11-21 03:44:25.879578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.404 qpair failed and we were unable to recover it. 00:27:45.404 [2024-11-21 03:44:25.879736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.404 [2024-11-21 03:44:25.879864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.404 [2024-11-21 03:44:25.879890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.404 qpair failed and we were unable to recover it. 00:27:45.404 [2024-11-21 03:44:25.880029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.404 [2024-11-21 03:44:25.880153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.404 [2024-11-21 03:44:25.880182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.404 qpair failed and we were unable to recover it. 00:27:45.404 [2024-11-21 03:44:25.880313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.404 [2024-11-21 03:44:25.880464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.404 [2024-11-21 03:44:25.880489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.404 qpair failed and we were unable to recover it. 00:27:45.404 [2024-11-21 03:44:25.880645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.404 [2024-11-21 03:44:25.880789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.404 [2024-11-21 03:44:25.880816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.404 qpair failed and we were unable to recover it. 00:27:45.404 [2024-11-21 03:44:25.881009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.404 [2024-11-21 03:44:25.881183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.404 [2024-11-21 03:44:25.881209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.404 qpair failed and we were unable to recover it. 00:27:45.404 [2024-11-21 03:44:25.881364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.404 [2024-11-21 03:44:25.881502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.404 [2024-11-21 03:44:25.881544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.404 qpair failed and we were unable to recover it. 00:27:45.404 [2024-11-21 03:44:25.881649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.404 [2024-11-21 03:44:25.881762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.404 [2024-11-21 03:44:25.881790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.404 qpair failed and we were unable to recover it. 00:27:45.404 [2024-11-21 03:44:25.881907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.404 [2024-11-21 03:44:25.882046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.404 [2024-11-21 03:44:25.882081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.404 qpair failed and we were unable to recover it. 00:27:45.404 [2024-11-21 03:44:25.882234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.404 [2024-11-21 03:44:25.882334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.404 [2024-11-21 03:44:25.882358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.404 qpair failed and we were unable to recover it. 00:27:45.404 [2024-11-21 03:44:25.882505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.404 [2024-11-21 03:44:25.882639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.404 [2024-11-21 03:44:25.882667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.404 qpair failed and we were unable to recover it. 00:27:45.404 [2024-11-21 03:44:25.882835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.404 [2024-11-21 03:44:25.882999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.404 [2024-11-21 03:44:25.883026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.404 qpair failed and we were unable to recover it. 00:27:45.404 [2024-11-21 03:44:25.883190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.404 [2024-11-21 03:44:25.883321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.404 [2024-11-21 03:44:25.883345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.404 qpair failed and we were unable to recover it. 00:27:45.404 [2024-11-21 03:44:25.883516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.404 [2024-11-21 03:44:25.883657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.404 [2024-11-21 03:44:25.883686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.404 qpair failed and we were unable to recover it. 00:27:45.404 [2024-11-21 03:44:25.883828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.405 [2024-11-21 03:44:25.883937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.405 [2024-11-21 03:44:25.883965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.405 qpair failed and we were unable to recover it. 00:27:45.405 [2024-11-21 03:44:25.884151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.405 [2024-11-21 03:44:25.884284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.405 [2024-11-21 03:44:25.884308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.405 qpair failed and we were unable to recover it. 00:27:45.405 [2024-11-21 03:44:25.884437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.405 [2024-11-21 03:44:25.884591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.405 [2024-11-21 03:44:25.884615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.405 qpair failed and we were unable to recover it. 00:27:45.405 [2024-11-21 03:44:25.884749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.405 [2024-11-21 03:44:25.884929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.405 [2024-11-21 03:44:25.884958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.405 qpair failed and we were unable to recover it. 00:27:45.405 [2024-11-21 03:44:25.885087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.405 [2024-11-21 03:44:25.885248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.405 [2024-11-21 03:44:25.885274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.405 qpair failed and we were unable to recover it. 00:27:45.405 [2024-11-21 03:44:25.885440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.405 [2024-11-21 03:44:25.885609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.405 [2024-11-21 03:44:25.885663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.405 qpair failed and we were unable to recover it. 00:27:45.405 [2024-11-21 03:44:25.885814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.405 [2024-11-21 03:44:25.885957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.405 [2024-11-21 03:44:25.885986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.405 qpair failed and we were unable to recover it. 00:27:45.405 [2024-11-21 03:44:25.886092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.405 [2024-11-21 03:44:25.886247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.405 [2024-11-21 03:44:25.886272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.405 qpair failed and we were unable to recover it. 00:27:45.405 [2024-11-21 03:44:25.886373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.405 [2024-11-21 03:44:25.886500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.405 [2024-11-21 03:44:25.886524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.405 qpair failed and we were unable to recover it. 00:27:45.405 [2024-11-21 03:44:25.886692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.405 [2024-11-21 03:44:25.886810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.405 [2024-11-21 03:44:25.886838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.405 qpair failed and we were unable to recover it. 00:27:45.405 [2024-11-21 03:44:25.886961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.405 [2024-11-21 03:44:25.887080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.405 [2024-11-21 03:44:25.887108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.405 qpair failed and we were unable to recover it. 00:27:45.405 [2024-11-21 03:44:25.887214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.405 [2024-11-21 03:44:25.887369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.405 [2024-11-21 03:44:25.887394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.405 qpair failed and we were unable to recover it. 00:27:45.405 [2024-11-21 03:44:25.887501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.405 [2024-11-21 03:44:25.887659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.405 [2024-11-21 03:44:25.887684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.405 qpair failed and we were unable to recover it. 00:27:45.405 [2024-11-21 03:44:25.887831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.405 [2024-11-21 03:44:25.887938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.405 [2024-11-21 03:44:25.887965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.405 qpair failed and we were unable to recover it. 00:27:45.405 [2024-11-21 03:44:25.888131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.405 [2024-11-21 03:44:25.888234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.405 [2024-11-21 03:44:25.888258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.405 qpair failed and we were unable to recover it. 00:27:45.405 [2024-11-21 03:44:25.888363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.405 [2024-11-21 03:44:25.888491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.405 [2024-11-21 03:44:25.888515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.405 qpair failed and we were unable to recover it. 00:27:45.405 [2024-11-21 03:44:25.888644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.405 [2024-11-21 03:44:25.888746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.405 [2024-11-21 03:44:25.888771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.405 qpair failed and we were unable to recover it. 00:27:45.405 [2024-11-21 03:44:25.888889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.405 [2024-11-21 03:44:25.889023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.405 [2024-11-21 03:44:25.889047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.405 qpair failed and we were unable to recover it. 00:27:45.405 [2024-11-21 03:44:25.889177] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2470600 is same with the state(5) to be set 00:27:45.405 [2024-11-21 03:44:25.889406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.405 [2024-11-21 03:44:25.889543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.405 [2024-11-21 03:44:25.889576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:45.405 qpair failed and we were unable to recover it. 00:27:45.405 [2024-11-21 03:44:25.889716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.405 [2024-11-21 03:44:25.889821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.405 [2024-11-21 03:44:25.889848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:45.405 qpair failed and we were unable to recover it. 00:27:45.405 Read completed with error (sct=0, sc=8) 00:27:45.405 starting I/O failed 00:27:45.405 Read completed with error (sct=0, sc=8) 00:27:45.405 starting I/O failed 00:27:45.405 Read completed with error (sct=0, sc=8) 00:27:45.405 starting I/O failed 00:27:45.405 Read completed with error (sct=0, sc=8) 00:27:45.405 starting I/O failed 00:27:45.405 Read completed with error (sct=0, sc=8) 00:27:45.405 starting I/O failed 00:27:45.405 Read completed with error (sct=0, sc=8) 00:27:45.405 starting I/O failed 00:27:45.405 Read completed with error (sct=0, sc=8) 00:27:45.405 starting I/O failed 00:27:45.405 Read completed with error (sct=0, sc=8) 00:27:45.405 starting I/O failed 00:27:45.405 Read completed with error (sct=0, sc=8) 00:27:45.405 starting I/O failed 00:27:45.405 Read completed with error (sct=0, sc=8) 00:27:45.405 starting I/O failed 00:27:45.405 Read completed with error (sct=0, sc=8) 00:27:45.405 starting I/O failed 00:27:45.405 Write completed with error (sct=0, sc=8) 00:27:45.405 starting I/O failed 00:27:45.405 Read completed with error (sct=0, sc=8) 00:27:45.405 starting I/O failed 00:27:45.405 Read completed with error (sct=0, sc=8) 00:27:45.405 starting I/O failed 00:27:45.405 Read completed with error (sct=0, sc=8) 00:27:45.405 starting I/O failed 00:27:45.405 Read completed with error (sct=0, sc=8) 00:27:45.405 starting I/O failed 00:27:45.405 Read completed with error (sct=0, sc=8) 00:27:45.405 starting I/O failed 00:27:45.405 Write completed with error (sct=0, sc=8) 00:27:45.405 starting I/O failed 00:27:45.405 Write completed with error (sct=0, sc=8) 00:27:45.405 starting I/O failed 00:27:45.405 Read completed with error (sct=0, sc=8) 00:27:45.405 starting I/O failed 00:27:45.405 Read completed with error (sct=0, sc=8) 00:27:45.405 starting I/O failed 00:27:45.405 Write completed with error (sct=0, sc=8) 00:27:45.405 starting I/O failed 00:27:45.405 Read completed with error (sct=0, sc=8) 00:27:45.405 starting I/O failed 00:27:45.405 Read completed with error (sct=0, sc=8) 00:27:45.405 starting I/O failed 00:27:45.405 Read completed with error (sct=0, sc=8) 00:27:45.405 starting I/O failed 00:27:45.405 Write completed with error (sct=0, sc=8) 00:27:45.405 starting I/O failed 00:27:45.405 Read completed with error (sct=0, sc=8) 00:27:45.405 starting I/O failed 00:27:45.405 Read completed with error (sct=0, sc=8) 00:27:45.405 starting I/O failed 00:27:45.405 Write completed with error (sct=0, sc=8) 00:27:45.405 starting I/O failed 00:27:45.405 Read completed with error (sct=0, sc=8) 00:27:45.405 starting I/O failed 00:27:45.405 Write completed with error (sct=0, sc=8) 00:27:45.405 starting I/O failed 00:27:45.405 Read completed with error (sct=0, sc=8) 00:27:45.405 starting I/O failed 00:27:45.406 [2024-11-21 03:44:25.890196] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:45.406 [2024-11-21 03:44:25.890312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.406 [2024-11-21 03:44:25.890415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.406 [2024-11-21 03:44:25.890439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.406 qpair failed and we were unable to recover it. 00:27:45.406 [2024-11-21 03:44:25.890564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.406 [2024-11-21 03:44:25.890656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.406 [2024-11-21 03:44:25.890680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.406 qpair failed and we were unable to recover it. 00:27:45.406 [2024-11-21 03:44:25.890883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.406 [2024-11-21 03:44:25.891017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.406 [2024-11-21 03:44:25.891042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.406 qpair failed and we were unable to recover it. 00:27:45.406 [2024-11-21 03:44:25.891223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.406 [2024-11-21 03:44:25.891353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.406 [2024-11-21 03:44:25.891377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.406 qpair failed and we were unable to recover it. 00:27:45.406 [2024-11-21 03:44:25.891509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.406 [2024-11-21 03:44:25.891642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.406 [2024-11-21 03:44:25.891666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.406 qpair failed and we were unable to recover it. 00:27:45.406 [2024-11-21 03:44:25.891798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.406 [2024-11-21 03:44:25.891937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.406 [2024-11-21 03:44:25.891964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.406 qpair failed and we were unable to recover it. 00:27:45.406 [2024-11-21 03:44:25.892107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.406 [2024-11-21 03:44:25.892234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.406 [2024-11-21 03:44:25.892258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.406 qpair failed and we were unable to recover it. 00:27:45.406 [2024-11-21 03:44:25.892394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.406 [2024-11-21 03:44:25.892498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.406 [2024-11-21 03:44:25.892523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.406 qpair failed and we were unable to recover it. 00:27:45.406 [2024-11-21 03:44:25.892692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.406 [2024-11-21 03:44:25.892788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.406 [2024-11-21 03:44:25.892812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.406 qpair failed and we were unable to recover it. 00:27:45.406 [2024-11-21 03:44:25.892944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.406 [2024-11-21 03:44:25.893110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.406 [2024-11-21 03:44:25.893135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.406 qpair failed and we were unable to recover it. 00:27:45.406 [2024-11-21 03:44:25.893233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.406 [2024-11-21 03:44:25.893338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.406 [2024-11-21 03:44:25.893363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.406 qpair failed and we were unable to recover it. 00:27:45.406 [2024-11-21 03:44:25.893466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.406 [2024-11-21 03:44:25.893568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.406 [2024-11-21 03:44:25.893593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.406 qpair failed and we were unable to recover it. 00:27:45.406 [2024-11-21 03:44:25.893721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.406 [2024-11-21 03:44:25.893844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.406 [2024-11-21 03:44:25.893870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.406 qpair failed and we were unable to recover it. 00:27:45.406 [2024-11-21 03:44:25.893969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.406 [2024-11-21 03:44:25.894066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.406 [2024-11-21 03:44:25.894099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.406 qpair failed and we were unable to recover it. 00:27:45.406 [2024-11-21 03:44:25.894224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.406 [2024-11-21 03:44:25.894331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.406 [2024-11-21 03:44:25.894372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.406 qpair failed and we were unable to recover it. 00:27:45.406 [2024-11-21 03:44:25.894538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.406 [2024-11-21 03:44:25.894688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.406 [2024-11-21 03:44:25.894717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.406 qpair failed and we were unable to recover it. 00:27:45.406 [2024-11-21 03:44:25.894844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.406 [2024-11-21 03:44:25.895001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.406 [2024-11-21 03:44:25.895042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.406 qpair failed and we were unable to recover it. 00:27:45.406 [2024-11-21 03:44:25.895175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.406 [2024-11-21 03:44:25.895277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.406 [2024-11-21 03:44:25.895301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.406 qpair failed and we were unable to recover it. 00:27:45.406 [2024-11-21 03:44:25.895457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.406 [2024-11-21 03:44:25.895610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.406 [2024-11-21 03:44:25.895636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.406 qpair failed and we were unable to recover it. 00:27:45.406 [2024-11-21 03:44:25.895788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.406 [2024-11-21 03:44:25.895948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.406 [2024-11-21 03:44:25.895973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.406 qpair failed and we were unable to recover it. 00:27:45.406 [2024-11-21 03:44:25.896100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.406 [2024-11-21 03:44:25.896218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.406 [2024-11-21 03:44:25.896243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.406 qpair failed and we were unable to recover it. 00:27:45.406 [2024-11-21 03:44:25.896356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.406 [2024-11-21 03:44:25.896503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.406 [2024-11-21 03:44:25.896531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.406 qpair failed and we were unable to recover it. 00:27:45.406 [2024-11-21 03:44:25.896641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.406 [2024-11-21 03:44:25.896743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.406 [2024-11-21 03:44:25.896767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.406 qpair failed and we were unable to recover it. 00:27:45.406 [2024-11-21 03:44:25.896891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.406 [2024-11-21 03:44:25.897034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.406 [2024-11-21 03:44:25.897081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.406 qpair failed and we were unable to recover it. 00:27:45.406 [2024-11-21 03:44:25.897218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.406 [2024-11-21 03:44:25.897361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.406 [2024-11-21 03:44:25.897388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.406 qpair failed and we were unable to recover it. 00:27:45.406 [2024-11-21 03:44:25.897567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.406 [2024-11-21 03:44:25.897710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.406 [2024-11-21 03:44:25.897740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.406 qpair failed and we were unable to recover it. 00:27:45.406 [2024-11-21 03:44:25.897867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.406 [2024-11-21 03:44:25.898020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.406 [2024-11-21 03:44:25.898048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.407 qpair failed and we were unable to recover it. 00:27:45.407 [2024-11-21 03:44:25.898227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.407 [2024-11-21 03:44:25.898356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.407 [2024-11-21 03:44:25.898381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.407 qpair failed and we were unable to recover it. 00:27:45.407 [2024-11-21 03:44:25.898516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.407 [2024-11-21 03:44:25.898678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.407 [2024-11-21 03:44:25.898719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.407 qpair failed and we were unable to recover it. 00:27:45.407 [2024-11-21 03:44:25.898833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.407 [2024-11-21 03:44:25.898977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.407 [2024-11-21 03:44:25.899004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.407 qpair failed and we were unable to recover it. 00:27:45.407 [2024-11-21 03:44:25.899139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.407 [2024-11-21 03:44:25.899273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.407 [2024-11-21 03:44:25.899297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.407 qpair failed and we were unable to recover it. 00:27:45.407 [2024-11-21 03:44:25.899430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.407 [2024-11-21 03:44:25.899554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.407 [2024-11-21 03:44:25.899579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.407 qpair failed and we were unable to recover it. 00:27:45.407 [2024-11-21 03:44:25.899740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.407 [2024-11-21 03:44:25.899879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.407 [2024-11-21 03:44:25.899908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.407 qpair failed and we were unable to recover it. 00:27:45.407 [2024-11-21 03:44:25.900098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.407 [2024-11-21 03:44:25.900225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.407 [2024-11-21 03:44:25.900249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.407 qpair failed and we were unable to recover it. 00:27:45.407 [2024-11-21 03:44:25.900354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.407 [2024-11-21 03:44:25.900520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.407 [2024-11-21 03:44:25.900544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.407 qpair failed and we were unable to recover it. 00:27:45.407 [2024-11-21 03:44:25.900686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.407 [2024-11-21 03:44:25.900788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.407 [2024-11-21 03:44:25.900817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.407 qpair failed and we were unable to recover it. 00:27:45.407 [2024-11-21 03:44:25.900925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.407 [2024-11-21 03:44:25.901086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.407 [2024-11-21 03:44:25.901132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.407 qpair failed and we were unable to recover it. 00:27:45.407 [2024-11-21 03:44:25.901256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.407 [2024-11-21 03:44:25.901356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.407 [2024-11-21 03:44:25.901382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.407 qpair failed and we were unable to recover it. 00:27:45.407 [2024-11-21 03:44:25.901479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.407 [2024-11-21 03:44:25.901574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.407 [2024-11-21 03:44:25.901599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.407 qpair failed and we were unable to recover it. 00:27:45.407 [2024-11-21 03:44:25.901701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.407 [2024-11-21 03:44:25.901906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.407 [2024-11-21 03:44:25.901934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.407 qpair failed and we were unable to recover it. 00:27:45.407 [2024-11-21 03:44:25.902141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.407 [2024-11-21 03:44:25.902239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.407 [2024-11-21 03:44:25.902264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.407 qpair failed and we were unable to recover it. 00:27:45.407 [2024-11-21 03:44:25.902415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.407 [2024-11-21 03:44:25.902534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.407 [2024-11-21 03:44:25.902562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.407 qpair failed and we were unable to recover it. 00:27:45.407 [2024-11-21 03:44:25.902667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.407 [2024-11-21 03:44:25.902780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.407 [2024-11-21 03:44:25.902807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.407 qpair failed and we were unable to recover it. 00:27:45.407 [2024-11-21 03:44:25.902931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.407 [2024-11-21 03:44:25.903060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.407 [2024-11-21 03:44:25.903091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.407 qpair failed and we were unable to recover it. 00:27:45.407 [2024-11-21 03:44:25.903194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.407 [2024-11-21 03:44:25.903295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.407 [2024-11-21 03:44:25.903320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.407 qpair failed and we were unable to recover it. 00:27:45.407 [2024-11-21 03:44:25.903418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.407 [2024-11-21 03:44:25.903581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.407 [2024-11-21 03:44:25.903608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.407 qpair failed and we were unable to recover it. 00:27:45.407 [2024-11-21 03:44:25.903738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.407 [2024-11-21 03:44:25.903834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.407 [2024-11-21 03:44:25.903859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.407 qpair failed and we were unable to recover it. 00:27:45.407 [2024-11-21 03:44:25.903979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.407 [2024-11-21 03:44:25.904135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.407 [2024-11-21 03:44:25.904161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.407 qpair failed and we were unable to recover it. 00:27:45.407 [2024-11-21 03:44:25.904271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.407 [2024-11-21 03:44:25.904442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.407 [2024-11-21 03:44:25.904471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.407 qpair failed and we were unable to recover it. 00:27:45.407 [2024-11-21 03:44:25.904619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.407 [2024-11-21 03:44:25.904743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.407 [2024-11-21 03:44:25.904769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.407 qpair failed and we were unable to recover it. 00:27:45.407 [2024-11-21 03:44:25.904908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.407 [2024-11-21 03:44:25.905026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.407 [2024-11-21 03:44:25.905054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.407 qpair failed and we were unable to recover it. 00:27:45.407 [2024-11-21 03:44:25.905225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.407 [2024-11-21 03:44:25.905325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.407 [2024-11-21 03:44:25.905350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.407 qpair failed and we were unable to recover it. 00:27:45.407 [2024-11-21 03:44:25.905475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.407 [2024-11-21 03:44:25.905624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.407 [2024-11-21 03:44:25.905649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.407 qpair failed and we were unable to recover it. 00:27:45.407 [2024-11-21 03:44:25.905775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.407 [2024-11-21 03:44:25.905915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.407 [2024-11-21 03:44:25.905942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.407 qpair failed and we were unable to recover it. 00:27:45.407 [2024-11-21 03:44:25.906062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.407 [2024-11-21 03:44:25.906188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.408 [2024-11-21 03:44:25.906213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.408 qpair failed and we were unable to recover it. 00:27:45.408 [2024-11-21 03:44:25.906333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.408 [2024-11-21 03:44:25.906428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.408 [2024-11-21 03:44:25.906453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.408 qpair failed and we were unable to recover it. 00:27:45.408 [2024-11-21 03:44:25.906660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.408 [2024-11-21 03:44:25.906756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.408 [2024-11-21 03:44:25.906783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.408 qpair failed and we were unable to recover it. 00:27:45.408 [2024-11-21 03:44:25.906914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.408 [2024-11-21 03:44:25.907063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.408 [2024-11-21 03:44:25.907102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.408 qpair failed and we were unable to recover it. 00:27:45.408 [2024-11-21 03:44:25.907255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.408 [2024-11-21 03:44:25.907388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.408 [2024-11-21 03:44:25.907412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.408 qpair failed and we were unable to recover it. 00:27:45.408 [2024-11-21 03:44:25.907586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.408 [2024-11-21 03:44:25.907731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.408 [2024-11-21 03:44:25.907759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.408 qpair failed and we were unable to recover it. 00:27:45.408 [2024-11-21 03:44:25.907880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.408 [2024-11-21 03:44:25.908028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.408 [2024-11-21 03:44:25.908053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.408 qpair failed and we were unable to recover it. 00:27:45.408 [2024-11-21 03:44:25.908162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.408 [2024-11-21 03:44:25.908289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.408 [2024-11-21 03:44:25.908313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.408 qpair failed and we were unable to recover it. 00:27:45.408 [2024-11-21 03:44:25.908467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.408 [2024-11-21 03:44:25.908632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.408 [2024-11-21 03:44:25.908660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.408 qpair failed and we were unable to recover it. 00:27:45.408 [2024-11-21 03:44:25.908828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.408 [2024-11-21 03:44:25.908939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.408 [2024-11-21 03:44:25.908965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.408 qpair failed and we were unable to recover it. 00:27:45.408 [2024-11-21 03:44:25.909088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.408 [2024-11-21 03:44:25.909202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.408 [2024-11-21 03:44:25.909226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.408 qpair failed and we were unable to recover it. 00:27:45.408 [2024-11-21 03:44:25.909331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.408 [2024-11-21 03:44:25.909452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.408 [2024-11-21 03:44:25.909477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.408 qpair failed and we were unable to recover it. 00:27:45.408 [2024-11-21 03:44:25.909585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.408 [2024-11-21 03:44:25.909758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.408 [2024-11-21 03:44:25.909783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.408 qpair failed and we were unable to recover it. 00:27:45.408 [2024-11-21 03:44:25.909912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.408 [2024-11-21 03:44:25.910034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.408 [2024-11-21 03:44:25.910058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.408 qpair failed and we were unable to recover it. 00:27:45.408 [2024-11-21 03:44:25.910196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.408 [2024-11-21 03:44:25.910313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.408 [2024-11-21 03:44:25.910337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.408 qpair failed and we were unable to recover it. 00:27:45.408 [2024-11-21 03:44:25.910448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.408 [2024-11-21 03:44:25.910602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.408 [2024-11-21 03:44:25.910629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.408 qpair failed and we were unable to recover it. 00:27:45.408 [2024-11-21 03:44:25.910765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.408 [2024-11-21 03:44:25.910893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.408 [2024-11-21 03:44:25.910919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.408 qpair failed and we were unable to recover it. 00:27:45.408 [2024-11-21 03:44:25.911078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.408 [2024-11-21 03:44:25.911250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.408 [2024-11-21 03:44:25.911276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.408 qpair failed and we were unable to recover it. 00:27:45.408 [2024-11-21 03:44:25.911408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.408 [2024-11-21 03:44:25.911557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.408 [2024-11-21 03:44:25.911584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.408 qpair failed and we were unable to recover it. 00:27:45.408 [2024-11-21 03:44:25.911703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.408 [2024-11-21 03:44:25.911808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.408 [2024-11-21 03:44:25.911832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.408 qpair failed and we were unable to recover it. 00:27:45.408 [2024-11-21 03:44:25.911969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.408 [2024-11-21 03:44:25.912127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.408 [2024-11-21 03:44:25.912153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.408 qpair failed and we were unable to recover it. 00:27:45.408 [2024-11-21 03:44:25.912255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.408 [2024-11-21 03:44:25.912380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.408 [2024-11-21 03:44:25.912422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.408 qpair failed and we were unable to recover it. 00:27:45.408 [2024-11-21 03:44:25.912576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.408 [2024-11-21 03:44:25.912679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.408 [2024-11-21 03:44:25.912703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.408 qpair failed and we were unable to recover it. 00:27:45.408 [2024-11-21 03:44:25.912843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.408 [2024-11-21 03:44:25.912953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.408 [2024-11-21 03:44:25.912981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.408 qpair failed and we were unable to recover it. 00:27:45.408 [2024-11-21 03:44:25.913148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.408 [2024-11-21 03:44:25.913296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.408 [2024-11-21 03:44:25.913320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.408 qpair failed and we were unable to recover it. 00:27:45.408 [2024-11-21 03:44:25.913477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.408 [2024-11-21 03:44:25.913576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.408 [2024-11-21 03:44:25.913601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.408 qpair failed and we were unable to recover it. 00:27:45.408 [2024-11-21 03:44:25.913735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.408 [2024-11-21 03:44:25.913877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.408 [2024-11-21 03:44:25.913904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.408 qpair failed and we were unable to recover it. 00:27:45.408 [2024-11-21 03:44:25.914021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.408 [2024-11-21 03:44:25.914189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.409 [2024-11-21 03:44:25.914216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.409 qpair failed and we were unable to recover it. 00:27:45.409 [2024-11-21 03:44:25.914347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.409 [2024-11-21 03:44:25.914479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.409 [2024-11-21 03:44:25.914504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.409 qpair failed and we were unable to recover it. 00:27:45.409 [2024-11-21 03:44:25.914654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.409 [2024-11-21 03:44:25.914802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.409 [2024-11-21 03:44:25.914826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.409 qpair failed and we were unable to recover it. 00:27:45.409 [2024-11-21 03:44:25.914948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.409 [2024-11-21 03:44:25.915088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.409 [2024-11-21 03:44:25.915116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.409 qpair failed and we were unable to recover it. 00:27:45.409 [2024-11-21 03:44:25.915259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.409 [2024-11-21 03:44:25.915386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.409 [2024-11-21 03:44:25.915412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.409 qpair failed and we were unable to recover it. 00:27:45.409 [2024-11-21 03:44:25.915566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.409 [2024-11-21 03:44:25.915693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.409 [2024-11-21 03:44:25.915722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.409 qpair failed and we were unable to recover it. 00:27:45.409 [2024-11-21 03:44:25.915843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.409 [2024-11-21 03:44:25.915982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.409 [2024-11-21 03:44:25.916009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.409 qpair failed and we were unable to recover it. 00:27:45.409 [2024-11-21 03:44:25.916126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.409 [2024-11-21 03:44:25.916254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.409 [2024-11-21 03:44:25.916280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.409 qpair failed and we were unable to recover it. 00:27:45.409 [2024-11-21 03:44:25.916392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.409 [2024-11-21 03:44:25.916501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.409 [2024-11-21 03:44:25.916540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.409 qpair failed and we were unable to recover it. 00:27:45.409 [2024-11-21 03:44:25.916705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.409 [2024-11-21 03:44:25.916853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.409 [2024-11-21 03:44:25.916881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.409 qpair failed and we were unable to recover it. 00:27:45.409 [2024-11-21 03:44:25.917007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.409 [2024-11-21 03:44:25.917143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.409 [2024-11-21 03:44:25.917169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.409 qpair failed and we were unable to recover it. 00:27:45.409 [2024-11-21 03:44:25.917296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.409 [2024-11-21 03:44:25.917406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.409 [2024-11-21 03:44:25.917434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.409 qpair failed and we were unable to recover it. 00:27:45.409 [2024-11-21 03:44:25.917609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.409 [2024-11-21 03:44:25.917740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.409 [2024-11-21 03:44:25.917764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.409 qpair failed and we were unable to recover it. 00:27:45.409 [2024-11-21 03:44:25.917890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.409 [2024-11-21 03:44:25.918020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.409 [2024-11-21 03:44:25.918044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.409 qpair failed and we were unable to recover it. 00:27:45.409 [2024-11-21 03:44:25.918162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.409 [2024-11-21 03:44:25.918284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.409 [2024-11-21 03:44:25.918308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.409 qpair failed and we were unable to recover it. 00:27:45.409 [2024-11-21 03:44:25.918410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.409 [2024-11-21 03:44:25.918534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.409 [2024-11-21 03:44:25.918558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.409 qpair failed and we were unable to recover it. 00:27:45.409 [2024-11-21 03:44:25.918662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.409 [2024-11-21 03:44:25.918819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.409 [2024-11-21 03:44:25.918844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.409 qpair failed and we were unable to recover it. 00:27:45.409 [2024-11-21 03:44:25.918971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.409 [2024-11-21 03:44:25.919156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.409 [2024-11-21 03:44:25.919183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.409 qpair failed and we were unable to recover it. 00:27:45.409 [2024-11-21 03:44:25.919306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.409 [2024-11-21 03:44:25.919400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.409 [2024-11-21 03:44:25.919439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.409 qpair failed and we were unable to recover it. 00:27:45.409 [2024-11-21 03:44:25.919601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.409 [2024-11-21 03:44:25.919727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.409 [2024-11-21 03:44:25.919753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.409 qpair failed and we were unable to recover it. 00:27:45.409 [2024-11-21 03:44:25.919908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.409 [2024-11-21 03:44:25.920016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.409 [2024-11-21 03:44:25.920043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.409 qpair failed and we were unable to recover it. 00:27:45.409 [2024-11-21 03:44:25.920194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.409 [2024-11-21 03:44:25.920295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.409 [2024-11-21 03:44:25.920320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.409 qpair failed and we were unable to recover it. 00:27:45.409 [2024-11-21 03:44:25.920440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.409 [2024-11-21 03:44:25.920541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.409 [2024-11-21 03:44:25.920566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.409 qpair failed and we were unable to recover it. 00:27:45.409 [2024-11-21 03:44:25.920687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.409 [2024-11-21 03:44:25.920834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.409 [2024-11-21 03:44:25.920858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.409 qpair failed and we were unable to recover it. 00:27:45.409 [2024-11-21 03:44:25.920981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.409 [2024-11-21 03:44:25.921121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.410 [2024-11-21 03:44:25.921149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.410 qpair failed and we were unable to recover it. 00:27:45.410 [2024-11-21 03:44:25.921273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.410 [2024-11-21 03:44:25.921400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.410 [2024-11-21 03:44:25.921425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.410 qpair failed and we were unable to recover it. 00:27:45.410 [2024-11-21 03:44:25.921562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.410 [2024-11-21 03:44:25.921677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.410 [2024-11-21 03:44:25.921705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.410 qpair failed and we were unable to recover it. 00:27:45.410 [2024-11-21 03:44:25.921873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.410 [2024-11-21 03:44:25.922012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.410 [2024-11-21 03:44:25.922040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.410 qpair failed and we were unable to recover it. 00:27:45.410 [2024-11-21 03:44:25.922217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.410 [2024-11-21 03:44:25.922391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.410 [2024-11-21 03:44:25.922419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.410 qpair failed and we were unable to recover it. 00:27:45.410 [2024-11-21 03:44:25.922561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.410 [2024-11-21 03:44:25.922717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.410 [2024-11-21 03:44:25.922743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.410 qpair failed and we were unable to recover it. 00:27:45.410 [2024-11-21 03:44:25.922872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.410 [2024-11-21 03:44:25.922971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.410 [2024-11-21 03:44:25.923012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.410 qpair failed and we were unable to recover it. 00:27:45.410 [2024-11-21 03:44:25.923166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.410 [2024-11-21 03:44:25.923264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.410 [2024-11-21 03:44:25.923289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.410 qpair failed and we were unable to recover it. 00:27:45.410 [2024-11-21 03:44:25.923410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.410 [2024-11-21 03:44:25.923517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.410 [2024-11-21 03:44:25.923546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.410 qpair failed and we were unable to recover it. 00:27:45.410 [2024-11-21 03:44:25.923688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.410 [2024-11-21 03:44:25.923805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.410 [2024-11-21 03:44:25.923833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.410 qpair failed and we were unable to recover it. 00:27:45.410 [2024-11-21 03:44:25.923961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.410 [2024-11-21 03:44:25.924092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.410 [2024-11-21 03:44:25.924117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.410 qpair failed and we were unable to recover it. 00:27:45.410 [2024-11-21 03:44:25.924210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.410 [2024-11-21 03:44:25.924359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.410 [2024-11-21 03:44:25.924388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.410 qpair failed and we were unable to recover it. 00:27:45.410 [2024-11-21 03:44:25.924539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.410 [2024-11-21 03:44:25.924676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.410 [2024-11-21 03:44:25.924704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.410 qpair failed and we were unable to recover it. 00:27:45.410 [2024-11-21 03:44:25.924881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.410 [2024-11-21 03:44:25.925009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.410 [2024-11-21 03:44:25.925050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.410 qpair failed and we were unable to recover it. 00:27:45.410 [2024-11-21 03:44:25.925209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.410 [2024-11-21 03:44:25.925311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.410 [2024-11-21 03:44:25.925336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.410 qpair failed and we were unable to recover it. 00:27:45.410 [2024-11-21 03:44:25.925503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.410 [2024-11-21 03:44:25.925607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.410 [2024-11-21 03:44:25.925632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.410 qpair failed and we were unable to recover it. 00:27:45.410 [2024-11-21 03:44:25.925765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.410 [2024-11-21 03:44:25.925918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.410 [2024-11-21 03:44:25.925943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.410 qpair failed and we were unable to recover it. 00:27:45.410 [2024-11-21 03:44:25.926087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.410 [2024-11-21 03:44:25.926243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.410 [2024-11-21 03:44:25.926269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.410 qpair failed and we were unable to recover it. 00:27:45.410 [2024-11-21 03:44:25.926374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.410 [2024-11-21 03:44:25.926470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.410 [2024-11-21 03:44:25.926494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.410 qpair failed and we were unable to recover it. 00:27:45.410 [2024-11-21 03:44:25.926684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.410 [2024-11-21 03:44:25.926813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.410 [2024-11-21 03:44:25.926838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.410 qpair failed and we were unable to recover it. 00:27:45.410 [2024-11-21 03:44:25.926965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.410 [2024-11-21 03:44:25.927109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.410 [2024-11-21 03:44:25.927138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.410 qpair failed and we were unable to recover it. 00:27:45.410 [2024-11-21 03:44:25.927298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.410 [2024-11-21 03:44:25.927431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.410 [2024-11-21 03:44:25.927456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.410 qpair failed and we were unable to recover it. 00:27:45.410 [2024-11-21 03:44:25.927551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.410 [2024-11-21 03:44:25.927687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.410 [2024-11-21 03:44:25.927711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.410 qpair failed and we were unable to recover it. 00:27:45.410 [2024-11-21 03:44:25.927843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.410 [2024-11-21 03:44:25.927948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.410 [2024-11-21 03:44:25.927976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.410 qpair failed and we were unable to recover it. 00:27:45.410 [2024-11-21 03:44:25.928153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.410 [2024-11-21 03:44:25.928280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.410 [2024-11-21 03:44:25.928305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.410 qpair failed and we were unable to recover it. 00:27:45.410 [2024-11-21 03:44:25.928433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.410 [2024-11-21 03:44:25.928556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.410 [2024-11-21 03:44:25.928581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.410 qpair failed and we were unable to recover it. 00:27:45.410 [2024-11-21 03:44:25.928719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.410 [2024-11-21 03:44:25.928869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.410 [2024-11-21 03:44:25.928894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.410 qpair failed and we were unable to recover it. 00:27:45.410 [2024-11-21 03:44:25.929006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.410 [2024-11-21 03:44:25.929167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.410 [2024-11-21 03:44:25.929192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.410 qpair failed and we were unable to recover it. 00:27:45.410 [2024-11-21 03:44:25.929293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.410 [2024-11-21 03:44:25.929393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.410 [2024-11-21 03:44:25.929417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.410 qpair failed and we were unable to recover it. 00:27:45.410 [2024-11-21 03:44:25.929538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.411 [2024-11-21 03:44:25.929643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.411 [2024-11-21 03:44:25.929671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.411 qpair failed and we were unable to recover it. 00:27:45.411 [2024-11-21 03:44:25.929783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.411 [2024-11-21 03:44:25.929921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.411 [2024-11-21 03:44:25.929948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.411 qpair failed and we were unable to recover it. 00:27:45.411 [2024-11-21 03:44:25.930094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.411 [2024-11-21 03:44:25.930200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.411 [2024-11-21 03:44:25.930226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.411 qpair failed and we were unable to recover it. 00:27:45.411 [2024-11-21 03:44:25.930336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.411 [2024-11-21 03:44:25.930437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.411 [2024-11-21 03:44:25.930483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.411 qpair failed and we were unable to recover it. 00:27:45.411 [2024-11-21 03:44:25.930621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.411 [2024-11-21 03:44:25.930765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.411 [2024-11-21 03:44:25.930793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.411 qpair failed and we were unable to recover it. 00:27:45.411 [2024-11-21 03:44:25.930940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.411 [2024-11-21 03:44:25.931035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.411 [2024-11-21 03:44:25.931060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.411 qpair failed and we were unable to recover it. 00:27:45.411 [2024-11-21 03:44:25.931227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.411 [2024-11-21 03:44:25.931382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.411 [2024-11-21 03:44:25.931408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.411 qpair failed and we were unable to recover it. 00:27:45.411 [2024-11-21 03:44:25.931523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.411 [2024-11-21 03:44:25.931706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.411 [2024-11-21 03:44:25.931731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.411 qpair failed and we were unable to recover it. 00:27:45.411 [2024-11-21 03:44:25.931882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.411 [2024-11-21 03:44:25.932030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.411 [2024-11-21 03:44:25.932058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.411 qpair failed and we were unable to recover it. 00:27:45.411 [2024-11-21 03:44:25.932192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.411 [2024-11-21 03:44:25.932320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.411 [2024-11-21 03:44:25.932345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.411 qpair failed and we were unable to recover it. 00:27:45.411 [2024-11-21 03:44:25.932445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.411 [2024-11-21 03:44:25.932591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.411 [2024-11-21 03:44:25.932619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.411 qpair failed and we were unable to recover it. 00:27:45.411 [2024-11-21 03:44:25.932748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.411 [2024-11-21 03:44:25.932880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.411 [2024-11-21 03:44:25.932904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.411 qpair failed and we were unable to recover it. 00:27:45.411 [2024-11-21 03:44:25.933022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.411 [2024-11-21 03:44:25.933175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.411 [2024-11-21 03:44:25.933204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.411 qpair failed and we were unable to recover it. 00:27:45.411 [2024-11-21 03:44:25.933368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.411 [2024-11-21 03:44:25.933520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.411 [2024-11-21 03:44:25.933545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.411 qpair failed and we were unable to recover it. 00:27:45.411 [2024-11-21 03:44:25.933684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.411 [2024-11-21 03:44:25.933787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.411 [2024-11-21 03:44:25.933811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.411 qpair failed and we were unable to recover it. 00:27:45.411 [2024-11-21 03:44:25.933943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.411 [2024-11-21 03:44:25.934054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.411 [2024-11-21 03:44:25.934089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.411 qpair failed and we were unable to recover it. 00:27:45.411 [2024-11-21 03:44:25.934238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.411 [2024-11-21 03:44:25.934352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.411 [2024-11-21 03:44:25.934379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.411 qpair failed and we were unable to recover it. 00:27:45.411 [2024-11-21 03:44:25.934504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.411 [2024-11-21 03:44:25.934659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.411 [2024-11-21 03:44:25.934685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.411 qpair failed and we were unable to recover it. 00:27:45.411 [2024-11-21 03:44:25.934811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.411 [2024-11-21 03:44:25.934930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.411 [2024-11-21 03:44:25.934958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.411 qpair failed and we were unable to recover it. 00:27:45.411 [2024-11-21 03:44:25.935064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.411 [2024-11-21 03:44:25.935183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.411 [2024-11-21 03:44:25.935210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.411 qpair failed and we were unable to recover it. 00:27:45.411 [2024-11-21 03:44:25.935337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.411 [2024-11-21 03:44:25.935491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.411 [2024-11-21 03:44:25.935516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.411 qpair failed and we were unable to recover it. 00:27:45.411 [2024-11-21 03:44:25.935638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.411 [2024-11-21 03:44:25.935775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.411 [2024-11-21 03:44:25.935802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.411 qpair failed and we were unable to recover it. 00:27:45.411 [2024-11-21 03:44:25.935951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.411 [2024-11-21 03:44:25.936083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.411 [2024-11-21 03:44:25.936109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.411 qpair failed and we were unable to recover it. 00:27:45.411 [2024-11-21 03:44:25.936269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.411 [2024-11-21 03:44:25.936373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.411 [2024-11-21 03:44:25.936397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.411 qpair failed and we were unable to recover it. 00:27:45.411 [2024-11-21 03:44:25.936528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.411 [2024-11-21 03:44:25.936669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.411 [2024-11-21 03:44:25.936696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.411 qpair failed and we were unable to recover it. 00:27:45.411 [2024-11-21 03:44:25.936808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.411 [2024-11-21 03:44:25.936930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.411 [2024-11-21 03:44:25.936954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.411 qpair failed and we were unable to recover it. 00:27:45.411 [2024-11-21 03:44:25.937119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.411 [2024-11-21 03:44:25.937222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.411 [2024-11-21 03:44:25.937248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.411 qpair failed and we were unable to recover it. 00:27:45.411 [2024-11-21 03:44:25.937398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.411 [2024-11-21 03:44:25.937503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.411 [2024-11-21 03:44:25.937530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.411 qpair failed and we were unable to recover it. 00:27:45.411 [2024-11-21 03:44:25.937642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.411 [2024-11-21 03:44:25.937788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.411 [2024-11-21 03:44:25.937813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.412 qpair failed and we were unable to recover it. 00:27:45.412 [2024-11-21 03:44:25.937918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.412 [2024-11-21 03:44:25.938037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.412 [2024-11-21 03:44:25.938063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.412 qpair failed and we were unable to recover it. 00:27:45.412 [2024-11-21 03:44:25.938239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.412 [2024-11-21 03:44:25.938359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.412 [2024-11-21 03:44:25.938386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.412 qpair failed and we were unable to recover it. 00:27:45.412 [2024-11-21 03:44:25.938530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.412 [2024-11-21 03:44:25.938635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.412 [2024-11-21 03:44:25.938662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.412 qpair failed and we were unable to recover it. 00:27:45.412 [2024-11-21 03:44:25.938784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.412 [2024-11-21 03:44:25.938887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.412 [2024-11-21 03:44:25.938911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.412 qpair failed and we were unable to recover it. 00:27:45.412 [2024-11-21 03:44:25.939087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.412 [2024-11-21 03:44:25.939261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.412 [2024-11-21 03:44:25.939288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.412 qpair failed and we were unable to recover it. 00:27:45.412 [2024-11-21 03:44:25.939400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.412 [2024-11-21 03:44:25.939539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.412 [2024-11-21 03:44:25.939566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.412 qpair failed and we were unable to recover it. 00:27:45.412 [2024-11-21 03:44:25.939684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.412 [2024-11-21 03:44:25.939840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.412 [2024-11-21 03:44:25.939865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.412 qpair failed and we were unable to recover it. 00:27:45.412 [2024-11-21 03:44:25.939996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.412 [2024-11-21 03:44:25.940146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.412 [2024-11-21 03:44:25.940172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.412 qpair failed and we were unable to recover it. 00:27:45.412 [2024-11-21 03:44:25.940300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.412 [2024-11-21 03:44:25.940435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.412 [2024-11-21 03:44:25.940462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.412 qpair failed and we were unable to recover it. 00:27:45.412 [2024-11-21 03:44:25.940578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.412 [2024-11-21 03:44:25.940682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.412 [2024-11-21 03:44:25.940707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.412 qpair failed and we were unable to recover it. 00:27:45.412 [2024-11-21 03:44:25.940834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.412 [2024-11-21 03:44:25.940991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.412 [2024-11-21 03:44:25.941019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.412 qpair failed and we were unable to recover it. 00:27:45.412 [2024-11-21 03:44:25.941124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.412 [2024-11-21 03:44:25.941250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.412 [2024-11-21 03:44:25.941274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.412 qpair failed and we were unable to recover it. 00:27:45.412 [2024-11-21 03:44:25.941498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.412 [2024-11-21 03:44:25.941647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.412 [2024-11-21 03:44:25.941689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.412 qpair failed and we were unable to recover it. 00:27:45.412 [2024-11-21 03:44:25.941825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.412 [2024-11-21 03:44:25.941983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.412 [2024-11-21 03:44:25.942010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.412 qpair failed and we were unable to recover it. 00:27:45.412 [2024-11-21 03:44:25.942169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.412 [2024-11-21 03:44:25.942295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.412 [2024-11-21 03:44:25.942319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.412 qpair failed and we were unable to recover it. 00:27:45.412 [2024-11-21 03:44:25.942510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.412 [2024-11-21 03:44:25.942616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.412 [2024-11-21 03:44:25.942642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.412 qpair failed and we were unable to recover it. 00:27:45.412 [2024-11-21 03:44:25.942762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.412 [2024-11-21 03:44:25.942905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.412 [2024-11-21 03:44:25.942933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.412 qpair failed and we were unable to recover it. 00:27:45.412 [2024-11-21 03:44:25.943094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.412 [2024-11-21 03:44:25.943198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.412 [2024-11-21 03:44:25.943224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.412 qpair failed and we were unable to recover it. 00:27:45.412 [2024-11-21 03:44:25.943353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.412 [2024-11-21 03:44:25.943457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.412 [2024-11-21 03:44:25.943482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.412 qpair failed and we were unable to recover it. 00:27:45.412 [2024-11-21 03:44:25.943645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.412 [2024-11-21 03:44:25.943769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.412 [2024-11-21 03:44:25.943793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.412 qpair failed and we were unable to recover it. 00:27:45.412 [2024-11-21 03:44:25.943914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.412 [2024-11-21 03:44:25.944060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.412 [2024-11-21 03:44:25.944095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.412 qpair failed and we were unable to recover it. 00:27:45.412 [2024-11-21 03:44:25.944255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.412 [2024-11-21 03:44:25.944384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.412 [2024-11-21 03:44:25.944425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.412 qpair failed and we were unable to recover it. 00:27:45.412 [2024-11-21 03:44:25.944541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.412 [2024-11-21 03:44:25.944651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.412 [2024-11-21 03:44:25.944679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.412 qpair failed and we were unable to recover it. 00:27:45.412 [2024-11-21 03:44:25.944819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.412 [2024-11-21 03:44:25.944932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.412 [2024-11-21 03:44:25.944960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.412 qpair failed and we were unable to recover it. 00:27:45.412 [2024-11-21 03:44:25.945142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.412 [2024-11-21 03:44:25.945280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.412 [2024-11-21 03:44:25.945322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.412 qpair failed and we were unable to recover it. 00:27:45.412 [2024-11-21 03:44:25.945470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.412 [2024-11-21 03:44:25.945607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.412 [2024-11-21 03:44:25.945638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.412 qpair failed and we were unable to recover it. 00:27:45.412 [2024-11-21 03:44:25.945783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.412 [2024-11-21 03:44:25.945923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.412 [2024-11-21 03:44:25.945950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.412 qpair failed and we were unable to recover it. 00:27:45.412 [2024-11-21 03:44:25.946082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.412 [2024-11-21 03:44:25.946196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.413 [2024-11-21 03:44:25.946222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.413 qpair failed and we were unable to recover it. 00:27:45.413 [2024-11-21 03:44:25.946328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.413 [2024-11-21 03:44:25.946451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.413 [2024-11-21 03:44:25.946478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.413 qpair failed and we were unable to recover it. 00:27:45.413 [2024-11-21 03:44:25.946625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.413 [2024-11-21 03:44:25.946781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.413 [2024-11-21 03:44:25.946806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.413 qpair failed and we were unable to recover it. 00:27:45.413 [2024-11-21 03:44:25.946933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.413 [2024-11-21 03:44:25.947117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.413 [2024-11-21 03:44:25.947142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.413 qpair failed and we were unable to recover it. 00:27:45.413 [2024-11-21 03:44:25.947251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.413 [2024-11-21 03:44:25.947357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.413 [2024-11-21 03:44:25.947381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.413 qpair failed and we were unable to recover it. 00:27:45.413 [2024-11-21 03:44:25.947534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.413 [2024-11-21 03:44:25.947680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.413 [2024-11-21 03:44:25.947707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.413 qpair failed and we were unable to recover it. 00:27:45.413 [2024-11-21 03:44:25.947833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.413 [2024-11-21 03:44:25.947983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.413 [2024-11-21 03:44:25.948007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.413 qpair failed and we were unable to recover it. 00:27:45.413 [2024-11-21 03:44:25.948138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.413 [2024-11-21 03:44:25.948256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.413 [2024-11-21 03:44:25.948284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.413 qpair failed and we were unable to recover it. 00:27:45.413 [2024-11-21 03:44:25.948415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.413 [2024-11-21 03:44:25.948549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.413 [2024-11-21 03:44:25.948582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.413 qpair failed and we were unable to recover it. 00:27:45.413 [2024-11-21 03:44:25.948733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.413 [2024-11-21 03:44:25.948829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.413 [2024-11-21 03:44:25.948855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.413 qpair failed and we were unable to recover it. 00:27:45.413 [2024-11-21 03:44:25.948991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.413 [2024-11-21 03:44:25.949126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.413 [2024-11-21 03:44:25.949152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.413 qpair failed and we were unable to recover it. 00:27:45.413 [2024-11-21 03:44:25.949317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.413 [2024-11-21 03:44:25.949426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.413 [2024-11-21 03:44:25.949450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.413 qpair failed and we were unable to recover it. 00:27:45.413 [2024-11-21 03:44:25.949575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.413 [2024-11-21 03:44:25.949729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.413 [2024-11-21 03:44:25.949769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.413 qpair failed and we were unable to recover it. 00:27:45.413 [2024-11-21 03:44:25.949922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.413 [2024-11-21 03:44:25.950049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.413 [2024-11-21 03:44:25.950081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.413 qpair failed and we were unable to recover it. 00:27:45.413 [2024-11-21 03:44:25.950201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.413 [2024-11-21 03:44:25.950308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.413 [2024-11-21 03:44:25.950336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.413 qpair failed and we were unable to recover it. 00:27:45.413 [2024-11-21 03:44:25.950493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.413 [2024-11-21 03:44:25.950621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.413 [2024-11-21 03:44:25.950646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.413 qpair failed and we were unable to recover it. 00:27:45.413 [2024-11-21 03:44:25.950743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.413 [2024-11-21 03:44:25.950875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.413 [2024-11-21 03:44:25.950900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.413 qpair failed and we were unable to recover it. 00:27:45.413 [2024-11-21 03:44:25.951082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.413 [2024-11-21 03:44:25.951220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.413 [2024-11-21 03:44:25.951247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.413 qpair failed and we were unable to recover it. 00:27:45.413 [2024-11-21 03:44:25.951384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.413 [2024-11-21 03:44:25.951490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.413 [2024-11-21 03:44:25.951517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.413 qpair failed and we were unable to recover it. 00:27:45.413 [2024-11-21 03:44:25.951643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.413 [2024-11-21 03:44:25.951782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.413 [2024-11-21 03:44:25.951810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.413 qpair failed and we were unable to recover it. 00:27:45.413 [2024-11-21 03:44:25.951963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.413 [2024-11-21 03:44:25.952081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.413 [2024-11-21 03:44:25.952110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.413 qpair failed and we were unable to recover it. 00:27:45.413 [2024-11-21 03:44:25.952280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.413 [2024-11-21 03:44:25.952416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.413 [2024-11-21 03:44:25.952458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.413 qpair failed and we were unable to recover it. 00:27:45.413 [2024-11-21 03:44:25.952627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.413 [2024-11-21 03:44:25.952765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.413 [2024-11-21 03:44:25.952792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.413 qpair failed and we were unable to recover it. 00:27:45.413 [2024-11-21 03:44:25.952934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.413 [2024-11-21 03:44:25.953084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.413 [2024-11-21 03:44:25.953111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.413 qpair failed and we were unable to recover it. 00:27:45.413 [2024-11-21 03:44:25.953266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.413 [2024-11-21 03:44:25.953371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.413 [2024-11-21 03:44:25.953397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.413 qpair failed and we were unable to recover it. 00:27:45.413 [2024-11-21 03:44:25.953519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.413 [2024-11-21 03:44:25.953665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.413 [2024-11-21 03:44:25.953694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.413 qpair failed and we were unable to recover it. 00:27:45.413 [2024-11-21 03:44:25.953859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.413 [2024-11-21 03:44:25.953997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.413 [2024-11-21 03:44:25.954024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.413 qpair failed and we were unable to recover it. 00:27:45.413 [2024-11-21 03:44:25.954176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.413 [2024-11-21 03:44:25.954311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.413 [2024-11-21 03:44:25.954335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.414 qpair failed and we were unable to recover it. 00:27:45.414 [2024-11-21 03:44:25.954433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.414 [2024-11-21 03:44:25.954549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.414 [2024-11-21 03:44:25.954573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.414 qpair failed and we were unable to recover it. 00:27:45.414 [2024-11-21 03:44:25.954721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.414 [2024-11-21 03:44:25.954844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.414 [2024-11-21 03:44:25.954886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.414 qpair failed and we were unable to recover it. 00:27:45.414 [2024-11-21 03:44:25.956156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.414 [2024-11-21 03:44:25.956331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.414 [2024-11-21 03:44:25.956361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.414 qpair failed and we were unable to recover it. 00:27:45.414 [2024-11-21 03:44:25.956486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.414 [2024-11-21 03:44:25.956626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.414 [2024-11-21 03:44:25.956654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.414 qpair failed and we were unable to recover it. 00:27:45.414 [2024-11-21 03:44:25.956777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.414 [2024-11-21 03:44:25.956926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.414 [2024-11-21 03:44:25.956951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.414 qpair failed and we were unable to recover it. 00:27:45.414 [2024-11-21 03:44:25.957045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.414 [2024-11-21 03:44:25.957179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.414 [2024-11-21 03:44:25.957205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.414 qpair failed and we were unable to recover it. 00:27:45.414 [2024-11-21 03:44:25.957327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.414 [2024-11-21 03:44:25.957458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.414 [2024-11-21 03:44:25.957485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.414 qpair failed and we were unable to recover it. 00:27:45.414 [2024-11-21 03:44:25.957620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.414 [2024-11-21 03:44:25.957740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.414 [2024-11-21 03:44:25.957769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.414 qpair failed and we were unable to recover it. 00:27:45.414 [2024-11-21 03:44:25.957917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.414 [2024-11-21 03:44:25.958044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.414 [2024-11-21 03:44:25.958078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.414 qpair failed and we were unable to recover it. 00:27:45.414 [2024-11-21 03:44:25.958201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.414 [2024-11-21 03:44:25.958340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.414 [2024-11-21 03:44:25.958368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.414 qpair failed and we were unable to recover it. 00:27:45.414 [2024-11-21 03:44:25.958494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.414 [2024-11-21 03:44:25.958660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.414 [2024-11-21 03:44:25.958689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.414 qpair failed and we were unable to recover it. 00:27:45.414 [2024-11-21 03:44:25.958800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.414 [2024-11-21 03:44:25.958951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.414 [2024-11-21 03:44:25.958977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.414 qpair failed and we were unable to recover it. 00:27:45.414 [2024-11-21 03:44:25.959083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.414 [2024-11-21 03:44:25.959214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.414 [2024-11-21 03:44:25.959243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.414 qpair failed and we were unable to recover it. 00:27:45.414 [2024-11-21 03:44:25.959362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.414 [2024-11-21 03:44:25.959506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.414 [2024-11-21 03:44:25.959532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.414 qpair failed and we were unable to recover it. 00:27:45.414 [2024-11-21 03:44:25.959660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.414 [2024-11-21 03:44:25.959793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.414 [2024-11-21 03:44:25.959818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.414 qpair failed and we were unable to recover it. 00:27:45.414 [2024-11-21 03:44:25.959945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.414 [2024-11-21 03:44:25.960049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.414 [2024-11-21 03:44:25.960082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.414 qpair failed and we were unable to recover it. 00:27:45.414 [2024-11-21 03:44:25.960239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.414 [2024-11-21 03:44:25.960372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.414 [2024-11-21 03:44:25.960396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.414 qpair failed and we were unable to recover it. 00:27:45.414 [2024-11-21 03:44:25.960522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.414 [2024-11-21 03:44:25.960620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.414 [2024-11-21 03:44:25.960645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.414 qpair failed and we were unable to recover it. 00:27:45.414 [2024-11-21 03:44:25.960734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.414 [2024-11-21 03:44:25.960865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.414 [2024-11-21 03:44:25.960889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.414 qpair failed and we were unable to recover it. 00:27:45.414 [2024-11-21 03:44:25.960993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.414 [2024-11-21 03:44:25.961121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.414 [2024-11-21 03:44:25.961158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.414 qpair failed and we were unable to recover it. 00:27:45.414 [2024-11-21 03:44:25.961301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.414 [2024-11-21 03:44:25.961430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.414 [2024-11-21 03:44:25.961454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.414 qpair failed and we were unable to recover it. 00:27:45.414 [2024-11-21 03:44:25.961568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.414 [2024-11-21 03:44:25.961750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.414 [2024-11-21 03:44:25.961778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.414 qpair failed and we were unable to recover it. 00:27:45.414 [2024-11-21 03:44:25.961887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.414 [2024-11-21 03:44:25.962037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.414 [2024-11-21 03:44:25.962062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.414 qpair failed and we were unable to recover it. 00:27:45.414 [2024-11-21 03:44:25.962227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.415 [2024-11-21 03:44:25.962388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.415 [2024-11-21 03:44:25.962413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.415 qpair failed and we were unable to recover it. 00:27:45.415 [2024-11-21 03:44:25.962598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.415 [2024-11-21 03:44:25.962711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.415 [2024-11-21 03:44:25.962739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.415 qpair failed and we were unable to recover it. 00:27:45.415 [2024-11-21 03:44:25.962852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.415 [2024-11-21 03:44:25.963001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.415 [2024-11-21 03:44:25.963028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.415 qpair failed and we were unable to recover it. 00:27:45.415 [2024-11-21 03:44:25.963204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.415 [2024-11-21 03:44:25.963337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.415 [2024-11-21 03:44:25.963363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.415 qpair failed and we were unable to recover it. 00:27:45.415 [2024-11-21 03:44:25.963518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.415 [2024-11-21 03:44:25.963624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.415 [2024-11-21 03:44:25.963653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.415 qpair failed and we were unable to recover it. 00:27:45.415 [2024-11-21 03:44:25.963793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.415 [2024-11-21 03:44:25.963929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.415 [2024-11-21 03:44:25.963957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.415 qpair failed and we were unable to recover it. 00:27:45.415 [2024-11-21 03:44:25.964112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.415 [2024-11-21 03:44:25.964252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.415 [2024-11-21 03:44:25.964276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.415 qpair failed and we were unable to recover it. 00:27:45.415 [2024-11-21 03:44:25.964428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.415 [2024-11-21 03:44:25.964607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.415 [2024-11-21 03:44:25.964634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.415 qpair failed and we were unable to recover it. 00:27:45.415 [2024-11-21 03:44:25.964769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.415 [2024-11-21 03:44:25.964865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.415 [2024-11-21 03:44:25.964895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.415 qpair failed and we were unable to recover it. 00:27:45.415 [2024-11-21 03:44:25.965018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.415 [2024-11-21 03:44:25.965147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.415 [2024-11-21 03:44:25.965173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.415 qpair failed and we were unable to recover it. 00:27:45.415 [2024-11-21 03:44:25.965361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.415 [2024-11-21 03:44:25.965516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.415 [2024-11-21 03:44:25.965541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.415 qpair failed and we were unable to recover it. 00:27:45.415 [2024-11-21 03:44:25.965669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.415 [2024-11-21 03:44:25.965855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.415 [2024-11-21 03:44:25.965879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.415 qpair failed and we were unable to recover it. 00:27:45.415 [2024-11-21 03:44:25.966014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.415 [2024-11-21 03:44:25.966102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.415 [2024-11-21 03:44:25.966128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.415 qpair failed and we were unable to recover it. 00:27:45.415 [2024-11-21 03:44:25.966245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.415 [2024-11-21 03:44:25.966402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.415 [2024-11-21 03:44:25.966429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.415 qpair failed and we were unable to recover it. 00:27:45.415 [2024-11-21 03:44:25.966575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.415 [2024-11-21 03:44:25.966708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.415 [2024-11-21 03:44:25.966737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.415 qpair failed and we were unable to recover it. 00:27:45.415 [2024-11-21 03:44:25.966882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.415 [2024-11-21 03:44:25.966981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.415 [2024-11-21 03:44:25.967006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.415 qpair failed and we were unable to recover it. 00:27:45.415 [2024-11-21 03:44:25.967148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.415 [2024-11-21 03:44:25.967289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.415 [2024-11-21 03:44:25.967314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.415 qpair failed and we were unable to recover it. 00:27:45.415 [2024-11-21 03:44:25.967468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.415 [2024-11-21 03:44:25.967615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.415 [2024-11-21 03:44:25.967642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.415 qpair failed and we were unable to recover it. 00:27:45.415 [2024-11-21 03:44:25.967802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.415 [2024-11-21 03:44:25.967929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.415 [2024-11-21 03:44:25.967953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.415 qpair failed and we were unable to recover it. 00:27:45.415 [2024-11-21 03:44:25.968117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.415 [2024-11-21 03:44:25.968246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.415 [2024-11-21 03:44:25.968271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.415 qpair failed and we were unable to recover it. 00:27:45.415 [2024-11-21 03:44:25.968371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.415 [2024-11-21 03:44:25.968467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.415 [2024-11-21 03:44:25.968491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.415 qpair failed and we were unable to recover it. 00:27:45.415 [2024-11-21 03:44:25.968627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.415 [2024-11-21 03:44:25.968730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.415 [2024-11-21 03:44:25.968754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.415 qpair failed and we were unable to recover it. 00:27:45.415 [2024-11-21 03:44:25.968855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.415 [2024-11-21 03:44:25.968985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.415 [2024-11-21 03:44:25.969027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.415 qpair failed and we were unable to recover it. 00:27:45.415 [2024-11-21 03:44:25.969179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.415 [2024-11-21 03:44:25.969278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.415 [2024-11-21 03:44:25.969303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.415 qpair failed and we were unable to recover it. 00:27:45.415 [2024-11-21 03:44:25.969412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.415 [2024-11-21 03:44:25.969514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.415 [2024-11-21 03:44:25.969539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.415 qpair failed and we were unable to recover it. 00:27:45.415 [2024-11-21 03:44:25.969655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.415 [2024-11-21 03:44:25.969760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.415 [2024-11-21 03:44:25.969784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.415 qpair failed and we were unable to recover it. 00:27:45.415 [2024-11-21 03:44:25.969882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.415 [2024-11-21 03:44:25.969989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.415 [2024-11-21 03:44:25.970013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.415 qpair failed and we were unable to recover it. 00:27:45.415 [2024-11-21 03:44:25.970118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.415 [2024-11-21 03:44:25.970250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.415 [2024-11-21 03:44:25.970275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.415 qpair failed and we were unable to recover it. 00:27:45.415 [2024-11-21 03:44:25.970398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.415 [2024-11-21 03:44:25.970535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.415 [2024-11-21 03:44:25.970563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.415 qpair failed and we were unable to recover it. 00:27:45.416 [2024-11-21 03:44:25.970689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.416 [2024-11-21 03:44:25.970826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.416 [2024-11-21 03:44:25.970854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.416 qpair failed and we were unable to recover it. 00:27:45.416 [2024-11-21 03:44:25.970971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.416 [2024-11-21 03:44:25.971097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.416 [2024-11-21 03:44:25.971123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.416 qpair failed and we were unable to recover it. 00:27:45.416 [2024-11-21 03:44:25.971243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.416 [2024-11-21 03:44:25.971363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.416 [2024-11-21 03:44:25.971390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.416 qpair failed and we were unable to recover it. 00:27:45.416 [2024-11-21 03:44:25.971569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.416 [2024-11-21 03:44:25.971714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.416 [2024-11-21 03:44:25.971741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.416 qpair failed and we were unable to recover it. 00:27:45.416 [2024-11-21 03:44:25.971896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.416 [2024-11-21 03:44:25.972048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.416 [2024-11-21 03:44:25.972081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.416 qpair failed and we were unable to recover it. 00:27:45.416 [2024-11-21 03:44:25.972245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.416 [2024-11-21 03:44:25.972365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.416 [2024-11-21 03:44:25.972390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.416 qpair failed and we were unable to recover it. 00:27:45.416 [2024-11-21 03:44:25.972495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.416 [2024-11-21 03:44:25.972646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.416 [2024-11-21 03:44:25.972687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.416 qpair failed and we were unable to recover it. 00:27:45.416 [2024-11-21 03:44:25.972812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.416 [2024-11-21 03:44:25.972936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.416 [2024-11-21 03:44:25.972960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.416 qpair failed and we were unable to recover it. 00:27:45.416 [2024-11-21 03:44:25.973096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.416 [2024-11-21 03:44:25.973233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.416 [2024-11-21 03:44:25.973258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.416 qpair failed and we were unable to recover it. 00:27:45.416 [2024-11-21 03:44:25.973381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.416 [2024-11-21 03:44:25.973484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.416 [2024-11-21 03:44:25.973508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.416 qpair failed and we were unable to recover it. 00:27:45.416 [2024-11-21 03:44:25.973614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.416 [2024-11-21 03:44:25.973738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.416 [2024-11-21 03:44:25.973762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.416 qpair failed and we were unable to recover it. 00:27:45.416 [2024-11-21 03:44:25.973907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.416 [2024-11-21 03:44:25.974057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.416 [2024-11-21 03:44:25.974092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.416 qpair failed and we were unable to recover it. 00:27:45.416 [2024-11-21 03:44:25.974192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.416 [2024-11-21 03:44:25.974322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.416 [2024-11-21 03:44:25.974347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.416 qpair failed and we were unable to recover it. 00:27:45.416 [2024-11-21 03:44:25.974482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.416 [2024-11-21 03:44:25.974609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.416 [2024-11-21 03:44:25.974634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.416 qpair failed and we were unable to recover it. 00:27:45.416 [2024-11-21 03:44:25.974793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.416 [2024-11-21 03:44:25.974987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.416 [2024-11-21 03:44:25.975015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.416 qpair failed and we were unable to recover it. 00:27:45.416 [2024-11-21 03:44:25.975153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.416 [2024-11-21 03:44:25.975283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.416 [2024-11-21 03:44:25.975308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.416 qpair failed and we were unable to recover it. 00:27:45.416 [2024-11-21 03:44:25.975412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.416 [2024-11-21 03:44:25.975512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.416 [2024-11-21 03:44:25.975536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.416 qpair failed and we were unable to recover it. 00:27:45.416 [2024-11-21 03:44:25.975668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.416 [2024-11-21 03:44:25.975807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.416 [2024-11-21 03:44:25.975834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.416 qpair failed and we were unable to recover it. 00:27:45.416 [2024-11-21 03:44:25.975989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.416 [2024-11-21 03:44:25.976102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.416 [2024-11-21 03:44:25.976128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.416 qpair failed and we were unable to recover it. 00:27:45.416 [2024-11-21 03:44:25.976264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.416 [2024-11-21 03:44:25.976364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.416 [2024-11-21 03:44:25.976389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.416 qpair failed and we were unable to recover it. 00:27:45.416 [2024-11-21 03:44:25.976531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.416 [2024-11-21 03:44:25.976646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.416 [2024-11-21 03:44:25.976674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.416 qpair failed and we were unable to recover it. 00:27:45.416 [2024-11-21 03:44:25.976837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.416 [2024-11-21 03:44:25.976953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.416 [2024-11-21 03:44:25.976978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.416 qpair failed and we were unable to recover it. 00:27:45.416 [2024-11-21 03:44:25.977107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.416 [2024-11-21 03:44:25.977247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.416 [2024-11-21 03:44:25.977273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.416 qpair failed and we were unable to recover it. 00:27:45.416 [2024-11-21 03:44:25.977431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.416 [2024-11-21 03:44:25.977573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.416 [2024-11-21 03:44:25.977600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.416 qpair failed and we were unable to recover it. 00:27:45.416 [2024-11-21 03:44:25.977743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.416 [2024-11-21 03:44:25.977860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.416 [2024-11-21 03:44:25.977888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.416 qpair failed and we were unable to recover it. 00:27:45.416 [2024-11-21 03:44:25.978045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.416 [2024-11-21 03:44:25.978191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.416 [2024-11-21 03:44:25.978217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.416 qpair failed and we were unable to recover it. 00:27:45.416 [2024-11-21 03:44:25.978372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.416 [2024-11-21 03:44:25.978480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.416 [2024-11-21 03:44:25.978507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.416 qpair failed and we were unable to recover it. 00:27:45.416 [2024-11-21 03:44:25.978615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.416 [2024-11-21 03:44:25.978776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.416 [2024-11-21 03:44:25.978801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.416 qpair failed and we were unable to recover it. 00:27:45.416 [2024-11-21 03:44:25.978933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.416 [2024-11-21 03:44:25.979064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.416 [2024-11-21 03:44:25.979098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.417 qpair failed and we were unable to recover it. 00:27:45.417 [2024-11-21 03:44:25.979261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.417 [2024-11-21 03:44:25.979363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.417 [2024-11-21 03:44:25.979387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.417 qpair failed and we were unable to recover it. 00:27:45.417 [2024-11-21 03:44:25.979513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.417 [2024-11-21 03:44:25.979645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.417 [2024-11-21 03:44:25.979678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.417 qpair failed and we were unable to recover it. 00:27:45.417 [2024-11-21 03:44:25.979791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.417 [2024-11-21 03:44:25.979930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.417 [2024-11-21 03:44:25.979954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.417 qpair failed and we were unable to recover it. 00:27:45.417 [2024-11-21 03:44:25.980083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.417 [2024-11-21 03:44:25.980249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.417 [2024-11-21 03:44:25.980274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.417 qpair failed and we were unable to recover it. 00:27:45.417 [2024-11-21 03:44:25.980412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.417 [2024-11-21 03:44:25.980539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.417 [2024-11-21 03:44:25.980563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.417 qpair failed and we were unable to recover it. 00:27:45.417 [2024-11-21 03:44:25.980695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.417 [2024-11-21 03:44:25.980795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.417 [2024-11-21 03:44:25.980820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.417 qpair failed and we were unable to recover it. 00:27:45.417 [2024-11-21 03:44:25.980938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.417 [2024-11-21 03:44:25.981106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.417 [2024-11-21 03:44:25.981140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.417 qpair failed and we were unable to recover it. 00:27:45.417 [2024-11-21 03:44:25.981265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.417 [2024-11-21 03:44:25.981411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.417 [2024-11-21 03:44:25.981435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.417 qpair failed and we were unable to recover it. 00:27:45.417 [2024-11-21 03:44:25.981537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.417 [2024-11-21 03:44:25.981638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.417 [2024-11-21 03:44:25.981662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.417 qpair failed and we were unable to recover it. 00:27:45.417 [2024-11-21 03:44:25.981848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.417 [2024-11-21 03:44:25.981977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.417 [2024-11-21 03:44:25.982003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.417 qpair failed and we were unable to recover it. 00:27:45.417 [2024-11-21 03:44:25.982170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.417 [2024-11-21 03:44:25.982286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.417 [2024-11-21 03:44:25.982310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.417 qpair failed and we were unable to recover it. 00:27:45.417 [2024-11-21 03:44:25.982468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.417 [2024-11-21 03:44:25.982572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.417 [2024-11-21 03:44:25.982597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.417 qpair failed and we were unable to recover it. 00:27:45.417 [2024-11-21 03:44:25.982761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.417 [2024-11-21 03:44:25.982891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.417 [2024-11-21 03:44:25.982919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.417 qpair failed and we were unable to recover it. 00:27:45.417 [2024-11-21 03:44:25.983062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.417 [2024-11-21 03:44:25.983243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.417 [2024-11-21 03:44:25.983268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.417 qpair failed and we were unable to recover it. 00:27:45.417 [2024-11-21 03:44:25.983370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.417 [2024-11-21 03:44:25.983526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.417 [2024-11-21 03:44:25.983550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.417 qpair failed and we were unable to recover it. 00:27:45.417 [2024-11-21 03:44:25.983717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.417 [2024-11-21 03:44:25.983823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.417 [2024-11-21 03:44:25.983849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.417 qpair failed and we were unable to recover it. 00:27:45.417 [2024-11-21 03:44:25.983943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.417 [2024-11-21 03:44:25.984080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.417 [2024-11-21 03:44:25.984105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.417 qpair failed and we were unable to recover it. 00:27:45.417 [2024-11-21 03:44:25.984220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.417 [2024-11-21 03:44:25.984317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.417 [2024-11-21 03:44:25.984342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.417 qpair failed and we were unable to recover it. 00:27:45.417 [2024-11-21 03:44:25.984472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.417 [2024-11-21 03:44:25.984620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.417 [2024-11-21 03:44:25.984647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.417 qpair failed and we were unable to recover it. 00:27:45.417 [2024-11-21 03:44:25.984802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.417 [2024-11-21 03:44:25.984912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.417 [2024-11-21 03:44:25.984937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.417 qpair failed and we were unable to recover it. 00:27:45.417 [2024-11-21 03:44:25.985039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.417 [2024-11-21 03:44:25.985205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.417 [2024-11-21 03:44:25.985231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.417 qpair failed and we were unable to recover it. 00:27:45.417 [2024-11-21 03:44:25.985375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.417 [2024-11-21 03:44:25.985512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.417 [2024-11-21 03:44:25.985540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.417 qpair failed and we were unable to recover it. 00:27:45.417 [2024-11-21 03:44:25.985682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.417 [2024-11-21 03:44:25.985822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.417 [2024-11-21 03:44:25.985850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.417 qpair failed and we were unable to recover it. 00:27:45.417 [2024-11-21 03:44:25.985971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.417 [2024-11-21 03:44:25.986103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.417 [2024-11-21 03:44:25.986129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.417 qpair failed and we were unable to recover it. 00:27:45.417 [2024-11-21 03:44:25.986258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.417 [2024-11-21 03:44:25.986401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.417 [2024-11-21 03:44:25.986428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.417 qpair failed and we were unable to recover it. 00:27:45.417 [2024-11-21 03:44:25.986547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.417 [2024-11-21 03:44:25.986662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.417 [2024-11-21 03:44:25.986690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.417 qpair failed and we were unable to recover it. 00:27:45.417 [2024-11-21 03:44:25.986814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.417 [2024-11-21 03:44:25.986945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.418 [2024-11-21 03:44:25.986970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.418 qpair failed and we were unable to recover it. 00:27:45.418 [2024-11-21 03:44:25.987091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.418 [2024-11-21 03:44:25.987241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.418 [2024-11-21 03:44:25.987269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.418 qpair failed and we were unable to recover it. 00:27:45.418 [2024-11-21 03:44:25.987383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.418 [2024-11-21 03:44:25.987486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.418 [2024-11-21 03:44:25.987513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.418 qpair failed and we were unable to recover it. 00:27:45.418 [2024-11-21 03:44:25.987642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.418 [2024-11-21 03:44:25.987767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.418 [2024-11-21 03:44:25.987792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.418 qpair failed and we were unable to recover it. 00:27:45.418 [2024-11-21 03:44:25.987903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.418 [2024-11-21 03:44:25.988024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.418 [2024-11-21 03:44:25.988049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.418 qpair failed and we were unable to recover it. 00:27:45.418 [2024-11-21 03:44:25.988171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.418 [2024-11-21 03:44:25.988272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.418 [2024-11-21 03:44:25.988298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.418 qpair failed and we were unable to recover it. 00:27:45.418 [2024-11-21 03:44:25.988443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.418 [2024-11-21 03:44:25.988574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.418 [2024-11-21 03:44:25.988621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:45.418 qpair failed and we were unable to recover it. 00:27:45.418 [2024-11-21 03:44:25.988771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.418 [2024-11-21 03:44:25.988970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.418 [2024-11-21 03:44:25.989013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:45.418 qpair failed and we were unable to recover it. 00:27:45.418 [2024-11-21 03:44:25.989121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.418 [2024-11-21 03:44:25.989238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.418 [2024-11-21 03:44:25.989265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:45.418 qpair failed and we were unable to recover it. 00:27:45.418 [2024-11-21 03:44:25.989419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.418 [2024-11-21 03:44:25.989594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.418 [2024-11-21 03:44:25.989636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:45.418 qpair failed and we were unable to recover it. 00:27:45.418 [2024-11-21 03:44:25.989791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.418 [2024-11-21 03:44:25.989938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.418 [2024-11-21 03:44:25.989964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:45.418 qpair failed and we were unable to recover it. 00:27:45.418 [2024-11-21 03:44:25.990078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.418 [2024-11-21 03:44:25.990262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.418 [2024-11-21 03:44:25.990305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:45.418 qpair failed and we were unable to recover it. 00:27:45.418 [2024-11-21 03:44:25.990518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.418 [2024-11-21 03:44:25.990745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.418 [2024-11-21 03:44:25.990788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:45.418 qpair failed and we were unable to recover it. 00:27:45.418 [2024-11-21 03:44:25.990926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.418 [2024-11-21 03:44:25.991078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.418 [2024-11-21 03:44:25.991108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:45.418 qpair failed and we were unable to recover it. 00:27:45.418 [2024-11-21 03:44:25.991249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.418 [2024-11-21 03:44:25.991348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.418 [2024-11-21 03:44:25.991373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:45.418 qpair failed and we were unable to recover it. 00:27:45.418 [2024-11-21 03:44:25.991582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.418 [2024-11-21 03:44:25.991724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.418 [2024-11-21 03:44:25.991767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:45.418 qpair failed and we were unable to recover it. 00:27:45.418 [2024-11-21 03:44:25.991921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.418 [2024-11-21 03:44:25.992053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.418 [2024-11-21 03:44:25.992105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:45.418 qpair failed and we were unable to recover it. 00:27:45.418 [2024-11-21 03:44:25.992230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.418 [2024-11-21 03:44:25.992378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.418 [2024-11-21 03:44:25.992403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:45.418 qpair failed and we were unable to recover it. 00:27:45.418 [2024-11-21 03:44:25.992555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.418 [2024-11-21 03:44:25.992733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.418 [2024-11-21 03:44:25.992758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:45.418 qpair failed and we were unable to recover it. 00:27:45.418 [2024-11-21 03:44:25.992859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.418 [2024-11-21 03:44:25.992961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.418 [2024-11-21 03:44:25.992987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:45.418 qpair failed and we were unable to recover it. 00:27:45.418 [2024-11-21 03:44:25.993097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.418 [2024-11-21 03:44:25.993276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.418 [2024-11-21 03:44:25.993318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:45.418 qpair failed and we were unable to recover it. 00:27:45.418 [2024-11-21 03:44:25.993443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.418 [2024-11-21 03:44:25.993564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.418 [2024-11-21 03:44:25.993589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:45.418 qpair failed and we were unable to recover it. 00:27:45.418 [2024-11-21 03:44:25.993699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.418 [2024-11-21 03:44:25.993809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.418 [2024-11-21 03:44:25.993834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:45.418 qpair failed and we were unable to recover it. 00:27:45.418 [2024-11-21 03:44:25.993938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.418 [2024-11-21 03:44:25.994044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.418 [2024-11-21 03:44:25.994075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:45.418 qpair failed and we were unable to recover it. 00:27:45.418 [2024-11-21 03:44:25.994184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.418 [2024-11-21 03:44:25.994319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.418 [2024-11-21 03:44:25.994344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:45.418 qpair failed and we were unable to recover it. 00:27:45.418 [2024-11-21 03:44:25.994481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.418 [2024-11-21 03:44:25.994585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.418 [2024-11-21 03:44:25.994612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:45.419 qpair failed and we were unable to recover it. 00:27:45.419 [2024-11-21 03:44:25.994715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.419 [2024-11-21 03:44:25.994818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.419 [2024-11-21 03:44:25.994844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:45.419 qpair failed and we were unable to recover it. 00:27:45.419 [2024-11-21 03:44:25.994951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.419 [2024-11-21 03:44:25.995057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.419 [2024-11-21 03:44:25.995090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.419 qpair failed and we were unable to recover it. 00:27:45.419 [2024-11-21 03:44:25.995218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.419 [2024-11-21 03:44:25.995357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.419 [2024-11-21 03:44:25.995384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.419 qpair failed and we were unable to recover it. 00:27:45.419 [2024-11-21 03:44:25.995498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.419 [2024-11-21 03:44:25.995628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.419 [2024-11-21 03:44:25.995655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.419 qpair failed and we were unable to recover it. 00:27:45.419 [2024-11-21 03:44:25.995786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.419 [2024-11-21 03:44:25.995925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.419 [2024-11-21 03:44:25.995952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.419 qpair failed and we were unable to recover it. 00:27:45.419 [2024-11-21 03:44:25.996090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.419 [2024-11-21 03:44:25.996213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.419 [2024-11-21 03:44:25.996238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.419 qpair failed and we were unable to recover it. 00:27:45.419 [2024-11-21 03:44:25.996389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.419 [2024-11-21 03:44:25.996501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.419 [2024-11-21 03:44:25.996528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.419 qpair failed and we were unable to recover it. 00:27:45.419 [2024-11-21 03:44:25.996692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.419 [2024-11-21 03:44:25.996861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.419 [2024-11-21 03:44:25.996888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.419 qpair failed and we were unable to recover it. 00:27:45.419 [2024-11-21 03:44:25.997002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.419 [2024-11-21 03:44:25.997155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.419 [2024-11-21 03:44:25.997180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.419 qpair failed and we were unable to recover it. 00:27:45.419 [2024-11-21 03:44:25.997281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.419 [2024-11-21 03:44:25.997411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.419 [2024-11-21 03:44:25.997438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.419 qpair failed and we were unable to recover it. 00:27:45.419 [2024-11-21 03:44:25.997545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.419 [2024-11-21 03:44:25.997690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.419 [2024-11-21 03:44:25.997721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.419 qpair failed and we were unable to recover it. 00:27:45.419 [2024-11-21 03:44:25.997818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.419 [2024-11-21 03:44:25.997927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.419 [2024-11-21 03:44:25.997954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.419 qpair failed and we were unable to recover it. 00:27:45.419 [2024-11-21 03:44:25.998083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.419 [2024-11-21 03:44:25.998209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.419 [2024-11-21 03:44:25.998235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.419 qpair failed and we were unable to recover it. 00:27:45.419 [2024-11-21 03:44:25.998355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.419 [2024-11-21 03:44:25.998457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.419 [2024-11-21 03:44:25.998483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.419 qpair failed and we were unable to recover it. 00:27:45.419 [2024-11-21 03:44:25.998585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.419 [2024-11-21 03:44:25.998696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.419 [2024-11-21 03:44:25.998721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.419 qpair failed and we were unable to recover it. 00:27:45.419 [2024-11-21 03:44:25.998895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.419 [2024-11-21 03:44:25.998998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.419 [2024-11-21 03:44:25.999023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.419 qpair failed and we were unable to recover it. 00:27:45.419 [2024-11-21 03:44:25.999157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.419 [2024-11-21 03:44:25.999254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.419 [2024-11-21 03:44:25.999280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.419 qpair failed and we were unable to recover it. 00:27:45.419 [2024-11-21 03:44:25.999388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.419 [2024-11-21 03:44:25.999519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.419 [2024-11-21 03:44:25.999545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.419 qpair failed and we were unable to recover it. 00:27:45.419 [2024-11-21 03:44:25.999704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.419 [2024-11-21 03:44:25.999811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.419 [2024-11-21 03:44:25.999837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.419 qpair failed and we were unable to recover it. 00:27:45.419 [2024-11-21 03:44:25.999966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.419 [2024-11-21 03:44:26.000078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.419 [2024-11-21 03:44:26.000104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.419 qpair failed and we were unable to recover it. 00:27:45.419 [2024-11-21 03:44:26.000239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.419 [2024-11-21 03:44:26.000382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.419 [2024-11-21 03:44:26.000415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.419 qpair failed and we were unable to recover it. 00:27:45.419 [2024-11-21 03:44:26.000615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.419 [2024-11-21 03:44:26.000728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.419 [2024-11-21 03:44:26.000755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.419 qpair failed and we were unable to recover it. 00:27:45.419 [2024-11-21 03:44:26.000949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.419 [2024-11-21 03:44:26.001081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.419 [2024-11-21 03:44:26.001107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.419 qpair failed and we were unable to recover it. 00:27:45.419 [2024-11-21 03:44:26.001212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.419 [2024-11-21 03:44:26.001315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.419 [2024-11-21 03:44:26.001356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.419 qpair failed and we were unable to recover it. 00:27:45.419 [2024-11-21 03:44:26.001504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.419 [2024-11-21 03:44:26.001631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.419 [2024-11-21 03:44:26.001657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.419 qpair failed and we were unable to recover it. 00:27:45.419 [2024-11-21 03:44:26.001823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.419 [2024-11-21 03:44:26.001950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.419 [2024-11-21 03:44:26.001980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.419 qpair failed and we were unable to recover it. 00:27:45.419 [2024-11-21 03:44:26.002122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.419 [2024-11-21 03:44:26.002256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.419 [2024-11-21 03:44:26.002280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.419 qpair failed and we were unable to recover it. 00:27:45.419 [2024-11-21 03:44:26.002397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.419 [2024-11-21 03:44:26.002526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.420 [2024-11-21 03:44:26.002551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.420 qpair failed and we were unable to recover it. 00:27:45.420 [2024-11-21 03:44:26.002690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.420 [2024-11-21 03:44:26.002799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.420 [2024-11-21 03:44:26.002824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.420 qpair failed and we were unable to recover it. 00:27:45.420 [2024-11-21 03:44:26.002947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.420 [2024-11-21 03:44:26.003080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.420 [2024-11-21 03:44:26.003106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.420 qpair failed and we were unable to recover it. 00:27:45.420 [2024-11-21 03:44:26.003261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.420 [2024-11-21 03:44:26.003403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.420 [2024-11-21 03:44:26.003430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.420 qpair failed and we were unable to recover it. 00:27:45.420 [2024-11-21 03:44:26.003553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.420 [2024-11-21 03:44:26.003675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.420 [2024-11-21 03:44:26.003700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.420 qpair failed and we were unable to recover it. 00:27:45.420 [2024-11-21 03:44:26.003812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.420 [2024-11-21 03:44:26.003918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.420 [2024-11-21 03:44:26.003944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.420 qpair failed and we were unable to recover it. 00:27:45.420 [2024-11-21 03:44:26.004046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.420 [2024-11-21 03:44:26.004192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.420 [2024-11-21 03:44:26.004218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.420 qpair failed and we were unable to recover it. 00:27:45.420 [2024-11-21 03:44:26.004320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.420 [2024-11-21 03:44:26.004450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.420 [2024-11-21 03:44:26.004475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.420 qpair failed and we were unable to recover it. 00:27:45.695 [2024-11-21 03:44:26.004604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-21 03:44:26.004773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-21 03:44:26.004799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.695 qpair failed and we were unable to recover it. 00:27:45.695 [2024-11-21 03:44:26.004951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-21 03:44:26.005062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-21 03:44:26.005094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.695 qpair failed and we were unable to recover it. 00:27:45.695 [2024-11-21 03:44:26.005242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-21 03:44:26.005344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-21 03:44:26.005369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.695 qpair failed and we were unable to recover it. 00:27:45.695 [2024-11-21 03:44:26.005522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-21 03:44:26.005626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-21 03:44:26.005652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.695 qpair failed and we were unable to recover it. 00:27:45.695 [2024-11-21 03:44:26.005782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-21 03:44:26.005890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-21 03:44:26.005916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.695 qpair failed and we were unable to recover it. 00:27:45.695 [2024-11-21 03:44:26.006081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-21 03:44:26.006231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-21 03:44:26.006257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.695 qpair failed and we were unable to recover it. 00:27:45.695 [2024-11-21 03:44:26.006368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-21 03:44:26.006519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-21 03:44:26.006545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.695 qpair failed and we were unable to recover it. 00:27:45.695 [2024-11-21 03:44:26.006692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-21 03:44:26.006875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-21 03:44:26.006899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.695 qpair failed and we were unable to recover it. 00:27:45.695 [2024-11-21 03:44:26.006999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-21 03:44:26.007142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-21 03:44:26.007168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.695 qpair failed and we were unable to recover it. 00:27:45.695 [2024-11-21 03:44:26.007294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-21 03:44:26.007449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-21 03:44:26.007477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.695 qpair failed and we were unable to recover it. 00:27:45.695 [2024-11-21 03:44:26.007614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-21 03:44:26.007744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-21 03:44:26.007787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.695 qpair failed and we were unable to recover it. 00:27:45.695 [2024-11-21 03:44:26.007926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-21 03:44:26.008036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-21 03:44:26.008062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.695 qpair failed and we were unable to recover it. 00:27:45.695 [2024-11-21 03:44:26.008186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-21 03:44:26.008293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-21 03:44:26.008318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.695 qpair failed and we were unable to recover it. 00:27:45.695 [2024-11-21 03:44:26.008441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-21 03:44:26.008550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-21 03:44:26.008577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.695 qpair failed and we were unable to recover it. 00:27:45.695 [2024-11-21 03:44:26.008743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-21 03:44:26.008846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-21 03:44:26.008873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.695 qpair failed and we were unable to recover it. 00:27:45.695 [2024-11-21 03:44:26.009041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-21 03:44:26.009170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-21 03:44:26.009196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.695 qpair failed and we were unable to recover it. 00:27:45.695 [2024-11-21 03:44:26.009310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-21 03:44:26.009459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-21 03:44:26.009486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.695 qpair failed and we were unable to recover it. 00:27:45.695 [2024-11-21 03:44:26.009645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-21 03:44:26.009774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-21 03:44:26.009801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.695 qpair failed and we were unable to recover it. 00:27:45.695 [2024-11-21 03:44:26.009947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-21 03:44:26.010094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-21 03:44:26.010120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.695 qpair failed and we were unable to recover it. 00:27:45.695 [2024-11-21 03:44:26.010225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-21 03:44:26.010348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-21 03:44:26.010373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.695 qpair failed and we were unable to recover it. 00:27:45.695 [2024-11-21 03:44:26.010473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-21 03:44:26.010603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-21 03:44:26.010628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.695 qpair failed and we were unable to recover it. 00:27:45.695 [2024-11-21 03:44:26.010739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-21 03:44:26.010892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-21 03:44:26.010919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.695 qpair failed and we were unable to recover it. 00:27:45.695 [2024-11-21 03:44:26.011104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-21 03:44:26.011237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-21 03:44:26.011261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.695 qpair failed and we were unable to recover it. 00:27:45.695 [2024-11-21 03:44:26.011385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-21 03:44:26.011509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-21 03:44:26.011535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.695 qpair failed and we were unable to recover it. 00:27:45.695 [2024-11-21 03:44:26.011661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-21 03:44:26.011805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-21 03:44:26.011831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.695 qpair failed and we were unable to recover it. 00:27:45.695 [2024-11-21 03:44:26.011935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-21 03:44:26.012038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-21 03:44:26.012065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.695 qpair failed and we were unable to recover it. 00:27:45.695 [2024-11-21 03:44:26.012175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-21 03:44:26.012301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.695 [2024-11-21 03:44:26.012327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.695 qpair failed and we were unable to recover it. 00:27:45.696 [2024-11-21 03:44:26.012459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-21 03:44:26.012578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-21 03:44:26.012605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.696 qpair failed and we were unable to recover it. 00:27:45.696 [2024-11-21 03:44:26.012746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-21 03:44:26.012847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-21 03:44:26.012874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.696 qpair failed and we were unable to recover it. 00:27:45.696 [2024-11-21 03:44:26.013008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-21 03:44:26.013101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-21 03:44:26.013126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.696 qpair failed and we were unable to recover it. 00:27:45.696 [2024-11-21 03:44:26.013317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-21 03:44:26.013450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-21 03:44:26.013475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.696 qpair failed and we were unable to recover it. 00:27:45.696 [2024-11-21 03:44:26.013616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-21 03:44:26.013727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-21 03:44:26.013754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.696 qpair failed and we were unable to recover it. 00:27:45.696 [2024-11-21 03:44:26.013902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-21 03:44:26.014022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-21 03:44:26.014047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.696 qpair failed and we were unable to recover it. 00:27:45.696 [2024-11-21 03:44:26.014194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-21 03:44:26.014327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-21 03:44:26.014352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.696 qpair failed and we were unable to recover it. 00:27:45.696 [2024-11-21 03:44:26.014469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-21 03:44:26.014574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-21 03:44:26.014599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.696 qpair failed and we were unable to recover it. 00:27:45.696 [2024-11-21 03:44:26.014717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-21 03:44:26.014813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-21 03:44:26.014838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.696 qpair failed and we were unable to recover it. 00:27:45.696 [2024-11-21 03:44:26.014968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-21 03:44:26.015114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-21 03:44:26.015147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.696 qpair failed and we were unable to recover it. 00:27:45.696 [2024-11-21 03:44:26.015253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-21 03:44:26.015403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-21 03:44:26.015430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.696 qpair failed and we were unable to recover it. 00:27:45.696 [2024-11-21 03:44:26.015585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-21 03:44:26.015714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-21 03:44:26.015740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.696 qpair failed and we were unable to recover it. 00:27:45.696 [2024-11-21 03:44:26.015871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-21 03:44:26.015972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-21 03:44:26.015998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.696 qpair failed and we were unable to recover it. 00:27:45.696 [2024-11-21 03:44:26.016113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-21 03:44:26.016257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-21 03:44:26.016286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.696 qpair failed and we were unable to recover it. 00:27:45.696 [2024-11-21 03:44:26.016437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-21 03:44:26.016568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-21 03:44:26.016592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.696 qpair failed and we were unable to recover it. 00:27:45.696 [2024-11-21 03:44:26.016774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-21 03:44:26.016891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-21 03:44:26.016919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.696 qpair failed and we were unable to recover it. 00:27:45.696 [2024-11-21 03:44:26.017031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-21 03:44:26.017191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-21 03:44:26.017216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.696 qpair failed and we were unable to recover it. 00:27:45.696 [2024-11-21 03:44:26.017343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-21 03:44:26.017483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-21 03:44:26.017524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.696 qpair failed and we were unable to recover it. 00:27:45.696 [2024-11-21 03:44:26.017671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-21 03:44:26.017827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-21 03:44:26.017852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.696 qpair failed and we were unable to recover it. 00:27:45.696 [2024-11-21 03:44:26.017973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-21 03:44:26.018131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-21 03:44:26.018156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.696 qpair failed and we were unable to recover it. 00:27:45.696 [2024-11-21 03:44:26.018263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-21 03:44:26.018393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-21 03:44:26.018419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.696 qpair failed and we were unable to recover it. 00:27:45.696 [2024-11-21 03:44:26.018600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-21 03:44:26.018711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-21 03:44:26.018738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.696 qpair failed and we were unable to recover it. 00:27:45.696 [2024-11-21 03:44:26.018915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-21 03:44:26.019042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-21 03:44:26.019078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.696 qpair failed and we were unable to recover it. 00:27:45.696 [2024-11-21 03:44:26.019225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-21 03:44:26.019360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-21 03:44:26.019384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.696 qpair failed and we were unable to recover it. 00:27:45.696 [2024-11-21 03:44:26.019488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-21 03:44:26.019639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-21 03:44:26.019668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.696 qpair failed and we were unable to recover it. 00:27:45.696 [2024-11-21 03:44:26.019810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-21 03:44:26.019924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-21 03:44:26.019952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.696 qpair failed and we were unable to recover it. 00:27:45.696 [2024-11-21 03:44:26.020067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-21 03:44:26.020207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.696 [2024-11-21 03:44:26.020233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.696 qpair failed and we were unable to recover it. 00:27:45.696 [2024-11-21 03:44:26.020368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-21 03:44:26.020514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-21 03:44:26.020539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.697 qpair failed and we were unable to recover it. 00:27:45.697 [2024-11-21 03:44:26.020671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-21 03:44:26.020824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-21 03:44:26.020851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.697 qpair failed and we were unable to recover it. 00:27:45.697 [2024-11-21 03:44:26.021003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-21 03:44:26.021127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-21 03:44:26.021161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.697 qpair failed and we were unable to recover it. 00:27:45.697 [2024-11-21 03:44:26.021301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-21 03:44:26.021451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-21 03:44:26.021478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.697 qpair failed and we were unable to recover it. 00:27:45.697 [2024-11-21 03:44:26.021625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-21 03:44:26.021736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-21 03:44:26.021761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.697 qpair failed and we were unable to recover it. 00:27:45.697 [2024-11-21 03:44:26.021895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-21 03:44:26.022035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-21 03:44:26.022083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.697 qpair failed and we were unable to recover it. 00:27:45.697 [2024-11-21 03:44:26.022240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-21 03:44:26.022375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-21 03:44:26.022402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.697 qpair failed and we were unable to recover it. 00:27:45.697 [2024-11-21 03:44:26.022508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-21 03:44:26.022672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-21 03:44:26.022697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.697 qpair failed and we were unable to recover it. 00:27:45.697 [2024-11-21 03:44:26.022806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-21 03:44:26.022904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-21 03:44:26.022931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.697 qpair failed and we were unable to recover it. 00:27:45.697 [2024-11-21 03:44:26.023047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-21 03:44:26.023188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-21 03:44:26.023217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.697 qpair failed and we were unable to recover it. 00:27:45.697 [2024-11-21 03:44:26.023387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-21 03:44:26.023491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-21 03:44:26.023516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.697 qpair failed and we were unable to recover it. 00:27:45.697 [2024-11-21 03:44:26.023643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-21 03:44:26.023803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-21 03:44:26.023829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.697 qpair failed and we were unable to recover it. 00:27:45.697 [2024-11-21 03:44:26.024012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-21 03:44:26.024168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-21 03:44:26.024193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.697 qpair failed and we were unable to recover it. 00:27:45.697 [2024-11-21 03:44:26.024325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-21 03:44:26.024472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-21 03:44:26.024499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.697 qpair failed and we were unable to recover it. 00:27:45.697 [2024-11-21 03:44:26.024644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-21 03:44:26.024797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-21 03:44:26.024822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.697 qpair failed and we were unable to recover it. 00:27:45.697 [2024-11-21 03:44:26.024950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-21 03:44:26.025078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-21 03:44:26.025107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.697 qpair failed and we were unable to recover it. 00:27:45.697 [2024-11-21 03:44:26.025215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-21 03:44:26.025335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-21 03:44:26.025361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.697 qpair failed and we were unable to recover it. 00:27:45.697 [2024-11-21 03:44:26.025508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-21 03:44:26.025634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-21 03:44:26.025659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.697 qpair failed and we were unable to recover it. 00:27:45.697 [2024-11-21 03:44:26.025788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-21 03:44:26.025928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-21 03:44:26.025953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.697 qpair failed and we were unable to recover it. 00:27:45.697 [2024-11-21 03:44:26.026109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-21 03:44:26.026262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-21 03:44:26.026287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.697 qpair failed and we were unable to recover it. 00:27:45.697 [2024-11-21 03:44:26.026392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-21 03:44:26.026517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-21 03:44:26.026541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.697 qpair failed and we were unable to recover it. 00:27:45.697 [2024-11-21 03:44:26.026692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-21 03:44:26.026810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-21 03:44:26.026839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.697 qpair failed and we were unable to recover it. 00:27:45.697 [2024-11-21 03:44:26.026956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-21 03:44:26.027095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-21 03:44:26.027123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.697 qpair failed and we were unable to recover it. 00:27:45.697 [2024-11-21 03:44:26.027251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-21 03:44:26.027403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-21 03:44:26.027429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.697 qpair failed and we were unable to recover it. 00:27:45.697 [2024-11-21 03:44:26.027558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-21 03:44:26.027655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-21 03:44:26.027680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.697 qpair failed and we were unable to recover it. 00:27:45.697 [2024-11-21 03:44:26.027813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-21 03:44:26.027937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-21 03:44:26.027962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.697 qpair failed and we were unable to recover it. 00:27:45.697 [2024-11-21 03:44:26.028091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.697 [2024-11-21 03:44:26.028238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-21 03:44:26.028279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.698 qpair failed and we were unable to recover it. 00:27:45.698 [2024-11-21 03:44:26.028424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-21 03:44:26.028589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-21 03:44:26.028617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.698 qpair failed and we were unable to recover it. 00:27:45.698 [2024-11-21 03:44:26.028767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-21 03:44:26.028909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-21 03:44:26.028936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.698 qpair failed and we were unable to recover it. 00:27:45.698 [2024-11-21 03:44:26.029065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-21 03:44:26.029232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-21 03:44:26.029257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.698 qpair failed and we were unable to recover it. 00:27:45.698 [2024-11-21 03:44:26.029411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-21 03:44:26.029566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-21 03:44:26.029590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.698 qpair failed and we were unable to recover it. 00:27:45.698 [2024-11-21 03:44:26.029695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-21 03:44:26.029807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-21 03:44:26.029834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.698 qpair failed and we were unable to recover it. 00:27:45.698 [2024-11-21 03:44:26.029984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-21 03:44:26.030115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-21 03:44:26.030140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.698 qpair failed and we were unable to recover it. 00:27:45.698 [2024-11-21 03:44:26.030306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-21 03:44:26.030432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-21 03:44:26.030460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.698 qpair failed and we were unable to recover it. 00:27:45.698 [2024-11-21 03:44:26.030592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-21 03:44:26.030754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-21 03:44:26.030779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.698 qpair failed and we were unable to recover it. 00:27:45.698 [2024-11-21 03:44:26.030908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-21 03:44:26.031034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-21 03:44:26.031059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.698 qpair failed and we were unable to recover it. 00:27:45.698 [2024-11-21 03:44:26.031208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-21 03:44:26.031331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-21 03:44:26.031359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.698 qpair failed and we were unable to recover it. 00:27:45.698 [2024-11-21 03:44:26.031459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-21 03:44:26.031598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-21 03:44:26.031625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.698 qpair failed and we were unable to recover it. 00:27:45.698 [2024-11-21 03:44:26.031745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-21 03:44:26.031903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-21 03:44:26.031927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.698 qpair failed and we were unable to recover it. 00:27:45.698 [2024-11-21 03:44:26.032111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-21 03:44:26.032241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-21 03:44:26.032266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.698 qpair failed and we were unable to recover it. 00:27:45.698 [2024-11-21 03:44:26.032428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-21 03:44:26.032589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-21 03:44:26.032617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.698 qpair failed and we were unable to recover it. 00:27:45.698 [2024-11-21 03:44:26.032738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-21 03:44:26.032837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-21 03:44:26.032862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.698 qpair failed and we were unable to recover it. 00:27:45.698 [2024-11-21 03:44:26.032982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-21 03:44:26.033119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-21 03:44:26.033148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.698 qpair failed and we were unable to recover it. 00:27:45.698 [2024-11-21 03:44:26.033279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-21 03:44:26.033383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-21 03:44:26.033411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.698 qpair failed and we were unable to recover it. 00:27:45.698 [2024-11-21 03:44:26.033544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-21 03:44:26.033669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-21 03:44:26.033694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.698 qpair failed and we were unable to recover it. 00:27:45.698 [2024-11-21 03:44:26.033833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-21 03:44:26.033973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-21 03:44:26.034000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.698 qpair failed and we were unable to recover it. 00:27:45.698 [2024-11-21 03:44:26.034121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-21 03:44:26.034222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-21 03:44:26.034247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.698 qpair failed and we were unable to recover it. 00:27:45.698 [2024-11-21 03:44:26.034380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-21 03:44:26.034484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-21 03:44:26.034509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.698 qpair failed and we were unable to recover it. 00:27:45.698 [2024-11-21 03:44:26.034607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-21 03:44:26.034741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-21 03:44:26.034785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.698 qpair failed and we were unable to recover it. 00:27:45.698 [2024-11-21 03:44:26.034924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-21 03:44:26.035059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-21 03:44:26.035095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.698 qpair failed and we were unable to recover it. 00:27:45.698 [2024-11-21 03:44:26.035245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-21 03:44:26.035376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-21 03:44:26.035401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.698 qpair failed and we were unable to recover it. 00:27:45.698 [2024-11-21 03:44:26.035570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-21 03:44:26.035667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-21 03:44:26.035692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.698 qpair failed and we were unable to recover it. 00:27:45.698 [2024-11-21 03:44:26.035813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-21 03:44:26.035918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-21 03:44:26.035943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.698 qpair failed and we were unable to recover it. 00:27:45.698 [2024-11-21 03:44:26.036085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-21 03:44:26.036183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-21 03:44:26.036208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.698 qpair failed and we were unable to recover it. 00:27:45.698 [2024-11-21 03:44:26.036364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-21 03:44:26.036481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.698 [2024-11-21 03:44:26.036508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.698 qpair failed and we were unable to recover it. 00:27:45.698 [2024-11-21 03:44:26.036626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.699 [2024-11-21 03:44:26.036733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.699 [2024-11-21 03:44:26.036760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.699 qpair failed and we were unable to recover it. 00:27:45.699 [2024-11-21 03:44:26.036886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.699 [2024-11-21 03:44:26.037013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.699 [2024-11-21 03:44:26.037038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.699 qpair failed and we were unable to recover it. 00:27:45.699 [2024-11-21 03:44:26.037216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.699 [2024-11-21 03:44:26.037332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.699 [2024-11-21 03:44:26.037359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.699 qpair failed and we were unable to recover it. 00:27:45.699 [2024-11-21 03:44:26.037516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.699 [2024-11-21 03:44:26.037651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.699 [2024-11-21 03:44:26.037676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.699 qpair failed and we were unable to recover it. 00:27:45.699 [2024-11-21 03:44:26.037830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.699 [2024-11-21 03:44:26.037930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.699 [2024-11-21 03:44:26.037955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.699 qpair failed and we were unable to recover it. 00:27:45.699 [2024-11-21 03:44:26.038107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.699 [2024-11-21 03:44:26.038220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.699 [2024-11-21 03:44:26.038250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.699 qpair failed and we were unable to recover it. 00:27:45.699 [2024-11-21 03:44:26.038399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.699 [2024-11-21 03:44:26.038557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.699 [2024-11-21 03:44:26.038582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.699 qpair failed and we were unable to recover it. 00:27:45.699 [2024-11-21 03:44:26.038682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.699 [2024-11-21 03:44:26.038816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.699 [2024-11-21 03:44:26.038841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.699 qpair failed and we were unable to recover it. 00:27:45.699 [2024-11-21 03:44:26.038994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.699 [2024-11-21 03:44:26.039112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.699 [2024-11-21 03:44:26.039143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.699 qpair failed and we were unable to recover it. 00:27:45.699 [2024-11-21 03:44:26.039297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.699 [2024-11-21 03:44:26.039471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.699 [2024-11-21 03:44:26.039499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.699 qpair failed and we were unable to recover it. 00:27:45.699 [2024-11-21 03:44:26.039642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.699 [2024-11-21 03:44:26.039749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.699 [2024-11-21 03:44:26.039774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.699 qpair failed and we were unable to recover it. 00:27:45.699 [2024-11-21 03:44:26.039886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.699 [2024-11-21 03:44:26.040016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.699 [2024-11-21 03:44:26.040041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.699 qpair failed and we were unable to recover it. 00:27:45.699 [2024-11-21 03:44:26.040146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.699 [2024-11-21 03:44:26.040299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.699 [2024-11-21 03:44:26.040324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.699 qpair failed and we were unable to recover it. 00:27:45.699 [2024-11-21 03:44:26.040424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.699 [2024-11-21 03:44:26.040519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.699 [2024-11-21 03:44:26.040544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.699 qpair failed and we were unable to recover it. 00:27:45.699 [2024-11-21 03:44:26.040690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.699 [2024-11-21 03:44:26.040828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.699 [2024-11-21 03:44:26.040856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.699 qpair failed and we were unable to recover it. 00:27:45.699 [2024-11-21 03:44:26.040970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.699 [2024-11-21 03:44:26.041083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.699 [2024-11-21 03:44:26.041125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.699 qpair failed and we were unable to recover it. 00:27:45.699 [2024-11-21 03:44:26.041237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.699 [2024-11-21 03:44:26.041338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.699 [2024-11-21 03:44:26.041363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.699 qpair failed and we were unable to recover it. 00:27:45.699 [2024-11-21 03:44:26.041490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.699 [2024-11-21 03:44:26.041612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.699 [2024-11-21 03:44:26.041640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.699 qpair failed and we were unable to recover it. 00:27:45.699 [2024-11-21 03:44:26.041743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.699 [2024-11-21 03:44:26.041852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.699 [2024-11-21 03:44:26.041879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.699 qpair failed and we were unable to recover it. 00:27:45.699 [2024-11-21 03:44:26.042003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.699 [2024-11-21 03:44:26.042109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.699 [2024-11-21 03:44:26.042135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.699 qpair failed and we were unable to recover it. 00:27:45.699 [2024-11-21 03:44:26.042240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.699 [2024-11-21 03:44:26.042369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.699 [2024-11-21 03:44:26.042407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.699 qpair failed and we were unable to recover it. 00:27:45.699 [2024-11-21 03:44:26.042550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.699 [2024-11-21 03:44:26.042685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.699 [2024-11-21 03:44:26.042712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.699 qpair failed and we were unable to recover it. 00:27:45.699 [2024-11-21 03:44:26.042864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.699 [2024-11-21 03:44:26.042967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.699 [2024-11-21 03:44:26.042992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.699 qpair failed and we were unable to recover it. 00:27:45.699 [2024-11-21 03:44:26.043139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.699 [2024-11-21 03:44:26.043253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.700 [2024-11-21 03:44:26.043281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.700 qpair failed and we were unable to recover it. 00:27:45.700 [2024-11-21 03:44:26.043401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.700 [2024-11-21 03:44:26.043568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.700 [2024-11-21 03:44:26.043596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.700 qpair failed and we were unable to recover it. 00:27:45.700 [2024-11-21 03:44:26.043723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.700 [2024-11-21 03:44:26.043875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.700 [2024-11-21 03:44:26.043901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.700 qpair failed and we were unable to recover it. 00:27:45.700 [2024-11-21 03:44:26.044030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.700 [2024-11-21 03:44:26.044170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.700 [2024-11-21 03:44:26.044196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.700 qpair failed and we were unable to recover it. 00:27:45.700 [2024-11-21 03:44:26.044331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.700 [2024-11-21 03:44:26.044491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.700 [2024-11-21 03:44:26.044515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.700 qpair failed and we were unable to recover it. 00:27:45.700 [2024-11-21 03:44:26.044615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.700 [2024-11-21 03:44:26.044711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.700 [2024-11-21 03:44:26.044734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.700 qpair failed and we were unable to recover it. 00:27:45.700 [2024-11-21 03:44:26.044888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.700 [2024-11-21 03:44:26.045002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.700 [2024-11-21 03:44:26.045033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.700 qpair failed and we were unable to recover it. 00:27:45.700 [2024-11-21 03:44:26.045271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.700 [2024-11-21 03:44:26.045384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.700 [2024-11-21 03:44:26.045410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.700 qpair failed and we were unable to recover it. 00:27:45.700 [2024-11-21 03:44:26.045568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.700 [2024-11-21 03:44:26.045690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.700 [2024-11-21 03:44:26.045715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.700 qpair failed and we were unable to recover it. 00:27:45.700 [2024-11-21 03:44:26.045866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.700 [2024-11-21 03:44:26.046009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.700 [2024-11-21 03:44:26.046036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.700 qpair failed and we were unable to recover it. 00:27:45.700 [2024-11-21 03:44:26.046174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.700 [2024-11-21 03:44:26.046300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.700 [2024-11-21 03:44:26.046325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.700 qpair failed and we were unable to recover it. 00:27:45.700 [2024-11-21 03:44:26.046484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.700 [2024-11-21 03:44:26.046579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.700 [2024-11-21 03:44:26.046604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.700 qpair failed and we were unable to recover it. 00:27:45.700 [2024-11-21 03:44:26.046758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.700 [2024-11-21 03:44:26.046882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.700 [2024-11-21 03:44:26.046907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.700 qpair failed and we were unable to recover it. 00:27:45.700 [2024-11-21 03:44:26.047063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.700 [2024-11-21 03:44:26.047257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.700 [2024-11-21 03:44:26.047286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.700 qpair failed and we were unable to recover it. 00:27:45.700 [2024-11-21 03:44:26.047450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.700 [2024-11-21 03:44:26.047580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.700 [2024-11-21 03:44:26.047606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.700 qpair failed and we were unable to recover it. 00:27:45.700 [2024-11-21 03:44:26.047740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.700 [2024-11-21 03:44:26.047884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.700 [2024-11-21 03:44:26.047911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.700 qpair failed and we were unable to recover it. 00:27:45.700 [2024-11-21 03:44:26.048085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.700 [2024-11-21 03:44:26.048210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.700 [2024-11-21 03:44:26.048238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.700 qpair failed and we were unable to recover it. 00:27:45.700 [2024-11-21 03:44:26.048372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.700 [2024-11-21 03:44:26.048474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.700 [2024-11-21 03:44:26.048499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.700 qpair failed and we were unable to recover it. 00:27:45.700 [2024-11-21 03:44:26.048619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.700 [2024-11-21 03:44:26.048754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.700 [2024-11-21 03:44:26.048781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.700 qpair failed and we were unable to recover it. 00:27:45.700 [2024-11-21 03:44:26.048886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.700 [2024-11-21 03:44:26.048998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.700 [2024-11-21 03:44:26.049024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.700 qpair failed and we were unable to recover it. 00:27:45.700 [2024-11-21 03:44:26.049172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.700 [2024-11-21 03:44:26.049279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.700 [2024-11-21 03:44:26.049304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.700 qpair failed and we were unable to recover it. 00:27:45.700 [2024-11-21 03:44:26.049445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.700 [2024-11-21 03:44:26.049581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.700 [2024-11-21 03:44:26.049609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.700 qpair failed and we were unable to recover it. 00:27:45.700 [2024-11-21 03:44:26.049776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.700 [2024-11-21 03:44:26.049896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.700 [2024-11-21 03:44:26.049923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.700 qpair failed and we were unable to recover it. 00:27:45.700 [2024-11-21 03:44:26.050063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.700 [2024-11-21 03:44:26.050210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.700 [2024-11-21 03:44:26.050235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.700 qpair failed and we were unable to recover it. 00:27:45.700 [2024-11-21 03:44:26.050346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.700 [2024-11-21 03:44:26.050491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.700 [2024-11-21 03:44:26.050519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.700 qpair failed and we were unable to recover it. 00:27:45.700 [2024-11-21 03:44:26.050624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.700 [2024-11-21 03:44:26.050765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.700 [2024-11-21 03:44:26.050793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.700 qpair failed and we were unable to recover it. 00:27:45.700 [2024-11-21 03:44:26.050914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.700 [2024-11-21 03:44:26.051079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.700 [2024-11-21 03:44:26.051105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.700 qpair failed and we were unable to recover it. 00:27:45.700 [2024-11-21 03:44:26.051215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.700 [2024-11-21 03:44:26.051331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.700 [2024-11-21 03:44:26.051360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.700 qpair failed and we were unable to recover it. 00:27:45.700 [2024-11-21 03:44:26.051495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.700 [2024-11-21 03:44:26.051609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.701 [2024-11-21 03:44:26.051636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.701 qpair failed and we were unable to recover it. 00:27:45.701 [2024-11-21 03:44:26.051786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.701 [2024-11-21 03:44:26.051892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.701 [2024-11-21 03:44:26.051917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.701 qpair failed and we were unable to recover it. 00:27:45.701 [2024-11-21 03:44:26.052062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.701 [2024-11-21 03:44:26.052175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.701 [2024-11-21 03:44:26.052199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.701 qpair failed and we were unable to recover it. 00:27:45.701 [2024-11-21 03:44:26.052351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.701 [2024-11-21 03:44:26.052488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.701 [2024-11-21 03:44:26.052515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.701 qpair failed and we were unable to recover it. 00:27:45.701 [2024-11-21 03:44:26.052635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.701 [2024-11-21 03:44:26.052733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.701 [2024-11-21 03:44:26.052757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.701 qpair failed and we were unable to recover it. 00:27:45.701 [2024-11-21 03:44:26.052863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.701 [2024-11-21 03:44:26.052968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.701 [2024-11-21 03:44:26.052996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.701 qpair failed and we were unable to recover it. 00:27:45.701 [2024-11-21 03:44:26.053139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.701 [2024-11-21 03:44:26.053281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.701 [2024-11-21 03:44:26.053309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.701 qpair failed and we were unable to recover it. 00:27:45.701 [2024-11-21 03:44:26.053433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.701 [2024-11-21 03:44:26.053586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.701 [2024-11-21 03:44:26.053611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.701 qpair failed and we were unable to recover it. 00:27:45.701 [2024-11-21 03:44:26.053741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.701 [2024-11-21 03:44:26.053909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.701 [2024-11-21 03:44:26.053936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.701 qpair failed and we were unable to recover it. 00:27:45.701 [2024-11-21 03:44:26.054124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.701 [2024-11-21 03:44:26.054238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.701 [2024-11-21 03:44:26.054266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.701 qpair failed and we were unable to recover it. 00:27:45.701 [2024-11-21 03:44:26.054390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.701 [2024-11-21 03:44:26.054496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.701 [2024-11-21 03:44:26.054522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.701 qpair failed and we were unable to recover it. 00:27:45.701 [2024-11-21 03:44:26.054683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.701 [2024-11-21 03:44:26.054805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.701 [2024-11-21 03:44:26.054829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.701 qpair failed and we were unable to recover it. 00:27:45.701 [2024-11-21 03:44:26.054926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.701 [2024-11-21 03:44:26.055075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.701 [2024-11-21 03:44:26.055104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.701 qpair failed and we were unable to recover it. 00:27:45.701 [2024-11-21 03:44:26.055267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.701 [2024-11-21 03:44:26.055370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.701 [2024-11-21 03:44:26.055397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.701 qpair failed and we were unable to recover it. 00:27:45.701 [2024-11-21 03:44:26.055539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.701 [2024-11-21 03:44:26.055682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.701 [2024-11-21 03:44:26.055723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.701 qpair failed and we were unable to recover it. 00:27:45.701 [2024-11-21 03:44:26.055829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.701 [2024-11-21 03:44:26.056001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.701 [2024-11-21 03:44:26.056030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.701 qpair failed and we were unable to recover it. 00:27:45.701 [2024-11-21 03:44:26.056184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.701 [2024-11-21 03:44:26.056342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.701 [2024-11-21 03:44:26.056376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.701 qpair failed and we were unable to recover it. 00:27:45.701 [2024-11-21 03:44:26.056502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.701 [2024-11-21 03:44:26.056642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.701 [2024-11-21 03:44:26.056669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.701 qpair failed and we were unable to recover it. 00:27:45.701 [2024-11-21 03:44:26.056798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.701 [2024-11-21 03:44:26.056934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.701 [2024-11-21 03:44:26.056961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.701 qpair failed and we were unable to recover it. 00:27:45.701 [2024-11-21 03:44:26.057105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.701 [2024-11-21 03:44:26.057203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.701 [2024-11-21 03:44:26.057229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.701 qpair failed and we were unable to recover it. 00:27:45.701 [2024-11-21 03:44:26.057327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.701 [2024-11-21 03:44:26.057517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.701 [2024-11-21 03:44:26.057545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.701 qpair failed and we were unable to recover it. 00:27:45.701 [2024-11-21 03:44:26.057688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.701 [2024-11-21 03:44:26.057862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.701 [2024-11-21 03:44:26.057886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.701 qpair failed and we were unable to recover it. 00:27:45.701 [2024-11-21 03:44:26.058009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.701 [2024-11-21 03:44:26.058136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.701 [2024-11-21 03:44:26.058161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.701 qpair failed and we were unable to recover it. 00:27:45.701 [2024-11-21 03:44:26.058268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.701 [2024-11-21 03:44:26.058378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.701 [2024-11-21 03:44:26.058404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.701 qpair failed and we were unable to recover it. 00:27:45.701 [2024-11-21 03:44:26.058516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.701 [2024-11-21 03:44:26.058670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.701 [2024-11-21 03:44:26.058695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.701 qpair failed and we were unable to recover it. 00:27:45.701 [2024-11-21 03:44:26.058835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.701 [2024-11-21 03:44:26.058932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.701 [2024-11-21 03:44:26.058956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.701 qpair failed and we were unable to recover it. 00:27:45.701 [2024-11-21 03:44:26.059079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.701 [2024-11-21 03:44:26.059193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.701 [2024-11-21 03:44:26.059220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.701 qpair failed and we were unable to recover it. 00:27:45.701 [2024-11-21 03:44:26.059373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.701 [2024-11-21 03:44:26.059512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.701 [2024-11-21 03:44:26.059538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.701 qpair failed and we were unable to recover it. 00:27:45.701 [2024-11-21 03:44:26.059688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.701 [2024-11-21 03:44:26.059810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.701 [2024-11-21 03:44:26.059835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.701 qpair failed and we were unable to recover it. 00:27:45.701 [2024-11-21 03:44:26.059958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.702 [2024-11-21 03:44:26.060091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.702 [2024-11-21 03:44:26.060125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.702 qpair failed and we were unable to recover it. 00:27:45.702 [2024-11-21 03:44:26.060310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.702 [2024-11-21 03:44:26.060414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.702 [2024-11-21 03:44:26.060438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.702 qpair failed and we were unable to recover it. 00:27:45.702 [2024-11-21 03:44:26.060539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.702 [2024-11-21 03:44:26.060670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.702 [2024-11-21 03:44:26.060695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.702 qpair failed and we were unable to recover it. 00:27:45.702 [2024-11-21 03:44:26.060849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.702 [2024-11-21 03:44:26.060979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.702 [2024-11-21 03:44:26.061003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.702 qpair failed and we were unable to recover it. 00:27:45.702 [2024-11-21 03:44:26.061154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.702 [2024-11-21 03:44:26.061287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.702 [2024-11-21 03:44:26.061314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.702 qpair failed and we were unable to recover it. 00:27:45.702 [2024-11-21 03:44:26.061469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.702 [2024-11-21 03:44:26.061569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.702 [2024-11-21 03:44:26.061596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.702 qpair failed and we were unable to recover it. 00:27:45.702 [2024-11-21 03:44:26.061697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.702 [2024-11-21 03:44:26.061802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.702 [2024-11-21 03:44:26.061828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.702 qpair failed and we were unable to recover it. 00:27:45.702 [2024-11-21 03:44:26.061951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.702 [2024-11-21 03:44:26.062085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.702 [2024-11-21 03:44:26.062119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.702 qpair failed and we were unable to recover it. 00:27:45.702 [2024-11-21 03:44:26.062294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.702 [2024-11-21 03:44:26.062429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.702 [2024-11-21 03:44:26.062455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.702 qpair failed and we were unable to recover it. 00:27:45.702 [2024-11-21 03:44:26.062586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.702 [2024-11-21 03:44:26.062784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.702 [2024-11-21 03:44:26.062813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.702 qpair failed and we were unable to recover it. 00:27:45.702 [2024-11-21 03:44:26.062978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.702 [2024-11-21 03:44:26.063118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.702 [2024-11-21 03:44:26.063151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.702 qpair failed and we were unable to recover it. 00:27:45.702 [2024-11-21 03:44:26.063305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.702 [2024-11-21 03:44:26.063450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.702 [2024-11-21 03:44:26.063475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.702 qpair failed and we were unable to recover it. 00:27:45.702 [2024-11-21 03:44:26.063577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.702 [2024-11-21 03:44:26.063717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.702 [2024-11-21 03:44:26.063744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.702 qpair failed and we were unable to recover it. 00:27:45.702 [2024-11-21 03:44:26.063856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.702 [2024-11-21 03:44:26.064034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.702 [2024-11-21 03:44:26.064059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.702 qpair failed and we were unable to recover it. 00:27:45.702 [2024-11-21 03:44:26.064204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.702 [2024-11-21 03:44:26.064307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.702 [2024-11-21 03:44:26.064332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.702 qpair failed and we were unable to recover it. 00:27:45.702 [2024-11-21 03:44:26.064452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.702 [2024-11-21 03:44:26.064555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.702 [2024-11-21 03:44:26.064580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.702 qpair failed and we were unable to recover it. 00:27:45.702 [2024-11-21 03:44:26.064738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.702 [2024-11-21 03:44:26.064874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.702 [2024-11-21 03:44:26.064899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.702 qpair failed and we were unable to recover it. 00:27:45.702 [2024-11-21 03:44:26.065056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.702 [2024-11-21 03:44:26.065175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.702 [2024-11-21 03:44:26.065200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.702 qpair failed and we were unable to recover it. 00:27:45.702 [2024-11-21 03:44:26.065331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.702 [2024-11-21 03:44:26.065471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.702 [2024-11-21 03:44:26.065498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.702 qpair failed and we were unable to recover it. 00:27:45.702 [2024-11-21 03:44:26.065655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.702 [2024-11-21 03:44:26.065793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.702 [2024-11-21 03:44:26.065817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.702 qpair failed and we were unable to recover it. 00:27:45.702 [2024-11-21 03:44:26.065940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.702 [2024-11-21 03:44:26.066090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.702 [2024-11-21 03:44:26.066118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.702 qpair failed and we were unable to recover it. 00:27:45.702 [2024-11-21 03:44:26.066226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.702 [2024-11-21 03:44:26.066369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.702 [2024-11-21 03:44:26.066397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.702 qpair failed and we were unable to recover it. 00:27:45.702 [2024-11-21 03:44:26.066508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.702 [2024-11-21 03:44:26.066627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.702 [2024-11-21 03:44:26.066655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.702 qpair failed and we were unable to recover it. 00:27:45.702 [2024-11-21 03:44:26.066772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.702 [2024-11-21 03:44:26.066896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.702 [2024-11-21 03:44:26.066920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.702 qpair failed and we were unable to recover it. 00:27:45.702 [2024-11-21 03:44:26.067035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.702 [2024-11-21 03:44:26.067154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.702 [2024-11-21 03:44:26.067195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.702 qpair failed and we were unable to recover it. 00:27:45.702 [2024-11-21 03:44:26.067297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.702 [2024-11-21 03:44:26.067457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.702 [2024-11-21 03:44:26.067484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.702 qpair failed and we were unable to recover it. 00:27:45.702 [2024-11-21 03:44:26.067604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.702 [2024-11-21 03:44:26.067735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.702 [2024-11-21 03:44:26.067760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.702 qpair failed and we were unable to recover it. 00:27:45.702 [2024-11-21 03:44:26.067907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.702 [2024-11-21 03:44:26.068089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.702 [2024-11-21 03:44:26.068118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.702 qpair failed and we were unable to recover it. 00:27:45.702 [2024-11-21 03:44:26.068260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.702 [2024-11-21 03:44:26.068369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.702 [2024-11-21 03:44:26.068396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.702 qpair failed and we were unable to recover it. 00:27:45.703 [2024-11-21 03:44:26.068530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.703 [2024-11-21 03:44:26.068658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.703 [2024-11-21 03:44:26.068682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.703 qpair failed and we were unable to recover it. 00:27:45.703 [2024-11-21 03:44:26.068867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.703 [2024-11-21 03:44:26.068996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.703 [2024-11-21 03:44:26.069022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.703 qpair failed and we were unable to recover it. 00:27:45.703 [2024-11-21 03:44:26.069208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.703 [2024-11-21 03:44:26.069310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.703 [2024-11-21 03:44:26.069334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.703 qpair failed and we were unable to recover it. 00:27:45.703 [2024-11-21 03:44:26.069462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.703 [2024-11-21 03:44:26.069582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.703 [2024-11-21 03:44:26.069607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.703 qpair failed and we were unable to recover it. 00:27:45.703 [2024-11-21 03:44:26.069718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.703 [2024-11-21 03:44:26.069846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.703 [2024-11-21 03:44:26.069871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.703 qpair failed and we were unable to recover it. 00:27:45.703 [2024-11-21 03:44:26.069973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.703 [2024-11-21 03:44:26.070104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.703 [2024-11-21 03:44:26.070133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.703 qpair failed and we were unable to recover it. 00:27:45.703 [2024-11-21 03:44:26.070259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.703 [2024-11-21 03:44:26.070393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.703 [2024-11-21 03:44:26.070418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.703 qpair failed and we were unable to recover it. 00:27:45.703 [2024-11-21 03:44:26.070535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.703 [2024-11-21 03:44:26.070646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.703 [2024-11-21 03:44:26.070674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.703 qpair failed and we were unable to recover it. 00:27:45.703 [2024-11-21 03:44:26.070790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.703 [2024-11-21 03:44:26.070976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.703 [2024-11-21 03:44:26.071004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.703 qpair failed and we were unable to recover it. 00:27:45.703 [2024-11-21 03:44:26.071151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.703 [2024-11-21 03:44:26.071255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.703 [2024-11-21 03:44:26.071281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.703 qpair failed and we were unable to recover it. 00:27:45.703 [2024-11-21 03:44:26.071461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.703 [2024-11-21 03:44:26.071601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.703 [2024-11-21 03:44:26.071631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.703 qpair failed and we were unable to recover it. 00:27:45.703 [2024-11-21 03:44:26.071791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.703 [2024-11-21 03:44:26.071897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.703 [2024-11-21 03:44:26.071921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.703 qpair failed and we were unable to recover it. 00:27:45.703 [2024-11-21 03:44:26.072050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.703 [2024-11-21 03:44:26.072195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.703 [2024-11-21 03:44:26.072221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.703 qpair failed and we were unable to recover it. 00:27:45.703 [2024-11-21 03:44:26.072375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.703 [2024-11-21 03:44:26.072485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.703 [2024-11-21 03:44:26.072512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.703 qpair failed and we were unable to recover it. 00:27:45.703 [2024-11-21 03:44:26.072624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.703 [2024-11-21 03:44:26.072764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.703 [2024-11-21 03:44:26.072791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.703 qpair failed and we were unable to recover it. 00:27:45.703 [2024-11-21 03:44:26.072940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.703 [2024-11-21 03:44:26.073077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.703 [2024-11-21 03:44:26.073103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.703 qpair failed and we were unable to recover it. 00:27:45.703 [2024-11-21 03:44:26.073244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.703 [2024-11-21 03:44:26.073345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.703 [2024-11-21 03:44:26.073371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.703 qpair failed and we were unable to recover it. 00:27:45.703 [2024-11-21 03:44:26.073462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.703 [2024-11-21 03:44:26.073642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.703 [2024-11-21 03:44:26.073671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.703 qpair failed and we were unable to recover it. 00:27:45.703 [2024-11-21 03:44:26.073817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.703 [2024-11-21 03:44:26.073950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.703 [2024-11-21 03:44:26.073975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.703 qpair failed and we were unable to recover it. 00:27:45.703 [2024-11-21 03:44:26.074137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.703 [2024-11-21 03:44:26.074292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.703 [2024-11-21 03:44:26.074320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.703 qpair failed and we were unable to recover it. 00:27:45.703 [2024-11-21 03:44:26.074442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.703 [2024-11-21 03:44:26.074579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.703 [2024-11-21 03:44:26.074606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.703 qpair failed and we were unable to recover it. 00:27:45.703 [2024-11-21 03:44:26.074754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.703 [2024-11-21 03:44:26.074876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.703 [2024-11-21 03:44:26.074901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.703 qpair failed and we were unable to recover it. 00:27:45.703 [2024-11-21 03:44:26.075056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.703 [2024-11-21 03:44:26.075173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.703 [2024-11-21 03:44:26.075202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.703 qpair failed and we were unable to recover it. 00:27:45.703 [2024-11-21 03:44:26.075320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.703 [2024-11-21 03:44:26.075491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.703 [2024-11-21 03:44:26.075516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.703 qpair failed and we were unable to recover it. 00:27:45.703 [2024-11-21 03:44:26.075653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.703 [2024-11-21 03:44:26.075752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.703 [2024-11-21 03:44:26.075777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.703 qpair failed and we were unable to recover it. 00:27:45.703 [2024-11-21 03:44:26.075870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.703 [2024-11-21 03:44:26.075999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.703 [2024-11-21 03:44:26.076024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.703 qpair failed and we were unable to recover it. 00:27:45.703 [2024-11-21 03:44:26.076156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.703 [2024-11-21 03:44:26.076274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.703 [2024-11-21 03:44:26.076298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.703 qpair failed and we were unable to recover it. 00:27:45.703 [2024-11-21 03:44:26.076456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.703 [2024-11-21 03:44:26.076560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.703 [2024-11-21 03:44:26.076586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.703 qpair failed and we were unable to recover it. 00:27:45.703 [2024-11-21 03:44:26.076762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.703 [2024-11-21 03:44:26.076902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.703 [2024-11-21 03:44:26.076930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.704 qpair failed and we were unable to recover it. 00:27:45.704 [2024-11-21 03:44:26.077039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.704 [2024-11-21 03:44:26.077182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.704 [2024-11-21 03:44:26.077210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.704 qpair failed and we were unable to recover it. 00:27:45.704 [2024-11-21 03:44:26.077357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.704 [2024-11-21 03:44:26.077471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.704 [2024-11-21 03:44:26.077498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.704 qpair failed and we were unable to recover it. 00:27:45.704 [2024-11-21 03:44:26.077626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.704 [2024-11-21 03:44:26.077732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.704 [2024-11-21 03:44:26.077759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.704 qpair failed and we were unable to recover it. 00:27:45.704 [2024-11-21 03:44:26.077895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.704 [2024-11-21 03:44:26.078004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.704 [2024-11-21 03:44:26.078038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.704 qpair failed and we were unable to recover it. 00:27:45.704 [2024-11-21 03:44:26.078246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.704 [2024-11-21 03:44:26.078403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.704 [2024-11-21 03:44:26.078429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.704 qpair failed and we were unable to recover it. 00:27:45.704 [2024-11-21 03:44:26.078586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.704 [2024-11-21 03:44:26.078752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.704 [2024-11-21 03:44:26.078780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.704 qpair failed and we were unable to recover it. 00:27:45.704 [2024-11-21 03:44:26.078920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.704 [2024-11-21 03:44:26.079085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.704 [2024-11-21 03:44:26.079129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.704 qpair failed and we were unable to recover it. 00:27:45.704 [2024-11-21 03:44:26.079251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.704 [2024-11-21 03:44:26.079351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.704 [2024-11-21 03:44:26.079377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.704 qpair failed and we were unable to recover it. 00:27:45.704 [2024-11-21 03:44:26.079515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.704 [2024-11-21 03:44:26.079698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.704 [2024-11-21 03:44:26.079723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.704 qpair failed and we were unable to recover it. 00:27:45.704 [2024-11-21 03:44:26.079849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.704 [2024-11-21 03:44:26.079975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.704 [2024-11-21 03:44:26.079999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.704 qpair failed and we were unable to recover it. 00:27:45.704 [2024-11-21 03:44:26.080110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.704 [2024-11-21 03:44:26.080203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.704 [2024-11-21 03:44:26.080228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.704 qpair failed and we were unable to recover it. 00:27:45.704 [2024-11-21 03:44:26.080358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.704 [2024-11-21 03:44:26.080462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.704 [2024-11-21 03:44:26.080505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.704 qpair failed and we were unable to recover it. 00:27:45.704 [2024-11-21 03:44:26.080621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.704 [2024-11-21 03:44:26.080733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.704 [2024-11-21 03:44:26.080758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.704 qpair failed and we were unable to recover it. 00:27:45.704 [2024-11-21 03:44:26.080891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.704 [2024-11-21 03:44:26.081023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.704 [2024-11-21 03:44:26.081047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.704 qpair failed and we were unable to recover it. 00:27:45.704 [2024-11-21 03:44:26.081197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.704 [2024-11-21 03:44:26.081376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.704 [2024-11-21 03:44:26.081404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.704 qpair failed and we were unable to recover it. 00:27:45.704 [2024-11-21 03:44:26.081548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.704 [2024-11-21 03:44:26.081686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.704 [2024-11-21 03:44:26.081714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.704 qpair failed and we were unable to recover it. 00:27:45.704 [2024-11-21 03:44:26.081868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.704 [2024-11-21 03:44:26.082043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.704 [2024-11-21 03:44:26.082079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.704 qpair failed and we were unable to recover it. 00:27:45.704 [2024-11-21 03:44:26.082205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.704 [2024-11-21 03:44:26.082346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.704 [2024-11-21 03:44:26.082374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.704 qpair failed and we were unable to recover it. 00:27:45.704 [2024-11-21 03:44:26.082482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.704 [2024-11-21 03:44:26.082599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.704 [2024-11-21 03:44:26.082623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.704 qpair failed and we were unable to recover it. 00:27:45.704 [2024-11-21 03:44:26.082750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.704 [2024-11-21 03:44:26.082850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.704 [2024-11-21 03:44:26.082877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.704 qpair failed and we were unable to recover it. 00:27:45.704 [2024-11-21 03:44:26.083020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.704 [2024-11-21 03:44:26.083162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.704 [2024-11-21 03:44:26.083190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.704 qpair failed and we were unable to recover it. 00:27:45.704 [2024-11-21 03:44:26.083343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.704 [2024-11-21 03:44:26.083465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.704 [2024-11-21 03:44:26.083491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.704 qpair failed and we were unable to recover it. 00:27:45.704 [2024-11-21 03:44:26.083650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.704 [2024-11-21 03:44:26.083780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.704 [2024-11-21 03:44:26.083822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.704 qpair failed and we were unable to recover it. 00:27:45.704 [2024-11-21 03:44:26.083975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.704 [2024-11-21 03:44:26.084123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.704 [2024-11-21 03:44:26.084149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.704 qpair failed and we were unable to recover it. 00:27:45.704 [2024-11-21 03:44:26.084340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.704 [2024-11-21 03:44:26.084495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.704 [2024-11-21 03:44:26.084521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.704 qpair failed and we were unable to recover it. 00:27:45.704 [2024-11-21 03:44:26.084660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.705 [2024-11-21 03:44:26.084814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.705 [2024-11-21 03:44:26.084840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.705 qpair failed and we were unable to recover it. 00:27:45.705 [2024-11-21 03:44:26.084967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.705 [2024-11-21 03:44:26.085138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.705 [2024-11-21 03:44:26.085164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.705 qpair failed and we were unable to recover it. 00:27:45.705 [2024-11-21 03:44:26.085267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.705 [2024-11-21 03:44:26.085397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.705 [2024-11-21 03:44:26.085421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.705 qpair failed and we were unable to recover it. 00:27:45.705 [2024-11-21 03:44:26.085518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.705 [2024-11-21 03:44:26.085648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.705 [2024-11-21 03:44:26.085672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.705 qpair failed and we were unable to recover it. 00:27:45.705 [2024-11-21 03:44:26.085793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.705 [2024-11-21 03:44:26.085905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.705 [2024-11-21 03:44:26.085946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.705 qpair failed and we were unable to recover it. 00:27:45.705 [2024-11-21 03:44:26.086106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.705 [2024-11-21 03:44:26.086266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.705 [2024-11-21 03:44:26.086292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.705 qpair failed and we were unable to recover it. 00:27:45.705 [2024-11-21 03:44:26.086420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.705 [2024-11-21 03:44:26.086516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.705 [2024-11-21 03:44:26.086540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.705 qpair failed and we were unable to recover it. 00:27:45.705 [2024-11-21 03:44:26.086666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.705 [2024-11-21 03:44:26.086781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.705 [2024-11-21 03:44:26.086808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.705 qpair failed and we were unable to recover it. 00:27:45.705 [2024-11-21 03:44:26.086957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.705 [2024-11-21 03:44:26.087061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.705 [2024-11-21 03:44:26.087098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.705 qpair failed and we were unable to recover it. 00:27:45.705 [2024-11-21 03:44:26.087253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.705 [2024-11-21 03:44:26.087408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.705 [2024-11-21 03:44:26.087434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.705 qpair failed and we were unable to recover it. 00:27:45.705 [2024-11-21 03:44:26.087571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.705 [2024-11-21 03:44:26.087695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.705 [2024-11-21 03:44:26.087736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.705 qpair failed and we were unable to recover it. 00:27:45.705 [2024-11-21 03:44:26.087861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.705 [2024-11-21 03:44:26.087963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.705 [2024-11-21 03:44:26.087988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.705 qpair failed and we were unable to recover it. 00:27:45.705 [2024-11-21 03:44:26.088092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.705 [2024-11-21 03:44:26.088205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.705 [2024-11-21 03:44:26.088230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.705 qpair failed and we were unable to recover it. 00:27:45.705 [2024-11-21 03:44:26.088355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.705 [2024-11-21 03:44:26.088532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.705 [2024-11-21 03:44:26.088557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.705 qpair failed and we were unable to recover it. 00:27:45.705 [2024-11-21 03:44:26.088658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.705 [2024-11-21 03:44:26.088754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.705 [2024-11-21 03:44:26.088779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.705 qpair failed and we were unable to recover it. 00:27:45.705 [2024-11-21 03:44:26.088891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.705 [2024-11-21 03:44:26.089019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.705 [2024-11-21 03:44:26.089044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.705 qpair failed and we were unable to recover it. 00:27:45.705 [2024-11-21 03:44:26.089164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.705 [2024-11-21 03:44:26.089287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.705 [2024-11-21 03:44:26.089315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.705 qpair failed and we were unable to recover it. 00:27:45.705 [2024-11-21 03:44:26.089451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.705 [2024-11-21 03:44:26.089590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.705 [2024-11-21 03:44:26.089615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.705 qpair failed and we were unable to recover it. 00:27:45.705 [2024-11-21 03:44:26.089769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.705 [2024-11-21 03:44:26.089872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.705 [2024-11-21 03:44:26.089898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.705 qpair failed and we were unable to recover it. 00:27:45.705 [2024-11-21 03:44:26.090049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.705 [2024-11-21 03:44:26.090206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.705 [2024-11-21 03:44:26.090232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.705 qpair failed and we were unable to recover it. 00:27:45.705 [2024-11-21 03:44:26.090367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.705 [2024-11-21 03:44:26.090483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.705 [2024-11-21 03:44:26.090510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.705 qpair failed and we were unable to recover it. 00:27:45.705 [2024-11-21 03:44:26.090667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.705 [2024-11-21 03:44:26.090800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.705 [2024-11-21 03:44:26.090826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.705 qpair failed and we were unable to recover it. 00:27:45.705 [2024-11-21 03:44:26.090928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.705 [2024-11-21 03:44:26.091027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.705 [2024-11-21 03:44:26.091053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.705 qpair failed and we were unable to recover it. 00:27:45.705 [2024-11-21 03:44:26.091166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.705 [2024-11-21 03:44:26.091328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.705 [2024-11-21 03:44:26.091353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.705 qpair failed and we were unable to recover it. 00:27:45.705 [2024-11-21 03:44:26.091495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.705 [2024-11-21 03:44:26.091617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.705 [2024-11-21 03:44:26.091642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.705 qpair failed and we were unable to recover it. 00:27:45.705 [2024-11-21 03:44:26.091806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.705 [2024-11-21 03:44:26.091939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.705 [2024-11-21 03:44:26.091964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.705 qpair failed and we were unable to recover it. 00:27:45.705 [2024-11-21 03:44:26.092117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.705 [2024-11-21 03:44:26.092272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.705 [2024-11-21 03:44:26.092298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.705 qpair failed and we were unable to recover it. 00:27:45.705 [2024-11-21 03:44:26.092455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.705 [2024-11-21 03:44:26.092554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.705 [2024-11-21 03:44:26.092579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.705 qpair failed and we were unable to recover it. 00:27:45.705 [2024-11-21 03:44:26.092708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.706 [2024-11-21 03:44:26.092869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.706 [2024-11-21 03:44:26.092897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.706 qpair failed and we were unable to recover it. 00:27:45.706 [2024-11-21 03:44:26.093007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.706 [2024-11-21 03:44:26.093142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.706 [2024-11-21 03:44:26.093174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.706 qpair failed and we were unable to recover it. 00:27:45.706 [2024-11-21 03:44:26.093290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.706 [2024-11-21 03:44:26.093396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.706 [2024-11-21 03:44:26.093421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.706 qpair failed and we were unable to recover it. 00:27:45.706 [2024-11-21 03:44:26.093579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.706 [2024-11-21 03:44:26.093709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.706 [2024-11-21 03:44:26.093734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.706 qpair failed and we were unable to recover it. 00:27:45.706 [2024-11-21 03:44:26.093887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.706 [2024-11-21 03:44:26.094036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.706 [2024-11-21 03:44:26.094063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.706 qpair failed and we were unable to recover it. 00:27:45.706 [2024-11-21 03:44:26.094232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.706 [2024-11-21 03:44:26.094334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.706 [2024-11-21 03:44:26.094359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.706 qpair failed and we were unable to recover it. 00:27:45.706 [2024-11-21 03:44:26.094469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.706 [2024-11-21 03:44:26.094618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.706 [2024-11-21 03:44:26.094646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.706 qpair failed and we were unable to recover it. 00:27:45.706 [2024-11-21 03:44:26.094785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.706 [2024-11-21 03:44:26.094923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.706 [2024-11-21 03:44:26.094952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.706 qpair failed and we were unable to recover it. 00:27:45.706 [2024-11-21 03:44:26.095088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.706 [2024-11-21 03:44:26.095200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.706 [2024-11-21 03:44:26.095230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.706 qpair failed and we were unable to recover it. 00:27:45.706 [2024-11-21 03:44:26.095328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.706 [2024-11-21 03:44:26.095432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.706 [2024-11-21 03:44:26.095457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.706 qpair failed and we were unable to recover it. 00:27:45.706 [2024-11-21 03:44:26.095630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.706 [2024-11-21 03:44:26.095760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.706 [2024-11-21 03:44:26.095785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.706 qpair failed and we were unable to recover it. 00:27:45.706 [2024-11-21 03:44:26.095928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.706 [2024-11-21 03:44:26.096098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.706 [2024-11-21 03:44:26.096149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.706 qpair failed and we were unable to recover it. 00:27:45.706 [2024-11-21 03:44:26.096282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.706 [2024-11-21 03:44:26.096470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.706 [2024-11-21 03:44:26.096495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.706 qpair failed and we were unable to recover it. 00:27:45.706 [2024-11-21 03:44:26.096622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.706 [2024-11-21 03:44:26.096728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.706 [2024-11-21 03:44:26.096770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.706 qpair failed and we were unable to recover it. 00:27:45.706 [2024-11-21 03:44:26.096903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.706 [2024-11-21 03:44:26.097062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.706 [2024-11-21 03:44:26.097093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.706 qpair failed and we were unable to recover it. 00:27:45.706 [2024-11-21 03:44:26.097219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.706 [2024-11-21 03:44:26.097374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.706 [2024-11-21 03:44:26.097399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.706 qpair failed and we were unable to recover it. 00:27:45.706 [2024-11-21 03:44:26.097513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.706 [2024-11-21 03:44:26.097641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.706 [2024-11-21 03:44:26.097667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.706 qpair failed and we were unable to recover it. 00:27:45.706 [2024-11-21 03:44:26.097768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.706 [2024-11-21 03:44:26.097897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.706 [2024-11-21 03:44:26.097922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.706 qpair failed and we were unable to recover it. 00:27:45.706 [2024-11-21 03:44:26.098040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.706 [2024-11-21 03:44:26.098159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.706 [2024-11-21 03:44:26.098189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.706 qpair failed and we were unable to recover it. 00:27:45.706 [2024-11-21 03:44:26.098359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.706 [2024-11-21 03:44:26.098459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.706 [2024-11-21 03:44:26.098487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.706 qpair failed and we were unable to recover it. 00:27:45.706 [2024-11-21 03:44:26.098615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.706 [2024-11-21 03:44:26.098712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.706 [2024-11-21 03:44:26.098736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.706 qpair failed and we were unable to recover it. 00:27:45.706 [2024-11-21 03:44:26.098884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.706 [2024-11-21 03:44:26.098998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.706 [2024-11-21 03:44:26.099026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.706 qpair failed and we were unable to recover it. 00:27:45.706 [2024-11-21 03:44:26.099189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.706 [2024-11-21 03:44:26.099302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.706 [2024-11-21 03:44:26.099326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.706 qpair failed and we were unable to recover it. 00:27:45.706 [2024-11-21 03:44:26.099452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.706 [2024-11-21 03:44:26.099557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.706 [2024-11-21 03:44:26.099584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.706 qpair failed and we were unable to recover it. 00:27:45.706 [2024-11-21 03:44:26.099729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.706 [2024-11-21 03:44:26.099897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.706 [2024-11-21 03:44:26.099925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.706 qpair failed and we were unable to recover it. 00:27:45.706 [2024-11-21 03:44:26.100067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.706 [2024-11-21 03:44:26.100238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.706 [2024-11-21 03:44:26.100264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.706 qpair failed and we were unable to recover it. 00:27:45.706 [2024-11-21 03:44:26.100363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.706 [2024-11-21 03:44:26.100491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.706 [2024-11-21 03:44:26.100516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.706 qpair failed and we were unable to recover it. 00:27:45.706 [2024-11-21 03:44:26.100640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.706 [2024-11-21 03:44:26.100783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.706 [2024-11-21 03:44:26.100810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.706 qpair failed and we were unable to recover it. 00:27:45.706 [2024-11-21 03:44:26.100947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.707 [2024-11-21 03:44:26.101103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.707 [2024-11-21 03:44:26.101133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.707 qpair failed and we were unable to recover it. 00:27:45.707 [2024-11-21 03:44:26.101254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.707 [2024-11-21 03:44:26.101350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.707 [2024-11-21 03:44:26.101376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.707 qpair failed and we were unable to recover it. 00:27:45.707 [2024-11-21 03:44:26.101556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.707 [2024-11-21 03:44:26.101700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.707 [2024-11-21 03:44:26.101724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.707 qpair failed and we were unable to recover it. 00:27:45.707 [2024-11-21 03:44:26.101821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.707 [2024-11-21 03:44:26.101971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.707 [2024-11-21 03:44:26.101999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.707 qpair failed and we were unable to recover it. 00:27:45.707 [2024-11-21 03:44:26.102166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.707 [2024-11-21 03:44:26.102295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.707 [2024-11-21 03:44:26.102319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.707 qpair failed and we were unable to recover it. 00:27:45.707 [2024-11-21 03:44:26.102500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.707 [2024-11-21 03:44:26.102649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.707 [2024-11-21 03:44:26.102680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.707 qpair failed and we were unable to recover it. 00:27:45.707 [2024-11-21 03:44:26.102873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.707 [2024-11-21 03:44:26.102976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.707 [2024-11-21 03:44:26.103002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.707 qpair failed and we were unable to recover it. 00:27:45.707 [2024-11-21 03:44:26.103106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.707 [2024-11-21 03:44:26.103235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.707 [2024-11-21 03:44:26.103260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.707 qpair failed and we were unable to recover it. 00:27:45.707 [2024-11-21 03:44:26.103414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.707 [2024-11-21 03:44:26.103584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.707 [2024-11-21 03:44:26.103611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.707 qpair failed and we were unable to recover it. 00:27:45.707 [2024-11-21 03:44:26.103759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.707 [2024-11-21 03:44:26.103907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.707 [2024-11-21 03:44:26.103932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.707 qpair failed and we were unable to recover it. 00:27:45.707 [2024-11-21 03:44:26.104044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.707 [2024-11-21 03:44:26.104176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.707 [2024-11-21 03:44:26.104202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.707 qpair failed and we were unable to recover it. 00:27:45.707 [2024-11-21 03:44:26.104308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.707 [2024-11-21 03:44:26.104405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.707 [2024-11-21 03:44:26.104430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.707 qpair failed and we were unable to recover it. 00:27:45.707 [2024-11-21 03:44:26.104550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.707 [2024-11-21 03:44:26.104700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.707 [2024-11-21 03:44:26.104729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.707 qpair failed and we were unable to recover it. 00:27:45.707 [2024-11-21 03:44:26.104844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.707 [2024-11-21 03:44:26.104941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.707 [2024-11-21 03:44:26.104966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.707 qpair failed and we were unable to recover it. 00:27:45.707 [2024-11-21 03:44:26.105100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.707 [2024-11-21 03:44:26.105258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.707 [2024-11-21 03:44:26.105284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.707 qpair failed and we were unable to recover it. 00:27:45.707 [2024-11-21 03:44:26.105385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.707 [2024-11-21 03:44:26.105484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.707 [2024-11-21 03:44:26.105511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.707 qpair failed and we were unable to recover it. 00:27:45.707 [2024-11-21 03:44:26.105607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.707 [2024-11-21 03:44:26.105707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.707 [2024-11-21 03:44:26.105732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.707 qpair failed and we were unable to recover it. 00:27:45.707 [2024-11-21 03:44:26.105890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.707 [2024-11-21 03:44:26.106023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.707 [2024-11-21 03:44:26.106051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.707 qpair failed and we were unable to recover it. 00:27:45.707 [2024-11-21 03:44:26.106177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.707 [2024-11-21 03:44:26.106283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.707 [2024-11-21 03:44:26.106314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.707 qpair failed and we were unable to recover it. 00:27:45.707 [2024-11-21 03:44:26.106427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.707 [2024-11-21 03:44:26.106557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.707 [2024-11-21 03:44:26.106584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.707 qpair failed and we were unable to recover it. 00:27:45.707 [2024-11-21 03:44:26.106696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.707 [2024-11-21 03:44:26.106835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.707 [2024-11-21 03:44:26.106863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.707 qpair failed and we were unable to recover it. 00:27:45.707 [2024-11-21 03:44:26.107006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.707 [2024-11-21 03:44:26.107121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.707 [2024-11-21 03:44:26.107149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.707 qpair failed and we were unable to recover it. 00:27:45.707 [2024-11-21 03:44:26.107270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.707 [2024-11-21 03:44:26.107362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.707 [2024-11-21 03:44:26.107387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.707 qpair failed and we were unable to recover it. 00:27:45.707 [2024-11-21 03:44:26.107481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.707 [2024-11-21 03:44:26.107692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.707 [2024-11-21 03:44:26.107717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.707 qpair failed and we were unable to recover it. 00:27:45.707 [2024-11-21 03:44:26.107848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.707 [2024-11-21 03:44:26.108024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.707 [2024-11-21 03:44:26.108057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.707 qpair failed and we were unable to recover it. 00:27:45.707 [2024-11-21 03:44:26.108193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.707 [2024-11-21 03:44:26.108304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.707 [2024-11-21 03:44:26.108329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.707 qpair failed and we were unable to recover it. 00:27:45.707 [2024-11-21 03:44:26.108431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.707 [2024-11-21 03:44:26.108533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.707 [2024-11-21 03:44:26.108558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.707 qpair failed and we were unable to recover it. 00:27:45.707 [2024-11-21 03:44:26.108683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.707 [2024-11-21 03:44:26.108809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.707 [2024-11-21 03:44:26.108834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.707 qpair failed and we were unable to recover it. 00:27:45.707 [2024-11-21 03:44:26.108959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.708 [2024-11-21 03:44:26.109121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.708 [2024-11-21 03:44:26.109164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.708 qpair failed and we were unable to recover it. 00:27:45.708 [2024-11-21 03:44:26.109269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.708 [2024-11-21 03:44:26.109377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.708 [2024-11-21 03:44:26.109421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.708 qpair failed and we were unable to recover it. 00:27:45.708 [2024-11-21 03:44:26.109519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.708 [2024-11-21 03:44:26.109628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.708 [2024-11-21 03:44:26.109670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.708 qpair failed and we were unable to recover it. 00:27:45.708 [2024-11-21 03:44:26.109805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.708 [2024-11-21 03:44:26.109931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.708 [2024-11-21 03:44:26.109957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.708 qpair failed and we were unable to recover it. 00:27:45.708 [2024-11-21 03:44:26.110082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.708 [2024-11-21 03:44:26.110224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.708 [2024-11-21 03:44:26.110248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.708 qpair failed and we were unable to recover it. 00:27:45.708 [2024-11-21 03:44:26.110357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.708 [2024-11-21 03:44:26.110543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.708 [2024-11-21 03:44:26.110567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.708 qpair failed and we were unable to recover it. 00:27:45.708 [2024-11-21 03:44:26.110669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.708 [2024-11-21 03:44:26.110771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.708 [2024-11-21 03:44:26.110800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.708 qpair failed and we were unable to recover it. 00:27:45.708 [2024-11-21 03:44:26.110950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.708 [2024-11-21 03:44:26.111098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.708 [2024-11-21 03:44:26.111126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.708 qpair failed and we were unable to recover it. 00:27:45.708 [2024-11-21 03:44:26.111260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.708 [2024-11-21 03:44:26.111383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.708 [2024-11-21 03:44:26.111409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.708 qpair failed and we were unable to recover it. 00:27:45.708 [2024-11-21 03:44:26.111535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.708 [2024-11-21 03:44:26.111658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.708 [2024-11-21 03:44:26.111683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.708 qpair failed and we were unable to recover it. 00:27:45.708 [2024-11-21 03:44:26.111859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.708 [2024-11-21 03:44:26.111969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.708 [2024-11-21 03:44:26.111997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.708 qpair failed and we were unable to recover it. 00:27:45.708 [2024-11-21 03:44:26.112152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.708 [2024-11-21 03:44:26.112277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.708 [2024-11-21 03:44:26.112302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.708 qpair failed and we were unable to recover it. 00:27:45.708 [2024-11-21 03:44:26.112433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.708 [2024-11-21 03:44:26.112585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.708 [2024-11-21 03:44:26.112610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.708 qpair failed and we were unable to recover it. 00:27:45.708 [2024-11-21 03:44:26.112743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.708 [2024-11-21 03:44:26.112893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.708 [2024-11-21 03:44:26.112918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.708 qpair failed and we were unable to recover it. 00:27:45.708 [2024-11-21 03:44:26.113019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.708 [2024-11-21 03:44:26.113142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.708 [2024-11-21 03:44:26.113167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.708 qpair failed and we were unable to recover it. 00:27:45.708 [2024-11-21 03:44:26.113268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.708 [2024-11-21 03:44:26.113365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.708 [2024-11-21 03:44:26.113389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.708 qpair failed and we were unable to recover it. 00:27:45.708 [2024-11-21 03:44:26.113543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.708 [2024-11-21 03:44:26.113670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.708 [2024-11-21 03:44:26.113697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.708 qpair failed and we were unable to recover it. 00:27:45.708 [2024-11-21 03:44:26.113839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.708 [2024-11-21 03:44:26.113992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.708 [2024-11-21 03:44:26.114017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.708 qpair failed and we were unable to recover it. 00:27:45.708 [2024-11-21 03:44:26.114120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.708 [2024-11-21 03:44:26.114226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.708 [2024-11-21 03:44:26.114252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.708 qpair failed and we were unable to recover it. 00:27:45.708 [2024-11-21 03:44:26.114382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.708 [2024-11-21 03:44:26.114518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.708 [2024-11-21 03:44:26.114545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.708 qpair failed and we were unable to recover it. 00:27:45.708 [2024-11-21 03:44:26.114696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.708 [2024-11-21 03:44:26.114862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.708 [2024-11-21 03:44:26.114891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.708 qpair failed and we were unable to recover it. 00:27:45.708 [2024-11-21 03:44:26.115015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.708 [2024-11-21 03:44:26.115171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.708 [2024-11-21 03:44:26.115198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.708 qpair failed and we were unable to recover it. 00:27:45.708 [2024-11-21 03:44:26.115325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.708 [2024-11-21 03:44:26.115455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.708 [2024-11-21 03:44:26.115481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.708 qpair failed and we were unable to recover it. 00:27:45.708 [2024-11-21 03:44:26.115574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.708 [2024-11-21 03:44:26.115681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.708 [2024-11-21 03:44:26.115706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.708 qpair failed and we were unable to recover it. 00:27:45.708 [2024-11-21 03:44:26.115832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.708 [2024-11-21 03:44:26.115938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.708 [2024-11-21 03:44:26.115963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.708 qpair failed and we were unable to recover it. 00:27:45.708 [2024-11-21 03:44:26.116061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.708 [2024-11-21 03:44:26.116190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.708 [2024-11-21 03:44:26.116232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.708 qpair failed and we were unable to recover it. 00:27:45.708 [2024-11-21 03:44:26.116356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.708 [2024-11-21 03:44:26.116496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.708 [2024-11-21 03:44:26.116537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.708 qpair failed and we were unable to recover it. 00:27:45.708 [2024-11-21 03:44:26.116670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.708 [2024-11-21 03:44:26.116826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.708 [2024-11-21 03:44:26.116850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.708 qpair failed and we were unable to recover it. 00:27:45.708 [2024-11-21 03:44:26.117004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.708 [2024-11-21 03:44:26.117107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.708 [2024-11-21 03:44:26.117132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.709 qpair failed and we were unable to recover it. 00:27:45.709 [2024-11-21 03:44:26.117262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.709 [2024-11-21 03:44:26.117373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.709 [2024-11-21 03:44:26.117402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.709 qpair failed and we were unable to recover it. 00:27:45.709 [2024-11-21 03:44:26.117542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.709 [2024-11-21 03:44:26.117647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.709 [2024-11-21 03:44:26.117671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.709 qpair failed and we were unable to recover it. 00:27:45.709 [2024-11-21 03:44:26.117781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.709 [2024-11-21 03:44:26.117904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.709 [2024-11-21 03:44:26.117929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.709 qpair failed and we were unable to recover it. 00:27:45.709 [2024-11-21 03:44:26.118084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.709 [2024-11-21 03:44:26.118200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.709 [2024-11-21 03:44:26.118226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.709 qpair failed and we were unable to recover it. 00:27:45.709 [2024-11-21 03:44:26.118355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.709 [2024-11-21 03:44:26.118479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.709 [2024-11-21 03:44:26.118504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.709 qpair failed and we were unable to recover it. 00:27:45.709 [2024-11-21 03:44:26.118630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.709 [2024-11-21 03:44:26.118783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.709 [2024-11-21 03:44:26.118810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.709 qpair failed and we were unable to recover it. 00:27:45.709 [2024-11-21 03:44:26.118950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.709 [2024-11-21 03:44:26.119056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.709 [2024-11-21 03:44:26.119093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.709 qpair failed and we were unable to recover it. 00:27:45.709 [2024-11-21 03:44:26.119238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.709 [2024-11-21 03:44:26.119338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.709 [2024-11-21 03:44:26.119362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.709 qpair failed and we were unable to recover it. 00:27:45.709 [2024-11-21 03:44:26.119478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.709 [2024-11-21 03:44:26.119609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.709 [2024-11-21 03:44:26.119635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.709 qpair failed and we were unable to recover it. 00:27:45.709 [2024-11-21 03:44:26.119771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.709 [2024-11-21 03:44:26.119908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.709 [2024-11-21 03:44:26.119951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.709 qpair failed and we were unable to recover it. 00:27:45.709 [2024-11-21 03:44:26.120046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.709 [2024-11-21 03:44:26.120158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.709 [2024-11-21 03:44:26.120185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.709 qpair failed and we were unable to recover it. 00:27:45.709 [2024-11-21 03:44:26.120316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.709 [2024-11-21 03:44:26.120453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.709 [2024-11-21 03:44:26.120481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.709 qpair failed and we were unable to recover it. 00:27:45.709 [2024-11-21 03:44:26.120633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.709 [2024-11-21 03:44:26.120748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.709 [2024-11-21 03:44:26.120775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.709 qpair failed and we were unable to recover it. 00:27:45.709 [2024-11-21 03:44:26.120922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.709 [2024-11-21 03:44:26.121018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.709 [2024-11-21 03:44:26.121044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.709 qpair failed and we were unable to recover it. 00:27:45.709 [2024-11-21 03:44:26.121178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.709 [2024-11-21 03:44:26.121326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.709 [2024-11-21 03:44:26.121354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.709 qpair failed and we were unable to recover it. 00:27:45.709 [2024-11-21 03:44:26.121487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.709 [2024-11-21 03:44:26.121639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.709 [2024-11-21 03:44:26.121664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.709 qpair failed and we were unable to recover it. 00:27:45.709 [2024-11-21 03:44:26.121765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.709 [2024-11-21 03:44:26.121887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.709 [2024-11-21 03:44:26.121912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.709 qpair failed and we were unable to recover it. 00:27:45.709 [2024-11-21 03:44:26.122076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.709 [2024-11-21 03:44:26.122198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.709 [2024-11-21 03:44:26.122222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.709 qpair failed and we were unable to recover it. 00:27:45.709 [2024-11-21 03:44:26.122350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.709 [2024-11-21 03:44:26.122463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.709 [2024-11-21 03:44:26.122491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.709 qpair failed and we were unable to recover it. 00:27:45.709 [2024-11-21 03:44:26.122611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.709 [2024-11-21 03:44:26.122742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.709 [2024-11-21 03:44:26.122766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.709 qpair failed and we were unable to recover it. 00:27:45.709 [2024-11-21 03:44:26.122932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.709 [2024-11-21 03:44:26.123061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.709 [2024-11-21 03:44:26.123095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.709 qpair failed and we were unable to recover it. 00:27:45.709 [2024-11-21 03:44:26.123220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.709 [2024-11-21 03:44:26.123360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.709 [2024-11-21 03:44:26.123388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.709 qpair failed and we were unable to recover it. 00:27:45.709 [2024-11-21 03:44:26.123542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.709 [2024-11-21 03:44:26.123675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.709 [2024-11-21 03:44:26.123699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.709 qpair failed and we were unable to recover it. 00:27:45.709 [2024-11-21 03:44:26.123815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.709 [2024-11-21 03:44:26.123936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.709 [2024-11-21 03:44:26.123963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.709 qpair failed and we were unable to recover it. 00:27:45.709 [2024-11-21 03:44:26.124098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.709 [2024-11-21 03:44:26.124200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.710 [2024-11-21 03:44:26.124224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.710 qpair failed and we were unable to recover it. 00:27:45.710 [2024-11-21 03:44:26.124326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.710 [2024-11-21 03:44:26.124424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.710 [2024-11-21 03:44:26.124449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.710 qpair failed and we were unable to recover it. 00:27:45.710 [2024-11-21 03:44:26.124599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.710 [2024-11-21 03:44:26.124711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.710 [2024-11-21 03:44:26.124738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.710 qpair failed and we were unable to recover it. 00:27:45.710 [2024-11-21 03:44:26.124876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.710 [2024-11-21 03:44:26.125021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.710 [2024-11-21 03:44:26.125048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.710 qpair failed and we were unable to recover it. 00:27:45.710 [2024-11-21 03:44:26.125206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.710 [2024-11-21 03:44:26.125334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.710 [2024-11-21 03:44:26.125364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.710 qpair failed and we were unable to recover it. 00:27:45.710 [2024-11-21 03:44:26.125508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.710 [2024-11-21 03:44:26.125664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.710 [2024-11-21 03:44:26.125690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.710 qpair failed and we were unable to recover it. 00:27:45.710 [2024-11-21 03:44:26.125792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.710 [2024-11-21 03:44:26.125918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.710 [2024-11-21 03:44:26.125943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.710 qpair failed and we were unable to recover it. 00:27:45.710 [2024-11-21 03:44:26.126066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.710 [2024-11-21 03:44:26.126207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.710 [2024-11-21 03:44:26.126232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.710 qpair failed and we were unable to recover it. 00:27:45.710 [2024-11-21 03:44:26.126408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.710 [2024-11-21 03:44:26.126507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.710 [2024-11-21 03:44:26.126533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.710 qpair failed and we were unable to recover it. 00:27:45.710 [2024-11-21 03:44:26.126635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.710 [2024-11-21 03:44:26.126731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.710 [2024-11-21 03:44:26.126755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.710 qpair failed and we were unable to recover it. 00:27:45.710 [2024-11-21 03:44:26.126909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.710 [2024-11-21 03:44:26.127082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.710 [2024-11-21 03:44:26.127110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.710 qpair failed and we were unable to recover it. 00:27:45.710 [2024-11-21 03:44:26.127230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.710 [2024-11-21 03:44:26.127344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.710 [2024-11-21 03:44:26.127372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.710 qpair failed and we were unable to recover it. 00:27:45.710 [2024-11-21 03:44:26.127482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.710 [2024-11-21 03:44:26.127625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.710 [2024-11-21 03:44:26.127651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.710 qpair failed and we were unable to recover it. 00:27:45.710 [2024-11-21 03:44:26.127792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.710 [2024-11-21 03:44:26.127919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.710 [2024-11-21 03:44:26.127944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.710 qpair failed and we were unable to recover it. 00:27:45.710 [2024-11-21 03:44:26.128101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.710 [2024-11-21 03:44:26.128229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.710 [2024-11-21 03:44:26.128258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.710 qpair failed and we were unable to recover it. 00:27:45.710 [2024-11-21 03:44:26.128399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.710 [2024-11-21 03:44:26.128535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.710 [2024-11-21 03:44:26.128563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.710 qpair failed and we were unable to recover it. 00:27:45.710 [2024-11-21 03:44:26.128718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.710 [2024-11-21 03:44:26.128842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.710 [2024-11-21 03:44:26.128866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.710 qpair failed and we were unable to recover it. 00:27:45.710 [2024-11-21 03:44:26.129012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.710 [2024-11-21 03:44:26.129192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.710 [2024-11-21 03:44:26.129217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.710 qpair failed and we were unable to recover it. 00:27:45.710 [2024-11-21 03:44:26.129316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.710 [2024-11-21 03:44:26.129418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.710 [2024-11-21 03:44:26.129444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.710 qpair failed and we were unable to recover it. 00:27:45.710 [2024-11-21 03:44:26.129574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.710 [2024-11-21 03:44:26.129734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.710 [2024-11-21 03:44:26.129777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.710 qpair failed and we were unable to recover it. 00:27:45.710 [2024-11-21 03:44:26.129953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.710 [2024-11-21 03:44:26.130096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.710 [2024-11-21 03:44:26.130138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.710 qpair failed and we were unable to recover it. 00:27:45.710 [2024-11-21 03:44:26.130270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.710 [2024-11-21 03:44:26.130458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.710 [2024-11-21 03:44:26.130484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.710 qpair failed and we were unable to recover it. 00:27:45.710 [2024-11-21 03:44:26.130611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.710 [2024-11-21 03:44:26.130746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.710 [2024-11-21 03:44:26.130771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.710 qpair failed and we were unable to recover it. 00:27:45.710 [2024-11-21 03:44:26.130920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.710 [2024-11-21 03:44:26.131053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.710 [2024-11-21 03:44:26.131089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.710 qpair failed and we were unable to recover it. 00:27:45.710 [2024-11-21 03:44:26.131200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.710 [2024-11-21 03:44:26.131316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.710 [2024-11-21 03:44:26.131345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.710 qpair failed and we were unable to recover it. 00:27:45.710 [2024-11-21 03:44:26.131500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.710 [2024-11-21 03:44:26.131604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.710 [2024-11-21 03:44:26.131630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.710 qpair failed and we were unable to recover it. 00:27:45.710 [2024-11-21 03:44:26.131751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.710 [2024-11-21 03:44:26.131887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.710 [2024-11-21 03:44:26.131915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.710 qpair failed and we were unable to recover it. 00:27:45.710 [2024-11-21 03:44:26.132059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.710 [2024-11-21 03:44:26.132203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.710 [2024-11-21 03:44:26.132231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.710 qpair failed and we were unable to recover it. 00:27:45.710 [2024-11-21 03:44:26.132354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.710 [2024-11-21 03:44:26.132482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.710 [2024-11-21 03:44:26.132506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.710 qpair failed and we were unable to recover it. 00:27:45.711 [2024-11-21 03:44:26.132641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.711 [2024-11-21 03:44:26.132761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.711 [2024-11-21 03:44:26.132788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.711 qpair failed and we were unable to recover it. 00:27:45.711 [2024-11-21 03:44:26.132958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.711 [2024-11-21 03:44:26.133066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.711 [2024-11-21 03:44:26.133123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.711 qpair failed and we were unable to recover it. 00:27:45.711 [2024-11-21 03:44:26.133248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.711 [2024-11-21 03:44:26.133378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.711 [2024-11-21 03:44:26.133403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.711 qpair failed and we were unable to recover it. 00:27:45.711 [2024-11-21 03:44:26.133534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.711 [2024-11-21 03:44:26.133658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.711 [2024-11-21 03:44:26.133683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.711 qpair failed and we were unable to recover it. 00:27:45.711 [2024-11-21 03:44:26.133797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.711 [2024-11-21 03:44:26.133962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.711 [2024-11-21 03:44:26.133990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.711 qpair failed and we were unable to recover it. 00:27:45.711 [2024-11-21 03:44:26.134123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.711 [2024-11-21 03:44:26.134255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.711 [2024-11-21 03:44:26.134279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.711 qpair failed and we were unable to recover it. 00:27:45.711 [2024-11-21 03:44:26.134427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.711 [2024-11-21 03:44:26.134571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.711 [2024-11-21 03:44:26.134599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.711 qpair failed and we were unable to recover it. 00:27:45.711 [2024-11-21 03:44:26.134717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.711 [2024-11-21 03:44:26.134857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.711 [2024-11-21 03:44:26.134885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.711 qpair failed and we were unable to recover it. 00:27:45.711 [2024-11-21 03:44:26.135029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.711 [2024-11-21 03:44:26.135138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.711 [2024-11-21 03:44:26.135164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.711 qpair failed and we were unable to recover it. 00:27:45.711 [2024-11-21 03:44:26.135284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.711 [2024-11-21 03:44:26.135452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.711 [2024-11-21 03:44:26.135478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.711 qpair failed and we were unable to recover it. 00:27:45.711 [2024-11-21 03:44:26.135612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.711 [2024-11-21 03:44:26.135771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.711 [2024-11-21 03:44:26.135796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.711 qpair failed and we were unable to recover it. 00:27:45.711 [2024-11-21 03:44:26.135971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.711 [2024-11-21 03:44:26.136102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.711 [2024-11-21 03:44:26.136128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.711 qpair failed and we were unable to recover it. 00:27:45.711 [2024-11-21 03:44:26.136238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.711 [2024-11-21 03:44:26.136364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.711 [2024-11-21 03:44:26.136389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.711 qpair failed and we were unable to recover it. 00:27:45.711 [2024-11-21 03:44:26.136539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.711 [2024-11-21 03:44:26.136655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.711 [2024-11-21 03:44:26.136682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.711 qpair failed and we were unable to recover it. 00:27:45.711 [2024-11-21 03:44:26.136811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.711 [2024-11-21 03:44:26.136932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.711 [2024-11-21 03:44:26.136957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.711 qpair failed and we were unable to recover it. 00:27:45.711 [2024-11-21 03:44:26.137108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.711 [2024-11-21 03:44:26.137222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.711 [2024-11-21 03:44:26.137246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.711 qpair failed and we were unable to recover it. 00:27:45.711 [2024-11-21 03:44:26.137408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.711 [2024-11-21 03:44:26.137563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.711 [2024-11-21 03:44:26.137588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.711 qpair failed and we were unable to recover it. 00:27:45.711 [2024-11-21 03:44:26.137724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.711 [2024-11-21 03:44:26.137824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.711 [2024-11-21 03:44:26.137848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.711 qpair failed and we were unable to recover it. 00:27:45.711 [2024-11-21 03:44:26.137976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.711 [2024-11-21 03:44:26.138090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.711 [2024-11-21 03:44:26.138128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.711 qpair failed and we were unable to recover it. 00:27:45.711 [2024-11-21 03:44:26.138294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.711 [2024-11-21 03:44:26.138430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.711 [2024-11-21 03:44:26.138454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.711 qpair failed and we were unable to recover it. 00:27:45.711 [2024-11-21 03:44:26.138585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.711 [2024-11-21 03:44:26.138710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.711 [2024-11-21 03:44:26.138734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.711 qpair failed and we were unable to recover it. 00:27:45.711 [2024-11-21 03:44:26.138905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.711 [2024-11-21 03:44:26.139042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.711 [2024-11-21 03:44:26.139066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.711 qpair failed and we were unable to recover it. 00:27:45.711 [2024-11-21 03:44:26.139267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.711 [2024-11-21 03:44:26.139371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.711 [2024-11-21 03:44:26.139396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.711 qpair failed and we were unable to recover it. 00:27:45.711 [2024-11-21 03:44:26.139527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.711 [2024-11-21 03:44:26.139665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.711 [2024-11-21 03:44:26.139690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.711 qpair failed and we were unable to recover it. 00:27:45.711 [2024-11-21 03:44:26.139823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.711 [2024-11-21 03:44:26.139933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.711 [2024-11-21 03:44:26.139974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.711 qpair failed and we were unable to recover it. 00:27:45.711 [2024-11-21 03:44:26.140127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.711 [2024-11-21 03:44:26.140274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.711 [2024-11-21 03:44:26.140299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.711 qpair failed and we were unable to recover it. 00:27:45.711 [2024-11-21 03:44:26.140402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.711 [2024-11-21 03:44:26.140555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.711 [2024-11-21 03:44:26.140586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.711 qpair failed and we were unable to recover it. 00:27:45.711 [2024-11-21 03:44:26.140733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.711 [2024-11-21 03:44:26.140895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.711 [2024-11-21 03:44:26.140922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.711 qpair failed and we were unable to recover it. 00:27:45.711 [2024-11-21 03:44:26.141100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.711 [2024-11-21 03:44:26.141201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.712 [2024-11-21 03:44:26.141226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.712 qpair failed and we were unable to recover it. 00:27:45.712 [2024-11-21 03:44:26.141353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.712 [2024-11-21 03:44:26.141455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.712 [2024-11-21 03:44:26.141480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.712 qpair failed and we were unable to recover it. 00:27:45.712 [2024-11-21 03:44:26.141656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.712 [2024-11-21 03:44:26.141796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.712 [2024-11-21 03:44:26.141824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.712 qpair failed and we were unable to recover it. 00:27:45.712 [2024-11-21 03:44:26.141932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.712 [2024-11-21 03:44:26.142100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.712 [2024-11-21 03:44:26.142127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.712 qpair failed and we were unable to recover it. 00:27:45.712 [2024-11-21 03:44:26.142252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.712 [2024-11-21 03:44:26.142354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.712 [2024-11-21 03:44:26.142378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.712 qpair failed and we were unable to recover it. 00:27:45.712 [2024-11-21 03:44:26.142504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.712 [2024-11-21 03:44:26.142667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.712 [2024-11-21 03:44:26.142692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.712 qpair failed and we were unable to recover it. 00:27:45.712 [2024-11-21 03:44:26.142827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.712 [2024-11-21 03:44:26.142949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.712 [2024-11-21 03:44:26.142977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.712 qpair failed and we were unable to recover it. 00:27:45.712 [2024-11-21 03:44:26.143146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.712 [2024-11-21 03:44:26.143252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.712 [2024-11-21 03:44:26.143277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.712 qpair failed and we were unable to recover it. 00:27:45.712 [2024-11-21 03:44:26.143421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.712 [2024-11-21 03:44:26.143602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.712 [2024-11-21 03:44:26.143628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.712 qpair failed and we were unable to recover it. 00:27:45.712 [2024-11-21 03:44:26.143743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.712 [2024-11-21 03:44:26.143884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.712 [2024-11-21 03:44:26.143912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.712 qpair failed and we were unable to recover it. 00:27:45.712 [2024-11-21 03:44:26.144061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.712 [2024-11-21 03:44:26.144194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.712 [2024-11-21 03:44:26.144219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.712 qpair failed and we were unable to recover it. 00:27:45.712 [2024-11-21 03:44:26.144381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.712 [2024-11-21 03:44:26.144505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.712 [2024-11-21 03:44:26.144530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.712 qpair failed and we were unable to recover it. 00:27:45.712 [2024-11-21 03:44:26.144693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.712 [2024-11-21 03:44:26.144790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.712 [2024-11-21 03:44:26.144814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.712 qpair failed and we were unable to recover it. 00:27:45.712 [2024-11-21 03:44:26.144923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.712 [2024-11-21 03:44:26.145097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.712 [2024-11-21 03:44:26.145134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.712 qpair failed and we were unable to recover it. 00:27:45.712 [2024-11-21 03:44:26.145281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.712 [2024-11-21 03:44:26.145447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.712 [2024-11-21 03:44:26.145475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.712 qpair failed and we were unable to recover it. 00:27:45.712 [2024-11-21 03:44:26.145635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.712 [2024-11-21 03:44:26.145728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.712 [2024-11-21 03:44:26.145753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.712 qpair failed and we were unable to recover it. 00:27:45.712 [2024-11-21 03:44:26.145909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.712 [2024-11-21 03:44:26.146030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.712 [2024-11-21 03:44:26.146055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.712 qpair failed and we were unable to recover it. 00:27:45.712 [2024-11-21 03:44:26.146229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.712 [2024-11-21 03:44:26.146344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.712 [2024-11-21 03:44:26.146372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.712 qpair failed and we were unable to recover it. 00:27:45.712 [2024-11-21 03:44:26.146516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.712 [2024-11-21 03:44:26.146657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.712 [2024-11-21 03:44:26.146685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.712 qpair failed and we were unable to recover it. 00:27:45.712 [2024-11-21 03:44:26.146865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.712 [2024-11-21 03:44:26.146967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.712 [2024-11-21 03:44:26.146993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.712 qpair failed and we were unable to recover it. 00:27:45.712 [2024-11-21 03:44:26.147099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.712 [2024-11-21 03:44:26.147194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.712 [2024-11-21 03:44:26.147237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.712 qpair failed and we were unable to recover it. 00:27:45.712 [2024-11-21 03:44:26.147406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.712 [2024-11-21 03:44:26.147541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.712 [2024-11-21 03:44:26.147568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.712 qpair failed and we were unable to recover it. 00:27:45.712 [2024-11-21 03:44:26.147745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.712 [2024-11-21 03:44:26.147867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.712 [2024-11-21 03:44:26.147892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.712 qpair failed and we were unable to recover it. 00:27:45.712 [2024-11-21 03:44:26.147996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.712 [2024-11-21 03:44:26.148139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.712 [2024-11-21 03:44:26.148168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.712 qpair failed and we were unable to recover it. 00:27:45.712 [2024-11-21 03:44:26.148313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.712 [2024-11-21 03:44:26.148482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.712 [2024-11-21 03:44:26.148511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.712 qpair failed and we were unable to recover it. 00:27:45.712 [2024-11-21 03:44:26.148636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.712 [2024-11-21 03:44:26.148742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.712 [2024-11-21 03:44:26.148768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.712 qpair failed and we were unable to recover it. 00:27:45.712 [2024-11-21 03:44:26.148916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.712 [2024-11-21 03:44:26.149061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.712 [2024-11-21 03:44:26.149096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.712 qpair failed and we were unable to recover it. 00:27:45.712 [2024-11-21 03:44:26.149239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.712 [2024-11-21 03:44:26.149354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.712 [2024-11-21 03:44:26.149397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.712 qpair failed and we were unable to recover it. 00:27:45.712 [2024-11-21 03:44:26.149503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.712 [2024-11-21 03:44:26.149604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.712 [2024-11-21 03:44:26.149630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.712 qpair failed and we were unable to recover it. 00:27:45.712 [2024-11-21 03:44:26.149731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.712 [2024-11-21 03:44:26.149879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.713 [2024-11-21 03:44:26.149906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.713 qpair failed and we were unable to recover it. 00:27:45.713 [2024-11-21 03:44:26.150079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.713 [2024-11-21 03:44:26.150224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.713 [2024-11-21 03:44:26.150252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.713 qpair failed and we were unable to recover it. 00:27:45.713 [2024-11-21 03:44:26.150408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.713 [2024-11-21 03:44:26.150536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.713 [2024-11-21 03:44:26.150561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.713 qpair failed and we were unable to recover it. 00:27:45.713 [2024-11-21 03:44:26.150762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.713 [2024-11-21 03:44:26.150856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.713 [2024-11-21 03:44:26.150882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.713 qpair failed and we were unable to recover it. 00:27:45.713 [2024-11-21 03:44:26.150982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.713 [2024-11-21 03:44:26.151146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.713 [2024-11-21 03:44:26.151172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.713 qpair failed and we were unable to recover it. 00:27:45.713 [2024-11-21 03:44:26.151303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.713 [2024-11-21 03:44:26.151398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.713 [2024-11-21 03:44:26.151424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.713 qpair failed and we were unable to recover it. 00:27:45.713 [2024-11-21 03:44:26.151548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.713 [2024-11-21 03:44:26.151668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.713 [2024-11-21 03:44:26.151693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.713 qpair failed and we were unable to recover it. 00:27:45.713 [2024-11-21 03:44:26.151820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.713 [2024-11-21 03:44:26.151923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.713 [2024-11-21 03:44:26.151948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.713 qpair failed and we were unable to recover it. 00:27:45.713 [2024-11-21 03:44:26.152058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.713 [2024-11-21 03:44:26.152192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.713 [2024-11-21 03:44:26.152217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.713 qpair failed and we were unable to recover it. 00:27:45.713 [2024-11-21 03:44:26.152324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.713 [2024-11-21 03:44:26.152475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.713 [2024-11-21 03:44:26.152502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.713 qpair failed and we were unable to recover it. 00:27:45.713 [2024-11-21 03:44:26.152638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.713 [2024-11-21 03:44:26.152741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.713 [2024-11-21 03:44:26.152769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.713 qpair failed and we were unable to recover it. 00:27:45.713 [2024-11-21 03:44:26.152886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.713 [2024-11-21 03:44:26.153012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.713 [2024-11-21 03:44:26.153038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.713 qpair failed and we were unable to recover it. 00:27:45.713 [2024-11-21 03:44:26.153203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.713 [2024-11-21 03:44:26.153307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.713 [2024-11-21 03:44:26.153336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.713 qpair failed and we were unable to recover it. 00:27:45.713 [2024-11-21 03:44:26.153507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.713 [2024-11-21 03:44:26.153645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.713 [2024-11-21 03:44:26.153674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.713 qpair failed and we were unable to recover it. 00:27:45.713 [2024-11-21 03:44:26.153821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.713 [2024-11-21 03:44:26.153945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.713 [2024-11-21 03:44:26.153971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.713 qpair failed and we were unable to recover it. 00:27:45.713 [2024-11-21 03:44:26.154114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.713 [2024-11-21 03:44:26.154236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.713 [2024-11-21 03:44:26.154264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.713 qpair failed and we were unable to recover it. 00:27:45.713 [2024-11-21 03:44:26.154435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.713 [2024-11-21 03:44:26.154554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.713 [2024-11-21 03:44:26.154590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.713 qpair failed and we were unable to recover it. 00:27:45.713 [2024-11-21 03:44:26.154720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.713 [2024-11-21 03:44:26.154821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.713 [2024-11-21 03:44:26.154846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.713 qpair failed and we were unable to recover it. 00:27:45.713 [2024-11-21 03:44:26.154989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.713 [2024-11-21 03:44:26.155172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.713 [2024-11-21 03:44:26.155198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.713 qpair failed and we were unable to recover it. 00:27:45.713 [2024-11-21 03:44:26.155352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.713 [2024-11-21 03:44:26.155471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.713 [2024-11-21 03:44:26.155498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.713 qpair failed and we were unable to recover it. 00:27:45.713 [2024-11-21 03:44:26.155618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.713 [2024-11-21 03:44:26.155720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.713 [2024-11-21 03:44:26.155748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.713 qpair failed and we were unable to recover it. 00:27:45.713 [2024-11-21 03:44:26.155864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.713 [2024-11-21 03:44:26.155994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.713 [2024-11-21 03:44:26.156018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.713 qpair failed and we were unable to recover it. 00:27:45.713 [2024-11-21 03:44:26.156127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.713 [2024-11-21 03:44:26.156228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.713 [2024-11-21 03:44:26.156253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.713 qpair failed and we were unable to recover it. 00:27:45.713 [2024-11-21 03:44:26.156389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.713 [2024-11-21 03:44:26.156511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.713 [2024-11-21 03:44:26.156535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.713 qpair failed and we were unable to recover it. 00:27:45.713 [2024-11-21 03:44:26.156658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.713 [2024-11-21 03:44:26.156810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.713 [2024-11-21 03:44:26.156838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.713 qpair failed and we were unable to recover it. 00:27:45.713 [2024-11-21 03:44:26.156946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.713 [2024-11-21 03:44:26.157090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.713 [2024-11-21 03:44:26.157121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.713 qpair failed and we were unable to recover it. 00:27:45.714 [2024-11-21 03:44:26.157227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.714 [2024-11-21 03:44:26.157328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.714 [2024-11-21 03:44:26.157354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.714 qpair failed and we were unable to recover it. 00:27:45.714 [2024-11-21 03:44:26.157497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.714 [2024-11-21 03:44:26.157638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.714 [2024-11-21 03:44:26.157666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.714 qpair failed and we were unable to recover it. 00:27:45.714 [2024-11-21 03:44:26.157799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.714 [2024-11-21 03:44:26.157931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.714 [2024-11-21 03:44:26.157958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.714 qpair failed and we were unable to recover it. 00:27:45.714 [2024-11-21 03:44:26.158082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.714 [2024-11-21 03:44:26.158214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.714 [2024-11-21 03:44:26.158240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.714 qpair failed and we were unable to recover it. 00:27:45.714 [2024-11-21 03:44:26.158372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.714 [2024-11-21 03:44:26.158545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.714 [2024-11-21 03:44:26.158576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.714 qpair failed and we were unable to recover it. 00:27:45.714 [2024-11-21 03:44:26.158686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.714 [2024-11-21 03:44:26.158808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.714 [2024-11-21 03:44:26.158836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.714 qpair failed and we were unable to recover it. 00:27:45.714 [2024-11-21 03:44:26.158994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.714 [2024-11-21 03:44:26.159125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.714 [2024-11-21 03:44:26.159151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.714 qpair failed and we were unable to recover it. 00:27:45.714 [2024-11-21 03:44:26.159308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.714 [2024-11-21 03:44:26.159439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.714 [2024-11-21 03:44:26.159467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.714 qpair failed and we were unable to recover it. 00:27:45.714 [2024-11-21 03:44:26.159600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.714 [2024-11-21 03:44:26.159731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.714 [2024-11-21 03:44:26.159757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.714 qpair failed and we were unable to recover it. 00:27:45.714 [2024-11-21 03:44:26.159884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.714 [2024-11-21 03:44:26.160039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.714 [2024-11-21 03:44:26.160064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.714 qpair failed and we were unable to recover it. 00:27:45.714 [2024-11-21 03:44:26.160189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.714 [2024-11-21 03:44:26.160316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.714 [2024-11-21 03:44:26.160340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.714 qpair failed and we were unable to recover it. 00:27:45.714 [2024-11-21 03:44:26.160487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.714 [2024-11-21 03:44:26.160640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.714 [2024-11-21 03:44:26.160665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.714 qpair failed and we were unable to recover it. 00:27:45.714 [2024-11-21 03:44:26.160781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.714 [2024-11-21 03:44:26.160909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.714 [2024-11-21 03:44:26.160934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.714 qpair failed and we were unable to recover it. 00:27:45.714 [2024-11-21 03:44:26.161079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.714 [2024-11-21 03:44:26.161204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.714 [2024-11-21 03:44:26.161229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.714 qpair failed and we were unable to recover it. 00:27:45.714 [2024-11-21 03:44:26.161330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.714 [2024-11-21 03:44:26.161434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.714 [2024-11-21 03:44:26.161476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.714 qpair failed and we were unable to recover it. 00:27:45.714 [2024-11-21 03:44:26.161643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.714 [2024-11-21 03:44:26.161790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.714 [2024-11-21 03:44:26.161815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.714 qpair failed and we were unable to recover it. 00:27:45.714 [2024-11-21 03:44:26.161918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.714 [2024-11-21 03:44:26.162062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.714 [2024-11-21 03:44:26.162098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.714 qpair failed and we were unable to recover it. 00:27:45.714 [2024-11-21 03:44:26.162207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.714 [2024-11-21 03:44:26.162364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.714 [2024-11-21 03:44:26.162389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.714 qpair failed and we were unable to recover it. 00:27:45.714 [2024-11-21 03:44:26.162515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.714 [2024-11-21 03:44:26.162621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.714 [2024-11-21 03:44:26.162646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.714 qpair failed and we were unable to recover it. 00:27:45.714 [2024-11-21 03:44:26.162789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.714 [2024-11-21 03:44:26.162932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.714 [2024-11-21 03:44:26.162958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.714 qpair failed and we were unable to recover it. 00:27:45.714 [2024-11-21 03:44:26.163097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.714 [2024-11-21 03:44:26.163204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.714 [2024-11-21 03:44:26.163227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.714 qpair failed and we were unable to recover it. 00:27:45.714 [2024-11-21 03:44:26.163325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.714 [2024-11-21 03:44:26.163423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.714 [2024-11-21 03:44:26.163447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.714 qpair failed and we were unable to recover it. 00:27:45.714 [2024-11-21 03:44:26.163579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.714 [2024-11-21 03:44:26.163673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.714 [2024-11-21 03:44:26.163697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.714 qpair failed and we were unable to recover it. 00:27:45.714 [2024-11-21 03:44:26.163822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.714 [2024-11-21 03:44:26.163948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.714 [2024-11-21 03:44:26.163972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.714 qpair failed and we were unable to recover it. 00:27:45.714 [2024-11-21 03:44:26.164095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.714 [2024-11-21 03:44:26.164215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.714 [2024-11-21 03:44:26.164245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:45.714 qpair failed and we were unable to recover it. 00:27:45.714 [2024-11-21 03:44:26.164385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.714 [2024-11-21 03:44:26.164498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.714 [2024-11-21 03:44:26.164527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:45.714 qpair failed and we were unable to recover it. 00:27:45.714 [2024-11-21 03:44:26.164657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.714 [2024-11-21 03:44:26.164786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.714 [2024-11-21 03:44:26.164811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:45.714 qpair failed and we were unable to recover it. 00:27:45.714 [2024-11-21 03:44:26.164914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.714 [2024-11-21 03:44:26.165066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.714 [2024-11-21 03:44:26.165101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:45.714 qpair failed and we were unable to recover it. 00:27:45.714 [2024-11-21 03:44:26.165237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.714 [2024-11-21 03:44:26.165369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.714 [2024-11-21 03:44:26.165394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:45.715 qpair failed and we were unable to recover it. 00:27:45.715 [2024-11-21 03:44:26.165526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.715 [2024-11-21 03:44:26.165653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.715 [2024-11-21 03:44:26.165679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:45.715 qpair failed and we were unable to recover it. 00:27:45.715 [2024-11-21 03:44:26.165770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.715 [2024-11-21 03:44:26.165877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.715 [2024-11-21 03:44:26.165903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:45.715 qpair failed and we were unable to recover it. 00:27:45.715 [2024-11-21 03:44:26.166116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.715 [2024-11-21 03:44:26.166314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.715 [2024-11-21 03:44:26.166365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:45.715 qpair failed and we were unable to recover it. 00:27:45.715 [2024-11-21 03:44:26.166516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.715 [2024-11-21 03:44:26.166700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.715 [2024-11-21 03:44:26.166725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:45.715 qpair failed and we were unable to recover it. 00:27:45.715 [2024-11-21 03:44:26.166820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.715 [2024-11-21 03:44:26.166956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.715 [2024-11-21 03:44:26.166981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:45.715 qpair failed and we were unable to recover it. 00:27:45.715 [2024-11-21 03:44:26.167128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.715 [2024-11-21 03:44:26.167296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.715 [2024-11-21 03:44:26.167341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:45.715 qpair failed and we were unable to recover it. 00:27:45.715 [2024-11-21 03:44:26.167482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.715 [2024-11-21 03:44:26.167625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.715 [2024-11-21 03:44:26.167651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:45.715 qpair failed and we were unable to recover it. 00:27:45.715 [2024-11-21 03:44:26.167858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.715 [2024-11-21 03:44:26.167995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.715 [2024-11-21 03:44:26.168021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:45.715 qpair failed and we were unable to recover it. 00:27:45.715 [2024-11-21 03:44:26.168169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.715 [2024-11-21 03:44:26.168334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.715 [2024-11-21 03:44:26.168362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:45.715 qpair failed and we were unable to recover it. 00:27:45.715 [2024-11-21 03:44:26.168518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.715 [2024-11-21 03:44:26.168685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.715 [2024-11-21 03:44:26.168729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:45.715 qpair failed and we were unable to recover it. 00:27:45.715 [2024-11-21 03:44:26.168830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.715 [2024-11-21 03:44:26.169037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.715 [2024-11-21 03:44:26.169062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:45.715 qpair failed and we were unable to recover it. 00:27:45.715 [2024-11-21 03:44:26.169215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.715 [2024-11-21 03:44:26.169377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.715 [2024-11-21 03:44:26.169406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:45.715 qpair failed and we were unable to recover it. 00:27:45.715 [2024-11-21 03:44:26.169570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.715 [2024-11-21 03:44:26.169737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.715 [2024-11-21 03:44:26.169780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:45.715 qpair failed and we were unable to recover it. 00:27:45.715 [2024-11-21 03:44:26.169910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.715 [2024-11-21 03:44:26.170016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.715 [2024-11-21 03:44:26.170043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:45.715 qpair failed and we were unable to recover it. 00:27:45.715 [2024-11-21 03:44:26.170184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.715 [2024-11-21 03:44:26.170413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.715 [2024-11-21 03:44:26.170455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:45.715 qpair failed and we were unable to recover it. 00:27:45.715 [2024-11-21 03:44:26.170601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.715 [2024-11-21 03:44:26.170753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.715 [2024-11-21 03:44:26.170778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:45.715 qpair failed and we were unable to recover it. 00:27:45.715 [2024-11-21 03:44:26.170908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.715 [2024-11-21 03:44:26.171006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.715 [2024-11-21 03:44:26.171031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.715 qpair failed and we were unable to recover it. 00:27:45.715 [2024-11-21 03:44:26.171152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.715 [2024-11-21 03:44:26.171293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.715 [2024-11-21 03:44:26.171323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.715 qpair failed and we were unable to recover it. 00:27:45.715 [2024-11-21 03:44:26.171441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.715 [2024-11-21 03:44:26.171574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.715 [2024-11-21 03:44:26.171598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.715 qpair failed and we were unable to recover it. 00:27:45.715 [2024-11-21 03:44:26.171750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.715 [2024-11-21 03:44:26.171882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.715 [2024-11-21 03:44:26.171911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.715 qpair failed and we were unable to recover it. 00:27:45.715 [2024-11-21 03:44:26.172064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.715 [2024-11-21 03:44:26.172169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.715 [2024-11-21 03:44:26.172213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.715 qpair failed and we were unable to recover it. 00:27:45.715 [2024-11-21 03:44:26.172377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.715 [2024-11-21 03:44:26.172520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.715 [2024-11-21 03:44:26.172548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.715 qpair failed and we were unable to recover it. 00:27:45.715 [2024-11-21 03:44:26.172684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.715 [2024-11-21 03:44:26.172805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.715 [2024-11-21 03:44:26.172833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.715 qpair failed and we were unable to recover it. 00:27:45.715 [2024-11-21 03:44:26.172962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.715 [2024-11-21 03:44:26.173076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.715 [2024-11-21 03:44:26.173104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.715 qpair failed and we were unable to recover it. 00:27:45.715 [2024-11-21 03:44:26.173222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.715 [2024-11-21 03:44:26.173368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.715 [2024-11-21 03:44:26.173395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.715 qpair failed and we were unable to recover it. 00:27:45.715 [2024-11-21 03:44:26.173569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.715 [2024-11-21 03:44:26.173679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.715 [2024-11-21 03:44:26.173707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.715 qpair failed and we were unable to recover it. 00:27:45.715 [2024-11-21 03:44:26.173879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.715 [2024-11-21 03:44:26.174030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.715 [2024-11-21 03:44:26.174059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.715 qpair failed and we were unable to recover it. 00:27:45.715 [2024-11-21 03:44:26.174223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.715 [2024-11-21 03:44:26.174376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.715 [2024-11-21 03:44:26.174400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.715 qpair failed and we were unable to recover it. 00:27:45.716 [2024-11-21 03:44:26.174524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.716 [2024-11-21 03:44:26.174705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.716 [2024-11-21 03:44:26.174757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.716 qpair failed and we were unable to recover it. 00:27:45.716 [2024-11-21 03:44:26.174876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.716 [2024-11-21 03:44:26.175006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.716 [2024-11-21 03:44:26.175034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.716 qpair failed and we were unable to recover it. 00:27:45.716 [2024-11-21 03:44:26.175175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.716 [2024-11-21 03:44:26.175300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.716 [2024-11-21 03:44:26.175328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.716 qpair failed and we were unable to recover it. 00:27:45.716 [2024-11-21 03:44:26.175506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.716 [2024-11-21 03:44:26.175677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.716 [2024-11-21 03:44:26.175704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.716 qpair failed and we were unable to recover it. 00:27:45.716 [2024-11-21 03:44:26.175811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.716 [2024-11-21 03:44:26.175927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.716 [2024-11-21 03:44:26.175954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.716 qpair failed and we were unable to recover it. 00:27:45.716 [2024-11-21 03:44:26.176135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.716 [2024-11-21 03:44:26.176260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.716 [2024-11-21 03:44:26.176285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.716 qpair failed and we were unable to recover it. 00:27:45.716 [2024-11-21 03:44:26.176407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.716 [2024-11-21 03:44:26.176585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.716 [2024-11-21 03:44:26.176613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.716 qpair failed and we were unable to recover it. 00:27:45.716 [2024-11-21 03:44:26.176728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.716 [2024-11-21 03:44:26.176843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.716 [2024-11-21 03:44:26.176871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.716 qpair failed and we were unable to recover it. 00:27:45.716 [2024-11-21 03:44:26.177015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.716 [2024-11-21 03:44:26.177165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.716 [2024-11-21 03:44:26.177195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.716 qpair failed and we were unable to recover it. 00:27:45.716 [2024-11-21 03:44:26.177318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.716 [2024-11-21 03:44:26.177411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.716 [2024-11-21 03:44:26.177437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.716 qpair failed and we were unable to recover it. 00:27:45.716 [2024-11-21 03:44:26.177568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.716 [2024-11-21 03:44:26.177684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.716 [2024-11-21 03:44:26.177712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.716 qpair failed and we were unable to recover it. 00:27:45.716 [2024-11-21 03:44:26.177888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.716 [2024-11-21 03:44:26.178031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.716 [2024-11-21 03:44:26.178059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.716 qpair failed and we were unable to recover it. 00:27:45.716 [2024-11-21 03:44:26.178217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.716 [2024-11-21 03:44:26.178353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.716 [2024-11-21 03:44:26.178380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.716 qpair failed and we were unable to recover it. 00:27:45.716 [2024-11-21 03:44:26.178499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.716 [2024-11-21 03:44:26.178617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.716 [2024-11-21 03:44:26.178645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.716 qpair failed and we were unable to recover it. 00:27:45.716 [2024-11-21 03:44:26.178788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.716 [2024-11-21 03:44:26.178900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.716 [2024-11-21 03:44:26.178928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.716 qpair failed and we were unable to recover it. 00:27:45.716 [2024-11-21 03:44:26.179081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.716 [2024-11-21 03:44:26.179241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.716 [2024-11-21 03:44:26.179267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.716 qpair failed and we were unable to recover it. 00:27:45.716 [2024-11-21 03:44:26.179450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.716 [2024-11-21 03:44:26.179590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.716 [2024-11-21 03:44:26.179620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.716 qpair failed and we were unable to recover it. 00:27:45.716 [2024-11-21 03:44:26.179734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.716 [2024-11-21 03:44:26.179898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.716 [2024-11-21 03:44:26.179926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.716 qpair failed and we were unable to recover it. 00:27:45.716 [2024-11-21 03:44:26.180082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.716 [2024-11-21 03:44:26.180188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.716 [2024-11-21 03:44:26.180213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.716 qpair failed and we were unable to recover it. 00:27:45.716 [2024-11-21 03:44:26.180320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.716 [2024-11-21 03:44:26.180475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.716 [2024-11-21 03:44:26.180503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.716 qpair failed and we were unable to recover it. 00:27:45.716 [2024-11-21 03:44:26.180637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.716 [2024-11-21 03:44:26.180806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.716 [2024-11-21 03:44:26.180834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.716 qpair failed and we were unable to recover it. 00:27:45.716 [2024-11-21 03:44:26.180944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.716 [2024-11-21 03:44:26.181048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.716 [2024-11-21 03:44:26.181080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.716 qpair failed and we were unable to recover it. 00:27:45.716 [2024-11-21 03:44:26.181180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.716 [2024-11-21 03:44:26.181291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.716 [2024-11-21 03:44:26.181316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.716 qpair failed and we were unable to recover it. 00:27:45.716 [2024-11-21 03:44:26.181449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.716 [2024-11-21 03:44:26.181574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.716 [2024-11-21 03:44:26.181615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.716 qpair failed and we were unable to recover it. 00:27:45.716 [2024-11-21 03:44:26.181756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.716 [2024-11-21 03:44:26.181897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.716 [2024-11-21 03:44:26.181926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.716 qpair failed and we were unable to recover it. 00:27:45.716 [2024-11-21 03:44:26.182041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.716 [2024-11-21 03:44:26.182232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.716 [2024-11-21 03:44:26.182259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.716 qpair failed and we were unable to recover it. 00:27:45.716 [2024-11-21 03:44:26.182405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.716 [2024-11-21 03:44:26.182515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.716 [2024-11-21 03:44:26.182543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.716 qpair failed and we were unable to recover it. 00:27:45.716 [2024-11-21 03:44:26.182666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.716 [2024-11-21 03:44:26.182800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.716 [2024-11-21 03:44:26.182825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.716 qpair failed and we were unable to recover it. 00:27:45.716 [2024-11-21 03:44:26.182952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.716 [2024-11-21 03:44:26.183085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.717 [2024-11-21 03:44:26.183114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.717 qpair failed and we were unable to recover it. 00:27:45.717 [2024-11-21 03:44:26.183242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.717 [2024-11-21 03:44:26.183390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.717 [2024-11-21 03:44:26.183418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.717 qpair failed and we were unable to recover it. 00:27:45.717 [2024-11-21 03:44:26.183560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.717 [2024-11-21 03:44:26.183680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.717 [2024-11-21 03:44:26.183705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.717 qpair failed and we were unable to recover it. 00:27:45.717 [2024-11-21 03:44:26.183824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.717 [2024-11-21 03:44:26.183940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.717 [2024-11-21 03:44:26.183967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.717 qpair failed and we were unable to recover it. 00:27:45.717 [2024-11-21 03:44:26.184091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.717 [2024-11-21 03:44:26.184205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.717 [2024-11-21 03:44:26.184234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.717 qpair failed and we were unable to recover it. 00:27:45.717 [2024-11-21 03:44:26.184360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.717 [2024-11-21 03:44:26.184462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.717 [2024-11-21 03:44:26.184488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.717 qpair failed and we were unable to recover it. 00:27:45.717 [2024-11-21 03:44:26.184593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.717 [2024-11-21 03:44:26.184745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.717 [2024-11-21 03:44:26.184771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.717 qpair failed and we were unable to recover it. 00:27:45.717 [2024-11-21 03:44:26.184887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.717 [2024-11-21 03:44:26.185026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.717 [2024-11-21 03:44:26.185054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.717 qpair failed and we were unable to recover it. 00:27:45.717 [2024-11-21 03:44:26.185199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.717 [2024-11-21 03:44:26.185307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.717 [2024-11-21 03:44:26.185332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.717 qpair failed and we were unable to recover it. 00:27:45.717 [2024-11-21 03:44:26.185475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.717 [2024-11-21 03:44:26.185629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.717 [2024-11-21 03:44:26.185654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.717 qpair failed and we were unable to recover it. 00:27:45.717 [2024-11-21 03:44:26.185753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.717 [2024-11-21 03:44:26.185858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.717 [2024-11-21 03:44:26.185883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.717 qpair failed and we were unable to recover it. 00:27:45.717 [2024-11-21 03:44:26.185991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.717 [2024-11-21 03:44:26.186095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.717 [2024-11-21 03:44:26.186121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.717 qpair failed and we were unable to recover it. 00:27:45.717 [2024-11-21 03:44:26.186257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.717 [2024-11-21 03:44:26.186395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.717 [2024-11-21 03:44:26.186423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.717 qpair failed and we were unable to recover it. 00:27:45.717 [2024-11-21 03:44:26.186555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.717 [2024-11-21 03:44:26.186726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.717 [2024-11-21 03:44:26.186754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.717 qpair failed and we were unable to recover it. 00:27:45.717 [2024-11-21 03:44:26.186903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.717 [2024-11-21 03:44:26.187025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.717 [2024-11-21 03:44:26.187050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.717 qpair failed and we were unable to recover it. 00:27:45.717 [2024-11-21 03:44:26.187190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.717 [2024-11-21 03:44:26.187295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.717 [2024-11-21 03:44:26.187324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.717 qpair failed and we were unable to recover it. 00:27:45.717 [2024-11-21 03:44:26.187463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.717 [2024-11-21 03:44:26.187596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.717 [2024-11-21 03:44:26.187625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.717 qpair failed and we were unable to recover it. 00:27:45.717 [2024-11-21 03:44:26.187774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.717 [2024-11-21 03:44:26.187877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.717 [2024-11-21 03:44:26.187902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.717 qpair failed and we were unable to recover it. 00:27:45.717 [2024-11-21 03:44:26.188009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.717 [2024-11-21 03:44:26.188113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.717 [2024-11-21 03:44:26.188156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.717 qpair failed and we were unable to recover it. 00:27:45.717 [2024-11-21 03:44:26.188302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.717 [2024-11-21 03:44:26.188444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.717 [2024-11-21 03:44:26.188473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.717 qpair failed and we were unable to recover it. 00:27:45.717 [2024-11-21 03:44:26.188629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.717 [2024-11-21 03:44:26.188736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.717 [2024-11-21 03:44:26.188761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.717 qpair failed and we were unable to recover it. 00:27:45.717 [2024-11-21 03:44:26.188864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.717 [2024-11-21 03:44:26.189018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.717 [2024-11-21 03:44:26.189046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.717 qpair failed and we were unable to recover it. 00:27:45.717 [2024-11-21 03:44:26.189192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.717 [2024-11-21 03:44:26.189295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.717 [2024-11-21 03:44:26.189320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.717 qpair failed and we were unable to recover it. 00:27:45.717 [2024-11-21 03:44:26.189453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.717 [2024-11-21 03:44:26.189578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.717 [2024-11-21 03:44:26.189604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.717 qpair failed and we were unable to recover it. 00:27:45.717 [2024-11-21 03:44:26.189757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.717 [2024-11-21 03:44:26.189902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.717 [2024-11-21 03:44:26.189927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.717 qpair failed and we were unable to recover it. 00:27:45.717 [2024-11-21 03:44:26.190036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.717 [2024-11-21 03:44:26.190163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.717 [2024-11-21 03:44:26.190188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.717 qpair failed and we were unable to recover it. 00:27:45.717 [2024-11-21 03:44:26.190309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.717 [2024-11-21 03:44:26.190411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.717 [2024-11-21 03:44:26.190436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.717 qpair failed and we were unable to recover it. 00:27:45.717 [2024-11-21 03:44:26.190530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.717 [2024-11-21 03:44:26.190648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.717 [2024-11-21 03:44:26.190673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.717 qpair failed and we were unable to recover it. 00:27:45.717 [2024-11-21 03:44:26.190769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.717 [2024-11-21 03:44:26.190915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.717 [2024-11-21 03:44:26.190943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.717 qpair failed and we were unable to recover it. 00:27:45.717 [2024-11-21 03:44:26.191090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.718 [2024-11-21 03:44:26.191193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.718 [2024-11-21 03:44:26.191219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.718 qpair failed and we were unable to recover it. 00:27:45.718 [2024-11-21 03:44:26.191319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.718 [2024-11-21 03:44:26.191449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.718 [2024-11-21 03:44:26.191474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.718 qpair failed and we were unable to recover it. 00:27:45.718 [2024-11-21 03:44:26.191572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.718 [2024-11-21 03:44:26.191739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.718 [2024-11-21 03:44:26.191769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.718 qpair failed and we were unable to recover it. 00:27:45.718 [2024-11-21 03:44:26.191902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.718 [2024-11-21 03:44:26.192026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.718 [2024-11-21 03:44:26.192051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.718 qpair failed and we were unable to recover it. 00:27:45.718 [2024-11-21 03:44:26.192191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.718 [2024-11-21 03:44:26.192315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.718 [2024-11-21 03:44:26.192357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.718 qpair failed and we were unable to recover it. 00:27:45.718 [2024-11-21 03:44:26.192457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.718 [2024-11-21 03:44:26.192589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.718 [2024-11-21 03:44:26.192615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.718 qpair failed and we were unable to recover it. 00:27:45.718 [2024-11-21 03:44:26.192748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.718 [2024-11-21 03:44:26.192877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.718 [2024-11-21 03:44:26.192901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.718 qpair failed and we were unable to recover it. 00:27:45.718 [2024-11-21 03:44:26.193082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.718 [2024-11-21 03:44:26.193196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.718 [2024-11-21 03:44:26.193224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.718 qpair failed and we were unable to recover it. 00:27:45.718 [2024-11-21 03:44:26.193360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.718 [2024-11-21 03:44:26.193470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.718 [2024-11-21 03:44:26.193512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.718 qpair failed and we were unable to recover it. 00:27:45.718 [2024-11-21 03:44:26.193612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.718 [2024-11-21 03:44:26.193711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.718 [2024-11-21 03:44:26.193736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.718 qpair failed and we were unable to recover it. 00:27:45.718 [2024-11-21 03:44:26.193861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.718 [2024-11-21 03:44:26.194017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.718 [2024-11-21 03:44:26.194045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.718 qpair failed and we were unable to recover it. 00:27:45.718 [2024-11-21 03:44:26.194214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.718 [2024-11-21 03:44:26.194395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.718 [2024-11-21 03:44:26.194441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:45.718 qpair failed and we were unable to recover it. 00:27:45.718 [2024-11-21 03:44:26.194572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.718 [2024-11-21 03:44:26.194678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.718 [2024-11-21 03:44:26.194709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:45.718 qpair failed and we were unable to recover it. 00:27:45.718 [2024-11-21 03:44:26.194825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.718 [2024-11-21 03:44:26.194957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.718 [2024-11-21 03:44:26.194985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:45.718 qpair failed and we were unable to recover it. 00:27:45.718 [2024-11-21 03:44:26.195092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.718 [2024-11-21 03:44:26.195217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.718 [2024-11-21 03:44:26.195243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:45.718 qpair failed and we were unable to recover it. 00:27:45.718 [2024-11-21 03:44:26.195373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.718 [2024-11-21 03:44:26.195476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.718 [2024-11-21 03:44:26.195504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:45.718 qpair failed and we were unable to recover it. 00:27:45.718 [2024-11-21 03:44:26.195616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.718 [2024-11-21 03:44:26.195726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.718 [2024-11-21 03:44:26.195753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:45.718 qpair failed and we were unable to recover it. 00:27:45.718 [2024-11-21 03:44:26.195900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.718 [2024-11-21 03:44:26.196053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.718 [2024-11-21 03:44:26.196085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.718 qpair failed and we were unable to recover it. 00:27:45.718 [2024-11-21 03:44:26.196191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.718 [2024-11-21 03:44:26.196316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.718 [2024-11-21 03:44:26.196341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.718 qpair failed and we were unable to recover it. 00:27:45.718 [2024-11-21 03:44:26.196511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.718 [2024-11-21 03:44:26.196620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.718 [2024-11-21 03:44:26.196648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.718 qpair failed and we were unable to recover it. 00:27:45.718 [2024-11-21 03:44:26.196792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.718 [2024-11-21 03:44:26.196915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.718 [2024-11-21 03:44:26.196943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.718 qpair failed and we were unable to recover it. 00:27:45.718 [2024-11-21 03:44:26.197104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.718 [2024-11-21 03:44:26.197256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.718 [2024-11-21 03:44:26.197281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.718 qpair failed and we were unable to recover it. 00:27:45.718 [2024-11-21 03:44:26.197381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.718 [2024-11-21 03:44:26.197527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.718 [2024-11-21 03:44:26.197555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.718 qpair failed and we were unable to recover it. 00:27:45.718 [2024-11-21 03:44:26.197699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.718 [2024-11-21 03:44:26.197797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.718 [2024-11-21 03:44:26.197823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.718 qpair failed and we were unable to recover it. 00:27:45.718 [2024-11-21 03:44:26.197948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.718 [2024-11-21 03:44:26.198055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.718 [2024-11-21 03:44:26.198090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.718 qpair failed and we were unable to recover it. 00:27:45.718 [2024-11-21 03:44:26.198216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.718 [2024-11-21 03:44:26.198317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.719 [2024-11-21 03:44:26.198341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.719 qpair failed and we were unable to recover it. 00:27:45.719 [2024-11-21 03:44:26.198475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.719 [2024-11-21 03:44:26.198591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.719 [2024-11-21 03:44:26.198619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.719 qpair failed and we were unable to recover it. 00:27:45.719 [2024-11-21 03:44:26.198773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.719 [2024-11-21 03:44:26.198892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.719 [2024-11-21 03:44:26.198918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.719 qpair failed and we were unable to recover it. 00:27:45.719 [2024-11-21 03:44:26.199081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.719 [2024-11-21 03:44:26.199202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.719 [2024-11-21 03:44:26.199227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.719 qpair failed and we were unable to recover it. 00:27:45.719 [2024-11-21 03:44:26.199330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.719 [2024-11-21 03:44:26.199477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.719 [2024-11-21 03:44:26.199504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.719 qpair failed and we were unable to recover it. 00:27:45.719 [2024-11-21 03:44:26.199621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.719 [2024-11-21 03:44:26.199720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.719 [2024-11-21 03:44:26.199745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.719 qpair failed and we were unable to recover it. 00:27:45.719 [2024-11-21 03:44:26.199863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.719 [2024-11-21 03:44:26.200035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.719 [2024-11-21 03:44:26.200063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.719 qpair failed and we were unable to recover it. 00:27:45.719 [2024-11-21 03:44:26.200217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.719 [2024-11-21 03:44:26.200310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.719 [2024-11-21 03:44:26.200336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.719 qpair failed and we were unable to recover it. 00:27:45.719 [2024-11-21 03:44:26.200469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.719 [2024-11-21 03:44:26.200601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.719 [2024-11-21 03:44:26.200625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.719 qpair failed and we were unable to recover it. 00:27:45.719 [2024-11-21 03:44:26.200756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.719 [2024-11-21 03:44:26.200909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.719 [2024-11-21 03:44:26.200935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.719 qpair failed and we were unable to recover it. 00:27:45.719 [2024-11-21 03:44:26.201079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.719 [2024-11-21 03:44:26.201183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.719 [2024-11-21 03:44:26.201208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.719 qpair failed and we were unable to recover it. 00:27:45.719 [2024-11-21 03:44:26.201315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.719 [2024-11-21 03:44:26.201410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.719 [2024-11-21 03:44:26.201435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.719 qpair failed and we were unable to recover it. 00:27:45.719 [2024-11-21 03:44:26.201586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.719 [2024-11-21 03:44:26.201731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.719 [2024-11-21 03:44:26.201756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.719 qpair failed and we were unable to recover it. 00:27:45.719 [2024-11-21 03:44:26.201933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.719 [2024-11-21 03:44:26.202094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.719 [2024-11-21 03:44:26.202120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.719 qpair failed and we were unable to recover it. 00:27:45.719 [2024-11-21 03:44:26.202218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.719 [2024-11-21 03:44:26.202318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.719 [2024-11-21 03:44:26.202343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.719 qpair failed and we were unable to recover it. 00:27:45.719 [2024-11-21 03:44:26.202449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.719 [2024-11-21 03:44:26.202574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.719 [2024-11-21 03:44:26.202600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.719 qpair failed and we were unable to recover it. 00:27:45.719 [2024-11-21 03:44:26.202727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.719 [2024-11-21 03:44:26.202857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.719 [2024-11-21 03:44:26.202882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.719 qpair failed and we were unable to recover it. 00:27:45.719 [2024-11-21 03:44:26.202977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.719 [2024-11-21 03:44:26.203076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.719 [2024-11-21 03:44:26.203102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.719 qpair failed and we were unable to recover it. 00:27:45.719 [2024-11-21 03:44:26.203204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.719 [2024-11-21 03:44:26.203329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.719 [2024-11-21 03:44:26.203371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.719 qpair failed and we were unable to recover it. 00:27:45.719 [2024-11-21 03:44:26.203479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.719 [2024-11-21 03:44:26.203617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.719 [2024-11-21 03:44:26.203644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.719 qpair failed and we were unable to recover it. 00:27:45.719 [2024-11-21 03:44:26.203762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.719 [2024-11-21 03:44:26.203917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.719 [2024-11-21 03:44:26.203942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.719 qpair failed and we were unable to recover it. 00:27:45.719 [2024-11-21 03:44:26.204051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.719 [2024-11-21 03:44:26.204183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.719 [2024-11-21 03:44:26.204209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.719 qpair failed and we were unable to recover it. 00:27:45.719 [2024-11-21 03:44:26.204338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.719 [2024-11-21 03:44:26.204439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.719 [2024-11-21 03:44:26.204464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.719 qpair failed and we were unable to recover it. 00:27:45.719 [2024-11-21 03:44:26.204569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.719 [2024-11-21 03:44:26.204694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.719 [2024-11-21 03:44:26.204720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.719 qpair failed and we were unable to recover it. 00:27:45.719 [2024-11-21 03:44:26.204897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.719 [2024-11-21 03:44:26.205012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.719 [2024-11-21 03:44:26.205040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.719 qpair failed and we were unable to recover it. 00:27:45.719 [2024-11-21 03:44:26.205223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.719 [2024-11-21 03:44:26.205325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.719 [2024-11-21 03:44:26.205350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.719 qpair failed and we were unable to recover it. 00:27:45.719 [2024-11-21 03:44:26.205476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.719 [2024-11-21 03:44:26.205605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.719 [2024-11-21 03:44:26.205630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.719 qpair failed and we were unable to recover it. 00:27:45.719 [2024-11-21 03:44:26.205728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.719 [2024-11-21 03:44:26.205825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.719 [2024-11-21 03:44:26.205850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.719 qpair failed and we were unable to recover it. 00:27:45.719 [2024-11-21 03:44:26.205986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.719 [2024-11-21 03:44:26.206092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.719 [2024-11-21 03:44:26.206118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.719 qpair failed and we were unable to recover it. 00:27:45.719 [2024-11-21 03:44:26.206212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.720 [2024-11-21 03:44:26.206316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.720 [2024-11-21 03:44:26.206341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.720 qpair failed and we were unable to recover it. 00:27:45.720 [2024-11-21 03:44:26.206495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.720 [2024-11-21 03:44:26.206616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.720 [2024-11-21 03:44:26.206644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.720 qpair failed and we were unable to recover it. 00:27:45.720 [2024-11-21 03:44:26.206796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.720 [2024-11-21 03:44:26.206917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.720 [2024-11-21 03:44:26.206942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.720 qpair failed and we were unable to recover it. 00:27:45.720 [2024-11-21 03:44:26.207042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.720 [2024-11-21 03:44:26.207167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.720 [2024-11-21 03:44:26.207193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.720 qpair failed and we were unable to recover it. 00:27:45.720 [2024-11-21 03:44:26.207343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.720 [2024-11-21 03:44:26.207486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.720 [2024-11-21 03:44:26.207512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.720 qpair failed and we were unable to recover it. 00:27:45.720 [2024-11-21 03:44:26.207660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.720 [2024-11-21 03:44:26.207799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.720 [2024-11-21 03:44:26.207827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.720 qpair failed and we were unable to recover it. 00:27:45.720 [2024-11-21 03:44:26.207945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.720 [2024-11-21 03:44:26.208080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.720 [2024-11-21 03:44:26.208107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.720 qpair failed and we were unable to recover it. 00:27:45.720 [2024-11-21 03:44:26.208199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.720 [2024-11-21 03:44:26.208312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.720 [2024-11-21 03:44:26.208337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.720 qpair failed and we were unable to recover it. 00:27:45.720 [2024-11-21 03:44:26.208461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.720 [2024-11-21 03:44:26.208599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.720 [2024-11-21 03:44:26.208627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.720 qpair failed and we were unable to recover it. 00:27:45.720 [2024-11-21 03:44:26.208775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.720 [2024-11-21 03:44:26.208872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.720 [2024-11-21 03:44:26.208901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.720 qpair failed and we were unable to recover it. 00:27:45.720 [2024-11-21 03:44:26.209035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.720 [2024-11-21 03:44:26.209181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.720 [2024-11-21 03:44:26.209206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.720 qpair failed and we were unable to recover it. 00:27:45.720 [2024-11-21 03:44:26.209338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.720 [2024-11-21 03:44:26.209484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.720 [2024-11-21 03:44:26.209512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.720 qpair failed and we were unable to recover it. 00:27:45.720 [2024-11-21 03:44:26.209660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.720 [2024-11-21 03:44:26.209765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.720 [2024-11-21 03:44:26.209790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.720 qpair failed and we were unable to recover it. 00:27:45.720 [2024-11-21 03:44:26.209930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.720 [2024-11-21 03:44:26.210036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.720 [2024-11-21 03:44:26.210064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.720 qpair failed and we were unable to recover it. 00:27:45.720 [2024-11-21 03:44:26.210241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.720 [2024-11-21 03:44:26.210341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.720 [2024-11-21 03:44:26.210366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.720 qpair failed and we were unable to recover it. 00:27:45.720 [2024-11-21 03:44:26.210474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.720 [2024-11-21 03:44:26.210597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.720 [2024-11-21 03:44:26.210622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.720 qpair failed and we were unable to recover it. 00:27:45.720 [2024-11-21 03:44:26.210718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.720 [2024-11-21 03:44:26.210871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.720 [2024-11-21 03:44:26.210899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.720 qpair failed and we were unable to recover it. 00:27:45.720 [2024-11-21 03:44:26.211012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.720 [2024-11-21 03:44:26.211133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.720 [2024-11-21 03:44:26.211159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.720 qpair failed and we were unable to recover it. 00:27:45.720 [2024-11-21 03:44:26.211282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.720 [2024-11-21 03:44:26.211400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.720 [2024-11-21 03:44:26.211425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.720 qpair failed and we were unable to recover it. 00:27:45.720 [2024-11-21 03:44:26.211549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.720 [2024-11-21 03:44:26.211642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.720 [2024-11-21 03:44:26.211667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.720 qpair failed and we were unable to recover it. 00:27:45.720 [2024-11-21 03:44:26.211798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.720 [2024-11-21 03:44:26.211893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.720 [2024-11-21 03:44:26.211920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.720 qpair failed and we were unable to recover it. 00:27:45.720 [2024-11-21 03:44:26.212025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.720 [2024-11-21 03:44:26.212147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.720 [2024-11-21 03:44:26.212173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.720 qpair failed and we were unable to recover it. 00:27:45.720 [2024-11-21 03:44:26.212294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.720 [2024-11-21 03:44:26.212396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.720 [2024-11-21 03:44:26.212422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.720 qpair failed and we were unable to recover it. 00:27:45.720 [2024-11-21 03:44:26.212545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.720 [2024-11-21 03:44:26.212665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.720 [2024-11-21 03:44:26.212694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.720 qpair failed and we were unable to recover it. 00:27:45.720 [2024-11-21 03:44:26.212854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.720 [2024-11-21 03:44:26.212982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.720 [2024-11-21 03:44:26.213007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.720 qpair failed and we were unable to recover it. 00:27:45.720 [2024-11-21 03:44:26.213176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.720 [2024-11-21 03:44:26.213333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.720 [2024-11-21 03:44:26.213358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.720 qpair failed and we were unable to recover it. 00:27:45.720 [2024-11-21 03:44:26.213479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.720 [2024-11-21 03:44:26.213658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.720 [2024-11-21 03:44:26.213683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.720 qpair failed and we were unable to recover it. 00:27:45.720 [2024-11-21 03:44:26.213796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.720 [2024-11-21 03:44:26.213920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.720 [2024-11-21 03:44:26.213945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.720 qpair failed and we were unable to recover it. 00:27:45.720 [2024-11-21 03:44:26.214054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.720 [2024-11-21 03:44:26.214218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.720 [2024-11-21 03:44:26.214244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.720 qpair failed and we were unable to recover it. 00:27:45.721 [2024-11-21 03:44:26.214360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.721 [2024-11-21 03:44:26.214517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.721 [2024-11-21 03:44:26.214543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.721 qpair failed and we were unable to recover it. 00:27:45.721 [2024-11-21 03:44:26.214646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.721 [2024-11-21 03:44:26.214777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.721 [2024-11-21 03:44:26.214802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.721 qpair failed and we were unable to recover it. 00:27:45.721 [2024-11-21 03:44:26.214921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.721 [2024-11-21 03:44:26.215056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.721 [2024-11-21 03:44:26.215095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.721 qpair failed and we were unable to recover it. 00:27:45.721 [2024-11-21 03:44:26.215216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.721 [2024-11-21 03:44:26.215345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.721 [2024-11-21 03:44:26.215370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.721 qpair failed and we were unable to recover it. 00:27:45.721 [2024-11-21 03:44:26.215507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.721 [2024-11-21 03:44:26.215600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.721 [2024-11-21 03:44:26.215625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.721 qpair failed and we were unable to recover it. 00:27:45.721 [2024-11-21 03:44:26.215774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.721 [2024-11-21 03:44:26.215884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.721 [2024-11-21 03:44:26.215911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.721 qpair failed and we were unable to recover it. 00:27:45.721 [2024-11-21 03:44:26.216046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.721 [2024-11-21 03:44:26.216234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.721 [2024-11-21 03:44:26.216266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.721 qpair failed and we were unable to recover it. 00:27:45.721 [2024-11-21 03:44:26.216385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.721 [2024-11-21 03:44:26.216513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.721 [2024-11-21 03:44:26.216539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.721 qpair failed and we were unable to recover it. 00:27:45.721 [2024-11-21 03:44:26.216670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.721 [2024-11-21 03:44:26.216846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.721 [2024-11-21 03:44:26.216872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.721 qpair failed and we were unable to recover it. 00:27:45.721 [2024-11-21 03:44:26.217002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.721 [2024-11-21 03:44:26.217115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.721 [2024-11-21 03:44:26.217158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.721 qpair failed and we were unable to recover it. 00:27:45.721 [2024-11-21 03:44:26.217291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.721 [2024-11-21 03:44:26.217381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.721 [2024-11-21 03:44:26.217406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.721 qpair failed and we were unable to recover it. 00:27:45.721 [2024-11-21 03:44:26.217541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.721 [2024-11-21 03:44:26.217711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.721 [2024-11-21 03:44:26.217737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.721 qpair failed and we were unable to recover it. 00:27:45.721 [2024-11-21 03:44:26.217841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.721 [2024-11-21 03:44:26.217933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.721 [2024-11-21 03:44:26.217959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.721 qpair failed and we were unable to recover it. 00:27:45.721 [2024-11-21 03:44:26.218050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.721 [2024-11-21 03:44:26.218194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.721 [2024-11-21 03:44:26.218220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.721 qpair failed and we were unable to recover it. 00:27:45.721 [2024-11-21 03:44:26.218322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.721 [2024-11-21 03:44:26.218451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.721 [2024-11-21 03:44:26.218476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.721 qpair failed and we were unable to recover it. 00:27:45.721 [2024-11-21 03:44:26.218609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.721 [2024-11-21 03:44:26.218729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.721 [2024-11-21 03:44:26.218756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.721 qpair failed and we were unable to recover it. 00:27:45.721 [2024-11-21 03:44:26.218910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.721 [2024-11-21 03:44:26.219011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.721 [2024-11-21 03:44:26.219036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.721 qpair failed and we were unable to recover it. 00:27:45.721 [2024-11-21 03:44:26.219196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.721 [2024-11-21 03:44:26.219323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.721 [2024-11-21 03:44:26.219348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.721 qpair failed and we were unable to recover it. 00:27:45.721 [2024-11-21 03:44:26.219495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.721 [2024-11-21 03:44:26.219612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.721 [2024-11-21 03:44:26.219642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.721 qpair failed and we were unable to recover it. 00:27:45.721 [2024-11-21 03:44:26.219776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.721 [2024-11-21 03:44:26.219872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.721 [2024-11-21 03:44:26.219897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.721 qpair failed and we were unable to recover it. 00:27:45.721 [2024-11-21 03:44:26.220031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.721 [2024-11-21 03:44:26.220180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.721 [2024-11-21 03:44:26.220209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.721 qpair failed and we were unable to recover it. 00:27:45.721 [2024-11-21 03:44:26.220344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.721 [2024-11-21 03:44:26.220457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.721 [2024-11-21 03:44:26.220485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.721 qpair failed and we were unable to recover it. 00:27:45.721 [2024-11-21 03:44:26.220598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.721 [2024-11-21 03:44:26.220714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.721 [2024-11-21 03:44:26.220738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.721 qpair failed and we were unable to recover it. 00:27:45.721 [2024-11-21 03:44:26.220887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.721 [2024-11-21 03:44:26.221065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.721 [2024-11-21 03:44:26.221103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.721 qpair failed and we were unable to recover it. 00:27:45.721 [2024-11-21 03:44:26.221243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.721 [2024-11-21 03:44:26.221352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.721 [2024-11-21 03:44:26.221379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.721 qpair failed and we were unable to recover it. 00:27:45.721 [2024-11-21 03:44:26.221507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.721 [2024-11-21 03:44:26.221613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.721 [2024-11-21 03:44:26.221638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.721 qpair failed and we were unable to recover it. 00:27:45.721 [2024-11-21 03:44:26.221745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.721 [2024-11-21 03:44:26.221918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.721 [2024-11-21 03:44:26.221946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.721 qpair failed and we were unable to recover it. 00:27:45.721 [2024-11-21 03:44:26.222098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.721 [2024-11-21 03:44:26.222230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.721 [2024-11-21 03:44:26.222255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.721 qpair failed and we were unable to recover it. 00:27:45.721 [2024-11-21 03:44:26.222362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.721 [2024-11-21 03:44:26.222466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.722 [2024-11-21 03:44:26.222491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.722 qpair failed and we were unable to recover it. 00:27:45.722 [2024-11-21 03:44:26.222614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.722 [2024-11-21 03:44:26.222756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.722 [2024-11-21 03:44:26.222784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.722 qpair failed and we were unable to recover it. 00:27:45.722 [2024-11-21 03:44:26.222895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.722 [2024-11-21 03:44:26.223015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.722 [2024-11-21 03:44:26.223043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.722 qpair failed and we were unable to recover it. 00:27:45.722 [2024-11-21 03:44:26.223188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.722 [2024-11-21 03:44:26.223351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.722 [2024-11-21 03:44:26.223395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.722 qpair failed and we were unable to recover it. 00:27:45.722 [2024-11-21 03:44:26.223550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.722 [2024-11-21 03:44:26.223677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.722 [2024-11-21 03:44:26.223702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.722 qpair failed and we were unable to recover it. 00:27:45.722 [2024-11-21 03:44:26.223828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.722 [2024-11-21 03:44:26.223970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.722 [2024-11-21 03:44:26.223998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.722 qpair failed and we were unable to recover it. 00:27:45.722 [2024-11-21 03:44:26.224151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.722 [2024-11-21 03:44:26.224254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.722 [2024-11-21 03:44:26.224279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.722 qpair failed and we were unable to recover it. 00:27:45.722 [2024-11-21 03:44:26.224406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.722 [2024-11-21 03:44:26.224546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.722 [2024-11-21 03:44:26.224587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.722 qpair failed and we were unable to recover it. 00:27:45.722 [2024-11-21 03:44:26.224715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.722 [2024-11-21 03:44:26.224876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.722 [2024-11-21 03:44:26.224904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.722 qpair failed and we were unable to recover it. 00:27:45.722 [2024-11-21 03:44:26.225055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.722 [2024-11-21 03:44:26.225204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.722 [2024-11-21 03:44:26.225230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.722 qpair failed and we were unable to recover it. 00:27:45.722 [2024-11-21 03:44:26.225356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.722 [2024-11-21 03:44:26.225491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.722 [2024-11-21 03:44:26.225519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.722 qpair failed and we were unable to recover it. 00:27:45.722 [2024-11-21 03:44:26.225661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.722 [2024-11-21 03:44:26.225788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.722 [2024-11-21 03:44:26.225813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.722 qpair failed and we were unable to recover it. 00:27:45.722 [2024-11-21 03:44:26.225934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.722 [2024-11-21 03:44:26.226049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.722 [2024-11-21 03:44:26.226125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.722 qpair failed and we were unable to recover it. 00:27:45.722 [2024-11-21 03:44:26.226234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.722 [2024-11-21 03:44:26.226332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.722 [2024-11-21 03:44:26.226361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.722 qpair failed and we were unable to recover it. 00:27:45.722 [2024-11-21 03:44:26.226462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.722 [2024-11-21 03:44:26.226649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.722 [2024-11-21 03:44:26.226678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.722 qpair failed and we were unable to recover it. 00:27:45.722 [2024-11-21 03:44:26.226826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.722 [2024-11-21 03:44:26.226957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.722 [2024-11-21 03:44:26.226982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.722 qpair failed and we were unable to recover it. 00:27:45.722 [2024-11-21 03:44:26.227081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.722 [2024-11-21 03:44:26.227215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.722 [2024-11-21 03:44:26.227240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.722 qpair failed and we were unable to recover it. 00:27:45.722 [2024-11-21 03:44:26.227348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.722 [2024-11-21 03:44:26.227455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.722 [2024-11-21 03:44:26.227479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.722 qpair failed and we were unable to recover it. 00:27:45.722 [2024-11-21 03:44:26.227577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.722 [2024-11-21 03:44:26.227671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.722 [2024-11-21 03:44:26.227696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.722 qpair failed and we were unable to recover it. 00:27:45.722 [2024-11-21 03:44:26.227828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.722 [2024-11-21 03:44:26.227981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.722 [2024-11-21 03:44:26.228009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.722 qpair failed and we were unable to recover it. 00:27:45.722 [2024-11-21 03:44:26.228150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.722 [2024-11-21 03:44:26.228265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.722 [2024-11-21 03:44:26.228292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.722 qpair failed and we were unable to recover it. 00:27:45.722 [2024-11-21 03:44:26.228471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.722 [2024-11-21 03:44:26.228575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.722 [2024-11-21 03:44:26.228600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.722 qpair failed and we were unable to recover it. 00:27:45.722 [2024-11-21 03:44:26.228698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.722 [2024-11-21 03:44:26.228799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.722 [2024-11-21 03:44:26.228824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.722 qpair failed and we were unable to recover it. 00:27:45.722 [2024-11-21 03:44:26.228973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.722 [2024-11-21 03:44:26.229124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.722 [2024-11-21 03:44:26.229163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.722 qpair failed and we were unable to recover it. 00:27:45.722 [2024-11-21 03:44:26.229280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.722 [2024-11-21 03:44:26.229444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.722 [2024-11-21 03:44:26.229469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.722 qpair failed and we were unable to recover it. 00:27:45.722 [2024-11-21 03:44:26.229592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.722 [2024-11-21 03:44:26.229717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.722 [2024-11-21 03:44:26.229745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.722 qpair failed and we were unable to recover it. 00:27:45.723 [2024-11-21 03:44:26.229881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.723 [2024-11-21 03:44:26.230046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.723 [2024-11-21 03:44:26.230083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.723 qpair failed and we were unable to recover it. 00:27:45.723 [2024-11-21 03:44:26.230238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.723 [2024-11-21 03:44:26.230333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.723 [2024-11-21 03:44:26.230358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.723 qpair failed and we were unable to recover it. 00:27:45.723 [2024-11-21 03:44:26.230472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.723 [2024-11-21 03:44:26.230614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.723 [2024-11-21 03:44:26.230656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.723 qpair failed and we were unable to recover it. 00:27:45.723 [2024-11-21 03:44:26.230812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.723 [2024-11-21 03:44:26.230961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.723 [2024-11-21 03:44:26.230989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.723 qpair failed and we were unable to recover it. 00:27:45.723 [2024-11-21 03:44:26.231154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.723 [2024-11-21 03:44:26.231264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.723 [2024-11-21 03:44:26.231287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.723 qpair failed and we were unable to recover it. 00:27:45.723 [2024-11-21 03:44:26.231447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.723 [2024-11-21 03:44:26.231556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.723 [2024-11-21 03:44:26.231584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.723 qpair failed and we were unable to recover it. 00:27:45.723 [2024-11-21 03:44:26.231718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.723 [2024-11-21 03:44:26.231829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.723 [2024-11-21 03:44:26.231857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.723 qpair failed and we were unable to recover it. 00:27:45.723 [2024-11-21 03:44:26.232006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.723 [2024-11-21 03:44:26.232136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.723 [2024-11-21 03:44:26.232162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.723 qpair failed and we were unable to recover it. 00:27:45.723 [2024-11-21 03:44:26.232353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.723 [2024-11-21 03:44:26.232466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.723 [2024-11-21 03:44:26.232494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.723 qpair failed and we were unable to recover it. 00:27:45.723 [2024-11-21 03:44:26.232625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.723 [2024-11-21 03:44:26.232776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.723 [2024-11-21 03:44:26.232804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.723 qpair failed and we were unable to recover it. 00:27:45.723 [2024-11-21 03:44:26.232955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.723 [2024-11-21 03:44:26.233066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.723 [2024-11-21 03:44:26.233102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.723 qpair failed and we were unable to recover it. 00:27:45.723 [2024-11-21 03:44:26.233218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.723 [2024-11-21 03:44:26.233326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.723 [2024-11-21 03:44:26.233367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.723 qpair failed and we were unable to recover it. 00:27:45.723 [2024-11-21 03:44:26.233505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.723 [2024-11-21 03:44:26.233630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.723 [2024-11-21 03:44:26.233655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.723 qpair failed and we were unable to recover it. 00:27:45.723 [2024-11-21 03:44:26.233787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.723 [2024-11-21 03:44:26.233885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.723 [2024-11-21 03:44:26.233911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.723 qpair failed and we were unable to recover it. 00:27:45.723 [2024-11-21 03:44:26.234086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.723 [2024-11-21 03:44:26.234269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.723 [2024-11-21 03:44:26.234294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.723 qpair failed and we were unable to recover it. 00:27:45.723 [2024-11-21 03:44:26.234393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.723 [2024-11-21 03:44:26.234571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.723 [2024-11-21 03:44:26.234596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.723 qpair failed and we were unable to recover it. 00:27:45.723 [2024-11-21 03:44:26.234701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.723 [2024-11-21 03:44:26.234798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.723 [2024-11-21 03:44:26.234824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.723 qpair failed and we were unable to recover it. 00:27:45.723 [2024-11-21 03:44:26.234970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.723 [2024-11-21 03:44:26.235114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.723 [2024-11-21 03:44:26.235144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.723 qpair failed and we were unable to recover it. 00:27:45.723 [2024-11-21 03:44:26.235261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.723 [2024-11-21 03:44:26.235379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.723 [2024-11-21 03:44:26.235421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.723 qpair failed and we were unable to recover it. 00:27:45.723 [2024-11-21 03:44:26.235517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.723 [2024-11-21 03:44:26.235674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.723 [2024-11-21 03:44:26.235701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.723 qpair failed and we were unable to recover it. 00:27:45.723 [2024-11-21 03:44:26.235837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.723 [2024-11-21 03:44:26.235956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.723 [2024-11-21 03:44:26.235992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.723 qpair failed and we were unable to recover it. 00:27:45.723 [2024-11-21 03:44:26.236111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.723 [2024-11-21 03:44:26.236227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.723 [2024-11-21 03:44:26.236255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.723 qpair failed and we were unable to recover it. 00:27:45.723 [2024-11-21 03:44:26.236385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.723 [2024-11-21 03:44:26.236482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.723 [2024-11-21 03:44:26.236508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.723 qpair failed and we were unable to recover it. 00:27:45.723 [2024-11-21 03:44:26.236619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.723 [2024-11-21 03:44:26.236796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.723 [2024-11-21 03:44:26.236824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.723 qpair failed and we were unable to recover it. 00:27:45.723 [2024-11-21 03:44:26.236960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.723 [2024-11-21 03:44:26.237130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.723 [2024-11-21 03:44:26.237158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.723 qpair failed and we were unable to recover it. 00:27:45.723 [2024-11-21 03:44:26.237316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.723 [2024-11-21 03:44:26.237456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.723 [2024-11-21 03:44:26.237496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.723 qpair failed and we were unable to recover it. 00:27:45.723 [2024-11-21 03:44:26.237637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.723 [2024-11-21 03:44:26.237803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.723 [2024-11-21 03:44:26.237830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.723 qpair failed and we were unable to recover it. 00:27:45.723 [2024-11-21 03:44:26.237945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.723 [2024-11-21 03:44:26.238065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.723 [2024-11-21 03:44:26.238098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.723 qpair failed and we were unable to recover it. 00:27:45.723 [2024-11-21 03:44:26.238203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.724 [2024-11-21 03:44:26.238356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.724 [2024-11-21 03:44:26.238381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.724 qpair failed and we were unable to recover it. 00:27:45.724 [2024-11-21 03:44:26.238510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.724 [2024-11-21 03:44:26.238689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.724 [2024-11-21 03:44:26.238715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.724 qpair failed and we were unable to recover it. 00:27:45.724 [2024-11-21 03:44:26.238824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.724 [2024-11-21 03:44:26.238970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.724 [2024-11-21 03:44:26.238997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.724 qpair failed and we were unable to recover it. 00:27:45.724 [2024-11-21 03:44:26.239121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.724 [2024-11-21 03:44:26.239223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.724 [2024-11-21 03:44:26.239248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.724 qpair failed and we were unable to recover it. 00:27:45.724 [2024-11-21 03:44:26.239373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.724 [2024-11-21 03:44:26.239513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.724 [2024-11-21 03:44:26.239541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.724 qpair failed and we were unable to recover it. 00:27:45.724 [2024-11-21 03:44:26.239680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.724 [2024-11-21 03:44:26.239796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.724 [2024-11-21 03:44:26.239823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.724 qpair failed and we were unable to recover it. 00:27:45.724 [2024-11-21 03:44:26.239965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.724 [2024-11-21 03:44:26.240093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.724 [2024-11-21 03:44:26.240122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.724 qpair failed and we were unable to recover it. 00:27:45.724 [2024-11-21 03:44:26.240237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.724 [2024-11-21 03:44:26.240372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.724 [2024-11-21 03:44:26.240400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.724 qpair failed and we were unable to recover it. 00:27:45.724 [2024-11-21 03:44:26.240537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.724 [2024-11-21 03:44:26.240655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.724 [2024-11-21 03:44:26.240683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.724 qpair failed and we were unable to recover it. 00:27:45.724 [2024-11-21 03:44:26.240810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.724 [2024-11-21 03:44:26.240910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.724 [2024-11-21 03:44:26.240936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.724 qpair failed and we were unable to recover it. 00:27:45.724 [2024-11-21 03:44:26.241050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.724 [2024-11-21 03:44:26.241172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.724 [2024-11-21 03:44:26.241208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.724 qpair failed and we were unable to recover it. 00:27:45.724 [2024-11-21 03:44:26.241344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.724 [2024-11-21 03:44:26.241490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.724 [2024-11-21 03:44:26.241516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.724 qpair failed and we were unable to recover it. 00:27:45.724 [2024-11-21 03:44:26.241631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.724 [2024-11-21 03:44:26.241784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.724 [2024-11-21 03:44:26.241808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.724 qpair failed and we were unable to recover it. 00:27:45.724 [2024-11-21 03:44:26.241960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.724 [2024-11-21 03:44:26.242091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.724 [2024-11-21 03:44:26.242122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.724 qpair failed and we were unable to recover it. 00:27:45.724 [2024-11-21 03:44:26.242286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.724 [2024-11-21 03:44:26.242424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.724 [2024-11-21 03:44:26.242449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.724 qpair failed and we were unable to recover it. 00:27:45.724 [2024-11-21 03:44:26.242543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.724 [2024-11-21 03:44:26.242696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.724 [2024-11-21 03:44:26.242721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.724 qpair failed and we were unable to recover it. 00:27:45.724 [2024-11-21 03:44:26.242868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.724 [2024-11-21 03:44:26.242988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.724 [2024-11-21 03:44:26.243015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.724 qpair failed and we were unable to recover it. 00:27:45.724 [2024-11-21 03:44:26.243152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.724 [2024-11-21 03:44:26.243256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.724 [2024-11-21 03:44:26.243281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.724 qpair failed and we were unable to recover it. 00:27:45.724 [2024-11-21 03:44:26.243405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.724 [2024-11-21 03:44:26.243513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.724 [2024-11-21 03:44:26.243537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.724 qpair failed and we were unable to recover it. 00:27:45.724 [2024-11-21 03:44:26.243667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.724 [2024-11-21 03:44:26.243816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.724 [2024-11-21 03:44:26.243840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.724 qpair failed and we were unable to recover it. 00:27:45.724 [2024-11-21 03:44:26.243974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.724 [2024-11-21 03:44:26.244136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.724 [2024-11-21 03:44:26.244162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.724 qpair failed and we were unable to recover it. 00:27:45.724 [2024-11-21 03:44:26.244275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.724 [2024-11-21 03:44:26.244405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.724 [2024-11-21 03:44:26.244429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.724 qpair failed and we were unable to recover it. 00:27:45.724 [2024-11-21 03:44:26.244592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.724 [2024-11-21 03:44:26.244697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.724 [2024-11-21 03:44:26.244722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.724 qpair failed and we were unable to recover it. 00:27:45.724 [2024-11-21 03:44:26.244840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.724 [2024-11-21 03:44:26.244987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.724 [2024-11-21 03:44:26.245013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.724 qpair failed and we were unable to recover it. 00:27:45.724 [2024-11-21 03:44:26.245144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.724 [2024-11-21 03:44:26.245275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.724 [2024-11-21 03:44:26.245301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.724 qpair failed and we were unable to recover it. 00:27:45.724 [2024-11-21 03:44:26.245403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.724 [2024-11-21 03:44:26.245537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.724 [2024-11-21 03:44:26.245561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.724 qpair failed and we were unable to recover it. 00:27:45.724 [2024-11-21 03:44:26.245709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.724 [2024-11-21 03:44:26.245836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.724 [2024-11-21 03:44:26.245876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.724 qpair failed and we were unable to recover it. 00:27:45.724 [2024-11-21 03:44:26.245974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.724 [2024-11-21 03:44:26.246105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.724 [2024-11-21 03:44:26.246131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.724 qpair failed and we were unable to recover it. 00:27:45.724 [2024-11-21 03:44:26.246319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.724 [2024-11-21 03:44:26.246448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.725 [2024-11-21 03:44:26.246472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.725 qpair failed and we were unable to recover it. 00:27:45.725 [2024-11-21 03:44:26.246630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.725 [2024-11-21 03:44:26.246751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.725 [2024-11-21 03:44:26.246778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.725 qpair failed and we were unable to recover it. 00:27:45.725 [2024-11-21 03:44:26.246928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.725 [2024-11-21 03:44:26.247033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.725 [2024-11-21 03:44:26.247058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.725 qpair failed and we were unable to recover it. 00:27:45.725 [2024-11-21 03:44:26.247199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.725 [2024-11-21 03:44:26.247312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.725 [2024-11-21 03:44:26.247340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.725 qpair failed and we were unable to recover it. 00:27:45.725 [2024-11-21 03:44:26.247458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.725 [2024-11-21 03:44:26.247568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.725 [2024-11-21 03:44:26.247595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.725 qpair failed and we were unable to recover it. 00:27:45.725 [2024-11-21 03:44:26.247786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.725 [2024-11-21 03:44:26.247916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.725 [2024-11-21 03:44:26.247942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.725 qpair failed and we were unable to recover it. 00:27:45.725 [2024-11-21 03:44:26.248104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.725 [2024-11-21 03:44:26.248222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.725 [2024-11-21 03:44:26.248250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.725 qpair failed and we were unable to recover it. 00:27:45.725 [2024-11-21 03:44:26.248369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.725 [2024-11-21 03:44:26.248508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.725 [2024-11-21 03:44:26.248535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.725 qpair failed and we were unable to recover it. 00:27:45.725 [2024-11-21 03:44:26.248664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.725 [2024-11-21 03:44:26.248785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.725 [2024-11-21 03:44:26.248810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.725 qpair failed and we were unable to recover it. 00:27:45.725 [2024-11-21 03:44:26.248924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.725 [2024-11-21 03:44:26.249101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.725 [2024-11-21 03:44:26.249129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.725 qpair failed and we were unable to recover it. 00:27:45.725 [2024-11-21 03:44:26.249271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.725 [2024-11-21 03:44:26.249387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.725 [2024-11-21 03:44:26.249417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.725 qpair failed and we were unable to recover it. 00:27:45.725 [2024-11-21 03:44:26.249600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.725 [2024-11-21 03:44:26.249707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.725 [2024-11-21 03:44:26.249733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.725 qpair failed and we were unable to recover it. 00:27:45.725 [2024-11-21 03:44:26.249895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.725 [2024-11-21 03:44:26.250034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.725 [2024-11-21 03:44:26.250061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.725 qpair failed and we were unable to recover it. 00:27:45.725 [2024-11-21 03:44:26.250204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.725 [2024-11-21 03:44:26.250317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.725 [2024-11-21 03:44:26.250345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.725 qpair failed and we were unable to recover it. 00:27:45.725 [2024-11-21 03:44:26.250472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.725 [2024-11-21 03:44:26.250604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.725 [2024-11-21 03:44:26.250628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.725 qpair failed and we were unable to recover it. 00:27:45.725 [2024-11-21 03:44:26.250808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.725 [2024-11-21 03:44:26.250917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.725 [2024-11-21 03:44:26.250945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.725 qpair failed and we were unable to recover it. 00:27:45.725 [2024-11-21 03:44:26.251061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.725 [2024-11-21 03:44:26.251226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.725 [2024-11-21 03:44:26.251254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.725 qpair failed and we were unable to recover it. 00:27:45.725 [2024-11-21 03:44:26.251405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.725 [2024-11-21 03:44:26.251508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.725 [2024-11-21 03:44:26.251534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.725 qpair failed and we were unable to recover it. 00:27:45.725 [2024-11-21 03:44:26.251660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.725 [2024-11-21 03:44:26.251772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.725 [2024-11-21 03:44:26.251796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.725 qpair failed and we were unable to recover it. 00:27:45.725 [2024-11-21 03:44:26.251938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.725 [2024-11-21 03:44:26.252049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.725 [2024-11-21 03:44:26.252091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.725 qpair failed and we were unable to recover it. 00:27:45.725 [2024-11-21 03:44:26.252219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.725 [2024-11-21 03:44:26.252329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.725 [2024-11-21 03:44:26.252354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.725 qpair failed and we were unable to recover it. 00:27:45.725 [2024-11-21 03:44:26.252461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.725 [2024-11-21 03:44:26.252586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.725 [2024-11-21 03:44:26.252611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.725 qpair failed and we were unable to recover it. 00:27:45.725 [2024-11-21 03:44:26.252758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.725 [2024-11-21 03:44:26.252876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.725 [2024-11-21 03:44:26.252903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.725 qpair failed and we were unable to recover it. 00:27:45.725 [2024-11-21 03:44:26.253079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.725 [2024-11-21 03:44:26.253208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.725 [2024-11-21 03:44:26.253234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.725 qpair failed and we were unable to recover it. 00:27:45.725 [2024-11-21 03:44:26.253340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.725 [2024-11-21 03:44:26.253465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.725 [2024-11-21 03:44:26.253494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.725 qpair failed and we were unable to recover it. 00:27:45.725 [2024-11-21 03:44:26.253601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.725 [2024-11-21 03:44:26.253714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.725 [2024-11-21 03:44:26.253741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.725 qpair failed and we were unable to recover it. 00:27:45.725 [2024-11-21 03:44:26.253900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.725 [2024-11-21 03:44:26.254024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.725 [2024-11-21 03:44:26.254048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.725 qpair failed and we were unable to recover it. 00:27:45.725 [2024-11-21 03:44:26.254188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.725 [2024-11-21 03:44:26.254307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.725 [2024-11-21 03:44:26.254336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.725 qpair failed and we were unable to recover it. 00:27:45.725 [2024-11-21 03:44:26.254447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.725 [2024-11-21 03:44:26.254599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.725 [2024-11-21 03:44:26.254624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.725 qpair failed and we were unable to recover it. 00:27:45.725 [2024-11-21 03:44:26.254728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.726 [2024-11-21 03:44:26.254834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.726 [2024-11-21 03:44:26.254859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.726 qpair failed and we were unable to recover it. 00:27:45.726 [2024-11-21 03:44:26.254998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.726 [2024-11-21 03:44:26.255134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.726 [2024-11-21 03:44:26.255161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.726 qpair failed and we were unable to recover it. 00:27:45.726 [2024-11-21 03:44:26.255268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.726 [2024-11-21 03:44:26.255390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.726 [2024-11-21 03:44:26.255430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.726 qpair failed and we were unable to recover it. 00:27:45.726 [2024-11-21 03:44:26.255562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.726 [2024-11-21 03:44:26.255662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.726 [2024-11-21 03:44:26.255687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.726 qpair failed and we were unable to recover it. 00:27:45.726 [2024-11-21 03:44:26.255829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.726 [2024-11-21 03:44:26.255966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.726 [2024-11-21 03:44:26.255997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.726 qpair failed and we were unable to recover it. 00:27:45.726 [2024-11-21 03:44:26.256105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.726 [2024-11-21 03:44:26.256239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.726 [2024-11-21 03:44:26.256263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.726 qpair failed and we were unable to recover it. 00:27:45.726 [2024-11-21 03:44:26.256382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.726 [2024-11-21 03:44:26.256509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.726 [2024-11-21 03:44:26.256534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.726 qpair failed and we were unable to recover it. 00:27:45.726 [2024-11-21 03:44:26.256662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.726 [2024-11-21 03:44:26.256795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.726 [2024-11-21 03:44:26.256836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.726 qpair failed and we were unable to recover it. 00:27:45.726 [2024-11-21 03:44:26.256937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.726 [2024-11-21 03:44:26.257037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.726 [2024-11-21 03:44:26.257061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.726 qpair failed and we were unable to recover it. 00:27:45.726 [2024-11-21 03:44:26.257199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.726 [2024-11-21 03:44:26.257308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.726 [2024-11-21 03:44:26.257332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.726 qpair failed and we were unable to recover it. 00:27:45.726 [2024-11-21 03:44:26.257465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.726 [2024-11-21 03:44:26.257615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.726 [2024-11-21 03:44:26.257639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.726 qpair failed and we were unable to recover it. 00:27:45.726 [2024-11-21 03:44:26.257761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.726 [2024-11-21 03:44:26.257856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.726 [2024-11-21 03:44:26.257880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.726 qpair failed and we were unable to recover it. 00:27:45.726 [2024-11-21 03:44:26.257979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.726 [2024-11-21 03:44:26.258106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.726 [2024-11-21 03:44:26.258131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.726 qpair failed and we were unable to recover it. 00:27:45.726 [2024-11-21 03:44:26.258283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.726 [2024-11-21 03:44:26.258427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.726 [2024-11-21 03:44:26.258451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.726 qpair failed and we were unable to recover it. 00:27:45.726 [2024-11-21 03:44:26.258596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.726 [2024-11-21 03:44:26.258736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.726 [2024-11-21 03:44:26.258762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.726 qpair failed and we were unable to recover it. 00:27:45.726 [2024-11-21 03:44:26.258881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.726 [2024-11-21 03:44:26.258978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.726 [2024-11-21 03:44:26.259003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.726 qpair failed and we were unable to recover it. 00:27:45.726 [2024-11-21 03:44:26.259116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.726 [2024-11-21 03:44:26.259211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.726 [2024-11-21 03:44:26.259235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.726 qpair failed and we were unable to recover it. 00:27:45.726 [2024-11-21 03:44:26.259337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.726 [2024-11-21 03:44:26.259521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.726 [2024-11-21 03:44:26.259547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.726 qpair failed and we were unable to recover it. 00:27:45.726 [2024-11-21 03:44:26.259689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.726 [2024-11-21 03:44:26.259794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.726 [2024-11-21 03:44:26.259819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.726 qpair failed and we were unable to recover it. 00:27:45.726 [2024-11-21 03:44:26.259922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.726 [2024-11-21 03:44:26.260039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.726 [2024-11-21 03:44:26.260066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.726 qpair failed and we were unable to recover it. 00:27:45.726 [2024-11-21 03:44:26.260253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.726 [2024-11-21 03:44:26.260377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.726 [2024-11-21 03:44:26.260401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.726 qpair failed and we were unable to recover it. 00:27:45.726 [2024-11-21 03:44:26.260532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.726 [2024-11-21 03:44:26.260624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.726 [2024-11-21 03:44:26.260649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.726 qpair failed and we were unable to recover it. 00:27:45.726 [2024-11-21 03:44:26.260796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.726 [2024-11-21 03:44:26.260931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.726 [2024-11-21 03:44:26.260956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.726 qpair failed and we were unable to recover it. 00:27:45.726 [2024-11-21 03:44:26.261091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.726 [2024-11-21 03:44:26.261203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.726 [2024-11-21 03:44:26.261227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.726 qpair failed and we were unable to recover it. 00:27:45.726 [2024-11-21 03:44:26.261331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.726 [2024-11-21 03:44:26.261436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.726 [2024-11-21 03:44:26.261460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.726 qpair failed and we were unable to recover it. 00:27:45.726 [2024-11-21 03:44:26.261595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.726 [2024-11-21 03:44:26.261745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.726 [2024-11-21 03:44:26.261771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.726 qpair failed and we were unable to recover it. 00:27:45.726 [2024-11-21 03:44:26.261875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.726 [2024-11-21 03:44:26.262002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.727 [2024-11-21 03:44:26.262027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.727 qpair failed and we were unable to recover it. 00:27:45.727 [2024-11-21 03:44:26.262191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.727 [2024-11-21 03:44:26.262371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.727 [2024-11-21 03:44:26.262397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.727 qpair failed and we were unable to recover it. 00:27:45.727 [2024-11-21 03:44:26.262547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.727 [2024-11-21 03:44:26.262652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.727 [2024-11-21 03:44:26.262679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.727 qpair failed and we were unable to recover it. 00:27:45.727 [2024-11-21 03:44:26.262801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.727 [2024-11-21 03:44:26.262955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.727 [2024-11-21 03:44:26.262981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.727 qpair failed and we were unable to recover it. 00:27:45.727 [2024-11-21 03:44:26.263085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.727 [2024-11-21 03:44:26.263183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.727 [2024-11-21 03:44:26.263208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.727 qpair failed and we were unable to recover it. 00:27:45.727 [2024-11-21 03:44:26.263310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.727 [2024-11-21 03:44:26.263449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.727 [2024-11-21 03:44:26.263475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.727 qpair failed and we were unable to recover it. 00:27:45.727 [2024-11-21 03:44:26.263636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.727 [2024-11-21 03:44:26.263759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.727 [2024-11-21 03:44:26.263784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.727 qpair failed and we were unable to recover it. 00:27:45.727 [2024-11-21 03:44:26.263906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.727 [2024-11-21 03:44:26.264036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.727 [2024-11-21 03:44:26.264061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.727 qpair failed and we were unable to recover it. 00:27:45.727 [2024-11-21 03:44:26.264223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.727 [2024-11-21 03:44:26.264329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.727 [2024-11-21 03:44:26.264353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.727 qpair failed and we were unable to recover it. 00:27:45.727 [2024-11-21 03:44:26.264456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.727 [2024-11-21 03:44:26.264590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.727 [2024-11-21 03:44:26.264614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.727 qpair failed and we were unable to recover it. 00:27:45.727 [2024-11-21 03:44:26.264710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.727 [2024-11-21 03:44:26.264842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.727 [2024-11-21 03:44:26.264866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.727 qpair failed and we were unable to recover it. 00:27:45.727 [2024-11-21 03:44:26.264993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.727 [2024-11-21 03:44:26.265147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.727 [2024-11-21 03:44:26.265171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.727 qpair failed and we were unable to recover it. 00:27:45.727 [2024-11-21 03:44:26.265276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.727 [2024-11-21 03:44:26.265403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.727 [2024-11-21 03:44:26.265427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.727 qpair failed and we were unable to recover it. 00:27:45.727 [2024-11-21 03:44:26.265591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.727 [2024-11-21 03:44:26.265688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.727 [2024-11-21 03:44:26.265712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.727 qpair failed and we were unable to recover it. 00:27:45.727 [2024-11-21 03:44:26.265846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.727 [2024-11-21 03:44:26.265944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.727 [2024-11-21 03:44:26.265969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.727 qpair failed and we were unable to recover it. 00:27:45.727 [2024-11-21 03:44:26.266099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.727 [2024-11-21 03:44:26.266224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.727 [2024-11-21 03:44:26.266250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.727 qpair failed and we were unable to recover it. 00:27:45.727 [2024-11-21 03:44:26.266381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.727 [2024-11-21 03:44:26.266489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.727 [2024-11-21 03:44:26.266515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.727 qpair failed and we were unable to recover it. 00:27:45.727 [2024-11-21 03:44:26.266650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.727 [2024-11-21 03:44:26.266751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.727 [2024-11-21 03:44:26.266776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.727 qpair failed and we were unable to recover it. 00:27:45.727 [2024-11-21 03:44:26.266905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.727 [2024-11-21 03:44:26.267028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.727 [2024-11-21 03:44:26.267053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.727 qpair failed and we were unable to recover it. 00:27:45.727 [2024-11-21 03:44:26.267173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.727 [2024-11-21 03:44:26.267283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.727 [2024-11-21 03:44:26.267309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.727 qpair failed and we were unable to recover it. 00:27:45.727 [2024-11-21 03:44:26.267446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.727 [2024-11-21 03:44:26.267584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.727 [2024-11-21 03:44:26.267609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.727 qpair failed and we were unable to recover it. 00:27:45.727 [2024-11-21 03:44:26.267709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.727 [2024-11-21 03:44:26.267862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.727 [2024-11-21 03:44:26.267888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.727 qpair failed and we were unable to recover it. 00:27:45.727 [2024-11-21 03:44:26.268017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.727 [2024-11-21 03:44:26.268150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.727 [2024-11-21 03:44:26.268175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.727 qpair failed and we were unable to recover it. 00:27:45.728 [2024-11-21 03:44:26.268278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.728 [2024-11-21 03:44:26.268373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.728 [2024-11-21 03:44:26.268397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.728 qpair failed and we were unable to recover it. 00:27:45.728 [2024-11-21 03:44:26.268492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.728 [2024-11-21 03:44:26.268594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.728 [2024-11-21 03:44:26.268619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.728 qpair failed and we were unable to recover it. 00:27:45.728 [2024-11-21 03:44:26.268723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.728 [2024-11-21 03:44:26.268820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.728 [2024-11-21 03:44:26.268845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.728 qpair failed and we were unable to recover it. 00:27:45.728 [2024-11-21 03:44:26.268949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.728 [2024-11-21 03:44:26.269052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.728 [2024-11-21 03:44:26.269086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.728 qpair failed and we were unable to recover it. 00:27:45.728 [2024-11-21 03:44:26.269191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.728 [2024-11-21 03:44:26.269343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.728 [2024-11-21 03:44:26.269368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.728 qpair failed and we were unable to recover it. 00:27:45.728 [2024-11-21 03:44:26.269522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.728 [2024-11-21 03:44:26.269621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.728 [2024-11-21 03:44:26.269645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.728 qpair failed and we were unable to recover it. 00:27:45.728 [2024-11-21 03:44:26.269746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.728 [2024-11-21 03:44:26.269845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.728 [2024-11-21 03:44:26.269874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.728 qpair failed and we were unable to recover it. 00:27:45.728 [2024-11-21 03:44:26.269980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.728 [2024-11-21 03:44:26.270085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.728 [2024-11-21 03:44:26.270119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.728 qpair failed and we were unable to recover it. 00:27:45.728 [2024-11-21 03:44:26.270217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.728 [2024-11-21 03:44:26.270314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.728 [2024-11-21 03:44:26.270338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.728 qpair failed and we were unable to recover it. 00:27:45.728 [2024-11-21 03:44:26.270473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.728 [2024-11-21 03:44:26.270576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.728 [2024-11-21 03:44:26.270601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.728 qpair failed and we were unable to recover it. 00:27:45.728 [2024-11-21 03:44:26.270755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.728 [2024-11-21 03:44:26.270853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.728 [2024-11-21 03:44:26.270878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.728 qpair failed and we were unable to recover it. 00:27:45.728 [2024-11-21 03:44:26.270989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.728 [2024-11-21 03:44:26.271115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.728 [2024-11-21 03:44:26.271140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.728 qpair failed and we were unable to recover it. 00:27:45.728 [2024-11-21 03:44:26.271252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.728 [2024-11-21 03:44:26.271388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.728 [2024-11-21 03:44:26.271413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.728 qpair failed and we were unable to recover it. 00:27:45.728 [2024-11-21 03:44:26.271546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.728 [2024-11-21 03:44:26.271670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.728 [2024-11-21 03:44:26.271695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.728 qpair failed and we were unable to recover it. 00:27:45.728 [2024-11-21 03:44:26.271848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.728 [2024-11-21 03:44:26.271998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.728 [2024-11-21 03:44:26.272022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.728 qpair failed and we were unable to recover it. 00:27:45.728 [2024-11-21 03:44:26.272138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.728 [2024-11-21 03:44:26.272232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.728 [2024-11-21 03:44:26.272257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.728 qpair failed and we were unable to recover it. 00:27:45.728 [2024-11-21 03:44:26.272408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.728 [2024-11-21 03:44:26.272511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.728 [2024-11-21 03:44:26.272536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.728 qpair failed and we were unable to recover it. 00:27:45.728 [2024-11-21 03:44:26.272639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.728 [2024-11-21 03:44:26.272769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.728 [2024-11-21 03:44:26.272794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.728 qpair failed and we were unable to recover it. 00:27:45.728 [2024-11-21 03:44:26.272896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.728 [2024-11-21 03:44:26.272992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.728 [2024-11-21 03:44:26.273018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.728 qpair failed and we were unable to recover it. 00:27:45.728 [2024-11-21 03:44:26.273120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.728 [2024-11-21 03:44:26.273224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.728 [2024-11-21 03:44:26.273250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.728 qpair failed and we were unable to recover it. 00:27:45.728 [2024-11-21 03:44:26.273352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.728 [2024-11-21 03:44:26.273479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.728 [2024-11-21 03:44:26.273504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.728 qpair failed and we were unable to recover it. 00:27:45.728 [2024-11-21 03:44:26.273605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.728 [2024-11-21 03:44:26.273756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.728 [2024-11-21 03:44:26.273781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.728 qpair failed and we were unable to recover it. 00:27:45.728 [2024-11-21 03:44:26.273892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.728 [2024-11-21 03:44:26.274019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.728 [2024-11-21 03:44:26.274044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.728 qpair failed and we were unable to recover it. 00:27:45.728 [2024-11-21 03:44:26.274215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.728 [2024-11-21 03:44:26.274347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.728 [2024-11-21 03:44:26.274372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.728 qpair failed and we were unable to recover it. 00:27:45.728 [2024-11-21 03:44:26.274483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.728 [2024-11-21 03:44:26.274591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.728 [2024-11-21 03:44:26.274616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.728 qpair failed and we were unable to recover it. 00:27:45.728 [2024-11-21 03:44:26.274722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.728 [2024-11-21 03:44:26.274831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.728 [2024-11-21 03:44:26.274857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.728 qpair failed and we were unable to recover it. 00:27:45.728 [2024-11-21 03:44:26.274980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.728 [2024-11-21 03:44:26.275114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.728 [2024-11-21 03:44:26.275140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.728 qpair failed and we were unable to recover it. 00:27:45.728 [2024-11-21 03:44:26.275252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.728 [2024-11-21 03:44:26.275376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.728 [2024-11-21 03:44:26.275401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.728 qpair failed and we were unable to recover it. 00:27:45.728 [2024-11-21 03:44:26.275498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.729 [2024-11-21 03:44:26.275602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.729 [2024-11-21 03:44:26.275628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.729 qpair failed and we were unable to recover it. 00:27:45.729 [2024-11-21 03:44:26.275732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.729 [2024-11-21 03:44:26.275857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.729 [2024-11-21 03:44:26.275882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.729 qpair failed and we were unable to recover it. 00:27:45.729 [2024-11-21 03:44:26.275983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.729 [2024-11-21 03:44:26.276080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.729 [2024-11-21 03:44:26.276106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.729 qpair failed and we were unable to recover it. 00:27:45.729 [2024-11-21 03:44:26.276239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.729 [2024-11-21 03:44:26.276365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.729 [2024-11-21 03:44:26.276391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.729 qpair failed and we were unable to recover it. 00:27:45.729 [2024-11-21 03:44:26.276491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.729 [2024-11-21 03:44:26.276617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.729 [2024-11-21 03:44:26.276643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.729 qpair failed and we were unable to recover it. 00:27:45.729 [2024-11-21 03:44:26.276773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.729 [2024-11-21 03:44:26.276874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.729 [2024-11-21 03:44:26.276899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.729 qpair failed and we were unable to recover it. 00:27:45.729 [2024-11-21 03:44:26.277007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.729 [2024-11-21 03:44:26.277134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.729 [2024-11-21 03:44:26.277160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.729 qpair failed and we were unable to recover it. 00:27:45.729 [2024-11-21 03:44:26.277255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.729 [2024-11-21 03:44:26.277359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.729 [2024-11-21 03:44:26.277384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.729 qpair failed and we were unable to recover it. 00:27:45.729 [2024-11-21 03:44:26.277516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.729 [2024-11-21 03:44:26.277675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.729 [2024-11-21 03:44:26.277699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.729 qpair failed and we were unable to recover it. 00:27:45.729 [2024-11-21 03:44:26.277811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.729 [2024-11-21 03:44:26.277930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.729 [2024-11-21 03:44:26.277955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.729 qpair failed and we were unable to recover it. 00:27:45.729 [2024-11-21 03:44:26.278085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.729 [2024-11-21 03:44:26.278187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.729 [2024-11-21 03:44:26.278212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.729 qpair failed and we were unable to recover it. 00:27:45.729 [2024-11-21 03:44:26.278314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.729 [2024-11-21 03:44:26.278415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.729 [2024-11-21 03:44:26.278440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.729 qpair failed and we were unable to recover it. 00:27:45.729 [2024-11-21 03:44:26.278574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.729 [2024-11-21 03:44:26.278694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.729 [2024-11-21 03:44:26.278719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.729 qpair failed and we were unable to recover it. 00:27:45.729 [2024-11-21 03:44:26.278814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.729 [2024-11-21 03:44:26.278911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.729 [2024-11-21 03:44:26.278936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.729 qpair failed and we were unable to recover it. 00:27:45.729 [2024-11-21 03:44:26.279033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.729 [2024-11-21 03:44:26.279167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.729 [2024-11-21 03:44:26.279193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.729 qpair failed and we were unable to recover it. 00:27:45.729 [2024-11-21 03:44:26.279347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.729 [2024-11-21 03:44:26.279455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.729 [2024-11-21 03:44:26.279480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.729 qpair failed and we were unable to recover it. 00:27:45.729 [2024-11-21 03:44:26.279611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.729 [2024-11-21 03:44:26.279723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.729 [2024-11-21 03:44:26.279748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.729 qpair failed and we were unable to recover it. 00:27:45.729 [2024-11-21 03:44:26.279889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.729 [2024-11-21 03:44:26.280014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.729 [2024-11-21 03:44:26.280039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.729 qpair failed and we were unable to recover it. 00:27:45.729 [2024-11-21 03:44:26.280151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.729 [2024-11-21 03:44:26.280250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.729 [2024-11-21 03:44:26.280275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.729 qpair failed and we were unable to recover it. 00:27:45.729 [2024-11-21 03:44:26.280375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.729 [2024-11-21 03:44:26.280478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.729 [2024-11-21 03:44:26.280503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.729 qpair failed and we were unable to recover it. 00:27:45.729 [2024-11-21 03:44:26.280635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.729 [2024-11-21 03:44:26.280741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.729 [2024-11-21 03:44:26.280766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.729 qpair failed and we were unable to recover it. 00:27:45.729 [2024-11-21 03:44:26.280869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.729 [2024-11-21 03:44:26.280998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.729 [2024-11-21 03:44:26.281023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.729 qpair failed and we were unable to recover it. 00:27:45.729 [2024-11-21 03:44:26.281122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.729 [2024-11-21 03:44:26.281234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.729 [2024-11-21 03:44:26.281259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.729 qpair failed and we were unable to recover it. 00:27:45.729 [2024-11-21 03:44:26.281361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.729 [2024-11-21 03:44:26.281491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.729 [2024-11-21 03:44:26.281516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.729 qpair failed and we were unable to recover it. 00:27:45.729 [2024-11-21 03:44:26.281612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.729 [2024-11-21 03:44:26.281737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.729 [2024-11-21 03:44:26.281762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.729 qpair failed and we were unable to recover it. 00:27:45.729 [2024-11-21 03:44:26.281864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.729 [2024-11-21 03:44:26.281993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.729 [2024-11-21 03:44:26.282018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.729 qpair failed and we were unable to recover it. 00:27:45.729 [2024-11-21 03:44:26.282128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.729 [2024-11-21 03:44:26.282226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.729 [2024-11-21 03:44:26.282252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.729 qpair failed and we were unable to recover it. 00:27:45.729 [2024-11-21 03:44:26.282376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.729 [2024-11-21 03:44:26.282478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.729 [2024-11-21 03:44:26.282503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.729 qpair failed and we were unable to recover it. 00:27:45.729 [2024-11-21 03:44:26.282631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.729 [2024-11-21 03:44:26.282740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.729 [2024-11-21 03:44:26.282765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.730 qpair failed and we were unable to recover it. 00:27:45.730 [2024-11-21 03:44:26.282873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.730 [2024-11-21 03:44:26.282997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.730 [2024-11-21 03:44:26.283028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.730 qpair failed and we were unable to recover it. 00:27:45.730 [2024-11-21 03:44:26.283173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.730 [2024-11-21 03:44:26.283332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.730 [2024-11-21 03:44:26.283357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.730 qpair failed and we were unable to recover it. 00:27:45.730 [2024-11-21 03:44:26.283487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.730 [2024-11-21 03:44:26.283587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.730 [2024-11-21 03:44:26.283610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.730 qpair failed and we were unable to recover it. 00:27:45.730 [2024-11-21 03:44:26.283713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.730 [2024-11-21 03:44:26.283812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.730 [2024-11-21 03:44:26.283837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.730 qpair failed and we were unable to recover it. 00:27:45.730 [2024-11-21 03:44:26.283962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.730 [2024-11-21 03:44:26.284093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.730 [2024-11-21 03:44:26.284119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.730 qpair failed and we were unable to recover it. 00:27:45.730 [2024-11-21 03:44:26.284218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.730 [2024-11-21 03:44:26.284317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.730 [2024-11-21 03:44:26.284342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.730 qpair failed and we were unable to recover it. 00:27:45.730 [2024-11-21 03:44:26.284508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.730 [2024-11-21 03:44:26.284631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.730 [2024-11-21 03:44:26.284656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.730 qpair failed and we were unable to recover it. 00:27:45.730 [2024-11-21 03:44:26.284762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.730 [2024-11-21 03:44:26.284889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.730 [2024-11-21 03:44:26.284916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.730 qpair failed and we were unable to recover it. 00:27:45.730 [2024-11-21 03:44:26.285021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.730 [2024-11-21 03:44:26.285121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.730 [2024-11-21 03:44:26.285147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.730 qpair failed and we were unable to recover it. 00:27:45.730 [2024-11-21 03:44:26.285252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.730 [2024-11-21 03:44:26.285408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.730 [2024-11-21 03:44:26.285433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.730 qpair failed and we were unable to recover it. 00:27:45.730 [2024-11-21 03:44:26.285538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.730 [2024-11-21 03:44:26.285637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.730 [2024-11-21 03:44:26.285668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.730 qpair failed and we were unable to recover it. 00:27:45.730 [2024-11-21 03:44:26.285772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.730 [2024-11-21 03:44:26.285899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.730 [2024-11-21 03:44:26.285924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.730 qpair failed and we were unable to recover it. 00:27:45.730 [2024-11-21 03:44:26.286084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.730 [2024-11-21 03:44:26.286218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.730 [2024-11-21 03:44:26.286244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.730 qpair failed and we were unable to recover it. 00:27:45.730 [2024-11-21 03:44:26.286379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.730 [2024-11-21 03:44:26.286481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.730 [2024-11-21 03:44:26.286505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.730 qpair failed and we were unable to recover it. 00:27:45.730 [2024-11-21 03:44:26.286632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.730 [2024-11-21 03:44:26.286730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.730 [2024-11-21 03:44:26.286754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.730 qpair failed and we were unable to recover it. 00:27:45.730 [2024-11-21 03:44:26.286851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.730 [2024-11-21 03:44:26.286942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.730 [2024-11-21 03:44:26.286968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.730 qpair failed and we were unable to recover it. 00:27:45.730 [2024-11-21 03:44:26.287095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.730 [2024-11-21 03:44:26.287226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.730 [2024-11-21 03:44:26.287250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.730 qpair failed and we were unable to recover it. 00:27:45.730 [2024-11-21 03:44:26.287343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.730 [2024-11-21 03:44:26.287441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.730 [2024-11-21 03:44:26.287466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.730 qpair failed and we were unable to recover it. 00:27:45.730 [2024-11-21 03:44:26.287573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.730 [2024-11-21 03:44:26.287671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.730 [2024-11-21 03:44:26.287696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.730 qpair failed and we were unable to recover it. 00:27:45.730 [2024-11-21 03:44:26.287788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.730 [2024-11-21 03:44:26.287916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.730 [2024-11-21 03:44:26.287941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.730 qpair failed and we were unable to recover it. 00:27:45.730 [2024-11-21 03:44:26.288056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.730 [2024-11-21 03:44:26.288172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.730 [2024-11-21 03:44:26.288197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.730 qpair failed and we were unable to recover it. 00:27:45.730 [2024-11-21 03:44:26.288313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.730 [2024-11-21 03:44:26.288416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.730 [2024-11-21 03:44:26.288440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.730 qpair failed and we were unable to recover it. 00:27:45.730 [2024-11-21 03:44:26.288578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.730 [2024-11-21 03:44:26.288706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.730 [2024-11-21 03:44:26.288731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.730 qpair failed and we were unable to recover it. 00:27:45.730 [2024-11-21 03:44:26.288832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.730 [2024-11-21 03:44:26.288960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.730 [2024-11-21 03:44:26.288985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.730 qpair failed and we were unable to recover it. 00:27:45.730 [2024-11-21 03:44:26.289148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.730 [2024-11-21 03:44:26.289245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.730 [2024-11-21 03:44:26.289271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.730 qpair failed and we were unable to recover it. 00:27:45.730 [2024-11-21 03:44:26.289372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.730 [2024-11-21 03:44:26.289474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.730 [2024-11-21 03:44:26.289499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.730 qpair failed and we were unable to recover it. 00:27:45.730 [2024-11-21 03:44:26.289604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.730 [2024-11-21 03:44:26.289735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.730 [2024-11-21 03:44:26.289760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.730 qpair failed and we were unable to recover it. 00:27:45.730 [2024-11-21 03:44:26.289875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.730 [2024-11-21 03:44:26.289975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.730 [2024-11-21 03:44:26.290000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.730 qpair failed and we were unable to recover it. 00:27:45.730 [2024-11-21 03:44:26.290109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.730 [2024-11-21 03:44:26.290234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.731 [2024-11-21 03:44:26.290258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.731 qpair failed and we were unable to recover it. 00:27:45.731 [2024-11-21 03:44:26.290363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.731 [2024-11-21 03:44:26.290459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.731 [2024-11-21 03:44:26.290484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.731 qpair failed and we were unable to recover it. 00:27:45.731 [2024-11-21 03:44:26.290592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.731 [2024-11-21 03:44:26.290718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.731 [2024-11-21 03:44:26.290742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.731 qpair failed and we were unable to recover it. 00:27:45.731 [2024-11-21 03:44:26.290849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.731 [2024-11-21 03:44:26.290952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.731 [2024-11-21 03:44:26.290977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.731 qpair failed and we were unable to recover it. 00:27:45.731 [2024-11-21 03:44:26.291085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.731 [2024-11-21 03:44:26.291218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.731 [2024-11-21 03:44:26.291242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.731 qpair failed and we were unable to recover it. 00:27:45.731 [2024-11-21 03:44:26.291401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.731 [2024-11-21 03:44:26.291529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.731 [2024-11-21 03:44:26.291554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.731 qpair failed and we were unable to recover it. 00:27:45.731 [2024-11-21 03:44:26.291690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.731 [2024-11-21 03:44:26.291821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.731 [2024-11-21 03:44:26.291846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.731 qpair failed and we were unable to recover it. 00:27:45.731 [2024-11-21 03:44:26.291974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.731 [2024-11-21 03:44:26.292078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.731 [2024-11-21 03:44:26.292104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.731 qpair failed and we were unable to recover it. 00:27:45.731 [2024-11-21 03:44:26.292236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.731 [2024-11-21 03:44:26.292342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.731 [2024-11-21 03:44:26.292367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.731 qpair failed and we were unable to recover it. 00:27:45.731 [2024-11-21 03:44:26.292474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.731 [2024-11-21 03:44:26.292580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.731 [2024-11-21 03:44:26.292605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.731 qpair failed and we were unable to recover it. 00:27:45.731 [2024-11-21 03:44:26.292709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.731 [2024-11-21 03:44:26.292817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.731 [2024-11-21 03:44:26.292841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.731 qpair failed and we were unable to recover it. 00:27:45.731 [2024-11-21 03:44:26.292971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.731 [2024-11-21 03:44:26.293099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.731 [2024-11-21 03:44:26.293125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.731 qpair failed and we were unable to recover it. 00:27:45.731 [2024-11-21 03:44:26.293234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.731 [2024-11-21 03:44:26.293333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.731 [2024-11-21 03:44:26.293358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.731 qpair failed and we were unable to recover it. 00:27:45.731 [2024-11-21 03:44:26.293456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.731 [2024-11-21 03:44:26.293555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.731 [2024-11-21 03:44:26.293579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.731 qpair failed and we were unable to recover it. 00:27:45.731 [2024-11-21 03:44:26.293718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.731 [2024-11-21 03:44:26.293872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.731 [2024-11-21 03:44:26.293897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.731 qpair failed and we were unable to recover it. 00:27:45.731 [2024-11-21 03:44:26.293999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.731 [2024-11-21 03:44:26.294130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.731 [2024-11-21 03:44:26.294156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.731 qpair failed and we were unable to recover it. 00:27:45.731 [2024-11-21 03:44:26.294291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.731 [2024-11-21 03:44:26.294418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.731 [2024-11-21 03:44:26.294443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.731 qpair failed and we were unable to recover it. 00:27:45.731 [2024-11-21 03:44:26.294576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.731 [2024-11-21 03:44:26.294677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.731 [2024-11-21 03:44:26.294702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.731 qpair failed and we were unable to recover it. 00:27:45.731 [2024-11-21 03:44:26.294834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.731 [2024-11-21 03:44:26.294958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.731 [2024-11-21 03:44:26.294982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.731 qpair failed and we were unable to recover it. 00:27:45.731 [2024-11-21 03:44:26.295090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.731 [2024-11-21 03:44:26.295208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.731 [2024-11-21 03:44:26.295234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.731 qpair failed and we were unable to recover it. 00:27:45.731 [2024-11-21 03:44:26.295333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.731 [2024-11-21 03:44:26.295450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.731 [2024-11-21 03:44:26.295475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.731 qpair failed and we were unable to recover it. 00:27:45.731 [2024-11-21 03:44:26.295575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.731 [2024-11-21 03:44:26.295705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.731 [2024-11-21 03:44:26.295730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.731 qpair failed and we were unable to recover it. 00:27:45.731 [2024-11-21 03:44:26.295862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.731 [2024-11-21 03:44:26.295960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.731 [2024-11-21 03:44:26.295985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.731 qpair failed and we were unable to recover it. 00:27:45.731 [2024-11-21 03:44:26.296115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.731 [2024-11-21 03:44:26.296242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.731 [2024-11-21 03:44:26.296267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.731 qpair failed and we were unable to recover it. 00:27:45.731 [2024-11-21 03:44:26.296390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.731 [2024-11-21 03:44:26.296489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.731 [2024-11-21 03:44:26.296514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.731 qpair failed and we were unable to recover it. 00:27:45.731 [2024-11-21 03:44:26.296664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.731 [2024-11-21 03:44:26.296759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.731 [2024-11-21 03:44:26.296783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.731 qpair failed and we were unable to recover it. 00:27:45.731 [2024-11-21 03:44:26.296920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.731 [2024-11-21 03:44:26.297047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.731 [2024-11-21 03:44:26.297080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.731 qpair failed and we were unable to recover it. 00:27:45.731 [2024-11-21 03:44:26.297179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.731 [2024-11-21 03:44:26.297281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.731 [2024-11-21 03:44:26.297308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.731 qpair failed and we were unable to recover it. 00:27:45.731 [2024-11-21 03:44:26.297440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.731 [2024-11-21 03:44:26.297538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.731 [2024-11-21 03:44:26.297562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.731 qpair failed and we were unable to recover it. 00:27:45.732 [2024-11-21 03:44:26.297688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.732 [2024-11-21 03:44:26.297792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.732 [2024-11-21 03:44:26.297816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.732 qpair failed and we were unable to recover it. 00:27:45.732 [2024-11-21 03:44:26.297947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.732 [2024-11-21 03:44:26.298102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.732 [2024-11-21 03:44:26.298128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.732 qpair failed and we were unable to recover it. 00:27:45.732 [2024-11-21 03:44:26.298259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.732 [2024-11-21 03:44:26.298396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.732 [2024-11-21 03:44:26.298421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.732 qpair failed and we were unable to recover it. 00:27:45.732 [2024-11-21 03:44:26.298529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.732 [2024-11-21 03:44:26.298657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.732 [2024-11-21 03:44:26.298681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.732 qpair failed and we were unable to recover it. 00:27:45.732 [2024-11-21 03:44:26.298784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.732 [2024-11-21 03:44:26.298907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.732 [2024-11-21 03:44:26.298935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.732 qpair failed and we were unable to recover it. 00:27:45.732 [2024-11-21 03:44:26.299031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.732 [2024-11-21 03:44:26.299169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.732 [2024-11-21 03:44:26.299194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.732 qpair failed and we were unable to recover it. 00:27:45.732 [2024-11-21 03:44:26.299304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.732 [2024-11-21 03:44:26.299432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.732 [2024-11-21 03:44:26.299456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.732 qpair failed and we were unable to recover it. 00:27:45.732 [2024-11-21 03:44:26.299582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.732 [2024-11-21 03:44:26.299679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.732 [2024-11-21 03:44:26.299703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.732 qpair failed and we were unable to recover it. 00:27:45.732 [2024-11-21 03:44:26.299832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.732 [2024-11-21 03:44:26.299957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.732 [2024-11-21 03:44:26.299981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.732 qpair failed and we were unable to recover it. 00:27:45.732 [2024-11-21 03:44:26.300084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.732 [2024-11-21 03:44:26.300183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.732 [2024-11-21 03:44:26.300207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.732 qpair failed and we were unable to recover it. 00:27:45.732 [2024-11-21 03:44:26.300307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.732 [2024-11-21 03:44:26.300434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.732 [2024-11-21 03:44:26.300458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.732 qpair failed and we were unable to recover it. 00:27:45.732 [2024-11-21 03:44:26.300552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.732 [2024-11-21 03:44:26.300675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.732 [2024-11-21 03:44:26.300699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.732 qpair failed and we were unable to recover it. 00:27:45.732 [2024-11-21 03:44:26.300858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.732 [2024-11-21 03:44:26.300981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.732 [2024-11-21 03:44:26.301006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.732 qpair failed and we were unable to recover it. 00:27:45.732 [2024-11-21 03:44:26.301115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.732 [2024-11-21 03:44:26.301245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.732 [2024-11-21 03:44:26.301270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.732 qpair failed and we were unable to recover it. 00:27:45.732 [2024-11-21 03:44:26.301400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.732 [2024-11-21 03:44:26.301551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.732 [2024-11-21 03:44:26.301575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.732 qpair failed and we were unable to recover it. 00:27:45.732 [2024-11-21 03:44:26.301708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.732 [2024-11-21 03:44:26.301804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.732 [2024-11-21 03:44:26.301829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.732 qpair failed and we were unable to recover it. 00:27:45.732 [2024-11-21 03:44:26.301964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.732 [2024-11-21 03:44:26.302067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.732 [2024-11-21 03:44:26.302099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.732 qpair failed and we were unable to recover it. 00:27:45.732 [2024-11-21 03:44:26.302204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.732 [2024-11-21 03:44:26.302336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.732 [2024-11-21 03:44:26.302360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.732 qpair failed and we were unable to recover it. 00:27:45.732 [2024-11-21 03:44:26.302493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.732 [2024-11-21 03:44:26.302620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.732 [2024-11-21 03:44:26.302645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.732 qpair failed and we were unable to recover it. 00:27:45.732 [2024-11-21 03:44:26.302747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.732 [2024-11-21 03:44:26.302848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.732 [2024-11-21 03:44:26.302873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.732 qpair failed and we were unable to recover it. 00:27:45.732 [2024-11-21 03:44:26.303004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.732 [2024-11-21 03:44:26.303127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.732 [2024-11-21 03:44:26.303153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.732 qpair failed and we were unable to recover it. 00:27:45.732 [2024-11-21 03:44:26.303283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.732 [2024-11-21 03:44:26.303420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.732 [2024-11-21 03:44:26.303446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.732 qpair failed and we were unable to recover it. 00:27:45.732 [2024-11-21 03:44:26.303541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.732 [2024-11-21 03:44:26.303663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.732 [2024-11-21 03:44:26.303688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.732 qpair failed and we were unable to recover it. 00:27:45.732 [2024-11-21 03:44:26.303783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.732 [2024-11-21 03:44:26.303939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.732 [2024-11-21 03:44:26.303965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.732 qpair failed and we were unable to recover it. 00:27:45.732 [2024-11-21 03:44:26.304095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.732 [2024-11-21 03:44:26.304199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.732 [2024-11-21 03:44:26.304224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.732 qpair failed and we were unable to recover it. 00:27:45.732 [2024-11-21 03:44:26.304364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.733 [2024-11-21 03:44:26.304499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.733 [2024-11-21 03:44:26.304524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.733 qpair failed and we were unable to recover it. 00:27:45.733 [2024-11-21 03:44:26.304632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.733 [2024-11-21 03:44:26.304765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.733 [2024-11-21 03:44:26.304791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.733 qpair failed and we were unable to recover it. 00:27:45.733 [2024-11-21 03:44:26.304896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.733 [2024-11-21 03:44:26.305016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.733 [2024-11-21 03:44:26.305041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.733 qpair failed and we were unable to recover it. 00:27:45.733 [2024-11-21 03:44:26.305158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.733 [2024-11-21 03:44:26.305283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.733 [2024-11-21 03:44:26.305308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.733 qpair failed and we were unable to recover it. 00:27:45.733 [2024-11-21 03:44:26.305432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.733 [2024-11-21 03:44:26.305536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.733 [2024-11-21 03:44:26.305560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.733 qpair failed and we were unable to recover it. 00:27:45.733 [2024-11-21 03:44:26.305690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.733 [2024-11-21 03:44:26.305858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.733 [2024-11-21 03:44:26.305882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.733 qpair failed and we were unable to recover it. 00:27:45.733 [2024-11-21 03:44:26.305987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.733 [2024-11-21 03:44:26.306103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.733 [2024-11-21 03:44:26.306130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.733 qpair failed and we were unable to recover it. 00:27:45.733 [2024-11-21 03:44:26.306231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.733 [2024-11-21 03:44:26.306384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.733 [2024-11-21 03:44:26.306409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.733 qpair failed and we were unable to recover it. 00:27:45.733 [2024-11-21 03:44:26.306537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.733 [2024-11-21 03:44:26.306662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.733 [2024-11-21 03:44:26.306687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.733 qpair failed and we were unable to recover it. 00:27:45.733 [2024-11-21 03:44:26.306787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.733 [2024-11-21 03:44:26.306887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.733 [2024-11-21 03:44:26.306911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.733 qpair failed and we were unable to recover it. 00:27:45.733 [2024-11-21 03:44:26.307063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.733 [2024-11-21 03:44:26.307202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.733 [2024-11-21 03:44:26.307227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.733 qpair failed and we were unable to recover it. 00:27:45.733 [2024-11-21 03:44:26.307353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.733 [2024-11-21 03:44:26.307450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.733 [2024-11-21 03:44:26.307475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.733 qpair failed and we were unable to recover it. 00:27:45.733 [2024-11-21 03:44:26.307602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.733 [2024-11-21 03:44:26.307725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.733 [2024-11-21 03:44:26.307750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.733 qpair failed and we were unable to recover it. 00:27:45.733 [2024-11-21 03:44:26.307853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.733 [2024-11-21 03:44:26.307952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.733 [2024-11-21 03:44:26.307977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.733 qpair failed and we were unable to recover it. 00:27:45.733 [2024-11-21 03:44:26.308101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.733 [2024-11-21 03:44:26.308229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.733 [2024-11-21 03:44:26.308255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.733 qpair failed and we were unable to recover it. 00:27:45.733 [2024-11-21 03:44:26.308385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.733 [2024-11-21 03:44:26.308534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.733 [2024-11-21 03:44:26.308559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.733 qpair failed and we were unable to recover it. 00:27:45.733 [2024-11-21 03:44:26.308654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.733 [2024-11-21 03:44:26.308782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.733 [2024-11-21 03:44:26.308807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.733 qpair failed and we were unable to recover it. 00:27:45.733 [2024-11-21 03:44:26.308969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.733 [2024-11-21 03:44:26.309101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.733 [2024-11-21 03:44:26.309126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.733 qpair failed and we were unable to recover it. 00:27:45.733 [2024-11-21 03:44:26.309235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.733 [2024-11-21 03:44:26.309333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.733 [2024-11-21 03:44:26.309358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.733 qpair failed and we were unable to recover it. 00:27:45.733 [2024-11-21 03:44:26.309460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.733 [2024-11-21 03:44:26.309585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.733 [2024-11-21 03:44:26.309610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.733 qpair failed and we were unable to recover it. 00:27:45.733 [2024-11-21 03:44:26.309711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.733 [2024-11-21 03:44:26.309841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.733 [2024-11-21 03:44:26.309865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.733 qpair failed and we were unable to recover it. 00:27:45.733 [2024-11-21 03:44:26.309985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.733 [2024-11-21 03:44:26.310087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.733 [2024-11-21 03:44:26.310113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.733 qpair failed and we were unable to recover it. 00:27:45.733 [2024-11-21 03:44:26.310216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.733 [2024-11-21 03:44:26.310316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.733 [2024-11-21 03:44:26.310341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.733 qpair failed and we were unable to recover it. 00:27:45.733 [2024-11-21 03:44:26.310439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.733 [2024-11-21 03:44:26.310595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.733 [2024-11-21 03:44:26.310620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.733 qpair failed and we were unable to recover it. 00:27:45.733 [2024-11-21 03:44:26.310747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.733 [2024-11-21 03:44:26.310904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.733 [2024-11-21 03:44:26.310928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.733 qpair failed and we were unable to recover it. 00:27:45.733 [2024-11-21 03:44:26.311082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.733 [2024-11-21 03:44:26.311184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.733 [2024-11-21 03:44:26.311211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.733 qpair failed and we were unable to recover it. 00:27:45.733 [2024-11-21 03:44:26.311368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.733 [2024-11-21 03:44:26.311508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.733 [2024-11-21 03:44:26.311532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.733 qpair failed and we were unable to recover it. 00:27:45.733 [2024-11-21 03:44:26.311659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.733 [2024-11-21 03:44:26.311760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.733 [2024-11-21 03:44:26.311785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.733 qpair failed and we were unable to recover it. 00:27:45.733 [2024-11-21 03:44:26.311911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.733 [2024-11-21 03:44:26.312014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.733 [2024-11-21 03:44:26.312039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.733 qpair failed and we were unable to recover it. 00:27:45.734 [2024-11-21 03:44:26.312178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.734 [2024-11-21 03:44:26.312272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.734 [2024-11-21 03:44:26.312298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.734 qpair failed and we were unable to recover it. 00:27:45.734 [2024-11-21 03:44:26.312424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.734 [2024-11-21 03:44:26.312515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.734 [2024-11-21 03:44:26.312544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.734 qpair failed and we were unable to recover it. 00:27:45.734 [2024-11-21 03:44:26.312704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.734 [2024-11-21 03:44:26.312835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.734 [2024-11-21 03:44:26.312861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.734 qpair failed and we were unable to recover it. 00:27:45.734 [2024-11-21 03:44:26.312990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.734 [2024-11-21 03:44:26.313094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.734 [2024-11-21 03:44:26.313120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.734 qpair failed and we were unable to recover it. 00:27:45.734 [2024-11-21 03:44:26.313230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.734 [2024-11-21 03:44:26.313358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.734 [2024-11-21 03:44:26.313383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.734 qpair failed and we were unable to recover it. 00:27:45.734 [2024-11-21 03:44:26.313490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.734 [2024-11-21 03:44:26.313599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.734 [2024-11-21 03:44:26.313624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.734 qpair failed and we were unable to recover it. 00:27:45.734 [2024-11-21 03:44:26.313756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.734 [2024-11-21 03:44:26.313851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.734 [2024-11-21 03:44:26.313876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.734 qpair failed and we were unable to recover it. 00:27:45.734 [2024-11-21 03:44:26.313979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.734 [2024-11-21 03:44:26.314118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.734 [2024-11-21 03:44:26.314144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.734 qpair failed and we were unable to recover it. 00:27:45.734 [2024-11-21 03:44:26.314245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.734 [2024-11-21 03:44:26.314348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.734 [2024-11-21 03:44:26.314373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.734 qpair failed and we were unable to recover it. 00:27:45.734 [2024-11-21 03:44:26.314485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.734 [2024-11-21 03:44:26.314592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.734 [2024-11-21 03:44:26.314617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.734 qpair failed and we were unable to recover it. 00:27:45.734 [2024-11-21 03:44:26.314719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.734 [2024-11-21 03:44:26.314847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.734 [2024-11-21 03:44:26.314872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.734 qpair failed and we were unable to recover it. 00:27:45.734 [2024-11-21 03:44:26.315002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.734 [2024-11-21 03:44:26.315134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.734 [2024-11-21 03:44:26.315159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.734 qpair failed and we were unable to recover it. 00:27:45.734 [2024-11-21 03:44:26.315297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.734 [2024-11-21 03:44:26.315392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.734 [2024-11-21 03:44:26.315418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.734 qpair failed and we were unable to recover it. 00:27:45.734 [2024-11-21 03:44:26.315521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.734 [2024-11-21 03:44:26.315645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.734 [2024-11-21 03:44:26.315670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.734 qpair failed and we were unable to recover it. 00:27:45.734 [2024-11-21 03:44:26.315805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.734 [2024-11-21 03:44:26.315959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.734 [2024-11-21 03:44:26.315984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.734 qpair failed and we were unable to recover it. 00:27:45.734 [2024-11-21 03:44:26.316090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.734 [2024-11-21 03:44:26.316222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.734 [2024-11-21 03:44:26.316248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.734 qpair failed and we were unable to recover it. 00:27:45.734 [2024-11-21 03:44:26.316357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.734 [2024-11-21 03:44:26.316483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.734 [2024-11-21 03:44:26.316508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.734 qpair failed and we were unable to recover it. 00:27:45.734 [2024-11-21 03:44:26.316631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.734 [2024-11-21 03:44:26.316759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.734 [2024-11-21 03:44:26.316784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.734 qpair failed and we were unable to recover it. 00:27:45.734 [2024-11-21 03:44:26.316941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.734 [2024-11-21 03:44:26.317076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.734 [2024-11-21 03:44:26.317103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.734 qpair failed and we were unable to recover it. 00:27:45.734 [2024-11-21 03:44:26.317207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.734 [2024-11-21 03:44:26.317340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.734 [2024-11-21 03:44:26.317365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.734 qpair failed and we were unable to recover it. 00:27:45.734 [2024-11-21 03:44:26.317462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.734 [2024-11-21 03:44:26.317586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.734 [2024-11-21 03:44:26.317611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.734 qpair failed and we were unable to recover it. 00:27:45.734 [2024-11-21 03:44:26.317707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.734 [2024-11-21 03:44:26.317826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.734 [2024-11-21 03:44:26.317851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.734 qpair failed and we were unable to recover it. 00:27:45.734 [2024-11-21 03:44:26.317982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.734 [2024-11-21 03:44:26.318099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.734 [2024-11-21 03:44:26.318126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.734 qpair failed and we were unable to recover it. 00:27:45.734 [2024-11-21 03:44:26.318230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.734 [2024-11-21 03:44:26.318362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.734 [2024-11-21 03:44:26.318387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.734 qpair failed and we were unable to recover it. 00:27:45.734 [2024-11-21 03:44:26.318494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.734 [2024-11-21 03:44:26.318648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.734 [2024-11-21 03:44:26.318673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.734 qpair failed and we were unable to recover it. 00:27:45.734 [2024-11-21 03:44:26.318776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.734 [2024-11-21 03:44:26.318876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.734 [2024-11-21 03:44:26.318901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.734 qpair failed and we were unable to recover it. 00:27:45.734 [2024-11-21 03:44:26.319003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.734 [2024-11-21 03:44:26.319108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.734 [2024-11-21 03:44:26.319134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.734 qpair failed and we were unable to recover it. 00:27:45.734 [2024-11-21 03:44:26.319241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.734 [2024-11-21 03:44:26.319370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.734 [2024-11-21 03:44:26.319395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.734 qpair failed and we were unable to recover it. 00:27:45.734 [2024-11-21 03:44:26.319522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.734 [2024-11-21 03:44:26.319613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.735 [2024-11-21 03:44:26.319638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.735 qpair failed and we were unable to recover it. 00:27:45.735 [2024-11-21 03:44:26.319739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.735 [2024-11-21 03:44:26.319872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.735 [2024-11-21 03:44:26.319897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.735 qpair failed and we were unable to recover it. 00:27:45.735 [2024-11-21 03:44:26.320029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.735 [2024-11-21 03:44:26.320166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.735 [2024-11-21 03:44:26.320191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.735 qpair failed and we were unable to recover it. 00:27:45.735 [2024-11-21 03:44:26.320297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.735 [2024-11-21 03:44:26.320421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.735 [2024-11-21 03:44:26.320445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.735 qpair failed and we were unable to recover it. 00:27:45.735 [2024-11-21 03:44:26.320555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.735 [2024-11-21 03:44:26.320680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.735 [2024-11-21 03:44:26.320704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.735 qpair failed and we were unable to recover it. 00:27:45.735 [2024-11-21 03:44:26.320808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.735 [2024-11-21 03:44:26.320933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.735 [2024-11-21 03:44:26.320958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.735 qpair failed and we were unable to recover it. 00:27:45.735 [2024-11-21 03:44:26.321093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.735 [2024-11-21 03:44:26.321202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.735 [2024-11-21 03:44:26.321227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.735 qpair failed and we were unable to recover it. 00:27:45.735 [2024-11-21 03:44:26.321331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.735 [2024-11-21 03:44:26.321447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.735 [2024-11-21 03:44:26.321471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.735 qpair failed and we were unable to recover it. 00:27:45.735 [2024-11-21 03:44:26.321575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.735 [2024-11-21 03:44:26.321703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.735 [2024-11-21 03:44:26.321728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.735 qpair failed and we were unable to recover it. 00:27:45.735 [2024-11-21 03:44:26.321858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.735 [2024-11-21 03:44:26.321986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.735 [2024-11-21 03:44:26.322011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.735 qpair failed and we were unable to recover it. 00:27:45.735 [2024-11-21 03:44:26.322139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.735 [2024-11-21 03:44:26.322246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.735 [2024-11-21 03:44:26.322271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.735 qpair failed and we were unable to recover it. 00:27:45.735 [2024-11-21 03:44:26.322395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.735 [2024-11-21 03:44:26.322517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.735 [2024-11-21 03:44:26.322542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.735 qpair failed and we were unable to recover it. 00:27:45.735 [2024-11-21 03:44:26.322647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.735 [2024-11-21 03:44:26.322744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.735 [2024-11-21 03:44:26.322771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.735 qpair failed and we were unable to recover it. 00:27:45.735 [2024-11-21 03:44:26.322901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.735 [2024-11-21 03:44:26.322995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.735 [2024-11-21 03:44:26.323021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.735 qpair failed and we were unable to recover it. 00:27:45.735 [2024-11-21 03:44:26.323157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.735 [2024-11-21 03:44:26.323271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.735 [2024-11-21 03:44:26.323297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.735 qpair failed and we were unable to recover it. 00:27:45.735 [2024-11-21 03:44:26.323450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.735 [2024-11-21 03:44:26.323540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.735 [2024-11-21 03:44:26.323565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.735 qpair failed and we were unable to recover it. 00:27:45.735 [2024-11-21 03:44:26.323668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.735 [2024-11-21 03:44:26.323821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.735 [2024-11-21 03:44:26.323846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.735 qpair failed and we were unable to recover it. 00:27:45.735 [2024-11-21 03:44:26.323937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.735 [2024-11-21 03:44:26.324091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.735 [2024-11-21 03:44:26.324117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.735 qpair failed and we were unable to recover it. 00:27:45.735 [2024-11-21 03:44:26.324250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.735 [2024-11-21 03:44:26.324381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.735 [2024-11-21 03:44:26.324406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.735 qpair failed and we were unable to recover it. 00:27:45.735 [2024-11-21 03:44:26.324536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.735 [2024-11-21 03:44:26.324660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.735 [2024-11-21 03:44:26.324686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.735 qpair failed and we were unable to recover it. 00:27:45.735 [2024-11-21 03:44:26.324792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.735 [2024-11-21 03:44:26.324921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.735 [2024-11-21 03:44:26.324948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.735 qpair failed and we were unable to recover it. 00:27:45.735 [2024-11-21 03:44:26.325045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.735 [2024-11-21 03:44:26.325206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.735 [2024-11-21 03:44:26.325233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:45.735 qpair failed and we were unable to recover it. 00:27:45.735 [2024-11-21 03:44:26.325365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.735 [2024-11-21 03:44:26.325521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.028 [2024-11-21 03:44:26.325547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.028 qpair failed and we were unable to recover it. 00:27:46.028 [2024-11-21 03:44:26.325648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.028 [2024-11-21 03:44:26.325755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.028 [2024-11-21 03:44:26.325781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.028 qpair failed and we were unable to recover it. 00:27:46.028 [2024-11-21 03:44:26.325886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.028 [2024-11-21 03:44:26.326012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.028 [2024-11-21 03:44:26.326043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.028 qpair failed and we were unable to recover it. 00:27:46.028 [2024-11-21 03:44:26.326157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.028 [2024-11-21 03:44:26.326289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.028 [2024-11-21 03:44:26.326315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.028 qpair failed and we were unable to recover it. 00:27:46.028 [2024-11-21 03:44:26.326455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.028 [2024-11-21 03:44:26.326583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.028 [2024-11-21 03:44:26.326608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.028 qpair failed and we were unable to recover it. 00:27:46.028 [2024-11-21 03:44:26.326734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.028 [2024-11-21 03:44:26.326868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.028 [2024-11-21 03:44:26.326893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.028 qpair failed and we were unable to recover it. 00:27:46.028 [2024-11-21 03:44:26.327019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.028 [2024-11-21 03:44:26.327126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.028 [2024-11-21 03:44:26.327153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.028 qpair failed and we were unable to recover it. 00:27:46.028 [2024-11-21 03:44:26.327318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.028 [2024-11-21 03:44:26.327418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.028 [2024-11-21 03:44:26.327444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.028 qpair failed and we were unable to recover it. 00:27:46.028 [2024-11-21 03:44:26.327574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.028 [2024-11-21 03:44:26.327749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.028 [2024-11-21 03:44:26.327778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.028 qpair failed and we were unable to recover it. 00:27:46.028 [2024-11-21 03:44:26.327898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.028 [2024-11-21 03:44:26.328026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.028 [2024-11-21 03:44:26.328051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.028 qpair failed and we were unable to recover it. 00:27:46.028 [2024-11-21 03:44:26.328221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.028 [2024-11-21 03:44:26.328330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.028 [2024-11-21 03:44:26.328356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.028 qpair failed and we were unable to recover it. 00:27:46.028 [2024-11-21 03:44:26.328459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.028 [2024-11-21 03:44:26.328609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.028 [2024-11-21 03:44:26.328635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.028 qpair failed and we were unable to recover it. 00:27:46.029 [2024-11-21 03:44:26.328766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.029 [2024-11-21 03:44:26.328893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.029 [2024-11-21 03:44:26.328924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.029 qpair failed and we were unable to recover it. 00:27:46.029 [2024-11-21 03:44:26.329084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.029 [2024-11-21 03:44:26.329193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.029 [2024-11-21 03:44:26.329219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.029 qpair failed and we were unable to recover it. 00:27:46.029 [2024-11-21 03:44:26.329323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.029 [2024-11-21 03:44:26.329442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.029 [2024-11-21 03:44:26.329467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.029 qpair failed and we were unable to recover it. 00:27:46.029 [2024-11-21 03:44:26.329594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.029 [2024-11-21 03:44:26.329717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.029 [2024-11-21 03:44:26.329743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.029 qpair failed and we were unable to recover it. 00:27:46.029 [2024-11-21 03:44:26.329847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.029 [2024-11-21 03:44:26.329947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.029 [2024-11-21 03:44:26.329973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.029 qpair failed and we were unable to recover it. 00:27:46.029 [2024-11-21 03:44:26.330081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.029 [2024-11-21 03:44:26.330176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.029 [2024-11-21 03:44:26.330202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.029 qpair failed and we were unable to recover it. 00:27:46.029 [2024-11-21 03:44:26.330332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.029 [2024-11-21 03:44:26.330461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.029 [2024-11-21 03:44:26.330487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.029 qpair failed and we were unable to recover it. 00:27:46.029 [2024-11-21 03:44:26.330618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.029 [2024-11-21 03:44:26.330755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.029 [2024-11-21 03:44:26.330780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.029 qpair failed and we were unable to recover it. 00:27:46.029 [2024-11-21 03:44:26.330927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.029 [2024-11-21 03:44:26.331077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.029 [2024-11-21 03:44:26.331108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.029 qpair failed and we were unable to recover it. 00:27:46.029 [2024-11-21 03:44:26.331232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.029 [2024-11-21 03:44:26.331342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.029 [2024-11-21 03:44:26.331368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.029 qpair failed and we were unable to recover it. 00:27:46.029 [2024-11-21 03:44:26.331477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.029 [2024-11-21 03:44:26.331585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.029 [2024-11-21 03:44:26.331612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.029 qpair failed and we were unable to recover it. 00:27:46.029 [2024-11-21 03:44:26.331716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.029 [2024-11-21 03:44:26.331842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.029 [2024-11-21 03:44:26.331869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.029 qpair failed and we were unable to recover it. 00:27:46.029 [2024-11-21 03:44:26.332024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.029 [2024-11-21 03:44:26.332126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.029 [2024-11-21 03:44:26.332152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.029 qpair failed and we were unable to recover it. 00:27:46.029 [2024-11-21 03:44:26.332288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.029 [2024-11-21 03:44:26.332413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.029 [2024-11-21 03:44:26.332439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.029 qpair failed and we were unable to recover it. 00:27:46.029 [2024-11-21 03:44:26.332547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.029 [2024-11-21 03:44:26.332693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.029 [2024-11-21 03:44:26.332719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.029 qpair failed and we were unable to recover it. 00:27:46.029 [2024-11-21 03:44:26.332822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.029 [2024-11-21 03:44:26.332981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.029 [2024-11-21 03:44:26.333008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.029 qpair failed and we were unable to recover it. 00:27:46.029 [2024-11-21 03:44:26.333104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.029 [2024-11-21 03:44:26.333208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.029 [2024-11-21 03:44:26.333234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.029 qpair failed and we were unable to recover it. 00:27:46.029 [2024-11-21 03:44:26.333396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.029 [2024-11-21 03:44:26.333496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.029 [2024-11-21 03:44:26.333532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.029 qpair failed and we were unable to recover it. 00:27:46.029 [2024-11-21 03:44:26.333634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.029 [2024-11-21 03:44:26.333734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.029 [2024-11-21 03:44:26.333764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.029 qpair failed and we were unable to recover it. 00:27:46.029 [2024-11-21 03:44:26.333889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.029 [2024-11-21 03:44:26.334020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.029 [2024-11-21 03:44:26.334046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.029 qpair failed and we were unable to recover it. 00:27:46.029 [2024-11-21 03:44:26.334155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.029 [2024-11-21 03:44:26.334286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.029 [2024-11-21 03:44:26.334313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.029 qpair failed and we were unable to recover it. 00:27:46.029 [2024-11-21 03:44:26.334423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.029 [2024-11-21 03:44:26.334554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.029 [2024-11-21 03:44:26.334580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.029 qpair failed and we were unable to recover it. 00:27:46.029 [2024-11-21 03:44:26.334705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.029 [2024-11-21 03:44:26.334832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.029 [2024-11-21 03:44:26.334858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.029 qpair failed and we were unable to recover it. 00:27:46.029 [2024-11-21 03:44:26.334965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.029 [2024-11-21 03:44:26.335088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.029 [2024-11-21 03:44:26.335114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.029 qpair failed and we were unable to recover it. 00:27:46.029 [2024-11-21 03:44:26.335216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.029 [2024-11-21 03:44:26.335366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.029 [2024-11-21 03:44:26.335392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.029 qpair failed and we were unable to recover it. 00:27:46.029 [2024-11-21 03:44:26.335496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.029 [2024-11-21 03:44:26.335619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.029 [2024-11-21 03:44:26.335645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.029 qpair failed and we were unable to recover it. 00:27:46.029 [2024-11-21 03:44:26.335753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.029 [2024-11-21 03:44:26.335872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.029 [2024-11-21 03:44:26.335896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.029 qpair failed and we were unable to recover it. 00:27:46.029 [2024-11-21 03:44:26.336007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.029 [2024-11-21 03:44:26.336135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.030 [2024-11-21 03:44:26.336161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.030 qpair failed and we were unable to recover it. 00:27:46.030 [2024-11-21 03:44:26.336317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.030 [2024-11-21 03:44:26.336423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.030 [2024-11-21 03:44:26.336450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.030 qpair failed and we were unable to recover it. 00:27:46.030 [2024-11-21 03:44:26.336580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.030 [2024-11-21 03:44:26.336703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.030 [2024-11-21 03:44:26.336729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.030 qpair failed and we were unable to recover it. 00:27:46.030 [2024-11-21 03:44:26.336853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.030 [2024-11-21 03:44:26.336989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.030 [2024-11-21 03:44:26.337015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.030 qpair failed and we were unable to recover it. 00:27:46.030 [2024-11-21 03:44:26.337124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.030 [2024-11-21 03:44:26.337231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.030 [2024-11-21 03:44:26.337256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.030 qpair failed and we were unable to recover it. 00:27:46.030 [2024-11-21 03:44:26.337359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.030 [2024-11-21 03:44:26.337489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.030 [2024-11-21 03:44:26.337514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.030 qpair failed and we were unable to recover it. 00:27:46.030 [2024-11-21 03:44:26.337623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.030 [2024-11-21 03:44:26.337751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.030 [2024-11-21 03:44:26.337777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.030 qpair failed and we were unable to recover it. 00:27:46.030 [2024-11-21 03:44:26.337908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.030 [2024-11-21 03:44:26.338039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.030 [2024-11-21 03:44:26.338065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.030 qpair failed and we were unable to recover it. 00:27:46.030 [2024-11-21 03:44:26.338177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.030 [2024-11-21 03:44:26.338281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.030 [2024-11-21 03:44:26.338306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.030 qpair failed and we were unable to recover it. 00:27:46.030 [2024-11-21 03:44:26.338407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.030 [2024-11-21 03:44:26.338562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.030 [2024-11-21 03:44:26.338588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.030 qpair failed and we were unable to recover it. 00:27:46.030 [2024-11-21 03:44:26.338712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.030 [2024-11-21 03:44:26.338836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.030 [2024-11-21 03:44:26.338862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.030 qpair failed and we were unable to recover it. 00:27:46.030 [2024-11-21 03:44:26.338965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.030 [2024-11-21 03:44:26.339118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.030 [2024-11-21 03:44:26.339144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.030 qpair failed and we were unable to recover it. 00:27:46.030 [2024-11-21 03:44:26.339251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.030 [2024-11-21 03:44:26.339345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.030 [2024-11-21 03:44:26.339371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.030 qpair failed and we were unable to recover it. 00:27:46.030 [2024-11-21 03:44:26.339506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.030 [2024-11-21 03:44:26.339637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.030 [2024-11-21 03:44:26.339664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.030 qpair failed and we were unable to recover it. 00:27:46.030 [2024-11-21 03:44:26.339829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.030 [2024-11-21 03:44:26.339967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.030 [2024-11-21 03:44:26.339994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.030 qpair failed and we were unable to recover it. 00:27:46.030 [2024-11-21 03:44:26.340126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.030 [2024-11-21 03:44:26.340230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.030 [2024-11-21 03:44:26.340258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.030 qpair failed and we were unable to recover it. 00:27:46.030 [2024-11-21 03:44:26.340381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.030 [2024-11-21 03:44:26.340498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.030 [2024-11-21 03:44:26.340528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.030 qpair failed and we were unable to recover it. 00:27:46.030 [2024-11-21 03:44:26.340680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.030 [2024-11-21 03:44:26.340818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.030 [2024-11-21 03:44:26.340845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.030 qpair failed and we were unable to recover it. 00:27:46.030 [2024-11-21 03:44:26.340951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.030 [2024-11-21 03:44:26.341082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.030 [2024-11-21 03:44:26.341109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.030 qpair failed and we were unable to recover it. 00:27:46.030 [2024-11-21 03:44:26.341258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.030 [2024-11-21 03:44:26.341425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.030 [2024-11-21 03:44:26.341453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.030 qpair failed and we were unable to recover it. 00:27:46.030 [2024-11-21 03:44:26.341587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.030 [2024-11-21 03:44:26.341714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.030 [2024-11-21 03:44:26.341740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.030 qpair failed and we were unable to recover it. 00:27:46.030 [2024-11-21 03:44:26.341877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.030 [2024-11-21 03:44:26.342002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.030 [2024-11-21 03:44:26.342029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.030 qpair failed and we were unable to recover it. 00:27:46.030 [2024-11-21 03:44:26.342143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.030 [2024-11-21 03:44:26.342269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.030 [2024-11-21 03:44:26.342298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.030 qpair failed and we were unable to recover it. 00:27:46.030 [2024-11-21 03:44:26.342442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.030 [2024-11-21 03:44:26.342618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.030 [2024-11-21 03:44:26.342645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.030 qpair failed and we were unable to recover it. 00:27:46.030 [2024-11-21 03:44:26.342798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.030 [2024-11-21 03:44:26.342895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.030 [2024-11-21 03:44:26.342925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.030 qpair failed and we were unable to recover it. 00:27:46.030 [2024-11-21 03:44:26.343087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.030 [2024-11-21 03:44:26.343218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.030 [2024-11-21 03:44:26.343262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.030 qpair failed and we were unable to recover it. 00:27:46.030 [2024-11-21 03:44:26.343392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.030 [2024-11-21 03:44:26.343523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.030 [2024-11-21 03:44:26.343549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.030 qpair failed and we were unable to recover it. 00:27:46.030 [2024-11-21 03:44:26.343649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.030 [2024-11-21 03:44:26.343771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.030 [2024-11-21 03:44:26.343796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.030 qpair failed and we were unable to recover it. 00:27:46.030 [2024-11-21 03:44:26.343904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.031 [2024-11-21 03:44:26.344005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.031 [2024-11-21 03:44:26.344031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.031 qpair failed and we were unable to recover it. 00:27:46.031 [2024-11-21 03:44:26.344169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.031 [2024-11-21 03:44:26.344299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.031 [2024-11-21 03:44:26.344325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.031 qpair failed and we were unable to recover it. 00:27:46.031 [2024-11-21 03:44:26.344427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.031 [2024-11-21 03:44:26.344523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.031 [2024-11-21 03:44:26.344549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.031 qpair failed and we were unable to recover it. 00:27:46.031 [2024-11-21 03:44:26.344728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.031 [2024-11-21 03:44:26.344869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.031 [2024-11-21 03:44:26.344899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.031 qpair failed and we were unable to recover it. 00:27:46.031 [2024-11-21 03:44:26.345066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.031 [2024-11-21 03:44:26.345228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.031 [2024-11-21 03:44:26.345256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.031 qpair failed and we were unable to recover it. 00:27:46.031 [2024-11-21 03:44:26.345386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.031 [2024-11-21 03:44:26.345521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.031 [2024-11-21 03:44:26.345547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.031 qpair failed and we were unable to recover it. 00:27:46.031 [2024-11-21 03:44:26.345674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.031 [2024-11-21 03:44:26.345803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.031 [2024-11-21 03:44:26.345832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.031 qpair failed and we were unable to recover it. 00:27:46.031 [2024-11-21 03:44:26.345953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.031 [2024-11-21 03:44:26.346111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.031 [2024-11-21 03:44:26.346138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.031 qpair failed and we were unable to recover it. 00:27:46.031 [2024-11-21 03:44:26.346270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.031 [2024-11-21 03:44:26.346433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.031 [2024-11-21 03:44:26.346459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.031 qpair failed and we were unable to recover it. 00:27:46.031 [2024-11-21 03:44:26.346595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.031 [2024-11-21 03:44:26.346693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.031 [2024-11-21 03:44:26.346719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.031 qpair failed and we were unable to recover it. 00:27:46.031 [2024-11-21 03:44:26.346858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.031 [2024-11-21 03:44:26.347099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.031 [2024-11-21 03:44:26.347126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.031 qpair failed and we were unable to recover it. 00:27:46.031 [2024-11-21 03:44:26.347233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.031 [2024-11-21 03:44:26.347358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.031 [2024-11-21 03:44:26.347384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.031 qpair failed and we were unable to recover it. 00:27:46.031 [2024-11-21 03:44:26.347540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.031 [2024-11-21 03:44:26.347677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.031 [2024-11-21 03:44:26.347702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.031 qpair failed and we were unable to recover it. 00:27:46.031 [2024-11-21 03:44:26.347831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.031 [2024-11-21 03:44:26.347937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.031 [2024-11-21 03:44:26.347963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.031 qpair failed and we were unable to recover it. 00:27:46.031 [2024-11-21 03:44:26.348083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.031 [2024-11-21 03:44:26.348219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.031 [2024-11-21 03:44:26.348245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.031 qpair failed and we were unable to recover it. 00:27:46.031 [2024-11-21 03:44:26.348369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.031 [2024-11-21 03:44:26.348522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.031 [2024-11-21 03:44:26.348548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.031 qpair failed and we were unable to recover it. 00:27:46.031 [2024-11-21 03:44:26.348658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.031 [2024-11-21 03:44:26.348812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.031 [2024-11-21 03:44:26.348837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.031 qpair failed and we were unable to recover it. 00:27:46.031 [2024-11-21 03:44:26.348972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.031 [2024-11-21 03:44:26.349079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.031 [2024-11-21 03:44:26.349105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.031 qpair failed and we were unable to recover it. 00:27:46.031 [2024-11-21 03:44:26.349271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.031 [2024-11-21 03:44:26.349381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.031 [2024-11-21 03:44:26.349406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.031 qpair failed and we were unable to recover it. 00:27:46.031 [2024-11-21 03:44:26.349506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.031 [2024-11-21 03:44:26.349612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.031 [2024-11-21 03:44:26.349639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.031 qpair failed and we were unable to recover it. 00:27:46.031 [2024-11-21 03:44:26.349738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.031 [2024-11-21 03:44:26.349845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.031 [2024-11-21 03:44:26.349872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.031 qpair failed and we were unable to recover it. 00:27:46.031 [2024-11-21 03:44:26.349972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.031 [2024-11-21 03:44:26.350076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.031 [2024-11-21 03:44:26.350102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.031 qpair failed and we were unable to recover it. 00:27:46.031 [2024-11-21 03:44:26.350211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.031 [2024-11-21 03:44:26.350360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.031 [2024-11-21 03:44:26.350386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.031 qpair failed and we were unable to recover it. 00:27:46.031 [2024-11-21 03:44:26.350517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.031 [2024-11-21 03:44:26.350653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.031 [2024-11-21 03:44:26.350679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.031 qpair failed and we were unable to recover it. 00:27:46.031 [2024-11-21 03:44:26.350835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.031 [2024-11-21 03:44:26.350930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.031 [2024-11-21 03:44:26.350957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.031 qpair failed and we were unable to recover it. 00:27:46.031 [2024-11-21 03:44:26.351062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.031 [2024-11-21 03:44:26.351201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.031 [2024-11-21 03:44:26.351227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.031 qpair failed and we were unable to recover it. 00:27:46.031 [2024-11-21 03:44:26.351356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.031 [2024-11-21 03:44:26.351465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.031 [2024-11-21 03:44:26.351491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.031 qpair failed and we were unable to recover it. 00:27:46.031 [2024-11-21 03:44:26.351600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.031 [2024-11-21 03:44:26.351700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.031 [2024-11-21 03:44:26.351726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.031 qpair failed and we were unable to recover it. 00:27:46.031 [2024-11-21 03:44:26.351851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.031 [2024-11-21 03:44:26.351982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.032 [2024-11-21 03:44:26.352007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.032 qpair failed and we were unable to recover it. 00:27:46.032 [2024-11-21 03:44:26.352110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.032 [2024-11-21 03:44:26.352241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.032 [2024-11-21 03:44:26.352267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.032 qpair failed and we were unable to recover it. 00:27:46.032 [2024-11-21 03:44:26.352398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.032 [2024-11-21 03:44:26.352527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.032 [2024-11-21 03:44:26.352553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.032 qpair failed and we were unable to recover it. 00:27:46.032 [2024-11-21 03:44:26.352681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.032 [2024-11-21 03:44:26.352791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.032 [2024-11-21 03:44:26.352817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.032 qpair failed and we were unable to recover it. 00:27:46.032 [2024-11-21 03:44:26.352944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.032 [2024-11-21 03:44:26.353044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.032 [2024-11-21 03:44:26.353082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.032 qpair failed and we were unable to recover it. 00:27:46.032 [2024-11-21 03:44:26.353215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.032 [2024-11-21 03:44:26.353317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.032 [2024-11-21 03:44:26.353343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.032 qpair failed and we were unable to recover it. 00:27:46.032 [2024-11-21 03:44:26.353449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.032 [2024-11-21 03:44:26.353555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.032 [2024-11-21 03:44:26.353582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.032 qpair failed and we were unable to recover it. 00:27:46.032 [2024-11-21 03:44:26.353714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.032 [2024-11-21 03:44:26.353811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.032 [2024-11-21 03:44:26.353838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.032 qpair failed and we were unable to recover it. 00:27:46.032 [2024-11-21 03:44:26.353963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.032 [2024-11-21 03:44:26.354075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.032 [2024-11-21 03:44:26.354102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.032 qpair failed and we were unable to recover it. 00:27:46.032 [2024-11-21 03:44:26.354262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.032 [2024-11-21 03:44:26.354362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.032 [2024-11-21 03:44:26.354388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.032 qpair failed and we were unable to recover it. 00:27:46.032 [2024-11-21 03:44:26.354496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.032 [2024-11-21 03:44:26.354649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.032 [2024-11-21 03:44:26.354675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.032 qpair failed and we were unable to recover it. 00:27:46.032 [2024-11-21 03:44:26.354774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.032 [2024-11-21 03:44:26.354897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.032 [2024-11-21 03:44:26.354923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.032 qpair failed and we were unable to recover it. 00:27:46.032 [2024-11-21 03:44:26.355018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.032 [2024-11-21 03:44:26.355119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.032 [2024-11-21 03:44:26.355146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.032 qpair failed and we were unable to recover it. 00:27:46.032 [2024-11-21 03:44:26.355249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.032 [2024-11-21 03:44:26.355385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.032 [2024-11-21 03:44:26.355411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.032 qpair failed and we were unable to recover it. 00:27:46.032 [2024-11-21 03:44:26.355538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.032 [2024-11-21 03:44:26.355670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.032 [2024-11-21 03:44:26.355696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.032 qpair failed and we were unable to recover it. 00:27:46.032 [2024-11-21 03:44:26.355794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.032 [2024-11-21 03:44:26.355890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.032 [2024-11-21 03:44:26.355916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.032 qpair failed and we were unable to recover it. 00:27:46.032 [2024-11-21 03:44:26.356052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.032 [2024-11-21 03:44:26.356167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.032 [2024-11-21 03:44:26.356196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.032 qpair failed and we were unable to recover it. 00:27:46.032 [2024-11-21 03:44:26.356305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.032 [2024-11-21 03:44:26.356401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.032 [2024-11-21 03:44:26.356427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.032 qpair failed and we were unable to recover it. 00:27:46.032 [2024-11-21 03:44:26.356522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.032 [2024-11-21 03:44:26.356617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.032 [2024-11-21 03:44:26.356644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.032 qpair failed and we were unable to recover it. 00:27:46.032 [2024-11-21 03:44:26.356775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.032 [2024-11-21 03:44:26.356900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.032 [2024-11-21 03:44:26.356930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.032 qpair failed and we were unable to recover it. 00:27:46.032 [2024-11-21 03:44:26.357035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.032 [2024-11-21 03:44:26.357146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.032 [2024-11-21 03:44:26.357172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.032 qpair failed and we were unable to recover it. 00:27:46.032 [2024-11-21 03:44:26.357276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.032 [2024-11-21 03:44:26.357405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.032 [2024-11-21 03:44:26.357431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.032 qpair failed and we were unable to recover it. 00:27:46.032 [2024-11-21 03:44:26.357585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.032 [2024-11-21 03:44:26.357678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.032 [2024-11-21 03:44:26.357704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.032 qpair failed and we were unable to recover it. 00:27:46.032 [2024-11-21 03:44:26.357860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.032 [2024-11-21 03:44:26.357983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.032 [2024-11-21 03:44:26.358010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.032 qpair failed and we were unable to recover it. 00:27:46.032 [2024-11-21 03:44:26.358133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.032 [2024-11-21 03:44:26.358232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.032 [2024-11-21 03:44:26.358259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.032 qpair failed and we were unable to recover it. 00:27:46.032 [2024-11-21 03:44:26.358369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.032 [2024-11-21 03:44:26.358536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.032 [2024-11-21 03:44:26.358563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.032 qpair failed and we were unable to recover it. 00:27:46.032 [2024-11-21 03:44:26.358670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.032 [2024-11-21 03:44:26.358789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.032 [2024-11-21 03:44:26.358815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.032 qpair failed and we were unable to recover it. 00:27:46.032 [2024-11-21 03:44:26.358943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.032 [2024-11-21 03:44:26.359051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.032 [2024-11-21 03:44:26.359083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.032 qpair failed and we were unable to recover it. 00:27:46.032 [2024-11-21 03:44:26.359188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.032 [2024-11-21 03:44:26.359286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.032 [2024-11-21 03:44:26.359313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.032 qpair failed and we were unable to recover it. 00:27:46.032 [2024-11-21 03:44:26.359442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.033 [2024-11-21 03:44:26.359567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.033 [2024-11-21 03:44:26.359593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.033 qpair failed and we were unable to recover it. 00:27:46.033 [2024-11-21 03:44:26.359729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.033 [2024-11-21 03:44:26.359834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.033 [2024-11-21 03:44:26.359878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.033 qpair failed and we were unable to recover it. 00:27:46.033 [2024-11-21 03:44:26.359998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.033 [2024-11-21 03:44:26.360155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.033 [2024-11-21 03:44:26.360183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.033 qpair failed and we were unable to recover it. 00:27:46.033 [2024-11-21 03:44:26.360279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.033 [2024-11-21 03:44:26.360377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.033 [2024-11-21 03:44:26.360403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.033 qpair failed and we were unable to recover it. 00:27:46.033 [2024-11-21 03:44:26.360501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.033 [2024-11-21 03:44:26.360601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.033 [2024-11-21 03:44:26.360628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.033 qpair failed and we were unable to recover it. 00:27:46.033 [2024-11-21 03:44:26.360764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.033 [2024-11-21 03:44:26.360920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.033 [2024-11-21 03:44:26.360947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.033 qpair failed and we were unable to recover it. 00:27:46.033 [2024-11-21 03:44:26.361047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.033 [2024-11-21 03:44:26.361159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.033 [2024-11-21 03:44:26.361185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.033 qpair failed and we were unable to recover it. 00:27:46.033 [2024-11-21 03:44:26.361313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.033 [2024-11-21 03:44:26.361433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.033 [2024-11-21 03:44:26.361463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.033 qpair failed and we were unable to recover it. 00:27:46.033 [2024-11-21 03:44:26.361616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.033 [2024-11-21 03:44:26.361745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.033 [2024-11-21 03:44:26.361771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.033 qpair failed and we were unable to recover it. 00:27:46.033 [2024-11-21 03:44:26.361919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.033 [2024-11-21 03:44:26.362077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.033 [2024-11-21 03:44:26.362105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.033 qpair failed and we were unable to recover it. 00:27:46.033 [2024-11-21 03:44:26.362238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.033 [2024-11-21 03:44:26.362372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.033 [2024-11-21 03:44:26.362398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.033 qpair failed and we were unable to recover it. 00:27:46.033 [2024-11-21 03:44:26.362556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.033 [2024-11-21 03:44:26.362656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.033 [2024-11-21 03:44:26.362683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.033 qpair failed and we were unable to recover it. 00:27:46.033 [2024-11-21 03:44:26.362806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.033 [2024-11-21 03:44:26.362912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.033 [2024-11-21 03:44:26.362938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.033 qpair failed and we were unable to recover it. 00:27:46.033 [2024-11-21 03:44:26.363097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.033 [2024-11-21 03:44:26.363202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.033 [2024-11-21 03:44:26.363228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.033 qpair failed and we were unable to recover it. 00:27:46.033 [2024-11-21 03:44:26.363382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.033 [2024-11-21 03:44:26.363507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.033 [2024-11-21 03:44:26.363533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.033 qpair failed and we were unable to recover it. 00:27:46.033 [2024-11-21 03:44:26.363635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.033 [2024-11-21 03:44:26.363780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.033 [2024-11-21 03:44:26.363808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.033 qpair failed and we were unable to recover it. 00:27:46.033 [2024-11-21 03:44:26.364012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.033 [2024-11-21 03:44:26.364142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.033 [2024-11-21 03:44:26.364170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.033 qpair failed and we were unable to recover it. 00:27:46.033 [2024-11-21 03:44:26.364302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.033 [2024-11-21 03:44:26.364431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.033 [2024-11-21 03:44:26.364458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.033 qpair failed and we were unable to recover it. 00:27:46.033 [2024-11-21 03:44:26.364615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.033 [2024-11-21 03:44:26.364776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.033 [2024-11-21 03:44:26.364802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.033 qpair failed and we were unable to recover it. 00:27:46.033 [2024-11-21 03:44:26.364930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.033 [2024-11-21 03:44:26.365060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.033 [2024-11-21 03:44:26.365092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.033 qpair failed and we were unable to recover it. 00:27:46.033 [2024-11-21 03:44:26.365232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.033 [2024-11-21 03:44:26.365365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.033 [2024-11-21 03:44:26.365391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.033 qpair failed and we were unable to recover it. 00:27:46.033 [2024-11-21 03:44:26.365524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.033 [2024-11-21 03:44:26.365633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.033 [2024-11-21 03:44:26.365659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.033 qpair failed and we were unable to recover it. 00:27:46.033 [2024-11-21 03:44:26.365813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.033 [2024-11-21 03:44:26.365919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.033 [2024-11-21 03:44:26.365944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.033 qpair failed and we were unable to recover it. 00:27:46.033 [2024-11-21 03:44:26.366083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.033 [2024-11-21 03:44:26.366253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.033 [2024-11-21 03:44:26.366279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.033 qpair failed and we were unable to recover it. 00:27:46.034 [2024-11-21 03:44:26.366385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.034 [2024-11-21 03:44:26.366504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.034 [2024-11-21 03:44:26.366531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.034 qpair failed and we were unable to recover it. 00:27:46.034 [2024-11-21 03:44:26.366653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.034 [2024-11-21 03:44:26.366781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.034 [2024-11-21 03:44:26.366807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.034 qpair failed and we were unable to recover it. 00:27:46.034 [2024-11-21 03:44:26.366936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.034 [2024-11-21 03:44:26.367092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.034 [2024-11-21 03:44:26.367124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.034 qpair failed and we were unable to recover it. 00:27:46.034 [2024-11-21 03:44:26.367281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.034 [2024-11-21 03:44:26.367422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.034 [2024-11-21 03:44:26.367447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.034 qpair failed and we were unable to recover it. 00:27:46.034 [2024-11-21 03:44:26.367571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.034 [2024-11-21 03:44:26.367702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.034 [2024-11-21 03:44:26.367728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.034 qpair failed and we were unable to recover it. 00:27:46.034 [2024-11-21 03:44:26.367851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.034 [2024-11-21 03:44:26.367960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.034 [2024-11-21 03:44:26.367985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.034 qpair failed and we were unable to recover it. 00:27:46.034 [2024-11-21 03:44:26.368113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.034 [2024-11-21 03:44:26.368241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.034 [2024-11-21 03:44:26.368267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.034 qpair failed and we were unable to recover it. 00:27:46.034 [2024-11-21 03:44:26.368397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.034 [2024-11-21 03:44:26.368498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.034 [2024-11-21 03:44:26.368526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.034 qpair failed and we were unable to recover it. 00:27:46.034 [2024-11-21 03:44:26.368659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.034 [2024-11-21 03:44:26.368759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.034 [2024-11-21 03:44:26.368784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.034 qpair failed and we were unable to recover it. 00:27:46.034 [2024-11-21 03:44:26.368884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.034 [2024-11-21 03:44:26.369017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.034 [2024-11-21 03:44:26.369042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.034 qpair failed and we were unable to recover it. 00:27:46.034 [2024-11-21 03:44:26.369152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.034 [2024-11-21 03:44:26.369281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.034 [2024-11-21 03:44:26.369308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.034 qpair failed and we were unable to recover it. 00:27:46.034 [2024-11-21 03:44:26.369441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.034 [2024-11-21 03:44:26.369568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.034 [2024-11-21 03:44:26.369594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.034 qpair failed and we were unable to recover it. 00:27:46.034 [2024-11-21 03:44:26.369723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.034 [2024-11-21 03:44:26.369874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.034 [2024-11-21 03:44:26.369899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.034 qpair failed and we were unable to recover it. 00:27:46.034 [2024-11-21 03:44:26.370014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.034 [2024-11-21 03:44:26.370149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.034 [2024-11-21 03:44:26.370175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.034 qpair failed and we were unable to recover it. 00:27:46.034 [2024-11-21 03:44:26.370304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.034 [2024-11-21 03:44:26.370410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.034 [2024-11-21 03:44:26.370436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.034 qpair failed and we were unable to recover it. 00:27:46.034 [2024-11-21 03:44:26.370569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.034 [2024-11-21 03:44:26.370694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.034 [2024-11-21 03:44:26.370719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.034 qpair failed and we were unable to recover it. 00:27:46.034 [2024-11-21 03:44:26.370847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.034 [2024-11-21 03:44:26.370973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.034 [2024-11-21 03:44:26.370998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.034 qpair failed and we were unable to recover it. 00:27:46.034 [2024-11-21 03:44:26.371101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.034 [2024-11-21 03:44:26.371206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.034 [2024-11-21 03:44:26.371235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.034 qpair failed and we were unable to recover it. 00:27:46.034 [2024-11-21 03:44:26.371341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.034 [2024-11-21 03:44:26.371444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.034 [2024-11-21 03:44:26.371470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.034 qpair failed and we were unable to recover it. 00:27:46.034 [2024-11-21 03:44:26.371569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.034 [2024-11-21 03:44:26.371673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.034 [2024-11-21 03:44:26.371698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.034 qpair failed and we were unable to recover it. 00:27:46.034 [2024-11-21 03:44:26.371804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.034 [2024-11-21 03:44:26.371908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.034 [2024-11-21 03:44:26.371933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.034 qpair failed and we were unable to recover it. 00:27:46.034 [2024-11-21 03:44:26.372101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.034 [2024-11-21 03:44:26.372207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.034 [2024-11-21 03:44:26.372232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.034 qpair failed and we were unable to recover it. 00:27:46.034 [2024-11-21 03:44:26.372363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.034 [2024-11-21 03:44:26.372495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.034 [2024-11-21 03:44:26.372520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.034 qpair failed and we were unable to recover it. 00:27:46.034 [2024-11-21 03:44:26.372674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.034 [2024-11-21 03:44:26.372781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.034 [2024-11-21 03:44:26.372808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.034 qpair failed and we were unable to recover it. 00:27:46.034 [2024-11-21 03:44:26.372941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.034 [2024-11-21 03:44:26.373080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.034 [2024-11-21 03:44:26.373107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.034 qpair failed and we were unable to recover it. 00:27:46.034 [2024-11-21 03:44:26.373243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.034 [2024-11-21 03:44:26.373343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.034 [2024-11-21 03:44:26.373370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.034 qpair failed and we were unable to recover it. 00:27:46.034 [2024-11-21 03:44:26.373497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.034 [2024-11-21 03:44:26.373626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.034 [2024-11-21 03:44:26.373652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.034 qpair failed and we were unable to recover it. 00:27:46.034 [2024-11-21 03:44:26.373748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.034 [2024-11-21 03:44:26.373853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.034 [2024-11-21 03:44:26.373880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.034 qpair failed and we were unable to recover it. 00:27:46.034 [2024-11-21 03:44:26.373984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.034 [2024-11-21 03:44:26.374081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.035 [2024-11-21 03:44:26.374108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.035 qpair failed and we were unable to recover it. 00:27:46.035 [2024-11-21 03:44:26.374215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.035 [2024-11-21 03:44:26.374307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.035 [2024-11-21 03:44:26.374332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.035 qpair failed and we were unable to recover it. 00:27:46.035 [2024-11-21 03:44:26.374463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.035 [2024-11-21 03:44:26.374560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.035 [2024-11-21 03:44:26.374586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.035 qpair failed and we were unable to recover it. 00:27:46.035 [2024-11-21 03:44:26.374720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.035 [2024-11-21 03:44:26.374841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.035 [2024-11-21 03:44:26.374868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.035 qpair failed and we were unable to recover it. 00:27:46.035 [2024-11-21 03:44:26.374992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.035 [2024-11-21 03:44:26.375103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.035 [2024-11-21 03:44:26.375129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.035 qpair failed and we were unable to recover it. 00:27:46.035 [2024-11-21 03:44:26.375227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.035 [2024-11-21 03:44:26.375341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.035 [2024-11-21 03:44:26.375366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.035 qpair failed and we were unable to recover it. 00:27:46.035 [2024-11-21 03:44:26.375519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.035 [2024-11-21 03:44:26.375641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.035 [2024-11-21 03:44:26.375666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.035 qpair failed and we were unable to recover it. 00:27:46.035 [2024-11-21 03:44:26.375782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.035 [2024-11-21 03:44:26.375891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.035 [2024-11-21 03:44:26.375917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.035 qpair failed and we were unable to recover it. 00:27:46.035 [2024-11-21 03:44:26.376045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.035 [2024-11-21 03:44:26.376180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.035 [2024-11-21 03:44:26.376206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.035 qpair failed and we were unable to recover it. 00:27:46.035 [2024-11-21 03:44:26.376330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.035 [2024-11-21 03:44:26.376427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.035 [2024-11-21 03:44:26.376453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.035 qpair failed and we were unable to recover it. 00:27:46.035 [2024-11-21 03:44:26.376551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.035 [2024-11-21 03:44:26.376678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.035 [2024-11-21 03:44:26.376704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.035 qpair failed and we were unable to recover it. 00:27:46.035 [2024-11-21 03:44:26.376865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.035 [2024-11-21 03:44:26.376965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.035 [2024-11-21 03:44:26.376992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.035 qpair failed and we were unable to recover it. 00:27:46.035 [2024-11-21 03:44:26.377122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.035 [2024-11-21 03:44:26.377232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.035 [2024-11-21 03:44:26.377259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.035 qpair failed and we were unable to recover it. 00:27:46.035 [2024-11-21 03:44:26.377371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.035 [2024-11-21 03:44:26.377478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.035 [2024-11-21 03:44:26.377503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.035 qpair failed and we were unable to recover it. 00:27:46.035 [2024-11-21 03:44:26.377613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.035 [2024-11-21 03:44:26.377706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.035 [2024-11-21 03:44:26.377732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.035 qpair failed and we were unable to recover it. 00:27:46.035 [2024-11-21 03:44:26.377863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.035 [2024-11-21 03:44:26.377964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.035 [2024-11-21 03:44:26.377990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.035 qpair failed and we were unable to recover it. 00:27:46.035 [2024-11-21 03:44:26.378091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.035 [2024-11-21 03:44:26.378220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.035 [2024-11-21 03:44:26.378246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.035 qpair failed and we were unable to recover it. 00:27:46.035 [2024-11-21 03:44:26.378342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.035 [2024-11-21 03:44:26.378438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.035 [2024-11-21 03:44:26.378464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.035 qpair failed and we were unable to recover it. 00:27:46.035 [2024-11-21 03:44:26.378576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.035 [2024-11-21 03:44:26.378704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.035 [2024-11-21 03:44:26.378730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.035 qpair failed and we were unable to recover it. 00:27:46.035 [2024-11-21 03:44:26.378859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.035 [2024-11-21 03:44:26.378961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.035 [2024-11-21 03:44:26.378987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.035 qpair failed and we were unable to recover it. 00:27:46.035 [2024-11-21 03:44:26.379120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.035 [2024-11-21 03:44:26.379224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.035 [2024-11-21 03:44:26.379249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.035 qpair failed and we were unable to recover it. 00:27:46.035 [2024-11-21 03:44:26.379348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.035 [2024-11-21 03:44:26.379467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.035 [2024-11-21 03:44:26.379493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.035 qpair failed and we were unable to recover it. 00:27:46.035 [2024-11-21 03:44:26.379591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.035 [2024-11-21 03:44:26.379692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.035 [2024-11-21 03:44:26.379720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.035 qpair failed and we were unable to recover it. 00:27:46.035 [2024-11-21 03:44:26.379854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.035 [2024-11-21 03:44:26.379958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.035 [2024-11-21 03:44:26.379984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.035 qpair failed and we were unable to recover it. 00:27:46.035 [2024-11-21 03:44:26.380108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.035 [2024-11-21 03:44:26.380205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.035 [2024-11-21 03:44:26.380232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.035 qpair failed and we were unable to recover it. 00:27:46.035 [2024-11-21 03:44:26.380361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.035 [2024-11-21 03:44:26.380458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.035 [2024-11-21 03:44:26.380484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.035 qpair failed and we were unable to recover it. 00:27:46.035 [2024-11-21 03:44:26.380605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.035 [2024-11-21 03:44:26.380710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.035 [2024-11-21 03:44:26.380737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.035 qpair failed and we were unable to recover it. 00:27:46.035 [2024-11-21 03:44:26.380873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.035 [2024-11-21 03:44:26.380972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.035 [2024-11-21 03:44:26.380998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.035 qpair failed and we were unable to recover it. 00:27:46.035 [2024-11-21 03:44:26.381106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.035 [2024-11-21 03:44:26.381240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.035 [2024-11-21 03:44:26.381266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.035 qpair failed and we were unable to recover it. 00:27:46.036 [2024-11-21 03:44:26.381404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.036 [2024-11-21 03:44:26.381535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.036 [2024-11-21 03:44:26.381561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.036 qpair failed and we were unable to recover it. 00:27:46.036 [2024-11-21 03:44:26.381660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.036 [2024-11-21 03:44:26.381787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.036 [2024-11-21 03:44:26.381813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.036 qpair failed and we were unable to recover it. 00:27:46.036 [2024-11-21 03:44:26.381912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.036 [2024-11-21 03:44:26.382041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.036 [2024-11-21 03:44:26.382076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.036 qpair failed and we were unable to recover it. 00:27:46.036 [2024-11-21 03:44:26.382213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.036 [2024-11-21 03:44:26.382344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.036 [2024-11-21 03:44:26.382370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.036 qpair failed and we were unable to recover it. 00:27:46.036 [2024-11-21 03:44:26.382491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.036 [2024-11-21 03:44:26.382593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.036 [2024-11-21 03:44:26.382619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.036 qpair failed and we were unable to recover it. 00:27:46.036 [2024-11-21 03:44:26.382723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.036 [2024-11-21 03:44:26.382832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.036 [2024-11-21 03:44:26.382858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.036 qpair failed and we were unable to recover it. 00:27:46.036 [2024-11-21 03:44:26.382958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.036 [2024-11-21 03:44:26.383092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.036 [2024-11-21 03:44:26.383118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.036 qpair failed and we were unable to recover it. 00:27:46.036 [2024-11-21 03:44:26.383251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.036 [2024-11-21 03:44:26.383356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.036 [2024-11-21 03:44:26.383382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.036 qpair failed and we were unable to recover it. 00:27:46.036 [2024-11-21 03:44:26.383510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.036 [2024-11-21 03:44:26.383605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.036 [2024-11-21 03:44:26.383630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.036 qpair failed and we were unable to recover it. 00:27:46.036 [2024-11-21 03:44:26.383728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.036 [2024-11-21 03:44:26.383857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.036 [2024-11-21 03:44:26.383883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.036 qpair failed and we were unable to recover it. 00:27:46.036 [2024-11-21 03:44:26.384008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.036 [2024-11-21 03:44:26.384139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.036 [2024-11-21 03:44:26.384166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.036 qpair failed and we were unable to recover it. 00:27:46.036 [2024-11-21 03:44:26.384272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.036 [2024-11-21 03:44:26.384404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.036 [2024-11-21 03:44:26.384434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.036 qpair failed and we were unable to recover it. 00:27:46.036 [2024-11-21 03:44:26.384538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.036 [2024-11-21 03:44:26.384635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.036 [2024-11-21 03:44:26.384661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.036 qpair failed and we were unable to recover it. 00:27:46.036 [2024-11-21 03:44:26.384764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.036 [2024-11-21 03:44:26.384888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.036 [2024-11-21 03:44:26.384914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.036 qpair failed and we were unable to recover it. 00:27:46.036 [2024-11-21 03:44:26.385048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.036 [2024-11-21 03:44:26.385186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.036 [2024-11-21 03:44:26.385212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.036 qpair failed and we were unable to recover it. 00:27:46.036 [2024-11-21 03:44:26.385315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.036 [2024-11-21 03:44:26.385407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.036 [2024-11-21 03:44:26.385432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.036 qpair failed and we were unable to recover it. 00:27:46.036 [2024-11-21 03:44:26.385587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.036 [2024-11-21 03:44:26.385684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.036 [2024-11-21 03:44:26.385711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.036 qpair failed and we were unable to recover it. 00:27:46.036 [2024-11-21 03:44:26.385816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.036 [2024-11-21 03:44:26.385969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.036 [2024-11-21 03:44:26.385994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.036 qpair failed and we were unable to recover it. 00:27:46.036 [2024-11-21 03:44:26.386126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.036 [2024-11-21 03:44:26.386252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.036 [2024-11-21 03:44:26.386278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.036 qpair failed and we were unable to recover it. 00:27:46.036 [2024-11-21 03:44:26.386375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.036 [2024-11-21 03:44:26.386503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.036 [2024-11-21 03:44:26.386528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.036 qpair failed and we were unable to recover it. 00:27:46.036 [2024-11-21 03:44:26.386635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.036 [2024-11-21 03:44:26.386768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.036 [2024-11-21 03:44:26.386795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.036 qpair failed and we were unable to recover it. 00:27:46.036 [2024-11-21 03:44:26.386943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.036 [2024-11-21 03:44:26.387099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.036 [2024-11-21 03:44:26.387130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.036 qpair failed and we were unable to recover it. 00:27:46.036 [2024-11-21 03:44:26.387285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.036 [2024-11-21 03:44:26.387410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.036 [2024-11-21 03:44:26.387436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.036 qpair failed and we were unable to recover it. 00:27:46.036 [2024-11-21 03:44:26.387553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.036 [2024-11-21 03:44:26.387646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.036 [2024-11-21 03:44:26.387672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.036 qpair failed and we were unable to recover it. 00:27:46.036 [2024-11-21 03:44:26.387805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.036 [2024-11-21 03:44:26.387956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.036 [2024-11-21 03:44:26.387982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.036 qpair failed and we were unable to recover it. 00:27:46.036 [2024-11-21 03:44:26.388111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.036 [2024-11-21 03:44:26.388220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.036 [2024-11-21 03:44:26.388246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.036 qpair failed and we were unable to recover it. 00:27:46.036 [2024-11-21 03:44:26.388357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.036 [2024-11-21 03:44:26.388454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.036 [2024-11-21 03:44:26.388479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.036 qpair failed and we were unable to recover it. 00:27:46.036 [2024-11-21 03:44:26.388635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.036 [2024-11-21 03:44:26.388758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.036 [2024-11-21 03:44:26.388785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.036 qpair failed and we were unable to recover it. 00:27:46.036 [2024-11-21 03:44:26.388881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.036 [2024-11-21 03:44:26.388975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.037 [2024-11-21 03:44:26.389001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.037 qpair failed and we were unable to recover it. 00:27:46.037 [2024-11-21 03:44:26.389105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.037 [2024-11-21 03:44:26.389261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.037 [2024-11-21 03:44:26.389287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.037 qpair failed and we were unable to recover it. 00:27:46.037 [2024-11-21 03:44:26.389392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.037 [2024-11-21 03:44:26.389518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.037 [2024-11-21 03:44:26.389544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.037 qpair failed and we were unable to recover it. 00:27:46.037 [2024-11-21 03:44:26.389671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.037 [2024-11-21 03:44:26.389776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.037 [2024-11-21 03:44:26.389801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.037 qpair failed and we were unable to recover it. 00:27:46.037 [2024-11-21 03:44:26.389960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.037 [2024-11-21 03:44:26.390064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.037 [2024-11-21 03:44:26.390098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.037 qpair failed and we were unable to recover it. 00:27:46.037 [2024-11-21 03:44:26.390230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.037 [2024-11-21 03:44:26.390330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.037 [2024-11-21 03:44:26.390355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.037 qpair failed and we were unable to recover it. 00:27:46.037 [2024-11-21 03:44:26.390481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.037 [2024-11-21 03:44:26.390589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.037 [2024-11-21 03:44:26.390615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.037 qpair failed and we were unable to recover it. 00:27:46.037 [2024-11-21 03:44:26.390743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.037 [2024-11-21 03:44:26.390879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.037 [2024-11-21 03:44:26.390905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.037 qpair failed and we were unable to recover it. 00:27:46.037 [2024-11-21 03:44:26.391042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.037 [2024-11-21 03:44:26.391182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.037 [2024-11-21 03:44:26.391208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.037 qpair failed and we were unable to recover it. 00:27:46.037 [2024-11-21 03:44:26.391308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.037 [2024-11-21 03:44:26.391438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.037 [2024-11-21 03:44:26.391463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.037 qpair failed and we were unable to recover it. 00:27:46.037 [2024-11-21 03:44:26.391570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.037 [2024-11-21 03:44:26.391694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.037 [2024-11-21 03:44:26.391720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.037 qpair failed and we were unable to recover it. 00:27:46.037 [2024-11-21 03:44:26.391824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.037 [2024-11-21 03:44:26.391929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.037 [2024-11-21 03:44:26.391955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.037 qpair failed and we were unable to recover it. 00:27:46.037 [2024-11-21 03:44:26.392055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.037 [2024-11-21 03:44:26.392195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.037 [2024-11-21 03:44:26.392221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.037 qpair failed and we were unable to recover it. 00:27:46.037 [2024-11-21 03:44:26.392362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.037 [2024-11-21 03:44:26.392465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.037 [2024-11-21 03:44:26.392491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.037 qpair failed and we were unable to recover it. 00:27:46.037 [2024-11-21 03:44:26.392601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.037 [2024-11-21 03:44:26.392727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.037 [2024-11-21 03:44:26.392753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.037 qpair failed and we were unable to recover it. 00:27:46.037 [2024-11-21 03:44:26.392860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.037 [2024-11-21 03:44:26.392991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.037 [2024-11-21 03:44:26.393017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.037 qpair failed and we were unable to recover it. 00:27:46.037 [2024-11-21 03:44:26.393145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.037 [2024-11-21 03:44:26.393252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.037 [2024-11-21 03:44:26.393278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.037 qpair failed and we were unable to recover it. 00:27:46.037 [2024-11-21 03:44:26.393387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.037 [2024-11-21 03:44:26.393519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.037 [2024-11-21 03:44:26.393545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.037 qpair failed and we were unable to recover it. 00:27:46.037 [2024-11-21 03:44:26.393649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.037 [2024-11-21 03:44:26.393806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.037 [2024-11-21 03:44:26.393833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.037 qpair failed and we were unable to recover it. 00:27:46.037 [2024-11-21 03:44:26.393943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.037 [2024-11-21 03:44:26.394043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.037 [2024-11-21 03:44:26.394077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.037 qpair failed and we were unable to recover it. 00:27:46.037 [2024-11-21 03:44:26.394205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.037 [2024-11-21 03:44:26.394346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.037 [2024-11-21 03:44:26.394371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.037 qpair failed and we were unable to recover it. 00:27:46.037 [2024-11-21 03:44:26.394470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.037 [2024-11-21 03:44:26.394567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.037 [2024-11-21 03:44:26.394592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.037 qpair failed and we were unable to recover it. 00:27:46.037 [2024-11-21 03:44:26.394722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.037 [2024-11-21 03:44:26.394855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.037 [2024-11-21 03:44:26.394881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.037 qpair failed and we were unable to recover it. 00:27:46.037 [2024-11-21 03:44:26.395012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.037 [2024-11-21 03:44:26.395124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.037 [2024-11-21 03:44:26.395151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.037 qpair failed and we were unable to recover it. 00:27:46.037 [2024-11-21 03:44:26.395252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.037 [2024-11-21 03:44:26.395384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.037 [2024-11-21 03:44:26.395410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.037 qpair failed and we were unable to recover it. 00:27:46.037 [2024-11-21 03:44:26.395517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.037 [2024-11-21 03:44:26.395647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.038 [2024-11-21 03:44:26.395672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.038 qpair failed and we were unable to recover it. 00:27:46.038 [2024-11-21 03:44:26.395833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.038 [2024-11-21 03:44:26.395962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.038 [2024-11-21 03:44:26.395988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.038 qpair failed and we were unable to recover it. 00:27:46.038 [2024-11-21 03:44:26.396119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.038 [2024-11-21 03:44:26.396223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.038 [2024-11-21 03:44:26.396249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.038 qpair failed and we were unable to recover it. 00:27:46.038 [2024-11-21 03:44:26.396352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.038 [2024-11-21 03:44:26.396476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.038 [2024-11-21 03:44:26.396502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.038 qpair failed and we were unable to recover it. 00:27:46.038 [2024-11-21 03:44:26.396604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.038 [2024-11-21 03:44:26.396725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.038 [2024-11-21 03:44:26.396751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.038 qpair failed and we were unable to recover it. 00:27:46.038 [2024-11-21 03:44:26.396845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.038 [2024-11-21 03:44:26.396999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.038 [2024-11-21 03:44:26.397025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.038 qpair failed and we were unable to recover it. 00:27:46.038 [2024-11-21 03:44:26.397155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.038 [2024-11-21 03:44:26.397264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.038 [2024-11-21 03:44:26.397291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.038 qpair failed and we were unable to recover it. 00:27:46.038 [2024-11-21 03:44:26.397390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.038 [2024-11-21 03:44:26.397491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.038 [2024-11-21 03:44:26.397517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.038 qpair failed and we were unable to recover it. 00:27:46.038 [2024-11-21 03:44:26.397624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.038 [2024-11-21 03:44:26.397751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.038 [2024-11-21 03:44:26.397776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.038 qpair failed and we were unable to recover it. 00:27:46.038 [2024-11-21 03:44:26.397907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.038 [2024-11-21 03:44:26.398016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.038 [2024-11-21 03:44:26.398043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.038 qpair failed and we were unable to recover it. 00:27:46.038 [2024-11-21 03:44:26.398206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.038 [2024-11-21 03:44:26.398338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.038 [2024-11-21 03:44:26.398365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.038 qpair failed and we were unable to recover it. 00:27:46.038 [2024-11-21 03:44:26.398523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.038 [2024-11-21 03:44:26.398628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.038 [2024-11-21 03:44:26.398655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.038 qpair failed and we were unable to recover it. 00:27:46.038 [2024-11-21 03:44:26.398786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.038 [2024-11-21 03:44:26.398911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.038 [2024-11-21 03:44:26.398937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.038 qpair failed and we were unable to recover it. 00:27:46.038 [2024-11-21 03:44:26.399039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.038 [2024-11-21 03:44:26.399180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.038 [2024-11-21 03:44:26.399208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.038 qpair failed and we were unable to recover it. 00:27:46.038 [2024-11-21 03:44:26.399340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.038 [2024-11-21 03:44:26.399471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.038 [2024-11-21 03:44:26.399497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.038 qpair failed and we were unable to recover it. 00:27:46.038 [2024-11-21 03:44:26.399668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.038 [2024-11-21 03:44:26.399768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.038 [2024-11-21 03:44:26.399794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.038 qpair failed and we were unable to recover it. 00:27:46.038 [2024-11-21 03:44:26.399918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.038 [2024-11-21 03:44:26.400026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.038 [2024-11-21 03:44:26.400052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.038 qpair failed and we were unable to recover it. 00:27:46.038 [2024-11-21 03:44:26.400169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.038 [2024-11-21 03:44:26.400269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.038 [2024-11-21 03:44:26.400294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.038 qpair failed and we were unable to recover it. 00:27:46.038 [2024-11-21 03:44:26.400401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.038 [2024-11-21 03:44:26.400557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.038 [2024-11-21 03:44:26.400582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.038 qpair failed and we were unable to recover it. 00:27:46.038 [2024-11-21 03:44:26.400730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.038 [2024-11-21 03:44:26.400873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.038 [2024-11-21 03:44:26.400904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.038 qpair failed and we were unable to recover it. 00:27:46.038 [2024-11-21 03:44:26.401010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.038 [2024-11-21 03:44:26.401113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.038 [2024-11-21 03:44:26.401139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.038 qpair failed and we were unable to recover it. 00:27:46.038 [2024-11-21 03:44:26.401254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.038 [2024-11-21 03:44:26.401413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.038 [2024-11-21 03:44:26.401439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.038 qpair failed and we were unable to recover it. 00:27:46.038 [2024-11-21 03:44:26.401577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.038 [2024-11-21 03:44:26.401677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.038 [2024-11-21 03:44:26.401702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.038 qpair failed and we were unable to recover it. 00:27:46.038 [2024-11-21 03:44:26.401830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.038 [2024-11-21 03:44:26.401957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.038 [2024-11-21 03:44:26.401983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.038 qpair failed and we were unable to recover it. 00:27:46.038 [2024-11-21 03:44:26.402096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.038 [2024-11-21 03:44:26.402252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.038 [2024-11-21 03:44:26.402278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.038 qpair failed and we were unable to recover it. 00:27:46.038 [2024-11-21 03:44:26.402382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.038 [2024-11-21 03:44:26.402476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.038 [2024-11-21 03:44:26.402501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.038 qpair failed and we were unable to recover it. 00:27:46.038 [2024-11-21 03:44:26.402629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.038 [2024-11-21 03:44:26.402759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.038 [2024-11-21 03:44:26.402785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.038 qpair failed and we were unable to recover it. 00:27:46.038 [2024-11-21 03:44:26.402891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.038 [2024-11-21 03:44:26.403019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.039 [2024-11-21 03:44:26.403046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.039 qpair failed and we were unable to recover it. 00:27:46.039 [2024-11-21 03:44:26.403188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.039 [2024-11-21 03:44:26.403280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.039 [2024-11-21 03:44:26.403306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.039 qpair failed and we were unable to recover it. 00:27:46.039 [2024-11-21 03:44:26.403404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.039 [2024-11-21 03:44:26.403505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.039 [2024-11-21 03:44:26.403531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.039 qpair failed and we were unable to recover it. 00:27:46.039 [2024-11-21 03:44:26.403665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.039 [2024-11-21 03:44:26.403793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.039 [2024-11-21 03:44:26.403819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.039 qpair failed and we were unable to recover it. 00:27:46.039 [2024-11-21 03:44:26.403920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.039 [2024-11-21 03:44:26.404031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.039 [2024-11-21 03:44:26.404056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.039 qpair failed and we were unable to recover it. 00:27:46.039 [2024-11-21 03:44:26.404227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.039 [2024-11-21 03:44:26.404387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.039 [2024-11-21 03:44:26.404413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.039 qpair failed and we were unable to recover it. 00:27:46.039 [2024-11-21 03:44:26.404515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.039 [2024-11-21 03:44:26.404619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.039 [2024-11-21 03:44:26.404644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.039 qpair failed and we were unable to recover it. 00:27:46.039 [2024-11-21 03:44:26.404739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.039 [2024-11-21 03:44:26.404893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.039 [2024-11-21 03:44:26.404919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.039 qpair failed and we were unable to recover it. 00:27:46.039 [2024-11-21 03:44:26.405046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.039 [2024-11-21 03:44:26.405156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.039 [2024-11-21 03:44:26.405182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.039 qpair failed and we were unable to recover it. 00:27:46.039 [2024-11-21 03:44:26.405284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.039 [2024-11-21 03:44:26.405390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.039 [2024-11-21 03:44:26.405416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.039 qpair failed and we were unable to recover it. 00:27:46.039 [2024-11-21 03:44:26.405571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.039 [2024-11-21 03:44:26.405680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.039 [2024-11-21 03:44:26.405705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.039 qpair failed and we were unable to recover it. 00:27:46.039 [2024-11-21 03:44:26.405817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.039 [2024-11-21 03:44:26.405916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.039 [2024-11-21 03:44:26.405942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.039 qpair failed and we were unable to recover it. 00:27:46.039 [2024-11-21 03:44:26.406051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.039 [2024-11-21 03:44:26.406194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.039 [2024-11-21 03:44:26.406220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.039 qpair failed and we were unable to recover it. 00:27:46.039 [2024-11-21 03:44:26.406327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.039 [2024-11-21 03:44:26.406462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.039 [2024-11-21 03:44:26.406487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.039 qpair failed and we were unable to recover it. 00:27:46.039 [2024-11-21 03:44:26.406613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.039 [2024-11-21 03:44:26.406717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.039 [2024-11-21 03:44:26.406742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.039 qpair failed and we were unable to recover it. 00:27:46.039 [2024-11-21 03:44:26.406900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.039 [2024-11-21 03:44:26.406995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.039 [2024-11-21 03:44:26.407021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.039 qpair failed and we were unable to recover it. 00:27:46.039 [2024-11-21 03:44:26.407146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.039 [2024-11-21 03:44:26.407250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.039 [2024-11-21 03:44:26.407275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.039 qpair failed and we were unable to recover it. 00:27:46.039 [2024-11-21 03:44:26.407375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.039 [2024-11-21 03:44:26.407507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.039 [2024-11-21 03:44:26.407533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.039 qpair failed and we were unable to recover it. 00:27:46.039 [2024-11-21 03:44:26.407639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.039 [2024-11-21 03:44:26.407773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.039 [2024-11-21 03:44:26.407798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.039 qpair failed and we were unable to recover it. 00:27:46.039 [2024-11-21 03:44:26.407929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.039 [2024-11-21 03:44:26.408036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.039 [2024-11-21 03:44:26.408062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.039 qpair failed and we were unable to recover it. 00:27:46.039 [2024-11-21 03:44:26.408204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.039 [2024-11-21 03:44:26.408303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.039 [2024-11-21 03:44:26.408328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.039 qpair failed and we were unable to recover it. 00:27:46.039 [2024-11-21 03:44:26.408454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.039 [2024-11-21 03:44:26.408553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.039 [2024-11-21 03:44:26.408578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.039 qpair failed and we were unable to recover it. 00:27:46.039 [2024-11-21 03:44:26.408682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.039 [2024-11-21 03:44:26.408782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.039 [2024-11-21 03:44:26.408808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.039 qpair failed and we were unable to recover it. 00:27:46.039 [2024-11-21 03:44:26.408924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.039 [2024-11-21 03:44:26.409054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.039 [2024-11-21 03:44:26.409089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.039 qpair failed and we were unable to recover it. 00:27:46.039 [2024-11-21 03:44:26.409196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.039 [2024-11-21 03:44:26.409291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.039 [2024-11-21 03:44:26.409318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.039 qpair failed and we were unable to recover it. 00:27:46.039 [2024-11-21 03:44:26.409453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.039 [2024-11-21 03:44:26.409559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.039 [2024-11-21 03:44:26.409586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.039 qpair failed and we were unable to recover it. 00:27:46.039 [2024-11-21 03:44:26.409714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.039 [2024-11-21 03:44:26.409821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.039 [2024-11-21 03:44:26.409848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.039 qpair failed and we were unable to recover it. 00:27:46.039 [2024-11-21 03:44:26.409950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.039 [2024-11-21 03:44:26.410050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.039 [2024-11-21 03:44:26.410102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.039 qpair failed and we were unable to recover it. 00:27:46.039 [2024-11-21 03:44:26.410210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.039 [2024-11-21 03:44:26.410317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.040 [2024-11-21 03:44:26.410342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.040 qpair failed and we were unable to recover it. 00:27:46.040 [2024-11-21 03:44:26.410469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.040 [2024-11-21 03:44:26.410596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.040 [2024-11-21 03:44:26.410623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.040 qpair failed and we were unable to recover it. 00:27:46.040 [2024-11-21 03:44:26.410726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.040 [2024-11-21 03:44:26.410860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.040 [2024-11-21 03:44:26.410886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.040 qpair failed and we were unable to recover it. 00:27:46.040 [2024-11-21 03:44:26.410999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.040 [2024-11-21 03:44:26.411101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.040 [2024-11-21 03:44:26.411128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.040 qpair failed and we were unable to recover it. 00:27:46.040 [2024-11-21 03:44:26.411234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.040 [2024-11-21 03:44:26.411365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.040 [2024-11-21 03:44:26.411391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.040 qpair failed and we were unable to recover it. 00:27:46.040 [2024-11-21 03:44:26.411492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.040 [2024-11-21 03:44:26.411607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.040 [2024-11-21 03:44:26.411633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.040 qpair failed and we were unable to recover it. 00:27:46.040 [2024-11-21 03:44:26.411765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.040 [2024-11-21 03:44:26.411870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.040 [2024-11-21 03:44:26.411896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.040 qpair failed and we were unable to recover it. 00:27:46.040 [2024-11-21 03:44:26.412027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.040 [2024-11-21 03:44:26.412163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.040 [2024-11-21 03:44:26.412191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.040 qpair failed and we were unable to recover it. 00:27:46.040 [2024-11-21 03:44:26.412296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.040 [2024-11-21 03:44:26.412423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.040 [2024-11-21 03:44:26.412449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.040 qpair failed and we were unable to recover it. 00:27:46.040 [2024-11-21 03:44:26.412560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.040 [2024-11-21 03:44:26.412787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.040 [2024-11-21 03:44:26.412813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.040 qpair failed and we were unable to recover it. 00:27:46.040 [2024-11-21 03:44:26.412946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.040 [2024-11-21 03:44:26.413043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.040 [2024-11-21 03:44:26.413077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.040 qpair failed and we were unable to recover it. 00:27:46.040 [2024-11-21 03:44:26.413211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.040 [2024-11-21 03:44:26.413338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.040 [2024-11-21 03:44:26.413364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.040 qpair failed and we were unable to recover it. 00:27:46.040 [2024-11-21 03:44:26.413484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.040 [2024-11-21 03:44:26.413606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.040 [2024-11-21 03:44:26.413632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.040 qpair failed and we were unable to recover it. 00:27:46.040 [2024-11-21 03:44:26.413754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.040 [2024-11-21 03:44:26.413853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.040 [2024-11-21 03:44:26.413880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.040 qpair failed and we were unable to recover it. 00:27:46.040 [2024-11-21 03:44:26.414097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.040 [2024-11-21 03:44:26.414233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.040 [2024-11-21 03:44:26.414259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.040 qpair failed and we were unable to recover it. 00:27:46.040 [2024-11-21 03:44:26.414354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.040 [2024-11-21 03:44:26.414465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.040 [2024-11-21 03:44:26.414495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.040 qpair failed and we were unable to recover it. 00:27:46.040 [2024-11-21 03:44:26.414655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.040 [2024-11-21 03:44:26.414777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.040 [2024-11-21 03:44:26.414803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.040 qpair failed and we were unable to recover it. 00:27:46.040 [2024-11-21 03:44:26.414956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.040 [2024-11-21 03:44:26.415085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.040 [2024-11-21 03:44:26.415112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.040 qpair failed and we were unable to recover it. 00:27:46.040 [2024-11-21 03:44:26.415225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.040 [2024-11-21 03:44:26.415351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.040 [2024-11-21 03:44:26.415378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.040 qpair failed and we were unable to recover it. 00:27:46.040 [2024-11-21 03:44:26.415504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.040 [2024-11-21 03:44:26.415609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.040 [2024-11-21 03:44:26.415635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.040 qpair failed and we were unable to recover it. 00:27:46.040 [2024-11-21 03:44:26.415738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.040 [2024-11-21 03:44:26.415831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.040 [2024-11-21 03:44:26.415857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.040 qpair failed and we were unable to recover it. 00:27:46.040 [2024-11-21 03:44:26.415954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.040 [2024-11-21 03:44:26.416052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.040 [2024-11-21 03:44:26.416084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.040 qpair failed and we were unable to recover it. 00:27:46.040 [2024-11-21 03:44:26.416191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.040 [2024-11-21 03:44:26.416292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.040 [2024-11-21 03:44:26.416317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.040 qpair failed and we were unable to recover it. 00:27:46.040 [2024-11-21 03:44:26.416419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.040 [2024-11-21 03:44:26.416540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.040 [2024-11-21 03:44:26.416566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.040 qpair failed and we were unable to recover it. 00:27:46.040 [2024-11-21 03:44:26.416689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.040 [2024-11-21 03:44:26.416785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.040 [2024-11-21 03:44:26.416811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.040 qpair failed and we were unable to recover it. 00:27:46.040 [2024-11-21 03:44:26.416914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.040 [2024-11-21 03:44:26.417021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.040 [2024-11-21 03:44:26.417047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.040 qpair failed and we were unable to recover it. 00:27:46.040 [2024-11-21 03:44:26.417157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.040 [2024-11-21 03:44:26.417259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.040 [2024-11-21 03:44:26.417285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.040 qpair failed and we were unable to recover it. 00:27:46.040 [2024-11-21 03:44:26.417402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.040 [2024-11-21 03:44:26.417531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.040 [2024-11-21 03:44:26.417557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.040 qpair failed and we were unable to recover it. 00:27:46.040 [2024-11-21 03:44:26.417710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.040 [2024-11-21 03:44:26.417811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.040 [2024-11-21 03:44:26.417838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.040 qpair failed and we were unable to recover it. 00:27:46.040 [2024-11-21 03:44:26.417948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.040 [2024-11-21 03:44:26.418056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.041 [2024-11-21 03:44:26.418091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.041 qpair failed and we were unable to recover it. 00:27:46.041 [2024-11-21 03:44:26.418224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.041 [2024-11-21 03:44:26.418354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.041 [2024-11-21 03:44:26.418379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.041 qpair failed and we were unable to recover it. 00:27:46.041 [2024-11-21 03:44:26.418505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.041 [2024-11-21 03:44:26.418639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.041 [2024-11-21 03:44:26.418666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.041 qpair failed and we were unable to recover it. 00:27:46.041 [2024-11-21 03:44:26.418794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.041 [2024-11-21 03:44:26.418922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.041 [2024-11-21 03:44:26.418949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.041 qpair failed and we were unable to recover it. 00:27:46.041 [2024-11-21 03:44:26.419111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.041 [2024-11-21 03:44:26.419238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.041 [2024-11-21 03:44:26.419265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.041 qpair failed and we were unable to recover it. 00:27:46.041 [2024-11-21 03:44:26.419400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.041 [2024-11-21 03:44:26.419528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.041 [2024-11-21 03:44:26.419553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.041 qpair failed and we were unable to recover it. 00:27:46.041 [2024-11-21 03:44:26.419682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.041 [2024-11-21 03:44:26.419843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.041 [2024-11-21 03:44:26.419868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.041 qpair failed and we were unable to recover it. 00:27:46.041 [2024-11-21 03:44:26.419970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.041 [2024-11-21 03:44:26.420066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.041 [2024-11-21 03:44:26.420099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.041 qpair failed and we were unable to recover it. 00:27:46.041 [2024-11-21 03:44:26.420210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.041 [2024-11-21 03:44:26.420337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.041 [2024-11-21 03:44:26.420363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.041 qpair failed and we were unable to recover it. 00:27:46.041 [2024-11-21 03:44:26.420463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.041 [2024-11-21 03:44:26.420559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.041 [2024-11-21 03:44:26.420585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.041 qpair failed and we were unable to recover it. 00:27:46.041 [2024-11-21 03:44:26.420688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.041 [2024-11-21 03:44:26.420822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.041 [2024-11-21 03:44:26.420847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.041 qpair failed and we were unable to recover it. 00:27:46.041 [2024-11-21 03:44:26.420946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.041 [2024-11-21 03:44:26.421047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.041 [2024-11-21 03:44:26.421079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.041 qpair failed and we were unable to recover it. 00:27:46.041 [2024-11-21 03:44:26.421208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.041 [2024-11-21 03:44:26.421310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.041 [2024-11-21 03:44:26.421335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.041 qpair failed and we were unable to recover it. 00:27:46.041 [2024-11-21 03:44:26.421498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.041 [2024-11-21 03:44:26.421630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.041 [2024-11-21 03:44:26.421655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.041 qpair failed and we were unable to recover it. 00:27:46.041 [2024-11-21 03:44:26.421753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.041 [2024-11-21 03:44:26.421853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.041 [2024-11-21 03:44:26.421878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.041 qpair failed and we were unable to recover it. 00:27:46.041 [2024-11-21 03:44:26.421988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.041 [2024-11-21 03:44:26.422119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.041 [2024-11-21 03:44:26.422145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.041 qpair failed and we were unable to recover it. 00:27:46.041 [2024-11-21 03:44:26.422297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.041 [2024-11-21 03:44:26.422428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.041 [2024-11-21 03:44:26.422454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.041 qpair failed and we were unable to recover it. 00:27:46.041 [2024-11-21 03:44:26.422560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.041 [2024-11-21 03:44:26.422686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.041 [2024-11-21 03:44:26.422713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.041 qpair failed and we were unable to recover it. 00:27:46.041 [2024-11-21 03:44:26.422848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.041 [2024-11-21 03:44:26.422951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.041 [2024-11-21 03:44:26.422977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.041 qpair failed and we were unable to recover it. 00:27:46.041 [2024-11-21 03:44:26.423105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.041 [2024-11-21 03:44:26.423262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.041 [2024-11-21 03:44:26.423289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.041 qpair failed and we were unable to recover it. 00:27:46.041 [2024-11-21 03:44:26.423391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.041 [2024-11-21 03:44:26.423484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.041 [2024-11-21 03:44:26.423510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.041 qpair failed and we were unable to recover it. 00:27:46.041 [2024-11-21 03:44:26.423635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.041 [2024-11-21 03:44:26.423769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.041 [2024-11-21 03:44:26.423794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.041 qpair failed and we were unable to recover it. 00:27:46.041 [2024-11-21 03:44:26.423902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.041 [2024-11-21 03:44:26.424029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.041 [2024-11-21 03:44:26.424055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.041 qpair failed and we were unable to recover it. 00:27:46.041 [2024-11-21 03:44:26.424176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.041 [2024-11-21 03:44:26.424271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.041 [2024-11-21 03:44:26.424296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.041 qpair failed and we were unable to recover it. 00:27:46.041 [2024-11-21 03:44:26.424434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.041 [2024-11-21 03:44:26.424556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.041 [2024-11-21 03:44:26.424582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.041 qpair failed and we were unable to recover it. 00:27:46.041 [2024-11-21 03:44:26.424765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.041 [2024-11-21 03:44:26.424902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.041 [2024-11-21 03:44:26.424930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.041 qpair failed and we were unable to recover it. 00:27:46.041 [2024-11-21 03:44:26.425044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.041 [2024-11-21 03:44:26.425189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.041 [2024-11-21 03:44:26.425218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.041 qpair failed and we were unable to recover it. 00:27:46.041 [2024-11-21 03:44:26.425378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.041 [2024-11-21 03:44:26.425515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.041 [2024-11-21 03:44:26.425542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.042 qpair failed and we were unable to recover it. 00:27:46.042 [2024-11-21 03:44:26.425670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.042 [2024-11-21 03:44:26.425797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.042 [2024-11-21 03:44:26.425823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.042 qpair failed and we were unable to recover it. 00:27:46.042 [2024-11-21 03:44:26.425957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.042 [2024-11-21 03:44:26.426091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.042 [2024-11-21 03:44:26.426119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.042 qpair failed and we were unable to recover it. 00:27:46.042 [2024-11-21 03:44:26.426217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.042 [2024-11-21 03:44:26.426317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.042 [2024-11-21 03:44:26.426342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.042 qpair failed and we were unable to recover it. 00:27:46.042 [2024-11-21 03:44:26.426442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.042 [2024-11-21 03:44:26.426573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.042 [2024-11-21 03:44:26.426598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.042 qpair failed and we were unable to recover it. 00:27:46.042 [2024-11-21 03:44:26.426692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.042 [2024-11-21 03:44:26.426799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.042 [2024-11-21 03:44:26.426826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.042 qpair failed and we were unable to recover it. 00:27:46.042 [2024-11-21 03:44:26.426959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.042 [2024-11-21 03:44:26.427090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.042 [2024-11-21 03:44:26.427117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.042 qpair failed and we were unable to recover it. 00:27:46.042 [2024-11-21 03:44:26.427247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.042 [2024-11-21 03:44:26.427359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.042 [2024-11-21 03:44:26.427385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.042 qpair failed and we were unable to recover it. 00:27:46.042 [2024-11-21 03:44:26.427476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.042 [2024-11-21 03:44:26.427604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.042 [2024-11-21 03:44:26.427630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.042 qpair failed and we were unable to recover it. 00:27:46.042 [2024-11-21 03:44:26.427753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.042 [2024-11-21 03:44:26.427878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.042 [2024-11-21 03:44:26.427903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.042 qpair failed and we were unable to recover it. 00:27:46.042 [2024-11-21 03:44:26.428078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.042 [2024-11-21 03:44:26.428202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.042 [2024-11-21 03:44:26.428233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.042 qpair failed and we were unable to recover it. 00:27:46.042 [2024-11-21 03:44:26.428368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.042 [2024-11-21 03:44:26.428469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.042 [2024-11-21 03:44:26.428495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.042 qpair failed and we were unable to recover it. 00:27:46.042 [2024-11-21 03:44:26.428597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.042 [2024-11-21 03:44:26.428747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.042 [2024-11-21 03:44:26.428773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.042 qpair failed and we were unable to recover it. 00:27:46.042 [2024-11-21 03:44:26.428926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.042 [2024-11-21 03:44:26.429030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.042 [2024-11-21 03:44:26.429056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.042 qpair failed and we were unable to recover it. 00:27:46.042 [2024-11-21 03:44:26.429176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.042 [2024-11-21 03:44:26.429283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.042 [2024-11-21 03:44:26.429308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.042 qpair failed and we were unable to recover it. 00:27:46.042 [2024-11-21 03:44:26.429412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.042 [2024-11-21 03:44:26.429536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.042 [2024-11-21 03:44:26.429563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.042 qpair failed and we were unable to recover it. 00:27:46.042 [2024-11-21 03:44:26.429688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.042 [2024-11-21 03:44:26.429818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.042 [2024-11-21 03:44:26.429845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.042 qpair failed and we were unable to recover it. 00:27:46.042 [2024-11-21 03:44:26.429937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.042 [2024-11-21 03:44:26.430062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.042 [2024-11-21 03:44:26.430094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.042 qpair failed and we were unable to recover it. 00:27:46.042 [2024-11-21 03:44:26.430250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.042 [2024-11-21 03:44:26.430378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.042 [2024-11-21 03:44:26.430403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.042 qpair failed and we were unable to recover it. 00:27:46.042 [2024-11-21 03:44:26.430511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.042 [2024-11-21 03:44:26.430634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.042 [2024-11-21 03:44:26.430659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.042 qpair failed and we were unable to recover it. 00:27:46.042 [2024-11-21 03:44:26.430751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.042 [2024-11-21 03:44:26.430874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.042 [2024-11-21 03:44:26.430904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.042 qpair failed and we were unable to recover it. 00:27:46.042 [2024-11-21 03:44:26.431040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.042 [2024-11-21 03:44:26.431157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.042 [2024-11-21 03:44:26.431184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.042 qpair failed and we were unable to recover it. 00:27:46.042 [2024-11-21 03:44:26.431316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.042 [2024-11-21 03:44:26.431440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.042 [2024-11-21 03:44:26.431466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.042 qpair failed and we were unable to recover it. 00:27:46.042 [2024-11-21 03:44:26.431598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.042 [2024-11-21 03:44:26.431725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.042 [2024-11-21 03:44:26.431752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.042 qpair failed and we were unable to recover it. 00:27:46.042 [2024-11-21 03:44:26.431906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.042 [2024-11-21 03:44:26.432064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.042 [2024-11-21 03:44:26.432099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.042 qpair failed and we were unable to recover it. 00:27:46.042 [2024-11-21 03:44:26.432256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.042 [2024-11-21 03:44:26.432389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.042 [2024-11-21 03:44:26.432414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.042 qpair failed and we were unable to recover it. 00:27:46.043 [2024-11-21 03:44:26.432544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.043 [2024-11-21 03:44:26.432702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.043 [2024-11-21 03:44:26.432728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.043 qpair failed and we were unable to recover it. 00:27:46.043 [2024-11-21 03:44:26.432863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.043 [2024-11-21 03:44:26.432967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.043 [2024-11-21 03:44:26.432993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.043 qpair failed and we were unable to recover it. 00:27:46.043 [2024-11-21 03:44:26.433125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.043 [2024-11-21 03:44:26.433255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.043 [2024-11-21 03:44:26.433281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.043 qpair failed and we were unable to recover it. 00:27:46.043 [2024-11-21 03:44:26.433378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.043 [2024-11-21 03:44:26.433477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.043 [2024-11-21 03:44:26.433503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.043 qpair failed and we were unable to recover it. 00:27:46.043 [2024-11-21 03:44:26.433634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.043 [2024-11-21 03:44:26.433767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.043 [2024-11-21 03:44:26.433794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.043 qpair failed and we were unable to recover it. 00:27:46.043 [2024-11-21 03:44:26.433904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.043 [2024-11-21 03:44:26.434062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.043 [2024-11-21 03:44:26.434115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.043 qpair failed and we were unable to recover it. 00:27:46.043 [2024-11-21 03:44:26.434222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.043 [2024-11-21 03:44:26.434354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.043 [2024-11-21 03:44:26.434381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.043 qpair failed and we were unable to recover it. 00:27:46.043 [2024-11-21 03:44:26.434488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.043 [2024-11-21 03:44:26.434594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.043 [2024-11-21 03:44:26.434620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.043 qpair failed and we were unable to recover it. 00:27:46.043 [2024-11-21 03:44:26.434757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.043 [2024-11-21 03:44:26.434856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.043 [2024-11-21 03:44:26.434883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.043 qpair failed and we were unable to recover it. 00:27:46.043 [2024-11-21 03:44:26.435013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.043 [2024-11-21 03:44:26.435117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.043 [2024-11-21 03:44:26.435144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.043 qpair failed and we were unable to recover it. 00:27:46.043 [2024-11-21 03:44:26.435251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.043 [2024-11-21 03:44:26.435354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.043 [2024-11-21 03:44:26.435381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.043 qpair failed and we were unable to recover it. 00:27:46.043 [2024-11-21 03:44:26.435484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.043 [2024-11-21 03:44:26.435586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.043 [2024-11-21 03:44:26.435613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.043 qpair failed and we were unable to recover it. 00:27:46.043 [2024-11-21 03:44:26.435739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.043 [2024-11-21 03:44:26.435846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.043 [2024-11-21 03:44:26.435873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.043 qpair failed and we were unable to recover it. 00:27:46.043 [2024-11-21 03:44:26.436000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.043 [2024-11-21 03:44:26.436096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.043 [2024-11-21 03:44:26.436122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.043 qpair failed and we were unable to recover it. 00:27:46.043 [2024-11-21 03:44:26.436221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.043 [2024-11-21 03:44:26.436349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.043 [2024-11-21 03:44:26.436375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.043 qpair failed and we were unable to recover it. 00:27:46.043 [2024-11-21 03:44:26.436509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.043 [2024-11-21 03:44:26.436640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.043 [2024-11-21 03:44:26.436666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.043 qpair failed and we were unable to recover it. 00:27:46.043 [2024-11-21 03:44:26.436805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.043 [2024-11-21 03:44:26.436932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.043 [2024-11-21 03:44:26.436959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.043 qpair failed and we were unable to recover it. 00:27:46.043 [2024-11-21 03:44:26.437056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.043 [2024-11-21 03:44:26.437238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.043 [2024-11-21 03:44:26.437266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.043 qpair failed and we were unable to recover it. 00:27:46.043 [2024-11-21 03:44:26.437400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.043 [2024-11-21 03:44:26.437519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.043 [2024-11-21 03:44:26.437546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.043 qpair failed and we were unable to recover it. 00:27:46.043 [2024-11-21 03:44:26.437671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.043 [2024-11-21 03:44:26.437801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.043 [2024-11-21 03:44:26.437828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.043 qpair failed and we were unable to recover it. 00:27:46.043 [2024-11-21 03:44:26.437921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.043 [2024-11-21 03:44:26.438055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.043 [2024-11-21 03:44:26.438089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.043 qpair failed and we were unable to recover it. 00:27:46.043 [2024-11-21 03:44:26.438223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.043 [2024-11-21 03:44:26.438389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.043 [2024-11-21 03:44:26.438416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.043 qpair failed and we were unable to recover it. 00:27:46.043 [2024-11-21 03:44:26.438544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.043 [2024-11-21 03:44:26.438699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.043 [2024-11-21 03:44:26.438725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.043 qpair failed and we were unable to recover it. 00:27:46.043 [2024-11-21 03:44:26.438852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.043 [2024-11-21 03:44:26.438975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.043 [2024-11-21 03:44:26.439001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.043 qpair failed and we were unable to recover it. 00:27:46.043 [2024-11-21 03:44:26.439100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.043 [2024-11-21 03:44:26.439202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.043 [2024-11-21 03:44:26.439228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.043 qpair failed and we were unable to recover it. 00:27:46.043 [2024-11-21 03:44:26.439334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.043 [2024-11-21 03:44:26.439464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.043 [2024-11-21 03:44:26.439490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.043 qpair failed and we were unable to recover it. 00:27:46.043 [2024-11-21 03:44:26.439608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.043 [2024-11-21 03:44:26.439715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.043 [2024-11-21 03:44:26.439743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.043 qpair failed and we were unable to recover it. 00:27:46.043 [2024-11-21 03:44:26.439907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.043 [2024-11-21 03:44:26.440001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.043 [2024-11-21 03:44:26.440027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.043 qpair failed and we were unable to recover it. 00:27:46.043 [2024-11-21 03:44:26.440135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.043 [2024-11-21 03:44:26.440228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.044 [2024-11-21 03:44:26.440255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.044 qpair failed and we were unable to recover it. 00:27:46.044 [2024-11-21 03:44:26.440360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.044 [2024-11-21 03:44:26.440487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.044 [2024-11-21 03:44:26.440513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.044 qpair failed and we were unable to recover it. 00:27:46.044 [2024-11-21 03:44:26.440667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.044 [2024-11-21 03:44:26.440795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.044 [2024-11-21 03:44:26.440821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.044 qpair failed and we were unable to recover it. 00:27:46.044 [2024-11-21 03:44:26.440919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.044 [2024-11-21 03:44:26.441081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.044 [2024-11-21 03:44:26.441108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.044 qpair failed and we were unable to recover it. 00:27:46.044 [2024-11-21 03:44:26.441263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.044 [2024-11-21 03:44:26.441389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.044 [2024-11-21 03:44:26.441415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.044 qpair failed and we were unable to recover it. 00:27:46.044 [2024-11-21 03:44:26.441543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.044 [2024-11-21 03:44:26.441642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.044 [2024-11-21 03:44:26.441669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.044 qpair failed and we were unable to recover it. 00:27:46.044 [2024-11-21 03:44:26.441803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.044 [2024-11-21 03:44:26.441936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.044 [2024-11-21 03:44:26.441962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.044 qpair failed and we were unable to recover it. 00:27:46.044 [2024-11-21 03:44:26.442151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.044 [2024-11-21 03:44:26.442283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.044 [2024-11-21 03:44:26.442309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.044 qpair failed and we were unable to recover it. 00:27:46.044 [2024-11-21 03:44:26.442453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.044 [2024-11-21 03:44:26.442604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.044 [2024-11-21 03:44:26.442634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.044 qpair failed and we were unable to recover it. 00:27:46.044 [2024-11-21 03:44:26.442761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.044 [2024-11-21 03:44:26.442913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.044 [2024-11-21 03:44:26.442940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.044 qpair failed and we were unable to recover it. 00:27:46.044 [2024-11-21 03:44:26.443091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.044 [2024-11-21 03:44:26.443244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.044 [2024-11-21 03:44:26.443272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.044 qpair failed and we were unable to recover it. 00:27:46.044 [2024-11-21 03:44:26.443388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.044 [2024-11-21 03:44:26.443544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.044 [2024-11-21 03:44:26.443570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.044 qpair failed and we were unable to recover it. 00:27:46.044 [2024-11-21 03:44:26.443690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.044 [2024-11-21 03:44:26.443845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.044 [2024-11-21 03:44:26.443871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.044 qpair failed and we were unable to recover it. 00:27:46.044 [2024-11-21 03:44:26.444002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.044 [2024-11-21 03:44:26.444166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.044 [2024-11-21 03:44:26.444193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.044 qpair failed and we were unable to recover it. 00:27:46.044 [2024-11-21 03:44:26.444325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.044 [2024-11-21 03:44:26.444431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.044 [2024-11-21 03:44:26.444457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.044 qpair failed and we were unable to recover it. 00:27:46.044 [2024-11-21 03:44:26.444595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.044 [2024-11-21 03:44:26.444727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.044 [2024-11-21 03:44:26.444753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.044 qpair failed and we were unable to recover it. 00:27:46.044 [2024-11-21 03:44:26.444860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.044 [2024-11-21 03:44:26.445004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.044 [2024-11-21 03:44:26.445032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.044 qpair failed and we were unable to recover it. 00:27:46.044 [2024-11-21 03:44:26.445204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.044 [2024-11-21 03:44:26.445331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.044 [2024-11-21 03:44:26.445362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.044 qpair failed and we were unable to recover it. 00:27:46.044 [2024-11-21 03:44:26.445492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.044 [2024-11-21 03:44:26.445591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.044 [2024-11-21 03:44:26.445617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.044 qpair failed and we were unable to recover it. 00:27:46.044 [2024-11-21 03:44:26.445725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.044 [2024-11-21 03:44:26.445881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.044 [2024-11-21 03:44:26.445907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.044 qpair failed and we were unable to recover it. 00:27:46.044 [2024-11-21 03:44:26.446089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.044 [2024-11-21 03:44:26.446206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.044 [2024-11-21 03:44:26.446234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.044 qpair failed and we were unable to recover it. 00:27:46.044 [2024-11-21 03:44:26.446414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.044 [2024-11-21 03:44:26.446510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.044 [2024-11-21 03:44:26.446535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.044 qpair failed and we were unable to recover it. 00:27:46.044 [2024-11-21 03:44:26.446678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.044 [2024-11-21 03:44:26.446845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.044 [2024-11-21 03:44:26.446873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.044 qpair failed and we were unable to recover it. 00:27:46.044 [2024-11-21 03:44:26.447018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.044 [2024-11-21 03:44:26.447188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.044 [2024-11-21 03:44:26.447218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.044 qpair failed and we were unable to recover it. 00:27:46.044 [2024-11-21 03:44:26.447367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.044 [2024-11-21 03:44:26.447519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.044 [2024-11-21 03:44:26.447544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.044 qpair failed and we were unable to recover it. 00:27:46.044 [2024-11-21 03:44:26.447704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.044 [2024-11-21 03:44:26.447804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.044 [2024-11-21 03:44:26.447841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.044 qpair failed and we were unable to recover it. 00:27:46.044 [2024-11-21 03:44:26.447969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.044 [2024-11-21 03:44:26.448142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.044 [2024-11-21 03:44:26.448171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.044 qpair failed and we were unable to recover it. 00:27:46.044 [2024-11-21 03:44:26.448297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.044 [2024-11-21 03:44:26.448427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.044 [2024-11-21 03:44:26.448453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.044 qpair failed and we were unable to recover it. 00:27:46.044 [2024-11-21 03:44:26.448649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.044 [2024-11-21 03:44:26.448789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.044 [2024-11-21 03:44:26.448818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.044 qpair failed and we were unable to recover it. 00:27:46.044 [2024-11-21 03:44:26.448932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.045 [2024-11-21 03:44:26.449076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.045 [2024-11-21 03:44:26.449120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.045 qpair failed and we were unable to recover it. 00:27:46.045 [2024-11-21 03:44:26.449249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.045 [2024-11-21 03:44:26.449349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.045 [2024-11-21 03:44:26.449375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.045 qpair failed and we were unable to recover it. 00:27:46.045 [2024-11-21 03:44:26.449542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.045 [2024-11-21 03:44:26.449683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.045 [2024-11-21 03:44:26.449708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.045 qpair failed and we were unable to recover it. 00:27:46.045 [2024-11-21 03:44:26.449831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.045 [2024-11-21 03:44:26.449981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.045 [2024-11-21 03:44:26.450010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.045 qpair failed and we were unable to recover it. 00:27:46.045 [2024-11-21 03:44:26.450141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.045 [2024-11-21 03:44:26.450302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.045 [2024-11-21 03:44:26.450328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.045 qpair failed and we were unable to recover it. 00:27:46.045 [2024-11-21 03:44:26.450473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.045 [2024-11-21 03:44:26.450652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.045 [2024-11-21 03:44:26.450681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.045 qpair failed and we were unable to recover it. 00:27:46.045 [2024-11-21 03:44:26.450855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.045 [2024-11-21 03:44:26.451032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.045 [2024-11-21 03:44:26.451062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.045 qpair failed and we were unable to recover it. 00:27:46.045 [2024-11-21 03:44:26.451215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.045 [2024-11-21 03:44:26.451347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.045 [2024-11-21 03:44:26.451373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.045 qpair failed and we were unable to recover it. 00:27:46.045 [2024-11-21 03:44:26.451531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.045 [2024-11-21 03:44:26.451750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.045 [2024-11-21 03:44:26.451806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.045 qpair failed and we were unable to recover it. 00:27:46.045 [2024-11-21 03:44:26.451925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.045 [2024-11-21 03:44:26.452090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.045 [2024-11-21 03:44:26.452129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.045 qpair failed and we were unable to recover it. 00:27:46.045 [2024-11-21 03:44:26.452239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.045 [2024-11-21 03:44:26.452334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.045 [2024-11-21 03:44:26.452361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.045 qpair failed and we were unable to recover it. 00:27:46.045 [2024-11-21 03:44:26.452473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.045 [2024-11-21 03:44:26.452587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.045 [2024-11-21 03:44:26.452616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.045 qpair failed and we were unable to recover it. 00:27:46.045 [2024-11-21 03:44:26.452731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.045 [2024-11-21 03:44:26.452873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.045 [2024-11-21 03:44:26.452902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.045 qpair failed and we were unable to recover it. 00:27:46.045 [2024-11-21 03:44:26.453056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.045 [2024-11-21 03:44:26.453175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.045 [2024-11-21 03:44:26.453204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.045 qpair failed and we were unable to recover it. 00:27:46.045 [2024-11-21 03:44:26.453363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.045 [2024-11-21 03:44:26.453513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.045 [2024-11-21 03:44:26.453539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.045 qpair failed and we were unable to recover it. 00:27:46.045 [2024-11-21 03:44:26.453668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.045 [2024-11-21 03:44:26.453797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.045 [2024-11-21 03:44:26.453826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.045 qpair failed and we were unable to recover it. 00:27:46.045 [2024-11-21 03:44:26.453953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.045 [2024-11-21 03:44:26.454080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.045 [2024-11-21 03:44:26.454107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.045 qpair failed and we were unable to recover it. 00:27:46.045 [2024-11-21 03:44:26.454216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.045 [2024-11-21 03:44:26.454363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.045 [2024-11-21 03:44:26.454393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.045 qpair failed and we were unable to recover it. 00:27:46.045 [2024-11-21 03:44:26.454543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.045 [2024-11-21 03:44:26.454719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.045 [2024-11-21 03:44:26.454748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.045 qpair failed and we were unable to recover it. 00:27:46.045 [2024-11-21 03:44:26.454869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.045 [2024-11-21 03:44:26.455006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.045 [2024-11-21 03:44:26.455032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.045 qpair failed and we were unable to recover it. 00:27:46.045 [2024-11-21 03:44:26.455172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.045 [2024-11-21 03:44:26.455269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.045 [2024-11-21 03:44:26.455296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.045 qpair failed and we were unable to recover it. 00:27:46.045 [2024-11-21 03:44:26.455429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.045 [2024-11-21 03:44:26.455583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.045 [2024-11-21 03:44:26.455612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.045 qpair failed and we were unable to recover it. 00:27:46.045 [2024-11-21 03:44:26.455769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.045 [2024-11-21 03:44:26.455939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.045 [2024-11-21 03:44:26.455983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.045 qpair failed and we were unable to recover it. 00:27:46.045 [2024-11-21 03:44:26.456094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.045 [2024-11-21 03:44:26.456212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.045 [2024-11-21 03:44:26.456239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.045 qpair failed and we were unable to recover it. 00:27:46.045 [2024-11-21 03:44:26.456362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.045 [2024-11-21 03:44:26.456510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.045 [2024-11-21 03:44:26.456539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.045 qpair failed and we were unable to recover it. 00:27:46.045 [2024-11-21 03:44:26.456656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.045 [2024-11-21 03:44:26.456791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.045 [2024-11-21 03:44:26.456818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.045 qpair failed and we were unable to recover it. 00:27:46.045 [2024-11-21 03:44:26.456942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.045 [2024-11-21 03:44:26.457079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.045 [2024-11-21 03:44:26.457106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.045 qpair failed and we were unable to recover it. 00:27:46.045 [2024-11-21 03:44:26.457207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.045 [2024-11-21 03:44:26.457329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.045 [2024-11-21 03:44:26.457355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.045 qpair failed and we were unable to recover it. 00:27:46.045 [2024-11-21 03:44:26.457483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.045 [2024-11-21 03:44:26.457612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.045 [2024-11-21 03:44:26.457638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.045 qpair failed and we were unable to recover it. 00:27:46.046 [2024-11-21 03:44:26.457764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.046 [2024-11-21 03:44:26.457949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.046 [2024-11-21 03:44:26.457976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.046 qpair failed and we were unable to recover it. 00:27:46.046 [2024-11-21 03:44:26.458120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.046 [2024-11-21 03:44:26.458244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.046 [2024-11-21 03:44:26.458270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.046 qpair failed and we were unable to recover it. 00:27:46.046 [2024-11-21 03:44:26.458400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.046 [2024-11-21 03:44:26.458504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.046 [2024-11-21 03:44:26.458530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.046 qpair failed and we were unable to recover it. 00:27:46.046 [2024-11-21 03:44:26.458690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.046 [2024-11-21 03:44:26.458836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.046 [2024-11-21 03:44:26.458865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.046 qpair failed and we were unable to recover it. 00:27:46.046 [2024-11-21 03:44:26.459000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.046 [2024-11-21 03:44:26.459108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.046 [2024-11-21 03:44:26.459152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.046 qpair failed and we were unable to recover it. 00:27:46.046 [2024-11-21 03:44:26.459311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.046 [2024-11-21 03:44:26.459443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.046 [2024-11-21 03:44:26.459486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.046 qpair failed and we were unable to recover it. 00:27:46.046 [2024-11-21 03:44:26.459656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.046 [2024-11-21 03:44:26.459823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.046 [2024-11-21 03:44:26.459852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.046 qpair failed and we were unable to recover it. 00:27:46.046 [2024-11-21 03:44:26.459964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.046 [2024-11-21 03:44:26.460067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.046 [2024-11-21 03:44:26.460106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.046 qpair failed and we were unable to recover it. 00:27:46.046 [2024-11-21 03:44:26.460268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.046 [2024-11-21 03:44:26.460374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.046 [2024-11-21 03:44:26.460401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.046 qpair failed and we were unable to recover it. 00:27:46.046 [2024-11-21 03:44:26.460579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.046 [2024-11-21 03:44:26.460749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.046 [2024-11-21 03:44:26.460774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.046 qpair failed and we were unable to recover it. 00:27:46.046 [2024-11-21 03:44:26.460967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.046 [2024-11-21 03:44:26.461123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.046 [2024-11-21 03:44:26.461157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.046 qpair failed and we were unable to recover it. 00:27:46.046 [2024-11-21 03:44:26.461293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.046 [2024-11-21 03:44:26.461394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.046 [2024-11-21 03:44:26.461423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.046 qpair failed and we were unable to recover it. 00:27:46.046 [2024-11-21 03:44:26.461608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.046 [2024-11-21 03:44:26.461763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.046 [2024-11-21 03:44:26.461789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.046 qpair failed and we were unable to recover it. 00:27:46.046 [2024-11-21 03:44:26.461919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.046 [2024-11-21 03:44:26.462063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.046 [2024-11-21 03:44:26.462101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.046 qpair failed and we were unable to recover it. 00:27:46.046 [2024-11-21 03:44:26.462225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.046 [2024-11-21 03:44:26.462358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.046 [2024-11-21 03:44:26.462384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.046 qpair failed and we were unable to recover it. 00:27:46.046 [2024-11-21 03:44:26.462544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.046 [2024-11-21 03:44:26.462708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.046 [2024-11-21 03:44:26.462735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.046 qpair failed and we were unable to recover it. 00:27:46.046 [2024-11-21 03:44:26.462914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.046 [2024-11-21 03:44:26.463056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.046 [2024-11-21 03:44:26.463092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.046 qpair failed and we were unable to recover it. 00:27:46.046 [2024-11-21 03:44:26.463236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.046 [2024-11-21 03:44:26.463368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.046 [2024-11-21 03:44:26.463393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.046 qpair failed and we were unable to recover it. 00:27:46.046 [2024-11-21 03:44:26.463549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.046 [2024-11-21 03:44:26.463683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.046 [2024-11-21 03:44:26.463712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.046 qpair failed and we were unable to recover it. 00:27:46.046 [2024-11-21 03:44:26.463881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.046 [2024-11-21 03:44:26.464018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.046 [2024-11-21 03:44:26.464047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.046 qpair failed and we were unable to recover it. 00:27:46.046 [2024-11-21 03:44:26.464206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.046 [2024-11-21 03:44:26.464304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.046 [2024-11-21 03:44:26.464330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.046 qpair failed and we were unable to recover it. 00:27:46.046 [2024-11-21 03:44:26.464463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.046 [2024-11-21 03:44:26.464644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.046 [2024-11-21 03:44:26.464673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.046 qpair failed and we were unable to recover it. 00:27:46.046 [2024-11-21 03:44:26.464807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.046 [2024-11-21 03:44:26.464950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.046 [2024-11-21 03:44:26.464979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.046 qpair failed and we were unable to recover it. 00:27:46.046 [2024-11-21 03:44:26.465140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.046 [2024-11-21 03:44:26.465294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.046 [2024-11-21 03:44:26.465320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.046 qpair failed and we were unable to recover it. 00:27:46.046 [2024-11-21 03:44:26.465479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.046 [2024-11-21 03:44:26.465632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.046 [2024-11-21 03:44:26.465657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.046 qpair failed and we were unable to recover it. 00:27:46.046 [2024-11-21 03:44:26.465791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.046 [2024-11-21 03:44:26.465932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.046 [2024-11-21 03:44:26.465960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.046 qpair failed and we were unable to recover it. 00:27:46.046 [2024-11-21 03:44:26.466103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.046 [2024-11-21 03:44:26.466257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.046 [2024-11-21 03:44:26.466283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.046 qpair failed and we were unable to recover it. 00:27:46.046 [2024-11-21 03:44:26.466486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.046 [2024-11-21 03:44:26.466650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.046 [2024-11-21 03:44:26.466675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.046 qpair failed and we were unable to recover it. 00:27:46.046 [2024-11-21 03:44:26.466833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.046 [2024-11-21 03:44:26.466971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.047 [2024-11-21 03:44:26.467000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.047 qpair failed and we were unable to recover it. 00:27:46.047 [2024-11-21 03:44:26.467170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.047 [2024-11-21 03:44:26.467296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.047 [2024-11-21 03:44:26.467322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.047 qpair failed and we were unable to recover it. 00:27:46.047 [2024-11-21 03:44:26.467456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.047 [2024-11-21 03:44:26.467650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.047 [2024-11-21 03:44:26.467676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.047 qpair failed and we were unable to recover it. 00:27:46.047 [2024-11-21 03:44:26.467827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.047 [2024-11-21 03:44:26.467964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.047 [2024-11-21 03:44:26.467993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.047 qpair failed and we were unable to recover it. 00:27:46.047 [2024-11-21 03:44:26.468151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.047 [2024-11-21 03:44:26.468283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.047 [2024-11-21 03:44:26.468309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.047 qpair failed and we were unable to recover it. 00:27:46.047 [2024-11-21 03:44:26.468419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.047 [2024-11-21 03:44:26.468549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.047 [2024-11-21 03:44:26.468575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.047 qpair failed and we were unable to recover it. 00:27:46.047 [2024-11-21 03:44:26.468721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.047 [2024-11-21 03:44:26.468890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.047 [2024-11-21 03:44:26.468919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.047 qpair failed and we were unable to recover it. 00:27:46.047 [2024-11-21 03:44:26.469093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.047 [2024-11-21 03:44:26.469234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.047 [2024-11-21 03:44:26.469260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.047 qpair failed and we were unable to recover it. 00:27:46.047 [2024-11-21 03:44:26.469414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.047 [2024-11-21 03:44:26.469582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.047 [2024-11-21 03:44:26.469611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.047 qpair failed and we were unable to recover it. 00:27:46.047 [2024-11-21 03:44:26.469732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.047 [2024-11-21 03:44:26.469846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.047 [2024-11-21 03:44:26.469875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.047 qpair failed and we were unable to recover it. 00:27:46.047 [2024-11-21 03:44:26.470027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.047 [2024-11-21 03:44:26.470245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.047 [2024-11-21 03:44:26.470306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.047 qpair failed and we were unable to recover it. 00:27:46.047 [2024-11-21 03:44:26.470442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.047 [2024-11-21 03:44:26.470625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.047 [2024-11-21 03:44:26.470650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.047 qpair failed and we were unable to recover it. 00:27:46.047 [2024-11-21 03:44:26.470818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.047 [2024-11-21 03:44:26.470945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.047 [2024-11-21 03:44:26.470972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.047 qpair failed and we were unable to recover it. 00:27:46.047 [2024-11-21 03:44:26.471168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.047 [2024-11-21 03:44:26.471314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.047 [2024-11-21 03:44:26.471344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.047 qpair failed and we were unable to recover it. 00:27:46.047 [2024-11-21 03:44:26.471513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.047 [2024-11-21 03:44:26.471712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.047 [2024-11-21 03:44:26.471756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.047 qpair failed and we were unable to recover it. 00:27:46.047 [2024-11-21 03:44:26.471938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.047 [2024-11-21 03:44:26.472085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.047 [2024-11-21 03:44:26.472113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.047 qpair failed and we were unable to recover it. 00:27:46.047 [2024-11-21 03:44:26.472270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.047 [2024-11-21 03:44:26.472408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.047 [2024-11-21 03:44:26.472436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.047 qpair failed and we were unable to recover it. 00:27:46.047 [2024-11-21 03:44:26.472593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.047 [2024-11-21 03:44:26.472717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.047 [2024-11-21 03:44:26.472761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.047 qpair failed and we were unable to recover it. 00:27:46.047 [2024-11-21 03:44:26.472903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.047 [2024-11-21 03:44:26.473113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.047 [2024-11-21 03:44:26.473140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.047 qpair failed and we were unable to recover it. 00:27:46.047 [2024-11-21 03:44:26.473297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.047 [2024-11-21 03:44:26.473417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.047 [2024-11-21 03:44:26.473462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.047 qpair failed and we were unable to recover it. 00:27:46.047 [2024-11-21 03:44:26.473640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.047 [2024-11-21 03:44:26.473833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.047 [2024-11-21 03:44:26.473899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.047 qpair failed and we were unable to recover it. 00:27:46.047 [2024-11-21 03:44:26.474036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.047 [2024-11-21 03:44:26.474191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.047 [2024-11-21 03:44:26.474237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.047 qpair failed and we were unable to recover it. 00:27:46.047 [2024-11-21 03:44:26.474425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.047 [2024-11-21 03:44:26.474587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.047 [2024-11-21 03:44:26.474632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.048 qpair failed and we were unable to recover it. 00:27:46.048 [2024-11-21 03:44:26.474783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.048 [2024-11-21 03:44:26.474923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.048 [2024-11-21 03:44:26.474950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.048 qpair failed and we were unable to recover it. 00:27:46.048 [2024-11-21 03:44:26.475058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.048 [2024-11-21 03:44:26.475223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.048 [2024-11-21 03:44:26.475249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.048 qpair failed and we were unable to recover it. 00:27:46.048 [2024-11-21 03:44:26.475387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.048 [2024-11-21 03:44:26.475530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.048 [2024-11-21 03:44:26.475557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.048 qpair failed and we were unable to recover it. 00:27:46.048 [2024-11-21 03:44:26.475659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.048 [2024-11-21 03:44:26.475812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.048 [2024-11-21 03:44:26.475839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.048 qpair failed and we were unable to recover it. 00:27:46.048 [2024-11-21 03:44:26.475974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.048 [2024-11-21 03:44:26.476134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.048 [2024-11-21 03:44:26.476162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.048 qpair failed and we were unable to recover it. 00:27:46.048 [2024-11-21 03:44:26.476320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.048 [2024-11-21 03:44:26.476520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.048 [2024-11-21 03:44:26.476566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.048 qpair failed and we were unable to recover it. 00:27:46.048 [2024-11-21 03:44:26.476705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.048 [2024-11-21 03:44:26.476840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.048 [2024-11-21 03:44:26.476867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.048 qpair failed and we were unable to recover it. 00:27:46.048 [2024-11-21 03:44:26.477081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.048 [2024-11-21 03:44:26.477264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.048 [2024-11-21 03:44:26.477309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.048 qpair failed and we were unable to recover it. 00:27:46.048 [2024-11-21 03:44:26.477489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.048 [2024-11-21 03:44:26.477681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.048 [2024-11-21 03:44:26.477725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.048 qpair failed and we were unable to recover it. 00:27:46.048 [2024-11-21 03:44:26.477857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.048 [2024-11-21 03:44:26.478018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.048 [2024-11-21 03:44:26.478044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.048 qpair failed and we were unable to recover it. 00:27:46.048 [2024-11-21 03:44:26.478211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.048 [2024-11-21 03:44:26.478416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.048 [2024-11-21 03:44:26.478459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.048 qpair failed and we were unable to recover it. 00:27:46.048 [2024-11-21 03:44:26.478671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.048 [2024-11-21 03:44:26.478859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.048 [2024-11-21 03:44:26.478886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.048 qpair failed and we were unable to recover it. 00:27:46.048 [2024-11-21 03:44:26.479012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.048 [2024-11-21 03:44:26.479202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.048 [2024-11-21 03:44:26.479229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.048 qpair failed and we were unable to recover it. 00:27:46.048 [2024-11-21 03:44:26.479392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.048 [2024-11-21 03:44:26.479530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.048 [2024-11-21 03:44:26.479558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.048 qpair failed and we were unable to recover it. 00:27:46.048 [2024-11-21 03:44:26.479770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.048 [2024-11-21 03:44:26.480014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.048 [2024-11-21 03:44:26.480041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.048 qpair failed and we were unable to recover it. 00:27:46.048 [2024-11-21 03:44:26.480232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.048 [2024-11-21 03:44:26.480406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.048 [2024-11-21 03:44:26.480450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.048 qpair failed and we were unable to recover it. 00:27:46.048 [2024-11-21 03:44:26.480634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.048 [2024-11-21 03:44:26.480751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.048 [2024-11-21 03:44:26.480779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.048 qpair failed and we were unable to recover it. 00:27:46.048 [2024-11-21 03:44:26.480913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.048 [2024-11-21 03:44:26.481046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.048 [2024-11-21 03:44:26.481079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.048 qpair failed and we were unable to recover it. 00:27:46.048 [2024-11-21 03:44:26.481232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.048 [2024-11-21 03:44:26.481381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.048 [2024-11-21 03:44:26.481431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.048 qpair failed and we were unable to recover it. 00:27:46.048 [2024-11-21 03:44:26.481580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.048 [2024-11-21 03:44:26.481745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.048 [2024-11-21 03:44:26.481774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.048 qpair failed and we were unable to recover it. 00:27:46.048 [2024-11-21 03:44:26.481925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.048 [2024-11-21 03:44:26.482062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.048 [2024-11-21 03:44:26.482097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.048 qpair failed and we were unable to recover it. 00:27:46.048 [2024-11-21 03:44:26.482254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.048 [2024-11-21 03:44:26.482411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.048 [2024-11-21 03:44:26.482438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.048 qpair failed and we were unable to recover it. 00:27:46.048 [2024-11-21 03:44:26.482562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.049 [2024-11-21 03:44:26.482669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.049 [2024-11-21 03:44:26.482697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.049 qpair failed and we were unable to recover it. 00:27:46.049 [2024-11-21 03:44:26.482862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.049 [2024-11-21 03:44:26.483017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.049 [2024-11-21 03:44:26.483044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.049 qpair failed and we were unable to recover it. 00:27:46.049 [2024-11-21 03:44:26.483230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.049 [2024-11-21 03:44:26.483434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.049 [2024-11-21 03:44:26.483464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.049 qpair failed and we were unable to recover it. 00:27:46.049 [2024-11-21 03:44:26.483661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.049 [2024-11-21 03:44:26.483809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.049 [2024-11-21 03:44:26.483836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.049 qpair failed and we were unable to recover it. 00:27:46.049 [2024-11-21 03:44:26.483958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.049 [2024-11-21 03:44:26.484138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.049 [2024-11-21 03:44:26.484183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.049 qpair failed and we were unable to recover it. 00:27:46.049 [2024-11-21 03:44:26.484305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.049 [2024-11-21 03:44:26.484478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.049 [2024-11-21 03:44:26.484524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.049 qpair failed and we were unable to recover it. 00:27:46.049 [2024-11-21 03:44:26.484626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.049 [2024-11-21 03:44:26.484761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.049 [2024-11-21 03:44:26.484787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.049 qpair failed and we were unable to recover it. 00:27:46.049 [2024-11-21 03:44:26.484901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.049 [2024-11-21 03:44:26.485005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.049 [2024-11-21 03:44:26.485030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.049 qpair failed and we were unable to recover it. 00:27:46.049 [2024-11-21 03:44:26.485170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.049 [2024-11-21 03:44:26.485303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.049 [2024-11-21 03:44:26.485330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.049 qpair failed and we were unable to recover it. 00:27:46.049 [2024-11-21 03:44:26.485464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.049 [2024-11-21 03:44:26.485622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.049 [2024-11-21 03:44:26.485649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.049 qpair failed and we were unable to recover it. 00:27:46.049 [2024-11-21 03:44:26.485807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.049 [2024-11-21 03:44:26.486014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.049 [2024-11-21 03:44:26.486041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.049 qpair failed and we were unable to recover it. 00:27:46.049 [2024-11-21 03:44:26.486201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.049 [2024-11-21 03:44:26.486351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.049 [2024-11-21 03:44:26.486378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.049 qpair failed and we were unable to recover it. 00:27:46.049 [2024-11-21 03:44:26.486481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.049 [2024-11-21 03:44:26.486624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.049 [2024-11-21 03:44:26.486668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.049 qpair failed and we were unable to recover it. 00:27:46.049 [2024-11-21 03:44:26.486792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.049 [2024-11-21 03:44:26.486952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.049 [2024-11-21 03:44:26.486990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.049 qpair failed and we were unable to recover it. 00:27:46.049 [2024-11-21 03:44:26.487173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.049 [2024-11-21 03:44:26.487341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.049 [2024-11-21 03:44:26.487385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.049 qpair failed and we were unable to recover it. 00:27:46.049 [2024-11-21 03:44:26.487567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.049 [2024-11-21 03:44:26.487712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.049 [2024-11-21 03:44:26.487739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.049 qpair failed and we were unable to recover it. 00:27:46.049 [2024-11-21 03:44:26.487861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.049 [2024-11-21 03:44:26.487993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.049 [2024-11-21 03:44:26.488020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.049 qpair failed and we were unable to recover it. 00:27:46.049 [2024-11-21 03:44:26.488169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.049 [2024-11-21 03:44:26.488321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.049 [2024-11-21 03:44:26.488348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.049 qpair failed and we were unable to recover it. 00:27:46.049 [2024-11-21 03:44:26.488505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.049 [2024-11-21 03:44:26.488635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.049 [2024-11-21 03:44:26.488666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.049 qpair failed and we were unable to recover it. 00:27:46.049 [2024-11-21 03:44:26.488788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.049 [2024-11-21 03:44:26.488917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.049 [2024-11-21 03:44:26.488945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.049 qpair failed and we were unable to recover it. 00:27:46.049 [2024-11-21 03:44:26.489103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.049 [2024-11-21 03:44:26.489249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.049 [2024-11-21 03:44:26.489292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.049 qpair failed and we were unable to recover it. 00:27:46.049 [2024-11-21 03:44:26.489468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.049 [2024-11-21 03:44:26.489699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.049 [2024-11-21 03:44:26.489726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.049 qpair failed and we were unable to recover it. 00:27:46.049 [2024-11-21 03:44:26.489882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.049 [2024-11-21 03:44:26.490042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.049 [2024-11-21 03:44:26.490075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.049 qpair failed and we were unable to recover it. 00:27:46.049 [2024-11-21 03:44:26.490202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.049 [2024-11-21 03:44:26.490334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.049 [2024-11-21 03:44:26.490363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.050 qpair failed and we were unable to recover it. 00:27:46.050 [2024-11-21 03:44:26.490561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.050 [2024-11-21 03:44:26.490697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.050 [2024-11-21 03:44:26.490740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.050 qpair failed and we were unable to recover it. 00:27:46.050 [2024-11-21 03:44:26.490949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.050 [2024-11-21 03:44:26.491049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.050 [2024-11-21 03:44:26.491082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.050 qpair failed and we were unable to recover it. 00:27:46.050 [2024-11-21 03:44:26.491265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.050 [2024-11-21 03:44:26.491410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.050 [2024-11-21 03:44:26.491437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.050 qpair failed and we were unable to recover it. 00:27:46.050 [2024-11-21 03:44:26.491571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.050 [2024-11-21 03:44:26.491667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.050 [2024-11-21 03:44:26.491695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.050 qpair failed and we were unable to recover it. 00:27:46.050 [2024-11-21 03:44:26.491831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.050 [2024-11-21 03:44:26.491987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.050 [2024-11-21 03:44:26.492019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.050 qpair failed and we were unable to recover it. 00:27:46.050 [2024-11-21 03:44:26.492168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.050 [2024-11-21 03:44:26.492270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.050 [2024-11-21 03:44:26.492298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.050 qpair failed and we were unable to recover it. 00:27:46.050 [2024-11-21 03:44:26.492454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.050 [2024-11-21 03:44:26.492593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.050 [2024-11-21 03:44:26.492624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.050 qpair failed and we were unable to recover it. 00:27:46.050 [2024-11-21 03:44:26.492786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.050 [2024-11-21 03:44:26.492923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.050 [2024-11-21 03:44:26.492950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.050 qpair failed and we were unable to recover it. 00:27:46.050 [2024-11-21 03:44:26.493125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.050 [2024-11-21 03:44:26.493274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.050 [2024-11-21 03:44:26.493304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.050 qpair failed and we were unable to recover it. 00:27:46.050 [2024-11-21 03:44:26.493427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.050 [2024-11-21 03:44:26.493586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.050 [2024-11-21 03:44:26.493615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.050 qpair failed and we were unable to recover it. 00:27:46.050 [2024-11-21 03:44:26.493810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.050 [2024-11-21 03:44:26.494015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.050 [2024-11-21 03:44:26.494044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.050 qpair failed and we were unable to recover it. 00:27:46.050 [2024-11-21 03:44:26.494205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.050 [2024-11-21 03:44:26.494351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.050 [2024-11-21 03:44:26.494380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.050 qpair failed and we were unable to recover it. 00:27:46.050 [2024-11-21 03:44:26.494548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.050 [2024-11-21 03:44:26.494712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.050 [2024-11-21 03:44:26.494741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.050 qpair failed and we were unable to recover it. 00:27:46.050 [2024-11-21 03:44:26.494932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.050 [2024-11-21 03:44:26.495077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.050 [2024-11-21 03:44:26.495122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.050 qpair failed and we were unable to recover it. 00:27:46.050 [2024-11-21 03:44:26.495225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.050 [2024-11-21 03:44:26.495395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.050 [2024-11-21 03:44:26.495430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.050 qpair failed and we were unable to recover it. 00:27:46.050 [2024-11-21 03:44:26.495599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.050 [2024-11-21 03:44:26.495733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.050 [2024-11-21 03:44:26.495761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.050 qpair failed and we were unable to recover it. 00:27:46.050 [2024-11-21 03:44:26.495933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.050 [2024-11-21 03:44:26.496088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.050 [2024-11-21 03:44:26.496116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.050 qpair failed and we were unable to recover it. 00:27:46.050 [2024-11-21 03:44:26.496271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.050 [2024-11-21 03:44:26.496414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.050 [2024-11-21 03:44:26.496441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.050 qpair failed and we were unable to recover it. 00:27:46.050 [2024-11-21 03:44:26.496621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.050 [2024-11-21 03:44:26.496738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.050 [2024-11-21 03:44:26.496766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.050 qpair failed and we were unable to recover it. 00:27:46.050 [2024-11-21 03:44:26.496959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.050 [2024-11-21 03:44:26.497080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.050 [2024-11-21 03:44:26.497124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.050 qpair failed and we were unable to recover it. 00:27:46.050 [2024-11-21 03:44:26.497251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.050 [2024-11-21 03:44:26.497430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.050 [2024-11-21 03:44:26.497459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.050 qpair failed and we were unable to recover it. 00:27:46.050 [2024-11-21 03:44:26.497599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.050 [2024-11-21 03:44:26.497768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.050 [2024-11-21 03:44:26.497798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.050 qpair failed and we were unable to recover it. 00:27:46.050 [2024-11-21 03:44:26.497961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.050 [2024-11-21 03:44:26.498102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.050 [2024-11-21 03:44:26.498150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.050 qpair failed and we were unable to recover it. 00:27:46.051 [2024-11-21 03:44:26.498264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.051 [2024-11-21 03:44:26.498421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.051 [2024-11-21 03:44:26.498447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.051 qpair failed and we were unable to recover it. 00:27:46.051 [2024-11-21 03:44:26.498591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.051 [2024-11-21 03:44:26.498731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.051 [2024-11-21 03:44:26.498760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.051 qpair failed and we were unable to recover it. 00:27:46.051 [2024-11-21 03:44:26.498979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.051 [2024-11-21 03:44:26.499099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.051 [2024-11-21 03:44:26.499126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.051 qpair failed and we were unable to recover it. 00:27:46.051 [2024-11-21 03:44:26.499332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.051 [2024-11-21 03:44:26.499483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.051 [2024-11-21 03:44:26.499513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.051 qpair failed and we were unable to recover it. 00:27:46.051 [2024-11-21 03:44:26.499628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.051 [2024-11-21 03:44:26.499748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.051 [2024-11-21 03:44:26.499777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.051 qpair failed and we were unable to recover it. 00:27:46.051 [2024-11-21 03:44:26.499919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.051 [2024-11-21 03:44:26.500087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.051 [2024-11-21 03:44:26.500133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.051 qpair failed and we were unable to recover it. 00:27:46.051 [2024-11-21 03:44:26.500257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.051 [2024-11-21 03:44:26.500380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.051 [2024-11-21 03:44:26.500409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.051 qpair failed and we were unable to recover it. 00:27:46.051 [2024-11-21 03:44:26.500527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.051 [2024-11-21 03:44:26.500663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.051 [2024-11-21 03:44:26.500692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.051 qpair failed and we were unable to recover it. 00:27:46.051 [2024-11-21 03:44:26.500869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.051 [2024-11-21 03:44:26.501018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.051 [2024-11-21 03:44:26.501046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.051 qpair failed and we were unable to recover it. 00:27:46.051 [2024-11-21 03:44:26.501200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.051 [2024-11-21 03:44:26.501374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.051 [2024-11-21 03:44:26.501404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.051 qpair failed and we were unable to recover it. 00:27:46.051 [2024-11-21 03:44:26.501586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.051 [2024-11-21 03:44:26.501682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.051 [2024-11-21 03:44:26.501709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.051 qpair failed and we were unable to recover it. 00:27:46.051 [2024-11-21 03:44:26.501832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.051 [2024-11-21 03:44:26.501970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.051 [2024-11-21 03:44:26.502000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.051 qpair failed and we were unable to recover it. 00:27:46.051 [2024-11-21 03:44:26.502148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.051 [2024-11-21 03:44:26.502285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.051 [2024-11-21 03:44:26.502315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.051 qpair failed and we were unable to recover it. 00:27:46.051 [2024-11-21 03:44:26.502440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.051 [2024-11-21 03:44:26.502550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.051 [2024-11-21 03:44:26.502577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.051 qpair failed and we were unable to recover it. 00:27:46.051 [2024-11-21 03:44:26.502736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.051 [2024-11-21 03:44:26.502859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.051 [2024-11-21 03:44:26.502902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.051 qpair failed and we were unable to recover it. 00:27:46.051 [2024-11-21 03:44:26.503042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.051 [2024-11-21 03:44:26.503218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.051 [2024-11-21 03:44:26.503248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.051 qpair failed and we were unable to recover it. 00:27:46.051 [2024-11-21 03:44:26.503428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.051 [2024-11-21 03:44:26.503530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.051 [2024-11-21 03:44:26.503556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.051 qpair failed and we were unable to recover it. 00:27:46.051 [2024-11-21 03:44:26.503720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.051 [2024-11-21 03:44:26.503855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.051 [2024-11-21 03:44:26.503882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.051 qpair failed and we were unable to recover it. 00:27:46.051 [2024-11-21 03:44:26.503981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.051 [2024-11-21 03:44:26.504105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.051 [2024-11-21 03:44:26.504135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.051 qpair failed and we were unable to recover it. 00:27:46.051 [2024-11-21 03:44:26.504240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.051 [2024-11-21 03:44:26.504370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.051 [2024-11-21 03:44:26.504400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.051 qpair failed and we were unable to recover it. 00:27:46.051 [2024-11-21 03:44:26.504566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.051 [2024-11-21 03:44:26.504697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.051 [2024-11-21 03:44:26.504724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.051 qpair failed and we were unable to recover it. 00:27:46.051 [2024-11-21 03:44:26.504878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.051 [2024-11-21 03:44:26.505055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.051 [2024-11-21 03:44:26.505090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.051 qpair failed and we were unable to recover it. 00:27:46.051 [2024-11-21 03:44:26.505223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.051 [2024-11-21 03:44:26.505408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.052 [2024-11-21 03:44:26.505437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.052 qpair failed and we were unable to recover it. 00:27:46.052 [2024-11-21 03:44:26.505566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.052 [2024-11-21 03:44:26.505723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.052 [2024-11-21 03:44:26.505749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.052 qpair failed and we were unable to recover it. 00:27:46.052 [2024-11-21 03:44:26.505890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.052 [2024-11-21 03:44:26.506035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.052 [2024-11-21 03:44:26.506065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.052 qpair failed and we were unable to recover it. 00:27:46.052 [2024-11-21 03:44:26.506240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.052 [2024-11-21 03:44:26.506369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.052 [2024-11-21 03:44:26.506396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.052 qpair failed and we were unable to recover it. 00:27:46.052 [2024-11-21 03:44:26.506555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.052 [2024-11-21 03:44:26.506657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.052 [2024-11-21 03:44:26.506683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.052 qpair failed and we were unable to recover it. 00:27:46.052 [2024-11-21 03:44:26.506840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.052 [2024-11-21 03:44:26.506975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.052 [2024-11-21 03:44:26.507022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.052 qpair failed and we were unable to recover it. 00:27:46.052 [2024-11-21 03:44:26.507150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.052 [2024-11-21 03:44:26.507282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.052 [2024-11-21 03:44:26.507309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.052 qpair failed and we were unable to recover it. 00:27:46.052 [2024-11-21 03:44:26.507469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.052 [2024-11-21 03:44:26.507643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.052 [2024-11-21 03:44:26.507673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.052 qpair failed and we were unable to recover it. 00:27:46.052 [2024-11-21 03:44:26.507792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.052 [2024-11-21 03:44:26.507904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.052 [2024-11-21 03:44:26.507934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.052 qpair failed and we were unable to recover it. 00:27:46.052 [2024-11-21 03:44:26.508100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.052 [2024-11-21 03:44:26.508211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.052 [2024-11-21 03:44:26.508241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.052 qpair failed and we were unable to recover it. 00:27:46.052 [2024-11-21 03:44:26.508391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.052 [2024-11-21 03:44:26.508528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.052 [2024-11-21 03:44:26.508555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.052 qpair failed and we were unable to recover it. 00:27:46.052 [2024-11-21 03:44:26.508742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.052 [2024-11-21 03:44:26.508895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.052 [2024-11-21 03:44:26.508925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.052 qpair failed and we were unable to recover it. 00:27:46.052 [2024-11-21 03:44:26.509078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.052 [2024-11-21 03:44:26.509193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.052 [2024-11-21 03:44:26.509220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.052 qpair failed and we were unable to recover it. 00:27:46.052 [2024-11-21 03:44:26.509347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.052 [2024-11-21 03:44:26.509447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.052 [2024-11-21 03:44:26.509474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.052 qpair failed and we were unable to recover it. 00:27:46.052 [2024-11-21 03:44:26.509601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.052 [2024-11-21 03:44:26.509789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.052 [2024-11-21 03:44:26.509816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.052 qpair failed and we were unable to recover it. 00:27:46.052 [2024-11-21 03:44:26.509950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.052 [2024-11-21 03:44:26.510085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.052 [2024-11-21 03:44:26.510115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.052 qpair failed and we were unable to recover it. 00:27:46.052 [2024-11-21 03:44:26.510261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.052 [2024-11-21 03:44:26.510426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.052 [2024-11-21 03:44:26.510468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.052 qpair failed and we were unable to recover it. 00:27:46.052 [2024-11-21 03:44:26.510619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.052 [2024-11-21 03:44:26.510737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.052 [2024-11-21 03:44:26.510766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.052 qpair failed and we were unable to recover it. 00:27:46.052 [2024-11-21 03:44:26.510912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.052 [2024-11-21 03:44:26.511051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.052 [2024-11-21 03:44:26.511088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.052 qpair failed and we were unable to recover it. 00:27:46.052 [2024-11-21 03:44:26.511215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.052 [2024-11-21 03:44:26.511342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.052 [2024-11-21 03:44:26.511368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.052 qpair failed and we were unable to recover it. 00:27:46.052 [2024-11-21 03:44:26.511517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.052 [2024-11-21 03:44:26.511634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.052 [2024-11-21 03:44:26.511668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.052 qpair failed and we were unable to recover it. 00:27:46.052 [2024-11-21 03:44:26.511780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.052 [2024-11-21 03:44:26.511952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.053 [2024-11-21 03:44:26.511982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.053 qpair failed and we were unable to recover it. 00:27:46.053 [2024-11-21 03:44:26.512130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.053 [2024-11-21 03:44:26.512288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.053 [2024-11-21 03:44:26.512315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.053 qpair failed and we were unable to recover it. 00:27:46.053 [2024-11-21 03:44:26.512473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.053 [2024-11-21 03:44:26.512578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.053 [2024-11-21 03:44:26.512607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.053 qpair failed and we were unable to recover it. 00:27:46.053 [2024-11-21 03:44:26.512778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.053 [2024-11-21 03:44:26.512922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.053 [2024-11-21 03:44:26.512951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.053 qpair failed and we were unable to recover it. 00:27:46.053 [2024-11-21 03:44:26.513097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.053 [2024-11-21 03:44:26.513255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.053 [2024-11-21 03:44:26.513281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.053 qpair failed and we were unable to recover it. 00:27:46.053 [2024-11-21 03:44:26.513468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.053 [2024-11-21 03:44:26.513625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.053 [2024-11-21 03:44:26.513651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.053 qpair failed and we were unable to recover it. 00:27:46.053 [2024-11-21 03:44:26.513796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.053 [2024-11-21 03:44:26.513965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.053 [2024-11-21 03:44:26.513994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.053 qpair failed and we were unable to recover it. 00:27:46.053 [2024-11-21 03:44:26.514141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.053 [2024-11-21 03:44:26.514250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.053 [2024-11-21 03:44:26.514276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.053 qpair failed and we were unable to recover it. 00:27:46.053 [2024-11-21 03:44:26.514406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.053 [2024-11-21 03:44:26.514554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.053 [2024-11-21 03:44:26.514586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.053 qpair failed and we were unable to recover it. 00:27:46.053 [2024-11-21 03:44:26.514734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.053 [2024-11-21 03:44:26.514892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.053 [2024-11-21 03:44:26.514919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.053 qpair failed and we were unable to recover it. 00:27:46.053 [2024-11-21 03:44:26.515080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.053 [2024-11-21 03:44:26.515214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.053 [2024-11-21 03:44:26.515258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.053 qpair failed and we were unable to recover it. 00:27:46.053 [2024-11-21 03:44:26.515407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.053 [2024-11-21 03:44:26.515531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.053 [2024-11-21 03:44:26.515560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.053 qpair failed and we were unable to recover it. 00:27:46.053 [2024-11-21 03:44:26.515676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.053 [2024-11-21 03:44:26.515811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.053 [2024-11-21 03:44:26.515838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.053 qpair failed and we were unable to recover it. 00:27:46.053 [2024-11-21 03:44:26.516015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.053 [2024-11-21 03:44:26.516196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.053 [2024-11-21 03:44:26.516223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.053 qpair failed and we were unable to recover it. 00:27:46.053 [2024-11-21 03:44:26.516356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.053 [2024-11-21 03:44:26.516487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.053 [2024-11-21 03:44:26.516513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.053 qpair failed and we were unable to recover it. 00:27:46.053 [2024-11-21 03:44:26.516672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.053 [2024-11-21 03:44:26.516809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.053 [2024-11-21 03:44:26.516836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.053 qpair failed and we were unable to recover it. 00:27:46.053 [2024-11-21 03:44:26.516967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.053 [2024-11-21 03:44:26.517108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.053 [2024-11-21 03:44:26.517136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.053 qpair failed and we were unable to recover it. 00:27:46.053 [2024-11-21 03:44:26.517299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.053 [2024-11-21 03:44:26.517439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.053 [2024-11-21 03:44:26.517469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.053 qpair failed and we were unable to recover it. 00:27:46.053 [2024-11-21 03:44:26.517649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.053 [2024-11-21 03:44:26.517784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.053 [2024-11-21 03:44:26.517811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.053 qpair failed and we were unable to recover it. 00:27:46.053 [2024-11-21 03:44:26.518014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.053 [2024-11-21 03:44:26.518144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.053 [2024-11-21 03:44:26.518171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.053 qpair failed and we were unable to recover it. 00:27:46.053 [2024-11-21 03:44:26.518316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.053 [2024-11-21 03:44:26.518510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.053 [2024-11-21 03:44:26.518536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.053 qpair failed and we were unable to recover it. 00:27:46.053 [2024-11-21 03:44:26.518660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.053 [2024-11-21 03:44:26.518816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.053 [2024-11-21 03:44:26.518842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.053 qpair failed and we were unable to recover it. 00:27:46.053 [2024-11-21 03:44:26.519006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.053 [2024-11-21 03:44:26.519166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.053 [2024-11-21 03:44:26.519193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.053 qpair failed and we were unable to recover it. 00:27:46.053 [2024-11-21 03:44:26.519340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.053 [2024-11-21 03:44:26.519455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.053 [2024-11-21 03:44:26.519484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.053 qpair failed and we were unable to recover it. 00:27:46.054 [2024-11-21 03:44:26.519657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.054 [2024-11-21 03:44:26.519799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.054 [2024-11-21 03:44:26.519833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.054 qpair failed and we were unable to recover it. 00:27:46.054 [2024-11-21 03:44:26.519979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.054 [2024-11-21 03:44:26.520112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.054 [2024-11-21 03:44:26.520140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.054 qpair failed and we were unable to recover it. 00:27:46.054 [2024-11-21 03:44:26.520298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.054 [2024-11-21 03:44:26.520441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.054 [2024-11-21 03:44:26.520470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.054 qpair failed and we were unable to recover it. 00:27:46.054 [2024-11-21 03:44:26.520640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.054 [2024-11-21 03:44:26.520815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.054 [2024-11-21 03:44:26.520842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.054 qpair failed and we were unable to recover it. 00:27:46.054 [2024-11-21 03:44:26.521000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.054 [2024-11-21 03:44:26.521132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.054 [2024-11-21 03:44:26.521176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.054 qpair failed and we were unable to recover it. 00:27:46.054 [2024-11-21 03:44:26.521314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.054 [2024-11-21 03:44:26.521463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.054 [2024-11-21 03:44:26.521492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.054 qpair failed and we were unable to recover it. 00:27:46.054 [2024-11-21 03:44:26.521636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.054 [2024-11-21 03:44:26.521810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.054 [2024-11-21 03:44:26.521837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.054 qpair failed and we were unable to recover it. 00:27:46.054 [2024-11-21 03:44:26.521935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.054 [2024-11-21 03:44:26.522065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.054 [2024-11-21 03:44:26.522099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.054 qpair failed and we were unable to recover it. 00:27:46.054 [2024-11-21 03:44:26.522222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.054 [2024-11-21 03:44:26.522364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.054 [2024-11-21 03:44:26.522393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.054 qpair failed and we were unable to recover it. 00:27:46.054 [2024-11-21 03:44:26.522542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.054 [2024-11-21 03:44:26.522702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.054 [2024-11-21 03:44:26.522728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.054 qpair failed and we were unable to recover it. 00:27:46.054 [2024-11-21 03:44:26.522861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.054 [2024-11-21 03:44:26.522988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.054 [2024-11-21 03:44:26.523015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.054 qpair failed and we were unable to recover it. 00:27:46.054 [2024-11-21 03:44:26.523192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.054 [2024-11-21 03:44:26.523350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.054 [2024-11-21 03:44:26.523394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.054 qpair failed and we were unable to recover it. 00:27:46.054 [2024-11-21 03:44:26.523535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.054 [2024-11-21 03:44:26.523699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.054 [2024-11-21 03:44:26.523729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.054 qpair failed and we were unable to recover it. 00:27:46.054 [2024-11-21 03:44:26.523876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.054 [2024-11-21 03:44:26.524033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.054 [2024-11-21 03:44:26.524060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.054 qpair failed and we were unable to recover it. 00:27:46.054 [2024-11-21 03:44:26.524216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.054 [2024-11-21 03:44:26.524391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.054 [2024-11-21 03:44:26.524420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.054 qpair failed and we were unable to recover it. 00:27:46.054 [2024-11-21 03:44:26.524591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.054 [2024-11-21 03:44:26.524707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.054 [2024-11-21 03:44:26.524736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.054 qpair failed and we were unable to recover it. 00:27:46.054 [2024-11-21 03:44:26.524860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.054 [2024-11-21 03:44:26.524984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.054 [2024-11-21 03:44:26.525012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.054 qpair failed and we were unable to recover it. 00:27:46.054 [2024-11-21 03:44:26.525151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.054 [2024-11-21 03:44:26.525295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.054 [2024-11-21 03:44:26.525324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.054 qpair failed and we were unable to recover it. 00:27:46.054 [2024-11-21 03:44:26.525495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.054 [2024-11-21 03:44:26.525681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.054 [2024-11-21 03:44:26.525708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.054 qpair failed and we were unable to recover it. 00:27:46.054 [2024-11-21 03:44:26.525837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.054 [2024-11-21 03:44:26.525992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.054 [2024-11-21 03:44:26.526035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.054 qpair failed and we were unable to recover it. 00:27:46.054 [2024-11-21 03:44:26.526211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.054 [2024-11-21 03:44:26.526353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.054 [2024-11-21 03:44:26.526384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.054 qpair failed and we were unable to recover it. 00:27:46.054 [2024-11-21 03:44:26.526560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.054 [2024-11-21 03:44:26.526717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.054 [2024-11-21 03:44:26.526743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.054 qpair failed and we were unable to recover it. 00:27:46.054 [2024-11-21 03:44:26.526877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.054 [2024-11-21 03:44:26.526981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.054 [2024-11-21 03:44:26.527008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.054 qpair failed and we were unable to recover it. 00:27:46.054 [2024-11-21 03:44:26.527113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.054 [2024-11-21 03:44:26.527268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.055 [2024-11-21 03:44:26.527295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.055 qpair failed and we were unable to recover it. 00:27:46.055 [2024-11-21 03:44:26.527420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.055 [2024-11-21 03:44:26.527612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.055 [2024-11-21 03:44:26.527639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.055 qpair failed and we were unable to recover it. 00:27:46.055 [2024-11-21 03:44:26.527768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.055 [2024-11-21 03:44:26.527901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.055 [2024-11-21 03:44:26.527928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.055 qpair failed and we were unable to recover it. 00:27:46.055 [2024-11-21 03:44:26.528113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.055 [2024-11-21 03:44:26.528232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.055 [2024-11-21 03:44:26.528267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.055 qpair failed and we were unable to recover it. 00:27:46.055 [2024-11-21 03:44:26.528410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.055 [2024-11-21 03:44:26.528522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.055 [2024-11-21 03:44:26.528551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.055 qpair failed and we were unable to recover it. 00:27:46.055 [2024-11-21 03:44:26.528684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.055 [2024-11-21 03:44:26.528790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.055 [2024-11-21 03:44:26.528817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.055 qpair failed and we were unable to recover it. 00:27:46.055 [2024-11-21 03:44:26.528917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.055 [2024-11-21 03:44:26.529081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.055 [2024-11-21 03:44:26.529108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.055 qpair failed and we were unable to recover it. 00:27:46.055 [2024-11-21 03:44:26.529230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.055 [2024-11-21 03:44:26.529406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.055 [2024-11-21 03:44:26.529432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.055 qpair failed and we were unable to recover it. 00:27:46.055 [2024-11-21 03:44:26.529566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.055 [2024-11-21 03:44:26.529700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.055 [2024-11-21 03:44:26.529727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.055 qpair failed and we were unable to recover it. 00:27:46.055 [2024-11-21 03:44:26.529921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.055 [2024-11-21 03:44:26.530050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.055 [2024-11-21 03:44:26.530084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.055 qpair failed and we were unable to recover it. 00:27:46.055 [2024-11-21 03:44:26.530254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.055 [2024-11-21 03:44:26.530411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.055 [2024-11-21 03:44:26.530441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.055 qpair failed and we were unable to recover it. 00:27:46.055 [2024-11-21 03:44:26.530620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.055 [2024-11-21 03:44:26.530804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.055 [2024-11-21 03:44:26.530878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.055 qpair failed and we were unable to recover it. 00:27:46.055 [2024-11-21 03:44:26.531025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.055 [2024-11-21 03:44:26.531153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.055 [2024-11-21 03:44:26.531180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.055 qpair failed and we were unable to recover it. 00:27:46.055 [2024-11-21 03:44:26.531312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.055 [2024-11-21 03:44:26.531519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.055 [2024-11-21 03:44:26.531579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.055 qpair failed and we were unable to recover it. 00:27:46.055 [2024-11-21 03:44:26.531773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.055 [2024-11-21 03:44:26.531905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.055 [2024-11-21 03:44:26.531932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.055 qpair failed and we were unable to recover it. 00:27:46.055 [2024-11-21 03:44:26.532067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.055 [2024-11-21 03:44:26.532224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.055 [2024-11-21 03:44:26.532253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.055 qpair failed and we were unable to recover it. 00:27:46.055 [2024-11-21 03:44:26.532354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.055 [2024-11-21 03:44:26.532508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.055 [2024-11-21 03:44:26.532537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.055 qpair failed and we were unable to recover it. 00:27:46.055 [2024-11-21 03:44:26.532692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.055 [2024-11-21 03:44:26.532844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.055 [2024-11-21 03:44:26.532870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.055 qpair failed and we were unable to recover it. 00:27:46.055 [2024-11-21 03:44:26.533026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.055 [2024-11-21 03:44:26.533184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.055 [2024-11-21 03:44:26.533214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.055 qpair failed and we were unable to recover it. 00:27:46.055 [2024-11-21 03:44:26.533359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.055 [2024-11-21 03:44:26.533502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.055 [2024-11-21 03:44:26.533531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.055 qpair failed and we were unable to recover it. 00:27:46.055 [2024-11-21 03:44:26.533643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.055 [2024-11-21 03:44:26.533750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.055 [2024-11-21 03:44:26.533777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.055 qpair failed and we were unable to recover it. 00:27:46.055 [2024-11-21 03:44:26.533919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.055 [2024-11-21 03:44:26.534052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.055 [2024-11-21 03:44:26.534091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.055 qpair failed and we were unable to recover it. 00:27:46.055 [2024-11-21 03:44:26.534233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.055 [2024-11-21 03:44:26.534408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.055 [2024-11-21 03:44:26.534435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.055 qpair failed and we were unable to recover it. 00:27:46.055 [2024-11-21 03:44:26.534571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.055 [2024-11-21 03:44:26.534671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.055 [2024-11-21 03:44:26.534697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.055 qpair failed and we were unable to recover it. 00:27:46.055 [2024-11-21 03:44:26.534861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.055 [2024-11-21 03:44:26.535044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.055 [2024-11-21 03:44:26.535081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.055 qpair failed and we were unable to recover it. 00:27:46.055 [2024-11-21 03:44:26.535226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.056 [2024-11-21 03:44:26.535382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.056 [2024-11-21 03:44:26.535409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.056 qpair failed and we were unable to recover it. 00:27:46.056 [2024-11-21 03:44:26.535537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.056 [2024-11-21 03:44:26.535693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.056 [2024-11-21 03:44:26.535736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.056 qpair failed and we were unable to recover it. 00:27:46.056 [2024-11-21 03:44:26.535873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.056 [2024-11-21 03:44:26.536042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.056 [2024-11-21 03:44:26.536088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.056 qpair failed and we were unable to recover it. 00:27:46.056 [2024-11-21 03:44:26.536225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.056 [2024-11-21 03:44:26.536381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.056 [2024-11-21 03:44:26.536408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.056 qpair failed and we were unable to recover it. 00:27:46.056 [2024-11-21 03:44:26.536598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.056 [2024-11-21 03:44:26.536699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.056 [2024-11-21 03:44:26.536725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.056 qpair failed and we were unable to recover it. 00:27:46.056 [2024-11-21 03:44:26.536881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.056 [2024-11-21 03:44:26.537034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.056 [2024-11-21 03:44:26.537062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.056 qpair failed and we were unable to recover it. 00:27:46.056 [2024-11-21 03:44:26.537233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.056 [2024-11-21 03:44:26.537365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.056 [2024-11-21 03:44:26.537407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.056 qpair failed and we were unable to recover it. 00:27:46.056 [2024-11-21 03:44:26.537560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.056 [2024-11-21 03:44:26.537653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.056 [2024-11-21 03:44:26.537680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.056 qpair failed and we were unable to recover it. 00:27:46.056 [2024-11-21 03:44:26.537854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.056 [2024-11-21 03:44:26.538000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.056 [2024-11-21 03:44:26.538030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.056 qpair failed and we were unable to recover it. 00:27:46.056 [2024-11-21 03:44:26.538222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.056 [2024-11-21 03:44:26.538399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.056 [2024-11-21 03:44:26.538429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.056 qpair failed and we were unable to recover it. 00:27:46.056 [2024-11-21 03:44:26.538555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.056 [2024-11-21 03:44:26.538726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.056 [2024-11-21 03:44:26.538753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.056 qpair failed and we were unable to recover it. 00:27:46.056 [2024-11-21 03:44:26.538905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.056 [2024-11-21 03:44:26.539082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.056 [2024-11-21 03:44:26.539113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.056 qpair failed and we were unable to recover it. 00:27:46.056 [2024-11-21 03:44:26.539255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.056 [2024-11-21 03:44:26.539408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.056 [2024-11-21 03:44:26.539437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.056 qpair failed and we were unable to recover it. 00:27:46.056 [2024-11-21 03:44:26.539551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.056 [2024-11-21 03:44:26.539707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.056 [2024-11-21 03:44:26.539734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.056 qpair failed and we were unable to recover it. 00:27:46.056 [2024-11-21 03:44:26.539918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.056 [2024-11-21 03:44:26.540041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.056 [2024-11-21 03:44:26.540083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.056 qpair failed and we were unable to recover it. 00:27:46.056 [2024-11-21 03:44:26.540231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.056 [2024-11-21 03:44:26.540391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.056 [2024-11-21 03:44:26.540421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.056 qpair failed and we were unable to recover it. 00:27:46.056 [2024-11-21 03:44:26.540565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.056 [2024-11-21 03:44:26.540695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.056 [2024-11-21 03:44:26.540722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.056 qpair failed and we were unable to recover it. 00:27:46.056 [2024-11-21 03:44:26.540856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.056 [2024-11-21 03:44:26.540973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.056 [2024-11-21 03:44:26.541002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.056 qpair failed and we were unable to recover it. 00:27:46.056 [2024-11-21 03:44:26.541160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.056 [2024-11-21 03:44:26.541302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.056 [2024-11-21 03:44:26.541332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.056 qpair failed and we were unable to recover it. 00:27:46.056 [2024-11-21 03:44:26.541486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.056 [2024-11-21 03:44:26.541648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.056 [2024-11-21 03:44:26.541675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.056 qpair failed and we were unable to recover it. 00:27:46.056 [2024-11-21 03:44:26.541831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.056 [2024-11-21 03:44:26.542002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.056 [2024-11-21 03:44:26.542029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.056 qpair failed and we were unable to recover it. 00:27:46.056 [2024-11-21 03:44:26.542190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.056 [2024-11-21 03:44:26.542374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.056 [2024-11-21 03:44:26.542401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.056 qpair failed and we were unable to recover it. 00:27:46.056 [2024-11-21 03:44:26.542528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.056 [2024-11-21 03:44:26.542689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.056 [2024-11-21 03:44:26.542731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.056 qpair failed and we were unable to recover it. 00:27:46.056 [2024-11-21 03:44:26.542878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.056 [2024-11-21 03:44:26.543043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.056 [2024-11-21 03:44:26.543076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.056 qpair failed and we were unable to recover it. 00:27:46.057 [2024-11-21 03:44:26.543221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.057 [2024-11-21 03:44:26.543365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.057 [2024-11-21 03:44:26.543395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.057 qpair failed and we were unable to recover it. 00:27:46.057 [2024-11-21 03:44:26.543541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.057 [2024-11-21 03:44:26.543650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.057 [2024-11-21 03:44:26.543676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.057 qpair failed and we were unable to recover it. 00:27:46.057 [2024-11-21 03:44:26.543800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.057 [2024-11-21 03:44:26.543932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.057 [2024-11-21 03:44:26.543958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.057 qpair failed and we were unable to recover it. 00:27:46.057 [2024-11-21 03:44:26.544077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.057 [2024-11-21 03:44:26.544248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.057 [2024-11-21 03:44:26.544277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.057 qpair failed and we were unable to recover it. 00:27:46.057 [2024-11-21 03:44:26.544406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.057 [2024-11-21 03:44:26.544538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.057 [2024-11-21 03:44:26.544564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.057 qpair failed and we were unable to recover it. 00:27:46.057 [2024-11-21 03:44:26.544724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.057 [2024-11-21 03:44:26.544872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.057 [2024-11-21 03:44:26.544906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.057 qpair failed and we were unable to recover it. 00:27:46.057 [2024-11-21 03:44:26.545082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.057 [2024-11-21 03:44:26.545230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.057 [2024-11-21 03:44:26.545258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.057 qpair failed and we were unable to recover it. 00:27:46.057 [2024-11-21 03:44:26.545352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.057 [2024-11-21 03:44:26.545442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.057 [2024-11-21 03:44:26.545468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.057 qpair failed and we were unable to recover it. 00:27:46.057 [2024-11-21 03:44:26.545614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.057 [2024-11-21 03:44:26.545769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.057 [2024-11-21 03:44:26.545796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.057 qpair failed and we were unable to recover it. 00:27:46.057 [2024-11-21 03:44:26.545926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.057 [2024-11-21 03:44:26.546088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.057 [2024-11-21 03:44:26.546120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.057 qpair failed and we were unable to recover it. 00:27:46.057 [2024-11-21 03:44:26.546268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.057 [2024-11-21 03:44:26.546429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.057 [2024-11-21 03:44:26.546471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.057 qpair failed and we were unable to recover it. 00:27:46.057 [2024-11-21 03:44:26.546613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.057 [2024-11-21 03:44:26.546780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.057 [2024-11-21 03:44:26.546810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.057 qpair failed and we were unable to recover it. 00:27:46.057 [2024-11-21 03:44:26.546961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.057 [2024-11-21 03:44:26.547089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.057 [2024-11-21 03:44:26.547117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.057 qpair failed and we were unable to recover it. 00:27:46.057 [2024-11-21 03:44:26.547278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.057 [2024-11-21 03:44:26.547404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.057 [2024-11-21 03:44:26.547447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.057 qpair failed and we were unable to recover it. 00:27:46.057 [2024-11-21 03:44:26.547615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.057 [2024-11-21 03:44:26.547760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.057 [2024-11-21 03:44:26.547789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.057 qpair failed and we were unable to recover it. 00:27:46.057 [2024-11-21 03:44:26.547960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.057 [2024-11-21 03:44:26.548153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.057 [2024-11-21 03:44:26.548212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.057 qpair failed and we were unable to recover it. 00:27:46.057 [2024-11-21 03:44:26.548369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.057 [2024-11-21 03:44:26.548477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.057 [2024-11-21 03:44:26.548505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.057 qpair failed and we were unable to recover it. 00:27:46.057 [2024-11-21 03:44:26.548636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.057 [2024-11-21 03:44:26.548811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.057 [2024-11-21 03:44:26.548840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.057 qpair failed and we were unable to recover it. 00:27:46.057 [2024-11-21 03:44:26.548975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.057 [2024-11-21 03:44:26.549144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.057 [2024-11-21 03:44:26.549175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.057 qpair failed and we were unable to recover it. 00:27:46.057 [2024-11-21 03:44:26.549321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.057 [2024-11-21 03:44:26.549411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.057 [2024-11-21 03:44:26.549437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.057 qpair failed and we were unable to recover it. 00:27:46.057 [2024-11-21 03:44:26.549562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.057 [2024-11-21 03:44:26.549713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.057 [2024-11-21 03:44:26.549740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.057 qpair failed and we were unable to recover it. 00:27:46.057 [2024-11-21 03:44:26.549874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.057 [2024-11-21 03:44:26.550001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.057 [2024-11-21 03:44:26.550044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.057 qpair failed and we were unable to recover it. 00:27:46.057 [2024-11-21 03:44:26.550183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.057 [2024-11-21 03:44:26.550310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.057 [2024-11-21 03:44:26.550339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.057 qpair failed and we were unable to recover it. 00:27:46.057 [2024-11-21 03:44:26.550503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.057 [2024-11-21 03:44:26.550655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.057 [2024-11-21 03:44:26.550682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.057 qpair failed and we were unable to recover it. 00:27:46.057 [2024-11-21 03:44:26.550812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.057 [2024-11-21 03:44:26.550971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.057 [2024-11-21 03:44:26.550998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.057 qpair failed and we were unable to recover it. 00:27:46.057 [2024-11-21 03:44:26.551134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.058 [2024-11-21 03:44:26.551239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.058 [2024-11-21 03:44:26.551266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.058 qpair failed and we were unable to recover it. 00:27:46.058 [2024-11-21 03:44:26.551381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.058 [2024-11-21 03:44:26.551556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.058 [2024-11-21 03:44:26.551585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.058 qpair failed and we were unable to recover it. 00:27:46.058 [2024-11-21 03:44:26.551724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.058 [2024-11-21 03:44:26.551901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.058 [2024-11-21 03:44:26.551928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.058 qpair failed and we were unable to recover it. 00:27:46.058 [2024-11-21 03:44:26.552028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.058 [2024-11-21 03:44:26.552166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.058 [2024-11-21 03:44:26.552202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.058 qpair failed and we were unable to recover it. 00:27:46.058 [2024-11-21 03:44:26.552327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.058 [2024-11-21 03:44:26.552467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.058 [2024-11-21 03:44:26.552493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.058 qpair failed and we were unable to recover it. 00:27:46.058 [2024-11-21 03:44:26.552652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.058 [2024-11-21 03:44:26.552773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.058 [2024-11-21 03:44:26.552800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.058 qpair failed and we were unable to recover it. 00:27:46.058 [2024-11-21 03:44:26.552935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.058 [2024-11-21 03:44:26.553030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.058 [2024-11-21 03:44:26.553057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.058 qpair failed and we were unable to recover it. 00:27:46.058 [2024-11-21 03:44:26.553222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.058 [2024-11-21 03:44:26.553341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.058 [2024-11-21 03:44:26.553384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.058 qpair failed and we were unable to recover it. 00:27:46.059 [2024-11-21 03:44:26.553544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.059 [2024-11-21 03:44:26.553691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.059 [2024-11-21 03:44:26.553720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.059 qpair failed and we were unable to recover it. 00:27:46.059 [2024-11-21 03:44:26.553896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.059 [2024-11-21 03:44:26.554032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.059 [2024-11-21 03:44:26.554059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.059 qpair failed and we were unable to recover it. 00:27:46.059 [2024-11-21 03:44:26.554195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.059 [2024-11-21 03:44:26.554295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.059 [2024-11-21 03:44:26.554322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.059 qpair failed and we were unable to recover it. 00:27:46.059 [2024-11-21 03:44:26.554448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.059 [2024-11-21 03:44:26.554591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.059 [2024-11-21 03:44:26.554621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.059 qpair failed and we were unable to recover it. 00:27:46.059 [2024-11-21 03:44:26.554772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.059 [2024-11-21 03:44:26.554928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.059 [2024-11-21 03:44:26.554954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.059 qpair failed and we were unable to recover it. 00:27:46.059 [2024-11-21 03:44:26.555148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.059 [2024-11-21 03:44:26.555288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.059 [2024-11-21 03:44:26.555314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.059 qpair failed and we were unable to recover it. 00:27:46.059 [2024-11-21 03:44:26.555489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.059 [2024-11-21 03:44:26.555633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.059 [2024-11-21 03:44:26.555663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.059 qpair failed and we were unable to recover it. 00:27:46.059 [2024-11-21 03:44:26.555815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.059 [2024-11-21 03:44:26.555948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.059 [2024-11-21 03:44:26.555975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.059 qpair failed and we were unable to recover it. 00:27:46.059 [2024-11-21 03:44:26.556154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.059 [2024-11-21 03:44:26.556283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.059 [2024-11-21 03:44:26.556310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.059 qpair failed and we were unable to recover it. 00:27:46.059 [2024-11-21 03:44:26.556486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.059 [2024-11-21 03:44:26.556644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.059 [2024-11-21 03:44:26.556670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.059 qpair failed and we were unable to recover it. 00:27:46.059 [2024-11-21 03:44:26.556792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.059 [2024-11-21 03:44:26.556929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.059 [2024-11-21 03:44:26.556956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.059 qpair failed and we were unable to recover it. 00:27:46.059 [2024-11-21 03:44:26.557125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.059 [2024-11-21 03:44:26.557258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.059 [2024-11-21 03:44:26.557285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.059 qpair failed and we were unable to recover it. 00:27:46.059 [2024-11-21 03:44:26.557439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.059 [2024-11-21 03:44:26.557587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.059 [2024-11-21 03:44:26.557617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.059 qpair failed and we were unable to recover it. 00:27:46.059 [2024-11-21 03:44:26.557758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.059 [2024-11-21 03:44:26.557866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.059 [2024-11-21 03:44:26.557892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.059 qpair failed and we were unable to recover it. 00:27:46.059 [2024-11-21 03:44:26.558014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.059 [2024-11-21 03:44:26.558158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.059 [2024-11-21 03:44:26.558189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.059 qpair failed and we were unable to recover it. 00:27:46.059 [2024-11-21 03:44:26.558343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.059 [2024-11-21 03:44:26.558481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.059 [2024-11-21 03:44:26.558511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.059 qpair failed and we were unable to recover it. 00:27:46.059 [2024-11-21 03:44:26.558687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.059 [2024-11-21 03:44:26.558858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.059 [2024-11-21 03:44:26.558887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.059 qpair failed and we were unable to recover it. 00:27:46.059 [2024-11-21 03:44:26.559053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.059 [2024-11-21 03:44:26.559229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.059 [2024-11-21 03:44:26.559259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.059 qpair failed and we were unable to recover it. 00:27:46.059 [2024-11-21 03:44:26.559375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.059 [2024-11-21 03:44:26.559478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.059 [2024-11-21 03:44:26.559508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.059 qpair failed and we were unable to recover it. 00:27:46.059 [2024-11-21 03:44:26.559660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.059 [2024-11-21 03:44:26.559757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.059 [2024-11-21 03:44:26.559785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.059 qpair failed and we were unable to recover it. 00:27:46.059 [2024-11-21 03:44:26.559936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.059 [2024-11-21 03:44:26.560100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.059 [2024-11-21 03:44:26.560131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.059 qpair failed and we were unable to recover it. 00:27:46.059 [2024-11-21 03:44:26.560277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.059 [2024-11-21 03:44:26.560423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.059 [2024-11-21 03:44:26.560450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.059 qpair failed and we were unable to recover it. 00:27:46.059 [2024-11-21 03:44:26.560606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.059 [2024-11-21 03:44:26.560738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.059 [2024-11-21 03:44:26.560781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.059 qpair failed and we were unable to recover it. 00:27:46.059 [2024-11-21 03:44:26.560928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.059 [2024-11-21 03:44:26.561031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.059 [2024-11-21 03:44:26.561059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.059 qpair failed and we were unable to recover it. 00:27:46.059 [2024-11-21 03:44:26.561214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.059 [2024-11-21 03:44:26.561375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.059 [2024-11-21 03:44:26.561402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.059 qpair failed and we were unable to recover it. 00:27:46.059 [2024-11-21 03:44:26.561561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.059 [2024-11-21 03:44:26.561701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.060 [2024-11-21 03:44:26.561745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.060 qpair failed and we were unable to recover it. 00:27:46.060 [2024-11-21 03:44:26.561901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.060 [2024-11-21 03:44:26.562067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.060 [2024-11-21 03:44:26.562103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.060 qpair failed and we were unable to recover it. 00:27:46.060 [2024-11-21 03:44:26.562238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.060 [2024-11-21 03:44:26.562403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.060 [2024-11-21 03:44:26.562432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.060 qpair failed and we were unable to recover it. 00:27:46.060 [2024-11-21 03:44:26.562563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.060 [2024-11-21 03:44:26.562721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.060 [2024-11-21 03:44:26.562747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.060 qpair failed and we were unable to recover it. 00:27:46.060 [2024-11-21 03:44:26.562878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.060 [2024-11-21 03:44:26.563011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.060 [2024-11-21 03:44:26.563037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.060 qpair failed and we were unable to recover it. 00:27:46.060 [2024-11-21 03:44:26.563178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.060 [2024-11-21 03:44:26.563299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.060 [2024-11-21 03:44:26.563326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.060 qpair failed and we were unable to recover it. 00:27:46.060 [2024-11-21 03:44:26.563419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.060 [2024-11-21 03:44:26.563550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.060 [2024-11-21 03:44:26.563578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.060 qpair failed and we were unable to recover it. 00:27:46.060 [2024-11-21 03:44:26.563747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.060 [2024-11-21 03:44:26.563877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.060 [2024-11-21 03:44:26.563904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.060 qpair failed and we were unable to recover it. 00:27:46.060 [2024-11-21 03:44:26.564031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.060 [2024-11-21 03:44:26.564180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.060 [2024-11-21 03:44:26.564212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.060 qpair failed and we were unable to recover it. 00:27:46.060 [2024-11-21 03:44:26.564347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.060 [2024-11-21 03:44:26.564505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.060 [2024-11-21 03:44:26.564532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.060 qpair failed and we were unable to recover it. 00:27:46.060 [2024-11-21 03:44:26.564708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.060 [2024-11-21 03:44:26.564898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.060 [2024-11-21 03:44:26.564924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.060 qpair failed and we were unable to recover it. 00:27:46.060 [2024-11-21 03:44:26.565047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.060 [2024-11-21 03:44:26.565235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.060 [2024-11-21 03:44:26.565265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.060 qpair failed and we were unable to recover it. 00:27:46.060 [2024-11-21 03:44:26.565436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.060 [2024-11-21 03:44:26.565565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.060 [2024-11-21 03:44:26.565591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.060 qpair failed and we were unable to recover it. 00:27:46.060 [2024-11-21 03:44:26.565748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.060 [2024-11-21 03:44:26.565930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.060 [2024-11-21 03:44:26.565956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.060 qpair failed and we were unable to recover it. 00:27:46.060 [2024-11-21 03:44:26.566081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.060 [2024-11-21 03:44:26.566230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.060 [2024-11-21 03:44:26.566259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.060 qpair failed and we were unable to recover it. 00:27:46.060 [2024-11-21 03:44:26.566392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.060 [2024-11-21 03:44:26.566524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.060 [2024-11-21 03:44:26.566551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.060 qpair failed and we were unable to recover it. 00:27:46.060 [2024-11-21 03:44:26.566675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.060 [2024-11-21 03:44:26.566845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.060 [2024-11-21 03:44:26.566874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.060 qpair failed and we were unable to recover it. 00:27:46.060 [2024-11-21 03:44:26.566991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.060 [2024-11-21 03:44:26.567152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.060 [2024-11-21 03:44:26.567179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.060 qpair failed and we were unable to recover it. 00:27:46.060 [2024-11-21 03:44:26.567308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.060 [2024-11-21 03:44:26.567474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.060 [2024-11-21 03:44:26.567519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.060 qpair failed and we were unable to recover it. 00:27:46.060 [2024-11-21 03:44:26.567670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.060 [2024-11-21 03:44:26.567780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.060 [2024-11-21 03:44:26.567809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.060 qpair failed and we were unable to recover it. 00:27:46.060 [2024-11-21 03:44:26.567952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.060 [2024-11-21 03:44:26.568100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.060 [2024-11-21 03:44:26.568131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.060 qpair failed and we were unable to recover it. 00:27:46.060 [2024-11-21 03:44:26.568274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.060 [2024-11-21 03:44:26.568383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.060 [2024-11-21 03:44:26.568410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.060 qpair failed and we were unable to recover it. 00:27:46.060 [2024-11-21 03:44:26.568538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.060 [2024-11-21 03:44:26.568632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.060 [2024-11-21 03:44:26.568658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.060 qpair failed and we were unable to recover it. 00:27:46.060 [2024-11-21 03:44:26.568777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.060 [2024-11-21 03:44:26.568983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.060 [2024-11-21 03:44:26.569026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.060 qpair failed and we were unable to recover it. 00:27:46.060 [2024-11-21 03:44:26.569214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.060 [2024-11-21 03:44:26.569350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.060 [2024-11-21 03:44:26.569377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.060 qpair failed and we were unable to recover it. 00:27:46.060 [2024-11-21 03:44:26.569537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.060 [2024-11-21 03:44:26.569668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.060 [2024-11-21 03:44:26.569695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.060 qpair failed and we were unable to recover it. 00:27:46.061 [2024-11-21 03:44:26.569838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.061 [2024-11-21 03:44:26.569967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.061 [2024-11-21 03:44:26.569997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.061 qpair failed and we were unable to recover it. 00:27:46.061 [2024-11-21 03:44:26.570151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.061 [2024-11-21 03:44:26.570284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.061 [2024-11-21 03:44:26.570311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.061 qpair failed and we were unable to recover it. 00:27:46.061 [2024-11-21 03:44:26.570505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.061 [2024-11-21 03:44:26.570610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.061 [2024-11-21 03:44:26.570637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.061 qpair failed and we were unable to recover it. 00:27:46.061 [2024-11-21 03:44:26.570772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.061 [2024-11-21 03:44:26.570871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.061 [2024-11-21 03:44:26.570898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.061 qpair failed and we were unable to recover it. 00:27:46.061 [2024-11-21 03:44:26.571030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.061 [2024-11-21 03:44:26.571172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.061 [2024-11-21 03:44:26.571199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.061 qpair failed and we were unable to recover it. 00:27:46.061 [2024-11-21 03:44:26.571360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.061 [2024-11-21 03:44:26.571507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.061 [2024-11-21 03:44:26.571533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.061 qpair failed and we were unable to recover it. 00:27:46.061 [2024-11-21 03:44:26.571663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.061 [2024-11-21 03:44:26.571831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.061 [2024-11-21 03:44:26.571861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.061 qpair failed and we were unable to recover it. 00:27:46.061 [2024-11-21 03:44:26.572014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.061 [2024-11-21 03:44:26.572173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.061 [2024-11-21 03:44:26.572216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.061 qpair failed and we were unable to recover it. 00:27:46.061 [2024-11-21 03:44:26.572359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.061 [2024-11-21 03:44:26.572512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.061 [2024-11-21 03:44:26.572539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.061 qpair failed and we were unable to recover it. 00:27:46.061 [2024-11-21 03:44:26.572670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.061 [2024-11-21 03:44:26.572767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.061 [2024-11-21 03:44:26.572794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.061 qpair failed and we were unable to recover it. 00:27:46.061 [2024-11-21 03:44:26.572901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.061 [2024-11-21 03:44:26.573029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.061 [2024-11-21 03:44:26.573055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.061 qpair failed and we were unable to recover it. 00:27:46.061 [2024-11-21 03:44:26.573237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.061 [2024-11-21 03:44:26.573386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.061 [2024-11-21 03:44:26.573416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.061 qpair failed and we were unable to recover it. 00:27:46.061 [2024-11-21 03:44:26.573529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.061 [2024-11-21 03:44:26.573674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.061 [2024-11-21 03:44:26.573704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.061 qpair failed and we were unable to recover it. 00:27:46.061 [2024-11-21 03:44:26.573828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.061 [2024-11-21 03:44:26.573973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.061 [2024-11-21 03:44:26.574000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.061 qpair failed and we were unable to recover it. 00:27:46.061 [2024-11-21 03:44:26.574125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.061 [2024-11-21 03:44:26.574281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.061 [2024-11-21 03:44:26.574310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.061 qpair failed and we were unable to recover it. 00:27:46.061 [2024-11-21 03:44:26.574416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.061 [2024-11-21 03:44:26.574575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.061 [2024-11-21 03:44:26.574602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.061 qpair failed and we were unable to recover it. 00:27:46.061 [2024-11-21 03:44:26.574724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.061 [2024-11-21 03:44:26.574886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.061 [2024-11-21 03:44:26.574913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.061 qpair failed and we were unable to recover it. 00:27:46.061 [2024-11-21 03:44:26.575105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.061 [2024-11-21 03:44:26.575273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.061 [2024-11-21 03:44:26.575326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.061 qpair failed and we were unable to recover it. 00:27:46.061 [2024-11-21 03:44:26.575470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.061 [2024-11-21 03:44:26.575581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.061 [2024-11-21 03:44:26.575622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.061 qpair failed and we were unable to recover it. 00:27:46.061 [2024-11-21 03:44:26.575747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.061 [2024-11-21 03:44:26.575902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.061 [2024-11-21 03:44:26.575929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.061 qpair failed and we were unable to recover it. 00:27:46.061 [2024-11-21 03:44:26.576105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.061 [2024-11-21 03:44:26.576218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.061 [2024-11-21 03:44:26.576248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.061 qpair failed and we were unable to recover it. 00:27:46.061 [2024-11-21 03:44:26.576395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.061 [2024-11-21 03:44:26.576564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.061 [2024-11-21 03:44:26.576593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.061 qpair failed and we were unable to recover it. 00:27:46.061 [2024-11-21 03:44:26.576741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.061 [2024-11-21 03:44:26.576845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.061 [2024-11-21 03:44:26.576871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.061 qpair failed and we were unable to recover it. 00:27:46.062 [2024-11-21 03:44:26.576971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.062 [2024-11-21 03:44:26.577127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.062 [2024-11-21 03:44:26.577158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.062 qpair failed and we were unable to recover it. 00:27:46.062 [2024-11-21 03:44:26.577298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.062 [2024-11-21 03:44:26.577455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.062 [2024-11-21 03:44:26.577482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.062 qpair failed and we were unable to recover it. 00:27:46.062 [2024-11-21 03:44:26.577608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.062 [2024-11-21 03:44:26.577766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.062 [2024-11-21 03:44:26.577809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.062 qpair failed and we were unable to recover it. 00:27:46.062 [2024-11-21 03:44:26.577923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.062 [2024-11-21 03:44:26.578090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.062 [2024-11-21 03:44:26.578133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.062 qpair failed and we were unable to recover it. 00:27:46.062 [2024-11-21 03:44:26.578286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.062 [2024-11-21 03:44:26.578449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.062 [2024-11-21 03:44:26.578478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.062 qpair failed and we were unable to recover it. 00:27:46.062 [2024-11-21 03:44:26.578631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.062 [2024-11-21 03:44:26.578771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.062 [2024-11-21 03:44:26.578797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.062 qpair failed and we were unable to recover it. 00:27:46.062 [2024-11-21 03:44:26.578895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.062 [2024-11-21 03:44:26.579018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.062 [2024-11-21 03:44:26.579047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.062 qpair failed and we were unable to recover it. 00:27:46.062 [2024-11-21 03:44:26.579194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.062 [2024-11-21 03:44:26.579362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.062 [2024-11-21 03:44:26.579391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.062 qpair failed and we were unable to recover it. 00:27:46.062 [2024-11-21 03:44:26.579518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.062 [2024-11-21 03:44:26.579675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.062 [2024-11-21 03:44:26.579702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.062 qpair failed and we were unable to recover it. 00:27:46.062 [2024-11-21 03:44:26.579847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.062 [2024-11-21 03:44:26.580014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.062 [2024-11-21 03:44:26.580043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.062 qpair failed and we were unable to recover it. 00:27:46.062 [2024-11-21 03:44:26.580183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.062 [2024-11-21 03:44:26.580309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.062 [2024-11-21 03:44:26.580340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.062 qpair failed and we were unable to recover it. 00:27:46.062 [2024-11-21 03:44:26.580442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.062 [2024-11-21 03:44:26.580570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.062 [2024-11-21 03:44:26.580597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.062 qpair failed and we were unable to recover it. 00:27:46.062 [2024-11-21 03:44:26.580699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.062 [2024-11-21 03:44:26.580883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.062 [2024-11-21 03:44:26.580912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.062 qpair failed and we were unable to recover it. 00:27:46.062 [2024-11-21 03:44:26.581084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.062 [2024-11-21 03:44:26.581219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.062 [2024-11-21 03:44:26.581249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.062 qpair failed and we were unable to recover it. 00:27:46.062 [2024-11-21 03:44:26.581401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.062 [2024-11-21 03:44:26.581532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.062 [2024-11-21 03:44:26.581560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.062 qpair failed and we were unable to recover it. 00:27:46.062 [2024-11-21 03:44:26.581685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.062 [2024-11-21 03:44:26.581809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.062 [2024-11-21 03:44:26.581835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.062 qpair failed and we were unable to recover it. 00:27:46.062 [2024-11-21 03:44:26.581968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.062 [2024-11-21 03:44:26.582120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.062 [2024-11-21 03:44:26.582147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.062 qpair failed and we were unable to recover it. 00:27:46.062 [2024-11-21 03:44:26.582302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.062 [2024-11-21 03:44:26.582489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.062 [2024-11-21 03:44:26.582518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.062 qpair failed and we were unable to recover it. 00:27:46.062 [2024-11-21 03:44:26.582688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.062 [2024-11-21 03:44:26.582824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.062 [2024-11-21 03:44:26.582853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.062 qpair failed and we were unable to recover it. 00:27:46.062 [2024-11-21 03:44:26.582993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.062 [2024-11-21 03:44:26.583130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.062 [2024-11-21 03:44:26.583174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.062 qpair failed and we were unable to recover it. 00:27:46.062 [2024-11-21 03:44:26.583278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.062 [2024-11-21 03:44:26.583430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.062 [2024-11-21 03:44:26.583456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.062 qpair failed and we were unable to recover it. 00:27:46.062 [2024-11-21 03:44:26.583590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.062 [2024-11-21 03:44:26.583750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.062 [2024-11-21 03:44:26.583780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.063 qpair failed and we were unable to recover it. 00:27:46.063 [2024-11-21 03:44:26.583949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.063 [2024-11-21 03:44:26.584107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.063 [2024-11-21 03:44:26.584134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.063 qpair failed and we were unable to recover it. 00:27:46.063 [2024-11-21 03:44:26.584288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.063 [2024-11-21 03:44:26.584421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.063 [2024-11-21 03:44:26.584448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.063 qpair failed and we were unable to recover it. 00:27:46.063 [2024-11-21 03:44:26.584576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.063 [2024-11-21 03:44:26.584706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.063 [2024-11-21 03:44:26.584732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.063 qpair failed and we were unable to recover it. 00:27:46.063 [2024-11-21 03:44:26.584875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.063 [2024-11-21 03:44:26.585054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.063 [2024-11-21 03:44:26.585092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.063 qpair failed and we were unable to recover it. 00:27:46.063 [2024-11-21 03:44:26.585242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.063 [2024-11-21 03:44:26.585368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.063 [2024-11-21 03:44:26.585395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.063 qpair failed and we were unable to recover it. 00:27:46.063 [2024-11-21 03:44:26.585535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.063 [2024-11-21 03:44:26.585681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.063 [2024-11-21 03:44:26.585711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.063 qpair failed and we were unable to recover it. 00:27:46.063 [2024-11-21 03:44:26.585884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.063 [2024-11-21 03:44:26.586028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.063 [2024-11-21 03:44:26.586059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.063 qpair failed and we were unable to recover it. 00:27:46.063 [2024-11-21 03:44:26.586196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.063 [2024-11-21 03:44:26.586354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.063 [2024-11-21 03:44:26.586380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.063 qpair failed and we were unable to recover it. 00:27:46.063 [2024-11-21 03:44:26.586559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.063 [2024-11-21 03:44:26.586664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.063 [2024-11-21 03:44:26.586693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.063 qpair failed and we were unable to recover it. 00:27:46.063 [2024-11-21 03:44:26.586873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.063 [2024-11-21 03:44:26.587006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.063 [2024-11-21 03:44:26.587036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.063 qpair failed and we were unable to recover it. 00:27:46.063 [2024-11-21 03:44:26.587179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.063 [2024-11-21 03:44:26.587316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.063 [2024-11-21 03:44:26.587343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.063 qpair failed and we were unable to recover it. 00:27:46.063 [2024-11-21 03:44:26.587504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.063 [2024-11-21 03:44:26.587634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.063 [2024-11-21 03:44:26.587661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.063 qpair failed and we were unable to recover it. 00:27:46.063 [2024-11-21 03:44:26.587808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.063 [2024-11-21 03:44:26.587941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.063 [2024-11-21 03:44:26.587971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.063 qpair failed and we were unable to recover it. 00:27:46.063 [2024-11-21 03:44:26.588117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.063 [2024-11-21 03:44:26.588224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.063 [2024-11-21 03:44:26.588251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.063 qpair failed and we were unable to recover it. 00:27:46.063 [2024-11-21 03:44:26.588391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.063 [2024-11-21 03:44:26.588536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.063 [2024-11-21 03:44:26.588565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.063 qpair failed and we were unable to recover it. 00:27:46.063 [2024-11-21 03:44:26.588699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.063 [2024-11-21 03:44:26.588837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.063 [2024-11-21 03:44:26.588866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.063 qpair failed and we were unable to recover it. 00:27:46.063 [2024-11-21 03:44:26.589012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.063 [2024-11-21 03:44:26.589167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.063 [2024-11-21 03:44:26.589195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.063 qpair failed and we were unable to recover it. 00:27:46.063 [2024-11-21 03:44:26.589352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.063 [2024-11-21 03:44:26.589499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.063 [2024-11-21 03:44:26.589528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.063 qpair failed and we were unable to recover it. 00:27:46.063 [2024-11-21 03:44:26.589696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.063 [2024-11-21 03:44:26.589839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.063 [2024-11-21 03:44:26.589869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.063 qpair failed and we were unable to recover it. 00:27:46.063 [2024-11-21 03:44:26.590000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.063 [2024-11-21 03:44:26.590132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.063 [2024-11-21 03:44:26.590159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.063 qpair failed and we were unable to recover it. 00:27:46.063 [2024-11-21 03:44:26.590308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.063 [2024-11-21 03:44:26.590477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.063 [2024-11-21 03:44:26.590506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.063 qpair failed and we were unable to recover it. 00:27:46.063 [2024-11-21 03:44:26.590615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.063 [2024-11-21 03:44:26.590786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.063 [2024-11-21 03:44:26.590816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.063 qpair failed and we were unable to recover it. 00:27:46.063 [2024-11-21 03:44:26.590936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.064 [2024-11-21 03:44:26.591064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.064 [2024-11-21 03:44:26.591097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.064 qpair failed and we were unable to recover it. 00:27:46.064 [2024-11-21 03:44:26.591223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.064 [2024-11-21 03:44:26.591335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.064 [2024-11-21 03:44:26.591364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.064 qpair failed and we were unable to recover it. 00:27:46.064 [2024-11-21 03:44:26.591508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.064 [2024-11-21 03:44:26.591635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.064 [2024-11-21 03:44:26.591662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.064 qpair failed and we were unable to recover it. 00:27:46.064 [2024-11-21 03:44:26.591762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.064 [2024-11-21 03:44:26.591916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.064 [2024-11-21 03:44:26.591943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.064 qpair failed and we were unable to recover it. 00:27:46.064 [2024-11-21 03:44:26.592063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.064 [2024-11-21 03:44:26.592189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.064 [2024-11-21 03:44:26.592218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.064 qpair failed and we were unable to recover it. 00:27:46.064 [2024-11-21 03:44:26.592375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.064 [2024-11-21 03:44:26.592505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.064 [2024-11-21 03:44:26.592532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.064 qpair failed and we were unable to recover it. 00:27:46.064 [2024-11-21 03:44:26.592652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.064 [2024-11-21 03:44:26.592782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.064 [2024-11-21 03:44:26.592808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.064 qpair failed and we were unable to recover it. 00:27:46.064 [2024-11-21 03:44:26.592928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.064 [2024-11-21 03:44:26.593085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.064 [2024-11-21 03:44:26.593116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.064 qpair failed and we were unable to recover it. 00:27:46.064 [2024-11-21 03:44:26.593276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.064 [2024-11-21 03:44:26.593407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.064 [2024-11-21 03:44:26.593433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.064 qpair failed and we were unable to recover it. 00:27:46.064 [2024-11-21 03:44:26.593589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.064 [2024-11-21 03:44:26.593689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.064 [2024-11-21 03:44:26.593716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.064 qpair failed and we were unable to recover it. 00:27:46.064 [2024-11-21 03:44:26.593904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.064 [2024-11-21 03:44:26.594048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.064 [2024-11-21 03:44:26.594085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.064 qpair failed and we were unable to recover it. 00:27:46.064 [2024-11-21 03:44:26.594245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.064 [2024-11-21 03:44:26.594397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.064 [2024-11-21 03:44:26.594426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.064 qpair failed and we were unable to recover it. 00:27:46.064 [2024-11-21 03:44:26.594571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.064 [2024-11-21 03:44:26.594727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.064 [2024-11-21 03:44:26.594753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.064 qpair failed and we were unable to recover it. 00:27:46.064 [2024-11-21 03:44:26.594913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.064 [2024-11-21 03:44:26.595078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.064 [2024-11-21 03:44:26.595105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.064 qpair failed and we were unable to recover it. 00:27:46.064 [2024-11-21 03:44:26.595264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.064 [2024-11-21 03:44:26.595445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.064 [2024-11-21 03:44:26.595503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.064 qpair failed and we were unable to recover it. 00:27:46.064 [2024-11-21 03:44:26.595655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.064 [2024-11-21 03:44:26.595780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.064 [2024-11-21 03:44:26.595807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.064 qpair failed and we were unable to recover it. 00:27:46.064 [2024-11-21 03:44:26.595976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.064 [2024-11-21 03:44:26.596122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.064 [2024-11-21 03:44:26.596153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.064 qpair failed and we were unable to recover it. 00:27:46.064 [2024-11-21 03:44:26.596324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.064 [2024-11-21 03:44:26.596491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.064 [2024-11-21 03:44:26.596525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.064 qpair failed and we were unable to recover it. 00:27:46.064 [2024-11-21 03:44:26.596655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.064 [2024-11-21 03:44:26.596762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.064 [2024-11-21 03:44:26.596788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.064 qpair failed and we were unable to recover it. 00:27:46.064 [2024-11-21 03:44:26.596919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.064 [2024-11-21 03:44:26.597098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.065 [2024-11-21 03:44:26.597128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.065 qpair failed and we were unable to recover it. 00:27:46.065 [2024-11-21 03:44:26.597265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.065 [2024-11-21 03:44:26.597384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.065 [2024-11-21 03:44:26.597413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.065 qpair failed and we were unable to recover it. 00:27:46.065 [2024-11-21 03:44:26.597559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.065 [2024-11-21 03:44:26.597712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.065 [2024-11-21 03:44:26.597739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.065 qpair failed and we were unable to recover it. 00:27:46.065 [2024-11-21 03:44:26.597901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.065 [2024-11-21 03:44:26.598050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.065 [2024-11-21 03:44:26.598099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.065 qpair failed and we were unable to recover it. 00:27:46.065 [2024-11-21 03:44:26.598225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.065 [2024-11-21 03:44:26.598375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.065 [2024-11-21 03:44:26.598405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.065 qpair failed and we were unable to recover it. 00:27:46.065 [2024-11-21 03:44:26.598529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.065 [2024-11-21 03:44:26.598633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.065 [2024-11-21 03:44:26.598659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.065 qpair failed and we were unable to recover it. 00:27:46.065 [2024-11-21 03:44:26.598849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.065 [2024-11-21 03:44:26.598982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.065 [2024-11-21 03:44:26.599008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.065 qpair failed and we were unable to recover it. 00:27:46.065 [2024-11-21 03:44:26.599187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.065 [2024-11-21 03:44:26.599332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.065 [2024-11-21 03:44:26.599363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.065 qpair failed and we were unable to recover it. 00:27:46.065 [2024-11-21 03:44:26.599516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.065 [2024-11-21 03:44:26.599669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.065 [2024-11-21 03:44:26.599711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.065 qpair failed and we were unable to recover it. 00:27:46.065 [2024-11-21 03:44:26.599823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.065 [2024-11-21 03:44:26.600002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.065 [2024-11-21 03:44:26.600031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.065 qpair failed and we were unable to recover it. 00:27:46.065 [2024-11-21 03:44:26.600214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.065 [2024-11-21 03:44:26.600319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.065 [2024-11-21 03:44:26.600346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.065 qpair failed and we were unable to recover it. 00:27:46.065 [2024-11-21 03:44:26.600448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.065 [2024-11-21 03:44:26.600611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.065 [2024-11-21 03:44:26.600638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.065 qpair failed and we were unable to recover it. 00:27:46.065 [2024-11-21 03:44:26.600805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.065 [2024-11-21 03:44:26.600927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.065 [2024-11-21 03:44:26.600953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.065 qpair failed and we were unable to recover it. 00:27:46.065 [2024-11-21 03:44:26.601128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.065 [2024-11-21 03:44:26.601301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.065 [2024-11-21 03:44:26.601330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.065 qpair failed and we were unable to recover it. 00:27:46.065 [2024-11-21 03:44:26.601505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.065 [2024-11-21 03:44:26.601662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.065 [2024-11-21 03:44:26.601692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.065 qpair failed and we were unable to recover it. 00:27:46.065 [2024-11-21 03:44:26.601881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.065 [2024-11-21 03:44:26.602022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.065 [2024-11-21 03:44:26.602051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.065 qpair failed and we were unable to recover it. 00:27:46.065 [2024-11-21 03:44:26.602244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.065 [2024-11-21 03:44:26.602367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.065 [2024-11-21 03:44:26.602396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.065 qpair failed and we were unable to recover it. 00:27:46.065 [2024-11-21 03:44:26.602577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.065 [2024-11-21 03:44:26.602684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.065 [2024-11-21 03:44:26.602712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.065 qpair failed and we were unable to recover it. 00:27:46.065 [2024-11-21 03:44:26.602874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.065 [2024-11-21 03:44:26.603007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.065 [2024-11-21 03:44:26.603036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.065 qpair failed and we were unable to recover it. 00:27:46.065 [2024-11-21 03:44:26.603199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.065 [2024-11-21 03:44:26.603330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.065 [2024-11-21 03:44:26.603357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.065 qpair failed and we were unable to recover it. 00:27:46.065 [2024-11-21 03:44:26.603555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.065 [2024-11-21 03:44:26.603685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.065 [2024-11-21 03:44:26.603728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.065 qpair failed and we were unable to recover it. 00:27:46.065 [2024-11-21 03:44:26.603908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.065 [2024-11-21 03:44:26.604052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.065 [2024-11-21 03:44:26.604088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.065 qpair failed and we were unable to recover it. 00:27:46.065 [2024-11-21 03:44:26.604261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.065 [2024-11-21 03:44:26.604398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.065 [2024-11-21 03:44:26.604428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.065 qpair failed and we were unable to recover it. 00:27:46.065 [2024-11-21 03:44:26.604580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.065 [2024-11-21 03:44:26.604675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.065 [2024-11-21 03:44:26.604702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.065 qpair failed and we were unable to recover it. 00:27:46.065 [2024-11-21 03:44:26.604821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.065 [2024-11-21 03:44:26.604936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.065 [2024-11-21 03:44:26.604965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.066 qpair failed and we were unable to recover it. 00:27:46.066 [2024-11-21 03:44:26.605109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.066 [2024-11-21 03:44:26.605247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.066 [2024-11-21 03:44:26.605276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.066 qpair failed and we were unable to recover it. 00:27:46.066 [2024-11-21 03:44:26.605429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.066 [2024-11-21 03:44:26.605532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.066 [2024-11-21 03:44:26.605558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.066 qpair failed and we were unable to recover it. 00:27:46.066 [2024-11-21 03:44:26.605723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.066 [2024-11-21 03:44:26.605863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.066 [2024-11-21 03:44:26.605890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.066 qpair failed and we were unable to recover it. 00:27:46.066 [2024-11-21 03:44:26.606040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.066 [2024-11-21 03:44:26.606201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.066 [2024-11-21 03:44:26.606232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.066 qpair failed and we were unable to recover it. 00:27:46.066 [2024-11-21 03:44:26.606387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.066 [2024-11-21 03:44:26.606553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.066 [2024-11-21 03:44:26.606579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.066 qpair failed and we were unable to recover it. 00:27:46.066 [2024-11-21 03:44:26.606713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.066 [2024-11-21 03:44:26.606851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.066 [2024-11-21 03:44:26.606880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.066 qpair failed and we were unable to recover it. 00:27:46.066 [2024-11-21 03:44:26.607017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.066 [2024-11-21 03:44:26.607163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.066 [2024-11-21 03:44:26.607193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.066 qpair failed and we were unable to recover it. 00:27:46.066 [2024-11-21 03:44:26.607345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.066 [2024-11-21 03:44:26.607444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.066 [2024-11-21 03:44:26.607471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.066 qpair failed and we were unable to recover it. 00:27:46.066 [2024-11-21 03:44:26.607652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.066 [2024-11-21 03:44:26.607790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.066 [2024-11-21 03:44:26.607819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.066 qpair failed and we were unable to recover it. 00:27:46.066 [2024-11-21 03:44:26.607988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.066 [2024-11-21 03:44:26.608130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.066 [2024-11-21 03:44:26.608161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.066 qpair failed and we were unable to recover it. 00:27:46.066 [2024-11-21 03:44:26.608341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.066 [2024-11-21 03:44:26.608477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.066 [2024-11-21 03:44:26.608504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.066 qpair failed and we were unable to recover it. 00:27:46.066 [2024-11-21 03:44:26.608633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.066 [2024-11-21 03:44:26.608755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.066 [2024-11-21 03:44:26.608785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.066 qpair failed and we were unable to recover it. 00:27:46.066 [2024-11-21 03:44:26.608903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.066 [2024-11-21 03:44:26.609043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.066 [2024-11-21 03:44:26.609077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.066 qpair failed and we were unable to recover it. 00:27:46.066 [2024-11-21 03:44:26.609210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.066 [2024-11-21 03:44:26.609334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.066 [2024-11-21 03:44:26.609360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.066 qpair failed and we were unable to recover it. 00:27:46.066 [2024-11-21 03:44:26.609523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.066 [2024-11-21 03:44:26.609697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.066 [2024-11-21 03:44:26.609727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.066 qpair failed and we were unable to recover it. 00:27:46.066 [2024-11-21 03:44:26.609841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.066 [2024-11-21 03:44:26.610009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.066 [2024-11-21 03:44:26.610035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.066 qpair failed and we were unable to recover it. 00:27:46.066 [2024-11-21 03:44:26.610177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.066 [2024-11-21 03:44:26.610315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.066 [2024-11-21 03:44:26.610341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.066 qpair failed and we were unable to recover it. 00:27:46.066 [2024-11-21 03:44:26.610508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.066 [2024-11-21 03:44:26.610612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.066 [2024-11-21 03:44:26.610639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.066 qpair failed and we were unable to recover it. 00:27:46.066 [2024-11-21 03:44:26.610773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.066 [2024-11-21 03:44:26.610898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.066 [2024-11-21 03:44:26.610925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.066 qpair failed and we were unable to recover it. 00:27:46.066 [2024-11-21 03:44:26.611116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.066 [2024-11-21 03:44:26.611249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.066 [2024-11-21 03:44:26.611275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.066 qpair failed and we were unable to recover it. 00:27:46.066 [2024-11-21 03:44:26.611434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.066 [2024-11-21 03:44:26.611538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.066 [2024-11-21 03:44:26.611565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.066 qpair failed and we were unable to recover it. 00:27:46.066 [2024-11-21 03:44:26.611716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.066 [2024-11-21 03:44:26.611893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.066 [2024-11-21 03:44:26.611922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.066 qpair failed and we were unable to recover it. 00:27:46.066 [2024-11-21 03:44:26.612100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.066 [2024-11-21 03:44:26.612257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.066 [2024-11-21 03:44:26.612284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.066 qpair failed and we were unable to recover it. 00:27:46.066 [2024-11-21 03:44:26.612466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.066 [2024-11-21 03:44:26.612639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.066 [2024-11-21 03:44:26.612668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.066 qpair failed and we were unable to recover it. 00:27:46.066 [2024-11-21 03:44:26.612817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.067 [2024-11-21 03:44:26.612955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.067 [2024-11-21 03:44:26.612989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.067 qpair failed and we were unable to recover it. 00:27:46.067 [2024-11-21 03:44:26.613112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.067 [2024-11-21 03:44:26.613241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.067 [2024-11-21 03:44:26.613269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.067 qpair failed and we were unable to recover it. 00:27:46.067 [2024-11-21 03:44:26.613388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.067 [2024-11-21 03:44:26.613525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.067 [2024-11-21 03:44:26.613554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.067 qpair failed and we were unable to recover it. 00:27:46.067 [2024-11-21 03:44:26.613711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.067 [2024-11-21 03:44:26.613871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.067 [2024-11-21 03:44:26.613898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.067 qpair failed and we were unable to recover it. 00:27:46.067 [2024-11-21 03:44:26.614028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.067 [2024-11-21 03:44:26.614167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.067 [2024-11-21 03:44:26.614195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.067 qpair failed and we were unable to recover it. 00:27:46.067 [2024-11-21 03:44:26.614313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.067 [2024-11-21 03:44:26.614448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.067 [2024-11-21 03:44:26.614477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.067 qpair failed and we were unable to recover it. 00:27:46.067 [2024-11-21 03:44:26.614658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.067 [2024-11-21 03:44:26.614826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.067 [2024-11-21 03:44:26.614856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.067 qpair failed and we were unable to recover it. 00:27:46.067 [2024-11-21 03:44:26.615033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.067 [2024-11-21 03:44:26.615171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.067 [2024-11-21 03:44:26.615216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.067 qpair failed and we were unable to recover it. 00:27:46.067 [2024-11-21 03:44:26.615337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.067 [2024-11-21 03:44:26.615445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.067 [2024-11-21 03:44:26.615475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.067 qpair failed and we were unable to recover it. 00:27:46.067 [2024-11-21 03:44:26.615652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.067 [2024-11-21 03:44:26.615792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.067 [2024-11-21 03:44:26.615821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.067 qpair failed and we were unable to recover it. 00:27:46.067 [2024-11-21 03:44:26.615998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.067 [2024-11-21 03:44:26.616141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.067 [2024-11-21 03:44:26.616193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.067 qpair failed and we were unable to recover it. 00:27:46.067 [2024-11-21 03:44:26.616314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.067 [2024-11-21 03:44:26.616508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.067 [2024-11-21 03:44:26.616535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.067 qpair failed and we were unable to recover it. 00:27:46.067 [2024-11-21 03:44:26.616703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.067 [2024-11-21 03:44:26.616864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.067 [2024-11-21 03:44:26.616894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.067 qpair failed and we were unable to recover it. 00:27:46.067 [2024-11-21 03:44:26.617052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.067 [2024-11-21 03:44:26.617197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.067 [2024-11-21 03:44:26.617224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.067 qpair failed and we were unable to recover it. 00:27:46.067 [2024-11-21 03:44:26.617386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.067 [2024-11-21 03:44:26.617565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.067 [2024-11-21 03:44:26.617594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.067 qpair failed and we were unable to recover it. 00:27:46.067 [2024-11-21 03:44:26.617719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.067 [2024-11-21 03:44:26.617833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.067 [2024-11-21 03:44:26.617864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.067 qpair failed and we were unable to recover it. 00:27:46.067 [2024-11-21 03:44:26.618024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.067 [2024-11-21 03:44:26.618162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.067 [2024-11-21 03:44:26.618189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.067 qpair failed and we were unable to recover it. 00:27:46.067 [2024-11-21 03:44:26.618297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.067 [2024-11-21 03:44:26.618404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.067 [2024-11-21 03:44:26.618430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.067 qpair failed and we were unable to recover it. 00:27:46.067 [2024-11-21 03:44:26.618526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.067 [2024-11-21 03:44:26.618682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.067 [2024-11-21 03:44:26.618709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.067 qpair failed and we were unable to recover it. 00:27:46.067 [2024-11-21 03:44:26.618837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.067 [2024-11-21 03:44:26.619054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.067 [2024-11-21 03:44:26.619092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.067 qpair failed and we were unable to recover it. 00:27:46.067 [2024-11-21 03:44:26.619252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.067 [2024-11-21 03:44:26.619367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.067 [2024-11-21 03:44:26.619395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.067 qpair failed and we were unable to recover it. 00:27:46.067 [2024-11-21 03:44:26.619533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.067 [2024-11-21 03:44:26.619718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.067 [2024-11-21 03:44:26.619746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.067 qpair failed and we were unable to recover it. 00:27:46.067 [2024-11-21 03:44:26.619900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.067 [2024-11-21 03:44:26.620103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.067 [2024-11-21 03:44:26.620148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.067 qpair failed and we were unable to recover it. 00:27:46.067 [2024-11-21 03:44:26.620281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.067 [2024-11-21 03:44:26.620436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.067 [2024-11-21 03:44:26.620465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.067 qpair failed and we were unable to recover it. 00:27:46.068 [2024-11-21 03:44:26.620680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.068 [2024-11-21 03:44:26.620849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.068 [2024-11-21 03:44:26.620879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.068 qpair failed and we were unable to recover it. 00:27:46.068 [2024-11-21 03:44:26.621035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.068 [2024-11-21 03:44:26.621178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.068 [2024-11-21 03:44:26.621205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.068 qpair failed and we were unable to recover it. 00:27:46.068 [2024-11-21 03:44:26.621364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.068 [2024-11-21 03:44:26.621544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.068 [2024-11-21 03:44:26.621571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.068 qpair failed and we were unable to recover it. 00:27:46.068 [2024-11-21 03:44:26.621702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.068 [2024-11-21 03:44:26.621883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.068 [2024-11-21 03:44:26.621912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.068 qpair failed and we were unable to recover it. 00:27:46.068 [2024-11-21 03:44:26.622064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.068 [2024-11-21 03:44:26.622206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.068 [2024-11-21 03:44:26.622233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.068 qpair failed and we were unable to recover it. 00:27:46.068 [2024-11-21 03:44:26.622361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.068 [2024-11-21 03:44:26.622498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.068 [2024-11-21 03:44:26.622527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.068 qpair failed and we were unable to recover it. 00:27:46.068 [2024-11-21 03:44:26.622635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.068 [2024-11-21 03:44:26.622808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.068 [2024-11-21 03:44:26.622837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.068 qpair failed and we were unable to recover it. 00:27:46.068 [2024-11-21 03:44:26.623029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.068 [2024-11-21 03:44:26.623181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.068 [2024-11-21 03:44:26.623226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.068 qpair failed and we were unable to recover it. 00:27:46.068 [2024-11-21 03:44:26.623393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.068 [2024-11-21 03:44:26.623510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.068 [2024-11-21 03:44:26.623539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.068 qpair failed and we were unable to recover it. 00:27:46.068 [2024-11-21 03:44:26.623709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.068 [2024-11-21 03:44:26.623875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.068 [2024-11-21 03:44:26.623904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.068 qpair failed and we were unable to recover it. 00:27:46.068 [2024-11-21 03:44:26.624088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.068 [2024-11-21 03:44:26.624222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.068 [2024-11-21 03:44:26.624248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.068 qpair failed and we were unable to recover it. 00:27:46.068 [2024-11-21 03:44:26.624410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.068 [2024-11-21 03:44:26.624617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.068 [2024-11-21 03:44:26.624675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.068 qpair failed and we were unable to recover it. 00:27:46.068 [2024-11-21 03:44:26.624820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.068 [2024-11-21 03:44:26.624981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.068 [2024-11-21 03:44:26.625007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.068 qpair failed and we were unable to recover it. 00:27:46.068 [2024-11-21 03:44:26.625141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.068 [2024-11-21 03:44:26.625302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.068 [2024-11-21 03:44:26.625328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.068 qpair failed and we were unable to recover it. 00:27:46.068 [2024-11-21 03:44:26.625463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.068 [2024-11-21 03:44:26.625653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.068 [2024-11-21 03:44:26.625683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.068 qpair failed and we were unable to recover it. 00:27:46.068 [2024-11-21 03:44:26.625822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.068 [2024-11-21 03:44:26.625972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.068 [2024-11-21 03:44:26.626002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.068 qpair failed and we were unable to recover it. 00:27:46.068 [2024-11-21 03:44:26.626132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.068 [2024-11-21 03:44:26.626294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.068 [2024-11-21 03:44:26.626320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.068 qpair failed and we were unable to recover it. 00:27:46.068 [2024-11-21 03:44:26.626469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.068 [2024-11-21 03:44:26.626691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.068 [2024-11-21 03:44:26.626743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.068 qpair failed and we were unable to recover it. 00:27:46.068 [2024-11-21 03:44:26.626851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.068 [2024-11-21 03:44:26.627017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.068 [2024-11-21 03:44:26.627046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.068 qpair failed and we were unable to recover it. 00:27:46.068 [2024-11-21 03:44:26.627238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.068 [2024-11-21 03:44:26.627387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.068 [2024-11-21 03:44:26.627430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.068 qpair failed and we were unable to recover it. 00:27:46.068 [2024-11-21 03:44:26.627571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.068 [2024-11-21 03:44:26.627709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.068 [2024-11-21 03:44:26.627738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.068 qpair failed and we were unable to recover it. 00:27:46.068 [2024-11-21 03:44:26.627905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.068 [2024-11-21 03:44:26.628047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.068 [2024-11-21 03:44:26.628095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.068 qpair failed and we were unable to recover it. 00:27:46.068 [2024-11-21 03:44:26.628291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.068 [2024-11-21 03:44:26.628420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.068 [2024-11-21 03:44:26.628447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.068 qpair failed and we were unable to recover it. 00:27:46.069 [2024-11-21 03:44:26.628632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.069 [2024-11-21 03:44:26.628766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.069 [2024-11-21 03:44:26.628795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.069 qpair failed and we were unable to recover it. 00:27:46.069 [2024-11-21 03:44:26.628964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.069 [2024-11-21 03:44:26.629104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.069 [2024-11-21 03:44:26.629135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.069 qpair failed and we were unable to recover it. 00:27:46.069 [2024-11-21 03:44:26.629282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.069 [2024-11-21 03:44:26.629412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.069 [2024-11-21 03:44:26.629439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.069 qpair failed and we were unable to recover it. 00:27:46.069 [2024-11-21 03:44:26.629595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.069 [2024-11-21 03:44:26.629733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.069 [2024-11-21 03:44:26.629762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.069 qpair failed and we were unable to recover it. 00:27:46.069 [2024-11-21 03:44:26.629906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.069 [2024-11-21 03:44:26.630076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.069 [2024-11-21 03:44:26.630104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.069 qpair failed and we were unable to recover it. 00:27:46.069 [2024-11-21 03:44:26.630211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.069 [2024-11-21 03:44:26.630335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.069 [2024-11-21 03:44:26.630362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.069 qpair failed and we were unable to recover it. 00:27:46.069 [2024-11-21 03:44:26.630470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.069 [2024-11-21 03:44:26.630611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.069 [2024-11-21 03:44:26.630640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.069 qpair failed and we were unable to recover it. 00:27:46.069 [2024-11-21 03:44:26.630815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.069 [2024-11-21 03:44:26.630981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.069 [2024-11-21 03:44:26.631011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.069 qpair failed and we were unable to recover it. 00:27:46.069 [2024-11-21 03:44:26.631161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.069 [2024-11-21 03:44:26.631296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.069 [2024-11-21 03:44:26.631323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.069 qpair failed and we were unable to recover it. 00:27:46.069 [2024-11-21 03:44:26.631455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.069 [2024-11-21 03:44:26.631615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.069 [2024-11-21 03:44:26.631644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.069 qpair failed and we were unable to recover it. 00:27:46.069 [2024-11-21 03:44:26.631826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.069 [2024-11-21 03:44:26.631932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.069 [2024-11-21 03:44:26.631962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.069 qpair failed and we were unable to recover it. 00:27:46.069 [2024-11-21 03:44:26.632105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.069 [2024-11-21 03:44:26.632261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.069 [2024-11-21 03:44:26.632288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.069 qpair failed and we were unable to recover it. 00:27:46.069 [2024-11-21 03:44:26.632412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.069 [2024-11-21 03:44:26.632550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.069 [2024-11-21 03:44:26.632578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.069 qpair failed and we were unable to recover it. 00:27:46.069 [2024-11-21 03:44:26.632713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.069 [2024-11-21 03:44:26.632866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.069 [2024-11-21 03:44:26.632892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.069 qpair failed and we were unable to recover it. 00:27:46.069 [2024-11-21 03:44:26.633111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.069 [2024-11-21 03:44:26.633268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.069 [2024-11-21 03:44:26.633300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.069 qpair failed and we were unable to recover it. 00:27:46.069 [2024-11-21 03:44:26.633447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.069 [2024-11-21 03:44:26.633585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.069 [2024-11-21 03:44:26.633628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.069 qpair failed and we were unable to recover it. 00:27:46.069 [2024-11-21 03:44:26.633756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.069 [2024-11-21 03:44:26.633931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.069 [2024-11-21 03:44:26.633960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.069 qpair failed and we were unable to recover it. 00:27:46.069 [2024-11-21 03:44:26.634112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.069 [2024-11-21 03:44:26.634265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.069 [2024-11-21 03:44:26.634292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.069 qpair failed and we were unable to recover it. 00:27:46.069 [2024-11-21 03:44:26.634477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.069 [2024-11-21 03:44:26.634633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.069 [2024-11-21 03:44:26.634675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.069 qpair failed and we were unable to recover it. 00:27:46.069 [2024-11-21 03:44:26.634796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.069 [2024-11-21 03:44:26.634942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.069 [2024-11-21 03:44:26.634968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.069 qpair failed and we were unable to recover it. 00:27:46.069 [2024-11-21 03:44:26.635121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.069 [2024-11-21 03:44:26.635247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.069 [2024-11-21 03:44:26.635291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.069 qpair failed and we were unable to recover it. 00:27:46.069 [2024-11-21 03:44:26.635392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.069 [2024-11-21 03:44:26.635529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.069 [2024-11-21 03:44:26.635558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.069 qpair failed and we were unable to recover it. 00:27:46.069 [2024-11-21 03:44:26.635705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.069 [2024-11-21 03:44:26.635838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.069 [2024-11-21 03:44:26.635865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.069 qpair failed and we were unable to recover it. 00:27:46.070 [2024-11-21 03:44:26.635996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.070 [2024-11-21 03:44:26.636128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.070 [2024-11-21 03:44:26.636155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.070 qpair failed and we were unable to recover it. 00:27:46.070 [2024-11-21 03:44:26.636324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.070 [2024-11-21 03:44:26.636452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.070 [2024-11-21 03:44:26.636477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.070 qpair failed and we were unable to recover it. 00:27:46.070 [2024-11-21 03:44:26.636634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.070 [2024-11-21 03:44:26.636776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.070 [2024-11-21 03:44:26.636804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.070 qpair failed and we were unable to recover it. 00:27:46.070 [2024-11-21 03:44:26.636901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.070 [2024-11-21 03:44:26.637004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.070 [2024-11-21 03:44:26.637031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.070 qpair failed and we were unable to recover it. 00:27:46.070 [2024-11-21 03:44:26.637166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.070 [2024-11-21 03:44:26.637321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.070 [2024-11-21 03:44:26.637348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.070 qpair failed and we were unable to recover it. 00:27:46.070 [2024-11-21 03:44:26.637503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.070 [2024-11-21 03:44:26.637634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.070 [2024-11-21 03:44:26.637661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.070 qpair failed and we were unable to recover it. 00:27:46.070 [2024-11-21 03:44:26.637769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.070 [2024-11-21 03:44:26.637894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.070 [2024-11-21 03:44:26.637923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.070 qpair failed and we were unable to recover it. 00:27:46.070 [2024-11-21 03:44:26.638021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.070 [2024-11-21 03:44:26.638140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.070 [2024-11-21 03:44:26.638168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.070 qpair failed and we were unable to recover it. 00:27:46.070 [2024-11-21 03:44:26.638273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.070 [2024-11-21 03:44:26.638408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.070 [2024-11-21 03:44:26.638435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.070 qpair failed and we were unable to recover it. 00:27:46.070 [2024-11-21 03:44:26.638565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.070 [2024-11-21 03:44:26.638660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.070 [2024-11-21 03:44:26.638687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.070 qpair failed and we were unable to recover it. 00:27:46.070 [2024-11-21 03:44:26.638795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.070 [2024-11-21 03:44:26.638894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.070 [2024-11-21 03:44:26.638921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.070 qpair failed and we were unable to recover it. 00:27:46.070 [2024-11-21 03:44:26.639048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.070 [2024-11-21 03:44:26.639199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.070 [2024-11-21 03:44:26.639230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.070 qpair failed and we were unable to recover it. 00:27:46.070 [2024-11-21 03:44:26.639356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.070 [2024-11-21 03:44:26.639463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.070 [2024-11-21 03:44:26.639490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.070 qpair failed and we were unable to recover it. 00:27:46.070 [2024-11-21 03:44:26.639631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.070 [2024-11-21 03:44:26.639748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.070 [2024-11-21 03:44:26.639778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.070 qpair failed and we were unable to recover it. 00:27:46.070 [2024-11-21 03:44:26.639892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.070 [2024-11-21 03:44:26.640039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.070 [2024-11-21 03:44:26.640077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.070 qpair failed and we were unable to recover it. 00:27:46.070 [2024-11-21 03:44:26.640239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.070 [2024-11-21 03:44:26.640340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.070 [2024-11-21 03:44:26.640368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.070 qpair failed and we were unable to recover it. 00:27:46.070 [2024-11-21 03:44:26.640494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.070 [2024-11-21 03:44:26.640636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.070 [2024-11-21 03:44:26.640666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.070 qpair failed and we were unable to recover it. 00:27:46.070 [2024-11-21 03:44:26.640772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.070 [2024-11-21 03:44:26.640918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.070 [2024-11-21 03:44:26.640948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.070 qpair failed and we were unable to recover it. 00:27:46.070 [2024-11-21 03:44:26.641079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.070 [2024-11-21 03:44:26.641209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.070 [2024-11-21 03:44:26.641237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.070 qpair failed and we were unable to recover it. 00:27:46.070 [2024-11-21 03:44:26.641403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.070 [2024-11-21 03:44:26.641531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.070 [2024-11-21 03:44:26.641558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.070 qpair failed and we were unable to recover it. 00:27:46.070 [2024-11-21 03:44:26.641710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.382 [2024-11-21 03:44:26.641863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.382 [2024-11-21 03:44:26.641892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.382 qpair failed and we were unable to recover it. 00:27:46.382 [2024-11-21 03:44:26.642045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.382 [2024-11-21 03:44:26.642162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.382 [2024-11-21 03:44:26.642191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.382 qpair failed and we were unable to recover it. 00:27:46.382 [2024-11-21 03:44:26.642351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.382 [2024-11-21 03:44:26.642451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.382 [2024-11-21 03:44:26.642491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.382 qpair failed and we were unable to recover it. 00:27:46.382 [2024-11-21 03:44:26.642629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.382 [2024-11-21 03:44:26.642781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.382 [2024-11-21 03:44:26.642812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.382 qpair failed and we were unable to recover it. 00:27:46.382 [2024-11-21 03:44:26.642948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.382 [2024-11-21 03:44:26.643104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.382 [2024-11-21 03:44:26.643132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.382 qpair failed and we were unable to recover it. 00:27:46.382 [2024-11-21 03:44:26.643257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.382 [2024-11-21 03:44:26.643376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.382 [2024-11-21 03:44:26.643408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.382 qpair failed and we were unable to recover it. 00:27:46.382 [2024-11-21 03:44:26.643556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.382 [2024-11-21 03:44:26.643700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.382 [2024-11-21 03:44:26.643730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.382 qpair failed and we were unable to recover it. 00:27:46.382 [2024-11-21 03:44:26.643848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.382 [2024-11-21 03:44:26.643967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.382 [2024-11-21 03:44:26.643997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.382 qpair failed and we were unable to recover it. 00:27:46.382 [2024-11-21 03:44:26.644169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.382 [2024-11-21 03:44:26.644306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.382 [2024-11-21 03:44:26.644331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.382 qpair failed and we were unable to recover it. 00:27:46.383 [2024-11-21 03:44:26.644451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.383 [2024-11-21 03:44:26.644593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.383 [2024-11-21 03:44:26.644625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.383 qpair failed and we were unable to recover it. 00:27:46.383 [2024-11-21 03:44:26.644745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.383 [2024-11-21 03:44:26.644902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.383 [2024-11-21 03:44:26.644932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.383 qpair failed and we were unable to recover it. 00:27:46.383 [2024-11-21 03:44:26.645112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.383 [2024-11-21 03:44:26.645217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.383 [2024-11-21 03:44:26.645244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.383 qpair failed and we were unable to recover it. 00:27:46.383 [2024-11-21 03:44:26.645375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.383 [2024-11-21 03:44:26.645502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.383 [2024-11-21 03:44:26.645533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.383 qpair failed and we were unable to recover it. 00:27:46.383 [2024-11-21 03:44:26.645702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.383 [2024-11-21 03:44:26.645839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.383 [2024-11-21 03:44:26.645869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.383 qpair failed and we were unable to recover it. 00:27:46.383 [2024-11-21 03:44:26.646006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.383 [2024-11-21 03:44:26.646109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.383 [2024-11-21 03:44:26.646154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.383 qpair failed and we were unable to recover it. 00:27:46.383 [2024-11-21 03:44:26.646261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.383 [2024-11-21 03:44:26.646374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.383 [2024-11-21 03:44:26.646401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.383 qpair failed and we were unable to recover it. 00:27:46.383 [2024-11-21 03:44:26.646527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.383 [2024-11-21 03:44:26.646665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.383 [2024-11-21 03:44:26.646695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.383 qpair failed and we were unable to recover it. 00:27:46.383 [2024-11-21 03:44:26.646874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.383 [2024-11-21 03:44:26.646993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.383 [2024-11-21 03:44:26.647020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.383 qpair failed and we were unable to recover it. 00:27:46.383 [2024-11-21 03:44:26.647125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.383 [2024-11-21 03:44:26.647249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.383 [2024-11-21 03:44:26.647275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.383 qpair failed and we were unable to recover it. 00:27:46.383 [2024-11-21 03:44:26.647380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.383 [2024-11-21 03:44:26.647485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.383 [2024-11-21 03:44:26.647512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.383 qpair failed and we were unable to recover it. 00:27:46.383 [2024-11-21 03:44:26.647606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.383 [2024-11-21 03:44:26.647714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.383 [2024-11-21 03:44:26.647740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.383 qpair failed and we were unable to recover it. 00:27:46.383 [2024-11-21 03:44:26.647866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.383 [2024-11-21 03:44:26.647977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.383 [2024-11-21 03:44:26.648007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.383 qpair failed and we were unable to recover it. 00:27:46.383 [2024-11-21 03:44:26.648167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.383 [2024-11-21 03:44:26.648306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.383 [2024-11-21 03:44:26.648338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.383 qpair failed and we were unable to recover it. 00:27:46.383 [2024-11-21 03:44:26.648455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.383 [2024-11-21 03:44:26.648599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.383 [2024-11-21 03:44:26.648628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.383 qpair failed and we were unable to recover it. 00:27:46.383 [2024-11-21 03:44:26.648809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.383 [2024-11-21 03:44:26.648943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.383 [2024-11-21 03:44:26.648970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.383 qpair failed and we were unable to recover it. 00:27:46.383 [2024-11-21 03:44:26.649132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.383 [2024-11-21 03:44:26.649238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.383 [2024-11-21 03:44:26.649265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.383 qpair failed and we were unable to recover it. 00:27:46.383 [2024-11-21 03:44:26.649408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.383 [2024-11-21 03:44:26.649524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.383 [2024-11-21 03:44:26.649554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.383 qpair failed and we were unable to recover it. 00:27:46.383 [2024-11-21 03:44:26.649698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.383 [2024-11-21 03:44:26.649809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.383 [2024-11-21 03:44:26.649839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.383 qpair failed and we were unable to recover it. 00:27:46.383 [2024-11-21 03:44:26.649953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.383 [2024-11-21 03:44:26.650138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.383 [2024-11-21 03:44:26.650165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.383 qpair failed and we were unable to recover it. 00:27:46.383 [2024-11-21 03:44:26.650274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.383 [2024-11-21 03:44:26.650379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.383 [2024-11-21 03:44:26.650421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.383 qpair failed and we were unable to recover it. 00:27:46.383 [2024-11-21 03:44:26.650563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.383 [2024-11-21 03:44:26.650670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.383 [2024-11-21 03:44:26.650700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.383 qpair failed and we were unable to recover it. 00:27:46.383 [2024-11-21 03:44:26.650842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.383 [2024-11-21 03:44:26.651009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.383 [2024-11-21 03:44:26.651038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.383 qpair failed and we were unable to recover it. 00:27:46.383 [2024-11-21 03:44:26.651177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.383 [2024-11-21 03:44:26.651281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.383 [2024-11-21 03:44:26.651308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.383 qpair failed and we were unable to recover it. 00:27:46.383 [2024-11-21 03:44:26.651431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.383 [2024-11-21 03:44:26.651606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.383 [2024-11-21 03:44:26.651636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.383 qpair failed and we were unable to recover it. 00:27:46.383 [2024-11-21 03:44:26.651757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.383 [2024-11-21 03:44:26.651874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.383 [2024-11-21 03:44:26.651904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.383 qpair failed and we were unable to recover it. 00:27:46.383 [2024-11-21 03:44:26.652065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.383 [2024-11-21 03:44:26.652176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.383 [2024-11-21 03:44:26.652203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.383 qpair failed and we were unable to recover it. 00:27:46.383 [2024-11-21 03:44:26.652301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.383 [2024-11-21 03:44:26.652478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.383 [2024-11-21 03:44:26.652507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.383 qpair failed and we were unable to recover it. 00:27:46.383 [2024-11-21 03:44:26.652628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.383 [2024-11-21 03:44:26.652756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.383 [2024-11-21 03:44:26.652783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.384 qpair failed and we were unable to recover it. 00:27:46.384 [2024-11-21 03:44:26.652879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.384 [2024-11-21 03:44:26.652971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.384 [2024-11-21 03:44:26.652999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.384 qpair failed and we were unable to recover it. 00:27:46.384 [2024-11-21 03:44:26.653131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.384 [2024-11-21 03:44:26.653270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.384 [2024-11-21 03:44:26.653297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.384 qpair failed and we were unable to recover it. 00:27:46.384 [2024-11-21 03:44:26.653435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.384 [2024-11-21 03:44:26.653564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.384 [2024-11-21 03:44:26.653591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.384 qpair failed and we were unable to recover it. 00:27:46.384 [2024-11-21 03:44:26.653721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.384 [2024-11-21 03:44:26.653871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.384 [2024-11-21 03:44:26.653900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.384 qpair failed and we were unable to recover it. 00:27:46.384 [2024-11-21 03:44:26.654048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.384 [2024-11-21 03:44:26.654175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.384 [2024-11-21 03:44:26.654203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.384 qpair failed and we were unable to recover it. 00:27:46.384 [2024-11-21 03:44:26.654318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.384 [2024-11-21 03:44:26.654419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.384 [2024-11-21 03:44:26.654447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.384 qpair failed and we were unable to recover it. 00:27:46.384 [2024-11-21 03:44:26.654572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.384 [2024-11-21 03:44:26.654688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.384 [2024-11-21 03:44:26.654717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.384 qpair failed and we were unable to recover it. 00:27:46.384 [2024-11-21 03:44:26.654859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.384 [2024-11-21 03:44:26.654974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.384 [2024-11-21 03:44:26.655004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.384 qpair failed and we were unable to recover it. 00:27:46.384 [2024-11-21 03:44:26.655129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.384 [2024-11-21 03:44:26.655232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.384 [2024-11-21 03:44:26.655258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.384 qpair failed and we were unable to recover it. 00:27:46.384 [2024-11-21 03:44:26.655409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.384 [2024-11-21 03:44:26.655518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.384 [2024-11-21 03:44:26.655547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.384 qpair failed and we were unable to recover it. 00:27:46.384 [2024-11-21 03:44:26.655652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.384 [2024-11-21 03:44:26.655819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.384 [2024-11-21 03:44:26.655849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.384 qpair failed and we were unable to recover it. 00:27:46.384 [2024-11-21 03:44:26.655992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.384 [2024-11-21 03:44:26.656122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.384 [2024-11-21 03:44:26.656150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.384 qpair failed and we were unable to recover it. 00:27:46.384 [2024-11-21 03:44:26.656280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.384 [2024-11-21 03:44:26.656432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.384 [2024-11-21 03:44:26.656461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.384 qpair failed and we were unable to recover it. 00:27:46.384 [2024-11-21 03:44:26.656601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.384 [2024-11-21 03:44:26.656735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.384 [2024-11-21 03:44:26.656765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.384 qpair failed and we were unable to recover it. 00:27:46.384 [2024-11-21 03:44:26.656920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.384 [2024-11-21 03:44:26.657065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.384 [2024-11-21 03:44:26.657128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.384 qpair failed and we were unable to recover it. 00:27:46.384 [2024-11-21 03:44:26.657263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.384 [2024-11-21 03:44:26.657367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.384 [2024-11-21 03:44:26.657394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.384 qpair failed and we were unable to recover it. 00:27:46.384 [2024-11-21 03:44:26.657495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.384 [2024-11-21 03:44:26.657590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.384 [2024-11-21 03:44:26.657617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.384 qpair failed and we were unable to recover it. 00:27:46.384 [2024-11-21 03:44:26.657720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.384 [2024-11-21 03:44:26.657825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.384 [2024-11-21 03:44:26.657852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.384 qpair failed and we were unable to recover it. 00:27:46.384 [2024-11-21 03:44:26.658000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.384 [2024-11-21 03:44:26.658151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.384 [2024-11-21 03:44:26.658178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.384 qpair failed and we were unable to recover it. 00:27:46.384 [2024-11-21 03:44:26.658312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.384 [2024-11-21 03:44:26.658455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.384 [2024-11-21 03:44:26.658484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.384 qpair failed and we were unable to recover it. 00:27:46.384 [2024-11-21 03:44:26.658635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.384 [2024-11-21 03:44:26.658762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.384 [2024-11-21 03:44:26.658789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.384 qpair failed and we were unable to recover it. 00:27:46.384 [2024-11-21 03:44:26.658913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.384 [2024-11-21 03:44:26.659059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.384 [2024-11-21 03:44:26.659114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.384 qpair failed and we were unable to recover it. 00:27:46.384 [2024-11-21 03:44:26.659237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.384 [2024-11-21 03:44:26.659336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.384 [2024-11-21 03:44:26.659380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.384 qpair failed and we were unable to recover it. 00:27:46.384 [2024-11-21 03:44:26.659510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.384 [2024-11-21 03:44:26.659606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.384 [2024-11-21 03:44:26.659633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.384 qpair failed and we were unable to recover it. 00:27:46.384 [2024-11-21 03:44:26.659790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.384 [2024-11-21 03:44:26.659902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.384 [2024-11-21 03:44:26.659933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.384 qpair failed and we were unable to recover it. 00:27:46.384 [2024-11-21 03:44:26.660093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.384 [2024-11-21 03:44:26.660227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.384 [2024-11-21 03:44:26.660254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.384 qpair failed and we were unable to recover it. 00:27:46.384 [2024-11-21 03:44:26.660348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.384 [2024-11-21 03:44:26.660455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.384 [2024-11-21 03:44:26.660482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.384 qpair failed and we were unable to recover it. 00:27:46.384 [2024-11-21 03:44:26.660600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.384 [2024-11-21 03:44:26.660707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.384 [2024-11-21 03:44:26.660736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.384 qpair failed and we were unable to recover it. 00:27:46.384 [2024-11-21 03:44:26.660881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.384 [2024-11-21 03:44:26.661024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.384 [2024-11-21 03:44:26.661053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.384 qpair failed and we were unable to recover it. 00:27:46.385 [2024-11-21 03:44:26.661186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.385 [2024-11-21 03:44:26.661343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.385 [2024-11-21 03:44:26.661370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.385 qpair failed and we were unable to recover it. 00:27:46.385 [2024-11-21 03:44:26.661497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.385 [2024-11-21 03:44:26.661686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.385 [2024-11-21 03:44:26.661713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.385 qpair failed and we were unable to recover it. 00:27:46.385 [2024-11-21 03:44:26.661809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.385 [2024-11-21 03:44:26.661924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.385 [2024-11-21 03:44:26.661954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.385 qpair failed and we were unable to recover it. 00:27:46.385 [2024-11-21 03:44:26.662105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.385 [2024-11-21 03:44:26.662233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.385 [2024-11-21 03:44:26.662260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.385 qpair failed and we were unable to recover it. 00:27:46.385 [2024-11-21 03:44:26.662396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.385 [2024-11-21 03:44:26.662511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.385 [2024-11-21 03:44:26.662540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.385 qpair failed and we were unable to recover it. 00:27:46.385 [2024-11-21 03:44:26.662692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.385 [2024-11-21 03:44:26.662794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.385 [2024-11-21 03:44:26.662821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.385 qpair failed and we were unable to recover it. 00:27:46.385 [2024-11-21 03:44:26.662943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.385 [2024-11-21 03:44:26.663090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.385 [2024-11-21 03:44:26.663143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.385 qpair failed and we were unable to recover it. 00:27:46.385 [2024-11-21 03:44:26.663253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.385 [2024-11-21 03:44:26.663378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.385 [2024-11-21 03:44:26.663405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.385 qpair failed and we were unable to recover it. 00:27:46.385 [2024-11-21 03:44:26.663501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.385 [2024-11-21 03:44:26.663645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.385 [2024-11-21 03:44:26.663675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.385 qpair failed and we were unable to recover it. 00:27:46.385 [2024-11-21 03:44:26.663802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.385 [2024-11-21 03:44:26.663934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.385 [2024-11-21 03:44:26.663961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.385 qpair failed and we were unable to recover it. 00:27:46.385 [2024-11-21 03:44:26.664113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.385 [2024-11-21 03:44:26.664230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.385 [2024-11-21 03:44:26.664257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.385 qpair failed and we were unable to recover it. 00:27:46.385 [2024-11-21 03:44:26.664368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.385 [2024-11-21 03:44:26.664506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.385 [2024-11-21 03:44:26.664548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.385 qpair failed and we were unable to recover it. 00:27:46.385 [2024-11-21 03:44:26.664726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.385 [2024-11-21 03:44:26.664866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.385 [2024-11-21 03:44:26.664896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.385 qpair failed and we were unable to recover it. 00:27:46.385 [2024-11-21 03:44:26.665021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.385 [2024-11-21 03:44:26.665172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.385 [2024-11-21 03:44:26.665200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.385 qpair failed and we were unable to recover it. 00:27:46.385 [2024-11-21 03:44:26.665330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.385 [2024-11-21 03:44:26.665485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.385 [2024-11-21 03:44:26.665515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.385 qpair failed and we were unable to recover it. 00:27:46.385 [2024-11-21 03:44:26.665640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.385 [2024-11-21 03:44:26.665732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.385 [2024-11-21 03:44:26.665759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.385 qpair failed and we were unable to recover it. 00:27:46.385 [2024-11-21 03:44:26.665936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.385 [2024-11-21 03:44:26.666055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.385 [2024-11-21 03:44:26.666097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.385 qpair failed and we were unable to recover it. 00:27:46.385 [2024-11-21 03:44:26.666255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.385 [2024-11-21 03:44:26.666380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.385 [2024-11-21 03:44:26.666408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.385 qpair failed and we were unable to recover it. 00:27:46.385 [2024-11-21 03:44:26.666536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.385 [2024-11-21 03:44:26.666664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.385 [2024-11-21 03:44:26.666691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.385 qpair failed and we were unable to recover it. 00:27:46.385 [2024-11-21 03:44:26.666830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.385 [2024-11-21 03:44:26.666941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.385 [2024-11-21 03:44:26.666970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.385 qpair failed and we were unable to recover it. 00:27:46.385 [2024-11-21 03:44:26.667123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.385 [2024-11-21 03:44:26.667230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.385 [2024-11-21 03:44:26.667257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.385 qpair failed and we were unable to recover it. 00:27:46.385 [2024-11-21 03:44:26.667394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.385 [2024-11-21 03:44:26.667495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.385 [2024-11-21 03:44:26.667522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.385 qpair failed and we were unable to recover it. 00:27:46.385 [2024-11-21 03:44:26.667623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.385 [2024-11-21 03:44:26.667716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.385 [2024-11-21 03:44:26.667743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.385 qpair failed and we were unable to recover it. 00:27:46.385 [2024-11-21 03:44:26.667874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.385 [2024-11-21 03:44:26.667978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.385 [2024-11-21 03:44:26.668007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.385 qpair failed and we were unable to recover it. 00:27:46.385 [2024-11-21 03:44:26.668131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.385 [2024-11-21 03:44:26.668256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.385 [2024-11-21 03:44:26.668283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.385 qpair failed and we were unable to recover it. 00:27:46.385 [2024-11-21 03:44:26.668387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.385 [2024-11-21 03:44:26.668539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.385 [2024-11-21 03:44:26.668568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.385 qpair failed and we were unable to recover it. 00:27:46.385 [2024-11-21 03:44:26.668677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.385 [2024-11-21 03:44:26.668786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.385 [2024-11-21 03:44:26.668816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.385 qpair failed and we were unable to recover it. 00:27:46.385 [2024-11-21 03:44:26.668962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.385 [2024-11-21 03:44:26.669147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.385 [2024-11-21 03:44:26.669176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.385 qpair failed and we were unable to recover it. 00:27:46.385 [2024-11-21 03:44:26.669280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.386 [2024-11-21 03:44:26.669437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.386 [2024-11-21 03:44:26.669464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.386 qpair failed and we were unable to recover it. 00:27:46.386 [2024-11-21 03:44:26.669630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.386 [2024-11-21 03:44:26.669767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.386 [2024-11-21 03:44:26.669797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.386 qpair failed and we were unable to recover it. 00:27:46.386 [2024-11-21 03:44:26.669965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.386 [2024-11-21 03:44:26.670161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.386 [2024-11-21 03:44:26.670188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.386 qpair failed and we were unable to recover it. 00:27:46.386 [2024-11-21 03:44:26.670290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.386 [2024-11-21 03:44:26.670478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.386 [2024-11-21 03:44:26.670505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.386 qpair failed and we were unable to recover it. 00:27:46.386 [2024-11-21 03:44:26.670614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.386 [2024-11-21 03:44:26.670758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.386 [2024-11-21 03:44:26.670787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.386 qpair failed and we were unable to recover it. 00:27:46.386 [2024-11-21 03:44:26.670902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.386 [2024-11-21 03:44:26.671058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.386 [2024-11-21 03:44:26.671135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.386 qpair failed and we were unable to recover it. 00:27:46.386 [2024-11-21 03:44:26.671238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.386 [2024-11-21 03:44:26.671346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.386 [2024-11-21 03:44:26.671373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.386 qpair failed and we were unable to recover it. 00:27:46.386 [2024-11-21 03:44:26.671486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.386 [2024-11-21 03:44:26.671600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.386 [2024-11-21 03:44:26.671630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.386 qpair failed and we were unable to recover it. 00:27:46.386 [2024-11-21 03:44:26.671781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.386 [2024-11-21 03:44:26.671882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.386 [2024-11-21 03:44:26.671909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.386 qpair failed and we were unable to recover it. 00:27:46.386 [2024-11-21 03:44:26.672049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.386 [2024-11-21 03:44:26.672193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.386 [2024-11-21 03:44:26.672221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.386 qpair failed and we were unable to recover it. 00:27:46.386 [2024-11-21 03:44:26.672318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.386 [2024-11-21 03:44:26.672476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.386 [2024-11-21 03:44:26.672505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.386 qpair failed and we were unable to recover it. 00:27:46.386 [2024-11-21 03:44:26.672633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.386 [2024-11-21 03:44:26.672734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.386 [2024-11-21 03:44:26.672761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.386 qpair failed and we were unable to recover it. 00:27:46.386 [2024-11-21 03:44:26.672861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.386 [2024-11-21 03:44:26.672988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.386 [2024-11-21 03:44:26.673018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.386 qpair failed and we were unable to recover it. 00:27:46.386 [2024-11-21 03:44:26.673170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.386 [2024-11-21 03:44:26.673294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.386 [2024-11-21 03:44:26.673321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.386 qpair failed and we were unable to recover it. 00:27:46.386 [2024-11-21 03:44:26.673451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.386 [2024-11-21 03:44:26.673571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.386 [2024-11-21 03:44:26.673600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.386 qpair failed and we were unable to recover it. 00:27:46.386 [2024-11-21 03:44:26.673712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.386 [2024-11-21 03:44:26.673824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.386 [2024-11-21 03:44:26.673854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.386 qpair failed and we were unable to recover it. 00:27:46.386 [2024-11-21 03:44:26.673972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.386 [2024-11-21 03:44:26.674110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.386 [2024-11-21 03:44:26.674138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.386 qpair failed and we were unable to recover it. 00:27:46.386 [2024-11-21 03:44:26.674238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.386 [2024-11-21 03:44:26.674335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.386 [2024-11-21 03:44:26.674362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.386 qpair failed and we were unable to recover it. 00:27:46.386 [2024-11-21 03:44:26.674506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.386 [2024-11-21 03:44:26.674649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.386 [2024-11-21 03:44:26.674678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.386 qpair failed and we were unable to recover it. 00:27:46.386 [2024-11-21 03:44:26.674818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.386 [2024-11-21 03:44:26.674964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.386 [2024-11-21 03:44:26.674994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.386 qpair failed and we were unable to recover it. 00:27:46.386 [2024-11-21 03:44:26.675130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.386 [2024-11-21 03:44:26.675241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.386 [2024-11-21 03:44:26.675268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.386 qpair failed and we were unable to recover it. 00:27:46.386 [2024-11-21 03:44:26.675369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.386 [2024-11-21 03:44:26.675482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.386 [2024-11-21 03:44:26.675512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.386 qpair failed and we were unable to recover it. 00:27:46.386 [2024-11-21 03:44:26.675627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.386 [2024-11-21 03:44:26.675766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.386 [2024-11-21 03:44:26.675796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.386 qpair failed and we were unable to recover it. 00:27:46.386 [2024-11-21 03:44:26.675973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.386 [2024-11-21 03:44:26.676126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.386 [2024-11-21 03:44:26.676172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.386 qpair failed and we were unable to recover it. 00:27:46.386 [2024-11-21 03:44:26.676285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.386 [2024-11-21 03:44:26.676429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.386 [2024-11-21 03:44:26.676459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.386 qpair failed and we were unable to recover it. 00:27:46.386 [2024-11-21 03:44:26.676617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.386 [2024-11-21 03:44:26.676718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.386 [2024-11-21 03:44:26.676745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.386 qpair failed and we were unable to recover it. 00:27:46.386 [2024-11-21 03:44:26.676922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.386 [2024-11-21 03:44:26.677028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.386 [2024-11-21 03:44:26.677058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.386 qpair failed and we were unable to recover it. 00:27:46.386 [2024-11-21 03:44:26.677213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.386 [2024-11-21 03:44:26.677316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.386 [2024-11-21 03:44:26.677343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.386 qpair failed and we were unable to recover it. 00:27:46.386 [2024-11-21 03:44:26.677472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.386 [2024-11-21 03:44:26.677600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.386 [2024-11-21 03:44:26.677627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.386 qpair failed and we were unable to recover it. 00:27:46.386 [2024-11-21 03:44:26.677726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.387 [2024-11-21 03:44:26.677837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.387 [2024-11-21 03:44:26.677864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.387 qpair failed and we were unable to recover it. 00:27:46.387 [2024-11-21 03:44:26.677983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.387 [2024-11-21 03:44:26.678096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.387 [2024-11-21 03:44:26.678142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.387 qpair failed and we were unable to recover it. 00:27:46.387 [2024-11-21 03:44:26.678250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.387 [2024-11-21 03:44:26.678432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.387 [2024-11-21 03:44:26.678462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.387 qpair failed and we were unable to recover it. 00:27:46.387 [2024-11-21 03:44:26.678594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.387 [2024-11-21 03:44:26.678712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.387 [2024-11-21 03:44:26.678742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.387 qpair failed and we were unable to recover it. 00:27:46.387 [2024-11-21 03:44:26.678857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.387 [2024-11-21 03:44:26.678970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.387 [2024-11-21 03:44:26.679013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.387 qpair failed and we were unable to recover it. 00:27:46.387 [2024-11-21 03:44:26.679119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.387 [2024-11-21 03:44:26.679227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.387 [2024-11-21 03:44:26.679254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.387 qpair failed and we were unable to recover it. 00:27:46.387 [2024-11-21 03:44:26.679358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.387 [2024-11-21 03:44:26.679512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.387 [2024-11-21 03:44:26.679539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.387 qpair failed and we were unable to recover it. 00:27:46.387 [2024-11-21 03:44:26.679725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.387 [2024-11-21 03:44:26.679866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.387 [2024-11-21 03:44:26.679895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.387 qpair failed and we were unable to recover it. 00:27:46.387 [2024-11-21 03:44:26.680010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.387 [2024-11-21 03:44:26.680142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.387 [2024-11-21 03:44:26.680170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.387 qpair failed and we were unable to recover it. 00:27:46.387 [2024-11-21 03:44:26.680279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.387 [2024-11-21 03:44:26.680381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.387 [2024-11-21 03:44:26.680408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.387 qpair failed and we were unable to recover it. 00:27:46.387 [2024-11-21 03:44:26.680533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.387 [2024-11-21 03:44:26.680672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.387 [2024-11-21 03:44:26.680707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.387 qpair failed and we were unable to recover it. 00:27:46.387 [2024-11-21 03:44:26.680863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.387 [2024-11-21 03:44:26.680962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.387 [2024-11-21 03:44:26.680989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.387 qpair failed and we were unable to recover it. 00:27:46.387 [2024-11-21 03:44:26.681101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.387 [2024-11-21 03:44:26.681200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.387 [2024-11-21 03:44:26.681227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.387 qpair failed and we were unable to recover it. 00:27:46.387 [2024-11-21 03:44:26.681323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.387 [2024-11-21 03:44:26.681444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.387 [2024-11-21 03:44:26.681473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.387 qpair failed and we were unable to recover it. 00:27:46.387 [2024-11-21 03:44:26.681620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.387 [2024-11-21 03:44:26.681747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.387 [2024-11-21 03:44:26.681773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.387 qpair failed and we were unable to recover it. 00:27:46.387 [2024-11-21 03:44:26.681894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.387 [2024-11-21 03:44:26.682036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.387 [2024-11-21 03:44:26.682065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.387 qpair failed and we were unable to recover it. 00:27:46.387 [2024-11-21 03:44:26.682190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.387 [2024-11-21 03:44:26.682295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.387 [2024-11-21 03:44:26.682321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.387 qpair failed and we were unable to recover it. 00:27:46.387 [2024-11-21 03:44:26.682422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.387 [2024-11-21 03:44:26.682520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.387 [2024-11-21 03:44:26.682548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.387 qpair failed and we were unable to recover it. 00:27:46.387 [2024-11-21 03:44:26.682687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.387 [2024-11-21 03:44:26.682814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.387 [2024-11-21 03:44:26.682841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.387 qpair failed and we were unable to recover it. 00:27:46.387 [2024-11-21 03:44:26.682996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.387 [2024-11-21 03:44:26.683143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.387 [2024-11-21 03:44:26.683171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.387 qpair failed and we were unable to recover it. 00:27:46.387 [2024-11-21 03:44:26.683304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.387 [2024-11-21 03:44:26.683452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.387 [2024-11-21 03:44:26.683481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.387 qpair failed and we were unable to recover it. 00:27:46.387 [2024-11-21 03:44:26.683660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.387 [2024-11-21 03:44:26.683824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.387 [2024-11-21 03:44:26.683853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.387 qpair failed and we were unable to recover it. 00:27:46.387 [2024-11-21 03:44:26.683988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.387 [2024-11-21 03:44:26.684167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.387 [2024-11-21 03:44:26.684195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.387 qpair failed and we were unable to recover it. 00:27:46.387 [2024-11-21 03:44:26.684299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.387 [2024-11-21 03:44:26.684466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.387 [2024-11-21 03:44:26.684492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.387 qpair failed and we were unable to recover it. 00:27:46.387 [2024-11-21 03:44:26.684644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.387 [2024-11-21 03:44:26.684804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.388 [2024-11-21 03:44:26.684834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.388 qpair failed and we were unable to recover it. 00:27:46.388 [2024-11-21 03:44:26.684945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.388 [2024-11-21 03:44:26.685097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.388 [2024-11-21 03:44:26.685126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.388 qpair failed and we were unable to recover it. 00:27:46.388 [2024-11-21 03:44:26.685256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.388 [2024-11-21 03:44:26.685435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.388 [2024-11-21 03:44:26.685465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.388 qpair failed and we were unable to recover it. 00:27:46.388 [2024-11-21 03:44:26.685617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.388 [2024-11-21 03:44:26.685771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.388 [2024-11-21 03:44:26.685798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.388 qpair failed and we were unable to recover it. 00:27:46.388 [2024-11-21 03:44:26.685907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.388 [2024-11-21 03:44:26.686012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.388 [2024-11-21 03:44:26.686039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.388 qpair failed and we were unable to recover it. 00:27:46.388 [2024-11-21 03:44:26.686151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.388 [2024-11-21 03:44:26.686259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.388 [2024-11-21 03:44:26.686286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.388 qpair failed and we were unable to recover it. 00:27:46.388 [2024-11-21 03:44:26.686396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.388 [2024-11-21 03:44:26.686525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.388 [2024-11-21 03:44:26.686552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.388 qpair failed and we were unable to recover it. 00:27:46.388 [2024-11-21 03:44:26.686676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.388 [2024-11-21 03:44:26.686789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.388 [2024-11-21 03:44:26.686819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.388 qpair failed and we were unable to recover it. 00:27:46.388 [2024-11-21 03:44:26.686935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.388 [2024-11-21 03:44:26.687080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.388 [2024-11-21 03:44:26.687125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.388 qpair failed and we were unable to recover it. 00:27:46.388 [2024-11-21 03:44:26.687231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.388 [2024-11-21 03:44:26.687323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.388 [2024-11-21 03:44:26.687349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.388 qpair failed and we were unable to recover it. 00:27:46.388 [2024-11-21 03:44:26.687487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.388 [2024-11-21 03:44:26.687586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.388 [2024-11-21 03:44:26.687613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.388 qpair failed and we were unable to recover it. 00:27:46.388 [2024-11-21 03:44:26.687752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.388 [2024-11-21 03:44:26.687895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.388 [2024-11-21 03:44:26.687924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.388 qpair failed and we were unable to recover it. 00:27:46.388 [2024-11-21 03:44:26.688066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.388 [2024-11-21 03:44:26.688182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.388 [2024-11-21 03:44:26.688209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.388 qpair failed and we were unable to recover it. 00:27:46.388 [2024-11-21 03:44:26.688321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.388 [2024-11-21 03:44:26.688427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.388 [2024-11-21 03:44:26.688454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.388 qpair failed and we were unable to recover it. 00:27:46.388 [2024-11-21 03:44:26.688552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.388 [2024-11-21 03:44:26.688691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.388 [2024-11-21 03:44:26.688721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.388 qpair failed and we were unable to recover it. 00:27:46.388 [2024-11-21 03:44:26.688929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.388 [2024-11-21 03:44:26.689087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.388 [2024-11-21 03:44:26.689114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.388 qpair failed and we were unable to recover it. 00:27:46.388 [2024-11-21 03:44:26.689246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.388 [2024-11-21 03:44:26.689355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.388 [2024-11-21 03:44:26.689384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.388 qpair failed and we were unable to recover it. 00:27:46.388 [2024-11-21 03:44:26.689508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.388 [2024-11-21 03:44:26.689630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.388 [2024-11-21 03:44:26.689660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.388 qpair failed and we were unable to recover it. 00:27:46.388 [2024-11-21 03:44:26.689831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.388 [2024-11-21 03:44:26.689969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.388 [2024-11-21 03:44:26.689999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.388 qpair failed and we were unable to recover it. 00:27:46.388 [2024-11-21 03:44:26.690159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.388 [2024-11-21 03:44:26.690263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.388 [2024-11-21 03:44:26.690291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.388 qpair failed and we were unable to recover it. 00:27:46.388 [2024-11-21 03:44:26.690411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.388 [2024-11-21 03:44:26.690518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.388 [2024-11-21 03:44:26.690548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.388 qpair failed and we were unable to recover it. 00:27:46.388 [2024-11-21 03:44:26.690694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.388 [2024-11-21 03:44:26.690854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.388 [2024-11-21 03:44:26.690881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.388 qpair failed and we were unable to recover it. 00:27:46.388 [2024-11-21 03:44:26.691099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.388 [2024-11-21 03:44:26.691229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.388 [2024-11-21 03:44:26.691256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.388 qpair failed and we were unable to recover it. 00:27:46.388 [2024-11-21 03:44:26.691390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.388 [2024-11-21 03:44:26.691505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.388 [2024-11-21 03:44:26.691537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.388 qpair failed and we were unable to recover it. 00:27:46.388 [2024-11-21 03:44:26.691667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.388 [2024-11-21 03:44:26.691821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.388 [2024-11-21 03:44:26.691847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.388 qpair failed and we were unable to recover it. 00:27:46.388 [2024-11-21 03:44:26.691993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.388 [2024-11-21 03:44:26.692129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.388 [2024-11-21 03:44:26.692157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.388 qpair failed and we were unable to recover it. 00:27:46.388 [2024-11-21 03:44:26.692263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.388 [2024-11-21 03:44:26.692456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.388 [2024-11-21 03:44:26.692483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.388 qpair failed and we were unable to recover it. 00:27:46.388 [2024-11-21 03:44:26.692591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.388 [2024-11-21 03:44:26.692696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.388 [2024-11-21 03:44:26.692723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.388 qpair failed and we were unable to recover it. 00:27:46.388 [2024-11-21 03:44:26.692898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.388 [2024-11-21 03:44:26.693019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.388 [2024-11-21 03:44:26.693048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.388 qpair failed and we were unable to recover it. 00:27:46.388 [2024-11-21 03:44:26.693198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.388 [2024-11-21 03:44:26.693311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.389 [2024-11-21 03:44:26.693338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.389 qpair failed and we were unable to recover it. 00:27:46.389 [2024-11-21 03:44:26.693497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.389 [2024-11-21 03:44:26.693619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.389 [2024-11-21 03:44:26.693648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.389 qpair failed and we were unable to recover it. 00:27:46.389 [2024-11-21 03:44:26.693820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.389 [2024-11-21 03:44:26.693932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.389 [2024-11-21 03:44:26.693963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.389 qpair failed and we were unable to recover it. 00:27:46.389 [2024-11-21 03:44:26.694124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.389 [2024-11-21 03:44:26.694235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.389 [2024-11-21 03:44:26.694263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.389 qpair failed and we were unable to recover it. 00:27:46.389 [2024-11-21 03:44:26.694372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.389 [2024-11-21 03:44:26.694474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.389 [2024-11-21 03:44:26.694502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.389 qpair failed and we were unable to recover it. 00:27:46.389 [2024-11-21 03:44:26.694678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.389 [2024-11-21 03:44:26.694790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.389 [2024-11-21 03:44:26.694820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.389 qpair failed and we were unable to recover it. 00:27:46.389 [2024-11-21 03:44:26.694931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.389 [2024-11-21 03:44:26.695037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.389 [2024-11-21 03:44:26.695067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.389 qpair failed and we were unable to recover it. 00:27:46.389 [2024-11-21 03:44:26.695201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.389 [2024-11-21 03:44:26.695331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.389 [2024-11-21 03:44:26.695358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.389 qpair failed and we were unable to recover it. 00:27:46.389 [2024-11-21 03:44:26.695503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.389 [2024-11-21 03:44:26.695625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.389 [2024-11-21 03:44:26.695659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.389 qpair failed and we were unable to recover it. 00:27:46.389 [2024-11-21 03:44:26.695779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.389 [2024-11-21 03:44:26.695951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.389 [2024-11-21 03:44:26.695980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.389 qpair failed and we were unable to recover it. 00:27:46.389 [2024-11-21 03:44:26.696135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.389 [2024-11-21 03:44:26.696279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.389 [2024-11-21 03:44:26.696306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.389 qpair failed and we were unable to recover it. 00:27:46.389 [2024-11-21 03:44:26.696459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.389 [2024-11-21 03:44:26.696577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.389 [2024-11-21 03:44:26.696607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.389 qpair failed and we were unable to recover it. 00:27:46.389 [2024-11-21 03:44:26.696728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.389 [2024-11-21 03:44:26.696876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.389 [2024-11-21 03:44:26.696905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.389 qpair failed and we were unable to recover it. 00:27:46.389 [2024-11-21 03:44:26.697075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.389 [2024-11-21 03:44:26.697188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.389 [2024-11-21 03:44:26.697214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.389 qpair failed and we were unable to recover it. 00:27:46.389 [2024-11-21 03:44:26.697361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.389 [2024-11-21 03:44:26.697541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.389 [2024-11-21 03:44:26.697568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.389 qpair failed and we were unable to recover it. 00:27:46.389 [2024-11-21 03:44:26.697755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.389 [2024-11-21 03:44:26.697866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.389 [2024-11-21 03:44:26.697894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.389 qpair failed and we were unable to recover it. 00:27:46.389 [2024-11-21 03:44:26.698043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.389 [2024-11-21 03:44:26.698177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.389 [2024-11-21 03:44:26.698203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.389 qpair failed and we were unable to recover it. 00:27:46.389 [2024-11-21 03:44:26.698301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.389 [2024-11-21 03:44:26.698471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.389 [2024-11-21 03:44:26.698497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.389 qpair failed and we were unable to recover it. 00:27:46.389 [2024-11-21 03:44:26.698599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.389 [2024-11-21 03:44:26.698718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.389 [2024-11-21 03:44:26.698747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.389 qpair failed and we were unable to recover it. 00:27:46.389 [2024-11-21 03:44:26.698904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.389 [2024-11-21 03:44:26.699039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.389 [2024-11-21 03:44:26.699066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.389 qpair failed and we were unable to recover it. 00:27:46.389 [2024-11-21 03:44:26.699262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.389 [2024-11-21 03:44:26.699405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.389 [2024-11-21 03:44:26.699434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.389 qpair failed and we were unable to recover it. 00:27:46.389 [2024-11-21 03:44:26.699552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.389 [2024-11-21 03:44:26.699693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.389 [2024-11-21 03:44:26.699722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.389 qpair failed and we were unable to recover it. 00:27:46.389 [2024-11-21 03:44:26.699863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.389 [2024-11-21 03:44:26.700032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.389 [2024-11-21 03:44:26.700061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.389 qpair failed and we were unable to recover it. 00:27:46.389 [2024-11-21 03:44:26.700195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.389 [2024-11-21 03:44:26.700311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.389 [2024-11-21 03:44:26.700337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.389 qpair failed and we were unable to recover it. 00:27:46.389 [2024-11-21 03:44:26.700493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.389 [2024-11-21 03:44:26.700635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.389 [2024-11-21 03:44:26.700666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.389 qpair failed and we were unable to recover it. 00:27:46.389 [2024-11-21 03:44:26.700837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.389 [2024-11-21 03:44:26.700963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.389 [2024-11-21 03:44:26.700994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.389 qpair failed and we were unable to recover it. 00:27:46.389 [2024-11-21 03:44:26.701144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.389 [2024-11-21 03:44:26.701276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.389 [2024-11-21 03:44:26.701303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.389 qpair failed and we were unable to recover it. 00:27:46.389 [2024-11-21 03:44:26.701457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.389 [2024-11-21 03:44:26.701599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.389 [2024-11-21 03:44:26.701628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.389 qpair failed and we were unable to recover it. 00:27:46.389 [2024-11-21 03:44:26.701751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.389 [2024-11-21 03:44:26.701897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.389 [2024-11-21 03:44:26.701926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.389 qpair failed and we were unable to recover it. 00:27:46.389 [2024-11-21 03:44:26.702088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.389 [2024-11-21 03:44:26.702197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.390 [2024-11-21 03:44:26.702224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.390 qpair failed and we were unable to recover it. 00:27:46.390 [2024-11-21 03:44:26.702336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.390 [2024-11-21 03:44:26.702460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.390 [2024-11-21 03:44:26.702486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.390 qpair failed and we were unable to recover it. 00:27:46.390 [2024-11-21 03:44:26.702616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.390 [2024-11-21 03:44:26.702740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.390 [2024-11-21 03:44:26.702766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.390 qpair failed and we were unable to recover it. 00:27:46.390 [2024-11-21 03:44:26.702899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.390 [2024-11-21 03:44:26.703023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.390 [2024-11-21 03:44:26.703054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.390 qpair failed and we were unable to recover it. 00:27:46.390 [2024-11-21 03:44:26.703225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.390 [2024-11-21 03:44:26.703359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.390 [2024-11-21 03:44:26.703384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.390 qpair failed and we were unable to recover it. 00:27:46.390 [2024-11-21 03:44:26.703510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.390 [2024-11-21 03:44:26.703603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.390 [2024-11-21 03:44:26.703629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.390 qpair failed and we were unable to recover it. 00:27:46.390 [2024-11-21 03:44:26.703798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.390 [2024-11-21 03:44:26.703948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.390 [2024-11-21 03:44:26.703977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.390 qpair failed and we were unable to recover it. 00:27:46.390 [2024-11-21 03:44:26.704131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.390 [2024-11-21 03:44:26.704227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.390 [2024-11-21 03:44:26.704254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.390 qpair failed and we were unable to recover it. 00:27:46.390 [2024-11-21 03:44:26.704388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.390 [2024-11-21 03:44:26.704545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.390 [2024-11-21 03:44:26.704571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.390 qpair failed and we were unable to recover it. 00:27:46.390 [2024-11-21 03:44:26.704678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.390 [2024-11-21 03:44:26.704836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.390 [2024-11-21 03:44:26.704866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.390 qpair failed and we were unable to recover it. 00:27:46.390 [2024-11-21 03:44:26.704978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.390 [2024-11-21 03:44:26.705089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.390 [2024-11-21 03:44:26.705132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.390 qpair failed and we were unable to recover it. 00:27:46.390 [2024-11-21 03:44:26.705236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.390 [2024-11-21 03:44:26.705361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.390 [2024-11-21 03:44:26.705387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.390 qpair failed and we were unable to recover it. 00:27:46.390 [2024-11-21 03:44:26.705614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.390 [2024-11-21 03:44:26.705730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.390 [2024-11-21 03:44:26.705759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.390 qpair failed and we were unable to recover it. 00:27:46.390 [2024-11-21 03:44:26.705878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.390 [2024-11-21 03:44:26.706023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.390 [2024-11-21 03:44:26.706052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.390 qpair failed and we were unable to recover it. 00:27:46.390 [2024-11-21 03:44:26.706223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.390 [2024-11-21 03:44:26.706367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.390 [2024-11-21 03:44:26.706420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.390 qpair failed and we were unable to recover it. 00:27:46.390 [2024-11-21 03:44:26.706555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.390 [2024-11-21 03:44:26.706706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.390 [2024-11-21 03:44:26.706732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.390 qpair failed and we were unable to recover it. 00:27:46.390 [2024-11-21 03:44:26.706876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.390 [2024-11-21 03:44:26.707015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.390 [2024-11-21 03:44:26.707045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.390 qpair failed and we were unable to recover it. 00:27:46.390 [2024-11-21 03:44:26.707214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.390 [2024-11-21 03:44:26.707313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.390 [2024-11-21 03:44:26.707350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.390 qpair failed and we were unable to recover it. 00:27:46.390 [2024-11-21 03:44:26.707506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.390 [2024-11-21 03:44:26.707639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.390 [2024-11-21 03:44:26.707668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.390 qpair failed and we were unable to recover it. 00:27:46.390 [2024-11-21 03:44:26.707786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.390 [2024-11-21 03:44:26.707930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.390 [2024-11-21 03:44:26.707959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.390 qpair failed and we were unable to recover it. 00:27:46.390 [2024-11-21 03:44:26.708115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.390 [2024-11-21 03:44:26.708281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.390 [2024-11-21 03:44:26.708325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.390 qpair failed and we were unable to recover it. 00:27:46.390 [2024-11-21 03:44:26.708454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.390 [2024-11-21 03:44:26.708622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.390 [2024-11-21 03:44:26.708652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.390 qpair failed and we were unable to recover it. 00:27:46.390 [2024-11-21 03:44:26.708796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.390 [2024-11-21 03:44:26.708906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.390 [2024-11-21 03:44:26.708936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.390 qpair failed and we were unable to recover it. 00:27:46.390 [2024-11-21 03:44:26.709064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.390 [2024-11-21 03:44:26.709213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.390 [2024-11-21 03:44:26.709239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.390 qpair failed and we were unable to recover it. 00:27:46.390 [2024-11-21 03:44:26.709470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.390 [2024-11-21 03:44:26.709610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.390 [2024-11-21 03:44:26.709639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.390 qpair failed and we were unable to recover it. 00:27:46.390 [2024-11-21 03:44:26.709755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.390 [2024-11-21 03:44:26.709927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.390 [2024-11-21 03:44:26.709956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.390 qpair failed and we were unable to recover it. 00:27:46.390 [2024-11-21 03:44:26.710098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.390 [2024-11-21 03:44:26.710230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.390 [2024-11-21 03:44:26.710257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.390 qpair failed and we were unable to recover it. 00:27:46.390 [2024-11-21 03:44:26.710393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.390 [2024-11-21 03:44:26.710510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.390 [2024-11-21 03:44:26.710539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.390 qpair failed and we were unable to recover it. 00:27:46.390 [2024-11-21 03:44:26.710682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.390 [2024-11-21 03:44:26.710823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.390 [2024-11-21 03:44:26.710852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.390 qpair failed and we were unable to recover it. 00:27:46.390 [2024-11-21 03:44:26.710977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.390 [2024-11-21 03:44:26.711086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.391 [2024-11-21 03:44:26.711113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.391 qpair failed and we were unable to recover it. 00:27:46.391 [2024-11-21 03:44:26.711219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.391 [2024-11-21 03:44:26.711426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.391 [2024-11-21 03:44:26.711460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.391 qpair failed and we were unable to recover it. 00:27:46.391 [2024-11-21 03:44:26.711638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.391 [2024-11-21 03:44:26.711785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.391 [2024-11-21 03:44:26.711814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.391 qpair failed and we were unable to recover it. 00:27:46.391 [2024-11-21 03:44:26.711967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.391 [2024-11-21 03:44:26.712078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.391 [2024-11-21 03:44:26.712105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.391 qpair failed and we were unable to recover it. 00:27:46.391 [2024-11-21 03:44:26.712264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.391 [2024-11-21 03:44:26.712438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.391 [2024-11-21 03:44:26.712499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.391 qpair failed and we were unable to recover it. 00:27:46.391 [2024-11-21 03:44:26.712620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.391 [2024-11-21 03:44:26.712725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.391 [2024-11-21 03:44:26.712754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.391 qpair failed and we were unable to recover it. 00:27:46.391 [2024-11-21 03:44:26.712907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.391 [2024-11-21 03:44:26.713029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.391 [2024-11-21 03:44:26.713055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.391 qpair failed and we were unable to recover it. 00:27:46.391 [2024-11-21 03:44:26.713254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.391 [2024-11-21 03:44:26.713396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.391 [2024-11-21 03:44:26.713422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.391 qpair failed and we were unable to recover it. 00:27:46.391 [2024-11-21 03:44:26.713571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.391 [2024-11-21 03:44:26.713718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.391 [2024-11-21 03:44:26.713747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.391 qpair failed and we were unable to recover it. 00:27:46.391 [2024-11-21 03:44:26.713929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.391 [2024-11-21 03:44:26.714036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.391 [2024-11-21 03:44:26.714065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.391 qpair failed and we were unable to recover it. 00:27:46.391 [2024-11-21 03:44:26.714250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.391 [2024-11-21 03:44:26.714383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.391 [2024-11-21 03:44:26.714409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.391 qpair failed and we were unable to recover it. 00:27:46.391 [2024-11-21 03:44:26.714522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.391 [2024-11-21 03:44:26.714702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.391 [2024-11-21 03:44:26.714731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.391 qpair failed and we were unable to recover it. 00:27:46.391 [2024-11-21 03:44:26.714869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.391 [2024-11-21 03:44:26.715012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.391 [2024-11-21 03:44:26.715039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.391 qpair failed and we were unable to recover it. 00:27:46.391 [2024-11-21 03:44:26.715204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.391 [2024-11-21 03:44:26.715312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.391 [2024-11-21 03:44:26.715341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.391 qpair failed and we were unable to recover it. 00:27:46.391 [2024-11-21 03:44:26.715462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.391 [2024-11-21 03:44:26.715624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.391 [2024-11-21 03:44:26.715650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.391 qpair failed and we were unable to recover it. 00:27:46.391 [2024-11-21 03:44:26.715794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.391 [2024-11-21 03:44:26.715892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.391 [2024-11-21 03:44:26.715917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.391 qpair failed and we were unable to recover it. 00:27:46.391 [2024-11-21 03:44:26.716079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.391 [2024-11-21 03:44:26.716231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.391 [2024-11-21 03:44:26.716260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.391 qpair failed and we were unable to recover it. 00:27:46.391 [2024-11-21 03:44:26.716395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.391 [2024-11-21 03:44:26.716537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.391 [2024-11-21 03:44:26.716571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.391 qpair failed and we were unable to recover it. 00:27:46.391 [2024-11-21 03:44:26.716712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.391 [2024-11-21 03:44:26.716815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.391 [2024-11-21 03:44:26.716841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.391 qpair failed and we were unable to recover it. 00:27:46.391 [2024-11-21 03:44:26.716968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.391 [2024-11-21 03:44:26.717128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.391 [2024-11-21 03:44:26.717156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.391 qpair failed and we were unable to recover it. 00:27:46.391 [2024-11-21 03:44:26.717289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.391 [2024-11-21 03:44:26.717432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.391 [2024-11-21 03:44:26.717462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.391 qpair failed and we were unable to recover it. 00:27:46.391 [2024-11-21 03:44:26.717608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.391 [2024-11-21 03:44:26.717759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.391 [2024-11-21 03:44:26.717785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.391 qpair failed and we were unable to recover it. 00:27:46.391 [2024-11-21 03:44:26.717898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.391 [2024-11-21 03:44:26.718055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.391 [2024-11-21 03:44:26.718090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.391 qpair failed and we were unable to recover it. 00:27:46.391 [2024-11-21 03:44:26.718205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.391 [2024-11-21 03:44:26.718306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.391 [2024-11-21 03:44:26.718332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.391 qpair failed and we were unable to recover it. 00:27:46.391 [2024-11-21 03:44:26.718475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.391 [2024-11-21 03:44:26.718615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.391 [2024-11-21 03:44:26.718659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.391 qpair failed and we were unable to recover it. 00:27:46.391 [2024-11-21 03:44:26.718767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.391 [2024-11-21 03:44:26.718873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.391 [2024-11-21 03:44:26.718902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.391 qpair failed and we were unable to recover it. 00:27:46.391 [2024-11-21 03:44:26.719051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.392 [2024-11-21 03:44:26.719189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.392 [2024-11-21 03:44:26.719216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.392 qpair failed and we were unable to recover it. 00:27:46.392 [2024-11-21 03:44:26.719348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.392 [2024-11-21 03:44:26.719482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.392 [2024-11-21 03:44:26.719508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.392 qpair failed and we were unable to recover it. 00:27:46.392 [2024-11-21 03:44:26.719655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.392 [2024-11-21 03:44:26.719798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.392 [2024-11-21 03:44:26.719827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.392 qpair failed and we were unable to recover it. 00:27:46.392 [2024-11-21 03:44:26.719938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.392 [2024-11-21 03:44:26.720081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.392 [2024-11-21 03:44:26.720108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.392 qpair failed and we were unable to recover it. 00:27:46.392 [2024-11-21 03:44:26.720206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.392 [2024-11-21 03:44:26.720301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.392 [2024-11-21 03:44:26.720328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.392 qpair failed and we were unable to recover it. 00:27:46.392 [2024-11-21 03:44:26.720433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.392 [2024-11-21 03:44:26.720534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.392 [2024-11-21 03:44:26.720560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.392 qpair failed and we were unable to recover it. 00:27:46.392 [2024-11-21 03:44:26.720671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.392 [2024-11-21 03:44:26.720838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.392 [2024-11-21 03:44:26.720865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.392 qpair failed and we were unable to recover it. 00:27:46.392 [2024-11-21 03:44:26.720967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.392 [2024-11-21 03:44:26.721115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.392 [2024-11-21 03:44:26.721142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.392 qpair failed and we were unable to recover it. 00:27:46.392 [2024-11-21 03:44:26.721305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.392 [2024-11-21 03:44:26.721445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.392 [2024-11-21 03:44:26.721471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.392 qpair failed and we were unable to recover it. 00:27:46.392 [2024-11-21 03:44:26.721588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.392 [2024-11-21 03:44:26.721721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.392 [2024-11-21 03:44:26.721747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.392 qpair failed and we were unable to recover it. 00:27:46.392 [2024-11-21 03:44:26.721881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.392 [2024-11-21 03:44:26.721989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.392 [2024-11-21 03:44:26.722015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.392 qpair failed and we were unable to recover it. 00:27:46.392 [2024-11-21 03:44:26.722113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.392 [2024-11-21 03:44:26.722234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.392 [2024-11-21 03:44:26.722263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.392 qpair failed and we were unable to recover it. 00:27:46.392 [2024-11-21 03:44:26.722404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.392 [2024-11-21 03:44:26.722544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.392 [2024-11-21 03:44:26.722573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.392 qpair failed and we were unable to recover it. 00:27:46.392 [2024-11-21 03:44:26.722717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.392 [2024-11-21 03:44:26.722847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.392 [2024-11-21 03:44:26.722874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.392 qpair failed and we were unable to recover it. 00:27:46.392 [2024-11-21 03:44:26.723027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.392 [2024-11-21 03:44:26.723168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.392 [2024-11-21 03:44:26.723198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.392 qpair failed and we were unable to recover it. 00:27:46.392 [2024-11-21 03:44:26.723306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.392 [2024-11-21 03:44:26.723451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.392 [2024-11-21 03:44:26.723477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.392 qpair failed and we were unable to recover it. 00:27:46.392 [2024-11-21 03:44:26.723607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.392 [2024-11-21 03:44:26.723744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.392 [2024-11-21 03:44:26.723770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.392 qpair failed and we were unable to recover it. 00:27:46.392 [2024-11-21 03:44:26.723969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.392 [2024-11-21 03:44:26.724109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.392 [2024-11-21 03:44:26.724137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.392 qpair failed and we were unable to recover it. 00:27:46.392 [2024-11-21 03:44:26.724268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.392 [2024-11-21 03:44:26.724373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.392 [2024-11-21 03:44:26.724402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.392 qpair failed and we were unable to recover it. 00:27:46.392 [2024-11-21 03:44:26.724549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.392 [2024-11-21 03:44:26.724648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.392 [2024-11-21 03:44:26.724674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.392 qpair failed and we were unable to recover it. 00:27:46.392 [2024-11-21 03:44:26.724818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.392 [2024-11-21 03:44:26.724965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.392 [2024-11-21 03:44:26.724991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.392 qpair failed and we were unable to recover it. 00:27:46.392 [2024-11-21 03:44:26.725120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.392 [2024-11-21 03:44:26.725244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.392 [2024-11-21 03:44:26.725287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.392 qpair failed and we were unable to recover it. 00:27:46.392 [2024-11-21 03:44:26.725422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.392 [2024-11-21 03:44:26.725533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.392 [2024-11-21 03:44:26.725559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.392 qpair failed and we were unable to recover it. 00:27:46.392 [2024-11-21 03:44:26.725706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.392 [2024-11-21 03:44:26.725846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.392 [2024-11-21 03:44:26.725875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.392 qpair failed and we were unable to recover it. 00:27:46.392 [2024-11-21 03:44:26.726011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.392 [2024-11-21 03:44:26.726139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.392 [2024-11-21 03:44:26.726166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.392 qpair failed and we were unable to recover it. 00:27:46.392 [2024-11-21 03:44:26.726290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.392 [2024-11-21 03:44:26.726399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.392 [2024-11-21 03:44:26.726425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.392 qpair failed and we were unable to recover it. 00:27:46.392 [2024-11-21 03:44:26.726560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.392 [2024-11-21 03:44:26.726678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.392 [2024-11-21 03:44:26.726712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.392 qpair failed and we were unable to recover it. 00:27:46.392 [2024-11-21 03:44:26.726820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.392 [2024-11-21 03:44:26.726955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.392 [2024-11-21 03:44:26.726986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.392 qpair failed and we were unable to recover it. 00:27:46.392 [2024-11-21 03:44:26.727104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.392 [2024-11-21 03:44:26.727227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.392 [2024-11-21 03:44:26.727253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.392 qpair failed and we were unable to recover it. 00:27:46.393 [2024-11-21 03:44:26.727400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.393 [2024-11-21 03:44:26.727539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.393 [2024-11-21 03:44:26.727567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.393 qpair failed and we were unable to recover it. 00:27:46.393 [2024-11-21 03:44:26.727705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.393 [2024-11-21 03:44:26.727845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.393 [2024-11-21 03:44:26.727875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.393 qpair failed and we were unable to recover it. 00:27:46.393 [2024-11-21 03:44:26.728025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.393 [2024-11-21 03:44:26.728171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.393 [2024-11-21 03:44:26.728198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.393 qpair failed and we were unable to recover it. 00:27:46.393 [2024-11-21 03:44:26.728335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.393 [2024-11-21 03:44:26.728480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.393 [2024-11-21 03:44:26.728509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.393 qpair failed and we were unable to recover it. 00:27:46.393 [2024-11-21 03:44:26.728626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.393 [2024-11-21 03:44:26.728742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.393 [2024-11-21 03:44:26.728771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.393 qpair failed and we were unable to recover it. 00:27:46.393 [2024-11-21 03:44:26.728892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.393 [2024-11-21 03:44:26.729019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.393 [2024-11-21 03:44:26.729044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.393 qpair failed and we were unable to recover it. 00:27:46.393 [2024-11-21 03:44:26.729177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.393 [2024-11-21 03:44:26.729355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.393 [2024-11-21 03:44:26.729383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.393 qpair failed and we were unable to recover it. 00:27:46.393 [2024-11-21 03:44:26.729520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.393 [2024-11-21 03:44:26.729670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.393 [2024-11-21 03:44:26.729703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.393 qpair failed and we were unable to recover it. 00:27:46.393 [2024-11-21 03:44:26.729852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.393 [2024-11-21 03:44:26.729963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.393 [2024-11-21 03:44:26.729989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.393 qpair failed and we were unable to recover it. 00:27:46.393 [2024-11-21 03:44:26.730123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.393 [2024-11-21 03:44:26.730295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.393 [2024-11-21 03:44:26.730321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.393 qpair failed and we were unable to recover it. 00:27:46.393 [2024-11-21 03:44:26.730454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.393 [2024-11-21 03:44:26.730576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.393 [2024-11-21 03:44:26.730602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.393 qpair failed and we were unable to recover it. 00:27:46.393 [2024-11-21 03:44:26.730727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.393 [2024-11-21 03:44:26.730828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.393 [2024-11-21 03:44:26.730854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.393 qpair failed and we were unable to recover it. 00:27:46.393 [2024-11-21 03:44:26.730943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.393 [2024-11-21 03:44:26.731045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.393 [2024-11-21 03:44:26.731078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.393 qpair failed and we were unable to recover it. 00:27:46.393 [2024-11-21 03:44:26.731236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.393 [2024-11-21 03:44:26.731407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.393 [2024-11-21 03:44:26.731433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.393 qpair failed and we were unable to recover it. 00:27:46.393 [2024-11-21 03:44:26.731562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.393 [2024-11-21 03:44:26.731716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.393 [2024-11-21 03:44:26.731756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.393 qpair failed and we were unable to recover it. 00:27:46.393 [2024-11-21 03:44:26.731906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.393 [2024-11-21 03:44:26.732079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.393 [2024-11-21 03:44:26.732108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.393 qpair failed and we were unable to recover it. 00:27:46.393 [2024-11-21 03:44:26.732282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.393 [2024-11-21 03:44:26.732464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.393 [2024-11-21 03:44:26.732493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.393 qpair failed and we were unable to recover it. 00:27:46.393 [2024-11-21 03:44:26.732654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.393 [2024-11-21 03:44:26.732815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.393 [2024-11-21 03:44:26.732857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.393 qpair failed and we were unable to recover it. 00:27:46.393 [2024-11-21 03:44:26.733006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.393 [2024-11-21 03:44:26.733147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.393 [2024-11-21 03:44:26.733177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.393 qpair failed and we were unable to recover it. 00:27:46.393 [2024-11-21 03:44:26.733327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.393 [2024-11-21 03:44:26.733435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.393 [2024-11-21 03:44:26.733464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.393 qpair failed and we were unable to recover it. 00:27:46.393 [2024-11-21 03:44:26.733617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.393 [2024-11-21 03:44:26.733744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.393 [2024-11-21 03:44:26.733770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.393 qpair failed and we were unable to recover it. 00:27:46.393 [2024-11-21 03:44:26.733899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.393 [2024-11-21 03:44:26.734024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.393 [2024-11-21 03:44:26.734050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.393 qpair failed and we were unable to recover it. 00:27:46.393 [2024-11-21 03:44:26.734211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.393 [2024-11-21 03:44:26.734368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.393 [2024-11-21 03:44:26.734397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.393 qpair failed and we were unable to recover it. 00:27:46.393 [2024-11-21 03:44:26.734522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.393 [2024-11-21 03:44:26.734643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.393 [2024-11-21 03:44:26.734669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.393 qpair failed and we were unable to recover it. 00:27:46.393 [2024-11-21 03:44:26.734776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.393 [2024-11-21 03:44:26.734899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.393 [2024-11-21 03:44:26.734925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.393 qpair failed and we were unable to recover it. 00:27:46.393 [2024-11-21 03:44:26.735083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.393 [2024-11-21 03:44:26.735202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.393 [2024-11-21 03:44:26.735231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.393 qpair failed and we were unable to recover it. 00:27:46.393 [2024-11-21 03:44:26.735364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.393 [2024-11-21 03:44:26.735497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.393 [2024-11-21 03:44:26.735523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.393 qpair failed and we were unable to recover it. 00:27:46.393 [2024-11-21 03:44:26.735622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.393 [2024-11-21 03:44:26.735722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.393 [2024-11-21 03:44:26.735749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.393 qpair failed and we were unable to recover it. 00:27:46.393 [2024-11-21 03:44:26.735881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.393 [2024-11-21 03:44:26.736017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.393 [2024-11-21 03:44:26.736046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.393 qpair failed and we were unable to recover it. 00:27:46.394 [2024-11-21 03:44:26.736185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.394 [2024-11-21 03:44:26.736298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.394 [2024-11-21 03:44:26.736324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.394 qpair failed and we were unable to recover it. 00:27:46.394 [2024-11-21 03:44:26.736427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.394 [2024-11-21 03:44:26.736546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.394 [2024-11-21 03:44:26.736572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.394 qpair failed and we were unable to recover it. 00:27:46.394 [2024-11-21 03:44:26.736703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.394 [2024-11-21 03:44:26.736869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.394 [2024-11-21 03:44:26.736895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.394 qpair failed and we were unable to recover it. 00:27:46.394 [2024-11-21 03:44:26.737046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.394 [2024-11-21 03:44:26.737202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.394 [2024-11-21 03:44:26.737228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.394 qpair failed and we were unable to recover it. 00:27:46.394 [2024-11-21 03:44:26.737370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.394 [2024-11-21 03:44:26.737512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.394 [2024-11-21 03:44:26.737541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.394 qpair failed and we were unable to recover it. 00:27:46.394 [2024-11-21 03:44:26.737702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.394 [2024-11-21 03:44:26.737860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.394 [2024-11-21 03:44:26.737887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.394 qpair failed and we were unable to recover it. 00:27:46.394 [2024-11-21 03:44:26.738064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.394 [2024-11-21 03:44:26.738182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.394 [2024-11-21 03:44:26.738210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.394 qpair failed and we were unable to recover it. 00:27:46.394 [2024-11-21 03:44:26.738372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.394 [2024-11-21 03:44:26.738552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.394 [2024-11-21 03:44:26.738583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.394 qpair failed and we were unable to recover it. 00:27:46.394 [2024-11-21 03:44:26.738713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.394 [2024-11-21 03:44:26.738845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.394 [2024-11-21 03:44:26.738874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.394 qpair failed and we were unable to recover it. 00:27:46.394 [2024-11-21 03:44:26.739002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.394 [2024-11-21 03:44:26.739129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.394 [2024-11-21 03:44:26.739156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.394 qpair failed and we were unable to recover it. 00:27:46.394 [2024-11-21 03:44:26.739277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.394 [2024-11-21 03:44:26.739382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.394 [2024-11-21 03:44:26.739411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.394 qpair failed and we were unable to recover it. 00:27:46.394 [2024-11-21 03:44:26.739550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.394 [2024-11-21 03:44:26.739655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.394 [2024-11-21 03:44:26.739683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.394 qpair failed and we were unable to recover it. 00:27:46.394 [2024-11-21 03:44:26.739855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.394 [2024-11-21 03:44:26.739989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.394 [2024-11-21 03:44:26.740029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.394 qpair failed and we were unable to recover it. 00:27:46.394 [2024-11-21 03:44:26.740184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.394 [2024-11-21 03:44:26.740326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.394 [2024-11-21 03:44:26.740355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.394 qpair failed and we were unable to recover it. 00:27:46.394 [2024-11-21 03:44:26.740496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.394 [2024-11-21 03:44:26.740617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.394 [2024-11-21 03:44:26.740646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.394 qpair failed and we were unable to recover it. 00:27:46.394 [2024-11-21 03:44:26.740801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.394 [2024-11-21 03:44:26.740901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.394 [2024-11-21 03:44:26.740927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.394 qpair failed and we were unable to recover it. 00:27:46.394 [2024-11-21 03:44:26.741093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.394 [2024-11-21 03:44:26.741193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.394 [2024-11-21 03:44:26.741219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.394 qpair failed and we were unable to recover it. 00:27:46.394 [2024-11-21 03:44:26.741379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.394 [2024-11-21 03:44:26.741532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.394 [2024-11-21 03:44:26.741558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.394 qpair failed and we were unable to recover it. 00:27:46.394 [2024-11-21 03:44:26.741715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.394 [2024-11-21 03:44:26.741815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.394 [2024-11-21 03:44:26.741841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.394 qpair failed and we were unable to recover it. 00:27:46.394 [2024-11-21 03:44:26.741995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.394 [2024-11-21 03:44:26.742175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.394 [2024-11-21 03:44:26.742202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.394 qpair failed and we were unable to recover it. 00:27:46.394 [2024-11-21 03:44:26.742323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.394 [2024-11-21 03:44:26.742464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.394 [2024-11-21 03:44:26.742493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.394 qpair failed and we were unable to recover it. 00:27:46.394 [2024-11-21 03:44:26.742651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.394 [2024-11-21 03:44:26.742785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.394 [2024-11-21 03:44:26.742810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.394 qpair failed and we were unable to recover it. 00:27:46.394 [2024-11-21 03:44:26.742970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.394 [2024-11-21 03:44:26.743139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.394 [2024-11-21 03:44:26.743169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.394 qpair failed and we were unable to recover it. 00:27:46.394 [2024-11-21 03:44:26.743310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.394 [2024-11-21 03:44:26.743486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.394 [2024-11-21 03:44:26.743515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.394 qpair failed and we were unable to recover it. 00:27:46.394 [2024-11-21 03:44:26.743693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.394 [2024-11-21 03:44:26.743825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.394 [2024-11-21 03:44:26.743867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.394 qpair failed and we were unable to recover it. 00:27:46.394 [2024-11-21 03:44:26.744027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.394 [2024-11-21 03:44:26.744165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.394 [2024-11-21 03:44:26.744191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.394 qpair failed and we were unable to recover it. 00:27:46.394 [2024-11-21 03:44:26.744339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.394 [2024-11-21 03:44:26.744498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.394 [2024-11-21 03:44:26.744524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.394 qpair failed and we were unable to recover it. 00:27:46.394 [2024-11-21 03:44:26.744656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.394 [2024-11-21 03:44:26.744764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.394 [2024-11-21 03:44:26.744790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.394 qpair failed and we were unable to recover it. 00:27:46.394 [2024-11-21 03:44:26.744925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.394 [2024-11-21 03:44:26.745065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.394 [2024-11-21 03:44:26.745101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.394 qpair failed and we were unable to recover it. 00:27:46.394 [2024-11-21 03:44:26.745212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.395 [2024-11-21 03:44:26.745356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.395 [2024-11-21 03:44:26.745389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.395 qpair failed and we were unable to recover it. 00:27:46.395 [2024-11-21 03:44:26.745511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.395 [2024-11-21 03:44:26.745643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.395 [2024-11-21 03:44:26.745668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.395 qpair failed and we were unable to recover it. 00:27:46.395 [2024-11-21 03:44:26.745819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.395 [2024-11-21 03:44:26.745958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.395 [2024-11-21 03:44:26.745987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.395 qpair failed and we were unable to recover it. 00:27:46.395 [2024-11-21 03:44:26.746171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.395 [2024-11-21 03:44:26.746279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.395 [2024-11-21 03:44:26.746305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.395 qpair failed and we were unable to recover it. 00:27:46.395 [2024-11-21 03:44:26.746442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.395 [2024-11-21 03:44:26.746582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.395 [2024-11-21 03:44:26.746622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.395 qpair failed and we were unable to recover it. 00:27:46.395 [2024-11-21 03:44:26.746806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.395 [2024-11-21 03:44:26.746936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.395 [2024-11-21 03:44:26.746962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.395 qpair failed and we were unable to recover it. 00:27:46.395 [2024-11-21 03:44:26.747084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.395 [2024-11-21 03:44:26.747254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.395 [2024-11-21 03:44:26.747283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.395 qpair failed and we were unable to recover it. 00:27:46.395 [2024-11-21 03:44:26.747414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.395 [2024-11-21 03:44:26.747550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.395 [2024-11-21 03:44:26.747576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.395 qpair failed and we were unable to recover it. 00:27:46.395 [2024-11-21 03:44:26.747703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.395 [2024-11-21 03:44:26.747877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.395 [2024-11-21 03:44:26.747906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.395 qpair failed and we were unable to recover it. 00:27:46.395 [2024-11-21 03:44:26.748083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.395 [2024-11-21 03:44:26.748250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.395 [2024-11-21 03:44:26.748279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.395 qpair failed and we were unable to recover it. 00:27:46.395 [2024-11-21 03:44:26.748407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.395 [2024-11-21 03:44:26.748541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.395 [2024-11-21 03:44:26.748567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.395 qpair failed and we were unable to recover it. 00:27:46.395 [2024-11-21 03:44:26.748715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.395 [2024-11-21 03:44:26.748895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.395 [2024-11-21 03:44:26.748921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.395 qpair failed and we were unable to recover it. 00:27:46.395 [2024-11-21 03:44:26.749027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.395 [2024-11-21 03:44:26.749190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.395 [2024-11-21 03:44:26.749217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.395 qpair failed and we were unable to recover it. 00:27:46.395 [2024-11-21 03:44:26.749349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.395 [2024-11-21 03:44:26.749502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.395 [2024-11-21 03:44:26.749532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.395 qpair failed and we were unable to recover it. 00:27:46.395 [2024-11-21 03:44:26.749690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.395 [2024-11-21 03:44:26.749848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.395 [2024-11-21 03:44:26.749874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.395 qpair failed and we were unable to recover it. 00:27:46.395 [2024-11-21 03:44:26.750039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.395 [2024-11-21 03:44:26.750177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.395 [2024-11-21 03:44:26.750204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.395 qpair failed and we were unable to recover it. 00:27:46.395 [2024-11-21 03:44:26.750306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.395 [2024-11-21 03:44:26.750457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.395 [2024-11-21 03:44:26.750486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.395 qpair failed and we were unable to recover it. 00:27:46.395 [2024-11-21 03:44:26.750631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.395 [2024-11-21 03:44:26.750766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.395 [2024-11-21 03:44:26.750792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.395 qpair failed and we were unable to recover it. 00:27:46.395 [2024-11-21 03:44:26.750947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.395 [2024-11-21 03:44:26.751059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.395 [2024-11-21 03:44:26.751099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.395 qpair failed and we were unable to recover it. 00:27:46.395 [2024-11-21 03:44:26.751252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.395 [2024-11-21 03:44:26.751352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.395 [2024-11-21 03:44:26.751393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.395 qpair failed and we were unable to recover it. 00:27:46.395 [2024-11-21 03:44:26.751548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.395 [2024-11-21 03:44:26.751706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.395 [2024-11-21 03:44:26.751731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.395 qpair failed and we were unable to recover it. 00:27:46.395 [2024-11-21 03:44:26.751887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.395 [2024-11-21 03:44:26.752028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.395 [2024-11-21 03:44:26.752057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.395 qpair failed and we were unable to recover it. 00:27:46.395 [2024-11-21 03:44:26.752197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.395 [2024-11-21 03:44:26.752303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.395 [2024-11-21 03:44:26.752329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.395 qpair failed and we were unable to recover it. 00:27:46.395 [2024-11-21 03:44:26.752464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.395 [2024-11-21 03:44:26.752621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.395 [2024-11-21 03:44:26.752647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.395 qpair failed and we were unable to recover it. 00:27:46.395 [2024-11-21 03:44:26.752822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.395 [2024-11-21 03:44:26.752929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.395 [2024-11-21 03:44:26.752955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.395 qpair failed and we were unable to recover it. 00:27:46.395 [2024-11-21 03:44:26.753083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.395 [2024-11-21 03:44:26.753184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.395 [2024-11-21 03:44:26.753210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.395 qpair failed and we were unable to recover it. 00:27:46.395 [2024-11-21 03:44:26.753321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.395 [2024-11-21 03:44:26.753450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.395 [2024-11-21 03:44:26.753476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.395 qpair failed and we were unable to recover it. 00:27:46.395 [2024-11-21 03:44:26.753573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.395 [2024-11-21 03:44:26.753669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.395 [2024-11-21 03:44:26.753695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.395 qpair failed and we were unable to recover it. 00:27:46.395 [2024-11-21 03:44:26.753816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.395 [2024-11-21 03:44:26.753996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.396 [2024-11-21 03:44:26.754024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.396 qpair failed and we were unable to recover it. 00:27:46.396 [2024-11-21 03:44:26.754219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.396 [2024-11-21 03:44:26.754375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.396 [2024-11-21 03:44:26.754417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.396 qpair failed and we were unable to recover it. 00:27:46.396 [2024-11-21 03:44:26.754572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.396 [2024-11-21 03:44:26.754702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.396 [2024-11-21 03:44:26.754728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.396 qpair failed and we were unable to recover it. 00:27:46.396 [2024-11-21 03:44:26.754909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.396 [2024-11-21 03:44:26.755051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.396 [2024-11-21 03:44:26.755088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.396 qpair failed and we were unable to recover it. 00:27:46.396 [2024-11-21 03:44:26.755244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.396 [2024-11-21 03:44:26.755401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.396 [2024-11-21 03:44:26.755443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.396 qpair failed and we were unable to recover it. 00:27:46.396 [2024-11-21 03:44:26.755629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.396 [2024-11-21 03:44:26.755729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.396 [2024-11-21 03:44:26.755755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.396 qpair failed and we were unable to recover it. 00:27:46.396 [2024-11-21 03:44:26.755870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.396 [2024-11-21 03:44:26.755997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.396 [2024-11-21 03:44:26.756023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.396 qpair failed and we were unable to recover it. 00:27:46.396 [2024-11-21 03:44:26.756133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.396 [2024-11-21 03:44:26.756255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.396 [2024-11-21 03:44:26.756281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.396 qpair failed and we were unable to recover it. 00:27:46.396 [2024-11-21 03:44:26.756387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.396 [2024-11-21 03:44:26.756503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.396 [2024-11-21 03:44:26.756533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.396 qpair failed and we were unable to recover it. 00:27:46.396 [2024-11-21 03:44:26.756709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.396 [2024-11-21 03:44:26.756843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.396 [2024-11-21 03:44:26.756869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.396 qpair failed and we were unable to recover it. 00:27:46.396 [2024-11-21 03:44:26.756996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.396 [2024-11-21 03:44:26.757125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.396 [2024-11-21 03:44:26.757152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.396 qpair failed and we were unable to recover it. 00:27:46.396 [2024-11-21 03:44:26.757261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.396 [2024-11-21 03:44:26.757410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.396 [2024-11-21 03:44:26.757438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.396 qpair failed and we were unable to recover it. 00:27:46.396 [2024-11-21 03:44:26.757578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.396 [2024-11-21 03:44:26.757688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.396 [2024-11-21 03:44:26.757728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.396 qpair failed and we were unable to recover it. 00:27:46.396 [2024-11-21 03:44:26.757829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.396 [2024-11-21 03:44:26.757952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.396 [2024-11-21 03:44:26.757978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.396 qpair failed and we were unable to recover it. 00:27:46.396 [2024-11-21 03:44:26.758081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.396 [2024-11-21 03:44:26.758220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.396 [2024-11-21 03:44:26.758246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.396 qpair failed and we were unable to recover it. 00:27:46.396 [2024-11-21 03:44:26.758361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.396 [2024-11-21 03:44:26.758502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.396 [2024-11-21 03:44:26.758530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.396 qpair failed and we were unable to recover it. 00:27:46.396 [2024-11-21 03:44:26.758657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.396 [2024-11-21 03:44:26.758787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.396 [2024-11-21 03:44:26.758812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.396 qpair failed and we were unable to recover it. 00:27:46.396 [2024-11-21 03:44:26.758924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.396 [2024-11-21 03:44:26.759091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.396 [2024-11-21 03:44:26.759118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.396 qpair failed and we were unable to recover it. 00:27:46.396 [2024-11-21 03:44:26.759246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.396 [2024-11-21 03:44:26.759396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.396 [2024-11-21 03:44:26.759424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.396 qpair failed and we were unable to recover it. 00:27:46.396 [2024-11-21 03:44:26.759599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.396 [2024-11-21 03:44:26.759703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.396 [2024-11-21 03:44:26.759729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.396 qpair failed and we were unable to recover it. 00:27:46.396 [2024-11-21 03:44:26.759856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.396 [2024-11-21 03:44:26.759959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.396 [2024-11-21 03:44:26.759988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.396 qpair failed and we were unable to recover it. 00:27:46.396 [2024-11-21 03:44:26.760143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.396 [2024-11-21 03:44:26.760246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.396 [2024-11-21 03:44:26.760272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.396 qpair failed and we were unable to recover it. 00:27:46.396 [2024-11-21 03:44:26.760431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.396 [2024-11-21 03:44:26.760526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.396 [2024-11-21 03:44:26.760553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.396 qpair failed and we were unable to recover it. 00:27:46.396 [2024-11-21 03:44:26.760719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.396 [2024-11-21 03:44:26.760865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.396 [2024-11-21 03:44:26.760898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.396 qpair failed and we were unable to recover it. 00:27:46.396 [2024-11-21 03:44:26.761011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.396 [2024-11-21 03:44:26.761121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.396 [2024-11-21 03:44:26.761165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.396 qpair failed and we were unable to recover it. 00:27:46.396 [2024-11-21 03:44:26.761297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.396 [2024-11-21 03:44:26.761425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.396 [2024-11-21 03:44:26.761451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.396 qpair failed and we were unable to recover it. 00:27:46.396 [2024-11-21 03:44:26.761742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.396 [2024-11-21 03:44:26.761911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.396 [2024-11-21 03:44:26.761940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.397 qpair failed and we were unable to recover it. 00:27:46.397 [2024-11-21 03:44:26.762092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.397 [2024-11-21 03:44:26.762221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.397 [2024-11-21 03:44:26.762247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.397 qpair failed and we were unable to recover it. 00:27:46.397 [2024-11-21 03:44:26.762381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.397 [2024-11-21 03:44:26.762511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.397 [2024-11-21 03:44:26.762538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.397 qpair failed and we were unable to recover it. 00:27:46.397 [2024-11-21 03:44:26.762732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.397 [2024-11-21 03:44:26.762852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.397 [2024-11-21 03:44:26.762877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.397 qpair failed and we were unable to recover it. 00:27:46.397 [2024-11-21 03:44:26.762984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.397 [2024-11-21 03:44:26.763149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.397 [2024-11-21 03:44:26.763176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.397 qpair failed and we were unable to recover it. 00:27:46.397 [2024-11-21 03:44:26.763297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.397 [2024-11-21 03:44:26.763457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.397 [2024-11-21 03:44:26.763500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.397 qpair failed and we were unable to recover it. 00:27:46.397 [2024-11-21 03:44:26.763642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.397 [2024-11-21 03:44:26.763813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.397 [2024-11-21 03:44:26.763842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.397 qpair failed and we were unable to recover it. 00:27:46.397 [2024-11-21 03:44:26.763986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.397 [2024-11-21 03:44:26.764172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.397 [2024-11-21 03:44:26.764199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.397 qpair failed and we were unable to recover it. 00:27:46.397 [2024-11-21 03:44:26.764306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.397 [2024-11-21 03:44:26.764437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.397 [2024-11-21 03:44:26.764463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.397 qpair failed and we were unable to recover it. 00:27:46.397 [2024-11-21 03:44:26.764566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.397 [2024-11-21 03:44:26.764688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.397 [2024-11-21 03:44:26.764714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.397 qpair failed and we were unable to recover it. 00:27:46.397 [2024-11-21 03:44:26.764843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.397 [2024-11-21 03:44:26.765019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.397 [2024-11-21 03:44:26.765048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.397 qpair failed and we were unable to recover it. 00:27:46.397 [2024-11-21 03:44:26.765202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.397 [2024-11-21 03:44:26.765301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.397 [2024-11-21 03:44:26.765327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.397 qpair failed and we were unable to recover it. 00:27:46.397 [2024-11-21 03:44:26.765458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.397 [2024-11-21 03:44:26.765560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.397 [2024-11-21 03:44:26.765603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.397 qpair failed and we were unable to recover it. 00:27:46.397 [2024-11-21 03:44:26.765736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.397 [2024-11-21 03:44:26.765851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.397 [2024-11-21 03:44:26.765880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.397 qpair failed and we were unable to recover it. 00:27:46.397 [2024-11-21 03:44:26.766066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.397 [2024-11-21 03:44:26.766220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.397 [2024-11-21 03:44:26.766246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.397 qpair failed and we were unable to recover it. 00:27:46.397 [2024-11-21 03:44:26.766380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.397 [2024-11-21 03:44:26.766529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.397 [2024-11-21 03:44:26.766558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.397 qpair failed and we were unable to recover it. 00:27:46.397 [2024-11-21 03:44:26.766676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.397 [2024-11-21 03:44:26.766792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.397 [2024-11-21 03:44:26.766834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.397 qpair failed and we were unable to recover it. 00:27:46.397 [2024-11-21 03:44:26.766991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.397 [2024-11-21 03:44:26.767116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.397 [2024-11-21 03:44:26.767143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.397 qpair failed and we were unable to recover it. 00:27:46.397 [2024-11-21 03:44:26.767281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.397 [2024-11-21 03:44:26.767410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.397 [2024-11-21 03:44:26.767436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.397 qpair failed and we were unable to recover it. 00:27:46.397 [2024-11-21 03:44:26.767565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.397 [2024-11-21 03:44:26.767708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.397 [2024-11-21 03:44:26.767737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.397 qpair failed and we were unable to recover it. 00:27:46.397 [2024-11-21 03:44:26.767862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.397 [2024-11-21 03:44:26.767996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.397 [2024-11-21 03:44:26.768022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.397 qpair failed and we were unable to recover it. 00:27:46.397 [2024-11-21 03:44:26.768181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.397 [2024-11-21 03:44:26.768315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.397 [2024-11-21 03:44:26.768342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.397 qpair failed and we were unable to recover it. 00:27:46.397 [2024-11-21 03:44:26.768499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.397 [2024-11-21 03:44:26.768641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.397 [2024-11-21 03:44:26.768669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.397 qpair failed and we were unable to recover it. 00:27:46.397 [2024-11-21 03:44:26.768823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.397 [2024-11-21 03:44:26.768955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.397 [2024-11-21 03:44:26.768981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.397 qpair failed and we were unable to recover it. 00:27:46.397 [2024-11-21 03:44:26.769128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.397 [2024-11-21 03:44:26.769263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.397 [2024-11-21 03:44:26.769289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.397 qpair failed and we were unable to recover it. 00:27:46.397 [2024-11-21 03:44:26.769421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.397 [2024-11-21 03:44:26.769589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.397 [2024-11-21 03:44:26.769618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.397 qpair failed and we were unable to recover it. 00:27:46.397 [2024-11-21 03:44:26.769771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.397 [2024-11-21 03:44:26.769903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.397 [2024-11-21 03:44:26.769929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.397 qpair failed and we were unable to recover it. 00:27:46.397 [2024-11-21 03:44:26.770082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.397 [2024-11-21 03:44:26.770225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.397 [2024-11-21 03:44:26.770255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.397 qpair failed and we were unable to recover it. 00:27:46.397 [2024-11-21 03:44:26.770371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.397 [2024-11-21 03:44:26.770536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.397 [2024-11-21 03:44:26.770565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.397 qpair failed and we were unable to recover it. 00:27:46.397 [2024-11-21 03:44:26.770740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.397 [2024-11-21 03:44:26.770876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.397 [2024-11-21 03:44:26.770902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.398 qpair failed and we were unable to recover it. 00:27:46.398 [2024-11-21 03:44:26.771031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.398 [2024-11-21 03:44:26.771162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.398 [2024-11-21 03:44:26.771192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.398 qpair failed and we were unable to recover it. 00:27:46.398 [2024-11-21 03:44:26.771359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.398 [2024-11-21 03:44:26.771496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.398 [2024-11-21 03:44:26.771524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.398 qpair failed and we were unable to recover it. 00:27:46.398 [2024-11-21 03:44:26.771702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.398 [2024-11-21 03:44:26.771831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.398 [2024-11-21 03:44:26.771856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.398 qpair failed and we were unable to recover it. 00:27:46.398 [2024-11-21 03:44:26.771981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.398 [2024-11-21 03:44:26.772137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.398 [2024-11-21 03:44:26.772166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.398 qpair failed and we were unable to recover it. 00:27:46.398 [2024-11-21 03:44:26.772302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.398 [2024-11-21 03:44:26.772441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.398 [2024-11-21 03:44:26.772470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.398 qpair failed and we were unable to recover it. 00:27:46.398 [2024-11-21 03:44:26.772651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.398 [2024-11-21 03:44:26.772809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.398 [2024-11-21 03:44:26.772854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.398 qpair failed and we were unable to recover it. 00:27:46.398 [2024-11-21 03:44:26.772990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.398 [2024-11-21 03:44:26.773146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.398 [2024-11-21 03:44:26.773174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.398 qpair failed and we were unable to recover it. 00:27:46.398 [2024-11-21 03:44:26.773304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.398 [2024-11-21 03:44:26.773456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.398 [2024-11-21 03:44:26.773485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.398 qpair failed and we were unable to recover it. 00:27:46.398 [2024-11-21 03:44:26.773667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.398 [2024-11-21 03:44:26.773825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.398 [2024-11-21 03:44:26.773851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.398 qpair failed and we were unable to recover it. 00:27:46.398 [2024-11-21 03:44:26.774014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.398 [2024-11-21 03:44:26.774138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.398 [2024-11-21 03:44:26.774165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.398 qpair failed and we were unable to recover it. 00:27:46.398 [2024-11-21 03:44:26.774277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.398 [2024-11-21 03:44:26.774419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.398 [2024-11-21 03:44:26.774448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.398 qpair failed and we were unable to recover it. 00:27:46.398 [2024-11-21 03:44:26.774577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.398 [2024-11-21 03:44:26.774703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.398 [2024-11-21 03:44:26.774729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.398 qpair failed and we were unable to recover it. 00:27:46.398 [2024-11-21 03:44:26.774902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.398 [2024-11-21 03:44:26.775061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.398 [2024-11-21 03:44:26.775094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.398 qpair failed and we were unable to recover it. 00:27:46.398 [2024-11-21 03:44:26.775284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.398 [2024-11-21 03:44:26.775418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.398 [2024-11-21 03:44:26.775447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.398 qpair failed and we were unable to recover it. 00:27:46.398 [2024-11-21 03:44:26.775600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.398 [2024-11-21 03:44:26.775729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.398 [2024-11-21 03:44:26.775755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.398 qpair failed and we were unable to recover it. 00:27:46.398 [2024-11-21 03:44:26.775911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.398 [2024-11-21 03:44:26.776039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.398 [2024-11-21 03:44:26.776065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.398 qpair failed and we were unable to recover it. 00:27:46.398 [2024-11-21 03:44:26.776182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.398 [2024-11-21 03:44:26.776315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.398 [2024-11-21 03:44:26.776344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.398 qpair failed and we were unable to recover it. 00:27:46.398 [2024-11-21 03:44:26.776468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.398 [2024-11-21 03:44:26.776600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.398 [2024-11-21 03:44:26.776625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.398 qpair failed and we were unable to recover it. 00:27:46.398 [2024-11-21 03:44:26.776779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.398 [2024-11-21 03:44:26.776912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.398 [2024-11-21 03:44:26.776945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.398 qpair failed and we were unable to recover it. 00:27:46.398 [2024-11-21 03:44:26.777113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.398 [2024-11-21 03:44:26.777273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.398 [2024-11-21 03:44:26.777299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.398 qpair failed and we were unable to recover it. 00:27:46.398 [2024-11-21 03:44:26.777430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.398 [2024-11-21 03:44:26.777565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.398 [2024-11-21 03:44:26.777591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.398 qpair failed and we were unable to recover it. 00:27:46.398 [2024-11-21 03:44:26.777746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.398 [2024-11-21 03:44:26.777897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.398 [2024-11-21 03:44:26.777925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.398 qpair failed and we were unable to recover it. 00:27:46.398 [2024-11-21 03:44:26.778034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.398 [2024-11-21 03:44:26.778185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.398 [2024-11-21 03:44:26.778215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.398 qpair failed and we were unable to recover it. 00:27:46.398 [2024-11-21 03:44:26.778352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.398 [2024-11-21 03:44:26.778460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.398 [2024-11-21 03:44:26.778487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.398 qpair failed and we were unable to recover it. 00:27:46.398 [2024-11-21 03:44:26.778636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.398 [2024-11-21 03:44:26.778808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.398 [2024-11-21 03:44:26.778837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.398 qpair failed and we were unable to recover it. 00:27:46.398 [2024-11-21 03:44:26.778968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.398 [2024-11-21 03:44:26.779109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.398 [2024-11-21 03:44:26.779138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.398 qpair failed and we were unable to recover it. 00:27:46.398 [2024-11-21 03:44:26.779297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.398 [2024-11-21 03:44:26.779457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.398 [2024-11-21 03:44:26.779500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.398 qpair failed and we were unable to recover it. 00:27:46.398 [2024-11-21 03:44:26.779679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.398 [2024-11-21 03:44:26.779890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.398 [2024-11-21 03:44:26.779919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.398 qpair failed and we were unable to recover it. 00:27:46.398 [2024-11-21 03:44:26.780035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.398 [2024-11-21 03:44:26.780186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.398 [2024-11-21 03:44:26.780233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.399 qpair failed and we were unable to recover it. 00:27:46.399 [2024-11-21 03:44:26.780364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.399 [2024-11-21 03:44:26.780496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.399 [2024-11-21 03:44:26.780522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.399 qpair failed and we were unable to recover it. 00:27:46.399 [2024-11-21 03:44:26.780626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.399 [2024-11-21 03:44:26.780784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.399 [2024-11-21 03:44:26.780810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.399 qpair failed and we were unable to recover it. 00:27:46.399 [2024-11-21 03:44:26.780986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.399 [2024-11-21 03:44:26.781145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.399 [2024-11-21 03:44:26.781172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.399 qpair failed and we were unable to recover it. 00:27:46.399 [2024-11-21 03:44:26.781272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.399 [2024-11-21 03:44:26.781426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.399 [2024-11-21 03:44:26.781452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.399 qpair failed and we were unable to recover it. 00:27:46.399 [2024-11-21 03:44:26.781588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.399 [2024-11-21 03:44:26.781753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.399 [2024-11-21 03:44:26.781781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.399 qpair failed and we were unable to recover it. 00:27:46.399 [2024-11-21 03:44:26.781934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.399 [2024-11-21 03:44:26.782063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.399 [2024-11-21 03:44:26.782096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.399 qpair failed and we were unable to recover it. 00:27:46.399 [2024-11-21 03:44:26.782222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.399 [2024-11-21 03:44:26.782348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.399 [2024-11-21 03:44:26.782373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.399 qpair failed and we were unable to recover it. 00:27:46.399 [2024-11-21 03:44:26.782503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.399 [2024-11-21 03:44:26.782653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.399 [2024-11-21 03:44:26.782681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.399 qpair failed and we were unable to recover it. 00:27:46.399 [2024-11-21 03:44:26.782787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.399 [2024-11-21 03:44:26.782918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.399 [2024-11-21 03:44:26.782946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.399 qpair failed and we were unable to recover it. 00:27:46.399 [2024-11-21 03:44:26.783114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.399 [2024-11-21 03:44:26.783270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.399 [2024-11-21 03:44:26.783296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.399 qpair failed and we were unable to recover it. 00:27:46.399 [2024-11-21 03:44:26.783464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.399 [2024-11-21 03:44:26.783637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.399 [2024-11-21 03:44:26.783665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.399 qpair failed and we were unable to recover it. 00:27:46.399 [2024-11-21 03:44:26.783833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.399 [2024-11-21 03:44:26.783965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.399 [2024-11-21 03:44:26.783994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.399 qpair failed and we were unable to recover it. 00:27:46.399 [2024-11-21 03:44:26.784121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.399 [2024-11-21 03:44:26.784220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.399 [2024-11-21 03:44:26.784246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.399 qpair failed and we were unable to recover it. 00:27:46.399 [2024-11-21 03:44:26.784393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.399 [2024-11-21 03:44:26.784539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.399 [2024-11-21 03:44:26.784568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.399 qpair failed and we were unable to recover it. 00:27:46.399 [2024-11-21 03:44:26.784744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.399 [2024-11-21 03:44:26.784898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.399 [2024-11-21 03:44:26.784927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.399 qpair failed and we were unable to recover it. 00:27:46.399 [2024-11-21 03:44:26.785082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.399 [2024-11-21 03:44:26.785217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.399 [2024-11-21 03:44:26.785243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.399 qpair failed and we were unable to recover it. 00:27:46.399 [2024-11-21 03:44:26.785370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.399 [2024-11-21 03:44:26.785522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.399 [2024-11-21 03:44:26.785550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.399 qpair failed and we were unable to recover it. 00:27:46.399 [2024-11-21 03:44:26.785730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.399 [2024-11-21 03:44:26.785869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.399 [2024-11-21 03:44:26.785898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.399 qpair failed and we were unable to recover it. 00:27:46.399 [2024-11-21 03:44:26.786044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.399 [2024-11-21 03:44:26.786154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.399 [2024-11-21 03:44:26.786180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.399 qpair failed and we were unable to recover it. 00:27:46.399 [2024-11-21 03:44:26.786303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.399 [2024-11-21 03:44:26.786471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.399 [2024-11-21 03:44:26.786500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.399 qpair failed and we were unable to recover it. 00:27:46.399 [2024-11-21 03:44:26.786645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.399 [2024-11-21 03:44:26.786804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.399 [2024-11-21 03:44:26.786830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.399 qpair failed and we were unable to recover it. 00:27:46.399 [2024-11-21 03:44:26.786960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.399 [2024-11-21 03:44:26.787111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.399 [2024-11-21 03:44:26.787137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.399 qpair failed and we were unable to recover it. 00:27:46.399 [2024-11-21 03:44:26.787289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.399 [2024-11-21 03:44:26.787437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.399 [2024-11-21 03:44:26.787463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.399 qpair failed and we were unable to recover it. 00:27:46.399 [2024-11-21 03:44:26.787567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.399 [2024-11-21 03:44:26.787714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.399 [2024-11-21 03:44:26.787743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.399 qpair failed and we were unable to recover it. 00:27:46.399 [2024-11-21 03:44:26.787913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.399 [2024-11-21 03:44:26.788053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.399 [2024-11-21 03:44:26.788089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.399 qpair failed and we were unable to recover it. 00:27:46.399 [2024-11-21 03:44:26.788213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.399 [2024-11-21 03:44:26.788358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.399 [2024-11-21 03:44:26.788387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.399 qpair failed and we were unable to recover it. 00:27:46.399 [2024-11-21 03:44:26.788504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.399 [2024-11-21 03:44:26.788623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.399 [2024-11-21 03:44:26.788651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.399 qpair failed and we were unable to recover it. 00:27:46.399 [2024-11-21 03:44:26.788795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.399 [2024-11-21 03:44:26.788952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.399 [2024-11-21 03:44:26.788978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.399 qpair failed and we were unable to recover it. 00:27:46.399 [2024-11-21 03:44:26.789134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.399 [2024-11-21 03:44:26.789291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.399 [2024-11-21 03:44:26.789317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.399 qpair failed and we were unable to recover it. 00:27:46.400 [2024-11-21 03:44:26.789464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.400 [2024-11-21 03:44:26.789598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.400 [2024-11-21 03:44:26.789627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.400 qpair failed and we were unable to recover it. 00:27:46.400 [2024-11-21 03:44:26.789787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.400 [2024-11-21 03:44:26.789926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.400 [2024-11-21 03:44:26.789952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.400 qpair failed and we were unable to recover it. 00:27:46.400 [2024-11-21 03:44:26.790116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.400 [2024-11-21 03:44:26.790261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.400 [2024-11-21 03:44:26.790289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.400 qpair failed and we were unable to recover it. 00:27:46.400 [2024-11-21 03:44:26.790445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.400 [2024-11-21 03:44:26.790535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.400 [2024-11-21 03:44:26.790561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.400 qpair failed and we were unable to recover it. 00:27:46.400 [2024-11-21 03:44:26.790688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.400 [2024-11-21 03:44:26.790845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.400 [2024-11-21 03:44:26.790870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.400 qpair failed and we were unable to recover it. 00:27:46.400 [2024-11-21 03:44:26.791029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.400 [2024-11-21 03:44:26.791188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.400 [2024-11-21 03:44:26.791217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.400 qpair failed and we were unable to recover it. 00:27:46.400 [2024-11-21 03:44:26.791392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.400 [2024-11-21 03:44:26.791495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.400 [2024-11-21 03:44:26.791523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.400 qpair failed and we were unable to recover it. 00:27:46.400 [2024-11-21 03:44:26.791626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.400 [2024-11-21 03:44:26.791754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.400 [2024-11-21 03:44:26.791780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.400 qpair failed and we were unable to recover it. 00:27:46.400 [2024-11-21 03:44:26.791935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.400 [2024-11-21 03:44:26.792090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.400 [2024-11-21 03:44:26.792117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.400 qpair failed and we were unable to recover it. 00:27:46.400 [2024-11-21 03:44:26.792224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.400 [2024-11-21 03:44:26.792314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.400 [2024-11-21 03:44:26.792340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.400 qpair failed and we were unable to recover it. 00:27:46.400 [2024-11-21 03:44:26.792533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.400 [2024-11-21 03:44:26.792654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.400 [2024-11-21 03:44:26.792680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.400 qpair failed and we were unable to recover it. 00:27:46.400 [2024-11-21 03:44:26.792873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.400 [2024-11-21 03:44:26.793044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.400 [2024-11-21 03:44:26.793096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.400 qpair failed and we were unable to recover it. 00:27:46.400 [2024-11-21 03:44:26.793240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.400 [2024-11-21 03:44:26.793373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.400 [2024-11-21 03:44:26.793402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.400 qpair failed and we were unable to recover it. 00:27:46.400 [2024-11-21 03:44:26.793541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.400 [2024-11-21 03:44:26.793675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.400 [2024-11-21 03:44:26.793701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.400 qpair failed and we were unable to recover it. 00:27:46.400 [2024-11-21 03:44:26.793885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.400 [2024-11-21 03:44:26.794042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.400 [2024-11-21 03:44:26.794076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.400 qpair failed and we were unable to recover it. 00:27:46.400 [2024-11-21 03:44:26.794215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.400 [2024-11-21 03:44:26.794379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.400 [2024-11-21 03:44:26.794408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.400 qpair failed and we were unable to recover it. 00:27:46.400 [2024-11-21 03:44:26.794541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.400 [2024-11-21 03:44:26.794647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.400 [2024-11-21 03:44:26.794672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.400 qpair failed and we were unable to recover it. 00:27:46.400 [2024-11-21 03:44:26.794804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.400 [2024-11-21 03:44:26.794911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.400 [2024-11-21 03:44:26.794937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.400 qpair failed and we were unable to recover it. 00:27:46.400 [2024-11-21 03:44:26.795089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.400 [2024-11-21 03:44:26.795245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.400 [2024-11-21 03:44:26.795271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.400 qpair failed and we were unable to recover it. 00:27:46.400 [2024-11-21 03:44:26.795401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.400 [2024-11-21 03:44:26.795528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.400 [2024-11-21 03:44:26.795553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.400 qpair failed and we were unable to recover it. 00:27:46.400 [2024-11-21 03:44:26.795686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.400 [2024-11-21 03:44:26.795796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.400 [2024-11-21 03:44:26.795825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.400 qpair failed and we were unable to recover it. 00:27:46.400 [2024-11-21 03:44:26.795928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.400 [2024-11-21 03:44:26.796063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.400 [2024-11-21 03:44:26.796102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.400 qpair failed and we were unable to recover it. 00:27:46.400 [2024-11-21 03:44:26.796230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.400 [2024-11-21 03:44:26.796337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.400 [2024-11-21 03:44:26.796363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.400 qpair failed and we were unable to recover it. 00:27:46.400 [2024-11-21 03:44:26.796494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.400 [2024-11-21 03:44:26.796636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.400 [2024-11-21 03:44:26.796665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.400 qpair failed and we were unable to recover it. 00:27:46.400 [2024-11-21 03:44:26.796780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.400 [2024-11-21 03:44:26.796925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.400 [2024-11-21 03:44:26.796954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.400 qpair failed and we were unable to recover it. 00:27:46.400 [2024-11-21 03:44:26.797137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.400 [2024-11-21 03:44:26.797309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.400 [2024-11-21 03:44:26.797338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.400 qpair failed and we were unable to recover it. 00:27:46.401 [2024-11-21 03:44:26.797452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.401 [2024-11-21 03:44:26.797633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.401 [2024-11-21 03:44:26.797659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.401 qpair failed and we were unable to recover it. 00:27:46.401 [2024-11-21 03:44:26.797786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.401 [2024-11-21 03:44:26.797904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.401 [2024-11-21 03:44:26.797930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.401 qpair failed and we were unable to recover it. 00:27:46.401 [2024-11-21 03:44:26.798063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.401 [2024-11-21 03:44:26.798243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.401 [2024-11-21 03:44:26.798273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.401 qpair failed and we were unable to recover it. 00:27:46.401 [2024-11-21 03:44:26.798383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.401 [2024-11-21 03:44:26.798528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.401 [2024-11-21 03:44:26.798554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.401 qpair failed and we were unable to recover it. 00:27:46.401 [2024-11-21 03:44:26.798713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.401 [2024-11-21 03:44:26.798836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.401 [2024-11-21 03:44:26.798865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.401 qpair failed and we were unable to recover it. 00:27:46.401 [2024-11-21 03:44:26.799020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.401 [2024-11-21 03:44:26.799132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.401 [2024-11-21 03:44:26.799159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.401 qpair failed and we were unable to recover it. 00:27:46.401 [2024-11-21 03:44:26.799292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.401 [2024-11-21 03:44:26.799394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.401 [2024-11-21 03:44:26.799420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.401 qpair failed and we were unable to recover it. 00:27:46.401 [2024-11-21 03:44:26.799535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.401 [2024-11-21 03:44:26.799636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.401 [2024-11-21 03:44:26.799665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.401 qpair failed and we were unable to recover it. 00:27:46.401 [2024-11-21 03:44:26.799821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.401 [2024-11-21 03:44:26.799957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.401 [2024-11-21 03:44:26.799983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.401 qpair failed and we were unable to recover it. 00:27:46.401 [2024-11-21 03:44:26.800139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.401 [2024-11-21 03:44:26.800290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.401 [2024-11-21 03:44:26.800316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.401 qpair failed and we were unable to recover it. 00:27:46.401 [2024-11-21 03:44:26.800449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.401 [2024-11-21 03:44:26.800616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.401 [2024-11-21 03:44:26.800645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.401 qpair failed and we were unable to recover it. 00:27:46.401 [2024-11-21 03:44:26.800819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.401 [2024-11-21 03:44:26.800925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.401 [2024-11-21 03:44:26.800967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.401 qpair failed and we were unable to recover it. 00:27:46.401 [2024-11-21 03:44:26.801168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.401 [2024-11-21 03:44:26.801275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.401 [2024-11-21 03:44:26.801301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.401 qpair failed and we were unable to recover it. 00:27:46.401 [2024-11-21 03:44:26.801431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.401 [2024-11-21 03:44:26.801597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.401 [2024-11-21 03:44:26.801625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.401 qpair failed and we were unable to recover it. 00:27:46.401 [2024-11-21 03:44:26.801804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.401 [2024-11-21 03:44:26.801976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.401 [2024-11-21 03:44:26.802005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.401 qpair failed and we were unable to recover it. 00:27:46.401 [2024-11-21 03:44:26.802111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.401 [2024-11-21 03:44:26.802258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.401 [2024-11-21 03:44:26.802287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.401 qpair failed and we were unable to recover it. 00:27:46.401 [2024-11-21 03:44:26.802454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.401 [2024-11-21 03:44:26.802576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.401 [2024-11-21 03:44:26.802602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.401 qpair failed and we were unable to recover it. 00:27:46.401 [2024-11-21 03:44:26.802729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.401 [2024-11-21 03:44:26.802828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.401 [2024-11-21 03:44:26.802854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.401 qpair failed and we were unable to recover it. 00:27:46.401 [2024-11-21 03:44:26.802985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.401 [2024-11-21 03:44:26.803079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.401 [2024-11-21 03:44:26.803106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.401 qpair failed and we were unable to recover it. 00:27:46.401 [2024-11-21 03:44:26.803234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.401 [2024-11-21 03:44:26.803341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.401 [2024-11-21 03:44:26.803367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.401 qpair failed and we were unable to recover it. 00:27:46.401 [2024-11-21 03:44:26.803500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.401 [2024-11-21 03:44:26.803631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.401 [2024-11-21 03:44:26.803656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.401 qpair failed and we were unable to recover it. 00:27:46.401 [2024-11-21 03:44:26.803786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.401 [2024-11-21 03:44:26.803908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.401 [2024-11-21 03:44:26.803937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.401 qpair failed and we were unable to recover it. 00:27:46.401 [2024-11-21 03:44:26.804078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.401 [2024-11-21 03:44:26.804189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.401 [2024-11-21 03:44:26.804218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.401 qpair failed and we were unable to recover it. 00:27:46.401 [2024-11-21 03:44:26.804342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.401 [2024-11-21 03:44:26.804499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.401 [2024-11-21 03:44:26.804524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.401 qpair failed and we were unable to recover it. 00:27:46.401 [2024-11-21 03:44:26.804724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.401 [2024-11-21 03:44:26.804853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.401 [2024-11-21 03:44:26.804882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.401 qpair failed and we were unable to recover it. 00:27:46.401 [2024-11-21 03:44:26.804992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.401 [2024-11-21 03:44:26.805135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.401 [2024-11-21 03:44:26.805165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.401 qpair failed and we were unable to recover it. 00:27:46.401 [2024-11-21 03:44:26.805323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.401 [2024-11-21 03:44:26.805428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.401 [2024-11-21 03:44:26.805454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.401 qpair failed and we were unable to recover it. 00:27:46.401 [2024-11-21 03:44:26.805586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.401 [2024-11-21 03:44:26.805739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.401 [2024-11-21 03:44:26.805769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.401 qpair failed and we were unable to recover it. 00:27:46.401 [2024-11-21 03:44:26.805938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.401 [2024-11-21 03:44:26.806107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.401 [2024-11-21 03:44:26.806136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.401 qpair failed and we were unable to recover it. 00:27:46.401 [2024-11-21 03:44:26.806261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.402 [2024-11-21 03:44:26.806395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.402 [2024-11-21 03:44:26.806421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.402 qpair failed and we were unable to recover it. 00:27:46.402 [2024-11-21 03:44:26.806539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.402 [2024-11-21 03:44:26.806674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.402 [2024-11-21 03:44:26.806703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.402 qpair failed and we were unable to recover it. 00:27:46.402 [2024-11-21 03:44:26.806804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.402 [2024-11-21 03:44:26.806916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.402 [2024-11-21 03:44:26.806945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.402 qpair failed and we were unable to recover it. 00:27:46.402 [2024-11-21 03:44:26.807065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.402 [2024-11-21 03:44:26.807232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.402 [2024-11-21 03:44:26.807259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.402 qpair failed and we were unable to recover it. 00:27:46.402 [2024-11-21 03:44:26.807442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.402 [2024-11-21 03:44:26.807576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.402 [2024-11-21 03:44:26.807606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.402 qpair failed and we were unable to recover it. 00:27:46.402 [2024-11-21 03:44:26.807713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.402 [2024-11-21 03:44:26.807880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.402 [2024-11-21 03:44:26.807908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.402 qpair failed and we were unable to recover it. 00:27:46.402 [2024-11-21 03:44:26.808055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.402 [2024-11-21 03:44:26.808222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.402 [2024-11-21 03:44:26.808248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.402 qpair failed and we were unable to recover it. 00:27:46.402 [2024-11-21 03:44:26.808442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.402 [2024-11-21 03:44:26.808543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.402 [2024-11-21 03:44:26.808569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.402 qpair failed and we were unable to recover it. 00:27:46.402 [2024-11-21 03:44:26.808695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.402 [2024-11-21 03:44:26.808818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.402 [2024-11-21 03:44:26.808847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.402 qpair failed and we were unable to recover it. 00:27:46.402 [2024-11-21 03:44:26.809021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.402 [2024-11-21 03:44:26.809179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.402 [2024-11-21 03:44:26.809206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.402 qpair failed and we were unable to recover it. 00:27:46.402 [2024-11-21 03:44:26.809340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.402 [2024-11-21 03:44:26.809471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.402 [2024-11-21 03:44:26.809499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.402 qpair failed and we were unable to recover it. 00:27:46.402 [2024-11-21 03:44:26.809639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.402 [2024-11-21 03:44:26.809827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.402 [2024-11-21 03:44:26.809853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.402 qpair failed and we were unable to recover it. 00:27:46.402 [2024-11-21 03:44:26.809957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.402 [2024-11-21 03:44:26.810100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.402 [2024-11-21 03:44:26.810128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.402 qpair failed and we were unable to recover it. 00:27:46.402 [2024-11-21 03:44:26.810226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.402 [2024-11-21 03:44:26.810381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.402 [2024-11-21 03:44:26.810407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.402 qpair failed and we were unable to recover it. 00:27:46.402 [2024-11-21 03:44:26.810523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.402 [2024-11-21 03:44:26.810689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.402 [2024-11-21 03:44:26.810717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.402 qpair failed and we were unable to recover it. 00:27:46.402 [2024-11-21 03:44:26.810876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.402 [2024-11-21 03:44:26.811005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.402 [2024-11-21 03:44:26.811032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.402 qpair failed and we were unable to recover it. 00:27:46.402 [2024-11-21 03:44:26.811185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.402 [2024-11-21 03:44:26.811343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.402 [2024-11-21 03:44:26.811369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.402 qpair failed and we were unable to recover it. 00:27:46.402 [2024-11-21 03:44:26.811527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.402 [2024-11-21 03:44:26.811678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.402 [2024-11-21 03:44:26.811711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.402 qpair failed and we were unable to recover it. 00:27:46.402 [2024-11-21 03:44:26.811858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.402 [2024-11-21 03:44:26.812012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.402 [2024-11-21 03:44:26.812037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.402 qpair failed and we were unable to recover it. 00:27:46.402 [2024-11-21 03:44:26.812200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.402 [2024-11-21 03:44:26.812350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.402 [2024-11-21 03:44:26.812375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.402 qpair failed and we were unable to recover it. 00:27:46.402 [2024-11-21 03:44:26.812530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.402 [2024-11-21 03:44:26.812662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.402 [2024-11-21 03:44:26.812690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.402 qpair failed and we were unable to recover it. 00:27:46.402 [2024-11-21 03:44:26.812806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.402 [2024-11-21 03:44:26.812912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.402 [2024-11-21 03:44:26.812938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.402 qpair failed and we were unable to recover it. 00:27:46.402 [2024-11-21 03:44:26.813117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.402 [2024-11-21 03:44:26.813259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.402 [2024-11-21 03:44:26.813288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.402 qpair failed and we were unable to recover it. 00:27:46.402 [2024-11-21 03:44:26.813458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.402 [2024-11-21 03:44:26.813591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.402 [2024-11-21 03:44:26.813620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.402 qpair failed and we were unable to recover it. 00:27:46.402 [2024-11-21 03:44:26.813773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.402 [2024-11-21 03:44:26.813882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.402 [2024-11-21 03:44:26.813908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.402 qpair failed and we were unable to recover it. 00:27:46.402 [2024-11-21 03:44:26.814035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.402 [2024-11-21 03:44:26.814213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.402 [2024-11-21 03:44:26.814242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.402 qpair failed and we were unable to recover it. 00:27:46.402 [2024-11-21 03:44:26.814417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.402 [2024-11-21 03:44:26.814519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.402 [2024-11-21 03:44:26.814547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.402 qpair failed and we were unable to recover it. 00:27:46.402 [2024-11-21 03:44:26.814705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.402 [2024-11-21 03:44:26.814837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.402 [2024-11-21 03:44:26.814879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.402 qpair failed and we were unable to recover it. 00:27:46.402 [2024-11-21 03:44:26.815030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.402 [2024-11-21 03:44:26.815203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.402 [2024-11-21 03:44:26.815233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.402 qpair failed and we were unable to recover it. 00:27:46.402 [2024-11-21 03:44:26.815351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.403 [2024-11-21 03:44:26.815531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.403 [2024-11-21 03:44:26.815557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.403 qpair failed and we were unable to recover it. 00:27:46.403 [2024-11-21 03:44:26.815713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.403 [2024-11-21 03:44:26.815843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.403 [2024-11-21 03:44:26.815885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.403 qpair failed and we were unable to recover it. 00:27:46.403 [2024-11-21 03:44:26.816019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.403 [2024-11-21 03:44:26.816187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.403 [2024-11-21 03:44:26.816217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.403 qpair failed and we were unable to recover it. 00:27:46.403 [2024-11-21 03:44:26.816353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.403 [2024-11-21 03:44:26.816485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.403 [2024-11-21 03:44:26.816514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.403 qpair failed and we were unable to recover it. 00:27:46.403 [2024-11-21 03:44:26.816661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.403 [2024-11-21 03:44:26.816823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.403 [2024-11-21 03:44:26.816865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.403 qpair failed and we were unable to recover it. 00:27:46.403 [2024-11-21 03:44:26.817046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.403 [2024-11-21 03:44:26.817182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.403 [2024-11-21 03:44:26.817209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.403 qpair failed and we were unable to recover it. 00:27:46.403 [2024-11-21 03:44:26.817307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.403 [2024-11-21 03:44:26.817428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.403 [2024-11-21 03:44:26.817457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.403 qpair failed and we were unable to recover it. 00:27:46.403 [2024-11-21 03:44:26.817610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.403 [2024-11-21 03:44:26.817734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.403 [2024-11-21 03:44:26.817760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.403 qpair failed and we were unable to recover it. 00:27:46.403 [2024-11-21 03:44:26.817911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.403 [2024-11-21 03:44:26.818044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.403 [2024-11-21 03:44:26.818081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.403 qpair failed and we were unable to recover it. 00:27:46.403 [2024-11-21 03:44:26.818232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.403 [2024-11-21 03:44:26.818382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.403 [2024-11-21 03:44:26.818408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.403 qpair failed and we were unable to recover it. 00:27:46.403 [2024-11-21 03:44:26.818540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.403 [2024-11-21 03:44:26.818675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.403 [2024-11-21 03:44:26.818702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.403 qpair failed and we were unable to recover it. 00:27:46.403 [2024-11-21 03:44:26.818847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.403 [2024-11-21 03:44:26.819016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.403 [2024-11-21 03:44:26.819044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.403 qpair failed and we were unable to recover it. 00:27:46.403 [2024-11-21 03:44:26.819183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.403 [2024-11-21 03:44:26.819315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.403 [2024-11-21 03:44:26.819341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.403 qpair failed and we were unable to recover it. 00:27:46.403 [2024-11-21 03:44:26.819483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.403 [2024-11-21 03:44:26.819583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.403 [2024-11-21 03:44:26.819609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.403 qpair failed and we were unable to recover it. 00:27:46.403 [2024-11-21 03:44:26.819779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.403 [2024-11-21 03:44:26.819914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.403 [2024-11-21 03:44:26.819942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.403 qpair failed and we were unable to recover it. 00:27:46.403 [2024-11-21 03:44:26.820111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.403 [2024-11-21 03:44:26.820259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.403 [2024-11-21 03:44:26.820287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.403 qpair failed and we were unable to recover it. 00:27:46.403 [2024-11-21 03:44:26.820434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.403 [2024-11-21 03:44:26.820541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.403 [2024-11-21 03:44:26.820567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.403 qpair failed and we were unable to recover it. 00:27:46.403 [2024-11-21 03:44:26.820672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.403 [2024-11-21 03:44:26.820802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.403 [2024-11-21 03:44:26.820846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.403 qpair failed and we were unable to recover it. 00:27:46.403 [2024-11-21 03:44:26.820987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.403 [2024-11-21 03:44:26.821097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.403 [2024-11-21 03:44:26.821140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.403 qpair failed and we were unable to recover it. 00:27:46.403 [2024-11-21 03:44:26.821304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.403 [2024-11-21 03:44:26.821436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.403 [2024-11-21 03:44:26.821478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.403 qpair failed and we were unable to recover it. 00:27:46.403 [2024-11-21 03:44:26.821615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.403 [2024-11-21 03:44:26.821779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.403 [2024-11-21 03:44:26.821808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.403 qpair failed and we were unable to recover it. 00:27:46.403 [2024-11-21 03:44:26.821981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.403 [2024-11-21 03:44:26.822129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.403 [2024-11-21 03:44:26.822159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.403 qpair failed and we were unable to recover it. 00:27:46.403 [2024-11-21 03:44:26.822286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.403 [2024-11-21 03:44:26.822406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.403 [2024-11-21 03:44:26.822432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.403 qpair failed and we were unable to recover it. 00:27:46.403 [2024-11-21 03:44:26.822582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.403 [2024-11-21 03:44:26.822721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.403 [2024-11-21 03:44:26.822749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.403 qpair failed and we were unable to recover it. 00:27:46.403 [2024-11-21 03:44:26.822905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.403 [2024-11-21 03:44:26.822998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.403 [2024-11-21 03:44:26.823024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.403 qpair failed and we were unable to recover it. 00:27:46.403 [2024-11-21 03:44:26.823131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.403 [2024-11-21 03:44:26.823231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.403 [2024-11-21 03:44:26.823257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.403 qpair failed and we were unable to recover it. 00:27:46.403 [2024-11-21 03:44:26.823361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.403 [2024-11-21 03:44:26.823512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.403 [2024-11-21 03:44:26.823541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.403 qpair failed and we were unable to recover it. 00:27:46.403 [2024-11-21 03:44:26.823721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.403 [2024-11-21 03:44:26.823850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.403 [2024-11-21 03:44:26.823875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.403 qpair failed and we were unable to recover it. 00:27:46.403 [2024-11-21 03:44:26.824021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.403 [2024-11-21 03:44:26.824185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.403 [2024-11-21 03:44:26.824212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.403 qpair failed and we were unable to recover it. 00:27:46.403 [2024-11-21 03:44:26.824341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.404 [2024-11-21 03:44:26.824473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.404 [2024-11-21 03:44:26.824499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.404 qpair failed and we were unable to recover it. 00:27:46.404 [2024-11-21 03:44:26.824622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.404 [2024-11-21 03:44:26.824780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.404 [2024-11-21 03:44:26.824805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.404 qpair failed and we were unable to recover it. 00:27:46.404 [2024-11-21 03:44:26.824985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.404 [2024-11-21 03:44:26.825121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.404 [2024-11-21 03:44:26.825162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.404 qpair failed and we were unable to recover it. 00:27:46.404 [2024-11-21 03:44:26.825311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.404 [2024-11-21 03:44:26.825464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.404 [2024-11-21 03:44:26.825490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.404 qpair failed and we were unable to recover it. 00:27:46.404 [2024-11-21 03:44:26.825642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.404 [2024-11-21 03:44:26.825809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.404 [2024-11-21 03:44:26.825838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.404 qpair failed and we were unable to recover it. 00:27:46.404 [2024-11-21 03:44:26.825987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.404 [2024-11-21 03:44:26.826117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.404 [2024-11-21 03:44:26.826144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.404 qpair failed and we were unable to recover it. 00:27:46.404 [2024-11-21 03:44:26.826304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.404 [2024-11-21 03:44:26.826425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.404 [2024-11-21 03:44:26.826454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.404 qpair failed and we were unable to recover it. 00:27:46.404 [2024-11-21 03:44:26.826580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.404 [2024-11-21 03:44:26.826711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.404 [2024-11-21 03:44:26.826737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.404 qpair failed and we were unable to recover it. 00:27:46.404 [2024-11-21 03:44:26.826869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.404 [2024-11-21 03:44:26.827001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.404 [2024-11-21 03:44:26.827026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.404 qpair failed and we were unable to recover it. 00:27:46.404 [2024-11-21 03:44:26.827203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.404 [2024-11-21 03:44:26.827332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.404 [2024-11-21 03:44:26.827359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.404 qpair failed and we were unable to recover it. 00:27:46.404 [2024-11-21 03:44:26.827535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.404 [2024-11-21 03:44:26.827701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.404 [2024-11-21 03:44:26.827734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.404 qpair failed and we were unable to recover it. 00:27:46.404 [2024-11-21 03:44:26.827913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.404 [2024-11-21 03:44:26.828090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.404 [2024-11-21 03:44:26.828120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.404 qpair failed and we were unable to recover it. 00:27:46.404 [2024-11-21 03:44:26.828289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.404 [2024-11-21 03:44:26.828430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.404 [2024-11-21 03:44:26.828461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.404 qpair failed and we were unable to recover it. 00:27:46.404 [2024-11-21 03:44:26.828574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.404 [2024-11-21 03:44:26.828707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.404 [2024-11-21 03:44:26.828736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.404 qpair failed and we were unable to recover it. 00:27:46.404 [2024-11-21 03:44:26.828902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.404 [2024-11-21 03:44:26.829032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.404 [2024-11-21 03:44:26.829094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.404 qpair failed and we were unable to recover it. 00:27:46.404 [2024-11-21 03:44:26.829252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.404 [2024-11-21 03:44:26.829440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.404 [2024-11-21 03:44:26.829466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.404 qpair failed and we were unable to recover it. 00:27:46.404 [2024-11-21 03:44:26.829596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.404 [2024-11-21 03:44:26.829775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.404 [2024-11-21 03:44:26.829803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.404 qpair failed and we were unable to recover it. 00:27:46.404 [2024-11-21 03:44:26.829955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.404 [2024-11-21 03:44:26.830044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.404 [2024-11-21 03:44:26.830078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.404 qpair failed and we were unable to recover it. 00:27:46.404 [2024-11-21 03:44:26.830233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.404 [2024-11-21 03:44:26.830375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.404 [2024-11-21 03:44:26.830404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.404 qpair failed and we were unable to recover it. 00:27:46.404 [2024-11-21 03:44:26.830551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.404 [2024-11-21 03:44:26.830707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.404 [2024-11-21 03:44:26.830733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.404 qpair failed and we were unable to recover it. 00:27:46.404 [2024-11-21 03:44:26.830890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.404 [2024-11-21 03:44:26.830989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.404 [2024-11-21 03:44:26.831015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.404 qpair failed and we were unable to recover it. 00:27:46.404 [2024-11-21 03:44:26.831205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.404 [2024-11-21 03:44:26.831357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.404 [2024-11-21 03:44:26.831383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.404 qpair failed and we were unable to recover it. 00:27:46.404 [2024-11-21 03:44:26.831536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.404 [2024-11-21 03:44:26.831677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.404 [2024-11-21 03:44:26.831707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.404 qpair failed and we were unable to recover it. 00:27:46.404 [2024-11-21 03:44:26.831851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.404 [2024-11-21 03:44:26.831953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.404 [2024-11-21 03:44:26.831979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.404 qpair failed and we were unable to recover it. 00:27:46.404 [2024-11-21 03:44:26.832104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.404 [2024-11-21 03:44:26.832229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.404 [2024-11-21 03:44:26.832272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.404 qpair failed and we were unable to recover it. 00:27:46.404 [2024-11-21 03:44:26.832438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.404 [2024-11-21 03:44:26.832584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.404 [2024-11-21 03:44:26.832613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.404 qpair failed and we were unable to recover it. 00:27:46.404 [2024-11-21 03:44:26.832768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.404 [2024-11-21 03:44:26.832919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.404 [2024-11-21 03:44:26.832945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.404 qpair failed and we were unable to recover it. 00:27:46.404 [2024-11-21 03:44:26.833093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.404 [2024-11-21 03:44:26.833227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.404 [2024-11-21 03:44:26.833256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.404 qpair failed and we were unable to recover it. 00:27:46.404 [2024-11-21 03:44:26.833424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.404 [2024-11-21 03:44:26.833562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.404 [2024-11-21 03:44:26.833591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.404 qpair failed and we were unable to recover it. 00:27:46.404 [2024-11-21 03:44:26.833710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.405 [2024-11-21 03:44:26.833846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.405 [2024-11-21 03:44:26.833872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.405 qpair failed and we were unable to recover it. 00:27:46.405 [2024-11-21 03:44:26.833983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.405 [2024-11-21 03:44:26.834114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.405 [2024-11-21 03:44:26.834144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.405 qpair failed and we were unable to recover it. 00:27:46.405 [2024-11-21 03:44:26.834298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.405 [2024-11-21 03:44:26.834455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.405 [2024-11-21 03:44:26.834481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.405 qpair failed and we were unable to recover it. 00:27:46.405 [2024-11-21 03:44:26.834612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.405 [2024-11-21 03:44:26.834765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.405 [2024-11-21 03:44:26.834807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.405 qpair failed and we were unable to recover it. 00:27:46.405 [2024-11-21 03:44:26.834924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.405 [2024-11-21 03:44:26.835134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.405 [2024-11-21 03:44:26.835161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.405 qpair failed and we were unable to recover it. 00:27:46.405 [2024-11-21 03:44:26.835252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.405 [2024-11-21 03:44:26.835355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.405 [2024-11-21 03:44:26.835397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.405 qpair failed and we were unable to recover it. 00:27:46.405 [2024-11-21 03:44:26.835576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.405 [2024-11-21 03:44:26.835678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.405 [2024-11-21 03:44:26.835704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.405 qpair failed and we were unable to recover it. 00:27:46.405 [2024-11-21 03:44:26.835852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.405 [2024-11-21 03:44:26.835992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.405 [2024-11-21 03:44:26.836021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.405 qpair failed and we were unable to recover it. 00:27:46.405 [2024-11-21 03:44:26.836186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.405 [2024-11-21 03:44:26.836314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.405 [2024-11-21 03:44:26.836340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.405 qpair failed and we were unable to recover it. 00:27:46.405 [2024-11-21 03:44:26.836504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.405 [2024-11-21 03:44:26.836628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.405 [2024-11-21 03:44:26.836654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.405 qpair failed and we were unable to recover it. 00:27:46.405 [2024-11-21 03:44:26.836813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.405 [2024-11-21 03:44:26.836969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.405 [2024-11-21 03:44:26.836995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.405 qpair failed and we were unable to recover it. 00:27:46.405 [2024-11-21 03:44:26.837131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.405 [2024-11-21 03:44:26.837298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.405 [2024-11-21 03:44:26.837326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.405 qpair failed and we were unable to recover it. 00:27:46.405 [2024-11-21 03:44:26.837484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.405 [2024-11-21 03:44:26.837584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.405 [2024-11-21 03:44:26.837610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.405 qpair failed and we were unable to recover it. 00:27:46.405 [2024-11-21 03:44:26.837736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.405 [2024-11-21 03:44:26.837908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.405 [2024-11-21 03:44:26.837936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.405 qpair failed and we were unable to recover it. 00:27:46.405 [2024-11-21 03:44:26.838082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.405 [2024-11-21 03:44:26.838209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.405 [2024-11-21 03:44:26.838235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.405 qpair failed and we were unable to recover it. 00:27:46.405 [2024-11-21 03:44:26.838397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.405 [2024-11-21 03:44:26.838520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.405 [2024-11-21 03:44:26.838546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.405 qpair failed and we were unable to recover it. 00:27:46.405 [2024-11-21 03:44:26.838679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.405 [2024-11-21 03:44:26.838787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.405 [2024-11-21 03:44:26.838813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.405 qpair failed and we were unable to recover it. 00:27:46.405 [2024-11-21 03:44:26.838908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.405 [2024-11-21 03:44:26.839039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.405 [2024-11-21 03:44:26.839064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.405 qpair failed and we were unable to recover it. 00:27:46.405 [2024-11-21 03:44:26.839233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.405 [2024-11-21 03:44:26.839333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.405 [2024-11-21 03:44:26.839359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.405 qpair failed and we were unable to recover it. 00:27:46.405 [2024-11-21 03:44:26.839507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.405 [2024-11-21 03:44:26.839648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.405 [2024-11-21 03:44:26.839676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.405 qpair failed and we were unable to recover it. 00:27:46.405 [2024-11-21 03:44:26.839848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.405 [2024-11-21 03:44:26.839990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.405 [2024-11-21 03:44:26.840018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.405 qpair failed and we were unable to recover it. 00:27:46.405 [2024-11-21 03:44:26.840152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.405 [2024-11-21 03:44:26.840254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.405 [2024-11-21 03:44:26.840280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.405 qpair failed and we were unable to recover it. 00:27:46.405 [2024-11-21 03:44:26.840459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.405 [2024-11-21 03:44:26.840568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.405 [2024-11-21 03:44:26.840610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.405 qpair failed and we were unable to recover it. 00:27:46.405 [2024-11-21 03:44:26.840742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.405 [2024-11-21 03:44:26.840862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.405 [2024-11-21 03:44:26.840888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.405 qpair failed and we were unable to recover it. 00:27:46.405 [2024-11-21 03:44:26.841020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.405 [2024-11-21 03:44:26.841174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.405 [2024-11-21 03:44:26.841217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.405 qpair failed and we were unable to recover it. 00:27:46.405 [2024-11-21 03:44:26.841392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.405 [2024-11-21 03:44:26.841544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.405 [2024-11-21 03:44:26.841569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.405 qpair failed and we were unable to recover it. 00:27:46.406 [2024-11-21 03:44:26.841667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.406 [2024-11-21 03:44:26.841762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.406 [2024-11-21 03:44:26.841788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.406 qpair failed and we were unable to recover it. 00:27:46.406 [2024-11-21 03:44:26.841912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.406 [2024-11-21 03:44:26.842081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.406 [2024-11-21 03:44:26.842124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.406 qpair failed and we were unable to recover it. 00:27:46.406 [2024-11-21 03:44:26.842234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.406 [2024-11-21 03:44:26.842381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.406 [2024-11-21 03:44:26.842410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.406 qpair failed and we were unable to recover it. 00:27:46.406 [2024-11-21 03:44:26.842575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.406 [2024-11-21 03:44:26.842673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.406 [2024-11-21 03:44:26.842702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.406 qpair failed and we were unable to recover it. 00:27:46.406 [2024-11-21 03:44:26.842882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.406 [2024-11-21 03:44:26.843009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.406 [2024-11-21 03:44:26.843035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.406 qpair failed and we were unable to recover it. 00:27:46.406 [2024-11-21 03:44:26.843240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.406 [2024-11-21 03:44:26.843360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.406 [2024-11-21 03:44:26.843386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.406 qpair failed and we were unable to recover it. 00:27:46.406 [2024-11-21 03:44:26.843537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.406 [2024-11-21 03:44:26.843672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.406 [2024-11-21 03:44:26.843706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.406 qpair failed and we were unable to recover it. 00:27:46.406 [2024-11-21 03:44:26.843825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.406 [2024-11-21 03:44:26.843934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.406 [2024-11-21 03:44:26.843960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.406 qpair failed and we were unable to recover it. 00:27:46.406 [2024-11-21 03:44:26.844094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.406 [2024-11-21 03:44:26.844185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.406 [2024-11-21 03:44:26.844229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.406 qpair failed and we were unable to recover it. 00:27:46.406 [2024-11-21 03:44:26.844369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.406 [2024-11-21 03:44:26.844485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.406 [2024-11-21 03:44:26.844514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.406 qpair failed and we were unable to recover it. 00:27:46.406 [2024-11-21 03:44:26.844666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.406 [2024-11-21 03:44:26.844820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.406 [2024-11-21 03:44:26.844846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.406 qpair failed and we were unable to recover it. 00:27:46.406 [2024-11-21 03:44:26.845008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.406 [2024-11-21 03:44:26.845105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.406 [2024-11-21 03:44:26.845132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.406 qpair failed and we were unable to recover it. 00:27:46.406 [2024-11-21 03:44:26.845288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.406 [2024-11-21 03:44:26.845512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.406 [2024-11-21 03:44:26.845562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.406 qpair failed and we were unable to recover it. 00:27:46.406 [2024-11-21 03:44:26.845700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.406 [2024-11-21 03:44:26.845834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.406 [2024-11-21 03:44:26.845861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.406 qpair failed and we were unable to recover it. 00:27:46.406 [2024-11-21 03:44:26.845987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.406 [2024-11-21 03:44:26.846099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.406 [2024-11-21 03:44:26.846141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.406 qpair failed and we were unable to recover it. 00:27:46.406 [2024-11-21 03:44:26.846263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.406 [2024-11-21 03:44:26.846360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.406 [2024-11-21 03:44:26.846386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.406 qpair failed and we were unable to recover it. 00:27:46.406 [2024-11-21 03:44:26.846487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.406 [2024-11-21 03:44:26.846619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.406 [2024-11-21 03:44:26.846649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.406 qpair failed and we were unable to recover it. 00:27:46.406 [2024-11-21 03:44:26.846804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.406 [2024-11-21 03:44:26.846939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.406 [2024-11-21 03:44:26.846981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.406 qpair failed and we were unable to recover it. 00:27:46.406 [2024-11-21 03:44:26.847119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.406 [2024-11-21 03:44:26.847263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.406 [2024-11-21 03:44:26.847291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.406 qpair failed and we were unable to recover it. 00:27:46.406 [2024-11-21 03:44:26.847472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.406 [2024-11-21 03:44:26.847623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.406 [2024-11-21 03:44:26.847649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.406 qpair failed and we were unable to recover it. 00:27:46.406 [2024-11-21 03:44:26.847807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.406 [2024-11-21 03:44:26.847964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.406 [2024-11-21 03:44:26.847993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.406 qpair failed and we were unable to recover it. 00:27:46.406 [2024-11-21 03:44:26.848104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.406 [2024-11-21 03:44:26.848280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.406 [2024-11-21 03:44:26.848306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.406 qpair failed and we were unable to recover it. 00:27:46.406 [2024-11-21 03:44:26.848462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.406 [2024-11-21 03:44:26.848565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.406 [2024-11-21 03:44:26.848591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.406 qpair failed and we were unable to recover it. 00:27:46.406 [2024-11-21 03:44:26.848746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.406 [2024-11-21 03:44:26.848891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.406 [2024-11-21 03:44:26.848917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.406 qpair failed and we were unable to recover it. 00:27:46.406 [2024-11-21 03:44:26.849046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.406 [2024-11-21 03:44:26.849207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.406 [2024-11-21 03:44:26.849234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.406 qpair failed and we were unable to recover it. 00:27:46.406 [2024-11-21 03:44:26.849395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.406 [2024-11-21 03:44:26.849524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.406 [2024-11-21 03:44:26.849549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.406 qpair failed and we were unable to recover it. 00:27:46.406 [2024-11-21 03:44:26.849708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.406 [2024-11-21 03:44:26.849848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.406 [2024-11-21 03:44:26.849876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.406 qpair failed and we were unable to recover it. 00:27:46.406 [2024-11-21 03:44:26.850048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.406 [2024-11-21 03:44:26.850206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.406 [2024-11-21 03:44:26.850233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.406 qpair failed and we were unable to recover it. 00:27:46.406 [2024-11-21 03:44:26.850331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.406 [2024-11-21 03:44:26.850419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.406 [2024-11-21 03:44:26.850445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.406 qpair failed and we were unable to recover it. 00:27:46.406 [2024-11-21 03:44:26.850612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.407 [2024-11-21 03:44:26.850750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.407 [2024-11-21 03:44:26.850779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.407 qpair failed and we were unable to recover it. 00:27:46.407 [2024-11-21 03:44:26.850949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.407 [2024-11-21 03:44:26.851101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.407 [2024-11-21 03:44:26.851128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.407 qpair failed and we were unable to recover it. 00:27:46.407 [2024-11-21 03:44:26.851284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.407 [2024-11-21 03:44:26.851407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.407 [2024-11-21 03:44:26.851433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.407 qpair failed and we were unable to recover it. 00:27:46.407 [2024-11-21 03:44:26.851591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.407 [2024-11-21 03:44:26.851730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.407 [2024-11-21 03:44:26.851759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.407 qpair failed and we were unable to recover it. 00:27:46.407 [2024-11-21 03:44:26.851902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.407 [2024-11-21 03:44:26.852085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.407 [2024-11-21 03:44:26.852129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.407 qpair failed and we were unable to recover it. 00:27:46.407 [2024-11-21 03:44:26.852259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.407 [2024-11-21 03:44:26.852380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.407 [2024-11-21 03:44:26.852406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.407 qpair failed and we were unable to recover it. 00:27:46.407 [2024-11-21 03:44:26.852563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.407 [2024-11-21 03:44:26.852691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.407 [2024-11-21 03:44:26.852718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.407 qpair failed and we were unable to recover it. 00:27:46.407 [2024-11-21 03:44:26.852816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.407 [2024-11-21 03:44:26.852963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.407 [2024-11-21 03:44:26.852992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.407 qpair failed and we were unable to recover it. 00:27:46.407 [2024-11-21 03:44:26.853134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.407 [2024-11-21 03:44:26.853247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.407 [2024-11-21 03:44:26.853273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.407 qpair failed and we were unable to recover it. 00:27:46.407 [2024-11-21 03:44:26.853406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.407 [2024-11-21 03:44:26.853578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.407 [2024-11-21 03:44:26.853607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.407 qpair failed and we were unable to recover it. 00:27:46.407 [2024-11-21 03:44:26.853781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.407 [2024-11-21 03:44:26.853896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.407 [2024-11-21 03:44:26.853925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.407 qpair failed and we were unable to recover it. 00:27:46.407 [2024-11-21 03:44:26.854058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.407 [2024-11-21 03:44:26.854226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.407 [2024-11-21 03:44:26.854252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.407 qpair failed and we were unable to recover it. 00:27:46.407 [2024-11-21 03:44:26.854383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.407 [2024-11-21 03:44:26.854517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.407 [2024-11-21 03:44:26.854543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.407 qpair failed and we were unable to recover it. 00:27:46.407 [2024-11-21 03:44:26.854702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.407 [2024-11-21 03:44:26.854845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.407 [2024-11-21 03:44:26.854873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.407 qpair failed and we were unable to recover it. 00:27:46.407 [2024-11-21 03:44:26.855035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.407 [2024-11-21 03:44:26.855171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.407 [2024-11-21 03:44:26.855198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.407 qpair failed and we were unable to recover it. 00:27:46.407 [2024-11-21 03:44:26.855321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.407 [2024-11-21 03:44:26.855471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.407 [2024-11-21 03:44:26.855500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.407 qpair failed and we were unable to recover it. 00:27:46.407 [2024-11-21 03:44:26.855610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.407 [2024-11-21 03:44:26.855718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.407 [2024-11-21 03:44:26.855746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.407 qpair failed and we were unable to recover it. 00:27:46.407 [2024-11-21 03:44:26.855908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.407 [2024-11-21 03:44:26.856059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.407 [2024-11-21 03:44:26.856113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.407 qpair failed and we were unable to recover it. 00:27:46.407 [2024-11-21 03:44:26.856242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.407 [2024-11-21 03:44:26.856387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.407 [2024-11-21 03:44:26.856416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.407 qpair failed and we were unable to recover it. 00:27:46.407 [2024-11-21 03:44:26.856562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.407 [2024-11-21 03:44:26.856708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.407 [2024-11-21 03:44:26.856738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.407 qpair failed and we were unable to recover it. 00:27:46.407 [2024-11-21 03:44:26.856887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.407 [2024-11-21 03:44:26.857016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.407 [2024-11-21 03:44:26.857042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.407 qpair failed and we were unable to recover it. 00:27:46.407 [2024-11-21 03:44:26.857202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.407 [2024-11-21 03:44:26.857301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.407 [2024-11-21 03:44:26.857328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.407 qpair failed and we were unable to recover it. 00:27:46.407 [2024-11-21 03:44:26.857460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.407 [2024-11-21 03:44:26.857603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.407 [2024-11-21 03:44:26.857632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.407 qpair failed and we were unable to recover it. 00:27:46.407 [2024-11-21 03:44:26.857811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.407 [2024-11-21 03:44:26.857935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.407 [2024-11-21 03:44:26.857961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.407 qpair failed and we were unable to recover it. 00:27:46.407 [2024-11-21 03:44:26.858111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.407 [2024-11-21 03:44:26.858249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.407 [2024-11-21 03:44:26.858277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.407 qpair failed and we were unable to recover it. 00:27:46.407 [2024-11-21 03:44:26.858423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.407 [2024-11-21 03:44:26.858563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.407 [2024-11-21 03:44:26.858592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.407 qpair failed and we were unable to recover it. 00:27:46.407 [2024-11-21 03:44:26.858739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.407 [2024-11-21 03:44:26.858840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.407 [2024-11-21 03:44:26.858866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.407 qpair failed and we were unable to recover it. 00:27:46.407 [2024-11-21 03:44:26.859018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.407 [2024-11-21 03:44:26.859132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.407 [2024-11-21 03:44:26.859161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.407 qpair failed and we were unable to recover it. 00:27:46.407 [2024-11-21 03:44:26.859283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.407 [2024-11-21 03:44:26.859436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.407 [2024-11-21 03:44:26.859463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.407 qpair failed and we were unable to recover it. 00:27:46.407 [2024-11-21 03:44:26.859565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.408 [2024-11-21 03:44:26.859657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.408 [2024-11-21 03:44:26.859683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.408 qpair failed and we were unable to recover it. 00:27:46.408 [2024-11-21 03:44:26.859794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.408 [2024-11-21 03:44:26.859884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.408 [2024-11-21 03:44:26.859910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.408 qpair failed and we were unable to recover it. 00:27:46.408 [2024-11-21 03:44:26.860037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.408 [2024-11-21 03:44:26.860177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.408 [2024-11-21 03:44:26.860207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.408 qpair failed and we were unable to recover it. 00:27:46.408 [2024-11-21 03:44:26.860357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.408 [2024-11-21 03:44:26.860515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.408 [2024-11-21 03:44:26.860556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.408 qpair failed and we were unable to recover it. 00:27:46.408 [2024-11-21 03:44:26.860708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.408 [2024-11-21 03:44:26.860865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.408 [2024-11-21 03:44:26.860891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.408 qpair failed and we were unable to recover it. 00:27:46.408 [2024-11-21 03:44:26.861022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.408 [2024-11-21 03:44:26.861175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.408 [2024-11-21 03:44:26.861205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.408 qpair failed and we were unable to recover it. 00:27:46.408 [2024-11-21 03:44:26.861381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.408 [2024-11-21 03:44:26.861539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.408 [2024-11-21 03:44:26.861583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.408 qpair failed and we were unable to recover it. 00:27:46.408 [2024-11-21 03:44:26.861720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.408 [2024-11-21 03:44:26.861887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.408 [2024-11-21 03:44:26.861915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.408 qpair failed and we were unable to recover it. 00:27:46.408 [2024-11-21 03:44:26.862047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.408 [2024-11-21 03:44:26.862186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.408 [2024-11-21 03:44:26.862212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.408 qpair failed and we were unable to recover it. 00:27:46.408 [2024-11-21 03:44:26.862343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.408 [2024-11-21 03:44:26.862450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.408 [2024-11-21 03:44:26.862480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.408 qpair failed and we were unable to recover it. 00:27:46.408 [2024-11-21 03:44:26.862604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.408 [2024-11-21 03:44:26.862776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.408 [2024-11-21 03:44:26.862804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.408 qpair failed and we were unable to recover it. 00:27:46.408 [2024-11-21 03:44:26.862985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.408 [2024-11-21 03:44:26.863085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.408 [2024-11-21 03:44:26.863112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.408 qpair failed and we were unable to recover it. 00:27:46.408 [2024-11-21 03:44:26.863249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.408 [2024-11-21 03:44:26.863346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.408 [2024-11-21 03:44:26.863373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.408 qpair failed and we were unable to recover it. 00:27:46.408 [2024-11-21 03:44:26.863579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.408 [2024-11-21 03:44:26.863714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.408 [2024-11-21 03:44:26.863743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.408 qpair failed and we were unable to recover it. 00:27:46.408 [2024-11-21 03:44:26.863890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.408 [2024-11-21 03:44:26.864012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.408 [2024-11-21 03:44:26.864037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.408 qpair failed and we were unable to recover it. 00:27:46.408 [2024-11-21 03:44:26.864208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.408 [2024-11-21 03:44:26.864381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.408 [2024-11-21 03:44:26.864409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.408 qpair failed and we were unable to recover it. 00:27:46.408 [2024-11-21 03:44:26.864545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.408 [2024-11-21 03:44:26.864663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.408 [2024-11-21 03:44:26.864691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.408 qpair failed and we were unable to recover it. 00:27:46.408 [2024-11-21 03:44:26.864849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.408 [2024-11-21 03:44:26.865004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.408 [2024-11-21 03:44:26.865030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.408 qpair failed and we were unable to recover it. 00:27:46.408 [2024-11-21 03:44:26.865183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.408 [2024-11-21 03:44:26.865290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.408 [2024-11-21 03:44:26.865317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.408 qpair failed and we were unable to recover it. 00:27:46.408 [2024-11-21 03:44:26.865439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.408 [2024-11-21 03:44:26.865589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.408 [2024-11-21 03:44:26.865618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.408 qpair failed and we were unable to recover it. 00:27:46.408 [2024-11-21 03:44:26.865761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.408 [2024-11-21 03:44:26.865870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.408 [2024-11-21 03:44:26.865896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.408 qpair failed and we were unable to recover it. 00:27:46.408 [2024-11-21 03:44:26.866019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.408 [2024-11-21 03:44:26.866121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.408 [2024-11-21 03:44:26.866146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.408 qpair failed and we were unable to recover it. 00:27:46.408 [2024-11-21 03:44:26.866275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.408 [2024-11-21 03:44:26.866418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.408 [2024-11-21 03:44:26.866447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.408 qpair failed and we were unable to recover it. 00:27:46.408 [2024-11-21 03:44:26.866616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.408 [2024-11-21 03:44:26.866797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.408 [2024-11-21 03:44:26.866823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.408 qpair failed and we were unable to recover it. 00:27:46.408 [2024-11-21 03:44:26.866979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.408 [2024-11-21 03:44:26.867081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.408 [2024-11-21 03:44:26.867107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.408 qpair failed and we were unable to recover it. 00:27:46.408 [2024-11-21 03:44:26.867290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.408 [2024-11-21 03:44:26.867506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.408 [2024-11-21 03:44:26.867560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.408 qpair failed and we were unable to recover it. 00:27:46.408 [2024-11-21 03:44:26.867738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.408 [2024-11-21 03:44:26.867899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.408 [2024-11-21 03:44:26.867925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.408 qpair failed and we were unable to recover it. 00:27:46.408 [2024-11-21 03:44:26.868060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.408 [2024-11-21 03:44:26.868195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.408 [2024-11-21 03:44:26.868221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.408 qpair failed and we were unable to recover it. 00:27:46.408 [2024-11-21 03:44:26.868418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.408 [2024-11-21 03:44:26.868578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.408 [2024-11-21 03:44:26.868604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.408 qpair failed and we were unable to recover it. 00:27:46.408 [2024-11-21 03:44:26.868756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.409 [2024-11-21 03:44:26.868870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.409 [2024-11-21 03:44:26.868899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.409 qpair failed and we were unable to recover it. 00:27:46.409 [2024-11-21 03:44:26.869048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.409 [2024-11-21 03:44:26.869235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.409 [2024-11-21 03:44:26.869278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.409 qpair failed and we were unable to recover it. 00:27:46.409 [2024-11-21 03:44:26.869429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.409 [2024-11-21 03:44:26.869572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.409 [2024-11-21 03:44:26.869602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.409 qpair failed and we were unable to recover it. 00:27:46.409 [2024-11-21 03:44:26.869771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.409 [2024-11-21 03:44:26.869887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.409 [2024-11-21 03:44:26.869929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.409 qpair failed and we were unable to recover it. 00:27:46.409 [2024-11-21 03:44:26.870052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.409 [2024-11-21 03:44:26.870160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.409 [2024-11-21 03:44:26.870186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.409 qpair failed and we were unable to recover it. 00:27:46.409 [2024-11-21 03:44:26.870360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.409 [2024-11-21 03:44:26.870528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.409 [2024-11-21 03:44:26.870556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.409 qpair failed and we were unable to recover it. 00:27:46.409 [2024-11-21 03:44:26.870665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.409 [2024-11-21 03:44:26.870836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.409 [2024-11-21 03:44:26.870865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.409 qpair failed and we were unable to recover it. 00:27:46.409 [2024-11-21 03:44:26.870982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.409 [2024-11-21 03:44:26.871115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.409 [2024-11-21 03:44:26.871141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.409 qpair failed and we were unable to recover it. 00:27:46.409 [2024-11-21 03:44:26.871275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.409 [2024-11-21 03:44:26.871415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.409 [2024-11-21 03:44:26.871444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.409 qpair failed and we were unable to recover it. 00:27:46.409 [2024-11-21 03:44:26.871578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.409 [2024-11-21 03:44:26.871720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.409 [2024-11-21 03:44:26.871750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.409 qpair failed and we were unable to recover it. 00:27:46.409 [2024-11-21 03:44:26.871900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.409 [2024-11-21 03:44:26.872033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.409 [2024-11-21 03:44:26.872060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.409 qpair failed and we were unable to recover it. 00:27:46.409 [2024-11-21 03:44:26.872222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.409 [2024-11-21 03:44:26.872389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.409 [2024-11-21 03:44:26.872422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:46.409 qpair failed and we were unable to recover it. 00:27:46.409 [2024-11-21 03:44:26.872544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.409 [2024-11-21 03:44:26.872715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.409 [2024-11-21 03:44:26.872744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:46.409 qpair failed and we were unable to recover it. 00:27:46.409 [2024-11-21 03:44:26.872898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.409 [2024-11-21 03:44:26.873033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.409 [2024-11-21 03:44:26.873059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:46.409 qpair failed and we were unable to recover it. 00:27:46.409 [2024-11-21 03:44:26.873262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.409 [2024-11-21 03:44:26.873388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.409 [2024-11-21 03:44:26.873414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:46.409 qpair failed and we were unable to recover it. 00:27:46.409 [2024-11-21 03:44:26.873545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.409 [2024-11-21 03:44:26.873665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.409 [2024-11-21 03:44:26.873696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:46.409 qpair failed and we were unable to recover it. 00:27:46.409 [2024-11-21 03:44:26.873874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.409 [2024-11-21 03:44:26.874008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.409 [2024-11-21 03:44:26.874051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:46.409 qpair failed and we were unable to recover it. 00:27:46.409 [2024-11-21 03:44:26.874203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.409 [2024-11-21 03:44:26.874336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.409 [2024-11-21 03:44:26.874364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.409 qpair failed and we were unable to recover it. 00:27:46.409 [2024-11-21 03:44:26.874515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.409 [2024-11-21 03:44:26.874672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.409 [2024-11-21 03:44:26.874698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.409 qpair failed and we were unable to recover it. 00:27:46.409 [2024-11-21 03:44:26.874859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.409 [2024-11-21 03:44:26.874989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.409 [2024-11-21 03:44:26.875032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.409 qpair failed and we were unable to recover it. 00:27:46.409 [2024-11-21 03:44:26.875152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.409 [2024-11-21 03:44:26.875264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.409 [2024-11-21 03:44:26.875293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.409 qpair failed and we were unable to recover it. 00:27:46.409 [2024-11-21 03:44:26.875438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.409 [2024-11-21 03:44:26.875572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.409 [2024-11-21 03:44:26.875601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.409 qpair failed and we were unable to recover it. 00:27:46.409 [2024-11-21 03:44:26.875730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.409 [2024-11-21 03:44:26.875860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.409 [2024-11-21 03:44:26.875886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.409 qpair failed and we were unable to recover it. 00:27:46.409 [2024-11-21 03:44:26.876056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.409 [2024-11-21 03:44:26.876211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.409 [2024-11-21 03:44:26.876240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.409 qpair failed and we were unable to recover it. 00:27:46.409 [2024-11-21 03:44:26.876361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.409 [2024-11-21 03:44:26.876537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.409 [2024-11-21 03:44:26.876563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.409 qpair failed and we were unable to recover it. 00:27:46.409 [2024-11-21 03:44:26.876723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.409 [2024-11-21 03:44:26.876826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.409 [2024-11-21 03:44:26.876852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.409 qpair failed and we were unable to recover it. 00:27:46.409 [2024-11-21 03:44:26.876968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.410 [2024-11-21 03:44:26.877135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.410 [2024-11-21 03:44:26.877167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.410 qpair failed and we were unable to recover it. 00:27:46.410 [2024-11-21 03:44:26.877313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.410 [2024-11-21 03:44:26.877427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.410 [2024-11-21 03:44:26.877458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.410 qpair failed and we were unable to recover it. 00:27:46.410 [2024-11-21 03:44:26.877614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.410 [2024-11-21 03:44:26.877738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.410 [2024-11-21 03:44:26.877763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.410 qpair failed and we were unable to recover it. 00:27:46.410 [2024-11-21 03:44:26.877928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.410 [2024-11-21 03:44:26.878060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.410 [2024-11-21 03:44:26.878093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.410 qpair failed and we were unable to recover it. 00:27:46.410 [2024-11-21 03:44:26.878200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.410 [2024-11-21 03:44:26.878294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.410 [2024-11-21 03:44:26.878337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.410 qpair failed and we were unable to recover it. 00:27:46.410 [2024-11-21 03:44:26.878492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.410 [2024-11-21 03:44:26.878599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.410 [2024-11-21 03:44:26.878629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.410 qpair failed and we were unable to recover it. 00:27:46.410 [2024-11-21 03:44:26.878790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.410 [2024-11-21 03:44:26.878894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.410 [2024-11-21 03:44:26.878922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.410 qpair failed and we were unable to recover it. 00:27:46.410 [2024-11-21 03:44:26.879092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.410 [2024-11-21 03:44:26.879196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.410 [2024-11-21 03:44:26.879225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.410 qpair failed and we were unable to recover it. 00:27:46.410 [2024-11-21 03:44:26.879373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.410 [2024-11-21 03:44:26.879475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.410 [2024-11-21 03:44:26.879501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.410 qpair failed and we were unable to recover it. 00:27:46.410 [2024-11-21 03:44:26.879652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.410 [2024-11-21 03:44:26.879799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.410 [2024-11-21 03:44:26.879828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.410 qpair failed and we were unable to recover it. 00:27:46.410 [2024-11-21 03:44:26.879968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.410 [2024-11-21 03:44:26.880119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.410 [2024-11-21 03:44:26.880149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.410 qpair failed and we were unable to recover it. 00:27:46.410 [2024-11-21 03:44:26.880275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.410 [2024-11-21 03:44:26.880385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.410 [2024-11-21 03:44:26.880411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.410 qpair failed and we were unable to recover it. 00:27:46.410 [2024-11-21 03:44:26.880536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.410 [2024-11-21 03:44:26.880682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.410 [2024-11-21 03:44:26.880710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.410 qpair failed and we were unable to recover it. 00:27:46.410 [2024-11-21 03:44:26.880831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.410 [2024-11-21 03:44:26.881008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.410 [2024-11-21 03:44:26.881034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.410 qpair failed and we were unable to recover it. 00:27:46.410 [2024-11-21 03:44:26.881184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.410 [2024-11-21 03:44:26.881316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.410 [2024-11-21 03:44:26.881342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.410 qpair failed and we were unable to recover it. 00:27:46.410 [2024-11-21 03:44:26.881477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.410 [2024-11-21 03:44:26.881645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.410 [2024-11-21 03:44:26.881679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.410 qpair failed and we were unable to recover it. 00:27:46.410 [2024-11-21 03:44:26.881817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.410 [2024-11-21 03:44:26.881934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.410 [2024-11-21 03:44:26.881976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.410 qpair failed and we were unable to recover it. 00:27:46.410 [2024-11-21 03:44:26.882105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.410 [2024-11-21 03:44:26.882210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.410 [2024-11-21 03:44:26.882236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.410 qpair failed and we were unable to recover it. 00:27:46.410 [2024-11-21 03:44:26.882351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.410 [2024-11-21 03:44:26.882523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.410 [2024-11-21 03:44:26.882548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.410 qpair failed and we were unable to recover it. 00:27:46.410 [2024-11-21 03:44:26.882685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.410 [2024-11-21 03:44:26.882851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.410 [2024-11-21 03:44:26.882880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.410 qpair failed and we were unable to recover it. 00:27:46.410 [2024-11-21 03:44:26.883011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.410 [2024-11-21 03:44:26.883167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.410 [2024-11-21 03:44:26.883193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.410 qpair failed and we were unable to recover it. 00:27:46.410 [2024-11-21 03:44:26.883312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.410 [2024-11-21 03:44:26.883429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.410 [2024-11-21 03:44:26.883457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.410 qpair failed and we were unable to recover it. 00:27:46.410 [2024-11-21 03:44:26.883569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.410 [2024-11-21 03:44:26.883721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.410 [2024-11-21 03:44:26.883748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.410 qpair failed and we were unable to recover it. 00:27:46.410 [2024-11-21 03:44:26.883886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.410 [2024-11-21 03:44:26.884016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.410 [2024-11-21 03:44:26.884042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.410 qpair failed and we were unable to recover it. 00:27:46.410 [2024-11-21 03:44:26.884155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.410 [2024-11-21 03:44:26.884257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.410 [2024-11-21 03:44:26.884283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.410 qpair failed and we were unable to recover it. 00:27:46.410 [2024-11-21 03:44:26.884391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.410 [2024-11-21 03:44:26.884581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.410 [2024-11-21 03:44:26.884606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.410 qpair failed and we were unable to recover it. 00:27:46.410 [2024-11-21 03:44:26.884713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.410 [2024-11-21 03:44:26.884874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.410 [2024-11-21 03:44:26.884900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.410 qpair failed and we were unable to recover it. 00:27:46.410 [2024-11-21 03:44:26.885055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.410 [2024-11-21 03:44:26.885187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.410 [2024-11-21 03:44:26.885213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.410 qpair failed and we were unable to recover it. 00:27:46.410 [2024-11-21 03:44:26.885346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.410 [2024-11-21 03:44:26.885438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.410 [2024-11-21 03:44:26.885464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.410 qpair failed and we were unable to recover it. 00:27:46.410 [2024-11-21 03:44:26.885593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.411 [2024-11-21 03:44:26.885723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.411 [2024-11-21 03:44:26.885749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.411 qpair failed and we were unable to recover it. 00:27:46.411 [2024-11-21 03:44:26.885909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.411 [2024-11-21 03:44:26.886056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.411 [2024-11-21 03:44:26.886095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.411 qpair failed and we were unable to recover it. 00:27:46.411 [2024-11-21 03:44:26.886227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.411 [2024-11-21 03:44:26.886371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.411 [2024-11-21 03:44:26.886400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.411 qpair failed and we were unable to recover it. 00:27:46.411 [2024-11-21 03:44:26.886516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.411 [2024-11-21 03:44:26.886642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.411 [2024-11-21 03:44:26.886668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.411 qpair failed and we were unable to recover it. 00:27:46.411 [2024-11-21 03:44:26.886803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.411 [2024-11-21 03:44:26.886909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.411 [2024-11-21 03:44:26.886951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.411 qpair failed and we were unable to recover it. 00:27:46.411 [2024-11-21 03:44:26.887112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.411 [2024-11-21 03:44:26.887255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.411 [2024-11-21 03:44:26.887281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.411 qpair failed and we were unable to recover it. 00:27:46.411 [2024-11-21 03:44:26.887428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.411 [2024-11-21 03:44:26.887541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.411 [2024-11-21 03:44:26.887569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.411 qpair failed and we were unable to recover it. 00:27:46.411 [2024-11-21 03:44:26.887709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.411 [2024-11-21 03:44:26.887844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.411 [2024-11-21 03:44:26.887873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.411 qpair failed and we were unable to recover it. 00:27:46.411 [2024-11-21 03:44:26.888040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.411 [2024-11-21 03:44:26.888165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.411 [2024-11-21 03:44:26.888191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.411 qpair failed and we were unable to recover it. 00:27:46.411 [2024-11-21 03:44:26.888327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.411 [2024-11-21 03:44:26.888480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.411 [2024-11-21 03:44:26.888523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.411 qpair failed and we were unable to recover it. 00:27:46.411 [2024-11-21 03:44:26.888636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.411 [2024-11-21 03:44:26.888803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.411 [2024-11-21 03:44:26.888831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.411 qpair failed and we were unable to recover it. 00:27:46.411 [2024-11-21 03:44:26.888942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.411 [2024-11-21 03:44:26.889050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.411 [2024-11-21 03:44:26.889086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.411 qpair failed and we were unable to recover it. 00:27:46.411 [2024-11-21 03:44:26.889237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.411 [2024-11-21 03:44:26.889342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.411 [2024-11-21 03:44:26.889368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.411 qpair failed and we were unable to recover it. 00:27:46.411 [2024-11-21 03:44:26.889494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.411 [2024-11-21 03:44:26.889602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.411 [2024-11-21 03:44:26.889644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.411 qpair failed and we were unable to recover it. 00:27:46.411 [2024-11-21 03:44:26.889770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.411 [2024-11-21 03:44:26.889924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.411 [2024-11-21 03:44:26.889953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.411 qpair failed and we were unable to recover it. 00:27:46.411 [2024-11-21 03:44:26.890085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.411 [2024-11-21 03:44:26.890211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.411 [2024-11-21 03:44:26.890237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.411 qpair failed and we were unable to recover it. 00:27:46.411 [2024-11-21 03:44:26.890337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.411 [2024-11-21 03:44:26.890459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.411 [2024-11-21 03:44:26.890501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.411 qpair failed and we were unable to recover it. 00:27:46.411 [2024-11-21 03:44:26.890654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.411 [2024-11-21 03:44:26.890777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.411 [2024-11-21 03:44:26.890805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.411 qpair failed and we were unable to recover it. 00:27:46.411 [2024-11-21 03:44:26.890958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.411 [2024-11-21 03:44:26.891099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.411 [2024-11-21 03:44:26.891143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.411 qpair failed and we were unable to recover it. 00:27:46.411 [2024-11-21 03:44:26.891271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.411 [2024-11-21 03:44:26.891405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.411 [2024-11-21 03:44:26.891431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.411 qpair failed and we were unable to recover it. 00:27:46.411 [2024-11-21 03:44:26.891558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.411 [2024-11-21 03:44:26.891678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.411 [2024-11-21 03:44:26.891704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.411 qpair failed and we were unable to recover it. 00:27:46.411 [2024-11-21 03:44:26.891813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.411 [2024-11-21 03:44:26.891940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.411 [2024-11-21 03:44:26.891982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.411 qpair failed and we were unable to recover it. 00:27:46.411 [2024-11-21 03:44:26.892145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.411 [2024-11-21 03:44:26.892255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.411 [2024-11-21 03:44:26.892281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.411 qpair failed and we were unable to recover it. 00:27:46.411 [2024-11-21 03:44:26.892384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.411 [2024-11-21 03:44:26.892532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.411 [2024-11-21 03:44:26.892561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.411 qpair failed and we were unable to recover it. 00:27:46.411 [2024-11-21 03:44:26.892730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.411 [2024-11-21 03:44:26.892898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.411 [2024-11-21 03:44:26.892926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.411 qpair failed and we were unable to recover it. 00:27:46.411 [2024-11-21 03:44:26.893076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.411 [2024-11-21 03:44:26.893201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.411 [2024-11-21 03:44:26.893228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.411 qpair failed and we were unable to recover it. 00:27:46.411 [2024-11-21 03:44:26.893404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.411 [2024-11-21 03:44:26.893546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.411 [2024-11-21 03:44:26.893575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.411 qpair failed and we were unable to recover it. 00:27:46.411 [2024-11-21 03:44:26.893721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.411 [2024-11-21 03:44:26.893869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.411 [2024-11-21 03:44:26.893897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.411 qpair failed and we were unable to recover it. 00:27:46.411 [2024-11-21 03:44:26.894078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.411 [2024-11-21 03:44:26.894226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.411 [2024-11-21 03:44:26.894253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.411 qpair failed and we were unable to recover it. 00:27:46.411 [2024-11-21 03:44:26.894361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.412 [2024-11-21 03:44:26.894514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.412 [2024-11-21 03:44:26.894543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.412 qpair failed and we were unable to recover it. 00:27:46.412 [2024-11-21 03:44:26.894694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.412 [2024-11-21 03:44:26.894837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.412 [2024-11-21 03:44:26.894865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.412 qpair failed and we were unable to recover it. 00:27:46.412 [2024-11-21 03:44:26.894985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.412 [2024-11-21 03:44:26.895114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.412 [2024-11-21 03:44:26.895141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.412 qpair failed and we were unable to recover it. 00:27:46.412 [2024-11-21 03:44:26.895257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.412 [2024-11-21 03:44:26.895390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.412 [2024-11-21 03:44:26.895419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.412 qpair failed and we were unable to recover it. 00:27:46.412 [2024-11-21 03:44:26.895561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.412 [2024-11-21 03:44:26.895695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.412 [2024-11-21 03:44:26.895724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.412 qpair failed and we were unable to recover it. 00:27:46.412 [2024-11-21 03:44:26.895892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.412 [2024-11-21 03:44:26.896030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.412 [2024-11-21 03:44:26.896059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.412 qpair failed and we were unable to recover it. 00:27:46.412 [2024-11-21 03:44:26.896215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.412 [2024-11-21 03:44:26.896353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.412 [2024-11-21 03:44:26.896379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.412 qpair failed and we were unable to recover it. 00:27:46.412 [2024-11-21 03:44:26.896563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.412 [2024-11-21 03:44:26.896694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.412 [2024-11-21 03:44:26.896723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.412 qpair failed and we were unable to recover it. 00:27:46.412 [2024-11-21 03:44:26.896838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.412 [2024-11-21 03:44:26.896973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.412 [2024-11-21 03:44:26.897008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.412 qpair failed and we were unable to recover it. 00:27:46.412 [2024-11-21 03:44:26.897177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.412 [2024-11-21 03:44:26.897285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.412 [2024-11-21 03:44:26.897311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.412 qpair failed and we were unable to recover it. 00:27:46.412 [2024-11-21 03:44:26.897418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.412 [2024-11-21 03:44:26.897679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.412 [2024-11-21 03:44:26.897707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.412 qpair failed and we were unable to recover it. 00:27:46.412 [2024-11-21 03:44:26.897849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.412 [2024-11-21 03:44:26.897998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.412 [2024-11-21 03:44:26.898024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.412 qpair failed and we were unable to recover it. 00:27:46.412 [2024-11-21 03:44:26.898193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.412 [2024-11-21 03:44:26.898294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.412 [2024-11-21 03:44:26.898320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.412 qpair failed and we were unable to recover it. 00:27:46.412 [2024-11-21 03:44:26.898487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.412 [2024-11-21 03:44:26.898654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.412 [2024-11-21 03:44:26.898682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.412 qpair failed and we were unable to recover it. 00:27:46.412 [2024-11-21 03:44:26.898811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.412 [2024-11-21 03:44:26.898933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.412 [2024-11-21 03:44:26.898959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.412 qpair failed and we were unable to recover it. 00:27:46.412 [2024-11-21 03:44:26.899063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.412 [2024-11-21 03:44:26.899188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.412 [2024-11-21 03:44:26.899230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.412 qpair failed and we were unable to recover it. 00:27:46.412 [2024-11-21 03:44:26.899365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.412 [2024-11-21 03:44:26.899481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.412 [2024-11-21 03:44:26.899511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.412 qpair failed and we were unable to recover it. 00:27:46.412 [2024-11-21 03:44:26.899623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.412 [2024-11-21 03:44:26.899791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.412 [2024-11-21 03:44:26.899819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.412 qpair failed and we were unable to recover it. 00:27:46.412 [2024-11-21 03:44:26.899991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.412 [2024-11-21 03:44:26.900106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.412 [2024-11-21 03:44:26.900148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.412 qpair failed and we were unable to recover it. 00:27:46.412 [2024-11-21 03:44:26.900262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.412 [2024-11-21 03:44:26.900367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.412 [2024-11-21 03:44:26.900393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.412 qpair failed and we were unable to recover it. 00:27:46.412 [2024-11-21 03:44:26.900545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.412 [2024-11-21 03:44:26.900680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.412 [2024-11-21 03:44:26.900709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.412 qpair failed and we were unable to recover it. 00:27:46.412 [2024-11-21 03:44:26.900831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.412 [2024-11-21 03:44:26.900999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.412 [2024-11-21 03:44:26.901027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.412 qpair failed and we were unable to recover it. 00:27:46.412 [2024-11-21 03:44:26.901185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.412 [2024-11-21 03:44:26.901315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.412 [2024-11-21 03:44:26.901341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.412 qpair failed and we were unable to recover it. 00:27:46.412 [2024-11-21 03:44:26.901502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.412 [2024-11-21 03:44:26.901639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.412 [2024-11-21 03:44:26.901668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.412 qpair failed and we were unable to recover it. 00:27:46.412 [2024-11-21 03:44:26.901804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.412 [2024-11-21 03:44:26.901920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.412 [2024-11-21 03:44:26.901949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.412 qpair failed and we were unable to recover it. 00:27:46.412 [2024-11-21 03:44:26.902110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.412 [2024-11-21 03:44:26.902207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.412 [2024-11-21 03:44:26.902233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.412 qpair failed and we were unable to recover it. 00:27:46.412 [2024-11-21 03:44:26.902342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.412 [2024-11-21 03:44:26.902464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.412 [2024-11-21 03:44:26.902489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.412 qpair failed and we were unable to recover it. 00:27:46.412 [2024-11-21 03:44:26.902593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.412 [2024-11-21 03:44:26.902722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.412 [2024-11-21 03:44:26.902748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.412 qpair failed and we were unable to recover it. 00:27:46.412 [2024-11-21 03:44:26.902908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.412 [2024-11-21 03:44:26.903120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.412 [2024-11-21 03:44:26.903147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.412 qpair failed and we were unable to recover it. 00:27:46.412 [2024-11-21 03:44:26.903260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.412 [2024-11-21 03:44:26.903443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.413 [2024-11-21 03:44:26.903472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.413 qpair failed and we were unable to recover it. 00:27:46.413 [2024-11-21 03:44:26.903600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.413 [2024-11-21 03:44:26.903697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.413 [2024-11-21 03:44:26.903723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.413 qpair failed and we were unable to recover it. 00:27:46.413 [2024-11-21 03:44:26.903870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.413 [2024-11-21 03:44:26.904039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.413 [2024-11-21 03:44:26.904067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.413 qpair failed and we were unable to recover it. 00:27:46.413 [2024-11-21 03:44:26.904234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.413 [2024-11-21 03:44:26.904371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.413 [2024-11-21 03:44:26.904400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.413 qpair failed and we were unable to recover it. 00:27:46.413 [2024-11-21 03:44:26.904506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.413 [2024-11-21 03:44:26.904675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.413 [2024-11-21 03:44:26.904704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.413 qpair failed and we were unable to recover it. 00:27:46.413 [2024-11-21 03:44:26.904871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.413 [2024-11-21 03:44:26.905013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.413 [2024-11-21 03:44:26.905042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.413 qpair failed and we were unable to recover it. 00:27:46.413 [2024-11-21 03:44:26.905204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.413 [2024-11-21 03:44:26.905298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.413 [2024-11-21 03:44:26.905324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.413 qpair failed and we were unable to recover it. 00:27:46.413 [2024-11-21 03:44:26.905414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.413 [2024-11-21 03:44:26.905570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.413 [2024-11-21 03:44:26.905595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.413 qpair failed and we were unable to recover it. 00:27:46.413 [2024-11-21 03:44:26.905741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.413 [2024-11-21 03:44:26.905910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.413 [2024-11-21 03:44:26.905939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.413 qpair failed and we were unable to recover it. 00:27:46.413 [2024-11-21 03:44:26.906144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.413 [2024-11-21 03:44:26.906304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.413 [2024-11-21 03:44:26.906330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.413 qpair failed and we were unable to recover it. 00:27:46.413 [2024-11-21 03:44:26.906491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.413 [2024-11-21 03:44:26.906596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.413 [2024-11-21 03:44:26.906624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.413 qpair failed and we were unable to recover it. 00:27:46.413 [2024-11-21 03:44:26.906763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.413 [2024-11-21 03:44:26.906875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.413 [2024-11-21 03:44:26.906903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.413 qpair failed and we were unable to recover it. 00:27:46.413 [2024-11-21 03:44:26.907049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.413 [2024-11-21 03:44:26.907193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.413 [2024-11-21 03:44:26.907219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.413 qpair failed and we were unable to recover it. 00:27:46.413 [2024-11-21 03:44:26.907345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.413 [2024-11-21 03:44:26.907503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.413 [2024-11-21 03:44:26.907545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.413 qpair failed and we were unable to recover it. 00:27:46.413 [2024-11-21 03:44:26.907686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.413 [2024-11-21 03:44:26.907795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.413 [2024-11-21 03:44:26.907824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.413 qpair failed and we were unable to recover it. 00:27:46.413 [2024-11-21 03:44:26.907974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.413 [2024-11-21 03:44:26.908155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.413 [2024-11-21 03:44:26.908182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.413 qpair failed and we were unable to recover it. 00:27:46.413 [2024-11-21 03:44:26.908285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.413 [2024-11-21 03:44:26.908446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.413 [2024-11-21 03:44:26.908471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.413 qpair failed and we were unable to recover it. 00:27:46.413 [2024-11-21 03:44:26.908603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.413 [2024-11-21 03:44:26.908763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.413 [2024-11-21 03:44:26.908789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.413 qpair failed and we were unable to recover it. 00:27:46.413 [2024-11-21 03:44:26.908948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.413 [2024-11-21 03:44:26.909091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.413 [2024-11-21 03:44:26.909133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.413 qpair failed and we were unable to recover it. 00:27:46.413 [2024-11-21 03:44:26.909269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.413 [2024-11-21 03:44:26.909387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.413 [2024-11-21 03:44:26.909413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.413 qpair failed and we were unable to recover it. 00:27:46.413 [2024-11-21 03:44:26.909560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.413 [2024-11-21 03:44:26.909705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.413 [2024-11-21 03:44:26.909734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.413 qpair failed and we were unable to recover it. 00:27:46.413 [2024-11-21 03:44:26.909879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.413 [2024-11-21 03:44:26.909977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.413 [2024-11-21 03:44:26.910005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.413 qpair failed and we were unable to recover it. 00:27:46.413 [2024-11-21 03:44:26.910187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.413 [2024-11-21 03:44:26.910282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.413 [2024-11-21 03:44:26.910308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.413 qpair failed and we were unable to recover it. 00:27:46.413 [2024-11-21 03:44:26.910463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.413 [2024-11-21 03:44:26.910601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.413 [2024-11-21 03:44:26.910629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.413 qpair failed and we were unable to recover it. 00:27:46.413 [2024-11-21 03:44:26.910741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.413 [2024-11-21 03:44:26.910909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.413 [2024-11-21 03:44:26.910937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.413 qpair failed and we were unable to recover it. 00:27:46.413 [2024-11-21 03:44:26.911146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.413 [2024-11-21 03:44:26.911281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.413 [2024-11-21 03:44:26.911307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.413 qpair failed and we were unable to recover it. 00:27:46.413 [2024-11-21 03:44:26.911444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.413 [2024-11-21 03:44:26.911602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.413 [2024-11-21 03:44:26.911627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.413 qpair failed and we were unable to recover it. 00:27:46.413 [2024-11-21 03:44:26.911787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.413 [2024-11-21 03:44:26.911938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.413 [2024-11-21 03:44:26.911964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.413 qpair failed and we were unable to recover it. 00:27:46.413 [2024-11-21 03:44:26.912094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.413 [2024-11-21 03:44:26.912247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.413 [2024-11-21 03:44:26.912276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.413 qpair failed and we were unable to recover it. 00:27:46.413 [2024-11-21 03:44:26.912432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.413 [2024-11-21 03:44:26.912586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.414 [2024-11-21 03:44:26.912611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.414 qpair failed and we were unable to recover it. 00:27:46.414 [2024-11-21 03:44:26.912751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.414 [2024-11-21 03:44:26.912890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.414 [2024-11-21 03:44:26.912924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.414 qpair failed and we were unable to recover it. 00:27:46.414 [2024-11-21 03:44:26.913067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.414 [2024-11-21 03:44:26.913220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.414 [2024-11-21 03:44:26.913247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.414 qpair failed and we were unable to recover it. 00:27:46.414 [2024-11-21 03:44:26.913356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.414 [2024-11-21 03:44:26.913484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.414 [2024-11-21 03:44:26.913510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.414 qpair failed and we were unable to recover it. 00:27:46.414 [2024-11-21 03:44:26.913635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.414 [2024-11-21 03:44:26.913776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.414 [2024-11-21 03:44:26.913805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.414 qpair failed and we were unable to recover it. 00:27:46.414 [2024-11-21 03:44:26.913923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.414 [2024-11-21 03:44:26.914054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.414 [2024-11-21 03:44:26.914089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.414 qpair failed and we were unable to recover it. 00:27:46.414 [2024-11-21 03:44:26.914232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.414 [2024-11-21 03:44:26.914329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.414 [2024-11-21 03:44:26.914354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.414 qpair failed and we were unable to recover it. 00:27:46.414 [2024-11-21 03:44:26.914482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.414 [2024-11-21 03:44:26.914611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.414 [2024-11-21 03:44:26.914639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.414 qpair failed and we were unable to recover it. 00:27:46.414 [2024-11-21 03:44:26.914786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.414 [2024-11-21 03:44:26.914962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.414 [2024-11-21 03:44:26.914990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.414 qpair failed and we were unable to recover it. 00:27:46.414 [2024-11-21 03:44:26.915179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.414 [2024-11-21 03:44:26.915313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.414 [2024-11-21 03:44:26.915338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.414 qpair failed and we were unable to recover it. 00:27:46.414 [2024-11-21 03:44:26.915498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.414 [2024-11-21 03:44:26.915646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.414 [2024-11-21 03:44:26.915675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.414 qpair failed and we were unable to recover it. 00:27:46.414 [2024-11-21 03:44:26.915816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.414 [2024-11-21 03:44:26.915986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.414 [2024-11-21 03:44:26.916014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.414 qpair failed and we were unable to recover it. 00:27:46.414 [2024-11-21 03:44:26.916164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.414 [2024-11-21 03:44:26.916289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.414 [2024-11-21 03:44:26.916315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.414 qpair failed and we were unable to recover it. 00:27:46.414 [2024-11-21 03:44:26.916494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.414 [2024-11-21 03:44:26.916658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.414 [2024-11-21 03:44:26.916687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.414 qpair failed and we were unable to recover it. 00:27:46.414 [2024-11-21 03:44:26.916805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.414 [2024-11-21 03:44:26.916941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.414 [2024-11-21 03:44:26.916970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.414 qpair failed and we were unable to recover it. 00:27:46.414 [2024-11-21 03:44:26.917087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.414 [2024-11-21 03:44:26.917236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.414 [2024-11-21 03:44:26.917263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.414 qpair failed and we were unable to recover it. 00:27:46.414 [2024-11-21 03:44:26.917396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.414 [2024-11-21 03:44:26.917502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.414 [2024-11-21 03:44:26.917527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.414 qpair failed and we were unable to recover it. 00:27:46.414 [2024-11-21 03:44:26.917675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.414 [2024-11-21 03:44:26.917816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.414 [2024-11-21 03:44:26.917842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.414 qpair failed and we were unable to recover it. 00:27:46.414 [2024-11-21 03:44:26.918011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.414 [2024-11-21 03:44:26.918166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.414 [2024-11-21 03:44:26.918193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.414 qpair failed and we were unable to recover it. 00:27:46.414 [2024-11-21 03:44:26.918367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.414 [2024-11-21 03:44:26.918529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.414 [2024-11-21 03:44:26.918592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.414 qpair failed and we were unable to recover it. 00:27:46.414 [2024-11-21 03:44:26.918751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.414 [2024-11-21 03:44:26.918884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.414 [2024-11-21 03:44:26.918913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.414 qpair failed and we were unable to recover it. 00:27:46.414 [2024-11-21 03:44:26.919086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.414 [2024-11-21 03:44:26.919203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.414 [2024-11-21 03:44:26.919229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.414 qpair failed and we were unable to recover it. 00:27:46.414 [2024-11-21 03:44:26.919358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.414 [2024-11-21 03:44:26.919486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.414 [2024-11-21 03:44:26.919515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.414 qpair failed and we were unable to recover it. 00:27:46.414 [2024-11-21 03:44:26.919683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.414 [2024-11-21 03:44:26.919842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.414 [2024-11-21 03:44:26.919868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.414 qpair failed and we were unable to recover it. 00:27:46.414 [2024-11-21 03:44:26.920053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.414 [2024-11-21 03:44:26.920214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.414 [2024-11-21 03:44:26.920241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.414 qpair failed and we were unable to recover it. 00:27:46.414 [2024-11-21 03:44:26.920364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.414 [2024-11-21 03:44:26.920533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.414 [2024-11-21 03:44:26.920561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.414 qpair failed and we were unable to recover it. 00:27:46.414 [2024-11-21 03:44:26.920697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.414 [2024-11-21 03:44:26.920829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.415 [2024-11-21 03:44:26.920854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.415 qpair failed and we were unable to recover it. 00:27:46.415 [2024-11-21 03:44:26.920986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.415 [2024-11-21 03:44:26.921114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.415 [2024-11-21 03:44:26.921143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.415 qpair failed and we were unable to recover it. 00:27:46.415 [2024-11-21 03:44:26.921325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.415 [2024-11-21 03:44:26.921480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.415 [2024-11-21 03:44:26.921506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.415 qpair failed and we were unable to recover it. 00:27:46.415 [2024-11-21 03:44:26.921664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.415 [2024-11-21 03:44:26.921851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.415 [2024-11-21 03:44:26.921877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.415 qpair failed and we were unable to recover it. 00:27:46.415 [2024-11-21 03:44:26.922062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.415 [2024-11-21 03:44:26.922211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.415 [2024-11-21 03:44:26.922237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.415 qpair failed and we were unable to recover it. 00:27:46.415 [2024-11-21 03:44:26.922396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.415 [2024-11-21 03:44:26.922569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.415 [2024-11-21 03:44:26.922630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.415 qpair failed and we were unable to recover it. 00:27:46.415 [2024-11-21 03:44:26.922786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.415 [2024-11-21 03:44:26.922885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.415 [2024-11-21 03:44:26.922912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.415 qpair failed and we were unable to recover it. 00:27:46.415 [2024-11-21 03:44:26.923082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.415 [2024-11-21 03:44:26.923205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.415 [2024-11-21 03:44:26.923231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.415 qpair failed and we were unable to recover it. 00:27:46.415 [2024-11-21 03:44:26.923412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.415 [2024-11-21 03:44:26.923550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.415 [2024-11-21 03:44:26.923579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.415 qpair failed and we were unable to recover it. 00:27:46.415 [2024-11-21 03:44:26.923745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.415 [2024-11-21 03:44:26.923882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.415 [2024-11-21 03:44:26.923911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.415 qpair failed and we were unable to recover it. 00:27:46.415 [2024-11-21 03:44:26.924062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.415 [2024-11-21 03:44:26.924168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.415 [2024-11-21 03:44:26.924194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.415 qpair failed and we were unable to recover it. 00:27:46.415 [2024-11-21 03:44:26.924296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.415 [2024-11-21 03:44:26.924423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.415 [2024-11-21 03:44:26.924448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.415 qpair failed and we were unable to recover it. 00:27:46.415 [2024-11-21 03:44:26.924594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.415 [2024-11-21 03:44:26.924731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.415 [2024-11-21 03:44:26.924759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.415 qpair failed and we were unable to recover it. 00:27:46.415 [2024-11-21 03:44:26.924858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.415 [2024-11-21 03:44:26.925038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.415 [2024-11-21 03:44:26.925064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.415 qpair failed and we were unable to recover it. 00:27:46.415 [2024-11-21 03:44:26.925180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.415 [2024-11-21 03:44:26.925302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.415 [2024-11-21 03:44:26.925327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.415 qpair failed and we were unable to recover it. 00:27:46.415 [2024-11-21 03:44:26.925461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.415 [2024-11-21 03:44:26.925637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.415 [2024-11-21 03:44:26.925665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.415 qpair failed and we were unable to recover it. 00:27:46.415 [2024-11-21 03:44:26.925815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.415 [2024-11-21 03:44:26.925957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.415 [2024-11-21 03:44:26.925987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.415 qpair failed and we were unable to recover it. 00:27:46.415 [2024-11-21 03:44:26.926145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.415 [2024-11-21 03:44:26.926276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.415 [2024-11-21 03:44:26.926302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.415 qpair failed and we were unable to recover it. 00:27:46.415 [2024-11-21 03:44:26.926408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.415 [2024-11-21 03:44:26.926527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.415 [2024-11-21 03:44:26.926552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.415 qpair failed and we were unable to recover it. 00:27:46.415 [2024-11-21 03:44:26.926670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.415 [2024-11-21 03:44:26.926782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.415 [2024-11-21 03:44:26.926811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.415 qpair failed and we were unable to recover it. 00:27:46.415 [2024-11-21 03:44:26.926958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.415 [2024-11-21 03:44:26.927144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.415 [2024-11-21 03:44:26.927170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.415 qpair failed and we were unable to recover it. 00:27:46.415 [2024-11-21 03:44:26.927305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.415 [2024-11-21 03:44:26.927406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.415 [2024-11-21 03:44:26.927432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.415 qpair failed and we were unable to recover it. 00:27:46.415 [2024-11-21 03:44:26.927546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.415 [2024-11-21 03:44:26.927711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.415 [2024-11-21 03:44:26.927740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.415 qpair failed and we were unable to recover it. 00:27:46.415 [2024-11-21 03:44:26.927908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.415 [2024-11-21 03:44:26.928049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.415 [2024-11-21 03:44:26.928084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.415 qpair failed and we were unable to recover it. 00:27:46.415 [2024-11-21 03:44:26.928228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.415 [2024-11-21 03:44:26.928325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.415 [2024-11-21 03:44:26.928368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.415 qpair failed and we were unable to recover it. 00:27:46.415 [2024-11-21 03:44:26.928517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.415 [2024-11-21 03:44:26.928662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.415 [2024-11-21 03:44:26.928693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.415 qpair failed and we were unable to recover it. 00:27:46.415 [2024-11-21 03:44:26.928864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.415 [2024-11-21 03:44:26.928996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.415 [2024-11-21 03:44:26.929027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.415 qpair failed and we were unable to recover it. 00:27:46.415 [2024-11-21 03:44:26.929165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.415 [2024-11-21 03:44:26.929275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.415 [2024-11-21 03:44:26.929301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.415 qpair failed and we were unable to recover it. 00:27:46.415 [2024-11-21 03:44:26.929412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.415 [2024-11-21 03:44:26.929566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.415 [2024-11-21 03:44:26.929592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.415 qpair failed and we were unable to recover it. 00:27:46.416 [2024-11-21 03:44:26.929751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.416 [2024-11-21 03:44:26.929876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.416 [2024-11-21 03:44:26.929906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.416 qpair failed and we were unable to recover it. 00:27:46.416 [2024-11-21 03:44:26.930081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.416 [2024-11-21 03:44:26.930221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.416 [2024-11-21 03:44:26.930247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.416 qpair failed and we were unable to recover it. 00:27:46.416 [2024-11-21 03:44:26.930366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.416 [2024-11-21 03:44:26.930501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.416 [2024-11-21 03:44:26.930529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.416 qpair failed and we were unable to recover it. 00:27:46.416 [2024-11-21 03:44:26.930701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.416 [2024-11-21 03:44:26.930832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.416 [2024-11-21 03:44:26.930861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.416 qpair failed and we were unable to recover it. 00:27:46.416 [2024-11-21 03:44:26.931007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.416 [2024-11-21 03:44:26.931179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.416 [2024-11-21 03:44:26.931210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.416 qpair failed and we were unable to recover it. 00:27:46.416 [2024-11-21 03:44:26.931364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.416 [2024-11-21 03:44:26.931530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.416 [2024-11-21 03:44:26.931573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.416 qpair failed and we were unable to recover it. 00:27:46.416 [2024-11-21 03:44:26.931757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.416 [2024-11-21 03:44:26.931886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.416 [2024-11-21 03:44:26.931912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.416 qpair failed and we were unable to recover it. 00:27:46.416 [2024-11-21 03:44:26.932084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.416 [2024-11-21 03:44:26.932208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.416 [2024-11-21 03:44:26.932238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.416 qpair failed and we were unable to recover it. 00:27:46.416 [2024-11-21 03:44:26.932390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.416 [2024-11-21 03:44:26.932528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.416 [2024-11-21 03:44:26.932557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.416 qpair failed and we were unable to recover it. 00:27:46.416 [2024-11-21 03:44:26.932700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.416 [2024-11-21 03:44:26.932870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.416 [2024-11-21 03:44:26.932899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.416 qpair failed and we were unable to recover it. 00:27:46.416 [2024-11-21 03:44:26.933075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.416 [2024-11-21 03:44:26.933225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.416 [2024-11-21 03:44:26.933251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.416 qpair failed and we were unable to recover it. 00:27:46.416 [2024-11-21 03:44:26.933362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.416 [2024-11-21 03:44:26.933519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.416 [2024-11-21 03:44:26.933545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.416 qpair failed and we were unable to recover it. 00:27:46.416 [2024-11-21 03:44:26.933715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.416 [2024-11-21 03:44:26.933888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.416 [2024-11-21 03:44:26.933914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.416 qpair failed and we were unable to recover it. 00:27:46.416 [2024-11-21 03:44:26.934100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.416 [2024-11-21 03:44:26.934219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.416 [2024-11-21 03:44:26.934245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.416 qpair failed and we were unable to recover it. 00:27:46.416 [2024-11-21 03:44:26.934430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.416 [2024-11-21 03:44:26.934598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.416 [2024-11-21 03:44:26.934624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.416 qpair failed and we were unable to recover it. 00:27:46.416 [2024-11-21 03:44:26.934778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.416 [2024-11-21 03:44:26.934893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.416 [2024-11-21 03:44:26.934921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.416 qpair failed and we were unable to recover it. 00:27:46.416 [2024-11-21 03:44:26.935092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.416 [2024-11-21 03:44:26.935246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.416 [2024-11-21 03:44:26.935272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.416 qpair failed and we were unable to recover it. 00:27:46.416 [2024-11-21 03:44:26.935376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.416 [2024-11-21 03:44:26.935505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.416 [2024-11-21 03:44:26.935531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.416 qpair failed and we were unable to recover it. 00:27:46.416 [2024-11-21 03:44:26.935662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.416 [2024-11-21 03:44:26.935832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.416 [2024-11-21 03:44:26.935858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.416 qpair failed and we were unable to recover it. 00:27:46.416 [2024-11-21 03:44:26.935979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.416 [2024-11-21 03:44:26.936140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.416 [2024-11-21 03:44:26.936167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.416 qpair failed and we were unable to recover it. 00:27:46.416 [2024-11-21 03:44:26.936303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.416 [2024-11-21 03:44:26.936417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.416 [2024-11-21 03:44:26.936446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.416 qpair failed and we were unable to recover it. 00:27:46.416 [2024-11-21 03:44:26.936547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.416 [2024-11-21 03:44:26.936706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.416 [2024-11-21 03:44:26.936732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.416 qpair failed and we were unable to recover it. 00:27:46.416 [2024-11-21 03:44:26.936893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.416 [2024-11-21 03:44:26.936997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.416 [2024-11-21 03:44:26.937026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.416 qpair failed and we were unable to recover it. 00:27:46.416 [2024-11-21 03:44:26.937173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.416 [2024-11-21 03:44:26.937309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.416 [2024-11-21 03:44:26.937335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.416 qpair failed and we were unable to recover it. 00:27:46.416 [2024-11-21 03:44:26.937452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.416 [2024-11-21 03:44:26.937598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.416 [2024-11-21 03:44:26.937623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.416 qpair failed and we were unable to recover it. 00:27:46.416 [2024-11-21 03:44:26.937746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.416 [2024-11-21 03:44:26.937877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.416 [2024-11-21 03:44:26.937903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.416 qpair failed and we were unable to recover it. 00:27:46.416 [2024-11-21 03:44:26.938048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.416 [2024-11-21 03:44:26.938185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.416 [2024-11-21 03:44:26.938211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.416 qpair failed and we were unable to recover it. 00:27:46.416 [2024-11-21 03:44:26.938320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.416 [2024-11-21 03:44:26.938470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.416 [2024-11-21 03:44:26.938499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.416 qpair failed and we were unable to recover it. 00:27:46.417 [2024-11-21 03:44:26.938623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.417 [2024-11-21 03:44:26.938761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.417 [2024-11-21 03:44:26.938789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.417 qpair failed and we were unable to recover it. 00:27:46.417 [2024-11-21 03:44:26.938927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.417 [2024-11-21 03:44:26.939034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.417 [2024-11-21 03:44:26.939062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.417 qpair failed and we were unable to recover it. 00:27:46.417 [2024-11-21 03:44:26.939221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.417 [2024-11-21 03:44:26.939323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.417 [2024-11-21 03:44:26.939365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.417 qpair failed and we were unable to recover it. 00:27:46.417 [2024-11-21 03:44:26.939536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.417 [2024-11-21 03:44:26.939677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.417 [2024-11-21 03:44:26.939706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.417 qpair failed and we were unable to recover it. 00:27:46.417 [2024-11-21 03:44:26.939817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.417 [2024-11-21 03:44:26.939961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.417 [2024-11-21 03:44:26.939989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.417 qpair failed and we were unable to recover it. 00:27:46.417 [2024-11-21 03:44:26.940171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.417 [2024-11-21 03:44:26.940301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.417 [2024-11-21 03:44:26.940327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.417 qpair failed and we were unable to recover it. 00:27:46.417 [2024-11-21 03:44:26.940482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.417 [2024-11-21 03:44:26.940623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.417 [2024-11-21 03:44:26.940664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.417 qpair failed and we were unable to recover it. 00:27:46.417 [2024-11-21 03:44:26.940842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.417 [2024-11-21 03:44:26.940983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.417 [2024-11-21 03:44:26.941011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.417 qpair failed and we were unable to recover it. 00:27:46.417 [2024-11-21 03:44:26.941169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.417 [2024-11-21 03:44:26.941322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.417 [2024-11-21 03:44:26.941364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.417 qpair failed and we were unable to recover it. 00:27:46.417 [2024-11-21 03:44:26.941519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.417 [2024-11-21 03:44:26.941676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.417 [2024-11-21 03:44:26.941719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.417 qpair failed and we were unable to recover it. 00:27:46.417 [2024-11-21 03:44:26.941892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.417 [2024-11-21 03:44:26.942075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.417 [2024-11-21 03:44:26.942105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.417 qpair failed and we were unable to recover it. 00:27:46.417 [2024-11-21 03:44:26.942280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.417 [2024-11-21 03:44:26.942382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.417 [2024-11-21 03:44:26.942408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.417 qpair failed and we were unable to recover it. 00:27:46.417 [2024-11-21 03:44:26.942529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.417 [2024-11-21 03:44:26.942674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.417 [2024-11-21 03:44:26.942702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.417 qpair failed and we were unable to recover it. 00:27:46.417 [2024-11-21 03:44:26.942852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.417 [2024-11-21 03:44:26.942979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.417 [2024-11-21 03:44:26.943004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.417 qpair failed and we were unable to recover it. 00:27:46.417 [2024-11-21 03:44:26.943165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.417 [2024-11-21 03:44:26.943286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.417 [2024-11-21 03:44:26.943316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.417 qpair failed and we were unable to recover it. 00:27:46.417 [2024-11-21 03:44:26.943467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.417 [2024-11-21 03:44:26.943602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.417 [2024-11-21 03:44:26.943645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.417 qpair failed and we were unable to recover it. 00:27:46.417 [2024-11-21 03:44:26.943778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.417 [2024-11-21 03:44:26.943880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.417 [2024-11-21 03:44:26.943906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.417 qpair failed and we were unable to recover it. 00:27:46.417 [2024-11-21 03:44:26.944044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.417 [2024-11-21 03:44:26.944171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.417 [2024-11-21 03:44:26.944198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.417 qpair failed and we were unable to recover it. 00:27:46.417 [2024-11-21 03:44:26.944335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.417 [2024-11-21 03:44:26.944477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.417 [2024-11-21 03:44:26.944505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.417 qpair failed and we were unable to recover it. 00:27:46.417 [2024-11-21 03:44:26.944624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.417 [2024-11-21 03:44:26.944733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.417 [2024-11-21 03:44:26.944762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.417 qpair failed and we were unable to recover it. 00:27:46.417 [2024-11-21 03:44:26.944919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.417 [2024-11-21 03:44:26.945081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.417 [2024-11-21 03:44:26.945109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.417 qpair failed and we were unable to recover it. 00:27:46.417 [2024-11-21 03:44:26.945241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.417 [2024-11-21 03:44:26.945396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.417 [2024-11-21 03:44:26.945421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.417 qpair failed and we were unable to recover it. 00:27:46.417 [2024-11-21 03:44:26.945580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.417 [2024-11-21 03:44:26.945682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.417 [2024-11-21 03:44:26.945711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.417 qpair failed and we were unable to recover it. 00:27:46.417 [2024-11-21 03:44:26.945876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.417 [2024-11-21 03:44:26.946021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.417 [2024-11-21 03:44:26.946049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.417 qpair failed and we were unable to recover it. 00:27:46.417 [2024-11-21 03:44:26.946233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.417 [2024-11-21 03:44:26.946360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.417 [2024-11-21 03:44:26.946401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.417 qpair failed and we were unable to recover it. 00:27:46.417 [2024-11-21 03:44:26.946551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.417 [2024-11-21 03:44:26.946672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.417 [2024-11-21 03:44:26.946697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.417 qpair failed and we were unable to recover it. 00:27:46.417 [2024-11-21 03:44:26.946868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.417 [2024-11-21 03:44:26.947004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.417 [2024-11-21 03:44:26.947032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.417 qpair failed and we were unable to recover it. 00:27:46.417 [2024-11-21 03:44:26.947206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.417 [2024-11-21 03:44:26.947312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.417 [2024-11-21 03:44:26.947341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.417 qpair failed and we were unable to recover it. 00:27:46.417 [2024-11-21 03:44:26.947513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.417 [2024-11-21 03:44:26.947698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.418 [2024-11-21 03:44:26.947724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.418 qpair failed and we were unable to recover it. 00:27:46.418 [2024-11-21 03:44:26.947853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.418 [2024-11-21 03:44:26.948042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.418 [2024-11-21 03:44:26.948078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.418 qpair failed and we were unable to recover it. 00:27:46.418 [2024-11-21 03:44:26.948230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.418 [2024-11-21 03:44:26.948329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.418 [2024-11-21 03:44:26.948378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.418 qpair failed and we were unable to recover it. 00:27:46.418 [2024-11-21 03:44:26.948520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.418 [2024-11-21 03:44:26.948662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.418 [2024-11-21 03:44:26.948691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.418 qpair failed and we were unable to recover it. 00:27:46.418 [2024-11-21 03:44:26.948837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.418 [2024-11-21 03:44:26.948984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.418 [2024-11-21 03:44:26.949010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.418 qpair failed and we were unable to recover it. 00:27:46.418 [2024-11-21 03:44:26.949220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.418 [2024-11-21 03:44:26.949400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.418 [2024-11-21 03:44:26.949428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.418 qpair failed and we were unable to recover it. 00:27:46.418 [2024-11-21 03:44:26.949602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.418 [2024-11-21 03:44:26.949706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.418 [2024-11-21 03:44:26.949734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.418 qpair failed and we were unable to recover it. 00:27:46.418 [2024-11-21 03:44:26.949870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.418 [2024-11-21 03:44:26.950005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.418 [2024-11-21 03:44:26.950034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.418 qpair failed and we were unable to recover it. 00:27:46.418 [2024-11-21 03:44:26.950169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.418 [2024-11-21 03:44:26.950328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.418 [2024-11-21 03:44:26.950354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.418 qpair failed and we were unable to recover it. 00:27:46.418 [2024-11-21 03:44:26.950491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.418 [2024-11-21 03:44:26.950616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.418 [2024-11-21 03:44:26.950642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.418 qpair failed and we were unable to recover it. 00:27:46.418 [2024-11-21 03:44:26.950740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.418 [2024-11-21 03:44:26.950867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.418 [2024-11-21 03:44:26.950893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.418 qpair failed and we were unable to recover it. 00:27:46.418 [2024-11-21 03:44:26.951042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.418 [2024-11-21 03:44:26.951210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.418 [2024-11-21 03:44:26.951239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.418 qpair failed and we were unable to recover it. 00:27:46.418 [2024-11-21 03:44:26.951388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.418 [2024-11-21 03:44:26.951527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.418 [2024-11-21 03:44:26.951555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.418 qpair failed and we were unable to recover it. 00:27:46.418 [2024-11-21 03:44:26.951722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.418 [2024-11-21 03:44:26.951878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.418 [2024-11-21 03:44:26.951904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.418 qpair failed and we were unable to recover it. 00:27:46.418 [2024-11-21 03:44:26.952056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.418 [2024-11-21 03:44:26.952212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.418 [2024-11-21 03:44:26.952241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.418 qpair failed and we were unable to recover it. 00:27:46.418 [2024-11-21 03:44:26.952390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.418 [2024-11-21 03:44:26.952503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.418 [2024-11-21 03:44:26.952532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.418 qpair failed and we were unable to recover it. 00:27:46.418 [2024-11-21 03:44:26.952677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.418 [2024-11-21 03:44:26.952788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.418 [2024-11-21 03:44:26.952816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.418 qpair failed and we were unable to recover it. 00:27:46.418 [2024-11-21 03:44:26.952996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.418 [2024-11-21 03:44:26.953122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.418 [2024-11-21 03:44:26.953166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.418 qpair failed and we were unable to recover it. 00:27:46.418 [2024-11-21 03:44:26.953302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.418 [2024-11-21 03:44:26.953406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.418 [2024-11-21 03:44:26.953434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.418 qpair failed and we were unable to recover it. 00:27:46.418 [2024-11-21 03:44:26.953604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.418 [2024-11-21 03:44:26.953758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.418 [2024-11-21 03:44:26.953784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.418 qpair failed and we were unable to recover it. 00:27:46.418 [2024-11-21 03:44:26.953875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.418 [2024-11-21 03:44:26.953974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.418 [2024-11-21 03:44:26.954000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.418 qpair failed and we were unable to recover it. 00:27:46.418 [2024-11-21 03:44:26.954159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.418 [2024-11-21 03:44:26.954325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.418 [2024-11-21 03:44:26.954354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.418 qpair failed and we were unable to recover it. 00:27:46.418 [2024-11-21 03:44:26.954468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.418 [2024-11-21 03:44:26.954642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.418 [2024-11-21 03:44:26.954669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.418 qpair failed and we were unable to recover it. 00:27:46.418 [2024-11-21 03:44:26.954858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.418 [2024-11-21 03:44:26.954985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.418 [2024-11-21 03:44:26.955012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.418 qpair failed and we were unable to recover it. 00:27:46.418 [2024-11-21 03:44:26.955173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.418 [2024-11-21 03:44:26.955271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.418 [2024-11-21 03:44:26.955297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.418 qpair failed and we were unable to recover it. 00:27:46.418 [2024-11-21 03:44:26.955423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.418 [2024-11-21 03:44:26.955557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.418 [2024-11-21 03:44:26.955583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.418 qpair failed and we were unable to recover it. 00:27:46.418 [2024-11-21 03:44:26.955772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.418 [2024-11-21 03:44:26.955908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.419 [2024-11-21 03:44:26.955934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.419 qpair failed and we were unable to recover it. 00:27:46.419 [2024-11-21 03:44:26.956539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.419 [2024-11-21 03:44:26.956724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.419 [2024-11-21 03:44:26.956751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.419 qpair failed and we were unable to recover it. 00:27:46.419 [2024-11-21 03:44:26.956884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.419 [2024-11-21 03:44:26.957067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.419 [2024-11-21 03:44:26.957112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.419 qpair failed and we were unable to recover it. 00:27:46.419 [2024-11-21 03:44:26.957244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.419 [2024-11-21 03:44:26.957381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.419 [2024-11-21 03:44:26.957407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.419 qpair failed and we were unable to recover it. 00:27:46.419 [2024-11-21 03:44:26.957508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.419 [2024-11-21 03:44:26.957617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.419 [2024-11-21 03:44:26.957643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.419 qpair failed and we were unable to recover it. 00:27:46.419 [2024-11-21 03:44:26.957790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.419 [2024-11-21 03:44:26.957968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.419 [2024-11-21 03:44:26.957994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.419 qpair failed and we were unable to recover it. 00:27:46.419 [2024-11-21 03:44:26.958160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.419 [2024-11-21 03:44:26.958319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.419 [2024-11-21 03:44:26.958348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.419 qpair failed and we were unable to recover it. 00:27:46.419 [2024-11-21 03:44:26.958527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.419 [2024-11-21 03:44:26.958653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.419 [2024-11-21 03:44:26.958680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.419 qpair failed and we were unable to recover it. 00:27:46.419 [2024-11-21 03:44:26.958835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.419 [2024-11-21 03:44:26.959008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.419 [2024-11-21 03:44:26.959037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.419 qpair failed and we were unable to recover it. 00:27:46.419 [2024-11-21 03:44:26.959186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.419 [2024-11-21 03:44:26.959299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.419 [2024-11-21 03:44:26.959328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.419 qpair failed and we were unable to recover it. 00:27:46.419 [2024-11-21 03:44:26.959479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.419 [2024-11-21 03:44:26.959635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.419 [2024-11-21 03:44:26.959661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.419 qpair failed and we were unable to recover it. 00:27:46.419 [2024-11-21 03:44:26.959812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.419 [2024-11-21 03:44:26.959979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.419 [2024-11-21 03:44:26.960007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.419 qpair failed and we were unable to recover it. 00:27:46.419 [2024-11-21 03:44:26.960165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.419 [2024-11-21 03:44:26.960260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.419 [2024-11-21 03:44:26.960286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.419 qpair failed and we were unable to recover it. 00:27:46.419 [2024-11-21 03:44:26.960403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.419 [2024-11-21 03:44:26.960519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.419 [2024-11-21 03:44:26.960548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.419 qpair failed and we were unable to recover it. 00:27:46.419 [2024-11-21 03:44:26.960694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.419 [2024-11-21 03:44:26.960838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.419 [2024-11-21 03:44:26.960867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.419 qpair failed and we were unable to recover it. 00:27:46.419 [2024-11-21 03:44:26.961081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.419 [2024-11-21 03:44:26.961223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.419 [2024-11-21 03:44:26.961250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.419 qpair failed and we were unable to recover it. 00:27:46.419 [2024-11-21 03:44:26.961422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.419 [2024-11-21 03:44:26.961563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.419 [2024-11-21 03:44:26.961592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.419 qpair failed and we were unable to recover it. 00:27:46.419 [2024-11-21 03:44:26.961732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.419 [2024-11-21 03:44:26.961903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.419 [2024-11-21 03:44:26.961932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.419 qpair failed and we were unable to recover it. 00:27:46.419 [2024-11-21 03:44:26.962124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.419 [2024-11-21 03:44:26.962255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.419 [2024-11-21 03:44:26.962282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.419 qpair failed and we were unable to recover it. 00:27:46.419 [2024-11-21 03:44:26.962441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.419 [2024-11-21 03:44:26.962578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.419 [2024-11-21 03:44:26.962603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.419 qpair failed and we were unable to recover it. 00:27:46.419 [2024-11-21 03:44:26.962710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.419 [2024-11-21 03:44:26.962813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.419 [2024-11-21 03:44:26.962838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.419 qpair failed and we were unable to recover it. 00:27:46.419 [2024-11-21 03:44:26.963013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.419 [2024-11-21 03:44:26.963142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.419 [2024-11-21 03:44:26.963173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.419 qpair failed and we were unable to recover it. 00:27:46.419 [2024-11-21 03:44:26.963344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.419 [2024-11-21 03:44:26.963563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.419 [2024-11-21 03:44:26.963617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.419 qpair failed and we were unable to recover it. 00:27:46.419 [2024-11-21 03:44:26.963792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.419 [2024-11-21 03:44:26.963923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.419 [2024-11-21 03:44:26.963965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.419 qpair failed and we were unable to recover it. 00:27:46.419 [2024-11-21 03:44:26.964150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.419 [2024-11-21 03:44:26.964285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.419 [2024-11-21 03:44:26.964311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.419 qpair failed and we were unable to recover it. 00:27:46.419 [2024-11-21 03:44:26.964413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.419 [2024-11-21 03:44:26.964573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.419 [2024-11-21 03:44:26.964599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.419 qpair failed and we were unable to recover it. 00:27:46.420 [2024-11-21 03:44:26.964751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.420 [2024-11-21 03:44:26.964885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.420 [2024-11-21 03:44:26.964913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.420 qpair failed and we were unable to recover it. 00:27:46.420 [2024-11-21 03:44:26.965059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.420 [2024-11-21 03:44:26.965165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.420 [2024-11-21 03:44:26.965196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.420 qpair failed and we were unable to recover it. 00:27:46.420 [2024-11-21 03:44:26.965322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.420 [2024-11-21 03:44:26.965457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.420 [2024-11-21 03:44:26.965485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.420 qpair failed and we were unable to recover it. 00:27:46.420 [2024-11-21 03:44:26.965626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.420 [2024-11-21 03:44:26.965739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.420 [2024-11-21 03:44:26.965765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.420 qpair failed and we were unable to recover it. 00:27:46.420 [2024-11-21 03:44:26.965923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.420 [2024-11-21 03:44:26.966060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.420 [2024-11-21 03:44:26.966096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.420 qpair failed and we were unable to recover it. 00:27:46.420 [2024-11-21 03:44:26.966264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.420 [2024-11-21 03:44:26.966398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.420 [2024-11-21 03:44:26.966425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.420 qpair failed and we were unable to recover it. 00:27:46.420 [2024-11-21 03:44:26.966525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.420 [2024-11-21 03:44:26.966676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.420 [2024-11-21 03:44:26.966705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.420 qpair failed and we were unable to recover it. 00:27:46.420 [2024-11-21 03:44:26.966875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.420 [2024-11-21 03:44:26.967014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.420 [2024-11-21 03:44:26.967042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.420 qpair failed and we were unable to recover it. 00:27:46.420 [2024-11-21 03:44:26.967206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.420 [2024-11-21 03:44:26.967332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.420 [2024-11-21 03:44:26.967358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.420 qpair failed and we were unable to recover it. 00:27:46.420 [2024-11-21 03:44:26.967523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.420 [2024-11-21 03:44:26.967648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.420 [2024-11-21 03:44:26.967673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.420 qpair failed and we were unable to recover it. 00:27:46.420 [2024-11-21 03:44:26.967802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.420 [2024-11-21 03:44:26.967919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.420 [2024-11-21 03:44:26.967947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.420 qpair failed and we were unable to recover it. 00:27:46.420 [2024-11-21 03:44:26.968104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.420 [2024-11-21 03:44:26.968249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.420 [2024-11-21 03:44:26.968275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.420 qpair failed and we were unable to recover it. 00:27:46.420 [2024-11-21 03:44:26.968431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.420 [2024-11-21 03:44:26.968575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.420 [2024-11-21 03:44:26.968603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.420 qpair failed and we were unable to recover it. 00:27:46.420 [2024-11-21 03:44:26.968759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.420 [2024-11-21 03:44:26.968863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.420 [2024-11-21 03:44:26.968889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.420 qpair failed and we were unable to recover it. 00:27:46.420 [2024-11-21 03:44:26.969042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.420 [2024-11-21 03:44:26.969203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.420 [2024-11-21 03:44:26.969229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.420 qpair failed and we were unable to recover it. 00:27:46.420 [2024-11-21 03:44:26.969329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.420 [2024-11-21 03:44:26.969484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.420 [2024-11-21 03:44:26.969510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.420 qpair failed and we were unable to recover it. 00:27:46.420 [2024-11-21 03:44:26.969766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.420 [2024-11-21 03:44:26.969963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.420 [2024-11-21 03:44:26.969989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.420 qpair failed and we were unable to recover it. 00:27:46.420 [2024-11-21 03:44:26.970144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.420 [2024-11-21 03:44:26.970284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.420 [2024-11-21 03:44:26.970310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.420 qpair failed and we were unable to recover it. 00:27:46.420 [2024-11-21 03:44:26.970451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.420 [2024-11-21 03:44:26.970581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.420 [2024-11-21 03:44:26.970607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.420 qpair failed and we were unable to recover it. 00:27:46.420 [2024-11-21 03:44:26.970740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.420 [2024-11-21 03:44:26.970879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.420 [2024-11-21 03:44:26.970905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.420 qpair failed and we were unable to recover it. 00:27:46.420 [2024-11-21 03:44:26.971089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.420 [2024-11-21 03:44:26.971214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.420 [2024-11-21 03:44:26.971243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.420 qpair failed and we were unable to recover it. 00:27:46.420 [2024-11-21 03:44:26.971395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.420 [2024-11-21 03:44:26.971552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.420 [2024-11-21 03:44:26.971578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.420 qpair failed and we were unable to recover it. 00:27:46.420 [2024-11-21 03:44:26.971739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.420 [2024-11-21 03:44:26.971908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.420 [2024-11-21 03:44:26.971936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.420 qpair failed and we were unable to recover it. 00:27:46.420 [2024-11-21 03:44:26.972110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.420 [2024-11-21 03:44:26.972243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.420 [2024-11-21 03:44:26.972269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.420 qpair failed and we were unable to recover it. 00:27:46.420 [2024-11-21 03:44:26.972429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.420 [2024-11-21 03:44:26.972608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.420 [2024-11-21 03:44:26.972638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.420 qpair failed and we were unable to recover it. 00:27:46.420 [2024-11-21 03:44:26.972766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.420 [2024-11-21 03:44:26.972869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.420 [2024-11-21 03:44:26.972895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.420 qpair failed and we were unable to recover it. 00:27:46.420 [2024-11-21 03:44:26.972990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.420 [2024-11-21 03:44:26.973136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.420 [2024-11-21 03:44:26.973166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.420 qpair failed and we were unable to recover it. 00:27:46.420 [2024-11-21 03:44:26.973288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.420 [2024-11-21 03:44:26.973402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.420 [2024-11-21 03:44:26.973444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.420 qpair failed and we were unable to recover it. 00:27:46.420 [2024-11-21 03:44:26.973552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.420 [2024-11-21 03:44:26.973708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.420 [2024-11-21 03:44:26.973734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.420 qpair failed and we were unable to recover it. 00:27:46.420 [2024-11-21 03:44:26.973865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.421 [2024-11-21 03:44:26.973969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.421 [2024-11-21 03:44:26.973995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.421 qpair failed and we were unable to recover it. 00:27:46.421 [2024-11-21 03:44:26.974106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.421 [2024-11-21 03:44:26.974248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.421 [2024-11-21 03:44:26.974277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.421 qpair failed and we were unable to recover it. 00:27:46.421 [2024-11-21 03:44:26.974423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.421 [2024-11-21 03:44:26.974542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.421 [2024-11-21 03:44:26.974570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.421 qpair failed and we were unable to recover it. 00:27:46.421 [2024-11-21 03:44:26.974722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.421 [2024-11-21 03:44:26.974859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.421 [2024-11-21 03:44:26.974888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.421 qpair failed and we were unable to recover it. 00:27:46.421 [2024-11-21 03:44:26.975043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.421 [2024-11-21 03:44:26.975221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.421 [2024-11-21 03:44:26.975250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.421 qpair failed and we were unable to recover it. 00:27:46.421 [2024-11-21 03:44:26.975427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.421 [2024-11-21 03:44:26.975558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.421 [2024-11-21 03:44:26.975584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.421 qpair failed and we were unable to recover it. 00:27:46.421 [2024-11-21 03:44:26.975766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.421 [2024-11-21 03:44:26.975919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.421 [2024-11-21 03:44:26.975948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.421 qpair failed and we were unable to recover it. 00:27:46.421 [2024-11-21 03:44:26.976104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.421 [2024-11-21 03:44:26.976250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.421 [2024-11-21 03:44:26.976279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.421 qpair failed and we were unable to recover it. 00:27:46.421 [2024-11-21 03:44:26.976458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.421 [2024-11-21 03:44:26.976589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.421 [2024-11-21 03:44:26.976615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.421 qpair failed and we were unable to recover it. 00:27:46.421 [2024-11-21 03:44:26.976719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.421 [2024-11-21 03:44:26.976893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.421 [2024-11-21 03:44:26.976921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.421 qpair failed and we were unable to recover it. 00:27:46.421 [2024-11-21 03:44:26.977080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.421 [2024-11-21 03:44:26.977233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.421 [2024-11-21 03:44:26.977259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.421 qpair failed and we were unable to recover it. 00:27:46.421 [2024-11-21 03:44:26.977422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.421 [2024-11-21 03:44:26.977556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.421 [2024-11-21 03:44:26.977585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.421 qpair failed and we were unable to recover it. 00:27:46.421 [2024-11-21 03:44:26.977743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.421 [2024-11-21 03:44:26.977898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.421 [2024-11-21 03:44:26.977924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.421 qpair failed and we were unable to recover it. 00:27:46.421 [2024-11-21 03:44:26.978090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.421 [2024-11-21 03:44:26.978237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.421 [2024-11-21 03:44:26.978266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.421 qpair failed and we were unable to recover it. 00:27:46.421 [2024-11-21 03:44:26.978384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.421 [2024-11-21 03:44:26.978534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.421 [2024-11-21 03:44:26.978560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.421 qpair failed and we were unable to recover it. 00:27:46.421 [2024-11-21 03:44:26.978717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.421 [2024-11-21 03:44:26.978843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.421 [2024-11-21 03:44:26.978870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.421 qpair failed and we were unable to recover it. 00:27:46.421 [2024-11-21 03:44:26.979002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.421 [2024-11-21 03:44:26.979134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.421 [2024-11-21 03:44:26.979161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.421 qpair failed and we were unable to recover it. 00:27:46.421 [2024-11-21 03:44:26.979302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.421 [2024-11-21 03:44:26.979453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.421 [2024-11-21 03:44:26.979482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.421 qpair failed and we were unable to recover it. 00:27:46.421 [2024-11-21 03:44:26.979597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.421 [2024-11-21 03:44:26.979710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.421 [2024-11-21 03:44:26.979738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.421 qpair failed and we were unable to recover it. 00:27:46.421 [2024-11-21 03:44:26.979874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.421 [2024-11-21 03:44:26.979983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.421 [2024-11-21 03:44:26.980011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.421 qpair failed and we were unable to recover it. 00:27:46.421 [2024-11-21 03:44:26.980139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.421 [2024-11-21 03:44:26.980265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.421 [2024-11-21 03:44:26.980291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.421 qpair failed and we were unable to recover it. 00:27:46.421 [2024-11-21 03:44:26.980485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.421 [2024-11-21 03:44:26.980641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.421 [2024-11-21 03:44:26.980667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.421 qpair failed and we were unable to recover it. 00:27:46.421 [2024-11-21 03:44:26.980766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.421 [2024-11-21 03:44:26.980871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.421 [2024-11-21 03:44:26.980899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.421 qpair failed and we were unable to recover it. 00:27:46.421 [2024-11-21 03:44:26.981033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.421 [2024-11-21 03:44:26.981196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.421 [2024-11-21 03:44:26.981228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.421 qpair failed and we were unable to recover it. 00:27:46.421 [2024-11-21 03:44:26.981366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.421 [2024-11-21 03:44:26.981532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.421 [2024-11-21 03:44:26.981558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.421 qpair failed and we were unable to recover it. 00:27:46.421 [2024-11-21 03:44:26.981680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.421 [2024-11-21 03:44:26.981849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.421 [2024-11-21 03:44:26.981878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.421 qpair failed and we were unable to recover it. 00:27:46.421 [2024-11-21 03:44:26.982018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.421 [2024-11-21 03:44:26.982129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.421 [2024-11-21 03:44:26.982158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.421 qpair failed and we were unable to recover it. 00:27:46.421 [2024-11-21 03:44:26.982299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.421 [2024-11-21 03:44:26.982416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.421 [2024-11-21 03:44:26.982442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.421 qpair failed and we were unable to recover it. 00:27:46.421 [2024-11-21 03:44:26.982597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.421 [2024-11-21 03:44:26.982717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.421 [2024-11-21 03:44:26.982743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.421 qpair failed and we were unable to recover it. 00:27:46.421 [2024-11-21 03:44:26.982905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.422 [2024-11-21 03:44:26.983013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.422 [2024-11-21 03:44:26.983042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.422 qpair failed and we were unable to recover it. 00:27:46.422 [2024-11-21 03:44:26.983198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.422 [2024-11-21 03:44:26.983321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.422 [2024-11-21 03:44:26.983348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.422 qpair failed and we were unable to recover it. 00:27:46.422 [2024-11-21 03:44:26.983489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.422 [2024-11-21 03:44:26.983596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.422 [2024-11-21 03:44:26.983624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.422 qpair failed and we were unable to recover it. 00:27:46.422 [2024-11-21 03:44:26.983802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.422 [2024-11-21 03:44:26.983913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.422 [2024-11-21 03:44:26.983943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.422 qpair failed and we were unable to recover it. 00:27:46.422 [2024-11-21 03:44:26.984144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.422 [2024-11-21 03:44:26.984281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.422 [2024-11-21 03:44:26.984307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.422 qpair failed and we were unable to recover it. 00:27:46.422 [2024-11-21 03:44:26.984447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.422 [2024-11-21 03:44:26.984598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.422 [2024-11-21 03:44:26.984623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.422 qpair failed and we were unable to recover it. 00:27:46.422 [2024-11-21 03:44:26.984748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.422 [2024-11-21 03:44:26.984875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.422 [2024-11-21 03:44:26.984903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.422 qpair failed and we were unable to recover it. 00:27:46.422 [2024-11-21 03:44:26.985047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.422 [2024-11-21 03:44:26.985204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.422 [2024-11-21 03:44:26.985231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.422 qpair failed and we were unable to recover it. 00:27:46.422 [2024-11-21 03:44:26.985440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.422 [2024-11-21 03:44:26.985573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.422 [2024-11-21 03:44:26.985599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.422 qpair failed and we were unable to recover it. 00:27:46.422 [2024-11-21 03:44:26.985699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.422 [2024-11-21 03:44:26.985822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.422 [2024-11-21 03:44:26.985848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.422 qpair failed and we were unable to recover it. 00:27:46.422 [2024-11-21 03:44:26.985978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.422 [2024-11-21 03:44:26.986133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.422 [2024-11-21 03:44:26.986162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.422 qpair failed and we were unable to recover it. 00:27:46.422 [2024-11-21 03:44:26.986299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.422 [2024-11-21 03:44:26.986445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.422 [2024-11-21 03:44:26.986471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.422 qpair failed and we were unable to recover it. 00:27:46.422 [2024-11-21 03:44:26.986625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.422 [2024-11-21 03:44:26.986784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.422 [2024-11-21 03:44:26.986810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.422 qpair failed and we were unable to recover it. 00:27:46.422 [2024-11-21 03:44:26.986940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.422 [2024-11-21 03:44:26.987082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.422 [2024-11-21 03:44:26.987109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.422 qpair failed and we were unable to recover it. 00:27:46.422 [2024-11-21 03:44:26.987279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.422 [2024-11-21 03:44:26.987419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.422 [2024-11-21 03:44:26.987445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.422 qpair failed and we were unable to recover it. 00:27:46.422 [2024-11-21 03:44:26.987556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.422 [2024-11-21 03:44:26.987653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.422 [2024-11-21 03:44:26.987678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.422 qpair failed and we were unable to recover it. 00:27:46.422 [2024-11-21 03:44:26.988518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.422 [2024-11-21 03:44:26.988711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.422 [2024-11-21 03:44:26.988741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.422 qpair failed and we were unable to recover it. 00:27:46.422 [2024-11-21 03:44:26.989700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.422 [2024-11-21 03:44:26.989896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.422 [2024-11-21 03:44:26.989926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.422 qpair failed and we were unable to recover it. 00:27:46.422 [2024-11-21 03:44:26.990048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.422 [2024-11-21 03:44:26.990207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.422 [2024-11-21 03:44:26.990234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.422 qpair failed and we were unable to recover it. 00:27:46.422 [2024-11-21 03:44:26.990368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.422 [2024-11-21 03:44:26.990482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.422 [2024-11-21 03:44:26.990508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.422 qpair failed and we were unable to recover it. 00:27:46.422 [2024-11-21 03:44:26.990628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.422 [2024-11-21 03:44:26.990740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.422 [2024-11-21 03:44:26.990768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.422 qpair failed and we were unable to recover it. 00:27:46.422 [2024-11-21 03:44:26.990873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.422 [2024-11-21 03:44:26.991003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.422 [2024-11-21 03:44:26.991029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.422 qpair failed and we were unable to recover it. 00:27:46.422 [2024-11-21 03:44:26.991165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.422 [2024-11-21 03:44:26.991273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.422 [2024-11-21 03:44:26.991299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.422 qpair failed and we were unable to recover it. 00:27:46.422 [2024-11-21 03:44:26.991427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.422 [2024-11-21 03:44:26.991558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.422 [2024-11-21 03:44:26.991584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.422 qpair failed and we were unable to recover it. 00:27:46.422 [2024-11-21 03:44:26.991723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.422 [2024-11-21 03:44:26.991854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.422 [2024-11-21 03:44:26.991880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.422 qpair failed and we were unable to recover it. 00:27:46.422 [2024-11-21 03:44:26.991981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.422 [2024-11-21 03:44:26.992114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.422 [2024-11-21 03:44:26.992141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.422 qpair failed and we were unable to recover it. 00:27:46.422 [2024-11-21 03:44:26.992291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.422 [2024-11-21 03:44:26.992453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.422 [2024-11-21 03:44:26.992478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.422 qpair failed and we were unable to recover it. 00:27:46.422 [2024-11-21 03:44:26.992611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.422 [2024-11-21 03:44:26.992787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.422 [2024-11-21 03:44:26.992816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.422 qpair failed and we were unable to recover it. 00:27:46.422 [2024-11-21 03:44:26.992972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.422 [2024-11-21 03:44:26.993081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.422 [2024-11-21 03:44:26.993108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.422 qpair failed and we were unable to recover it. 00:27:46.423 [2024-11-21 03:44:26.993217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.423 [2024-11-21 03:44:26.993349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.423 [2024-11-21 03:44:26.993375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.423 qpair failed and we were unable to recover it. 00:27:46.423 [2024-11-21 03:44:26.993517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.423 [2024-11-21 03:44:26.993658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.423 [2024-11-21 03:44:26.993687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.423 qpair failed and we were unable to recover it. 00:27:46.423 [2024-11-21 03:44:26.994588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.423 [2024-11-21 03:44:26.994741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.423 [2024-11-21 03:44:26.994771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.423 qpair failed and we were unable to recover it. 00:27:46.423 [2024-11-21 03:44:26.995631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.423 [2024-11-21 03:44:26.995826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.423 [2024-11-21 03:44:26.995854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.423 qpair failed and we were unable to recover it. 00:27:46.423 [2024-11-21 03:44:26.995996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.423 [2024-11-21 03:44:26.996155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.423 [2024-11-21 03:44:26.996182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.423 qpair failed and we were unable to recover it. 00:27:46.423 [2024-11-21 03:44:26.996291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.423 [2024-11-21 03:44:26.996454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.423 [2024-11-21 03:44:26.996480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.423 qpair failed and we were unable to recover it. 00:27:46.423 [2024-11-21 03:44:26.996619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.423 [2024-11-21 03:44:26.996780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.423 [2024-11-21 03:44:26.996809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.423 qpair failed and we were unable to recover it. 00:27:46.423 [2024-11-21 03:44:26.996956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.423 [2024-11-21 03:44:26.997084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.423 [2024-11-21 03:44:26.997111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.423 qpair failed and we were unable to recover it. 00:27:46.423 [2024-11-21 03:44:26.997216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.423 [2024-11-21 03:44:26.997319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.423 [2024-11-21 03:44:26.997345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.423 qpair failed and we were unable to recover it. 00:27:46.423 [2024-11-21 03:44:26.997481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.423 [2024-11-21 03:44:26.997601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.423 [2024-11-21 03:44:26.997630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.423 qpair failed and we were unable to recover it. 00:27:46.423 [2024-11-21 03:44:26.997770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.423 [2024-11-21 03:44:26.997898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.423 [2024-11-21 03:44:26.997927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.423 qpair failed and we were unable to recover it. 00:27:46.423 [2024-11-21 03:44:26.998080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.423 [2024-11-21 03:44:26.998189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.423 [2024-11-21 03:44:26.998215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.423 qpair failed and we were unable to recover it. 00:27:46.423 [2024-11-21 03:44:26.998367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.423 [2024-11-21 03:44:26.998564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.423 [2024-11-21 03:44:26.998593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.423 qpair failed and we were unable to recover it. 00:27:46.423 [2024-11-21 03:44:26.998740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.423 [2024-11-21 03:44:26.998890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.423 [2024-11-21 03:44:26.998918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.423 qpair failed and we were unable to recover it. 00:27:46.423 [2024-11-21 03:44:26.999061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.423 [2024-11-21 03:44:26.999174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.423 [2024-11-21 03:44:26.999199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.423 qpair failed and we were unable to recover it. 00:27:46.423 [2024-11-21 03:44:26.999321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.423 [2024-11-21 03:44:26.999460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.423 [2024-11-21 03:44:26.999488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.423 qpair failed and we were unable to recover it. 00:27:46.423 [2024-11-21 03:44:26.999595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.423 [2024-11-21 03:44:26.999735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.423 [2024-11-21 03:44:26.999768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.423 qpair failed and we were unable to recover it. 00:27:46.423 [2024-11-21 03:44:26.999905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.423 [2024-11-21 03:44:27.000026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.423 [2024-11-21 03:44:27.000055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.423 qpair failed and we were unable to recover it. 00:27:46.423 [2024-11-21 03:44:27.000191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.423 [2024-11-21 03:44:27.000316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.423 [2024-11-21 03:44:27.000342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.423 qpair failed and we were unable to recover it. 00:27:46.423 [2024-11-21 03:44:27.000535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.423 [2024-11-21 03:44:27.000679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.423 [2024-11-21 03:44:27.000708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.423 qpair failed and we were unable to recover it. 00:27:46.423 [2024-11-21 03:44:27.000842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.423 [2024-11-21 03:44:27.000984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.423 [2024-11-21 03:44:27.001013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.423 qpair failed and we were unable to recover it. 00:27:46.423 [2024-11-21 03:44:27.001180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.423 [2024-11-21 03:44:27.001276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.423 [2024-11-21 03:44:27.001302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.423 qpair failed and we were unable to recover it. 00:27:46.423 [2024-11-21 03:44:27.001401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.423 [2024-11-21 03:44:27.001501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.423 [2024-11-21 03:44:27.001527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.423 qpair failed and we were unable to recover it. 00:27:46.423 [2024-11-21 03:44:27.001714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.423 [2024-11-21 03:44:27.001867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.423 [2024-11-21 03:44:27.001896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.423 qpair failed and we were unable to recover it. 00:27:46.423 [2024-11-21 03:44:27.002039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.423 [2024-11-21 03:44:27.002196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.423 [2024-11-21 03:44:27.002223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.423 qpair failed and we were unable to recover it. 00:27:46.423 [2024-11-21 03:44:27.002334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.423 [2024-11-21 03:44:27.002488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.423 [2024-11-21 03:44:27.002517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.423 qpair failed and we were unable to recover it. 00:27:46.423 [2024-11-21 03:44:27.002658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.423 [2024-11-21 03:44:27.002795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.424 [2024-11-21 03:44:27.002828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.424 qpair failed and we were unable to recover it. 00:27:46.424 [2024-11-21 03:44:27.002974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.424 [2024-11-21 03:44:27.003118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.424 [2024-11-21 03:44:27.003145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.424 qpair failed and we were unable to recover it. 00:27:46.424 [2024-11-21 03:44:27.003283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.424 [2024-11-21 03:44:27.003447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.424 [2024-11-21 03:44:27.003478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.424 qpair failed and we were unable to recover it. 00:27:46.424 [2024-11-21 03:44:27.003615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.424 [2024-11-21 03:44:27.003803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.424 [2024-11-21 03:44:27.003831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.424 qpair failed and we were unable to recover it. 00:27:46.424 [2024-11-21 03:44:27.003978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.424 [2024-11-21 03:44:27.004119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.424 [2024-11-21 03:44:27.004145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.424 qpair failed and we were unable to recover it. 00:27:46.424 [2024-11-21 03:44:27.004269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.424 [2024-11-21 03:44:27.004377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.424 [2024-11-21 03:44:27.004403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.424 qpair failed and we were unable to recover it. 00:27:46.424 [2024-11-21 03:44:27.004539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.424 [2024-11-21 03:44:27.004678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.424 [2024-11-21 03:44:27.004706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.424 qpair failed and we were unable to recover it. 00:27:46.424 [2024-11-21 03:44:27.004893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.424 [2024-11-21 03:44:27.005040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.424 [2024-11-21 03:44:27.005078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.424 qpair failed and we were unable to recover it. 00:27:46.704 [2024-11-21 03:44:27.005212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.704 [2024-11-21 03:44:27.005986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.704 [2024-11-21 03:44:27.006020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.704 qpair failed and we were unable to recover it. 00:27:46.704 [2024-11-21 03:44:27.006172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.704 [2024-11-21 03:44:27.006883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.704 [2024-11-21 03:44:27.006915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.704 qpair failed and we were unable to recover it. 00:27:46.704 [2024-11-21 03:44:27.007133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.704 [2024-11-21 03:44:27.007245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.704 [2024-11-21 03:44:27.007272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.704 qpair failed and we were unable to recover it. 00:27:46.704 [2024-11-21 03:44:27.007441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.704 [2024-11-21 03:44:27.007599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.704 [2024-11-21 03:44:27.007627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.704 qpair failed and we were unable to recover it. 00:27:46.704 [2024-11-21 03:44:27.007797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.704 [2024-11-21 03:44:27.007958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.704 [2024-11-21 03:44:27.007983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.704 qpair failed and we were unable to recover it. 00:27:46.704 [2024-11-21 03:44:27.008092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.704 [2024-11-21 03:44:27.008203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.704 [2024-11-21 03:44:27.008229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.704 qpair failed and we were unable to recover it. 00:27:46.704 [2024-11-21 03:44:27.008324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.704 [2024-11-21 03:44:27.008537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.704 [2024-11-21 03:44:27.008565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.704 qpair failed and we were unable to recover it. 00:27:46.704 [2024-11-21 03:44:27.008681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.704 [2024-11-21 03:44:27.008815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.704 [2024-11-21 03:44:27.008843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.704 qpair failed and we were unable to recover it. 00:27:46.704 [2024-11-21 03:44:27.008956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.704 [2024-11-21 03:44:27.009049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.704 [2024-11-21 03:44:27.009080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.704 qpair failed and we were unable to recover it. 00:27:46.705 [2024-11-21 03:44:27.009216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.705 [2024-11-21 03:44:27.009313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.705 [2024-11-21 03:44:27.009338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.705 qpair failed and we were unable to recover it. 00:27:46.705 [2024-11-21 03:44:27.009441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.705 [2024-11-21 03:44:27.009551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.705 [2024-11-21 03:44:27.009579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.705 qpair failed and we were unable to recover it. 00:27:46.705 [2024-11-21 03:44:27.009768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.705 [2024-11-21 03:44:27.009940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.705 [2024-11-21 03:44:27.009968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.705 qpair failed and we were unable to recover it. 00:27:46.705 [2024-11-21 03:44:27.010098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.705 [2024-11-21 03:44:27.010230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.705 [2024-11-21 03:44:27.010256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.705 qpair failed and we were unable to recover it. 00:27:46.705 [2024-11-21 03:44:27.010410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.705 [2024-11-21 03:44:27.010523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.705 [2024-11-21 03:44:27.010560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.705 qpair failed and we were unable to recover it. 00:27:46.705 [2024-11-21 03:44:27.010712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.705 [2024-11-21 03:44:27.010842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.705 [2024-11-21 03:44:27.010885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.705 qpair failed and we were unable to recover it. 00:27:46.705 [2024-11-21 03:44:27.011026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.705 [2024-11-21 03:44:27.011181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.705 [2024-11-21 03:44:27.011207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.705 qpair failed and we were unable to recover it. 00:27:46.705 [2024-11-21 03:44:27.011333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.705 [2024-11-21 03:44:27.011433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.705 [2024-11-21 03:44:27.011458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.705 qpair failed and we were unable to recover it. 00:27:46.705 [2024-11-21 03:44:27.011618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.705 [2024-11-21 03:44:27.011762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.705 [2024-11-21 03:44:27.011789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.705 qpair failed and we were unable to recover it. 00:27:46.705 [2024-11-21 03:44:27.011951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.705 [2024-11-21 03:44:27.012045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.705 [2024-11-21 03:44:27.012091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.705 qpair failed and we were unable to recover it. 00:27:46.705 [2024-11-21 03:44:27.012232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.705 [2024-11-21 03:44:27.012385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.705 [2024-11-21 03:44:27.012413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.705 qpair failed and we were unable to recover it. 00:27:46.705 [2024-11-21 03:44:27.012532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.705 [2024-11-21 03:44:27.012680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.705 [2024-11-21 03:44:27.012722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.705 qpair failed and we were unable to recover it. 00:27:46.705 [2024-11-21 03:44:27.012859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.705 [2024-11-21 03:44:27.012991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.705 [2024-11-21 03:44:27.013019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.705 qpair failed and we were unable to recover it. 00:27:46.705 [2024-11-21 03:44:27.013149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.705 [2024-11-21 03:44:27.013249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.705 [2024-11-21 03:44:27.013275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.705 qpair failed and we were unable to recover it. 00:27:46.705 [2024-11-21 03:44:27.013471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.705 [2024-11-21 03:44:27.013581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.705 [2024-11-21 03:44:27.013610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.705 qpair failed and we were unable to recover it. 00:27:46.705 [2024-11-21 03:44:27.013808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.705 [2024-11-21 03:44:27.013968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.705 [2024-11-21 03:44:27.013996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.705 qpair failed and we were unable to recover it. 00:27:46.705 [2024-11-21 03:44:27.014148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.705 [2024-11-21 03:44:27.014282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.705 [2024-11-21 03:44:27.014307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.705 qpair failed and we were unable to recover it. 00:27:46.705 [2024-11-21 03:44:27.014467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.705 [2024-11-21 03:44:27.014663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.705 [2024-11-21 03:44:27.014692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.705 qpair failed and we were unable to recover it. 00:27:46.705 [2024-11-21 03:44:27.014873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.705 [2024-11-21 03:44:27.014970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.705 [2024-11-21 03:44:27.014998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.705 qpair failed and we were unable to recover it. 00:27:46.705 [2024-11-21 03:44:27.015147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.705 [2024-11-21 03:44:27.015280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.705 [2024-11-21 03:44:27.015305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.705 qpair failed and we were unable to recover it. 00:27:46.705 [2024-11-21 03:44:27.015455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.705 [2024-11-21 03:44:27.015596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.705 [2024-11-21 03:44:27.015624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.705 qpair failed and we were unable to recover it. 00:27:46.705 [2024-11-21 03:44:27.015754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.705 [2024-11-21 03:44:27.015932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.705 [2024-11-21 03:44:27.015959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.705 qpair failed and we were unable to recover it. 00:27:46.705 [2024-11-21 03:44:27.016122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.705 [2024-11-21 03:44:27.016218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.705 [2024-11-21 03:44:27.016243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.705 qpair failed and we were unable to recover it. 00:27:46.705 [2024-11-21 03:44:27.016358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.705 [2024-11-21 03:44:27.016480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.705 [2024-11-21 03:44:27.016513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.705 qpair failed and we were unable to recover it. 00:27:46.705 [2024-11-21 03:44:27.016659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.705 [2024-11-21 03:44:27.016766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.705 [2024-11-21 03:44:27.016794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.705 qpair failed and we were unable to recover it. 00:27:46.705 [2024-11-21 03:44:27.016938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.705 [2024-11-21 03:44:27.017098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.705 [2024-11-21 03:44:27.017124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.705 qpair failed and we were unable to recover it. 00:27:46.705 [2024-11-21 03:44:27.017229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.705 [2024-11-21 03:44:27.017356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.705 [2024-11-21 03:44:27.017381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.705 qpair failed and we were unable to recover it. 00:27:46.705 [2024-11-21 03:44:27.017500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.705 [2024-11-21 03:44:27.017675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.705 [2024-11-21 03:44:27.017704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.705 qpair failed and we were unable to recover it. 00:27:46.705 [2024-11-21 03:44:27.017833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.705 [2024-11-21 03:44:27.017979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.705 [2024-11-21 03:44:27.018004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.705 qpair failed and we were unable to recover it. 00:27:46.706 [2024-11-21 03:44:27.018144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.706 [2024-11-21 03:44:27.018272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.706 [2024-11-21 03:44:27.018297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.706 qpair failed and we were unable to recover it. 00:27:46.706 [2024-11-21 03:44:27.018427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.706 [2024-11-21 03:44:27.018584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.706 [2024-11-21 03:44:27.018612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.706 qpair failed and we were unable to recover it. 00:27:46.706 [2024-11-21 03:44:27.018732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.706 [2024-11-21 03:44:27.018911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.706 [2024-11-21 03:44:27.018939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.706 qpair failed and we were unable to recover it. 00:27:46.706 [2024-11-21 03:44:27.019084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.706 [2024-11-21 03:44:27.019193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.706 [2024-11-21 03:44:27.019217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.706 qpair failed and we were unable to recover it. 00:27:46.706 [2024-11-21 03:44:27.019376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.706 [2024-11-21 03:44:27.019536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.706 [2024-11-21 03:44:27.019564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.706 qpair failed and we were unable to recover it. 00:27:46.706 [2024-11-21 03:44:27.019710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.706 [2024-11-21 03:44:27.019819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.706 [2024-11-21 03:44:27.019851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.706 qpair failed and we were unable to recover it. 00:27:46.706 [2024-11-21 03:44:27.019972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.706 [2024-11-21 03:44:27.020064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.706 [2024-11-21 03:44:27.020098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.706 qpair failed and we were unable to recover it. 00:27:46.706 [2024-11-21 03:44:27.020230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.706 [2024-11-21 03:44:27.020388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.706 [2024-11-21 03:44:27.020416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.706 qpair failed and we were unable to recover it. 00:27:46.706 [2024-11-21 03:44:27.020535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.706 [2024-11-21 03:44:27.020640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.706 [2024-11-21 03:44:27.020668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.706 qpair failed and we were unable to recover it. 00:27:46.706 [2024-11-21 03:44:27.020780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.706 [2024-11-21 03:44:27.020915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.706 [2024-11-21 03:44:27.020954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.706 qpair failed and we were unable to recover it. 00:27:46.706 [2024-11-21 03:44:27.021145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.706 [2024-11-21 03:44:27.021297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.706 [2024-11-21 03:44:27.021322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.706 qpair failed and we were unable to recover it. 00:27:46.706 [2024-11-21 03:44:27.021456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.706 [2024-11-21 03:44:27.021675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.706 [2024-11-21 03:44:27.021703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.706 qpair failed and we were unable to recover it. 00:27:46.706 [2024-11-21 03:44:27.021847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.706 [2024-11-21 03:44:27.021991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.706 [2024-11-21 03:44:27.022018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.706 qpair failed and we were unable to recover it. 00:27:46.706 [2024-11-21 03:44:27.022153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.706 [2024-11-21 03:44:27.022310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.706 [2024-11-21 03:44:27.022336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.706 qpair failed and we were unable to recover it. 00:27:46.706 [2024-11-21 03:44:27.022468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.706 [2024-11-21 03:44:27.022592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.706 [2024-11-21 03:44:27.022618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.706 qpair failed and we were unable to recover it. 00:27:46.706 [2024-11-21 03:44:27.022804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.706 [2024-11-21 03:44:27.022986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.706 [2024-11-21 03:44:27.023014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.706 qpair failed and we were unable to recover it. 00:27:46.706 [2024-11-21 03:44:27.023159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.706 [2024-11-21 03:44:27.023299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.706 [2024-11-21 03:44:27.023325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.706 qpair failed and we were unable to recover it. 00:27:46.706 [2024-11-21 03:44:27.023477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.706 [2024-11-21 03:44:27.023622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.706 [2024-11-21 03:44:27.023650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.706 qpair failed and we were unable to recover it. 00:27:46.706 [2024-11-21 03:44:27.023823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.706 [2024-11-21 03:44:27.023933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.706 [2024-11-21 03:44:27.023961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.706 qpair failed and we were unable to recover it. 00:27:46.706 [2024-11-21 03:44:27.024137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.706 [2024-11-21 03:44:27.024239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.706 [2024-11-21 03:44:27.024265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.706 qpair failed and we were unable to recover it. 00:27:46.706 [2024-11-21 03:44:27.025035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.706 [2024-11-21 03:44:27.025232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.706 [2024-11-21 03:44:27.025259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.706 qpair failed and we were unable to recover it. 00:27:46.706 [2024-11-21 03:44:27.025376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.706 [2024-11-21 03:44:27.025527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.706 [2024-11-21 03:44:27.025556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.706 qpair failed and we were unable to recover it. 00:27:46.706 [2024-11-21 03:44:27.025734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.706 [2024-11-21 03:44:27.025925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.706 [2024-11-21 03:44:27.025953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.706 qpair failed and we were unable to recover it. 00:27:46.706 [2024-11-21 03:44:27.026106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.706 [2024-11-21 03:44:27.026260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.706 [2024-11-21 03:44:27.026288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.706 qpair failed and we were unable to recover it. 00:27:46.706 [2024-11-21 03:44:27.026467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.706 [2024-11-21 03:44:27.026606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.706 [2024-11-21 03:44:27.026631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.706 qpair failed and we were unable to recover it. 00:27:46.706 [2024-11-21 03:44:27.026768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.706 [2024-11-21 03:44:27.026923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.706 [2024-11-21 03:44:27.026948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.706 qpair failed and we were unable to recover it. 00:27:46.706 [2024-11-21 03:44:27.027064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.706 [2024-11-21 03:44:27.027205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.706 [2024-11-21 03:44:27.027233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.706 qpair failed and we were unable to recover it. 00:27:46.706 [2024-11-21 03:44:27.027340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.706 [2024-11-21 03:44:27.027491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.706 [2024-11-21 03:44:27.027519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.706 qpair failed and we were unable to recover it. 00:27:46.706 [2024-11-21 03:44:27.027641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.706 [2024-11-21 03:44:27.027768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.706 [2024-11-21 03:44:27.027794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.706 qpair failed and we were unable to recover it. 00:27:46.707 [2024-11-21 03:44:27.027901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.707 [2024-11-21 03:44:27.028030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.707 [2024-11-21 03:44:27.028055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.707 qpair failed and we were unable to recover it. 00:27:46.707 [2024-11-21 03:44:27.028230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.707 [2024-11-21 03:44:27.028348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.707 [2024-11-21 03:44:27.028404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.707 qpair failed and we were unable to recover it. 00:27:46.707 [2024-11-21 03:44:27.028606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.707 [2024-11-21 03:44:27.028759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.707 [2024-11-21 03:44:27.028784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.707 qpair failed and we were unable to recover it. 00:27:46.707 [2024-11-21 03:44:27.028926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.707 [2024-11-21 03:44:27.029022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.707 [2024-11-21 03:44:27.029047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.707 qpair failed and we were unable to recover it. 00:27:46.707 [2024-11-21 03:44:27.029189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.707 [2024-11-21 03:44:27.029294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.707 [2024-11-21 03:44:27.029322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.707 qpair failed and we were unable to recover it. 00:27:46.707 [2024-11-21 03:44:27.029465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.707 [2024-11-21 03:44:27.029605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.707 [2024-11-21 03:44:27.029633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.707 qpair failed and we were unable to recover it. 00:27:46.707 [2024-11-21 03:44:27.029756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.707 [2024-11-21 03:44:27.029857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.707 [2024-11-21 03:44:27.029882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.707 qpair failed and we were unable to recover it. 00:27:46.707 [2024-11-21 03:44:27.030037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.707 [2024-11-21 03:44:27.030189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.707 [2024-11-21 03:44:27.030224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:46.707 qpair failed and we were unable to recover it. 00:27:46.707 [2024-11-21 03:44:27.030390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.707 [2024-11-21 03:44:27.030629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.707 [2024-11-21 03:44:27.030659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:46.707 qpair failed and we were unable to recover it. 00:27:46.707 [2024-11-21 03:44:27.030811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.707 [2024-11-21 03:44:27.030913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.707 [2024-11-21 03:44:27.030939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:46.707 qpair failed and we were unable to recover it. 00:27:46.707 [2024-11-21 03:44:27.031042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.707 [2024-11-21 03:44:27.031179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.707 [2024-11-21 03:44:27.031208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:46.707 qpair failed and we were unable to recover it. 00:27:46.707 [2024-11-21 03:44:27.031357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.707 [2024-11-21 03:44:27.031489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.707 [2024-11-21 03:44:27.031518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:46.707 qpair failed and we were unable to recover it. 00:27:46.707 [2024-11-21 03:44:27.031696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.707 [2024-11-21 03:44:27.031798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.707 [2024-11-21 03:44:27.031825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:46.707 qpair failed and we were unable to recover it. 00:27:46.707 [2024-11-21 03:44:27.031958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.707 [2024-11-21 03:44:27.032056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.707 [2024-11-21 03:44:27.032092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:46.707 qpair failed and we were unable to recover it. 00:27:46.707 [2024-11-21 03:44:27.032202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.707 [2024-11-21 03:44:27.032315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.707 [2024-11-21 03:44:27.032340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:46.707 qpair failed and we were unable to recover it. 00:27:46.707 [2024-11-21 03:44:27.032486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.707 [2024-11-21 03:44:27.032614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.707 [2024-11-21 03:44:27.032640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:46.707 qpair failed and we were unable to recover it. 00:27:46.707 [2024-11-21 03:44:27.032769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.707 [2024-11-21 03:44:27.032871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.707 [2024-11-21 03:44:27.032897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:46.707 qpair failed and we were unable to recover it. 00:27:46.707 [2024-11-21 03:44:27.033036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.707 [2024-11-21 03:44:27.033161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.707 [2024-11-21 03:44:27.033188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:46.707 qpair failed and we were unable to recover it. 00:27:46.707 [2024-11-21 03:44:27.033295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.707 [2024-11-21 03:44:27.033424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.707 [2024-11-21 03:44:27.033450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:46.707 qpair failed and we were unable to recover it. 00:27:46.707 [2024-11-21 03:44:27.033558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.707 [2024-11-21 03:44:27.033681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.707 [2024-11-21 03:44:27.033707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:46.707 qpair failed and we were unable to recover it. 00:27:46.707 [2024-11-21 03:44:27.033821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.707 [2024-11-21 03:44:27.033949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.707 [2024-11-21 03:44:27.033975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:46.707 qpair failed and we were unable to recover it. 00:27:46.707 [2024-11-21 03:44:27.034086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.707 [2024-11-21 03:44:27.034193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.707 [2024-11-21 03:44:27.034218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:46.707 qpair failed and we were unable to recover it. 00:27:46.707 [2024-11-21 03:44:27.034330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.707 [2024-11-21 03:44:27.034483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.707 [2024-11-21 03:44:27.034509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:46.707 qpair failed and we were unable to recover it. 00:27:46.707 [2024-11-21 03:44:27.034607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.707 [2024-11-21 03:44:27.034735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.707 [2024-11-21 03:44:27.034762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:46.707 qpair failed and we were unable to recover it. 00:27:46.707 [2024-11-21 03:44:27.034882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.707 [2024-11-21 03:44:27.035010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.707 [2024-11-21 03:44:27.035036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:46.707 qpair failed and we were unable to recover it. 00:27:46.707 [2024-11-21 03:44:27.035180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.707 [2024-11-21 03:44:27.035325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.707 [2024-11-21 03:44:27.035372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.707 qpair failed and we were unable to recover it. 00:27:46.707 [2024-11-21 03:44:27.035542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.707 [2024-11-21 03:44:27.035709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.707 [2024-11-21 03:44:27.035736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.707 qpair failed and we were unable to recover it. 00:27:46.707 [2024-11-21 03:44:27.035885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.707 [2024-11-21 03:44:27.036023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.707 [2024-11-21 03:44:27.036049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.707 qpair failed and we were unable to recover it. 00:27:46.707 [2024-11-21 03:44:27.036188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.707 [2024-11-21 03:44:27.036362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.707 [2024-11-21 03:44:27.036404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.708 qpair failed and we were unable to recover it. 00:27:46.708 [2024-11-21 03:44:27.036532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.708 [2024-11-21 03:44:27.036691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.708 [2024-11-21 03:44:27.036716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.708 qpair failed and we were unable to recover it. 00:27:46.708 [2024-11-21 03:44:27.036852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.708 [2024-11-21 03:44:27.036988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.708 [2024-11-21 03:44:27.037017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.708 qpair failed and we were unable to recover it. 00:27:46.708 [2024-11-21 03:44:27.037177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.708 [2024-11-21 03:44:27.037316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.708 [2024-11-21 03:44:27.037361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.708 qpair failed and we were unable to recover it. 00:27:46.708 [2024-11-21 03:44:27.037510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.708 [2024-11-21 03:44:27.037682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.708 [2024-11-21 03:44:27.037728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.708 qpair failed and we were unable to recover it. 00:27:46.708 [2024-11-21 03:44:27.037840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.708 [2024-11-21 03:44:27.037970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.708 [2024-11-21 03:44:27.037997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.708 qpair failed and we were unable to recover it. 00:27:46.708 [2024-11-21 03:44:27.038161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.708 [2024-11-21 03:44:27.038310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.708 [2024-11-21 03:44:27.038355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.708 qpair failed and we were unable to recover it. 00:27:46.708 [2024-11-21 03:44:27.038512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.708 [2024-11-21 03:44:27.038657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.708 [2024-11-21 03:44:27.038682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.708 qpair failed and we were unable to recover it. 00:27:46.708 [2024-11-21 03:44:27.038794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.708 [2024-11-21 03:44:27.038952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.708 [2024-11-21 03:44:27.038978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.708 qpair failed and we were unable to recover it. 00:27:46.708 [2024-11-21 03:44:27.039133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.708 [2024-11-21 03:44:27.039292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.708 [2024-11-21 03:44:27.039318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.708 qpair failed and we were unable to recover it. 00:27:46.708 [2024-11-21 03:44:27.039440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.708 [2024-11-21 03:44:27.039594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.708 [2024-11-21 03:44:27.039619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.708 qpair failed and we were unable to recover it. 00:27:46.708 [2024-11-21 03:44:27.039723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.708 [2024-11-21 03:44:27.039882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.708 [2024-11-21 03:44:27.039907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.708 qpair failed and we were unable to recover it. 00:27:46.708 [2024-11-21 03:44:27.040043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.708 [2024-11-21 03:44:27.040200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.708 [2024-11-21 03:44:27.040244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.708 qpair failed and we were unable to recover it. 00:27:46.708 [2024-11-21 03:44:27.040365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.708 [2024-11-21 03:44:27.040532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.708 [2024-11-21 03:44:27.040560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.708 qpair failed and we were unable to recover it. 00:27:46.708 [2024-11-21 03:44:27.040703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.708 [2024-11-21 03:44:27.040877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.708 [2024-11-21 03:44:27.040903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.708 qpair failed and we were unable to recover it. 00:27:46.708 [2024-11-21 03:44:27.041000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.708 [2024-11-21 03:44:27.041140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.708 [2024-11-21 03:44:27.041169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.708 qpair failed and we were unable to recover it. 00:27:46.708 [2024-11-21 03:44:27.041315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.708 [2024-11-21 03:44:27.041480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.708 [2024-11-21 03:44:27.041506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.708 qpair failed and we were unable to recover it. 00:27:46.708 [2024-11-21 03:44:27.041656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.708 [2024-11-21 03:44:27.041805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.708 [2024-11-21 03:44:27.041830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.708 qpair failed and we were unable to recover it. 00:27:46.708 [2024-11-21 03:44:27.041955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.708 [2024-11-21 03:44:27.042062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.708 [2024-11-21 03:44:27.042094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.708 qpair failed and we were unable to recover it. 00:27:46.708 [2024-11-21 03:44:27.042254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.708 [2024-11-21 03:44:27.042407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.708 [2024-11-21 03:44:27.042462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.708 qpair failed and we were unable to recover it. 00:27:46.708 [2024-11-21 03:44:27.042583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.708 [2024-11-21 03:44:27.042750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.708 [2024-11-21 03:44:27.042785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.708 qpair failed and we were unable to recover it. 00:27:46.708 [2024-11-21 03:44:27.042917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.708 [2024-11-21 03:44:27.043044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.708 [2024-11-21 03:44:27.043075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.708 qpair failed and we were unable to recover it. 00:27:46.708 [2024-11-21 03:44:27.043203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.708 [2024-11-21 03:44:27.043329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.708 [2024-11-21 03:44:27.043358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.708 qpair failed and we were unable to recover it. 00:27:46.708 [2024-11-21 03:44:27.043551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.708 [2024-11-21 03:44:27.043674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.708 [2024-11-21 03:44:27.043716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.708 qpair failed and we were unable to recover it. 00:27:46.708 [2024-11-21 03:44:27.043884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.708 [2024-11-21 03:44:27.044010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.708 [2024-11-21 03:44:27.044036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.708 qpair failed and we were unable to recover it. 00:27:46.708 [2024-11-21 03:44:27.044206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.708 [2024-11-21 03:44:27.044345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.708 [2024-11-21 03:44:27.044375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:46.708 qpair failed and we were unable to recover it. 00:27:46.708 [2024-11-21 03:44:27.044614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.708 [2024-11-21 03:44:27.044732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.708 [2024-11-21 03:44:27.044758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:46.708 qpair failed and we were unable to recover it. 00:27:46.708 [2024-11-21 03:44:27.044920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.708 [2024-11-21 03:44:27.045053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.708 [2024-11-21 03:44:27.045093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:46.708 qpair failed and we were unable to recover it. 00:27:46.708 [2024-11-21 03:44:27.045221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.708 [2024-11-21 03:44:27.045366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.708 [2024-11-21 03:44:27.045395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:46.708 qpair failed and we were unable to recover it. 00:27:46.708 [2024-11-21 03:44:27.045521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.708 [2024-11-21 03:44:27.045685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.709 [2024-11-21 03:44:27.045716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:46.709 qpair failed and we were unable to recover it. 00:27:46.709 [2024-11-21 03:44:27.045852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.709 [2024-11-21 03:44:27.046013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.709 [2024-11-21 03:44:27.046039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:46.709 qpair failed and we were unable to recover it. 00:27:46.709 [2024-11-21 03:44:27.046189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.709 [2024-11-21 03:44:27.046330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.709 [2024-11-21 03:44:27.046374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.709 qpair failed and we were unable to recover it. 00:27:46.709 [2024-11-21 03:44:27.046527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.709 [2024-11-21 03:44:27.046690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.709 [2024-11-21 03:44:27.046733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.709 qpair failed and we were unable to recover it. 00:27:46.709 [2024-11-21 03:44:27.046833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.709 [2024-11-21 03:44:27.046985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.709 [2024-11-21 03:44:27.047012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.709 qpair failed and we were unable to recover it. 00:27:46.709 [2024-11-21 03:44:27.047179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.709 [2024-11-21 03:44:27.047345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.709 [2024-11-21 03:44:27.047388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.709 qpair failed and we were unable to recover it. 00:27:46.709 [2024-11-21 03:44:27.047567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.709 [2024-11-21 03:44:27.047679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.709 [2024-11-21 03:44:27.047706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.709 qpair failed and we were unable to recover it. 00:27:46.709 [2024-11-21 03:44:27.047834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.709 [2024-11-21 03:44:27.047959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.709 [2024-11-21 03:44:27.047985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.709 qpair failed and we were unable to recover it. 00:27:46.709 [2024-11-21 03:44:27.048134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.709 [2024-11-21 03:44:27.048317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.709 [2024-11-21 03:44:27.048344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.709 qpair failed and we were unable to recover it. 00:27:46.709 [2024-11-21 03:44:27.048453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.709 [2024-11-21 03:44:27.048582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.709 [2024-11-21 03:44:27.048607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.709 qpair failed and we were unable to recover it. 00:27:46.709 [2024-11-21 03:44:27.048774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.709 [2024-11-21 03:44:27.048878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.709 [2024-11-21 03:44:27.048910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.709 qpair failed and we were unable to recover it. 00:27:46.709 [2024-11-21 03:44:27.049083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.709 [2024-11-21 03:44:27.049186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.709 [2024-11-21 03:44:27.049213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.709 qpair failed and we were unable to recover it. 00:27:46.709 [2024-11-21 03:44:27.049316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.709 [2024-11-21 03:44:27.049450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.709 [2024-11-21 03:44:27.049475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.709 qpair failed and we were unable to recover it. 00:27:46.709 [2024-11-21 03:44:27.049623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.709 [2024-11-21 03:44:27.049744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.709 [2024-11-21 03:44:27.049770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.709 qpair failed and we were unable to recover it. 00:27:46.709 [2024-11-21 03:44:27.049905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.709 [2024-11-21 03:44:27.050008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.709 [2024-11-21 03:44:27.050034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.709 qpair failed and we were unable to recover it. 00:27:46.709 [2024-11-21 03:44:27.050183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.709 [2024-11-21 03:44:27.050337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.709 [2024-11-21 03:44:27.050380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.709 qpair failed and we were unable to recover it. 00:27:46.709 [2024-11-21 03:44:27.050537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.709 [2024-11-21 03:44:27.050685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.709 [2024-11-21 03:44:27.050710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.709 qpair failed and we were unable to recover it. 00:27:46.709 [2024-11-21 03:44:27.050867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.709 [2024-11-21 03:44:27.051029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.709 [2024-11-21 03:44:27.051054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.709 qpair failed and we were unable to recover it. 00:27:46.709 [2024-11-21 03:44:27.051177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.709 [2024-11-21 03:44:27.051318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.709 [2024-11-21 03:44:27.051344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.709 qpair failed and we were unable to recover it. 00:27:46.709 [2024-11-21 03:44:27.051480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.709 [2024-11-21 03:44:27.051585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.709 [2024-11-21 03:44:27.051611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.709 qpair failed and we were unable to recover it. 00:27:46.709 [2024-11-21 03:44:27.051773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.709 [2024-11-21 03:44:27.051928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.709 [2024-11-21 03:44:27.051958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.709 qpair failed and we were unable to recover it. 00:27:46.709 [2024-11-21 03:44:27.052057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.709 [2024-11-21 03:44:27.052255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.709 [2024-11-21 03:44:27.052300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.709 qpair failed and we were unable to recover it. 00:27:46.709 [2024-11-21 03:44:27.052497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.709 [2024-11-21 03:44:27.052628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.709 [2024-11-21 03:44:27.052670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.709 qpair failed and we were unable to recover it. 00:27:46.709 [2024-11-21 03:44:27.052809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.709 [2024-11-21 03:44:27.052918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.709 [2024-11-21 03:44:27.052943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.709 qpair failed and we were unable to recover it. 00:27:46.709 [2024-11-21 03:44:27.053122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.709 [2024-11-21 03:44:27.053234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.709 [2024-11-21 03:44:27.053260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.709 qpair failed and we were unable to recover it. 00:27:46.710 [2024-11-21 03:44:27.053391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.710 [2024-11-21 03:44:27.053519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.710 [2024-11-21 03:44:27.053544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.710 qpair failed and we were unable to recover it. 00:27:46.710 [2024-11-21 03:44:27.053701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.710 [2024-11-21 03:44:27.053857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.710 [2024-11-21 03:44:27.053884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.710 qpair failed and we were unable to recover it. 00:27:46.710 [2024-11-21 03:44:27.054008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.710 [2024-11-21 03:44:27.054132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.710 [2024-11-21 03:44:27.054162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.710 qpair failed and we were unable to recover it. 00:27:46.710 [2024-11-21 03:44:27.054309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.710 [2024-11-21 03:44:27.054469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.710 [2024-11-21 03:44:27.054495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.710 qpair failed and we were unable to recover it. 00:27:46.710 [2024-11-21 03:44:27.054631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.710 [2024-11-21 03:44:27.054735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.710 [2024-11-21 03:44:27.054763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.710 qpair failed and we were unable to recover it. 00:27:46.710 [2024-11-21 03:44:27.054894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.710 [2024-11-21 03:44:27.055066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.710 [2024-11-21 03:44:27.055098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.710 qpair failed and we were unable to recover it. 00:27:46.710 [2024-11-21 03:44:27.055232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.710 [2024-11-21 03:44:27.055333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.710 [2024-11-21 03:44:27.055359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.710 qpair failed and we were unable to recover it. 00:27:46.710 [2024-11-21 03:44:27.055465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.710 [2024-11-21 03:44:27.055632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.710 [2024-11-21 03:44:27.055657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.710 qpair failed and we were unable to recover it. 00:27:46.710 [2024-11-21 03:44:27.055781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.710 [2024-11-21 03:44:27.055882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.710 [2024-11-21 03:44:27.055909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.710 qpair failed and we were unable to recover it. 00:27:46.710 [2024-11-21 03:44:27.056074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.710 [2024-11-21 03:44:27.056177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.710 [2024-11-21 03:44:27.056204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.710 qpair failed and we were unable to recover it. 00:27:46.710 [2024-11-21 03:44:27.056303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.710 [2024-11-21 03:44:27.056425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.710 [2024-11-21 03:44:27.056450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.710 qpair failed and we were unable to recover it. 00:27:46.710 [2024-11-21 03:44:27.056576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.710 [2024-11-21 03:44:27.056702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.710 [2024-11-21 03:44:27.056731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.710 qpair failed and we were unable to recover it. 00:27:46.710 [2024-11-21 03:44:27.056833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.710 [2024-11-21 03:44:27.056939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.710 [2024-11-21 03:44:27.056965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.710 qpair failed and we were unable to recover it. 00:27:46.710 [2024-11-21 03:44:27.057104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.710 [2024-11-21 03:44:27.057234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.710 [2024-11-21 03:44:27.057260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.710 qpair failed and we were unable to recover it. 00:27:46.710 [2024-11-21 03:44:27.057445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.710 [2024-11-21 03:44:27.057586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.710 [2024-11-21 03:44:27.057611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.710 qpair failed and we were unable to recover it. 00:27:46.710 [2024-11-21 03:44:27.057714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.710 [2024-11-21 03:44:27.057843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.710 [2024-11-21 03:44:27.057868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.710 qpair failed and we were unable to recover it. 00:27:46.710 [2024-11-21 03:44:27.058007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.710 [2024-11-21 03:44:27.058158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.710 [2024-11-21 03:44:27.058202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.710 qpair failed and we were unable to recover it. 00:27:46.710 [2024-11-21 03:44:27.058347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.710 [2024-11-21 03:44:27.058505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.710 [2024-11-21 03:44:27.058549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.710 qpair failed and we were unable to recover it. 00:27:46.710 [2024-11-21 03:44:27.058655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.710 [2024-11-21 03:44:27.058760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.710 [2024-11-21 03:44:27.058785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.710 qpair failed and we were unable to recover it. 00:27:46.710 [2024-11-21 03:44:27.058924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.710 [2024-11-21 03:44:27.059065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.710 [2024-11-21 03:44:27.059102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.710 qpair failed and we were unable to recover it. 00:27:46.710 [2024-11-21 03:44:27.059211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.710 [2024-11-21 03:44:27.059341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.710 [2024-11-21 03:44:27.059366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.710 qpair failed and we were unable to recover it. 00:27:46.710 [2024-11-21 03:44:27.059497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.710 [2024-11-21 03:44:27.059622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.710 [2024-11-21 03:44:27.059647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.710 qpair failed and we were unable to recover it. 00:27:46.710 [2024-11-21 03:44:27.059806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.710 [2024-11-21 03:44:27.059941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.710 [2024-11-21 03:44:27.059967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.710 qpair failed and we were unable to recover it. 00:27:46.710 [2024-11-21 03:44:27.060126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.710 [2024-11-21 03:44:27.060230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.710 [2024-11-21 03:44:27.060257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.710 qpair failed and we were unable to recover it. 00:27:46.710 [2024-11-21 03:44:27.060362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.710 [2024-11-21 03:44:27.060468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.710 [2024-11-21 03:44:27.060494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.710 qpair failed and we were unable to recover it. 00:27:46.710 [2024-11-21 03:44:27.060631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.710 [2024-11-21 03:44:27.060740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.710 [2024-11-21 03:44:27.060767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.710 qpair failed and we were unable to recover it. 00:27:46.710 [2024-11-21 03:44:27.060902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.710 [2024-11-21 03:44:27.061056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.710 [2024-11-21 03:44:27.061089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.710 qpair failed and we were unable to recover it. 00:27:46.710 [2024-11-21 03:44:27.061230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.710 [2024-11-21 03:44:27.061339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.710 [2024-11-21 03:44:27.061365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.710 qpair failed and we were unable to recover it. 00:27:46.710 [2024-11-21 03:44:27.061496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.710 [2024-11-21 03:44:27.061654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.710 [2024-11-21 03:44:27.061679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.711 qpair failed and we were unable to recover it. 00:27:46.711 [2024-11-21 03:44:27.061812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.711 [2024-11-21 03:44:27.061947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.711 [2024-11-21 03:44:27.061973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.711 qpair failed and we were unable to recover it. 00:27:46.711 [2024-11-21 03:44:27.062083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.711 [2024-11-21 03:44:27.062185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.711 [2024-11-21 03:44:27.062211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.711 qpair failed and we were unable to recover it. 00:27:46.711 [2024-11-21 03:44:27.062354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.711 [2024-11-21 03:44:27.062546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.711 [2024-11-21 03:44:27.062589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.711 qpair failed and we were unable to recover it. 00:27:46.711 [2024-11-21 03:44:27.062690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.711 [2024-11-21 03:44:27.062812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.711 [2024-11-21 03:44:27.062838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.711 qpair failed and we were unable to recover it. 00:27:46.711 [2024-11-21 03:44:27.062983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.711 [2024-11-21 03:44:27.063119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.711 [2024-11-21 03:44:27.063151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.711 qpair failed and we were unable to recover it. 00:27:46.711 [2024-11-21 03:44:27.063323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.711 [2024-11-21 03:44:27.063449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.711 [2024-11-21 03:44:27.063476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.711 qpair failed and we were unable to recover it. 00:27:46.711 [2024-11-21 03:44:27.063606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.711 [2024-11-21 03:44:27.063734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.711 [2024-11-21 03:44:27.063760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.711 qpair failed and we were unable to recover it. 00:27:46.711 [2024-11-21 03:44:27.063913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.711 [2024-11-21 03:44:27.064011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.711 [2024-11-21 03:44:27.064037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.711 qpair failed and we were unable to recover it. 00:27:46.711 [2024-11-21 03:44:27.064212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.711 [2024-11-21 03:44:27.064408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.711 [2024-11-21 03:44:27.064452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.711 qpair failed and we were unable to recover it. 00:27:46.711 [2024-11-21 03:44:27.064586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.711 [2024-11-21 03:44:27.064734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.711 [2024-11-21 03:44:27.064762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.711 qpair failed and we were unable to recover it. 00:27:46.711 [2024-11-21 03:44:27.064918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.711 [2024-11-21 03:44:27.065028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.711 [2024-11-21 03:44:27.065054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.711 qpair failed and we were unable to recover it. 00:27:46.711 [2024-11-21 03:44:27.065177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.711 [2024-11-21 03:44:27.065310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.711 [2024-11-21 03:44:27.065336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.711 qpair failed and we were unable to recover it. 00:27:46.711 [2024-11-21 03:44:27.065510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.711 [2024-11-21 03:44:27.065662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.711 [2024-11-21 03:44:27.065687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.711 qpair failed and we were unable to recover it. 00:27:46.711 [2024-11-21 03:44:27.065824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.711 [2024-11-21 03:44:27.065955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.711 [2024-11-21 03:44:27.065981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.711 qpair failed and we were unable to recover it. 00:27:46.711 [2024-11-21 03:44:27.066128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.711 [2024-11-21 03:44:27.066300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.711 [2024-11-21 03:44:27.066348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.711 qpair failed and we were unable to recover it. 00:27:46.711 [2024-11-21 03:44:27.066507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.711 [2024-11-21 03:44:27.066646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.711 [2024-11-21 03:44:27.066672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.711 qpair failed and we were unable to recover it. 00:27:46.711 [2024-11-21 03:44:27.066800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.711 [2024-11-21 03:44:27.066922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.711 [2024-11-21 03:44:27.066947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.711 qpair failed and we were unable to recover it. 00:27:46.711 [2024-11-21 03:44:27.067108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.711 [2024-11-21 03:44:27.067237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.711 [2024-11-21 03:44:27.067263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.711 qpair failed and we were unable to recover it. 00:27:46.711 [2024-11-21 03:44:27.067379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.711 [2024-11-21 03:44:27.067533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.711 [2024-11-21 03:44:27.067559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.711 qpair failed and we were unable to recover it. 00:27:46.711 [2024-11-21 03:44:27.067659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.711 [2024-11-21 03:44:27.067758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.711 [2024-11-21 03:44:27.067785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.711 qpair failed and we were unable to recover it. 00:27:46.711 [2024-11-21 03:44:27.067895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.711 [2024-11-21 03:44:27.068061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.711 [2024-11-21 03:44:27.068092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.711 qpair failed and we were unable to recover it. 00:27:46.711 [2024-11-21 03:44:27.068239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.711 [2024-11-21 03:44:27.068407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.711 [2024-11-21 03:44:27.068435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.711 qpair failed and we were unable to recover it. 00:27:46.711 [2024-11-21 03:44:27.068597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.711 [2024-11-21 03:44:27.068746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.711 [2024-11-21 03:44:27.068782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.711 qpair failed and we were unable to recover it. 00:27:46.711 [2024-11-21 03:44:27.068914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.711 [2024-11-21 03:44:27.069079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.711 [2024-11-21 03:44:27.069105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.711 qpair failed and we were unable to recover it. 00:27:46.711 [2024-11-21 03:44:27.069236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.711 [2024-11-21 03:44:27.069356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.711 [2024-11-21 03:44:27.069408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.711 qpair failed and we were unable to recover it. 00:27:46.711 [2024-11-21 03:44:27.069514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.711 [2024-11-21 03:44:27.069666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.711 [2024-11-21 03:44:27.069692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.711 qpair failed and we were unable to recover it. 00:27:46.711 [2024-11-21 03:44:27.069827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.711 [2024-11-21 03:44:27.069954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.711 [2024-11-21 03:44:27.069979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.711 qpair failed and we were unable to recover it. 00:27:46.711 [2024-11-21 03:44:27.070100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.711 [2024-11-21 03:44:27.070262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.711 [2024-11-21 03:44:27.070287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.711 qpair failed and we were unable to recover it. 00:27:46.711 [2024-11-21 03:44:27.070477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.711 [2024-11-21 03:44:27.070595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.712 [2024-11-21 03:44:27.070638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.712 qpair failed and we were unable to recover it. 00:27:46.712 [2024-11-21 03:44:27.070788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.712 [2024-11-21 03:44:27.070918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.712 [2024-11-21 03:44:27.070944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.712 qpair failed and we were unable to recover it. 00:27:46.712 [2024-11-21 03:44:27.071086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.712 [2024-11-21 03:44:27.071235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.712 [2024-11-21 03:44:27.071279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.712 qpair failed and we were unable to recover it. 00:27:46.712 [2024-11-21 03:44:27.071427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.712 [2024-11-21 03:44:27.071622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.712 [2024-11-21 03:44:27.071665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.712 qpair failed and we were unable to recover it. 00:27:46.712 [2024-11-21 03:44:27.071801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.712 [2024-11-21 03:44:27.071966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.712 [2024-11-21 03:44:27.071992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.712 qpair failed and we were unable to recover it. 00:27:46.712 [2024-11-21 03:44:27.072143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.712 [2024-11-21 03:44:27.072310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.712 [2024-11-21 03:44:27.072338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.712 qpair failed and we were unable to recover it. 00:27:46.712 [2024-11-21 03:44:27.072532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.712 [2024-11-21 03:44:27.072666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.712 [2024-11-21 03:44:27.072693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.712 qpair failed and we were unable to recover it. 00:27:46.712 [2024-11-21 03:44:27.072820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.712 [2024-11-21 03:44:27.072992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.712 [2024-11-21 03:44:27.073017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.712 qpair failed and we were unable to recover it. 00:27:46.712 [2024-11-21 03:44:27.073160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.712 [2024-11-21 03:44:27.073289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.712 [2024-11-21 03:44:27.073315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.712 qpair failed and we were unable to recover it. 00:27:46.712 [2024-11-21 03:44:27.073427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.712 [2024-11-21 03:44:27.073555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.712 [2024-11-21 03:44:27.073582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.712 qpair failed and we were unable to recover it. 00:27:46.712 [2024-11-21 03:44:27.073725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.712 [2024-11-21 03:44:27.073854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.712 [2024-11-21 03:44:27.073879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.712 qpair failed and we were unable to recover it. 00:27:46.712 [2024-11-21 03:44:27.073979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.712 [2024-11-21 03:44:27.074139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.712 [2024-11-21 03:44:27.074166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.712 qpair failed and we were unable to recover it. 00:27:46.712 [2024-11-21 03:44:27.074302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.712 [2024-11-21 03:44:27.074417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.712 [2024-11-21 03:44:27.074444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.712 qpair failed and we were unable to recover it. 00:27:46.712 [2024-11-21 03:44:27.074578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.712 [2024-11-21 03:44:27.074730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.712 [2024-11-21 03:44:27.074756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.712 qpair failed and we were unable to recover it. 00:27:46.712 [2024-11-21 03:44:27.074862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.712 [2024-11-21 03:44:27.075015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.712 [2024-11-21 03:44:27.075041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.712 qpair failed and we were unable to recover it. 00:27:46.712 [2024-11-21 03:44:27.075158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.712 [2024-11-21 03:44:27.075272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.712 [2024-11-21 03:44:27.075298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.712 qpair failed and we were unable to recover it. 00:27:46.712 [2024-11-21 03:44:27.075427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.712 [2024-11-21 03:44:27.075588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.712 [2024-11-21 03:44:27.075614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.712 qpair failed and we were unable to recover it. 00:27:46.712 [2024-11-21 03:44:27.075778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.712 [2024-11-21 03:44:27.075879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.712 [2024-11-21 03:44:27.075905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.712 qpair failed and we were unable to recover it. 00:27:46.712 [2024-11-21 03:44:27.076036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.712 [2024-11-21 03:44:27.076168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.712 [2024-11-21 03:44:27.076211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.712 qpair failed and we were unable to recover it. 00:27:46.712 [2024-11-21 03:44:27.076377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.712 [2024-11-21 03:44:27.076545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.712 [2024-11-21 03:44:27.076592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.712 qpair failed and we were unable to recover it. 00:27:46.712 [2024-11-21 03:44:27.076754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.712 [2024-11-21 03:44:27.076918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.712 [2024-11-21 03:44:27.076943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.712 qpair failed and we were unable to recover it. 00:27:46.712 [2024-11-21 03:44:27.077049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.712 [2024-11-21 03:44:27.077169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.712 [2024-11-21 03:44:27.077199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.712 qpair failed and we were unable to recover it. 00:27:46.712 [2024-11-21 03:44:27.077329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.712 [2024-11-21 03:44:27.077545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.712 [2024-11-21 03:44:27.077591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.712 qpair failed and we were unable to recover it. 00:27:46.712 [2024-11-21 03:44:27.077730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.712 [2024-11-21 03:44:27.077886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.712 [2024-11-21 03:44:27.077912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.712 qpair failed and we were unable to recover it. 00:27:46.712 [2024-11-21 03:44:27.078043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.713 [2024-11-21 03:44:27.078180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.713 [2024-11-21 03:44:27.078224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.713 qpair failed and we were unable to recover it. 00:27:46.713 [2024-11-21 03:44:27.078371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.713 [2024-11-21 03:44:27.078550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.713 [2024-11-21 03:44:27.078576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.713 qpair failed and we were unable to recover it. 00:27:46.713 [2024-11-21 03:44:27.078705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.713 [2024-11-21 03:44:27.078835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.713 [2024-11-21 03:44:27.078861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.713 qpair failed and we were unable to recover it. 00:27:46.713 [2024-11-21 03:44:27.078987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.713 [2024-11-21 03:44:27.079139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.713 [2024-11-21 03:44:27.079188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.713 qpair failed and we were unable to recover it. 00:27:46.713 [2024-11-21 03:44:27.079348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.713 [2024-11-21 03:44:27.079499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.713 [2024-11-21 03:44:27.079541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.713 qpair failed and we were unable to recover it. 00:27:46.713 [2024-11-21 03:44:27.079722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.713 [2024-11-21 03:44:27.079903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.713 [2024-11-21 03:44:27.079928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.713 qpair failed and we were unable to recover it. 00:27:46.713 [2024-11-21 03:44:27.080088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.713 [2024-11-21 03:44:27.080243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.713 [2024-11-21 03:44:27.080287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.713 qpair failed and we were unable to recover it. 00:27:46.713 [2024-11-21 03:44:27.080448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.713 [2024-11-21 03:44:27.080592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.713 [2024-11-21 03:44:27.080619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.713 qpair failed and we were unable to recover it. 00:27:46.713 [2024-11-21 03:44:27.080752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.713 [2024-11-21 03:44:27.080852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.713 [2024-11-21 03:44:27.080878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.713 qpair failed and we were unable to recover it. 00:27:46.713 [2024-11-21 03:44:27.080984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.713 [2024-11-21 03:44:27.081122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.713 [2024-11-21 03:44:27.081148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.713 qpair failed and we were unable to recover it. 00:27:46.713 [2024-11-21 03:44:27.081280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.713 [2024-11-21 03:44:27.081370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.713 [2024-11-21 03:44:27.081394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.713 qpair failed and we were unable to recover it. 00:27:46.713 [2024-11-21 03:44:27.081523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.713 [2024-11-21 03:44:27.081660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.713 [2024-11-21 03:44:27.081685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.713 qpair failed and we were unable to recover it. 00:27:46.713 [2024-11-21 03:44:27.081818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.713 [2024-11-21 03:44:27.081949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.713 [2024-11-21 03:44:27.081974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.713 qpair failed and we were unable to recover it. 00:27:46.713 [2024-11-21 03:44:27.082102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.713 [2024-11-21 03:44:27.082256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.713 [2024-11-21 03:44:27.082299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.713 qpair failed and we were unable to recover it. 00:27:46.713 [2024-11-21 03:44:27.082446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.713 [2024-11-21 03:44:27.082589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.713 [2024-11-21 03:44:27.082616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.713 qpair failed and we were unable to recover it. 00:27:46.713 [2024-11-21 03:44:27.082773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.713 [2024-11-21 03:44:27.082888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.713 [2024-11-21 03:44:27.082913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.713 qpair failed and we were unable to recover it. 00:27:46.713 [2024-11-21 03:44:27.083048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.713 [2024-11-21 03:44:27.083175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.713 [2024-11-21 03:44:27.083221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.713 qpair failed and we were unable to recover it. 00:27:46.713 [2024-11-21 03:44:27.083381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.713 [2024-11-21 03:44:27.083536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.713 [2024-11-21 03:44:27.083561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.713 qpair failed and we were unable to recover it. 00:27:46.713 [2024-11-21 03:44:27.083690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.713 [2024-11-21 03:44:27.083819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.713 [2024-11-21 03:44:27.083844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.713 qpair failed and we were unable to recover it. 00:27:46.713 [2024-11-21 03:44:27.083988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.713 [2024-11-21 03:44:27.084127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.713 [2024-11-21 03:44:27.084153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.713 qpair failed and we were unable to recover it. 00:27:46.713 [2024-11-21 03:44:27.084319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.713 [2024-11-21 03:44:27.084467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.713 [2024-11-21 03:44:27.084510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.713 qpair failed and we were unable to recover it. 00:27:46.713 [2024-11-21 03:44:27.084612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.713 [2024-11-21 03:44:27.084737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.713 [2024-11-21 03:44:27.084763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.713 qpair failed and we were unable to recover it. 00:27:46.713 [2024-11-21 03:44:27.084892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.713 [2024-11-21 03:44:27.085024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.713 [2024-11-21 03:44:27.085049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.713 qpair failed and we were unable to recover it. 00:27:46.713 [2024-11-21 03:44:27.085160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.713 [2024-11-21 03:44:27.085257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.713 [2024-11-21 03:44:27.085283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.713 qpair failed and we were unable to recover it. 00:27:46.713 [2024-11-21 03:44:27.085453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.713 [2024-11-21 03:44:27.085608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.713 [2024-11-21 03:44:27.085633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.713 qpair failed and we were unable to recover it. 00:27:46.713 [2024-11-21 03:44:27.085734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.714 [2024-11-21 03:44:27.085840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.714 [2024-11-21 03:44:27.085866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.714 qpair failed and we were unable to recover it. 00:27:46.714 [2024-11-21 03:44:27.085995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.714 [2024-11-21 03:44:27.086098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.714 [2024-11-21 03:44:27.086124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.714 qpair failed and we were unable to recover it. 00:27:46.714 [2024-11-21 03:44:27.086254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.714 [2024-11-21 03:44:27.086409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.714 [2024-11-21 03:44:27.086435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.714 qpair failed and we were unable to recover it. 00:27:46.714 [2024-11-21 03:44:27.086566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.714 [2024-11-21 03:44:27.086697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.714 [2024-11-21 03:44:27.086722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.714 qpair failed and we were unable to recover it. 00:27:46.714 [2024-11-21 03:44:27.086847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.714 [2024-11-21 03:44:27.086971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.714 [2024-11-21 03:44:27.086997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.714 qpair failed and we were unable to recover it. 00:27:46.714 [2024-11-21 03:44:27.087143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.714 [2024-11-21 03:44:27.087291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.714 [2024-11-21 03:44:27.087316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.714 qpair failed and we were unable to recover it. 00:27:46.714 [2024-11-21 03:44:27.087456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.714 [2024-11-21 03:44:27.087584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.714 [2024-11-21 03:44:27.087610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.714 qpair failed and we were unable to recover it. 00:27:46.714 [2024-11-21 03:44:27.087720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.714 [2024-11-21 03:44:27.087876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.714 [2024-11-21 03:44:27.087902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.714 qpair failed and we were unable to recover it. 00:27:46.714 [2024-11-21 03:44:27.088031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.714 [2024-11-21 03:44:27.088169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.714 [2024-11-21 03:44:27.088195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.714 qpair failed and we were unable to recover it. 00:27:46.714 [2024-11-21 03:44:27.088301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.714 [2024-11-21 03:44:27.088414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.714 [2024-11-21 03:44:27.088440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.714 qpair failed and we were unable to recover it. 00:27:46.714 [2024-11-21 03:44:27.088581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.714 [2024-11-21 03:44:27.088717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.714 [2024-11-21 03:44:27.088743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.714 qpair failed and we were unable to recover it. 00:27:46.714 [2024-11-21 03:44:27.088854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.714 [2024-11-21 03:44:27.089007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.714 [2024-11-21 03:44:27.089032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.714 qpair failed and we were unable to recover it. 00:27:46.714 [2024-11-21 03:44:27.089209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.714 [2024-11-21 03:44:27.089336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.714 [2024-11-21 03:44:27.089363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.714 qpair failed and we were unable to recover it. 00:27:46.714 [2024-11-21 03:44:27.089482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.714 [2024-11-21 03:44:27.089655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.714 [2024-11-21 03:44:27.089680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.714 qpair failed and we were unable to recover it. 00:27:46.714 [2024-11-21 03:44:27.089804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.714 [2024-11-21 03:44:27.089903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.714 [2024-11-21 03:44:27.089928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.714 qpair failed and we were unable to recover it. 00:27:46.714 [2024-11-21 03:44:27.090064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.714 [2024-11-21 03:44:27.090177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.714 [2024-11-21 03:44:27.090204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.714 qpair failed and we were unable to recover it. 00:27:46.714 [2024-11-21 03:44:27.090333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.714 [2024-11-21 03:44:27.090443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.714 [2024-11-21 03:44:27.090469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.714 qpair failed and we were unable to recover it. 00:27:46.714 [2024-11-21 03:44:27.090567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.714 [2024-11-21 03:44:27.090699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.714 [2024-11-21 03:44:27.090724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.714 qpair failed and we were unable to recover it. 00:27:46.714 [2024-11-21 03:44:27.090852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.714 [2024-11-21 03:44:27.090954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.714 [2024-11-21 03:44:27.090979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.714 qpair failed and we were unable to recover it. 00:27:46.714 [2024-11-21 03:44:27.091084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.714 [2024-11-21 03:44:27.091179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.714 [2024-11-21 03:44:27.091204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.714 qpair failed and we were unable to recover it. 00:27:46.714 [2024-11-21 03:44:27.091338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.714 [2024-11-21 03:44:27.091486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.714 [2024-11-21 03:44:27.091533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.714 qpair failed and we were unable to recover it. 00:27:46.714 [2024-11-21 03:44:27.091668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.714 [2024-11-21 03:44:27.091794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.714 [2024-11-21 03:44:27.091819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.714 qpair failed and we were unable to recover it. 00:27:46.714 [2024-11-21 03:44:27.091954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.714 [2024-11-21 03:44:27.092084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.715 [2024-11-21 03:44:27.092111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.715 qpair failed and we were unable to recover it. 00:27:46.715 [2024-11-21 03:44:27.092228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.715 [2024-11-21 03:44:27.092352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.715 [2024-11-21 03:44:27.092377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.715 qpair failed and we were unable to recover it. 00:27:46.715 [2024-11-21 03:44:27.092483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.715 [2024-11-21 03:44:27.092610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.715 [2024-11-21 03:44:27.092635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.715 qpair failed and we were unable to recover it. 00:27:46.715 [2024-11-21 03:44:27.092760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.715 [2024-11-21 03:44:27.092859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.715 [2024-11-21 03:44:27.092885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.715 qpair failed and we were unable to recover it. 00:27:46.715 [2024-11-21 03:44:27.093009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.715 [2024-11-21 03:44:27.093118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.715 [2024-11-21 03:44:27.093144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.715 qpair failed and we were unable to recover it. 00:27:46.715 [2024-11-21 03:44:27.093256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.715 [2024-11-21 03:44:27.093381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.715 [2024-11-21 03:44:27.093407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.715 qpair failed and we were unable to recover it. 00:27:46.715 [2024-11-21 03:44:27.093530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.715 [2024-11-21 03:44:27.093627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.715 [2024-11-21 03:44:27.093654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.715 qpair failed and we were unable to recover it. 00:27:46.715 [2024-11-21 03:44:27.093782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.715 [2024-11-21 03:44:27.093944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.715 [2024-11-21 03:44:27.093969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.715 qpair failed and we were unable to recover it. 00:27:46.715 [2024-11-21 03:44:27.094077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.715 [2024-11-21 03:44:27.094194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.715 [2024-11-21 03:44:27.094241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.715 qpair failed and we were unable to recover it. 00:27:46.715 [2024-11-21 03:44:27.094430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.715 [2024-11-21 03:44:27.094574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.715 [2024-11-21 03:44:27.094599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.715 qpair failed and we were unable to recover it. 00:27:46.715 [2024-11-21 03:44:27.094731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.715 [2024-11-21 03:44:27.094851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.715 [2024-11-21 03:44:27.094877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.715 qpair failed and we were unable to recover it. 00:27:46.715 [2024-11-21 03:44:27.095034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.715 [2024-11-21 03:44:27.095223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.715 [2024-11-21 03:44:27.095267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.715 qpair failed and we were unable to recover it. 00:27:46.715 [2024-11-21 03:44:27.095419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.715 [2024-11-21 03:44:27.095566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.715 [2024-11-21 03:44:27.095592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.715 qpair failed and we were unable to recover it. 00:27:46.715 [2024-11-21 03:44:27.095724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.715 [2024-11-21 03:44:27.095851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.715 [2024-11-21 03:44:27.095876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.715 qpair failed and we were unable to recover it. 00:27:46.715 [2024-11-21 03:44:27.096032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.715 [2024-11-21 03:44:27.096188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.715 [2024-11-21 03:44:27.096231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.715 qpair failed and we were unable to recover it. 00:27:46.715 [2024-11-21 03:44:27.096376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.715 [2024-11-21 03:44:27.096545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.715 [2024-11-21 03:44:27.096587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.715 qpair failed and we were unable to recover it. 00:27:46.715 [2024-11-21 03:44:27.096719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.715 [2024-11-21 03:44:27.096873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.715 [2024-11-21 03:44:27.096898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.715 qpair failed and we were unable to recover it. 00:27:46.715 [2024-11-21 03:44:27.097008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.715 [2024-11-21 03:44:27.097161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.715 [2024-11-21 03:44:27.097204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.715 qpair failed and we were unable to recover it. 00:27:46.715 [2024-11-21 03:44:27.097318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.715 [2024-11-21 03:44:27.097487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.715 [2024-11-21 03:44:27.097535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.715 qpair failed and we were unable to recover it. 00:27:46.715 [2024-11-21 03:44:27.097646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.715 [2024-11-21 03:44:27.097801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.715 [2024-11-21 03:44:27.097827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.715 qpair failed and we were unable to recover it. 00:27:46.715 [2024-11-21 03:44:27.097953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.715 [2024-11-21 03:44:27.098087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.715 [2024-11-21 03:44:27.098113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.715 qpair failed and we were unable to recover it. 00:27:46.715 [2024-11-21 03:44:27.098287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.715 [2024-11-21 03:44:27.098463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.715 [2024-11-21 03:44:27.098506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.715 qpair failed and we were unable to recover it. 00:27:46.715 [2024-11-21 03:44:27.098636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.715 [2024-11-21 03:44:27.098794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.715 [2024-11-21 03:44:27.098820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.715 qpair failed and we were unable to recover it. 00:27:46.715 [2024-11-21 03:44:27.098955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.715 [2024-11-21 03:44:27.099083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.716 [2024-11-21 03:44:27.099109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.716 qpair failed and we were unable to recover it. 00:27:46.716 [2024-11-21 03:44:27.099228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.716 [2024-11-21 03:44:27.099416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.716 [2024-11-21 03:44:27.099444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.716 qpair failed and we were unable to recover it. 00:27:46.716 [2024-11-21 03:44:27.099646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.716 [2024-11-21 03:44:27.099793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.716 [2024-11-21 03:44:27.099818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.716 qpair failed and we were unable to recover it. 00:27:46.716 [2024-11-21 03:44:27.099919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.716 [2024-11-21 03:44:27.100012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.716 [2024-11-21 03:44:27.100037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.716 qpair failed and we were unable to recover it. 00:27:46.716 [2024-11-21 03:44:27.100188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.716 [2024-11-21 03:44:27.100305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.716 [2024-11-21 03:44:27.100330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.716 qpair failed and we were unable to recover it. 00:27:46.716 [2024-11-21 03:44:27.100490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.716 [2024-11-21 03:44:27.100593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.716 [2024-11-21 03:44:27.100623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.716 qpair failed and we were unable to recover it. 00:27:46.716 [2024-11-21 03:44:27.100757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.716 [2024-11-21 03:44:27.100884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.716 [2024-11-21 03:44:27.100911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.716 qpair failed and we were unable to recover it. 00:27:46.716 [2024-11-21 03:44:27.101013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.716 [2024-11-21 03:44:27.101178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.716 [2024-11-21 03:44:27.101204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.716 qpair failed and we were unable to recover it. 00:27:46.716 [2024-11-21 03:44:27.101337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.716 [2024-11-21 03:44:27.101470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.716 [2024-11-21 03:44:27.101495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.716 qpair failed and we were unable to recover it. 00:27:46.716 [2024-11-21 03:44:27.101587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.716 [2024-11-21 03:44:27.101715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.716 [2024-11-21 03:44:27.101740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.716 qpair failed and we were unable to recover it. 00:27:46.716 [2024-11-21 03:44:27.101873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.716 [2024-11-21 03:44:27.101971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.716 [2024-11-21 03:44:27.101998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.716 qpair failed and we were unable to recover it. 00:27:46.716 [2024-11-21 03:44:27.102130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.716 [2024-11-21 03:44:27.102260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.716 [2024-11-21 03:44:27.102285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.716 qpair failed and we were unable to recover it. 00:27:46.716 [2024-11-21 03:44:27.102397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.716 [2024-11-21 03:44:27.102528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.716 [2024-11-21 03:44:27.102553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.716 qpair failed and we were unable to recover it. 00:27:46.716 [2024-11-21 03:44:27.102707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.716 [2024-11-21 03:44:27.102801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.716 [2024-11-21 03:44:27.102826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.716 qpair failed and we were unable to recover it. 00:27:46.716 [2024-11-21 03:44:27.102959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.716 [2024-11-21 03:44:27.103077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.716 [2024-11-21 03:44:27.103103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.716 qpair failed and we were unable to recover it. 00:27:46.716 [2024-11-21 03:44:27.103234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.716 [2024-11-21 03:44:27.103368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.716 [2024-11-21 03:44:27.103394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.716 qpair failed and we were unable to recover it. 00:27:46.716 [2024-11-21 03:44:27.103566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.716 [2024-11-21 03:44:27.103695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.716 [2024-11-21 03:44:27.103722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.716 qpair failed and we were unable to recover it. 00:27:46.716 [2024-11-21 03:44:27.103854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.716 [2024-11-21 03:44:27.103953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.716 [2024-11-21 03:44:27.103979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.716 qpair failed and we were unable to recover it. 00:27:46.716 [2024-11-21 03:44:27.104141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.716 [2024-11-21 03:44:27.104300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.716 [2024-11-21 03:44:27.104343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.716 qpair failed and we were unable to recover it. 00:27:46.716 [2024-11-21 03:44:27.104471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.716 [2024-11-21 03:44:27.104578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.716 [2024-11-21 03:44:27.104605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.716 qpair failed and we were unable to recover it. 00:27:46.716 [2024-11-21 03:44:27.104767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.716 [2024-11-21 03:44:27.104868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.716 [2024-11-21 03:44:27.104894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.716 qpair failed and we were unable to recover it. 00:27:46.716 [2024-11-21 03:44:27.105048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.716 [2024-11-21 03:44:27.105208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.716 [2024-11-21 03:44:27.105252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.716 qpair failed and we were unable to recover it. 00:27:46.716 [2024-11-21 03:44:27.105396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.716 [2024-11-21 03:44:27.105553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.716 [2024-11-21 03:44:27.105595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.716 qpair failed and we were unable to recover it. 00:27:46.716 [2024-11-21 03:44:27.105725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.716 [2024-11-21 03:44:27.105855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.716 [2024-11-21 03:44:27.105880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.716 qpair failed and we were unable to recover it. 00:27:46.716 [2024-11-21 03:44:27.106010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.716 [2024-11-21 03:44:27.106131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.716 [2024-11-21 03:44:27.106160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.716 qpair failed and we were unable to recover it. 00:27:46.716 [2024-11-21 03:44:27.106299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.716 [2024-11-21 03:44:27.106496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.716 [2024-11-21 03:44:27.106539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.716 qpair failed and we were unable to recover it. 00:27:46.716 [2024-11-21 03:44:27.106702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.716 [2024-11-21 03:44:27.106858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.716 [2024-11-21 03:44:27.106883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.716 qpair failed and we were unable to recover it. 00:27:46.716 [2024-11-21 03:44:27.107044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.717 [2024-11-21 03:44:27.107192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.717 [2024-11-21 03:44:27.107236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.717 qpair failed and we were unable to recover it. 00:27:46.717 [2024-11-21 03:44:27.107425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.717 [2024-11-21 03:44:27.107617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.717 [2024-11-21 03:44:27.107660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.717 qpair failed and we were unable to recover it. 00:27:46.717 [2024-11-21 03:44:27.107783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.717 [2024-11-21 03:44:27.107884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.717 [2024-11-21 03:44:27.107909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.717 qpair failed and we were unable to recover it. 00:27:46.717 [2024-11-21 03:44:27.108036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.717 [2024-11-21 03:44:27.108190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.717 [2024-11-21 03:44:27.108234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.717 qpair failed and we were unable to recover it. 00:27:46.717 [2024-11-21 03:44:27.108365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.717 [2024-11-21 03:44:27.108499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.717 [2024-11-21 03:44:27.108523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.717 qpair failed and we were unable to recover it. 00:27:46.717 [2024-11-21 03:44:27.108687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.717 [2024-11-21 03:44:27.108815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.717 [2024-11-21 03:44:27.108840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.717 qpair failed and we were unable to recover it. 00:27:46.717 [2024-11-21 03:44:27.108943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.717 [2024-11-21 03:44:27.109100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.717 [2024-11-21 03:44:27.109126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.717 qpair failed and we were unable to recover it. 00:27:46.717 [2024-11-21 03:44:27.109308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.717 [2024-11-21 03:44:27.109457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.717 [2024-11-21 03:44:27.109500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.717 qpair failed and we were unable to recover it. 00:27:46.717 [2024-11-21 03:44:27.109659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.717 [2024-11-21 03:44:27.109800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.717 [2024-11-21 03:44:27.109826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.717 qpair failed and we were unable to recover it. 00:27:46.717 [2024-11-21 03:44:27.109928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.717 [2024-11-21 03:44:27.110028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.717 [2024-11-21 03:44:27.110054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.717 qpair failed and we were unable to recover it. 00:27:46.717 [2024-11-21 03:44:27.110210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.717 [2024-11-21 03:44:27.110337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.717 [2024-11-21 03:44:27.110365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.717 qpair failed and we were unable to recover it. 00:27:46.717 [2024-11-21 03:44:27.110563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.717 [2024-11-21 03:44:27.110684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.717 [2024-11-21 03:44:27.110710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.717 qpair failed and we were unable to recover it. 00:27:46.717 [2024-11-21 03:44:27.110845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.717 [2024-11-21 03:44:27.110971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.717 [2024-11-21 03:44:27.110997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.717 qpair failed and we were unable to recover it. 00:27:46.717 [2024-11-21 03:44:27.111100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.717 [2024-11-21 03:44:27.111247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.717 [2024-11-21 03:44:27.111290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.717 qpair failed and we were unable to recover it. 00:27:46.717 [2024-11-21 03:44:27.111423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.717 [2024-11-21 03:44:27.111597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.717 [2024-11-21 03:44:27.111622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.717 qpair failed and we were unable to recover it. 00:27:46.717 [2024-11-21 03:44:27.111778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.717 [2024-11-21 03:44:27.111880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.717 [2024-11-21 03:44:27.111907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.717 qpair failed and we were unable to recover it. 00:27:46.717 [2024-11-21 03:44:27.112034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.717 [2024-11-21 03:44:27.112149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.717 [2024-11-21 03:44:27.112176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.717 qpair failed and we were unable to recover it. 00:27:46.717 [2024-11-21 03:44:27.112325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.717 [2024-11-21 03:44:27.112519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.717 [2024-11-21 03:44:27.112562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.717 qpair failed and we were unable to recover it. 00:27:46.717 [2024-11-21 03:44:27.112670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.717 [2024-11-21 03:44:27.112797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.717 [2024-11-21 03:44:27.112822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.717 qpair failed and we were unable to recover it. 00:27:46.717 [2024-11-21 03:44:27.112937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.717 [2024-11-21 03:44:27.113075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.717 [2024-11-21 03:44:27.113101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.717 qpair failed and we were unable to recover it. 00:27:46.717 [2024-11-21 03:44:27.113256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.717 [2024-11-21 03:44:27.113374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.717 [2024-11-21 03:44:27.113401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.717 qpair failed and we were unable to recover it. 00:27:46.717 [2024-11-21 03:44:27.113529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.717 [2024-11-21 03:44:27.113686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.717 [2024-11-21 03:44:27.113711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.717 qpair failed and we were unable to recover it. 00:27:46.717 [2024-11-21 03:44:27.113840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.717 [2024-11-21 03:44:27.113969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.717 [2024-11-21 03:44:27.113996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.717 qpair failed and we were unable to recover it. 00:27:46.717 [2024-11-21 03:44:27.114129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.717 [2024-11-21 03:44:27.114233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.717 [2024-11-21 03:44:27.114259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.717 qpair failed and we were unable to recover it. 00:27:46.717 [2024-11-21 03:44:27.114358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.717 [2024-11-21 03:44:27.114478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.717 [2024-11-21 03:44:27.114503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.717 qpair failed and we were unable to recover it. 00:27:46.717 [2024-11-21 03:44:27.114628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.717 [2024-11-21 03:44:27.114782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.717 [2024-11-21 03:44:27.114808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.717 qpair failed and we were unable to recover it. 00:27:46.717 [2024-11-21 03:44:27.114915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.717 [2024-11-21 03:44:27.115079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.717 [2024-11-21 03:44:27.115106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.717 qpair failed and we were unable to recover it. 00:27:46.717 [2024-11-21 03:44:27.115267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.717 [2024-11-21 03:44:27.115402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.717 [2024-11-21 03:44:27.115428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.717 qpair failed and we were unable to recover it. 00:27:46.717 [2024-11-21 03:44:27.115530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.718 [2024-11-21 03:44:27.115661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.718 [2024-11-21 03:44:27.115686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.718 qpair failed and we were unable to recover it. 00:27:46.718 [2024-11-21 03:44:27.115820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.718 [2024-11-21 03:44:27.115915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.718 [2024-11-21 03:44:27.115941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.718 qpair failed and we were unable to recover it. 00:27:46.718 [2024-11-21 03:44:27.116043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.718 [2024-11-21 03:44:27.116180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.718 [2024-11-21 03:44:27.116206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.718 qpair failed and we were unable to recover it. 00:27:46.718 [2024-11-21 03:44:27.116316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.718 [2024-11-21 03:44:27.116470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.718 [2024-11-21 03:44:27.116496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.718 qpair failed and we were unable to recover it. 00:27:46.718 [2024-11-21 03:44:27.116653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.718 [2024-11-21 03:44:27.116783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.718 [2024-11-21 03:44:27.116808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.718 qpair failed and we were unable to recover it. 00:27:46.718 [2024-11-21 03:44:27.116941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.718 [2024-11-21 03:44:27.117104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.718 [2024-11-21 03:44:27.117131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.718 qpair failed and we were unable to recover it. 00:27:46.718 [2024-11-21 03:44:27.117287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.718 [2024-11-21 03:44:27.117447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.718 [2024-11-21 03:44:27.117490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.718 qpair failed and we were unable to recover it. 00:27:46.718 [2024-11-21 03:44:27.117627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.718 [2024-11-21 03:44:27.117755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.718 [2024-11-21 03:44:27.117782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.718 qpair failed and we were unable to recover it. 00:27:46.718 [2024-11-21 03:44:27.117891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.718 [2024-11-21 03:44:27.118019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.718 [2024-11-21 03:44:27.118044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.718 qpair failed and we were unable to recover it. 00:27:46.718 [2024-11-21 03:44:27.118179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.718 [2024-11-21 03:44:27.118326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.718 [2024-11-21 03:44:27.118369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.718 qpair failed and we were unable to recover it. 00:27:46.718 [2024-11-21 03:44:27.118471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.718 [2024-11-21 03:44:27.118626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.718 [2024-11-21 03:44:27.118651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.718 qpair failed and we were unable to recover it. 00:27:46.718 [2024-11-21 03:44:27.118784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.718 [2024-11-21 03:44:27.118941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.718 [2024-11-21 03:44:27.118967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.718 qpair failed and we were unable to recover it. 00:27:46.718 [2024-11-21 03:44:27.119150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.718 [2024-11-21 03:44:27.119295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.718 [2024-11-21 03:44:27.119338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.718 qpair failed and we were unable to recover it. 00:27:46.718 [2024-11-21 03:44:27.119437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.718 [2024-11-21 03:44:27.119594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.718 [2024-11-21 03:44:27.119620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.718 qpair failed and we were unable to recover it. 00:27:46.718 [2024-11-21 03:44:27.119787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.718 [2024-11-21 03:44:27.119913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.718 [2024-11-21 03:44:27.119940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.718 qpair failed and we were unable to recover it. 00:27:46.718 [2024-11-21 03:44:27.120103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.718 [2024-11-21 03:44:27.120259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.718 [2024-11-21 03:44:27.120284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.718 qpair failed and we were unable to recover it. 00:27:46.718 [2024-11-21 03:44:27.120458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.718 [2024-11-21 03:44:27.120604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.718 [2024-11-21 03:44:27.120630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.718 qpair failed and we were unable to recover it. 00:27:46.718 [2024-11-21 03:44:27.120797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.718 [2024-11-21 03:44:27.120925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.718 [2024-11-21 03:44:27.120951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.718 qpair failed and we were unable to recover it. 00:27:46.718 [2024-11-21 03:44:27.121048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.718 [2024-11-21 03:44:27.121213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.718 [2024-11-21 03:44:27.121261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.718 qpair failed and we were unable to recover it. 00:27:46.718 [2024-11-21 03:44:27.121396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.718 [2024-11-21 03:44:27.121527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.718 [2024-11-21 03:44:27.121553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.718 qpair failed and we were unable to recover it. 00:27:46.718 [2024-11-21 03:44:27.121651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.718 [2024-11-21 03:44:27.121783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.718 [2024-11-21 03:44:27.121808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:46.718 qpair failed and we were unable to recover it. 00:27:46.718 [2024-11-21 03:44:27.121962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.718 [2024-11-21 03:44:27.122114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.718 [2024-11-21 03:44:27.122144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.718 qpair failed and we were unable to recover it. 00:27:46.718 [2024-11-21 03:44:27.122277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.718 [2024-11-21 03:44:27.122406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.718 [2024-11-21 03:44:27.122432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.718 qpair failed and we were unable to recover it. 00:27:46.718 [2024-11-21 03:44:27.122565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.718 [2024-11-21 03:44:27.122689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.718 [2024-11-21 03:44:27.122716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.718 qpair failed and we were unable to recover it. 00:27:46.718 [2024-11-21 03:44:27.122883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.718 [2024-11-21 03:44:27.123021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.718 [2024-11-21 03:44:27.123049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.719 qpair failed and we were unable to recover it. 00:27:46.719 [2024-11-21 03:44:27.123197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.719 [2024-11-21 03:44:27.123335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.719 [2024-11-21 03:44:27.123363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.719 qpair failed and we were unable to recover it. 00:27:46.719 [2024-11-21 03:44:27.123504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.719 [2024-11-21 03:44:27.123621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.719 [2024-11-21 03:44:27.123649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.719 qpair failed and we were unable to recover it. 00:27:46.719 [2024-11-21 03:44:27.123764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.719 [2024-11-21 03:44:27.123903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.719 [2024-11-21 03:44:27.123930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.719 qpair failed and we were unable to recover it. 00:27:46.719 [2024-11-21 03:44:27.124081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.719 [2024-11-21 03:44:27.124181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.719 [2024-11-21 03:44:27.124206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.719 qpair failed and we were unable to recover it. 00:27:46.719 [2024-11-21 03:44:27.124356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.719 [2024-11-21 03:44:27.124498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.719 [2024-11-21 03:44:27.124525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.719 qpair failed and we were unable to recover it. 00:27:46.719 [2024-11-21 03:44:27.124639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.719 [2024-11-21 03:44:27.124780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.719 [2024-11-21 03:44:27.124808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.719 qpair failed and we were unable to recover it. 00:27:46.719 [2024-11-21 03:44:27.124982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.719 [2024-11-21 03:44:27.125141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.719 [2024-11-21 03:44:27.125167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.719 qpair failed and we were unable to recover it. 00:27:46.719 [2024-11-21 03:44:27.125306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.719 [2024-11-21 03:44:27.125465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.719 [2024-11-21 03:44:27.125507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.719 qpair failed and we were unable to recover it. 00:27:46.719 [2024-11-21 03:44:27.125712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.719 [2024-11-21 03:44:27.125884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.719 [2024-11-21 03:44:27.125912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.719 qpair failed and we were unable to recover it. 00:27:46.719 [2024-11-21 03:44:27.126082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.719 [2024-11-21 03:44:27.126208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.719 [2024-11-21 03:44:27.126234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.719 qpair failed and we were unable to recover it. 00:27:46.719 [2024-11-21 03:44:27.126386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.719 [2024-11-21 03:44:27.126528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.719 [2024-11-21 03:44:27.126557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.719 qpair failed and we were unable to recover it. 00:27:46.719 [2024-11-21 03:44:27.126667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.719 [2024-11-21 03:44:27.126771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.719 [2024-11-21 03:44:27.126799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.719 qpair failed and we were unable to recover it. 00:27:46.719 [2024-11-21 03:44:27.126967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.719 [2024-11-21 03:44:27.127080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.719 [2024-11-21 03:44:27.127120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.719 qpair failed and we were unable to recover it. 00:27:46.719 [2024-11-21 03:44:27.127250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.719 [2024-11-21 03:44:27.127406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.719 [2024-11-21 03:44:27.127434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.719 qpair failed and we were unable to recover it. 00:27:46.719 [2024-11-21 03:44:27.127554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.719 [2024-11-21 03:44:27.127702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.719 [2024-11-21 03:44:27.127730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.719 qpair failed and we were unable to recover it. 00:27:46.719 [2024-11-21 03:44:27.127870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.719 [2024-11-21 03:44:27.128021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.719 [2024-11-21 03:44:27.128046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.719 qpair failed and we were unable to recover it. 00:27:46.719 [2024-11-21 03:44:27.128158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.719 [2024-11-21 03:44:27.128286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.719 [2024-11-21 03:44:27.128316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.719 qpair failed and we were unable to recover it. 00:27:46.719 [2024-11-21 03:44:27.128413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.719 [2024-11-21 03:44:27.128575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.719 [2024-11-21 03:44:27.128603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.719 qpair failed and we were unable to recover it. 00:27:46.719 [2024-11-21 03:44:27.128776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.719 [2024-11-21 03:44:27.128888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.719 [2024-11-21 03:44:27.128918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.719 qpair failed and we were unable to recover it. 00:27:46.719 [2024-11-21 03:44:27.129025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.719 [2024-11-21 03:44:27.129210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.719 [2024-11-21 03:44:27.129235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.719 qpair failed and we were unable to recover it. 00:27:46.719 [2024-11-21 03:44:27.129360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.719 [2024-11-21 03:44:27.129468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.719 [2024-11-21 03:44:27.129493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.719 qpair failed and we were unable to recover it. 00:27:46.719 [2024-11-21 03:44:27.129692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.719 [2024-11-21 03:44:27.129870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.719 [2024-11-21 03:44:27.129898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.719 qpair failed and we were unable to recover it. 00:27:46.719 [2024-11-21 03:44:27.130041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.719 [2024-11-21 03:44:27.130203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.720 [2024-11-21 03:44:27.130229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.720 qpair failed and we were unable to recover it. 00:27:46.720 [2024-11-21 03:44:27.130355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.720 [2024-11-21 03:44:27.130460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.720 [2024-11-21 03:44:27.130488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.720 qpair failed and we were unable to recover it. 00:27:46.720 [2024-11-21 03:44:27.130682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.720 [2024-11-21 03:44:27.130819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.720 [2024-11-21 03:44:27.130847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.720 qpair failed and we were unable to recover it. 00:27:46.720 [2024-11-21 03:44:27.131023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.720 [2024-11-21 03:44:27.131182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.720 [2024-11-21 03:44:27.131208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.720 qpair failed and we were unable to recover it. 00:27:46.720 [2024-11-21 03:44:27.131334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.720 [2024-11-21 03:44:27.131494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.720 [2024-11-21 03:44:27.131527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.720 qpair failed and we were unable to recover it. 00:27:46.720 [2024-11-21 03:44:27.131666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.720 [2024-11-21 03:44:27.131784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.720 [2024-11-21 03:44:27.131812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.720 qpair failed and we were unable to recover it. 00:27:46.720 [2024-11-21 03:44:27.132019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.720 [2024-11-21 03:44:27.132171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.720 [2024-11-21 03:44:27.132197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.720 qpair failed and we were unable to recover it. 00:27:46.720 [2024-11-21 03:44:27.132335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.720 [2024-11-21 03:44:27.132453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.720 [2024-11-21 03:44:27.132481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.720 qpair failed and we were unable to recover it. 00:27:46.720 [2024-11-21 03:44:27.132671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.720 [2024-11-21 03:44:27.132845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.720 [2024-11-21 03:44:27.132873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.720 qpair failed and we were unable to recover it. 00:27:46.720 [2024-11-21 03:44:27.133015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.720 [2024-11-21 03:44:27.133192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.720 [2024-11-21 03:44:27.133218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.720 qpair failed and we were unable to recover it. 00:27:46.720 [2024-11-21 03:44:27.133348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.720 [2024-11-21 03:44:27.133472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.720 [2024-11-21 03:44:27.133496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.720 qpair failed and we were unable to recover it. 00:27:46.720 [2024-11-21 03:44:27.133647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.720 [2024-11-21 03:44:27.133777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.720 [2024-11-21 03:44:27.133805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.720 qpair failed and we were unable to recover it. 00:27:46.720 [2024-11-21 03:44:27.133953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.720 [2024-11-21 03:44:27.134085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.720 [2024-11-21 03:44:27.134127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.720 qpair failed and we were unable to recover it. 00:27:46.720 [2024-11-21 03:44:27.134286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.720 [2024-11-21 03:44:27.134462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.720 [2024-11-21 03:44:27.134490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.720 qpair failed and we were unable to recover it. 00:27:46.720 [2024-11-21 03:44:27.134641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.720 [2024-11-21 03:44:27.134769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.720 [2024-11-21 03:44:27.134794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.720 qpair failed and we were unable to recover it. 00:27:46.720 [2024-11-21 03:44:27.134894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.720 [2024-11-21 03:44:27.135047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.720 [2024-11-21 03:44:27.135077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.720 qpair failed and we were unable to recover it. 00:27:46.720 [2024-11-21 03:44:27.135234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.720 [2024-11-21 03:44:27.135383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.720 [2024-11-21 03:44:27.135407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.720 qpair failed and we were unable to recover it. 00:27:46.720 [2024-11-21 03:44:27.135564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.720 [2024-11-21 03:44:27.135687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.720 [2024-11-21 03:44:27.135715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.720 qpair failed and we were unable to recover it. 00:27:46.720 [2024-11-21 03:44:27.135828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.720 [2024-11-21 03:44:27.135953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.720 [2024-11-21 03:44:27.135977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.720 qpair failed and we were unable to recover it. 00:27:46.720 [2024-11-21 03:44:27.136121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.720 [2024-11-21 03:44:27.136223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.720 [2024-11-21 03:44:27.136251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.720 qpair failed and we were unable to recover it. 00:27:46.720 [2024-11-21 03:44:27.136428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.720 [2024-11-21 03:44:27.136576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.720 [2024-11-21 03:44:27.136601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.720 qpair failed and we were unable to recover it. 00:27:46.720 [2024-11-21 03:44:27.136765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.720 [2024-11-21 03:44:27.136913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.720 [2024-11-21 03:44:27.136941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.720 qpair failed and we were unable to recover it. 00:27:46.720 [2024-11-21 03:44:27.137088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.720 [2024-11-21 03:44:27.137221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.720 [2024-11-21 03:44:27.137246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.720 qpair failed and we were unable to recover it. 00:27:46.720 [2024-11-21 03:44:27.137378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.720 [2024-11-21 03:44:27.137566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.720 [2024-11-21 03:44:27.137591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.720 qpair failed and we were unable to recover it. 00:27:46.720 [2024-11-21 03:44:27.137727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.720 [2024-11-21 03:44:27.137859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.720 [2024-11-21 03:44:27.137884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.720 qpair failed and we were unable to recover it. 00:27:46.720 [2024-11-21 03:44:27.138030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.720 [2024-11-21 03:44:27.138191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.720 [2024-11-21 03:44:27.138217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.720 qpair failed and we were unable to recover it. 00:27:46.720 [2024-11-21 03:44:27.138347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.720 [2024-11-21 03:44:27.138476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.720 [2024-11-21 03:44:27.138501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.721 qpair failed and we were unable to recover it. 00:27:46.721 [2024-11-21 03:44:27.138657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.721 [2024-11-21 03:44:27.138833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.721 [2024-11-21 03:44:27.138860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.721 qpair failed and we were unable to recover it. 00:27:46.721 [2024-11-21 03:44:27.139032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.721 [2024-11-21 03:44:27.139180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.721 [2024-11-21 03:44:27.139208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.721 qpair failed and we were unable to recover it. 00:27:46.721 [2024-11-21 03:44:27.139351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.721 [2024-11-21 03:44:27.139516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.721 [2024-11-21 03:44:27.139544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.721 qpair failed and we were unable to recover it. 00:27:46.721 [2024-11-21 03:44:27.139689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.721 [2024-11-21 03:44:27.139852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.721 [2024-11-21 03:44:27.139877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.721 qpair failed and we were unable to recover it. 00:27:46.721 [2024-11-21 03:44:27.140060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.721 [2024-11-21 03:44:27.140227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.721 [2024-11-21 03:44:27.140252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.721 qpair failed and we were unable to recover it. 00:27:46.721 [2024-11-21 03:44:27.140346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.721 [2024-11-21 03:44:27.140490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.721 [2024-11-21 03:44:27.140518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.721 qpair failed and we were unable to recover it. 00:27:46.721 [2024-11-21 03:44:27.140687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.721 [2024-11-21 03:44:27.140805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.721 [2024-11-21 03:44:27.140833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.721 qpair failed and we were unable to recover it. 00:27:46.721 [2024-11-21 03:44:27.140978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.721 [2024-11-21 03:44:27.141090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.721 [2024-11-21 03:44:27.141116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.721 qpair failed and we were unable to recover it. 00:27:46.721 [2024-11-21 03:44:27.141240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.721 [2024-11-21 03:44:27.141357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.721 [2024-11-21 03:44:27.141383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.721 qpair failed and we were unable to recover it. 00:27:46.721 [2024-11-21 03:44:27.141484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.721 [2024-11-21 03:44:27.141574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.721 [2024-11-21 03:44:27.141599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.721 qpair failed and we were unable to recover it. 00:27:46.721 [2024-11-21 03:44:27.141759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.721 [2024-11-21 03:44:27.141938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.721 [2024-11-21 03:44:27.141963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.721 qpair failed and we were unable to recover it. 00:27:46.721 [2024-11-21 03:44:27.142090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.721 [2024-11-21 03:44:27.142200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.721 [2024-11-21 03:44:27.142225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.721 qpair failed and we were unable to recover it. 00:27:46.721 [2024-11-21 03:44:27.142398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.721 [2024-11-21 03:44:27.142571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.721 [2024-11-21 03:44:27.142598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.721 qpair failed and we were unable to recover it. 00:27:46.721 [2024-11-21 03:44:27.142752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.721 [2024-11-21 03:44:27.142926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.721 [2024-11-21 03:44:27.142951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.721 qpair failed and we were unable to recover it. 00:27:46.721 [2024-11-21 03:44:27.143088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.721 [2024-11-21 03:44:27.143228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.721 [2024-11-21 03:44:27.143255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.721 qpair failed and we were unable to recover it. 00:27:46.721 [2024-11-21 03:44:27.143386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.721 [2024-11-21 03:44:27.143513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.721 [2024-11-21 03:44:27.143538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.721 qpair failed and we were unable to recover it. 00:27:46.721 [2024-11-21 03:44:27.143712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.721 [2024-11-21 03:44:27.143849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.721 [2024-11-21 03:44:27.143877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.721 qpair failed and we were unable to recover it. 00:27:46.721 [2024-11-21 03:44:27.144057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.721 [2024-11-21 03:44:27.144190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.721 [2024-11-21 03:44:27.144215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.721 qpair failed and we were unable to recover it. 00:27:46.721 [2024-11-21 03:44:27.144396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.721 [2024-11-21 03:44:27.144515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.721 [2024-11-21 03:44:27.144556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.721 qpair failed and we were unable to recover it. 00:27:46.721 [2024-11-21 03:44:27.144709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.721 [2024-11-21 03:44:27.144834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.721 [2024-11-21 03:44:27.144874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.721 qpair failed and we were unable to recover it. 00:27:46.721 [2024-11-21 03:44:27.145019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.721 [2024-11-21 03:44:27.145190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.721 [2024-11-21 03:44:27.145216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.721 qpair failed and we were unable to recover it. 00:27:46.721 [2024-11-21 03:44:27.145349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.721 [2024-11-21 03:44:27.145538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.721 [2024-11-21 03:44:27.145563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.721 qpair failed and we were unable to recover it. 00:27:46.721 [2024-11-21 03:44:27.145721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.721 [2024-11-21 03:44:27.145838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.721 [2024-11-21 03:44:27.145866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.721 qpair failed and we were unable to recover it. 00:27:46.721 [2024-11-21 03:44:27.145994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.721 [2024-11-21 03:44:27.146161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.721 [2024-11-21 03:44:27.146188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.721 qpair failed and we were unable to recover it. 00:27:46.721 [2024-11-21 03:44:27.146297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.721 [2024-11-21 03:44:27.146406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.721 [2024-11-21 03:44:27.146434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.721 qpair failed and we were unable to recover it. 00:27:46.721 [2024-11-21 03:44:27.146581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.721 [2024-11-21 03:44:27.146752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.721 [2024-11-21 03:44:27.146777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.721 qpair failed and we were unable to recover it. 00:27:46.722 [2024-11-21 03:44:27.146957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.722 [2024-11-21 03:44:27.147127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.722 [2024-11-21 03:44:27.147156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.722 qpair failed and we were unable to recover it. 00:27:46.722 [2024-11-21 03:44:27.147316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.722 [2024-11-21 03:44:27.147436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.722 [2024-11-21 03:44:27.147461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.722 qpair failed and we were unable to recover it. 00:27:46.722 [2024-11-21 03:44:27.147613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.722 [2024-11-21 03:44:27.147741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.722 [2024-11-21 03:44:27.147770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.722 qpair failed and we were unable to recover it. 00:27:46.722 [2024-11-21 03:44:27.147943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.722 [2024-11-21 03:44:27.148047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.722 [2024-11-21 03:44:27.148080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.722 qpair failed and we were unable to recover it. 00:27:46.722 [2024-11-21 03:44:27.148226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.722 [2024-11-21 03:44:27.148339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.722 [2024-11-21 03:44:27.148367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.722 qpair failed and we were unable to recover it. 00:27:46.722 [2024-11-21 03:44:27.148514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.722 [2024-11-21 03:44:27.148647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.722 [2024-11-21 03:44:27.148672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.722 qpair failed and we were unable to recover it. 00:27:46.722 [2024-11-21 03:44:27.148781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.722 [2024-11-21 03:44:27.148903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.722 [2024-11-21 03:44:27.148933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.722 qpair failed and we were unable to recover it. 00:27:46.722 [2024-11-21 03:44:27.149047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.722 [2024-11-21 03:44:27.149225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.722 [2024-11-21 03:44:27.149254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.722 qpair failed and we were unable to recover it. 00:27:46.722 [2024-11-21 03:44:27.149421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.722 [2024-11-21 03:44:27.149562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.722 [2024-11-21 03:44:27.149590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.722 qpair failed and we were unable to recover it. 00:27:46.722 [2024-11-21 03:44:27.149748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.722 [2024-11-21 03:44:27.149850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.722 [2024-11-21 03:44:27.149875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.722 qpair failed and we were unable to recover it. 00:27:46.722 [2024-11-21 03:44:27.149991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.722 [2024-11-21 03:44:27.150131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.722 [2024-11-21 03:44:27.150159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.722 qpair failed and we were unable to recover it. 00:27:46.722 [2024-11-21 03:44:27.150331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.722 [2024-11-21 03:44:27.150468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.722 [2024-11-21 03:44:27.150496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.722 qpair failed and we were unable to recover it. 00:27:46.722 [2024-11-21 03:44:27.150678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.722 [2024-11-21 03:44:27.150804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.722 [2024-11-21 03:44:27.150829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.722 qpair failed and we were unable to recover it. 00:27:46.722 [2024-11-21 03:44:27.150960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.722 [2024-11-21 03:44:27.151074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.722 [2024-11-21 03:44:27.151100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.722 qpair failed and we were unable to recover it. 00:27:46.722 [2024-11-21 03:44:27.151217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.722 [2024-11-21 03:44:27.151354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.722 [2024-11-21 03:44:27.151382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.722 qpair failed and we were unable to recover it. 00:27:46.722 [2024-11-21 03:44:27.151527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.722 [2024-11-21 03:44:27.151672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.722 [2024-11-21 03:44:27.151700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.722 qpair failed and we were unable to recover it. 00:27:46.722 [2024-11-21 03:44:27.151821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.722 [2024-11-21 03:44:27.151932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.722 [2024-11-21 03:44:27.151974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.722 qpair failed and we were unable to recover it. 00:27:46.722 [2024-11-21 03:44:27.152128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.722 [2024-11-21 03:44:27.152232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.722 [2024-11-21 03:44:27.152257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.722 qpair failed and we were unable to recover it. 00:27:46.722 [2024-11-21 03:44:27.152356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.722 [2024-11-21 03:44:27.152486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.722 [2024-11-21 03:44:27.152511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.722 qpair failed and we were unable to recover it. 00:27:46.722 [2024-11-21 03:44:27.152627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.722 [2024-11-21 03:44:27.152780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.722 [2024-11-21 03:44:27.152805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.722 qpair failed and we were unable to recover it. 00:27:46.722 [2024-11-21 03:44:27.152963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.722 [2024-11-21 03:44:27.153083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.722 [2024-11-21 03:44:27.153112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.722 qpair failed and we were unable to recover it. 00:27:46.722 [2024-11-21 03:44:27.153260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.722 [2024-11-21 03:44:27.153386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.722 [2024-11-21 03:44:27.153412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.722 qpair failed and we were unable to recover it. 00:27:46.722 [2024-11-21 03:44:27.153569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.722 [2024-11-21 03:44:27.153683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.722 [2024-11-21 03:44:27.153710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.722 qpair failed and we were unable to recover it. 00:27:46.722 [2024-11-21 03:44:27.153888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.722 [2024-11-21 03:44:27.154058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.722 [2024-11-21 03:44:27.154094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.722 qpair failed and we were unable to recover it. 00:27:46.722 [2024-11-21 03:44:27.154249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.722 [2024-11-21 03:44:27.154343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.722 [2024-11-21 03:44:27.154368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.722 qpair failed and we were unable to recover it. 00:27:46.722 [2024-11-21 03:44:27.154495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.722 [2024-11-21 03:44:27.154624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.722 [2024-11-21 03:44:27.154649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.722 qpair failed and we were unable to recover it. 00:27:46.722 [2024-11-21 03:44:27.154772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.722 [2024-11-21 03:44:27.154925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.722 [2024-11-21 03:44:27.154949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.722 qpair failed and we were unable to recover it. 00:27:46.722 [2024-11-21 03:44:27.155046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.722 [2024-11-21 03:44:27.155184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.722 [2024-11-21 03:44:27.155227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.723 qpair failed and we were unable to recover it. 00:27:46.723 [2024-11-21 03:44:27.155396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.723 [2024-11-21 03:44:27.155541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.723 [2024-11-21 03:44:27.155566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.723 qpair failed and we were unable to recover it. 00:27:46.723 [2024-11-21 03:44:27.155687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.723 [2024-11-21 03:44:27.155813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.723 [2024-11-21 03:44:27.155838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.723 qpair failed and we were unable to recover it. 00:27:46.723 [2024-11-21 03:44:27.155963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.723 [2024-11-21 03:44:27.156104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.723 [2024-11-21 03:44:27.156133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.723 qpair failed and we were unable to recover it. 00:27:46.723 [2024-11-21 03:44:27.156306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.723 [2024-11-21 03:44:27.156439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.723 [2024-11-21 03:44:27.156467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.723 qpair failed and we were unable to recover it. 00:27:46.723 [2024-11-21 03:44:27.156615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.723 [2024-11-21 03:44:27.156791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.723 [2024-11-21 03:44:27.156816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.723 qpair failed and we were unable to recover it. 00:27:46.723 [2024-11-21 03:44:27.156916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.723 [2024-11-21 03:44:27.157034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.723 [2024-11-21 03:44:27.157059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.723 qpair failed and we were unable to recover it. 00:27:46.723 [2024-11-21 03:44:27.157238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.723 [2024-11-21 03:44:27.157407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.723 [2024-11-21 03:44:27.157435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.723 qpair failed and we were unable to recover it. 00:27:46.723 [2024-11-21 03:44:27.157575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.723 [2024-11-21 03:44:27.157722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.723 [2024-11-21 03:44:27.157747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.723 qpair failed and we were unable to recover it. 00:27:46.723 [2024-11-21 03:44:27.157906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.723 [2024-11-21 03:44:27.158098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.723 [2024-11-21 03:44:27.158124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.723 qpair failed and we were unable to recover it. 00:27:46.723 [2024-11-21 03:44:27.158256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.723 [2024-11-21 03:44:27.158410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.723 [2024-11-21 03:44:27.158434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.723 qpair failed and we were unable to recover it. 00:27:46.723 [2024-11-21 03:44:27.158568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.723 [2024-11-21 03:44:27.158686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.723 [2024-11-21 03:44:27.158713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.723 qpair failed and we were unable to recover it. 00:27:46.723 [2024-11-21 03:44:27.158892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.723 [2024-11-21 03:44:27.159029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.723 [2024-11-21 03:44:27.159056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.723 qpair failed and we were unable to recover it. 00:27:46.723 [2024-11-21 03:44:27.159206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.723 [2024-11-21 03:44:27.159361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.723 [2024-11-21 03:44:27.159385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.723 qpair failed and we were unable to recover it. 00:27:46.723 [2024-11-21 03:44:27.159539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.723 [2024-11-21 03:44:27.159707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.723 [2024-11-21 03:44:27.159735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.723 qpair failed and we were unable to recover it. 00:27:46.723 [2024-11-21 03:44:27.159875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.723 [2024-11-21 03:44:27.160041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.723 [2024-11-21 03:44:27.160076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.723 qpair failed and we were unable to recover it. 00:27:46.723 [2024-11-21 03:44:27.160190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.723 [2024-11-21 03:44:27.160331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.723 [2024-11-21 03:44:27.160360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.723 qpair failed and we were unable to recover it. 00:27:46.723 [2024-11-21 03:44:27.160517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.723 [2024-11-21 03:44:27.160621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.723 [2024-11-21 03:44:27.160646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.723 qpair failed and we were unable to recover it. 00:27:46.723 [2024-11-21 03:44:27.160771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.723 [2024-11-21 03:44:27.160900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.723 [2024-11-21 03:44:27.160925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.723 qpair failed and we were unable to recover it. 00:27:46.723 [2024-11-21 03:44:27.161101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.723 [2024-11-21 03:44:27.161257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.723 [2024-11-21 03:44:27.161282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.723 qpair failed and we were unable to recover it. 00:27:46.723 [2024-11-21 03:44:27.161387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.723 [2024-11-21 03:44:27.161563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.723 [2024-11-21 03:44:27.161592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.723 qpair failed and we were unable to recover it. 00:27:46.723 [2024-11-21 03:44:27.161761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.723 [2024-11-21 03:44:27.161937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.723 [2024-11-21 03:44:27.161962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.723 qpair failed and we were unable to recover it. 00:27:46.723 [2024-11-21 03:44:27.162090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.723 [2024-11-21 03:44:27.162215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.723 [2024-11-21 03:44:27.162240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.723 qpair failed and we were unable to recover it. 00:27:46.723 [2024-11-21 03:44:27.162336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.723 [2024-11-21 03:44:27.162494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.723 [2024-11-21 03:44:27.162522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.723 qpair failed and we were unable to recover it. 00:27:46.723 [2024-11-21 03:44:27.162692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.723 [2024-11-21 03:44:27.162806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.723 [2024-11-21 03:44:27.162835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.723 qpair failed and we were unable to recover it. 00:27:46.723 [2024-11-21 03:44:27.162979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.723 [2024-11-21 03:44:27.163105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.723 [2024-11-21 03:44:27.163130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.723 qpair failed and we were unable to recover it. 00:27:46.723 [2024-11-21 03:44:27.163284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.723 [2024-11-21 03:44:27.163458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.723 [2024-11-21 03:44:27.163490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.723 qpair failed and we were unable to recover it. 00:27:46.723 [2024-11-21 03:44:27.163626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.723 [2024-11-21 03:44:27.163741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.723 [2024-11-21 03:44:27.163768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.723 qpair failed and we were unable to recover it. 00:27:46.723 [2024-11-21 03:44:27.163920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.723 [2024-11-21 03:44:27.164053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.724 [2024-11-21 03:44:27.164102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.724 qpair failed and we were unable to recover it. 00:27:46.724 [2024-11-21 03:44:27.164260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.724 [2024-11-21 03:44:27.164378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.724 [2024-11-21 03:44:27.164406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.724 qpair failed and we were unable to recover it. 00:27:46.724 [2024-11-21 03:44:27.164557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.724 [2024-11-21 03:44:27.164685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.724 [2024-11-21 03:44:27.164710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.724 qpair failed and we were unable to recover it. 00:27:46.724 [2024-11-21 03:44:27.164859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.724 [2024-11-21 03:44:27.165000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.724 [2024-11-21 03:44:27.165028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.724 qpair failed and we were unable to recover it. 00:27:46.724 [2024-11-21 03:44:27.165162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.724 [2024-11-21 03:44:27.165303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.724 [2024-11-21 03:44:27.165332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.724 qpair failed and we were unable to recover it. 00:27:46.724 [2024-11-21 03:44:27.165480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.724 [2024-11-21 03:44:27.165648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.724 [2024-11-21 03:44:27.165676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.724 qpair failed and we were unable to recover it. 00:27:46.724 [2024-11-21 03:44:27.165828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.724 [2024-11-21 03:44:27.165982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.724 [2024-11-21 03:44:27.166007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.724 qpair failed and we were unable to recover it. 00:27:46.724 [2024-11-21 03:44:27.166205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.724 [2024-11-21 03:44:27.166362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.724 [2024-11-21 03:44:27.166387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.724 qpair failed and we were unable to recover it. 00:27:46.724 [2024-11-21 03:44:27.166545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.724 [2024-11-21 03:44:27.166737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.724 [2024-11-21 03:44:27.166762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.724 qpair failed and we were unable to recover it. 00:27:46.724 [2024-11-21 03:44:27.166922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.724 [2024-11-21 03:44:27.167114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.724 [2024-11-21 03:44:27.167141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.724 qpair failed and we were unable to recover it. 00:27:46.724 [2024-11-21 03:44:27.167299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.724 [2024-11-21 03:44:27.167426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.724 [2024-11-21 03:44:27.167468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.724 qpair failed and we were unable to recover it. 00:27:46.724 [2024-11-21 03:44:27.167606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.724 [2024-11-21 03:44:27.167749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.724 [2024-11-21 03:44:27.167774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.724 qpair failed and we were unable to recover it. 00:27:46.724 [2024-11-21 03:44:27.167895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.724 [2024-11-21 03:44:27.168072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.724 [2024-11-21 03:44:27.168098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.724 qpair failed and we were unable to recover it. 00:27:46.724 [2024-11-21 03:44:27.168257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.724 [2024-11-21 03:44:27.168379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.724 [2024-11-21 03:44:27.168407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.724 qpair failed and we were unable to recover it. 00:27:46.724 [2024-11-21 03:44:27.168585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.724 [2024-11-21 03:44:27.168738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.724 [2024-11-21 03:44:27.168781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.724 qpair failed and we were unable to recover it. 00:27:46.724 [2024-11-21 03:44:27.168921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.724 [2024-11-21 03:44:27.169067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.724 [2024-11-21 03:44:27.169119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.724 qpair failed and we were unable to recover it. 00:27:46.724 [2024-11-21 03:44:27.169304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.724 [2024-11-21 03:44:27.169433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.724 [2024-11-21 03:44:27.169459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.724 qpair failed and we were unable to recover it. 00:27:46.724 [2024-11-21 03:44:27.169641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.724 [2024-11-21 03:44:27.169781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.724 [2024-11-21 03:44:27.169809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.724 qpair failed and we were unable to recover it. 00:27:46.724 [2024-11-21 03:44:27.169990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.724 [2024-11-21 03:44:27.170118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.724 [2024-11-21 03:44:27.170159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.724 qpair failed and we were unable to recover it. 00:27:46.724 [2024-11-21 03:44:27.170317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.724 [2024-11-21 03:44:27.170423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.724 [2024-11-21 03:44:27.170449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.724 qpair failed and we were unable to recover it. 00:27:46.724 [2024-11-21 03:44:27.170593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.724 [2024-11-21 03:44:27.170697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.724 [2024-11-21 03:44:27.170739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.724 qpair failed and we were unable to recover it. 00:27:46.724 [2024-11-21 03:44:27.170865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.724 [2024-11-21 03:44:27.170996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.724 [2024-11-21 03:44:27.171021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.724 qpair failed and we were unable to recover it. 00:27:46.724 [2024-11-21 03:44:27.171123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.724 [2024-11-21 03:44:27.171232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.724 [2024-11-21 03:44:27.171257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.724 qpair failed and we were unable to recover it. 00:27:46.724 [2024-11-21 03:44:27.171375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.724 [2024-11-21 03:44:27.171480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.724 [2024-11-21 03:44:27.171509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.724 qpair failed and we were unable to recover it. 00:27:46.724 [2024-11-21 03:44:27.171630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.724 [2024-11-21 03:44:27.171794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.724 [2024-11-21 03:44:27.171822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.725 qpair failed and we were unable to recover it. 00:27:46.725 [2024-11-21 03:44:27.171973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.725 [2024-11-21 03:44:27.172081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.725 [2024-11-21 03:44:27.172109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.725 qpair failed and we were unable to recover it. 00:27:46.725 [2024-11-21 03:44:27.172220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.725 [2024-11-21 03:44:27.172324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.725 [2024-11-21 03:44:27.172349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.725 qpair failed and we were unable to recover it. 00:27:46.725 [2024-11-21 03:44:27.172468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.725 [2024-11-21 03:44:27.172585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.725 [2024-11-21 03:44:27.172613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.725 qpair failed and we were unable to recover it. 00:27:46.725 [2024-11-21 03:44:27.172748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.725 [2024-11-21 03:44:27.172901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.725 [2024-11-21 03:44:27.172926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.725 qpair failed and we were unable to recover it. 00:27:46.725 [2024-11-21 03:44:27.173056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.725 [2024-11-21 03:44:27.173242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.725 [2024-11-21 03:44:27.173270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.725 qpair failed and we were unable to recover it. 00:27:46.725 [2024-11-21 03:44:27.173395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.725 [2024-11-21 03:44:27.173519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.725 [2024-11-21 03:44:27.173544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.725 qpair failed and we were unable to recover it. 00:27:46.725 [2024-11-21 03:44:27.173735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.725 [2024-11-21 03:44:27.173865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.725 [2024-11-21 03:44:27.173890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.725 qpair failed and we were unable to recover it. 00:27:46.725 [2024-11-21 03:44:27.174045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.725 [2024-11-21 03:44:27.174233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.725 [2024-11-21 03:44:27.174259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.725 qpair failed and we were unable to recover it. 00:27:46.725 [2024-11-21 03:44:27.174384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.725 [2024-11-21 03:44:27.174497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.725 [2024-11-21 03:44:27.174525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.725 qpair failed and we were unable to recover it. 00:27:46.725 [2024-11-21 03:44:27.174672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.725 [2024-11-21 03:44:27.174777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.725 [2024-11-21 03:44:27.174801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.725 qpair failed and we were unable to recover it. 00:27:46.725 [2024-11-21 03:44:27.174955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.725 [2024-11-21 03:44:27.175111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.725 [2024-11-21 03:44:27.175137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.725 qpair failed and we were unable to recover it. 00:27:46.725 [2024-11-21 03:44:27.175243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.725 [2024-11-21 03:44:27.175410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.725 [2024-11-21 03:44:27.175438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.725 qpair failed and we were unable to recover it. 00:27:46.725 [2024-11-21 03:44:27.175606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.725 [2024-11-21 03:44:27.175784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.725 [2024-11-21 03:44:27.175809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.725 qpair failed and we were unable to recover it. 00:27:46.725 [2024-11-21 03:44:27.175938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.725 [2024-11-21 03:44:27.176097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.725 [2024-11-21 03:44:27.176122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.725 qpair failed and we were unable to recover it. 00:27:46.725 [2024-11-21 03:44:27.176246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.725 [2024-11-21 03:44:27.176389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.725 [2024-11-21 03:44:27.176418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.725 qpair failed and we were unable to recover it. 00:27:46.725 [2024-11-21 03:44:27.176596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.725 [2024-11-21 03:44:27.176707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.725 [2024-11-21 03:44:27.176735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.725 qpair failed and we were unable to recover it. 00:27:46.725 [2024-11-21 03:44:27.176877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.725 [2024-11-21 03:44:27.177020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.725 [2024-11-21 03:44:27.177047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.725 qpair failed and we were unable to recover it. 00:27:46.725 [2024-11-21 03:44:27.177181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.725 [2024-11-21 03:44:27.177282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.725 [2024-11-21 03:44:27.177307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.725 qpair failed and we were unable to recover it. 00:27:46.725 [2024-11-21 03:44:27.177435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.725 [2024-11-21 03:44:27.177603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.725 [2024-11-21 03:44:27.177628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.725 qpair failed and we were unable to recover it. 00:27:46.725 [2024-11-21 03:44:27.177758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.725 [2024-11-21 03:44:27.177860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.725 [2024-11-21 03:44:27.177903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.725 qpair failed and we were unable to recover it. 00:27:46.725 [2024-11-21 03:44:27.178079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.725 [2024-11-21 03:44:27.178224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.725 [2024-11-21 03:44:27.178251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.725 qpair failed and we were unable to recover it. 00:27:46.725 [2024-11-21 03:44:27.178407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.725 [2024-11-21 03:44:27.178539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.725 [2024-11-21 03:44:27.178564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.725 qpair failed and we were unable to recover it. 00:27:46.725 [2024-11-21 03:44:27.178713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.725 [2024-11-21 03:44:27.178847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.725 [2024-11-21 03:44:27.178874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.725 qpair failed and we were unable to recover it. 00:27:46.725 [2024-11-21 03:44:27.179015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.725 [2024-11-21 03:44:27.179166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.725 [2024-11-21 03:44:27.179192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.725 qpair failed and we were unable to recover it. 00:27:46.725 [2024-11-21 03:44:27.179323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.725 [2024-11-21 03:44:27.179452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.725 [2024-11-21 03:44:27.179481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.725 qpair failed and we were unable to recover it. 00:27:46.725 [2024-11-21 03:44:27.179651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.725 [2024-11-21 03:44:27.179777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.725 [2024-11-21 03:44:27.179819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.725 qpair failed and we were unable to recover it. 00:27:46.725 [2024-11-21 03:44:27.180000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.725 [2024-11-21 03:44:27.180092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.725 [2024-11-21 03:44:27.180118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.725 qpair failed and we were unable to recover it. 00:27:46.725 [2024-11-21 03:44:27.180266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.725 [2024-11-21 03:44:27.180377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.726 [2024-11-21 03:44:27.180405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.726 qpair failed and we were unable to recover it. 00:27:46.726 [2024-11-21 03:44:27.180552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.726 [2024-11-21 03:44:27.180664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.726 [2024-11-21 03:44:27.180692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.726 qpair failed and we were unable to recover it. 00:27:46.726 [2024-11-21 03:44:27.180835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.726 [2024-11-21 03:44:27.180963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.726 [2024-11-21 03:44:27.180988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.726 qpair failed and we were unable to recover it. 00:27:46.726 [2024-11-21 03:44:27.181145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.726 [2024-11-21 03:44:27.181285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.726 [2024-11-21 03:44:27.181313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.726 qpair failed and we were unable to recover it. 00:27:46.726 [2024-11-21 03:44:27.181428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.726 [2024-11-21 03:44:27.181536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.726 [2024-11-21 03:44:27.181563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.726 qpair failed and we were unable to recover it. 00:27:46.726 [2024-11-21 03:44:27.181734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.726 [2024-11-21 03:44:27.181877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.726 [2024-11-21 03:44:27.181905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.726 qpair failed and we were unable to recover it. 00:27:46.726 [2024-11-21 03:44:27.182063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.726 [2024-11-21 03:44:27.182166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.726 [2024-11-21 03:44:27.182192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.726 qpair failed and we were unable to recover it. 00:27:46.726 [2024-11-21 03:44:27.182339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.726 [2024-11-21 03:44:27.182491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.726 [2024-11-21 03:44:27.182520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.726 qpair failed and we were unable to recover it. 00:27:46.726 [2024-11-21 03:44:27.182645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.726 [2024-11-21 03:44:27.182801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.726 [2024-11-21 03:44:27.182826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.726 qpair failed and we were unable to recover it. 00:27:46.726 [2024-11-21 03:44:27.182948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.726 [2024-11-21 03:44:27.183089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.726 [2024-11-21 03:44:27.183118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.726 qpair failed and we were unable to recover it. 00:27:46.726 [2024-11-21 03:44:27.183297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.726 [2024-11-21 03:44:27.183423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.726 [2024-11-21 03:44:27.183465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.726 qpair failed and we were unable to recover it. 00:27:46.726 [2024-11-21 03:44:27.183572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.726 [2024-11-21 03:44:27.183713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.726 [2024-11-21 03:44:27.183741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.726 qpair failed and we were unable to recover it. 00:27:46.726 [2024-11-21 03:44:27.183858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.726 [2024-11-21 03:44:27.184004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.726 [2024-11-21 03:44:27.184032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.726 qpair failed and we were unable to recover it. 00:27:46.726 [2024-11-21 03:44:27.184193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.726 [2024-11-21 03:44:27.184346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.726 [2024-11-21 03:44:27.184386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.726 qpair failed and we were unable to recover it. 00:27:46.726 [2024-11-21 03:44:27.184527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.726 [2024-11-21 03:44:27.184666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.726 [2024-11-21 03:44:27.184691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.726 qpair failed and we were unable to recover it. 00:27:46.726 [2024-11-21 03:44:27.184815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.726 [2024-11-21 03:44:27.184943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.726 [2024-11-21 03:44:27.184968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.726 qpair failed and we were unable to recover it. 00:27:46.726 [2024-11-21 03:44:27.185105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.726 [2024-11-21 03:44:27.185208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.726 [2024-11-21 03:44:27.185236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.726 qpair failed and we were unable to recover it. 00:27:46.726 [2024-11-21 03:44:27.185377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.726 [2024-11-21 03:44:27.185520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.726 [2024-11-21 03:44:27.185547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.726 qpair failed and we were unable to recover it. 00:27:46.726 [2024-11-21 03:44:27.185703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.726 [2024-11-21 03:44:27.185857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.726 [2024-11-21 03:44:27.185882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.726 qpair failed and we were unable to recover it. 00:27:46.726 [2024-11-21 03:44:27.186002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.726 [2024-11-21 03:44:27.186153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.726 [2024-11-21 03:44:27.186181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.726 qpair failed and we were unable to recover it. 00:27:46.726 [2024-11-21 03:44:27.186352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.726 [2024-11-21 03:44:27.186495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.726 [2024-11-21 03:44:27.186525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.726 qpair failed and we were unable to recover it. 00:27:46.726 [2024-11-21 03:44:27.186632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.726 [2024-11-21 03:44:27.186770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.726 [2024-11-21 03:44:27.186798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.726 qpair failed and we were unable to recover it. 00:27:46.726 [2024-11-21 03:44:27.186948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.726 [2024-11-21 03:44:27.187080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.726 [2024-11-21 03:44:27.187106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.726 qpair failed and we were unable to recover it. 00:27:46.726 [2024-11-21 03:44:27.187286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.726 [2024-11-21 03:44:27.187401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.726 [2024-11-21 03:44:27.187428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.726 qpair failed and we were unable to recover it. 00:27:46.726 [2024-11-21 03:44:27.187577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.726 [2024-11-21 03:44:27.187727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.726 [2024-11-21 03:44:27.187752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.726 qpair failed and we were unable to recover it. 00:27:46.726 [2024-11-21 03:44:27.187855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.726 [2024-11-21 03:44:27.187988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.726 [2024-11-21 03:44:27.188013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.726 qpair failed and we were unable to recover it. 00:27:46.726 [2024-11-21 03:44:27.188179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.726 [2024-11-21 03:44:27.188310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.726 [2024-11-21 03:44:27.188353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.726 qpair failed and we were unable to recover it. 00:27:46.726 [2024-11-21 03:44:27.188517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.726 [2024-11-21 03:44:27.188701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.726 [2024-11-21 03:44:27.188726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.726 qpair failed and we were unable to recover it. 00:27:46.726 [2024-11-21 03:44:27.188893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.726 [2024-11-21 03:44:27.189014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.727 [2024-11-21 03:44:27.189042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.727 qpair failed and we were unable to recover it. 00:27:46.727 [2024-11-21 03:44:27.189199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.727 [2024-11-21 03:44:27.189327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.727 [2024-11-21 03:44:27.189352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.727 qpair failed and we were unable to recover it. 00:27:46.727 [2024-11-21 03:44:27.189541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.727 [2024-11-21 03:44:27.189697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.727 [2024-11-21 03:44:27.189722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.727 qpair failed and we were unable to recover it. 00:27:46.727 [2024-11-21 03:44:27.189842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.727 [2024-11-21 03:44:27.189961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.727 [2024-11-21 03:44:27.189989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.727 qpair failed and we were unable to recover it. 00:27:46.727 [2024-11-21 03:44:27.190163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.727 [2024-11-21 03:44:27.190305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.727 [2024-11-21 03:44:27.190333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.727 qpair failed and we were unable to recover it. 00:27:46.727 [2024-11-21 03:44:27.190447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.727 [2024-11-21 03:44:27.190590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.727 [2024-11-21 03:44:27.190618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.727 qpair failed and we were unable to recover it. 00:27:46.727 [2024-11-21 03:44:27.190767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.727 [2024-11-21 03:44:27.190892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.727 [2024-11-21 03:44:27.190917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.727 qpair failed and we were unable to recover it. 00:27:46.727 [2024-11-21 03:44:27.191014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.727 [2024-11-21 03:44:27.191143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.727 [2024-11-21 03:44:27.191169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.727 qpair failed and we were unable to recover it. 00:27:46.727 [2024-11-21 03:44:27.191276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.727 [2024-11-21 03:44:27.191444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.727 [2024-11-21 03:44:27.191469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.727 qpair failed and we were unable to recover it. 00:27:46.727 [2024-11-21 03:44:27.191628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.727 [2024-11-21 03:44:27.191777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.727 [2024-11-21 03:44:27.191805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.727 qpair failed and we were unable to recover it. 00:27:46.727 [2024-11-21 03:44:27.191956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.727 [2024-11-21 03:44:27.192093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.727 [2024-11-21 03:44:27.192120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.727 qpair failed and we were unable to recover it. 00:27:46.727 [2024-11-21 03:44:27.192283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.727 [2024-11-21 03:44:27.192398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.727 [2024-11-21 03:44:27.192427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.727 qpair failed and we were unable to recover it. 00:27:46.727 [2024-11-21 03:44:27.192575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.727 [2024-11-21 03:44:27.192720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.727 [2024-11-21 03:44:27.192748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.727 qpair failed and we were unable to recover it. 00:27:46.727 [2024-11-21 03:44:27.192862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.727 [2024-11-21 03:44:27.193013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.727 [2024-11-21 03:44:27.193038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.727 qpair failed and we were unable to recover it. 00:27:46.727 [2024-11-21 03:44:27.193149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.727 [2024-11-21 03:44:27.193256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.727 [2024-11-21 03:44:27.193281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.727 qpair failed and we were unable to recover it. 00:27:46.727 [2024-11-21 03:44:27.193422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.727 [2024-11-21 03:44:27.193558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.727 [2024-11-21 03:44:27.193585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.727 qpair failed and we were unable to recover it. 00:27:46.727 [2024-11-21 03:44:27.193735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.727 [2024-11-21 03:44:27.193900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.727 [2024-11-21 03:44:27.193928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.727 qpair failed and we were unable to recover it. 00:27:46.727 [2024-11-21 03:44:27.194092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.727 [2024-11-21 03:44:27.194249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.727 [2024-11-21 03:44:27.194273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.727 qpair failed and we were unable to recover it. 00:27:46.727 [2024-11-21 03:44:27.194438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.727 [2024-11-21 03:44:27.194565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.727 [2024-11-21 03:44:27.194590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.727 qpair failed and we were unable to recover it. 00:27:46.727 [2024-11-21 03:44:27.194706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.727 [2024-11-21 03:44:27.194854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.727 [2024-11-21 03:44:27.194894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.727 qpair failed and we were unable to recover it. 00:27:46.727 [2024-11-21 03:44:27.194994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.727 [2024-11-21 03:44:27.195136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.727 [2024-11-21 03:44:27.195169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.727 qpair failed and we were unable to recover it. 00:27:46.727 [2024-11-21 03:44:27.195312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.727 [2024-11-21 03:44:27.195445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.727 [2024-11-21 03:44:27.195472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.727 qpair failed and we were unable to recover it. 00:27:46.727 [2024-11-21 03:44:27.195626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.727 [2024-11-21 03:44:27.195732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.727 [2024-11-21 03:44:27.195758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.727 qpair failed and we were unable to recover it. 00:27:46.727 [2024-11-21 03:44:27.195872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.727 [2024-11-21 03:44:27.195982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.727 [2024-11-21 03:44:27.196009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.727 qpair failed and we were unable to recover it. 00:27:46.727 [2024-11-21 03:44:27.196161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.727 [2024-11-21 03:44:27.196306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.727 [2024-11-21 03:44:27.196331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.727 qpair failed and we were unable to recover it. 00:27:46.727 [2024-11-21 03:44:27.196510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.727 [2024-11-21 03:44:27.196650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.727 [2024-11-21 03:44:27.196677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.727 qpair failed and we were unable to recover it. 00:27:46.727 [2024-11-21 03:44:27.196829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.727 [2024-11-21 03:44:27.196970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.727 [2024-11-21 03:44:27.196995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.727 qpair failed and we were unable to recover it. 00:27:46.727 [2024-11-21 03:44:27.197191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.727 [2024-11-21 03:44:27.197310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.727 [2024-11-21 03:44:27.197338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.727 qpair failed and we were unable to recover it. 00:27:46.727 [2024-11-21 03:44:27.197452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.727 [2024-11-21 03:44:27.197592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.727 [2024-11-21 03:44:27.197617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.727 qpair failed and we were unable to recover it. 00:27:46.728 [2024-11-21 03:44:27.197766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.728 [2024-11-21 03:44:27.197933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.728 [2024-11-21 03:44:27.197960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.728 qpair failed and we were unable to recover it. 00:27:46.728 [2024-11-21 03:44:27.198110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.728 [2024-11-21 03:44:27.198237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.728 [2024-11-21 03:44:27.198265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.728 qpair failed and we were unable to recover it. 00:27:46.728 [2024-11-21 03:44:27.198405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.728 [2024-11-21 03:44:27.198540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.728 [2024-11-21 03:44:27.198567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.728 qpair failed and we were unable to recover it. 00:27:46.728 [2024-11-21 03:44:27.198743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.728 [2024-11-21 03:44:27.198877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.728 [2024-11-21 03:44:27.198904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.728 qpair failed and we were unable to recover it. 00:27:46.728 [2024-11-21 03:44:27.199014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.728 [2024-11-21 03:44:27.199131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.728 [2024-11-21 03:44:27.199159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.728 qpair failed and we were unable to recover it. 00:27:46.728 [2024-11-21 03:44:27.199311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.728 [2024-11-21 03:44:27.199435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.728 [2024-11-21 03:44:27.199459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.728 qpair failed and we were unable to recover it. 00:27:46.728 [2024-11-21 03:44:27.199610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.728 [2024-11-21 03:44:27.199791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.728 [2024-11-21 03:44:27.199816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.728 qpair failed and we were unable to recover it. 00:27:46.728 [2024-11-21 03:44:27.199923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.728 [2024-11-21 03:44:27.200043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.728 [2024-11-21 03:44:27.200075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.728 qpair failed and we were unable to recover it. 00:27:46.728 [2024-11-21 03:44:27.200224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.728 [2024-11-21 03:44:27.200395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.728 [2024-11-21 03:44:27.200420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.728 qpair failed and we were unable to recover it. 00:27:46.728 [2024-11-21 03:44:27.200548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.728 [2024-11-21 03:44:27.200701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.728 [2024-11-21 03:44:27.200742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.728 qpair failed and we were unable to recover it. 00:27:46.728 [2024-11-21 03:44:27.200897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.728 [2024-11-21 03:44:27.201049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.728 [2024-11-21 03:44:27.201081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.728 qpair failed and we were unable to recover it. 00:27:46.728 [2024-11-21 03:44:27.201289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.728 [2024-11-21 03:44:27.201441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.728 [2024-11-21 03:44:27.201466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.728 qpair failed and we were unable to recover it. 00:27:46.728 [2024-11-21 03:44:27.201652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.728 [2024-11-21 03:44:27.201794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.728 [2024-11-21 03:44:27.201835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.728 qpair failed and we were unable to recover it. 00:27:46.728 [2024-11-21 03:44:27.201943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.728 [2024-11-21 03:44:27.202078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.728 [2024-11-21 03:44:27.202104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.728 qpair failed and we were unable to recover it. 00:27:46.728 [2024-11-21 03:44:27.202255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.728 [2024-11-21 03:44:27.202409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.728 [2024-11-21 03:44:27.202435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.728 qpair failed and we were unable to recover it. 00:27:46.728 [2024-11-21 03:44:27.202566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.728 [2024-11-21 03:44:27.202718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.728 [2024-11-21 03:44:27.202743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.728 qpair failed and we were unable to recover it. 00:27:46.728 [2024-11-21 03:44:27.202836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.728 [2024-11-21 03:44:27.202957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.728 [2024-11-21 03:44:27.202982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.728 qpair failed and we were unable to recover it. 00:27:46.728 [2024-11-21 03:44:27.203081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.728 [2024-11-21 03:44:27.203246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.728 [2024-11-21 03:44:27.203271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.728 qpair failed and we were unable to recover it. 00:27:46.728 [2024-11-21 03:44:27.203376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.728 [2024-11-21 03:44:27.203516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.728 [2024-11-21 03:44:27.203541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.728 qpair failed and we were unable to recover it. 00:27:46.728 [2024-11-21 03:44:27.203680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.728 [2024-11-21 03:44:27.203782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.728 [2024-11-21 03:44:27.203807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.728 qpair failed and we were unable to recover it. 00:27:46.728 [2024-11-21 03:44:27.203941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.728 [2024-11-21 03:44:27.204067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.728 [2024-11-21 03:44:27.204099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.728 qpair failed and we were unable to recover it. 00:27:46.728 [2024-11-21 03:44:27.204245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.728 [2024-11-21 03:44:27.204348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.728 [2024-11-21 03:44:27.204373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.728 qpair failed and we were unable to recover it. 00:27:46.728 [2024-11-21 03:44:27.204478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.728 [2024-11-21 03:44:27.204637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.728 [2024-11-21 03:44:27.204662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.728 qpair failed and we were unable to recover it. 00:27:46.728 [2024-11-21 03:44:27.204798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.728 [2024-11-21 03:44:27.204895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.728 [2024-11-21 03:44:27.204920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.728 qpair failed and we were unable to recover it. 00:27:46.728 [2024-11-21 03:44:27.205045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.728 [2024-11-21 03:44:27.205219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.728 [2024-11-21 03:44:27.205248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.728 qpair failed and we were unable to recover it. 00:27:46.729 [2024-11-21 03:44:27.205404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.729 [2024-11-21 03:44:27.205530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.729 [2024-11-21 03:44:27.205555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.729 qpair failed and we were unable to recover it. 00:27:46.729 [2024-11-21 03:44:27.205654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.729 [2024-11-21 03:44:27.205801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.729 [2024-11-21 03:44:27.205828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.729 qpair failed and we were unable to recover it. 00:27:46.729 [2024-11-21 03:44:27.206001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.729 [2024-11-21 03:44:27.206136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.729 [2024-11-21 03:44:27.206165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.729 qpair failed and we were unable to recover it. 00:27:46.729 [2024-11-21 03:44:27.206303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.729 [2024-11-21 03:44:27.206439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.729 [2024-11-21 03:44:27.206467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.729 qpair failed and we were unable to recover it. 00:27:46.729 [2024-11-21 03:44:27.206616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.729 [2024-11-21 03:44:27.206711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.729 [2024-11-21 03:44:27.206736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.729 qpair failed and we were unable to recover it. 00:27:46.729 [2024-11-21 03:44:27.206939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.729 [2024-11-21 03:44:27.207061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.729 [2024-11-21 03:44:27.207104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.729 qpair failed and we were unable to recover it. 00:27:46.729 [2024-11-21 03:44:27.207266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.729 [2024-11-21 03:44:27.207403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.729 [2024-11-21 03:44:27.207430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.729 qpair failed and we were unable to recover it. 00:27:46.729 [2024-11-21 03:44:27.207544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.729 [2024-11-21 03:44:27.207705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.729 [2024-11-21 03:44:27.207730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.729 qpair failed and we were unable to recover it. 00:27:46.729 [2024-11-21 03:44:27.207863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.729 [2024-11-21 03:44:27.208018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.729 [2024-11-21 03:44:27.208043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.729 qpair failed and we were unable to recover it. 00:27:46.729 [2024-11-21 03:44:27.208170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.729 [2024-11-21 03:44:27.208281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.729 [2024-11-21 03:44:27.208309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.729 qpair failed and we were unable to recover it. 00:27:46.729 [2024-11-21 03:44:27.208436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.729 [2024-11-21 03:44:27.208568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.729 [2024-11-21 03:44:27.208596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.729 qpair failed and we were unable to recover it. 00:27:46.729 [2024-11-21 03:44:27.208704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.729 [2024-11-21 03:44:27.208837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.729 [2024-11-21 03:44:27.208864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.729 qpair failed and we were unable to recover it. 00:27:46.729 [2024-11-21 03:44:27.209010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.729 [2024-11-21 03:44:27.209162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.729 [2024-11-21 03:44:27.209187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.729 qpair failed and we were unable to recover it. 00:27:46.729 [2024-11-21 03:44:27.209314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.729 [2024-11-21 03:44:27.209462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.729 [2024-11-21 03:44:27.209489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.729 qpair failed and we were unable to recover it. 00:27:46.729 [2024-11-21 03:44:27.209671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.729 [2024-11-21 03:44:27.209763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.729 [2024-11-21 03:44:27.209788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.729 qpair failed and we were unable to recover it. 00:27:46.729 [2024-11-21 03:44:27.209956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.729 [2024-11-21 03:44:27.210114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.729 [2024-11-21 03:44:27.210139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.729 qpair failed and we were unable to recover it. 00:27:46.729 [2024-11-21 03:44:27.210240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.729 [2024-11-21 03:44:27.210341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.729 [2024-11-21 03:44:27.210366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.729 qpair failed and we were unable to recover it. 00:27:46.729 [2024-11-21 03:44:27.210495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.729 [2024-11-21 03:44:27.210628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.729 [2024-11-21 03:44:27.210653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.729 qpair failed and we were unable to recover it. 00:27:46.729 [2024-11-21 03:44:27.210807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.729 [2024-11-21 03:44:27.210956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.729 [2024-11-21 03:44:27.210981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.729 qpair failed and we were unable to recover it. 00:27:46.729 [2024-11-21 03:44:27.211128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.729 [2024-11-21 03:44:27.211295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.729 [2024-11-21 03:44:27.211323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.729 qpair failed and we were unable to recover it. 00:27:46.729 [2024-11-21 03:44:27.211447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.729 [2024-11-21 03:44:27.211574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.729 [2024-11-21 03:44:27.211599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.729 qpair failed and we were unable to recover it. 00:27:46.729 [2024-11-21 03:44:27.211710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.729 [2024-11-21 03:44:27.211864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.729 [2024-11-21 03:44:27.211889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.729 qpair failed and we were unable to recover it. 00:27:46.729 [2024-11-21 03:44:27.211993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.729 [2024-11-21 03:44:27.212136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.729 [2024-11-21 03:44:27.212165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.729 qpair failed and we were unable to recover it. 00:27:46.729 [2024-11-21 03:44:27.212297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.729 [2024-11-21 03:44:27.212436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.729 [2024-11-21 03:44:27.212464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.729 qpair failed and we were unable to recover it. 00:27:46.729 [2024-11-21 03:44:27.212605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.729 [2024-11-21 03:44:27.212729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.729 [2024-11-21 03:44:27.212754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.729 qpair failed and we were unable to recover it. 00:27:46.729 [2024-11-21 03:44:27.212877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.729 [2024-11-21 03:44:27.213045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.729 [2024-11-21 03:44:27.213080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.729 qpair failed and we were unable to recover it. 00:27:46.729 [2024-11-21 03:44:27.213243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.729 [2024-11-21 03:44:27.213370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.729 [2024-11-21 03:44:27.213395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.729 qpair failed and we were unable to recover it. 00:27:46.729 [2024-11-21 03:44:27.213534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.729 [2024-11-21 03:44:27.213685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.729 [2024-11-21 03:44:27.213714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.730 qpair failed and we were unable to recover it. 00:27:46.730 [2024-11-21 03:44:27.213843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.730 [2024-11-21 03:44:27.213996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.730 [2024-11-21 03:44:27.214037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.730 qpair failed and we were unable to recover it. 00:27:46.730 [2024-11-21 03:44:27.214169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.730 [2024-11-21 03:44:27.214320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.730 [2024-11-21 03:44:27.214345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.730 qpair failed and we were unable to recover it. 00:27:46.730 [2024-11-21 03:44:27.214502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.730 [2024-11-21 03:44:27.214654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.730 [2024-11-21 03:44:27.214681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.730 qpair failed and we were unable to recover it. 00:27:46.730 [2024-11-21 03:44:27.214825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.730 [2024-11-21 03:44:27.214961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.730 [2024-11-21 03:44:27.214988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.730 qpair failed and we were unable to recover it. 00:27:46.730 [2024-11-21 03:44:27.215171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.730 [2024-11-21 03:44:27.215273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.730 [2024-11-21 03:44:27.215300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.730 qpair failed and we were unable to recover it. 00:27:46.730 [2024-11-21 03:44:27.215433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.730 [2024-11-21 03:44:27.215579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.730 [2024-11-21 03:44:27.215604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.730 qpair failed and we were unable to recover it. 00:27:46.730 [2024-11-21 03:44:27.215765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.730 [2024-11-21 03:44:27.215865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.730 [2024-11-21 03:44:27.215890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.730 qpair failed and we were unable to recover it. 00:27:46.730 [2024-11-21 03:44:27.216014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.730 [2024-11-21 03:44:27.216157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.730 [2024-11-21 03:44:27.216186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.730 qpair failed and we were unable to recover it. 00:27:46.730 [2024-11-21 03:44:27.216311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.730 [2024-11-21 03:44:27.216415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.730 [2024-11-21 03:44:27.216440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.730 qpair failed and we were unable to recover it. 00:27:46.730 [2024-11-21 03:44:27.216551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.730 [2024-11-21 03:44:27.216738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.730 [2024-11-21 03:44:27.216763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.730 qpair failed and we were unable to recover it. 00:27:46.730 [2024-11-21 03:44:27.216899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.730 [2024-11-21 03:44:27.217026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.730 [2024-11-21 03:44:27.217050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.730 qpair failed and we were unable to recover it. 00:27:46.730 [2024-11-21 03:44:27.217189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.730 [2024-11-21 03:44:27.217300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.730 [2024-11-21 03:44:27.217325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.730 qpair failed and we were unable to recover it. 00:27:46.730 [2024-11-21 03:44:27.217451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.730 [2024-11-21 03:44:27.217575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.730 [2024-11-21 03:44:27.217600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.730 qpair failed and we were unable to recover it. 00:27:46.730 [2024-11-21 03:44:27.217783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.730 [2024-11-21 03:44:27.217949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.730 [2024-11-21 03:44:27.217977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.730 qpair failed and we were unable to recover it. 00:27:46.730 [2024-11-21 03:44:27.218152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.730 [2024-11-21 03:44:27.218303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.730 [2024-11-21 03:44:27.218328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.730 qpair failed and we were unable to recover it. 00:27:46.730 [2024-11-21 03:44:27.218517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.730 [2024-11-21 03:44:27.218646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.730 [2024-11-21 03:44:27.218671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.730 qpair failed and we were unable to recover it. 00:27:46.730 [2024-11-21 03:44:27.218760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.730 [2024-11-21 03:44:27.218881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.730 [2024-11-21 03:44:27.218906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.730 qpair failed and we were unable to recover it. 00:27:46.730 [2024-11-21 03:44:27.219003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.730 [2024-11-21 03:44:27.219111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.730 [2024-11-21 03:44:27.219138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.730 qpair failed and we were unable to recover it. 00:27:46.730 [2024-11-21 03:44:27.219243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.730 [2024-11-21 03:44:27.219367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.730 [2024-11-21 03:44:27.219392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.730 qpair failed and we were unable to recover it. 00:27:46.730 [2024-11-21 03:44:27.219533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.730 [2024-11-21 03:44:27.219680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.730 [2024-11-21 03:44:27.219707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.730 qpair failed and we were unable to recover it. 00:27:46.730 [2024-11-21 03:44:27.219856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.730 [2024-11-21 03:44:27.219961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.730 [2024-11-21 03:44:27.219986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.730 qpair failed and we were unable to recover it. 00:27:46.730 [2024-11-21 03:44:27.220140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.730 [2024-11-21 03:44:27.220253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.730 [2024-11-21 03:44:27.220281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.730 qpair failed and we were unable to recover it. 00:27:46.730 [2024-11-21 03:44:27.220433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.730 [2024-11-21 03:44:27.220573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.730 [2024-11-21 03:44:27.220600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.730 qpair failed and we were unable to recover it. 00:27:46.730 [2024-11-21 03:44:27.220734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.730 [2024-11-21 03:44:27.220841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.730 [2024-11-21 03:44:27.220869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.730 qpair failed and we were unable to recover it. 00:27:46.730 [2024-11-21 03:44:27.220989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.730 [2024-11-21 03:44:27.221111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.730 [2024-11-21 03:44:27.221137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.730 qpair failed and we were unable to recover it. 00:27:46.730 [2024-11-21 03:44:27.221260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.730 [2024-11-21 03:44:27.221367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.730 [2024-11-21 03:44:27.221395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.730 qpair failed and we were unable to recover it. 00:27:46.730 [2024-11-21 03:44:27.221544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.730 [2024-11-21 03:44:27.221695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.730 [2024-11-21 03:44:27.221719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.730 qpair failed and we were unable to recover it. 00:27:46.730 [2024-11-21 03:44:27.221869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.730 [2024-11-21 03:44:27.222035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.730 [2024-11-21 03:44:27.222063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.730 qpair failed and we were unable to recover it. 00:27:46.730 [2024-11-21 03:44:27.222227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.731 [2024-11-21 03:44:27.222338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.731 [2024-11-21 03:44:27.222363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.731 qpair failed and we were unable to recover it. 00:27:46.731 [2024-11-21 03:44:27.222457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.731 [2024-11-21 03:44:27.222577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.731 [2024-11-21 03:44:27.222602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.731 qpair failed and we were unable to recover it. 00:27:46.731 [2024-11-21 03:44:27.222766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.731 [2024-11-21 03:44:27.222949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.731 [2024-11-21 03:44:27.222977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.731 qpair failed and we were unable to recover it. 00:27:46.731 [2024-11-21 03:44:27.223095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.731 [2024-11-21 03:44:27.223238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.731 [2024-11-21 03:44:27.223266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.731 qpair failed and we were unable to recover it. 00:27:46.731 [2024-11-21 03:44:27.223416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.731 [2024-11-21 03:44:27.223524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.731 [2024-11-21 03:44:27.223549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.731 qpair failed and we were unable to recover it. 00:27:46.731 [2024-11-21 03:44:27.223675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.731 [2024-11-21 03:44:27.223811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.731 [2024-11-21 03:44:27.223839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.731 qpair failed and we were unable to recover it. 00:27:46.731 [2024-11-21 03:44:27.223979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.731 [2024-11-21 03:44:27.224089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.731 [2024-11-21 03:44:27.224118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.731 qpair failed and we were unable to recover it. 00:27:46.731 [2024-11-21 03:44:27.224296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.731 [2024-11-21 03:44:27.224401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.731 [2024-11-21 03:44:27.224428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.731 qpair failed and we were unable to recover it. 00:27:46.731 [2024-11-21 03:44:27.224575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.731 [2024-11-21 03:44:27.224709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.731 [2024-11-21 03:44:27.224735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.731 qpair failed and we were unable to recover it. 00:27:46.731 [2024-11-21 03:44:27.224888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.731 [2024-11-21 03:44:27.225033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.731 [2024-11-21 03:44:27.225061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.731 qpair failed and we were unable to recover it. 00:27:46.731 [2024-11-21 03:44:27.225216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.731 [2024-11-21 03:44:27.225325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.731 [2024-11-21 03:44:27.225352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.731 qpair failed and we were unable to recover it. 00:27:46.731 [2024-11-21 03:44:27.225504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.731 [2024-11-21 03:44:27.225632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.731 [2024-11-21 03:44:27.225657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.731 qpair failed and we were unable to recover it. 00:27:46.731 [2024-11-21 03:44:27.225789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.731 [2024-11-21 03:44:27.225916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.731 [2024-11-21 03:44:27.225941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.731 qpair failed and we were unable to recover it. 00:27:46.731 [2024-11-21 03:44:27.226092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.731 [2024-11-21 03:44:27.226209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.731 [2024-11-21 03:44:27.226237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.731 qpair failed and we were unable to recover it. 00:27:46.731 [2024-11-21 03:44:27.226356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.731 [2024-11-21 03:44:27.226503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.731 [2024-11-21 03:44:27.226528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.731 qpair failed and we were unable to recover it. 00:27:46.731 [2024-11-21 03:44:27.226636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.731 [2024-11-21 03:44:27.226766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.731 [2024-11-21 03:44:27.226794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.731 qpair failed and we were unable to recover it. 00:27:46.731 [2024-11-21 03:44:27.226945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.731 [2024-11-21 03:44:27.227051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.731 [2024-11-21 03:44:27.227084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.731 qpair failed and we were unable to recover it. 00:27:46.731 [2024-11-21 03:44:27.227214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.731 [2024-11-21 03:44:27.227394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.731 [2024-11-21 03:44:27.227421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.731 qpair failed and we were unable to recover it. 00:27:46.731 [2024-11-21 03:44:27.227558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.731 [2024-11-21 03:44:27.227700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.731 [2024-11-21 03:44:27.227727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.731 qpair failed and we were unable to recover it. 00:27:46.731 [2024-11-21 03:44:27.227920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.731 [2024-11-21 03:44:27.228022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.731 [2024-11-21 03:44:27.228047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.731 qpair failed and we were unable to recover it. 00:27:46.731 [2024-11-21 03:44:27.228145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.731 [2024-11-21 03:44:27.228274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.731 [2024-11-21 03:44:27.228300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.731 qpair failed and we were unable to recover it. 00:27:46.731 [2024-11-21 03:44:27.228439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.731 [2024-11-21 03:44:27.228566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.731 [2024-11-21 03:44:27.228591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.731 qpair failed and we were unable to recover it. 00:27:46.731 [2024-11-21 03:44:27.228780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.731 [2024-11-21 03:44:27.228930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.731 [2024-11-21 03:44:27.228959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.731 qpair failed and we were unable to recover it. 00:27:46.731 [2024-11-21 03:44:27.229086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.731 [2024-11-21 03:44:27.229234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.731 [2024-11-21 03:44:27.229262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.731 qpair failed and we were unable to recover it. 00:27:46.731 [2024-11-21 03:44:27.229385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.731 [2024-11-21 03:44:27.229540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.731 [2024-11-21 03:44:27.229565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.731 qpair failed and we were unable to recover it. 00:27:46.731 [2024-11-21 03:44:27.229710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.731 [2024-11-21 03:44:27.229832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.731 [2024-11-21 03:44:27.229860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.731 qpair failed and we were unable to recover it. 00:27:46.731 [2024-11-21 03:44:27.230013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.731 [2024-11-21 03:44:27.230144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.731 [2024-11-21 03:44:27.230169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.731 qpair failed and we were unable to recover it. 00:27:46.731 [2024-11-21 03:44:27.230317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.731 [2024-11-21 03:44:27.230446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.731 [2024-11-21 03:44:27.230474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.731 qpair failed and we were unable to recover it. 00:27:46.731 [2024-11-21 03:44:27.230604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.731 [2024-11-21 03:44:27.230737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.732 [2024-11-21 03:44:27.230762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.732 qpair failed and we were unable to recover it. 00:27:46.732 [2024-11-21 03:44:27.230943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.732 [2024-11-21 03:44:27.231084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.732 [2024-11-21 03:44:27.231113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.732 qpair failed and we were unable to recover it. 00:27:46.732 [2024-11-21 03:44:27.231223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.732 [2024-11-21 03:44:27.231368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.732 [2024-11-21 03:44:27.231393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.732 qpair failed and we were unable to recover it. 00:27:46.732 [2024-11-21 03:44:27.231572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.732 [2024-11-21 03:44:27.231741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.732 [2024-11-21 03:44:27.231769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.732 qpair failed and we were unable to recover it. 00:27:46.732 [2024-11-21 03:44:27.231912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.732 [2024-11-21 03:44:27.232005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.732 [2024-11-21 03:44:27.232029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.732 qpair failed and we were unable to recover it. 00:27:46.732 [2024-11-21 03:44:27.232235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.732 [2024-11-21 03:44:27.232337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.732 [2024-11-21 03:44:27.232361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.732 qpair failed and we were unable to recover it. 00:27:46.732 [2024-11-21 03:44:27.232461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.732 [2024-11-21 03:44:27.232588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.732 [2024-11-21 03:44:27.232615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.732 qpair failed and we were unable to recover it. 00:27:46.732 [2024-11-21 03:44:27.232748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.732 [2024-11-21 03:44:27.232913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.732 [2024-11-21 03:44:27.232938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.732 qpair failed and we were unable to recover it. 00:27:46.732 [2024-11-21 03:44:27.233044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.732 [2024-11-21 03:44:27.233147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.732 [2024-11-21 03:44:27.233173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.732 qpair failed and we were unable to recover it. 00:27:46.732 [2024-11-21 03:44:27.233340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.732 [2024-11-21 03:44:27.233455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.732 [2024-11-21 03:44:27.233482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.732 qpair failed and we were unable to recover it. 00:27:46.732 [2024-11-21 03:44:27.233623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.732 [2024-11-21 03:44:27.233761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.732 [2024-11-21 03:44:27.233790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.732 qpair failed and we were unable to recover it. 00:27:46.732 [2024-11-21 03:44:27.233927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.732 [2024-11-21 03:44:27.234100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.732 [2024-11-21 03:44:27.234129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.732 qpair failed and we were unable to recover it. 00:27:46.732 [2024-11-21 03:44:27.234279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.732 [2024-11-21 03:44:27.234383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.732 [2024-11-21 03:44:27.234408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.732 qpair failed and we were unable to recover it. 00:27:46.732 [2024-11-21 03:44:27.234567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.732 [2024-11-21 03:44:27.234662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.732 [2024-11-21 03:44:27.234687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.732 qpair failed and we were unable to recover it. 00:27:46.732 [2024-11-21 03:44:27.234846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.732 [2024-11-21 03:44:27.234990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.732 [2024-11-21 03:44:27.235017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.732 qpair failed and we were unable to recover it. 00:27:46.732 [2024-11-21 03:44:27.235194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.732 [2024-11-21 03:44:27.235371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.732 [2024-11-21 03:44:27.235396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.732 qpair failed and we were unable to recover it. 00:27:46.732 [2024-11-21 03:44:27.235497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.732 [2024-11-21 03:44:27.235625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.732 [2024-11-21 03:44:27.235650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.732 qpair failed and we were unable to recover it. 00:27:46.732 [2024-11-21 03:44:27.235775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.732 [2024-11-21 03:44:27.235887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.732 [2024-11-21 03:44:27.235917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.732 qpair failed and we were unable to recover it. 00:27:46.732 [2024-11-21 03:44:27.236095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.732 [2024-11-21 03:44:27.236223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.732 [2024-11-21 03:44:27.236248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.732 qpair failed and we were unable to recover it. 00:27:46.732 [2024-11-21 03:44:27.236398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.732 [2024-11-21 03:44:27.236538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.732 [2024-11-21 03:44:27.236565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.732 qpair failed and we were unable to recover it. 00:27:46.732 [2024-11-21 03:44:27.236741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.732 [2024-11-21 03:44:27.236918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.732 [2024-11-21 03:44:27.236945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.732 qpair failed and we were unable to recover it. 00:27:46.732 [2024-11-21 03:44:27.237094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.732 [2024-11-21 03:44:27.237265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.732 [2024-11-21 03:44:27.237293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.732 qpair failed and we were unable to recover it. 00:27:46.732 [2024-11-21 03:44:27.237404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.732 [2024-11-21 03:44:27.237511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.732 [2024-11-21 03:44:27.237539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.732 qpair failed and we were unable to recover it. 00:27:46.732 [2024-11-21 03:44:27.237719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.732 [2024-11-21 03:44:27.237847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.732 [2024-11-21 03:44:27.237881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.732 qpair failed and we were unable to recover it. 00:27:46.732 [2024-11-21 03:44:27.238011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.732 [2024-11-21 03:44:27.238163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.732 [2024-11-21 03:44:27.238205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.732 qpair failed and we were unable to recover it. 00:27:46.732 [2024-11-21 03:44:27.238360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.732 [2024-11-21 03:44:27.238506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.732 [2024-11-21 03:44:27.238531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.732 qpair failed and we were unable to recover it. 00:27:46.732 [2024-11-21 03:44:27.238670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.732 [2024-11-21 03:44:27.238826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.732 [2024-11-21 03:44:27.238851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.732 qpair failed and we were unable to recover it. 00:27:46.732 [2024-11-21 03:44:27.239029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.732 [2024-11-21 03:44:27.239162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.732 [2024-11-21 03:44:27.239188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.732 qpair failed and we were unable to recover it. 00:27:46.732 [2024-11-21 03:44:27.239289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.733 [2024-11-21 03:44:27.239396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.733 [2024-11-21 03:44:27.239420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.733 qpair failed and we were unable to recover it. 00:27:46.733 [2024-11-21 03:44:27.239566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.733 [2024-11-21 03:44:27.239748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.733 [2024-11-21 03:44:27.239773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.733 qpair failed and we were unable to recover it. 00:27:46.733 [2024-11-21 03:44:27.239941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.733 [2024-11-21 03:44:27.240103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.733 [2024-11-21 03:44:27.240132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.733 qpair failed and we were unable to recover it. 00:27:46.733 [2024-11-21 03:44:27.240266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.733 [2024-11-21 03:44:27.240377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.733 [2024-11-21 03:44:27.240405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.733 qpair failed and we were unable to recover it. 00:27:46.733 [2024-11-21 03:44:27.240557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.733 [2024-11-21 03:44:27.240716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.733 [2024-11-21 03:44:27.240757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.733 qpair failed and we were unable to recover it. 00:27:46.733 [2024-11-21 03:44:27.240940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.733 [2024-11-21 03:44:27.241076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.733 [2024-11-21 03:44:27.241102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.733 qpair failed and we were unable to recover it. 00:27:46.733 [2024-11-21 03:44:27.241255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.733 [2024-11-21 03:44:27.241405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.733 [2024-11-21 03:44:27.241432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.733 qpair failed and we were unable to recover it. 00:27:46.733 [2024-11-21 03:44:27.241566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.733 [2024-11-21 03:44:27.241683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.733 [2024-11-21 03:44:27.241710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.733 qpair failed and we were unable to recover it. 00:27:46.733 [2024-11-21 03:44:27.241832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.733 [2024-11-21 03:44:27.241929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.733 [2024-11-21 03:44:27.241954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.733 qpair failed and we were unable to recover it. 00:27:46.733 [2024-11-21 03:44:27.242092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.733 [2024-11-21 03:44:27.242204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.733 [2024-11-21 03:44:27.242232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.733 qpair failed and we were unable to recover it. 00:27:46.733 [2024-11-21 03:44:27.242366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.733 [2024-11-21 03:44:27.242478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.733 [2024-11-21 03:44:27.242505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.733 qpair failed and we were unable to recover it. 00:27:46.733 [2024-11-21 03:44:27.242608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.733 [2024-11-21 03:44:27.242746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.733 [2024-11-21 03:44:27.242774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.733 qpair failed and we were unable to recover it. 00:27:46.733 [2024-11-21 03:44:27.242895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.733 [2024-11-21 03:44:27.242999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.733 [2024-11-21 03:44:27.243024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.733 qpair failed and we were unable to recover it. 00:27:46.733 [2024-11-21 03:44:27.243150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.733 [2024-11-21 03:44:27.243252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.733 [2024-11-21 03:44:27.243279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.733 qpair failed and we were unable to recover it. 00:27:46.733 [2024-11-21 03:44:27.243380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.733 [2024-11-21 03:44:27.243536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.733 [2024-11-21 03:44:27.243562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.733 qpair failed and we were unable to recover it. 00:27:46.733 [2024-11-21 03:44:27.243721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.733 [2024-11-21 03:44:27.243877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.733 [2024-11-21 03:44:27.243902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.733 qpair failed and we were unable to recover it. 00:27:46.733 [2024-11-21 03:44:27.244062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.733 [2024-11-21 03:44:27.244189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.733 [2024-11-21 03:44:27.244215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.733 qpair failed and we were unable to recover it. 00:27:46.733 [2024-11-21 03:44:27.244344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.733 [2024-11-21 03:44:27.244518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.733 [2024-11-21 03:44:27.244551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.733 qpair failed and we were unable to recover it. 00:27:46.733 [2024-11-21 03:44:27.244732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.733 [2024-11-21 03:44:27.244876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.733 [2024-11-21 03:44:27.244904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.733 qpair failed and we were unable to recover it. 00:27:46.733 [2024-11-21 03:44:27.245035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.733 [2024-11-21 03:44:27.245189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.733 [2024-11-21 03:44:27.245218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.733 qpair failed and we were unable to recover it. 00:27:46.733 [2024-11-21 03:44:27.245353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.733 [2024-11-21 03:44:27.245520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.733 [2024-11-21 03:44:27.245545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.733 qpair failed and we were unable to recover it. 00:27:46.733 [2024-11-21 03:44:27.245690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.733 [2024-11-21 03:44:27.245796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.733 [2024-11-21 03:44:27.245824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.733 qpair failed and we were unable to recover it. 00:27:46.733 [2024-11-21 03:44:27.245962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.733 [2024-11-21 03:44:27.246082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.733 [2024-11-21 03:44:27.246125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.733 qpair failed and we were unable to recover it. 00:27:46.733 [2024-11-21 03:44:27.246254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.733 [2024-11-21 03:44:27.246372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.733 [2024-11-21 03:44:27.246398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.733 qpair failed and we were unable to recover it. 00:27:46.733 [2024-11-21 03:44:27.246552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.733 [2024-11-21 03:44:27.246681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.734 [2024-11-21 03:44:27.246706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.734 qpair failed and we were unable to recover it. 00:27:46.734 [2024-11-21 03:44:27.246807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.734 [2024-11-21 03:44:27.246937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.734 [2024-11-21 03:44:27.246962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.734 qpair failed and we were unable to recover it. 00:27:46.734 [2024-11-21 03:44:27.247092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.734 [2024-11-21 03:44:27.247224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.734 [2024-11-21 03:44:27.247252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.734 qpair failed and we were unable to recover it. 00:27:46.734 [2024-11-21 03:44:27.247391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.734 [2024-11-21 03:44:27.247529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.734 [2024-11-21 03:44:27.247561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.734 qpair failed and we were unable to recover it. 00:27:46.734 [2024-11-21 03:44:27.247742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.734 [2024-11-21 03:44:27.247871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.734 [2024-11-21 03:44:27.247896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.734 qpair failed and we were unable to recover it. 00:27:46.734 [2024-11-21 03:44:27.248035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.734 [2024-11-21 03:44:27.248195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.734 [2024-11-21 03:44:27.248223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.734 qpair failed and we were unable to recover it. 00:27:46.734 [2024-11-21 03:44:27.248366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.734 [2024-11-21 03:44:27.248534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.734 [2024-11-21 03:44:27.248562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.734 qpair failed and we were unable to recover it. 00:27:46.734 [2024-11-21 03:44:27.248717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.734 [2024-11-21 03:44:27.248845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.734 [2024-11-21 03:44:27.248870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.734 qpair failed and we were unable to recover it. 00:27:46.734 [2024-11-21 03:44:27.249000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.734 [2024-11-21 03:44:27.249128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.734 [2024-11-21 03:44:27.249154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.734 qpair failed and we were unable to recover it. 00:27:46.734 [2024-11-21 03:44:27.249255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.734 [2024-11-21 03:44:27.249383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.734 [2024-11-21 03:44:27.249426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.734 qpair failed and we were unable to recover it. 00:27:46.734 [2024-11-21 03:44:27.249562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.734 [2024-11-21 03:44:27.249694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.734 [2024-11-21 03:44:27.249722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.734 qpair failed and we were unable to recover it. 00:27:46.734 [2024-11-21 03:44:27.249863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.734 [2024-11-21 03:44:27.249994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.734 [2024-11-21 03:44:27.250022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.734 qpair failed and we were unable to recover it. 00:27:46.734 [2024-11-21 03:44:27.250195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.734 [2024-11-21 03:44:27.250347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.734 [2024-11-21 03:44:27.250388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.734 qpair failed and we were unable to recover it. 00:27:46.734 [2024-11-21 03:44:27.250511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.734 [2024-11-21 03:44:27.250694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.734 [2024-11-21 03:44:27.250719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.734 qpair failed and we were unable to recover it. 00:27:46.734 [2024-11-21 03:44:27.250857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.734 [2024-11-21 03:44:27.251004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.734 [2024-11-21 03:44:27.251032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.734 qpair failed and we were unable to recover it. 00:27:46.734 [2024-11-21 03:44:27.251157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.734 [2024-11-21 03:44:27.251286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.734 [2024-11-21 03:44:27.251311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.734 qpair failed and we were unable to recover it. 00:27:46.734 [2024-11-21 03:44:27.251455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.734 [2024-11-21 03:44:27.251550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.734 [2024-11-21 03:44:27.251575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.734 qpair failed and we were unable to recover it. 00:27:46.734 [2024-11-21 03:44:27.251732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.734 [2024-11-21 03:44:27.251906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.734 [2024-11-21 03:44:27.251934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.734 qpair failed and we were unable to recover it. 00:27:46.734 [2024-11-21 03:44:27.252084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.734 [2024-11-21 03:44:27.252213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.734 [2024-11-21 03:44:27.252238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.734 qpair failed and we were unable to recover it. 00:27:46.734 [2024-11-21 03:44:27.252371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.734 [2024-11-21 03:44:27.252495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.734 [2024-11-21 03:44:27.252520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.734 qpair failed and we were unable to recover it. 00:27:46.734 [2024-11-21 03:44:27.252647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.734 [2024-11-21 03:44:27.252777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.734 [2024-11-21 03:44:27.252803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.734 qpair failed and we were unable to recover it. 00:27:46.734 [2024-11-21 03:44:27.252928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.734 [2024-11-21 03:44:27.253067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.734 [2024-11-21 03:44:27.253101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.734 qpair failed and we were unable to recover it. 00:27:46.734 [2024-11-21 03:44:27.253285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.734 [2024-11-21 03:44:27.253400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.734 [2024-11-21 03:44:27.253425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.734 qpair failed and we were unable to recover it. 00:27:46.734 [2024-11-21 03:44:27.253573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.734 [2024-11-21 03:44:27.253715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.734 [2024-11-21 03:44:27.253743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.734 qpair failed and we were unable to recover it. 00:27:46.734 [2024-11-21 03:44:27.253902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.734 [2024-11-21 03:44:27.253999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.734 [2024-11-21 03:44:27.254024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.734 qpair failed and we were unable to recover it. 00:27:46.734 [2024-11-21 03:44:27.254215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.734 [2024-11-21 03:44:27.254352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.734 [2024-11-21 03:44:27.254377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.734 qpair failed and we were unable to recover it. 00:27:46.734 [2024-11-21 03:44:27.254545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.734 [2024-11-21 03:44:27.254692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.734 [2024-11-21 03:44:27.254717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.734 qpair failed and we were unable to recover it. 00:27:46.734 [2024-11-21 03:44:27.254878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.734 [2024-11-21 03:44:27.255052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.734 [2024-11-21 03:44:27.255090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.734 qpair failed and we were unable to recover it. 00:27:46.734 [2024-11-21 03:44:27.255245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.734 [2024-11-21 03:44:27.255371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.734 [2024-11-21 03:44:27.255396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.734 qpair failed and we were unable to recover it. 00:27:46.734 [2024-11-21 03:44:27.255494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.734 [2024-11-21 03:44:27.255628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.735 [2024-11-21 03:44:27.255671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.735 qpair failed and we were unable to recover it. 00:27:46.735 [2024-11-21 03:44:27.255814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.735 [2024-11-21 03:44:27.255917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.735 [2024-11-21 03:44:27.255945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.735 qpair failed and we were unable to recover it. 00:27:46.735 [2024-11-21 03:44:27.256065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.735 [2024-11-21 03:44:27.256238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.735 [2024-11-21 03:44:27.256267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.735 qpair failed and we were unable to recover it. 00:27:46.735 [2024-11-21 03:44:27.256403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.735 [2024-11-21 03:44:27.256535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.735 [2024-11-21 03:44:27.256560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.735 qpair failed and we were unable to recover it. 00:27:46.735 [2024-11-21 03:44:27.256664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.735 [2024-11-21 03:44:27.256816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.735 [2024-11-21 03:44:27.256844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.735 qpair failed and we were unable to recover it. 00:27:46.735 [2024-11-21 03:44:27.256988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.735 [2024-11-21 03:44:27.257145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.735 [2024-11-21 03:44:27.257188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.735 qpair failed and we were unable to recover it. 00:27:46.735 [2024-11-21 03:44:27.257285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.735 [2024-11-21 03:44:27.257392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.735 [2024-11-21 03:44:27.257417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.735 qpair failed and we were unable to recover it. 00:27:46.735 [2024-11-21 03:44:27.257573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.735 [2024-11-21 03:44:27.257702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.735 [2024-11-21 03:44:27.257743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.735 qpair failed and we were unable to recover it. 00:27:46.735 [2024-11-21 03:44:27.257862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.735 [2024-11-21 03:44:27.257976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.735 [2024-11-21 03:44:27.258004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.735 qpair failed and we were unable to recover it. 00:27:46.735 [2024-11-21 03:44:27.258186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.735 [2024-11-21 03:44:27.258311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.735 [2024-11-21 03:44:27.258336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.735 qpair failed and we were unable to recover it. 00:27:46.735 [2024-11-21 03:44:27.258483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.735 [2024-11-21 03:44:27.258613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.735 [2024-11-21 03:44:27.258638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.735 qpair failed and we were unable to recover it. 00:27:46.735 [2024-11-21 03:44:27.258782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.735 [2024-11-21 03:44:27.258917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.735 [2024-11-21 03:44:27.258957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.735 qpair failed and we were unable to recover it. 00:27:46.735 [2024-11-21 03:44:27.259102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.735 [2024-11-21 03:44:27.259246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.735 [2024-11-21 03:44:27.259271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.735 qpair failed and we were unable to recover it. 00:27:46.735 [2024-11-21 03:44:27.259470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.735 [2024-11-21 03:44:27.259605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.735 [2024-11-21 03:44:27.259633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.735 qpair failed and we were unable to recover it. 00:27:46.735 [2024-11-21 03:44:27.259774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.735 [2024-11-21 03:44:27.259878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.735 [2024-11-21 03:44:27.259903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.735 qpair failed and we were unable to recover it. 00:27:46.735 [2024-11-21 03:44:27.260006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.735 [2024-11-21 03:44:27.260121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.735 [2024-11-21 03:44:27.260147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.735 qpair failed and we were unable to recover it. 00:27:46.735 [2024-11-21 03:44:27.260272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.735 [2024-11-21 03:44:27.260412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.735 [2024-11-21 03:44:27.260441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.735 qpair failed and we were unable to recover it. 00:27:46.735 [2024-11-21 03:44:27.260590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.735 [2024-11-21 03:44:27.260753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.735 [2024-11-21 03:44:27.260781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.735 qpair failed and we were unable to recover it. 00:27:46.735 [2024-11-21 03:44:27.260902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.735 [2024-11-21 03:44:27.261043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.735 [2024-11-21 03:44:27.261099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.735 qpair failed and we were unable to recover it. 00:27:46.735 [2024-11-21 03:44:27.261210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.735 [2024-11-21 03:44:27.261318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.735 [2024-11-21 03:44:27.261345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.735 qpair failed and we were unable to recover it. 00:27:46.735 [2024-11-21 03:44:27.261458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.735 [2024-11-21 03:44:27.261594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.735 [2024-11-21 03:44:27.261621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.735 qpair failed and we were unable to recover it. 00:27:46.735 [2024-11-21 03:44:27.261773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.735 [2024-11-21 03:44:27.261901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.735 [2024-11-21 03:44:27.261930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.735 qpair failed and we were unable to recover it. 00:27:46.735 [2024-11-21 03:44:27.262096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.735 [2024-11-21 03:44:27.262232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.735 [2024-11-21 03:44:27.262260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.735 qpair failed and we were unable to recover it. 00:27:46.735 [2024-11-21 03:44:27.262408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.735 [2024-11-21 03:44:27.262552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.735 [2024-11-21 03:44:27.262577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.735 qpair failed and we were unable to recover it. 00:27:46.735 [2024-11-21 03:44:27.262737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.735 [2024-11-21 03:44:27.262842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.735 [2024-11-21 03:44:27.262872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.735 qpair failed and we were unable to recover it. 00:27:46.735 [2024-11-21 03:44:27.263012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.735 [2024-11-21 03:44:27.263162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.735 [2024-11-21 03:44:27.263198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.735 qpair failed and we were unable to recover it. 00:27:46.735 [2024-11-21 03:44:27.263339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.735 [2024-11-21 03:44:27.263455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.735 [2024-11-21 03:44:27.263483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.735 qpair failed and we were unable to recover it. 00:27:46.735 [2024-11-21 03:44:27.263627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.735 [2024-11-21 03:44:27.263754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.735 [2024-11-21 03:44:27.263780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.735 qpair failed and we were unable to recover it. 00:27:46.735 [2024-11-21 03:44:27.263944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.735 [2024-11-21 03:44:27.264063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.735 [2024-11-21 03:44:27.264094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.735 qpair failed and we were unable to recover it. 00:27:46.735 [2024-11-21 03:44:27.264232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.735 [2024-11-21 03:44:27.264361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.736 [2024-11-21 03:44:27.264386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.736 qpair failed and we were unable to recover it. 00:27:46.736 [2024-11-21 03:44:27.264521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.736 [2024-11-21 03:44:27.264657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.736 [2024-11-21 03:44:27.264685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.736 qpair failed and we were unable to recover it. 00:27:46.736 [2024-11-21 03:44:27.264808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.736 [2024-11-21 03:44:27.264899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.736 [2024-11-21 03:44:27.264924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.736 qpair failed and we were unable to recover it. 00:27:46.736 [2024-11-21 03:44:27.265074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.736 [2024-11-21 03:44:27.265230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.736 [2024-11-21 03:44:27.265257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.736 qpair failed and we were unable to recover it. 00:27:46.736 [2024-11-21 03:44:27.265397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.736 [2024-11-21 03:44:27.265508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.736 [2024-11-21 03:44:27.265536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.736 qpair failed and we were unable to recover it. 00:27:46.736 [2024-11-21 03:44:27.265642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.736 [2024-11-21 03:44:27.265762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.736 [2024-11-21 03:44:27.265803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.736 qpair failed and we were unable to recover it. 00:27:46.736 [2024-11-21 03:44:27.265962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.736 [2024-11-21 03:44:27.266059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.736 [2024-11-21 03:44:27.266099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.736 qpair failed and we were unable to recover it. 00:27:46.736 [2024-11-21 03:44:27.266280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.736 [2024-11-21 03:44:27.266436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.736 [2024-11-21 03:44:27.266461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.736 qpair failed and we were unable to recover it. 00:27:46.736 [2024-11-21 03:44:27.266582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.736 [2024-11-21 03:44:27.266727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.736 [2024-11-21 03:44:27.266755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.736 qpair failed and we were unable to recover it. 00:27:46.736 [2024-11-21 03:44:27.266897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.736 [2024-11-21 03:44:27.267040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.736 [2024-11-21 03:44:27.267079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.736 qpair failed and we were unable to recover it. 00:27:46.736 [2024-11-21 03:44:27.267243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.736 [2024-11-21 03:44:27.267374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.736 [2024-11-21 03:44:27.267400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.736 qpair failed and we were unable to recover it. 00:27:46.736 [2024-11-21 03:44:27.267558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.736 [2024-11-21 03:44:27.267723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.736 [2024-11-21 03:44:27.267751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.736 qpair failed and we were unable to recover it. 00:27:46.736 [2024-11-21 03:44:27.267926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.736 [2024-11-21 03:44:27.268063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.736 [2024-11-21 03:44:27.268099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.736 qpair failed and we were unable to recover it. 00:27:46.736 [2024-11-21 03:44:27.268229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.736 [2024-11-21 03:44:27.268372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.736 [2024-11-21 03:44:27.268399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.736 qpair failed and we were unable to recover it. 00:27:46.736 [2024-11-21 03:44:27.268541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.736 [2024-11-21 03:44:27.268637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.736 [2024-11-21 03:44:27.268662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.736 qpair failed and we were unable to recover it. 00:27:46.736 [2024-11-21 03:44:27.268811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.736 [2024-11-21 03:44:27.268918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.736 [2024-11-21 03:44:27.268946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.736 qpair failed and we were unable to recover it. 00:27:46.736 [2024-11-21 03:44:27.269098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.736 [2024-11-21 03:44:27.269203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.736 [2024-11-21 03:44:27.269229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.736 qpair failed and we were unable to recover it. 00:27:46.736 [2024-11-21 03:44:27.269385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.736 [2024-11-21 03:44:27.269521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.736 [2024-11-21 03:44:27.269549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.736 qpair failed and we were unable to recover it. 00:27:46.736 [2024-11-21 03:44:27.269730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.736 [2024-11-21 03:44:27.269902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.736 [2024-11-21 03:44:27.269930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.736 qpair failed and we were unable to recover it. 00:27:46.736 [2024-11-21 03:44:27.270077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.736 [2024-11-21 03:44:27.270195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.736 [2024-11-21 03:44:27.270223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.736 qpair failed and we were unable to recover it. 00:27:46.736 [2024-11-21 03:44:27.270336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.736 [2024-11-21 03:44:27.270449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.736 [2024-11-21 03:44:27.270479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.736 qpair failed and we were unable to recover it. 00:27:46.736 [2024-11-21 03:44:27.270652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.736 [2024-11-21 03:44:27.270804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.736 [2024-11-21 03:44:27.270829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.736 qpair failed and we were unable to recover it. 00:27:46.736 [2024-11-21 03:44:27.270960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.736 [2024-11-21 03:44:27.271092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.736 [2024-11-21 03:44:27.271118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.736 qpair failed and we were unable to recover it. 00:27:46.736 [2024-11-21 03:44:27.271249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.736 [2024-11-21 03:44:27.271359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.736 [2024-11-21 03:44:27.271387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.736 qpair failed and we were unable to recover it. 00:27:46.736 [2024-11-21 03:44:27.271491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.736 [2024-11-21 03:44:27.271628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.736 [2024-11-21 03:44:27.271656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.736 qpair failed and we were unable to recover it. 00:27:46.736 [2024-11-21 03:44:27.271769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.736 [2024-11-21 03:44:27.271918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.736 [2024-11-21 03:44:27.271943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.736 qpair failed and we were unable to recover it. 00:27:46.736 [2024-11-21 03:44:27.272066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.736 [2024-11-21 03:44:27.272178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.736 [2024-11-21 03:44:27.272203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.736 qpair failed and we were unable to recover it. 00:27:46.736 [2024-11-21 03:44:27.272338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.736 [2024-11-21 03:44:27.272520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.736 [2024-11-21 03:44:27.272547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.736 qpair failed and we were unable to recover it. 00:27:46.736 [2024-11-21 03:44:27.272719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.736 [2024-11-21 03:44:27.272858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.736 [2024-11-21 03:44:27.272885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.736 qpair failed and we were unable to recover it. 00:27:46.736 [2024-11-21 03:44:27.273016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.736 [2024-11-21 03:44:27.273147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.737 [2024-11-21 03:44:27.273173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.737 qpair failed and we were unable to recover it. 00:27:46.737 [2024-11-21 03:44:27.273273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.737 [2024-11-21 03:44:27.273375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.737 [2024-11-21 03:44:27.273400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.737 qpair failed and we were unable to recover it. 00:27:46.737 [2024-11-21 03:44:27.273530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.737 [2024-11-21 03:44:27.273673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.737 [2024-11-21 03:44:27.273701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.737 qpair failed and we were unable to recover it. 00:27:46.737 [2024-11-21 03:44:27.273875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.737 [2024-11-21 03:44:27.274051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.737 [2024-11-21 03:44:27.274102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.737 qpair failed and we were unable to recover it. 00:27:46.737 [2024-11-21 03:44:27.274217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.737 [2024-11-21 03:44:27.274328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.737 [2024-11-21 03:44:27.274355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.737 qpair failed and we were unable to recover it. 00:27:46.737 [2024-11-21 03:44:27.274507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.737 [2024-11-21 03:44:27.274604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.737 [2024-11-21 03:44:27.274629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.737 qpair failed and we were unable to recover it. 00:27:46.737 [2024-11-21 03:44:27.274761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.737 [2024-11-21 03:44:27.274892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.737 [2024-11-21 03:44:27.274917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.737 qpair failed and we were unable to recover it. 00:27:46.737 [2024-11-21 03:44:27.275066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.737 [2024-11-21 03:44:27.275171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.737 [2024-11-21 03:44:27.275199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.737 qpair failed and we were unable to recover it. 00:27:46.737 [2024-11-21 03:44:27.275341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.737 [2024-11-21 03:44:27.275485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.737 [2024-11-21 03:44:27.275526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.737 qpair failed and we were unable to recover it. 00:27:46.737 [2024-11-21 03:44:27.275626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.737 [2024-11-21 03:44:27.275724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.737 [2024-11-21 03:44:27.275749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.737 qpair failed and we were unable to recover it. 00:27:46.737 [2024-11-21 03:44:27.275923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.737 [2024-11-21 03:44:27.276090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.737 [2024-11-21 03:44:27.276118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.737 qpair failed and we were unable to recover it. 00:27:46.737 [2024-11-21 03:44:27.276259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.737 [2024-11-21 03:44:27.276430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.737 [2024-11-21 03:44:27.276455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.737 qpair failed and we were unable to recover it. 00:27:46.737 [2024-11-21 03:44:27.276582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.737 [2024-11-21 03:44:27.276702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.737 [2024-11-21 03:44:27.276744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.737 qpair failed and we were unable to recover it. 00:27:46.737 [2024-11-21 03:44:27.276893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.737 [2024-11-21 03:44:27.277032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.737 [2024-11-21 03:44:27.277060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.737 qpair failed and we were unable to recover it. 00:27:46.737 [2024-11-21 03:44:27.277222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.737 [2024-11-21 03:44:27.277318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.737 [2024-11-21 03:44:27.277364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.737 qpair failed and we were unable to recover it. 00:27:46.737 [2024-11-21 03:44:27.277502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.737 [2024-11-21 03:44:27.277665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.737 [2024-11-21 03:44:27.277693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.737 qpair failed and we were unable to recover it. 00:27:46.737 [2024-11-21 03:44:27.277816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.737 [2024-11-21 03:44:27.277980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.737 [2024-11-21 03:44:27.278007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.737 qpair failed and we were unable to recover it. 00:27:46.737 [2024-11-21 03:44:27.278123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.737 [2024-11-21 03:44:27.278254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.737 [2024-11-21 03:44:27.278279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.737 qpair failed and we were unable to recover it. 00:27:46.737 [2024-11-21 03:44:27.278396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.737 [2024-11-21 03:44:27.278501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.737 [2024-11-21 03:44:27.278530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.737 qpair failed and we were unable to recover it. 00:27:46.737 [2024-11-21 03:44:27.278658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.737 [2024-11-21 03:44:27.278804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.737 [2024-11-21 03:44:27.278832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.737 qpair failed and we were unable to recover it. 00:27:46.737 [2024-11-21 03:44:27.278955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.737 [2024-11-21 03:44:27.279101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.737 [2024-11-21 03:44:27.279130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.737 qpair failed and we were unable to recover it. 00:27:46.737 [2024-11-21 03:44:27.279278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.737 [2024-11-21 03:44:27.279444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.737 [2024-11-21 03:44:27.279469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.737 qpair failed and we were unable to recover it. 00:27:46.737 [2024-11-21 03:44:27.279629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.737 [2024-11-21 03:44:27.279765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.737 [2024-11-21 03:44:27.279792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.737 qpair failed and we were unable to recover it. 00:27:46.737 [2024-11-21 03:44:27.279948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.737 [2024-11-21 03:44:27.280037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.737 [2024-11-21 03:44:27.280061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.737 qpair failed and we were unable to recover it. 00:27:46.737 [2024-11-21 03:44:27.280167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.737 [2024-11-21 03:44:27.280301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.737 [2024-11-21 03:44:27.280326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.737 qpair failed and we were unable to recover it. 00:27:46.737 [2024-11-21 03:44:27.280457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.737 [2024-11-21 03:44:27.280584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.737 [2024-11-21 03:44:27.280609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.737 qpair failed and we were unable to recover it. 00:27:46.737 [2024-11-21 03:44:27.280706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.737 [2024-11-21 03:44:27.280834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.737 [2024-11-21 03:44:27.280874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.737 qpair failed and we were unable to recover it. 00:27:46.737 [2024-11-21 03:44:27.281021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.737 [2024-11-21 03:44:27.281169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.737 [2024-11-21 03:44:27.281198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.737 qpair failed and we were unable to recover it. 00:27:46.737 [2024-11-21 03:44:27.281365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.737 [2024-11-21 03:44:27.281477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.737 [2024-11-21 03:44:27.281505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.737 qpair failed and we were unable to recover it. 00:27:46.737 [2024-11-21 03:44:27.281658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.738 [2024-11-21 03:44:27.281777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.738 [2024-11-21 03:44:27.281801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.738 qpair failed and we were unable to recover it. 00:27:46.738 [2024-11-21 03:44:27.281984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.738 [2024-11-21 03:44:27.282129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.738 [2024-11-21 03:44:27.282158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.738 qpair failed and we were unable to recover it. 00:27:46.738 [2024-11-21 03:44:27.282304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.738 [2024-11-21 03:44:27.282445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.738 [2024-11-21 03:44:27.282473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.738 qpair failed and we were unable to recover it. 00:27:46.738 [2024-11-21 03:44:27.282657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.738 [2024-11-21 03:44:27.282786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.738 [2024-11-21 03:44:27.282813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.738 qpair failed and we were unable to recover it. 00:27:46.738 [2024-11-21 03:44:27.282976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.738 [2024-11-21 03:44:27.283076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.738 [2024-11-21 03:44:27.283102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.738 qpair failed and we were unable to recover it. 00:27:46.738 [2024-11-21 03:44:27.283252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.738 [2024-11-21 03:44:27.283376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.738 [2024-11-21 03:44:27.283401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.738 qpair failed and we were unable to recover it. 00:27:46.738 [2024-11-21 03:44:27.283539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.738 [2024-11-21 03:44:27.283704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.738 [2024-11-21 03:44:27.283729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.738 qpair failed and we were unable to recover it. 00:27:46.738 [2024-11-21 03:44:27.283861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.738 [2024-11-21 03:44:27.284011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.738 [2024-11-21 03:44:27.284038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.738 qpair failed and we were unable to recover it. 00:27:46.738 [2024-11-21 03:44:27.284196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.738 [2024-11-21 03:44:27.284331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.738 [2024-11-21 03:44:27.284356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.738 qpair failed and we were unable to recover it. 00:27:46.738 [2024-11-21 03:44:27.284510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.738 [2024-11-21 03:44:27.284643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.738 [2024-11-21 03:44:27.284671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.738 qpair failed and we were unable to recover it. 00:27:46.738 [2024-11-21 03:44:27.284811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.738 [2024-11-21 03:44:27.284982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.738 [2024-11-21 03:44:27.285010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.738 qpair failed and we were unable to recover it. 00:27:46.738 [2024-11-21 03:44:27.285171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.738 [2024-11-21 03:44:27.285303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.738 [2024-11-21 03:44:27.285328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.738 qpair failed and we were unable to recover it. 00:27:46.738 [2024-11-21 03:44:27.285466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.738 [2024-11-21 03:44:27.285568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.738 [2024-11-21 03:44:27.285593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.738 qpair failed and we were unable to recover it. 00:27:46.738 [2024-11-21 03:44:27.285788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.738 [2024-11-21 03:44:27.285904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.738 [2024-11-21 03:44:27.285931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.738 qpair failed and we were unable to recover it. 00:27:46.738 [2024-11-21 03:44:27.286082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.738 [2024-11-21 03:44:27.286202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.738 [2024-11-21 03:44:27.286227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.738 qpair failed and we were unable to recover it. 00:27:46.738 [2024-11-21 03:44:27.286323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.738 [2024-11-21 03:44:27.286470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.738 [2024-11-21 03:44:27.286497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.738 qpair failed and we were unable to recover it. 00:27:46.738 [2024-11-21 03:44:27.286623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.738 [2024-11-21 03:44:27.286753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.738 [2024-11-21 03:44:27.286777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.738 qpair failed and we were unable to recover it. 00:27:46.738 [2024-11-21 03:44:27.286954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.738 [2024-11-21 03:44:27.287123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.738 [2024-11-21 03:44:27.287151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.738 qpair failed and we were unable to recover it. 00:27:46.738 [2024-11-21 03:44:27.287337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.738 [2024-11-21 03:44:27.287464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.738 [2024-11-21 03:44:27.287489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.738 qpair failed and we were unable to recover it. 00:27:46.738 [2024-11-21 03:44:27.287642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.738 [2024-11-21 03:44:27.287800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.738 [2024-11-21 03:44:27.287825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.738 qpair failed and we were unable to recover it. 00:27:46.738 [2024-11-21 03:44:27.287987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.738 [2024-11-21 03:44:27.288156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.738 [2024-11-21 03:44:27.288185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.738 qpair failed and we were unable to recover it. 00:27:46.738 [2024-11-21 03:44:27.288295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.738 [2024-11-21 03:44:27.288436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.738 [2024-11-21 03:44:27.288461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.738 qpair failed and we were unable to recover it. 00:27:46.738 [2024-11-21 03:44:27.288588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.738 [2024-11-21 03:44:27.288686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.738 [2024-11-21 03:44:27.288710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.738 qpair failed and we were unable to recover it. 00:27:46.738 [2024-11-21 03:44:27.288889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.738 [2024-11-21 03:44:27.289040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.738 [2024-11-21 03:44:27.289065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.738 qpair failed and we were unable to recover it. 00:27:46.738 [2024-11-21 03:44:27.289205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.738 [2024-11-21 03:44:27.289334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.738 [2024-11-21 03:44:27.289358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.738 qpair failed and we were unable to recover it. 00:27:46.738 [2024-11-21 03:44:27.289470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.738 [2024-11-21 03:44:27.289615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.738 [2024-11-21 03:44:27.289640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.738 qpair failed and we were unable to recover it. 00:27:46.739 [2024-11-21 03:44:27.289770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.739 [2024-11-21 03:44:27.289908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.739 [2024-11-21 03:44:27.289935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.739 qpair failed and we were unable to recover it. 00:27:46.739 [2024-11-21 03:44:27.290096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.739 [2024-11-21 03:44:27.290201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.739 [2024-11-21 03:44:27.290229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.739 qpair failed and we were unable to recover it. 00:27:46.739 [2024-11-21 03:44:27.290397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.739 [2024-11-21 03:44:27.290554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.739 [2024-11-21 03:44:27.290580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.739 qpair failed and we were unable to recover it. 00:27:46.739 [2024-11-21 03:44:27.290766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.739 [2024-11-21 03:44:27.290925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.739 [2024-11-21 03:44:27.290950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.739 qpair failed and we were unable to recover it. 00:27:46.739 [2024-11-21 03:44:27.291106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.739 [2024-11-21 03:44:27.291254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.739 [2024-11-21 03:44:27.291282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.739 qpair failed and we were unable to recover it. 00:27:46.739 [2024-11-21 03:44:27.291398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.739 [2024-11-21 03:44:27.291533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.739 [2024-11-21 03:44:27.291561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.739 qpair failed and we were unable to recover it. 00:27:46.739 [2024-11-21 03:44:27.291738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.739 [2024-11-21 03:44:27.291840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.739 [2024-11-21 03:44:27.291865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.739 qpair failed and we were unable to recover it. 00:27:46.739 [2024-11-21 03:44:27.292024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.739 [2024-11-21 03:44:27.292200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.739 [2024-11-21 03:44:27.292228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.739 qpair failed and we were unable to recover it. 00:27:46.739 [2024-11-21 03:44:27.292373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.739 [2024-11-21 03:44:27.292522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.739 [2024-11-21 03:44:27.292550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.739 qpair failed and we were unable to recover it. 00:27:46.739 [2024-11-21 03:44:27.292657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.739 [2024-11-21 03:44:27.292801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.739 [2024-11-21 03:44:27.292829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.739 qpair failed and we were unable to recover it. 00:27:46.739 [2024-11-21 03:44:27.293009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.739 [2024-11-21 03:44:27.293146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.739 [2024-11-21 03:44:27.293192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.739 qpair failed and we were unable to recover it. 00:27:46.739 [2024-11-21 03:44:27.293306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.739 [2024-11-21 03:44:27.293456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.739 [2024-11-21 03:44:27.293484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.739 qpair failed and we were unable to recover it. 00:27:46.739 [2024-11-21 03:44:27.293631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.739 [2024-11-21 03:44:27.293765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.739 [2024-11-21 03:44:27.293793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.739 qpair failed and we were unable to recover it. 00:27:46.739 [2024-11-21 03:44:27.293965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.739 [2024-11-21 03:44:27.294077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.739 [2024-11-21 03:44:27.294106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.739 qpair failed and we were unable to recover it. 00:27:46.739 [2024-11-21 03:44:27.294235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.739 [2024-11-21 03:44:27.294328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.739 [2024-11-21 03:44:27.294357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.739 qpair failed and we were unable to recover it. 00:27:46.739 [2024-11-21 03:44:27.294497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.739 [2024-11-21 03:44:27.294641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.739 [2024-11-21 03:44:27.294669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.739 qpair failed and we were unable to recover it. 00:27:46.739 [2024-11-21 03:44:27.294819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.739 [2024-11-21 03:44:27.294928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.739 [2024-11-21 03:44:27.294955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.739 qpair failed and we were unable to recover it. 00:27:46.739 [2024-11-21 03:44:27.295061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.739 [2024-11-21 03:44:27.295177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.739 [2024-11-21 03:44:27.295205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.739 qpair failed and we were unable to recover it. 00:27:46.739 [2024-11-21 03:44:27.295395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.739 [2024-11-21 03:44:27.295514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.739 [2024-11-21 03:44:27.295555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.739 qpair failed and we were unable to recover it. 00:27:46.739 [2024-11-21 03:44:27.295689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.739 [2024-11-21 03:44:27.295833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.739 [2024-11-21 03:44:27.295861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.739 qpair failed and we were unable to recover it. 00:27:46.739 [2024-11-21 03:44:27.296006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.739 [2024-11-21 03:44:27.296122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.739 [2024-11-21 03:44:27.296151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.739 qpair failed and we were unable to recover it. 00:27:46.739 [2024-11-21 03:44:27.296260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.739 [2024-11-21 03:44:27.296415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.739 [2024-11-21 03:44:27.296440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.739 qpair failed and we were unable to recover it. 00:27:46.739 [2024-11-21 03:44:27.296542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.739 [2024-11-21 03:44:27.296666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.739 [2024-11-21 03:44:27.296691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.739 qpair failed and we were unable to recover it. 00:27:46.739 [2024-11-21 03:44:27.296837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.739 [2024-11-21 03:44:27.296945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.739 [2024-11-21 03:44:27.296973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.739 qpair failed and we were unable to recover it. 00:27:46.739 [2024-11-21 03:44:27.297081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.739 [2024-11-21 03:44:27.297196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.739 [2024-11-21 03:44:27.297225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.739 qpair failed and we were unable to recover it. 00:27:46.739 [2024-11-21 03:44:27.297360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.739 [2024-11-21 03:44:27.297486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.739 [2024-11-21 03:44:27.297511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.739 qpair failed and we were unable to recover it. 00:27:46.739 [2024-11-21 03:44:27.297611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.739 [2024-11-21 03:44:27.297717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.739 [2024-11-21 03:44:27.297742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.739 qpair failed and we were unable to recover it. 00:27:46.739 [2024-11-21 03:44:27.297919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.739 [2024-11-21 03:44:27.298087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.739 [2024-11-21 03:44:27.298113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.739 qpair failed and we were unable to recover it. 00:27:46.739 [2024-11-21 03:44:27.298272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.739 [2024-11-21 03:44:27.298385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.739 [2024-11-21 03:44:27.298413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.740 qpair failed and we were unable to recover it. 00:27:46.740 [2024-11-21 03:44:27.298561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.740 [2024-11-21 03:44:27.298725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.740 [2024-11-21 03:44:27.298753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.740 qpair failed and we were unable to recover it. 00:27:46.740 [2024-11-21 03:44:27.298895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.740 [2024-11-21 03:44:27.299062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.740 [2024-11-21 03:44:27.299092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.740 qpair failed and we were unable to recover it. 00:27:46.740 [2024-11-21 03:44:27.299258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.740 [2024-11-21 03:44:27.299357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.740 [2024-11-21 03:44:27.299382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.740 qpair failed and we were unable to recover it. 00:27:46.740 [2024-11-21 03:44:27.299558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.740 [2024-11-21 03:44:27.299714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.740 [2024-11-21 03:44:27.299738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.740 qpair failed and we were unable to recover it. 00:27:46.740 [2024-11-21 03:44:27.299866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.740 [2024-11-21 03:44:27.299984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.740 [2024-11-21 03:44:27.300012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.740 qpair failed and we were unable to recover it. 00:27:46.740 [2024-11-21 03:44:27.300173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.740 [2024-11-21 03:44:27.300304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.740 [2024-11-21 03:44:27.300329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.740 qpair failed and we were unable to recover it. 00:27:46.740 [2024-11-21 03:44:27.300510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.740 [2024-11-21 03:44:27.300647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.740 [2024-11-21 03:44:27.300675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.740 qpair failed and we were unable to recover it. 00:27:46.740 [2024-11-21 03:44:27.300850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.740 [2024-11-21 03:44:27.300992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.740 [2024-11-21 03:44:27.301020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.740 qpair failed and we were unable to recover it. 00:27:46.740 [2024-11-21 03:44:27.301141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.740 [2024-11-21 03:44:27.301250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.740 [2024-11-21 03:44:27.301275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.740 qpair failed and we were unable to recover it. 00:27:46.740 [2024-11-21 03:44:27.301389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.740 [2024-11-21 03:44:27.301545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.740 [2024-11-21 03:44:27.301570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.740 qpair failed and we were unable to recover it. 00:27:46.740 [2024-11-21 03:44:27.301696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.740 [2024-11-21 03:44:27.301809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.740 [2024-11-21 03:44:27.301838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.740 qpair failed and we were unable to recover it. 00:27:46.740 [2024-11-21 03:44:27.301988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.740 [2024-11-21 03:44:27.302114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.740 [2024-11-21 03:44:27.302142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.740 qpair failed and we were unable to recover it. 00:27:46.740 [2024-11-21 03:44:27.302290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.740 [2024-11-21 03:44:27.302392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.740 [2024-11-21 03:44:27.302419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.740 qpair failed and we were unable to recover it. 00:27:46.740 [2024-11-21 03:44:27.302570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.740 [2024-11-21 03:44:27.302695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.740 [2024-11-21 03:44:27.302719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.740 qpair failed and we were unable to recover it. 00:27:46.740 [2024-11-21 03:44:27.302842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.740 [2024-11-21 03:44:27.302938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.740 [2024-11-21 03:44:27.302966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.740 qpair failed and we were unable to recover it. 00:27:46.740 [2024-11-21 03:44:27.303172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.740 [2024-11-21 03:44:27.303308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.740 [2024-11-21 03:44:27.303334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.740 qpair failed and we were unable to recover it. 00:27:46.740 [2024-11-21 03:44:27.303517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.740 [2024-11-21 03:44:27.303665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.740 [2024-11-21 03:44:27.303693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.740 qpair failed and we were unable to recover it. 00:27:46.740 [2024-11-21 03:44:27.303842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.740 [2024-11-21 03:44:27.303969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.740 [2024-11-21 03:44:27.303994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.740 qpair failed and we were unable to recover it. 00:27:46.740 [2024-11-21 03:44:27.304102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.740 [2024-11-21 03:44:27.304262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.740 [2024-11-21 03:44:27.304287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.740 qpair failed and we were unable to recover it. 00:27:46.740 [2024-11-21 03:44:27.304450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.740 [2024-11-21 03:44:27.304596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.740 [2024-11-21 03:44:27.304624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.740 qpair failed and we were unable to recover it. 00:27:46.740 [2024-11-21 03:44:27.304796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.740 [2024-11-21 03:44:27.304952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.740 [2024-11-21 03:44:27.304977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.740 qpair failed and we were unable to recover it. 00:27:46.740 [2024-11-21 03:44:27.305096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.740 [2024-11-21 03:44:27.305229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.740 [2024-11-21 03:44:27.305254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.740 qpair failed and we were unable to recover it. 00:27:46.740 [2024-11-21 03:44:27.305411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.740 [2024-11-21 03:44:27.305551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.740 [2024-11-21 03:44:27.305579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.740 qpair failed and we were unable to recover it. 00:27:46.740 [2024-11-21 03:44:27.305772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.740 [2024-11-21 03:44:27.305927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.740 [2024-11-21 03:44:27.305952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.740 qpair failed and we were unable to recover it. 00:27:46.740 [2024-11-21 03:44:27.306105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.740 [2024-11-21 03:44:27.306216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.740 [2024-11-21 03:44:27.306245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.740 qpair failed and we were unable to recover it. 00:27:46.740 [2024-11-21 03:44:27.306398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.740 [2024-11-21 03:44:27.306532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.740 [2024-11-21 03:44:27.306557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.740 qpair failed and we were unable to recover it. 00:27:46.740 [2024-11-21 03:44:27.306748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.740 [2024-11-21 03:44:27.306907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.740 [2024-11-21 03:44:27.306932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.740 qpair failed and we were unable to recover it. 00:27:46.740 [2024-11-21 03:44:27.307101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.740 [2024-11-21 03:44:27.307235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.740 [2024-11-21 03:44:27.307260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.740 qpair failed and we were unable to recover it. 00:27:46.740 [2024-11-21 03:44:27.307416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.740 [2024-11-21 03:44:27.307571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.741 [2024-11-21 03:44:27.307598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.741 qpair failed and we were unable to recover it. 00:27:46.741 [2024-11-21 03:44:27.307720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.741 [2024-11-21 03:44:27.307845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.741 [2024-11-21 03:44:27.307870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.741 qpair failed and we were unable to recover it. 00:27:46.741 [2024-11-21 03:44:27.307960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.741 [2024-11-21 03:44:27.308121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.741 [2024-11-21 03:44:27.308149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.741 qpair failed and we were unable to recover it. 00:27:46.741 [2024-11-21 03:44:27.308323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.741 [2024-11-21 03:44:27.308430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.741 [2024-11-21 03:44:27.308471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.741 qpair failed and we were unable to recover it. 00:27:46.741 [2024-11-21 03:44:27.308602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.741 [2024-11-21 03:44:27.308728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.741 [2024-11-21 03:44:27.308753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.741 qpair failed and we were unable to recover it. 00:27:46.741 [2024-11-21 03:44:27.308879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.741 [2024-11-21 03:44:27.309047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.741 [2024-11-21 03:44:27.309089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.741 qpair failed and we were unable to recover it. 00:27:46.741 [2024-11-21 03:44:27.309248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.741 [2024-11-21 03:44:27.309385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.741 [2024-11-21 03:44:27.309413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.741 qpair failed and we were unable to recover it. 00:27:46.741 [2024-11-21 03:44:27.309560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.741 [2024-11-21 03:44:27.309668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.741 [2024-11-21 03:44:27.309699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.741 qpair failed and we were unable to recover it. 00:27:46.741 [2024-11-21 03:44:27.309814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.741 [2024-11-21 03:44:27.309960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.741 [2024-11-21 03:44:27.309989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.741 qpair failed and we were unable to recover it. 00:27:46.741 [2024-11-21 03:44:27.310136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.741 [2024-11-21 03:44:27.310269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.741 [2024-11-21 03:44:27.310294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.741 qpair failed and we were unable to recover it. 00:27:46.741 [2024-11-21 03:44:27.310400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.741 [2024-11-21 03:44:27.310524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.741 [2024-11-21 03:44:27.310549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.741 qpair failed and we were unable to recover it. 00:27:46.741 [2024-11-21 03:44:27.310647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.741 [2024-11-21 03:44:27.310830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.741 [2024-11-21 03:44:27.310858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.741 qpair failed and we were unable to recover it. 00:27:46.741 [2024-11-21 03:44:27.311024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.741 [2024-11-21 03:44:27.311177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.741 [2024-11-21 03:44:27.311205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.741 qpair failed and we were unable to recover it. 00:27:46.741 [2024-11-21 03:44:27.311326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.741 [2024-11-21 03:44:27.311456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.741 [2024-11-21 03:44:27.311481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.741 qpair failed and we were unable to recover it. 00:27:46.741 [2024-11-21 03:44:27.311633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.741 [2024-11-21 03:44:27.311805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.741 [2024-11-21 03:44:27.311833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.741 qpair failed and we were unable to recover it. 00:27:46.741 [2024-11-21 03:44:27.311944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.741 [2024-11-21 03:44:27.312085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.741 [2024-11-21 03:44:27.312128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.741 qpair failed and we were unable to recover it. 00:27:46.741 [2024-11-21 03:44:27.312258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.741 [2024-11-21 03:44:27.312416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.741 [2024-11-21 03:44:27.312441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.741 qpair failed and we were unable to recover it. 00:27:46.741 [2024-11-21 03:44:27.312600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.741 [2024-11-21 03:44:27.312722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.741 [2024-11-21 03:44:27.312747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.741 qpair failed and we were unable to recover it. 00:27:46.741 [2024-11-21 03:44:27.312920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.741 [2024-11-21 03:44:27.313065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.741 [2024-11-21 03:44:27.313123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.741 qpair failed and we were unable to recover it. 00:27:46.741 [2024-11-21 03:44:27.313255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.741 [2024-11-21 03:44:27.313366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.741 [2024-11-21 03:44:27.313391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.741 qpair failed and we were unable to recover it. 00:27:46.741 [2024-11-21 03:44:27.313491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.741 [2024-11-21 03:44:27.313611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.741 [2024-11-21 03:44:27.313639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.741 qpair failed and we were unable to recover it. 00:27:46.741 [2024-11-21 03:44:27.313762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.741 [2024-11-21 03:44:27.313916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.741 [2024-11-21 03:44:27.313941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.741 qpair failed and we were unable to recover it. 00:27:46.741 [2024-11-21 03:44:27.314098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.741 [2024-11-21 03:44:27.314264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.741 [2024-11-21 03:44:27.314290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.741 qpair failed and we were unable to recover it. 00:27:46.741 [2024-11-21 03:44:27.314484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.741 [2024-11-21 03:44:27.314623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.741 [2024-11-21 03:44:27.314653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.741 qpair failed and we were unable to recover it. 00:27:46.741 [2024-11-21 03:44:27.314813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.741 [2024-11-21 03:44:27.314907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.741 [2024-11-21 03:44:27.314932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.741 qpair failed and we were unable to recover it. 00:27:46.741 [2024-11-21 03:44:27.315095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.741 [2024-11-21 03:44:27.315200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.741 [2024-11-21 03:44:27.315225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.741 qpair failed and we were unable to recover it. 00:27:46.741 [2024-11-21 03:44:27.315354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.741 [2024-11-21 03:44:27.315504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.741 [2024-11-21 03:44:27.315529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.741 qpair failed and we were unable to recover it. 00:27:46.741 [2024-11-21 03:44:27.315635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.741 [2024-11-21 03:44:27.315792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.741 [2024-11-21 03:44:27.315817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.741 qpair failed and we were unable to recover it. 00:27:46.741 [2024-11-21 03:44:27.315941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.741 [2024-11-21 03:44:27.316092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.741 [2024-11-21 03:44:27.316118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.741 qpair failed and we were unable to recover it. 00:27:46.741 [2024-11-21 03:44:27.316274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.741 [2024-11-21 03:44:27.316404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.742 [2024-11-21 03:44:27.316446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.742 qpair failed and we were unable to recover it. 00:27:46.742 [2024-11-21 03:44:27.316565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.742 [2024-11-21 03:44:27.316709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.742 [2024-11-21 03:44:27.316738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.742 qpair failed and we were unable to recover it. 00:27:46.742 [2024-11-21 03:44:27.316887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.742 [2024-11-21 03:44:27.317046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.742 [2024-11-21 03:44:27.317076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.742 qpair failed and we were unable to recover it. 00:27:46.742 [2024-11-21 03:44:27.317200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.742 [2024-11-21 03:44:27.317318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.742 [2024-11-21 03:44:27.317345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.742 qpair failed and we were unable to recover it. 00:27:46.742 [2024-11-21 03:44:27.317475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.742 [2024-11-21 03:44:27.317603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.742 [2024-11-21 03:44:27.317630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.742 qpair failed and we were unable to recover it. 00:27:46.742 [2024-11-21 03:44:27.317734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.742 [2024-11-21 03:44:27.317894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.742 [2024-11-21 03:44:27.317922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.742 qpair failed and we were unable to recover it. 00:27:46.742 [2024-11-21 03:44:27.318104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.742 [2024-11-21 03:44:27.318226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.742 [2024-11-21 03:44:27.318254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.742 qpair failed and we were unable to recover it. 00:27:46.742 [2024-11-21 03:44:27.318407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.742 [2024-11-21 03:44:27.318547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.742 [2024-11-21 03:44:27.318575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.742 qpair failed and we were unable to recover it. 00:27:46.742 [2024-11-21 03:44:27.318721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.742 [2024-11-21 03:44:27.318821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.742 [2024-11-21 03:44:27.318847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.742 qpair failed and we were unable to recover it. 00:27:46.742 [2024-11-21 03:44:27.318978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.742 [2024-11-21 03:44:27.319081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.742 [2024-11-21 03:44:27.319108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.742 qpair failed and we were unable to recover it. 00:27:46.742 [2024-11-21 03:44:27.319273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.742 [2024-11-21 03:44:27.319377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.742 [2024-11-21 03:44:27.319402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.742 qpair failed and we were unable to recover it. 00:27:46.742 [2024-11-21 03:44:27.319521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.742 [2024-11-21 03:44:27.319628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.742 [2024-11-21 03:44:27.319656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.742 qpair failed and we were unable to recover it. 00:27:46.742 [2024-11-21 03:44:27.319801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.742 [2024-11-21 03:44:27.319899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.742 [2024-11-21 03:44:27.319924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.742 qpair failed and we were unable to recover it. 00:27:46.742 [2024-11-21 03:44:27.320031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.742 [2024-11-21 03:44:27.320212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.742 [2024-11-21 03:44:27.320237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.742 qpair failed and we were unable to recover it. 00:27:46.742 [2024-11-21 03:44:27.320403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.742 [2024-11-21 03:44:27.320555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.742 [2024-11-21 03:44:27.320596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.742 qpair failed and we were unable to recover it. 00:27:46.742 [2024-11-21 03:44:27.320754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.742 [2024-11-21 03:44:27.320908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.742 [2024-11-21 03:44:27.320936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.742 qpair failed and we were unable to recover it. 00:27:46.742 [2024-11-21 03:44:27.321093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.742 [2024-11-21 03:44:27.321249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.742 [2024-11-21 03:44:27.321275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.742 qpair failed and we were unable to recover it. 00:27:46.742 [2024-11-21 03:44:27.321411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.742 [2024-11-21 03:44:27.321561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.742 [2024-11-21 03:44:27.321589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.742 qpair failed and we were unable to recover it. 00:27:46.742 [2024-11-21 03:44:27.321703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.742 [2024-11-21 03:44:27.321804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.742 [2024-11-21 03:44:27.321832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.742 qpair failed and we were unable to recover it. 00:27:46.742 [2024-11-21 03:44:27.321977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.742 [2024-11-21 03:44:27.322102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.742 [2024-11-21 03:44:27.322131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.742 qpair failed and we were unable to recover it. 00:27:46.742 [2024-11-21 03:44:27.322285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.742 [2024-11-21 03:44:27.322425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.742 [2024-11-21 03:44:27.322450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.742 qpair failed and we were unable to recover it. 00:27:46.742 [2024-11-21 03:44:27.322645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.742 [2024-11-21 03:44:27.322784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.742 [2024-11-21 03:44:27.322812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.742 qpair failed and we were unable to recover it. 00:27:46.742 [2024-11-21 03:44:27.322966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.742 [2024-11-21 03:44:27.323125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.742 [2024-11-21 03:44:27.323151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.742 qpair failed and we were unable to recover it. 00:27:46.742 [2024-11-21 03:44:27.323297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.742 [2024-11-21 03:44:27.323476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.742 [2024-11-21 03:44:27.323504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.742 qpair failed and we were unable to recover it. 00:27:46.742 [2024-11-21 03:44:27.323621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.742 [2024-11-21 03:44:27.323748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.742 [2024-11-21 03:44:27.323773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.742 qpair failed and we were unable to recover it. 00:27:46.742 [2024-11-21 03:44:27.323894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.742 [2024-11-21 03:44:27.324037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.742 [2024-11-21 03:44:27.324085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:46.743 qpair failed and we were unable to recover it. 00:27:46.743 [2024-11-21 03:44:27.324235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.743 [2024-11-21 03:44:27.324371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.743 [2024-11-21 03:44:27.324400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:46.743 qpair failed and we were unable to recover it. 00:27:46.743 [2024-11-21 03:44:27.324532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.743 [2024-11-21 03:44:27.324663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.743 [2024-11-21 03:44:27.324689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:46.743 qpair failed and we were unable to recover it. 00:27:46.743 [2024-11-21 03:44:27.324851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.743 [2024-11-21 03:44:27.324952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.743 [2024-11-21 03:44:27.324980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:46.743 qpair failed and we were unable to recover it. 00:27:46.743 [2024-11-21 03:44:27.325122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.743 [2024-11-21 03:44:27.325281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.743 [2024-11-21 03:44:27.325307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:46.743 qpair failed and we were unable to recover it. 00:27:46.743 [2024-11-21 03:44:27.325411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.743 [2024-11-21 03:44:27.325519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.743 [2024-11-21 03:44:27.325545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:46.743 qpair failed and we were unable to recover it. 00:27:46.743 [2024-11-21 03:44:27.325680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.743 [2024-11-21 03:44:27.325784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.743 [2024-11-21 03:44:27.325810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:46.743 qpair failed and we were unable to recover it. 00:27:46.743 [2024-11-21 03:44:27.325941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.743 [2024-11-21 03:44:27.326067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.743 [2024-11-21 03:44:27.326102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:46.743 qpair failed and we were unable to recover it. 00:27:46.743 [2024-11-21 03:44:27.326230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.743 [2024-11-21 03:44:27.326334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.743 [2024-11-21 03:44:27.326359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:46.743 qpair failed and we were unable to recover it. 00:27:46.743 [2024-11-21 03:44:27.326456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.743 [2024-11-21 03:44:27.326582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.743 [2024-11-21 03:44:27.326607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:46.743 qpair failed and we were unable to recover it. 00:27:46.743 [2024-11-21 03:44:27.326731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.743 [2024-11-21 03:44:27.326843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.743 [2024-11-21 03:44:27.326869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:46.743 qpair failed and we were unable to recover it. 00:27:46.743 [2024-11-21 03:44:27.326982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.743 [2024-11-21 03:44:27.327087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.743 [2024-11-21 03:44:27.327117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:46.743 qpair failed and we were unable to recover it. 00:27:46.743 [2024-11-21 03:44:27.327222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.743 [2024-11-21 03:44:27.327316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.743 [2024-11-21 03:44:27.327342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:46.743 qpair failed and we were unable to recover it. 00:27:46.743 [2024-11-21 03:44:27.327461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.743 [2024-11-21 03:44:27.327571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.743 [2024-11-21 03:44:27.327597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:46.743 qpair failed and we were unable to recover it. 00:27:46.743 [2024-11-21 03:44:27.327720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.743 [2024-11-21 03:44:27.327853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.743 [2024-11-21 03:44:27.327878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:46.743 qpair failed and we were unable to recover it. 00:27:46.743 [2024-11-21 03:44:27.328011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.743 [2024-11-21 03:44:27.328150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.743 [2024-11-21 03:44:27.328176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:46.743 qpair failed and we were unable to recover it. 00:27:46.743 [2024-11-21 03:44:27.328343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.743 [2024-11-21 03:44:27.328470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.743 [2024-11-21 03:44:27.328496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:46.743 qpair failed and we were unable to recover it. 00:27:46.743 [2024-11-21 03:44:27.328628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.743 [2024-11-21 03:44:27.328729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:46.743 [2024-11-21 03:44:27.328756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.015 qpair failed and we were unable to recover it. 00:27:47.015 [2024-11-21 03:44:27.328892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.015 [2024-11-21 03:44:27.329026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.015 [2024-11-21 03:44:27.329051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.015 qpair failed and we were unable to recover it. 00:27:47.015 [2024-11-21 03:44:27.329179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.015 [2024-11-21 03:44:27.329306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.015 [2024-11-21 03:44:27.329332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.015 qpair failed and we were unable to recover it. 00:27:47.015 [2024-11-21 03:44:27.329472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.015 [2024-11-21 03:44:27.329604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.015 [2024-11-21 03:44:27.329631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.015 qpair failed and we were unable to recover it. 00:27:47.015 [2024-11-21 03:44:27.329788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.015 [2024-11-21 03:44:27.329961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.015 [2024-11-21 03:44:27.329989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.015 qpair failed and we were unable to recover it. 00:27:47.015 [2024-11-21 03:44:27.330114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.015 [2024-11-21 03:44:27.330242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.015 [2024-11-21 03:44:27.330269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.015 qpair failed and we were unable to recover it. 00:27:47.015 [2024-11-21 03:44:27.330403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.015 [2024-11-21 03:44:27.330532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.015 [2024-11-21 03:44:27.330557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.015 qpair failed and we were unable to recover it. 00:27:47.015 [2024-11-21 03:44:27.330657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.015 [2024-11-21 03:44:27.330788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.015 [2024-11-21 03:44:27.330813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.015 qpair failed and we were unable to recover it. 00:27:47.015 [2024-11-21 03:44:27.330934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.015 [2024-11-21 03:44:27.331033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.015 [2024-11-21 03:44:27.331083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.015 qpair failed and we were unable to recover it. 00:27:47.015 [2024-11-21 03:44:27.331224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.015 [2024-11-21 03:44:27.331353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.015 [2024-11-21 03:44:27.331379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.015 qpair failed and we were unable to recover it. 00:27:47.015 [2024-11-21 03:44:27.331551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.015 [2024-11-21 03:44:27.331653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.015 [2024-11-21 03:44:27.331679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.015 qpair failed and we were unable to recover it. 00:27:47.015 [2024-11-21 03:44:27.331801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.015 [2024-11-21 03:44:27.331898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.015 [2024-11-21 03:44:27.331923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.015 qpair failed and we were unable to recover it. 00:27:47.015 [2024-11-21 03:44:27.332022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.015 [2024-11-21 03:44:27.332139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.015 [2024-11-21 03:44:27.332166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.015 qpair failed and we were unable to recover it. 00:27:47.015 [2024-11-21 03:44:27.332295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.015 [2024-11-21 03:44:27.332432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.015 [2024-11-21 03:44:27.332458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.015 qpair failed and we were unable to recover it. 00:27:47.015 [2024-11-21 03:44:27.332586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.015 [2024-11-21 03:44:27.332743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.015 [2024-11-21 03:44:27.332768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.015 qpair failed and we were unable to recover it. 00:27:47.015 [2024-11-21 03:44:27.332941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.015 [2024-11-21 03:44:27.333160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.015 [2024-11-21 03:44:27.333187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.015 qpair failed and we were unable to recover it. 00:27:47.015 [2024-11-21 03:44:27.333293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.015 [2024-11-21 03:44:27.333392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.015 [2024-11-21 03:44:27.333417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.015 qpair failed and we were unable to recover it. 00:27:47.015 [2024-11-21 03:44:27.333546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.015 [2024-11-21 03:44:27.333678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.015 [2024-11-21 03:44:27.333703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.015 qpair failed and we were unable to recover it. 00:27:47.015 [2024-11-21 03:44:27.333841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.015 [2024-11-21 03:44:27.333975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.015 [2024-11-21 03:44:27.334006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.015 qpair failed and we were unable to recover it. 00:27:47.015 [2024-11-21 03:44:27.334120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.015 [2024-11-21 03:44:27.334255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.015 [2024-11-21 03:44:27.334282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.015 qpair failed and we were unable to recover it. 00:27:47.015 [2024-11-21 03:44:27.334412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.015 [2024-11-21 03:44:27.334520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.015 [2024-11-21 03:44:27.334545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.015 qpair failed and we were unable to recover it. 00:27:47.015 [2024-11-21 03:44:27.334650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.015 [2024-11-21 03:44:27.334773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.015 [2024-11-21 03:44:27.334798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.015 qpair failed and we were unable to recover it. 00:27:47.015 [2024-11-21 03:44:27.334931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.015 [2024-11-21 03:44:27.335085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.015 [2024-11-21 03:44:27.335112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.015 qpair failed and we were unable to recover it. 00:27:47.015 [2024-11-21 03:44:27.335221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.015 [2024-11-21 03:44:27.335354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.335380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.016 qpair failed and we were unable to recover it. 00:27:47.016 [2024-11-21 03:44:27.335487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.335619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.335648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.016 qpair failed and we were unable to recover it. 00:27:47.016 [2024-11-21 03:44:27.335782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.335910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.335936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.016 qpair failed and we were unable to recover it. 00:27:47.016 [2024-11-21 03:44:27.336056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.336212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.336238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.016 qpair failed and we were unable to recover it. 00:27:47.016 [2024-11-21 03:44:27.336349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.336515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.336540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.016 qpair failed and we were unable to recover it. 00:27:47.016 [2024-11-21 03:44:27.336637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.336760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.336790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.016 qpair failed and we were unable to recover it. 00:27:47.016 [2024-11-21 03:44:27.336920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.337030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.337055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.016 qpair failed and we were unable to recover it. 00:27:47.016 [2024-11-21 03:44:27.337225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.337349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.337383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.016 qpair failed and we were unable to recover it. 00:27:47.016 [2024-11-21 03:44:27.337516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.337671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.337697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.016 qpair failed and we were unable to recover it. 00:27:47.016 [2024-11-21 03:44:27.337793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.337956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.337981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.016 qpair failed and we were unable to recover it. 00:27:47.016 [2024-11-21 03:44:27.338114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.338251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.338277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.016 qpair failed and we were unable to recover it. 00:27:47.016 [2024-11-21 03:44:27.338411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.338571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.338597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.016 qpair failed and we were unable to recover it. 00:27:47.016 [2024-11-21 03:44:27.338692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.338824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.338849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.016 qpair failed and we were unable to recover it. 00:27:47.016 [2024-11-21 03:44:27.338950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.339055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.339091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.016 qpair failed and we were unable to recover it. 00:27:47.016 [2024-11-21 03:44:27.339221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.339377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.339403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.016 qpair failed and we were unable to recover it. 00:27:47.016 [2024-11-21 03:44:27.339502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.339659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.339688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.016 qpair failed and we were unable to recover it. 00:27:47.016 [2024-11-21 03:44:27.339851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.339983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.340010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.016 qpair failed and we were unable to recover it. 00:27:47.016 [2024-11-21 03:44:27.340169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.340302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.340327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.016 qpair failed and we were unable to recover it. 00:27:47.016 [2024-11-21 03:44:27.340460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.340562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.340588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.016 qpair failed and we were unable to recover it. 00:27:47.016 [2024-11-21 03:44:27.340718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.340874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.340900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.016 qpair failed and we were unable to recover it. 00:27:47.016 [2024-11-21 03:44:27.341055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.341167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.341193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.016 qpair failed and we were unable to recover it. 00:27:47.016 [2024-11-21 03:44:27.341289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.341440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.341466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.016 qpair failed and we were unable to recover it. 00:27:47.016 [2024-11-21 03:44:27.341596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.341760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.341785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.016 qpair failed and we were unable to recover it. 00:27:47.016 [2024-11-21 03:44:27.341891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.342089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.342131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.016 qpair failed and we were unable to recover it. 00:27:47.016 [2024-11-21 03:44:27.342235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.342364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.342389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.016 qpair failed and we were unable to recover it. 00:27:47.016 [2024-11-21 03:44:27.342524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.342650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.342675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.016 qpair failed and we were unable to recover it. 00:27:47.016 [2024-11-21 03:44:27.342785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.342885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.342911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.016 qpair failed and we were unable to recover it. 00:27:47.016 [2024-11-21 03:44:27.343013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.343184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.343211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.016 qpair failed and we were unable to recover it. 00:27:47.016 [2024-11-21 03:44:27.343342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.343450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.343476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.016 qpair failed and we were unable to recover it. 00:27:47.016 [2024-11-21 03:44:27.343591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.343748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.343773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.016 qpair failed and we were unable to recover it. 00:27:47.016 [2024-11-21 03:44:27.343897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.344052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.344083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.016 qpair failed and we were unable to recover it. 00:27:47.016 [2024-11-21 03:44:27.344217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.344345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.344372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.016 qpair failed and we were unable to recover it. 00:27:47.016 [2024-11-21 03:44:27.344543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.344651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.344677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.016 qpair failed and we were unable to recover it. 00:27:47.016 [2024-11-21 03:44:27.344815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.344947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.344973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.016 qpair failed and we were unable to recover it. 00:27:47.016 [2024-11-21 03:44:27.345102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.345234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.345261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.016 qpair failed and we were unable to recover it. 00:27:47.016 [2024-11-21 03:44:27.345429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.345585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.345611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.016 qpair failed and we were unable to recover it. 00:27:47.016 [2024-11-21 03:44:27.345752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.345906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.345931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.016 qpair failed and we were unable to recover it. 00:27:47.016 [2024-11-21 03:44:27.346036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.346165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.346191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.016 qpair failed and we were unable to recover it. 00:27:47.016 [2024-11-21 03:44:27.346316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.346444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.346470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.016 qpair failed and we were unable to recover it. 00:27:47.016 [2024-11-21 03:44:27.346597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.346725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.346751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.016 qpair failed and we were unable to recover it. 00:27:47.016 [2024-11-21 03:44:27.346891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.347028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.347056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.016 qpair failed and we were unable to recover it. 00:27:47.016 [2024-11-21 03:44:27.347237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.347374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.347402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.016 qpair failed and we were unable to recover it. 00:27:47.016 [2024-11-21 03:44:27.347580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.347726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.347754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.016 qpair failed and we were unable to recover it. 00:27:47.016 [2024-11-21 03:44:27.347941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.348093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.348137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.016 qpair failed and we were unable to recover it. 00:27:47.016 [2024-11-21 03:44:27.348300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.348441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.348467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.016 qpair failed and we were unable to recover it. 00:27:47.016 [2024-11-21 03:44:27.348572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.348671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.348698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.016 qpair failed and we were unable to recover it. 00:27:47.016 [2024-11-21 03:44:27.348830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.349000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.349028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.016 qpair failed and we were unable to recover it. 00:27:47.016 [2024-11-21 03:44:27.349159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.349253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.349278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.016 qpair failed and we were unable to recover it. 00:27:47.016 [2024-11-21 03:44:27.349435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.349601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.349626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.016 qpair failed and we were unable to recover it. 00:27:47.016 [2024-11-21 03:44:27.349751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.349874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.349901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.016 qpair failed and we were unable to recover it. 00:27:47.016 [2024-11-21 03:44:27.350151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.350305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.350330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.016 qpair failed and we were unable to recover it. 00:27:47.016 [2024-11-21 03:44:27.350438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.350608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.350633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.016 qpair failed and we were unable to recover it. 00:27:47.016 [2024-11-21 03:44:27.350737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.350864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.350889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.016 qpair failed and we were unable to recover it. 00:27:47.016 [2024-11-21 03:44:27.351021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.351155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.351181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.016 qpair failed and we were unable to recover it. 00:27:47.016 [2024-11-21 03:44:27.351319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.351430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.016 [2024-11-21 03:44:27.351456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.016 qpair failed and we were unable to recover it. 00:27:47.016 [2024-11-21 03:44:27.351615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.351711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.351737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.017 qpair failed and we were unable to recover it. 00:27:47.017 [2024-11-21 03:44:27.351877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.352025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.352053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.017 qpair failed and we were unable to recover it. 00:27:47.017 [2024-11-21 03:44:27.352237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.352341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.352374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.017 qpair failed and we were unable to recover it. 00:27:47.017 [2024-11-21 03:44:27.352504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.352659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.352684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.017 qpair failed and we were unable to recover it. 00:27:47.017 [2024-11-21 03:44:27.352823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.352972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.353000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.017 qpair failed and we were unable to recover it. 00:27:47.017 [2024-11-21 03:44:27.353143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.353277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.353302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.017 qpair failed and we were unable to recover it. 00:27:47.017 [2024-11-21 03:44:27.353404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.353557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.353583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.017 qpair failed and we were unable to recover it. 00:27:47.017 [2024-11-21 03:44:27.353691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.353819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.353844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.017 qpair failed and we were unable to recover it. 00:27:47.017 [2024-11-21 03:44:27.353976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.354130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.354156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.017 qpair failed and we were unable to recover it. 00:27:47.017 [2024-11-21 03:44:27.354283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.354392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.354418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.017 qpair failed and we were unable to recover it. 00:27:47.017 [2024-11-21 03:44:27.354548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.354648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.354674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.017 qpair failed and we were unable to recover it. 00:27:47.017 [2024-11-21 03:44:27.354776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.354939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.354965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.017 qpair failed and we were unable to recover it. 00:27:47.017 [2024-11-21 03:44:27.355127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.355256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.355282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.017 qpair failed and we were unable to recover it. 00:27:47.017 [2024-11-21 03:44:27.355413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.355557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.355583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.017 qpair failed and we were unable to recover it. 00:27:47.017 [2024-11-21 03:44:27.355750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.355856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.355882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.017 qpair failed and we were unable to recover it. 00:27:47.017 [2024-11-21 03:44:27.356022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.356174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.356201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.017 qpair failed and we were unable to recover it. 00:27:47.017 [2024-11-21 03:44:27.356339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.356468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.356493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.017 qpair failed and we were unable to recover it. 00:27:47.017 [2024-11-21 03:44:27.356616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.356740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.356765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.017 qpair failed and we were unable to recover it. 00:27:47.017 [2024-11-21 03:44:27.356947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.357052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.357084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.017 qpair failed and we were unable to recover it. 00:27:47.017 [2024-11-21 03:44:27.357217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.357327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.357353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.017 qpair failed and we were unable to recover it. 00:27:47.017 [2024-11-21 03:44:27.357447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.357575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.357600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.017 qpair failed and we were unable to recover it. 00:27:47.017 [2024-11-21 03:44:27.357727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.357851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.357877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.017 qpair failed and we were unable to recover it. 00:27:47.017 [2024-11-21 03:44:27.357994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.358112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.358139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.017 qpair failed and we were unable to recover it. 00:27:47.017 [2024-11-21 03:44:27.358292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.358403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.358430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.017 qpair failed and we were unable to recover it. 00:27:47.017 [2024-11-21 03:44:27.358554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.358652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.358677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.017 qpair failed and we were unable to recover it. 00:27:47.017 [2024-11-21 03:44:27.358803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.358928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.358954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.017 qpair failed and we were unable to recover it. 00:27:47.017 [2024-11-21 03:44:27.359052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.359178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.359204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.017 qpair failed and we were unable to recover it. 00:27:47.017 [2024-11-21 03:44:27.359332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.359434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.359459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.017 qpair failed and we were unable to recover it. 00:27:47.017 [2024-11-21 03:44:27.359567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.359718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.359744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.017 qpair failed and we were unable to recover it. 00:27:47.017 [2024-11-21 03:44:27.359887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.360025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.360053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.017 qpair failed and we were unable to recover it. 00:27:47.017 [2024-11-21 03:44:27.360174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.360340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.360366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.017 qpair failed and we were unable to recover it. 00:27:47.017 [2024-11-21 03:44:27.360478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.360609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.360636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.017 qpair failed and we were unable to recover it. 00:27:47.017 [2024-11-21 03:44:27.360749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.360875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.360903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.017 qpair failed and we were unable to recover it. 00:27:47.017 [2024-11-21 03:44:27.361034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.361201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.361227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.017 qpair failed and we were unable to recover it. 00:27:47.017 [2024-11-21 03:44:27.361380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.361512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.361540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.017 qpair failed and we were unable to recover it. 00:27:47.017 [2024-11-21 03:44:27.361684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.361870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.361900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.017 qpair failed and we were unable to recover it. 00:27:47.017 [2024-11-21 03:44:27.362104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.362219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.362246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.017 qpair failed and we were unable to recover it. 00:27:47.017 [2024-11-21 03:44:27.362380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.362511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.362536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.017 qpair failed and we were unable to recover it. 00:27:47.017 [2024-11-21 03:44:27.362660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.362789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.362814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.017 qpair failed and we were unable to recover it. 00:27:47.017 [2024-11-21 03:44:27.362935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.363186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.363212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.017 qpair failed and we were unable to recover it. 00:27:47.017 [2024-11-21 03:44:27.363349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.363473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.363499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.017 qpair failed and we were unable to recover it. 00:27:47.017 [2024-11-21 03:44:27.363658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.363785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.363811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.017 qpair failed and we were unable to recover it. 00:27:47.017 [2024-11-21 03:44:27.363993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.364150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.364176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.017 qpair failed and we were unable to recover it. 00:27:47.017 [2024-11-21 03:44:27.364275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.364376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.364401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.017 qpair failed and we were unable to recover it. 00:27:47.017 [2024-11-21 03:44:27.364536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.364657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.364682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.017 qpair failed and we were unable to recover it. 00:27:47.017 [2024-11-21 03:44:27.364812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.364965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.364994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.017 qpair failed and we were unable to recover it. 00:27:47.017 [2024-11-21 03:44:27.365118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.365218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.365244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.017 qpair failed and we were unable to recover it. 00:27:47.017 [2024-11-21 03:44:27.365402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.365499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.365524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.017 qpair failed and we were unable to recover it. 00:27:47.017 [2024-11-21 03:44:27.365655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.365781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.017 [2024-11-21 03:44:27.365806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.017 qpair failed and we were unable to recover it. 00:27:47.017 [2024-11-21 03:44:27.365950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.018 [2024-11-21 03:44:27.366156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.018 [2024-11-21 03:44:27.366182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.018 qpair failed and we were unable to recover it. 00:27:47.018 [2024-11-21 03:44:27.366311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.018 [2024-11-21 03:44:27.366458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.018 [2024-11-21 03:44:27.366486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.018 qpair failed and we were unable to recover it. 00:27:47.018 [2024-11-21 03:44:27.366631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.018 [2024-11-21 03:44:27.366766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.018 [2024-11-21 03:44:27.366796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.018 qpair failed and we were unable to recover it. 00:27:47.018 [2024-11-21 03:44:27.366981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.018 [2024-11-21 03:44:27.367151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.018 [2024-11-21 03:44:27.367178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.018 qpair failed and we were unable to recover it. 00:27:47.018 [2024-11-21 03:44:27.367321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.018 [2024-11-21 03:44:27.367432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.018 [2024-11-21 03:44:27.367460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.018 qpair failed and we were unable to recover it. 00:27:47.018 [2024-11-21 03:44:27.367676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.018 [2024-11-21 03:44:27.367848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.018 [2024-11-21 03:44:27.367876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.018 qpair failed and we were unable to recover it. 00:27:47.018 [2024-11-21 03:44:27.368051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.018 [2024-11-21 03:44:27.368175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.018 [2024-11-21 03:44:27.368202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.018 qpair failed and we were unable to recover it. 00:27:47.018 [2024-11-21 03:44:27.368355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.018 [2024-11-21 03:44:27.368480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.018 [2024-11-21 03:44:27.368505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.018 qpair failed and we were unable to recover it. 00:27:47.018 [2024-11-21 03:44:27.368631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.018 [2024-11-21 03:44:27.368766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.018 [2024-11-21 03:44:27.368794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.018 qpair failed and we were unable to recover it. 00:27:47.018 [2024-11-21 03:44:27.368938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.018 [2024-11-21 03:44:27.369074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.018 [2024-11-21 03:44:27.369119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.018 qpair failed and we were unable to recover it. 00:27:47.018 [2024-11-21 03:44:27.369339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.018 [2024-11-21 03:44:27.369573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.018 [2024-11-21 03:44:27.369602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.018 qpair failed and we were unable to recover it. 00:27:47.018 [2024-11-21 03:44:27.369753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.018 [2024-11-21 03:44:27.369880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.018 [2024-11-21 03:44:27.369905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.018 qpair failed and we were unable to recover it. 00:27:47.018 [2024-11-21 03:44:27.370034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.018 [2024-11-21 03:44:27.370198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.018 [2024-11-21 03:44:27.370225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.018 qpair failed and we were unable to recover it. 00:27:47.018 [2024-11-21 03:44:27.370356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.018 [2024-11-21 03:44:27.370486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.018 [2024-11-21 03:44:27.370512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.018 qpair failed and we were unable to recover it. 00:27:47.018 [2024-11-21 03:44:27.370644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.018 [2024-11-21 03:44:27.370810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.018 [2024-11-21 03:44:27.370835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.018 qpair failed and we were unable to recover it. 00:27:47.018 [2024-11-21 03:44:27.370993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.018 [2024-11-21 03:44:27.371142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.018 [2024-11-21 03:44:27.371168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.018 qpair failed and we were unable to recover it. 00:27:47.018 [2024-11-21 03:44:27.371272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.018 [2024-11-21 03:44:27.371428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.018 [2024-11-21 03:44:27.371453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.018 qpair failed and we were unable to recover it. 00:27:47.018 [2024-11-21 03:44:27.371581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.018 [2024-11-21 03:44:27.371709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.018 [2024-11-21 03:44:27.371735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.018 qpair failed and we were unable to recover it. 00:27:47.018 [2024-11-21 03:44:27.371862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.018 [2024-11-21 03:44:27.371957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.018 [2024-11-21 03:44:27.371983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.018 qpair failed and we were unable to recover it. 00:27:47.018 [2024-11-21 03:44:27.372096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.018 [2024-11-21 03:44:27.372231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.018 [2024-11-21 03:44:27.372256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.018 qpair failed and we were unable to recover it. 00:27:47.018 [2024-11-21 03:44:27.372424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.018 [2024-11-21 03:44:27.372555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.018 [2024-11-21 03:44:27.372581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.018 qpair failed and we were unable to recover it. 00:27:47.018 [2024-11-21 03:44:27.372678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.018 [2024-11-21 03:44:27.372838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.018 [2024-11-21 03:44:27.372864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.018 qpair failed and we were unable to recover it. 00:27:47.018 [2024-11-21 03:44:27.372965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.018 [2024-11-21 03:44:27.373079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.018 [2024-11-21 03:44:27.373114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.018 qpair failed and we were unable to recover it. 00:27:47.018 [2024-11-21 03:44:27.373215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.018 [2024-11-21 03:44:27.373348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.018 [2024-11-21 03:44:27.373374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.018 qpair failed and we were unable to recover it. 00:27:47.018 [2024-11-21 03:44:27.373539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.018 [2024-11-21 03:44:27.373659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.018 [2024-11-21 03:44:27.373684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.018 qpair failed and we were unable to recover it. 00:27:47.018 [2024-11-21 03:44:27.373813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.018 [2024-11-21 03:44:27.373938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.018 [2024-11-21 03:44:27.373964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.019 qpair failed and we were unable to recover it. 00:27:47.019 [2024-11-21 03:44:27.374120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.374218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.374243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.019 qpair failed and we were unable to recover it. 00:27:47.019 [2024-11-21 03:44:27.374376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.374504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.374529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.019 qpair failed and we were unable to recover it. 00:27:47.019 [2024-11-21 03:44:27.374660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.374750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.374775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.019 qpair failed and we were unable to recover it. 00:27:47.019 [2024-11-21 03:44:27.374902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.375081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.375125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.019 qpair failed and we were unable to recover it. 00:27:47.019 [2024-11-21 03:44:27.375228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.375353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.375379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.019 qpair failed and we were unable to recover it. 00:27:47.019 [2024-11-21 03:44:27.375479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.375639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.375665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.019 qpair failed and we were unable to recover it. 00:27:47.019 [2024-11-21 03:44:27.375792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.375933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.375958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.019 qpair failed and we were unable to recover it. 00:27:47.019 [2024-11-21 03:44:27.376096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.376198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.376224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.019 qpair failed and we were unable to recover it. 00:27:47.019 [2024-11-21 03:44:27.376352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.376480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.376506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.019 qpair failed and we were unable to recover it. 00:27:47.019 [2024-11-21 03:44:27.376645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.376801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.376826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.019 qpair failed and we were unable to recover it. 00:27:47.019 [2024-11-21 03:44:27.376951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.377046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.377076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.019 qpair failed and we were unable to recover it. 00:27:47.019 [2024-11-21 03:44:27.377212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.377348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.377375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.019 qpair failed and we were unable to recover it. 00:27:47.019 [2024-11-21 03:44:27.377505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.377636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.377662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.019 qpair failed and we were unable to recover it. 00:27:47.019 [2024-11-21 03:44:27.377790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.377926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.377954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.019 qpair failed and we were unable to recover it. 00:27:47.019 [2024-11-21 03:44:27.378103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.378234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.378259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.019 qpair failed and we were unable to recover it. 00:27:47.019 [2024-11-21 03:44:27.378365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.378526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.378551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.019 qpair failed and we were unable to recover it. 00:27:47.019 [2024-11-21 03:44:27.378685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.378846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.378876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.019 qpair failed and we were unable to recover it. 00:27:47.019 [2024-11-21 03:44:27.378995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.379124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.379150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.019 qpair failed and we were unable to recover it. 00:27:47.019 [2024-11-21 03:44:27.379281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.379440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.379466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.019 qpair failed and we were unable to recover it. 00:27:47.019 [2024-11-21 03:44:27.379601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.379730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.379756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.019 qpair failed and we were unable to recover it. 00:27:47.019 [2024-11-21 03:44:27.379886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.380083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.380128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.019 qpair failed and we were unable to recover it. 00:27:47.019 [2024-11-21 03:44:27.380236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.380388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.380414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.019 qpair failed and we were unable to recover it. 00:27:47.019 [2024-11-21 03:44:27.380547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.380677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.380704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.019 qpair failed and we were unable to recover it. 00:27:47.019 [2024-11-21 03:44:27.380834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.380939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.380966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.019 qpair failed and we were unable to recover it. 00:27:47.019 [2024-11-21 03:44:27.381097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.381226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.381252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.019 qpair failed and we were unable to recover it. 00:27:47.019 [2024-11-21 03:44:27.381388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.381511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.381536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.019 qpair failed and we were unable to recover it. 00:27:47.019 [2024-11-21 03:44:27.381668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.381764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.381794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.019 qpair failed and we were unable to recover it. 00:27:47.019 [2024-11-21 03:44:27.381915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.382021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.382050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.019 qpair failed and we were unable to recover it. 00:27:47.019 [2024-11-21 03:44:27.382178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.382333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.382359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.019 qpair failed and we were unable to recover it. 00:27:47.019 [2024-11-21 03:44:27.382461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.382616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.382642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.019 qpair failed and we were unable to recover it. 00:27:47.019 [2024-11-21 03:44:27.382741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.382846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.382872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.019 qpair failed and we were unable to recover it. 00:27:47.019 [2024-11-21 03:44:27.382999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.383167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.383193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.019 qpair failed and we were unable to recover it. 00:27:47.019 [2024-11-21 03:44:27.383315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.383450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.383475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.019 qpair failed and we were unable to recover it. 00:27:47.019 [2024-11-21 03:44:27.383575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.383676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.383702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.019 qpair failed and we were unable to recover it. 00:27:47.019 [2024-11-21 03:44:27.383793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.383922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.383947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.019 qpair failed and we were unable to recover it. 00:27:47.019 [2024-11-21 03:44:27.384082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.384178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.384203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.019 qpair failed and we were unable to recover it. 00:27:47.019 [2024-11-21 03:44:27.384329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.384452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.384482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.019 qpair failed and we were unable to recover it. 00:27:47.019 [2024-11-21 03:44:27.384609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.384766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.384791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.019 qpair failed and we were unable to recover it. 00:27:47.019 [2024-11-21 03:44:27.384912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.385165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.385191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.019 qpair failed and we were unable to recover it. 00:27:47.019 [2024-11-21 03:44:27.385299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.385455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.385481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.019 qpair failed and we were unable to recover it. 00:27:47.019 [2024-11-21 03:44:27.385618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.385777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.385803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.019 qpair failed and we were unable to recover it. 00:27:47.019 [2024-11-21 03:44:27.385930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.386057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.386100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.019 qpair failed and we were unable to recover it. 00:27:47.019 [2024-11-21 03:44:27.386264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.386401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.386426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.019 qpair failed and we were unable to recover it. 00:27:47.019 [2024-11-21 03:44:27.386528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.386655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.386681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.019 qpair failed and we were unable to recover it. 00:27:47.019 [2024-11-21 03:44:27.386809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.386956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.386984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.019 qpair failed and we were unable to recover it. 00:27:47.019 [2024-11-21 03:44:27.387148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.387276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.387301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.019 qpair failed and we were unable to recover it. 00:27:47.019 [2024-11-21 03:44:27.387439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.387598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.387628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.019 qpair failed and we were unable to recover it. 00:27:47.019 [2024-11-21 03:44:27.387724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.387829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.019 [2024-11-21 03:44:27.387855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.019 qpair failed and we were unable to recover it. 00:27:47.020 [2024-11-21 03:44:27.387990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.020 [2024-11-21 03:44:27.388111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.020 [2024-11-21 03:44:27.388138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.020 qpair failed and we were unable to recover it. 00:27:47.020 [2024-11-21 03:44:27.388273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.020 [2024-11-21 03:44:27.388401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.020 [2024-11-21 03:44:27.388427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.020 qpair failed and we were unable to recover it. 00:27:47.020 [2024-11-21 03:44:27.388583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.020 [2024-11-21 03:44:27.388713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.020 [2024-11-21 03:44:27.388738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.020 qpair failed and we were unable to recover it. 00:27:47.020 [2024-11-21 03:44:27.388888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.020 [2024-11-21 03:44:27.388992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.020 [2024-11-21 03:44:27.389019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.020 qpair failed and we were unable to recover it. 00:27:47.020 [2024-11-21 03:44:27.389180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.020 [2024-11-21 03:44:27.389311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.020 [2024-11-21 03:44:27.389336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.020 qpair failed and we were unable to recover it. 00:27:47.020 [2024-11-21 03:44:27.389446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.020 [2024-11-21 03:44:27.389619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.020 [2024-11-21 03:44:27.389645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.020 qpair failed and we were unable to recover it. 00:27:47.020 [2024-11-21 03:44:27.389748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.020 [2024-11-21 03:44:27.389878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.020 [2024-11-21 03:44:27.389904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.020 qpair failed and we were unable to recover it. 00:27:47.020 [2024-11-21 03:44:27.390033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.020 [2024-11-21 03:44:27.390165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.020 [2024-11-21 03:44:27.390191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.020 qpair failed and we were unable to recover it. 00:27:47.020 [2024-11-21 03:44:27.390353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.020 [2024-11-21 03:44:27.390450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.020 [2024-11-21 03:44:27.390475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.020 qpair failed and we were unable to recover it. 00:27:47.020 [2024-11-21 03:44:27.390613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.020 [2024-11-21 03:44:27.390711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.020 [2024-11-21 03:44:27.390736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.020 qpair failed and we were unable to recover it. 00:27:47.020 [2024-11-21 03:44:27.390900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.020 [2024-11-21 03:44:27.391003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.020 [2024-11-21 03:44:27.391029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.020 qpair failed and we were unable to recover it. 00:27:47.020 [2024-11-21 03:44:27.391165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.020 [2024-11-21 03:44:27.391303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.020 [2024-11-21 03:44:27.391329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.020 qpair failed and we were unable to recover it. 00:27:47.020 [2024-11-21 03:44:27.391462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.020 [2024-11-21 03:44:27.391590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.020 [2024-11-21 03:44:27.391616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.020 qpair failed and we were unable to recover it. 00:27:47.020 [2024-11-21 03:44:27.391744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.020 [2024-11-21 03:44:27.391902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.020 [2024-11-21 03:44:27.391929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.020 qpair failed and we were unable to recover it. 00:27:47.020 [2024-11-21 03:44:27.392111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.020 [2024-11-21 03:44:27.392230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.020 [2024-11-21 03:44:27.392256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.020 qpair failed and we were unable to recover it. 00:27:47.020 [2024-11-21 03:44:27.392389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.020 [2024-11-21 03:44:27.392488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.020 [2024-11-21 03:44:27.392513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.020 qpair failed and we were unable to recover it. 00:27:47.020 [2024-11-21 03:44:27.392617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.020 [2024-11-21 03:44:27.392717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.020 [2024-11-21 03:44:27.392742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.020 qpair failed and we were unable to recover it. 00:27:47.020 [2024-11-21 03:44:27.392899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.020 [2024-11-21 03:44:27.392996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.020 [2024-11-21 03:44:27.393022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.020 qpair failed and we were unable to recover it. 00:27:47.020 [2024-11-21 03:44:27.393166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.020 [2024-11-21 03:44:27.393265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.020 [2024-11-21 03:44:27.393290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.020 qpair failed and we were unable to recover it. 00:27:47.020 [2024-11-21 03:44:27.393425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.020 [2024-11-21 03:44:27.393558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.020 [2024-11-21 03:44:27.393583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.020 qpair failed and we were unable to recover it. 00:27:47.020 [2024-11-21 03:44:27.393746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.020 [2024-11-21 03:44:27.393875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.020 [2024-11-21 03:44:27.393900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.020 qpair failed and we were unable to recover it. 00:27:47.020 [2024-11-21 03:44:27.394066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.020 [2024-11-21 03:44:27.394248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.020 [2024-11-21 03:44:27.394273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.020 qpair failed and we were unable to recover it. 00:27:47.020 [2024-11-21 03:44:27.394374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.020 [2024-11-21 03:44:27.394471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.020 [2024-11-21 03:44:27.394496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.020 qpair failed and we were unable to recover it. 00:27:47.020 [2024-11-21 03:44:27.394628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.020 [2024-11-21 03:44:27.394747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.020 [2024-11-21 03:44:27.394773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.020 qpair failed and we were unable to recover it. 00:27:47.020 [2024-11-21 03:44:27.394881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.020 [2024-11-21 03:44:27.395012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.020 [2024-11-21 03:44:27.395039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.020 qpair failed and we were unable to recover it. 00:27:47.020 [2024-11-21 03:44:27.395178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.020 [2024-11-21 03:44:27.395338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.020 [2024-11-21 03:44:27.395363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.020 qpair failed and we were unable to recover it. 00:27:47.020 [2024-11-21 03:44:27.395470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.020 [2024-11-21 03:44:27.395596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.020 [2024-11-21 03:44:27.395622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.020 qpair failed and we were unable to recover it. 00:27:47.020 [2024-11-21 03:44:27.395790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.020 [2024-11-21 03:44:27.395935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.020 [2024-11-21 03:44:27.395963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.020 qpair failed and we were unable to recover it. 00:27:47.020 [2024-11-21 03:44:27.396127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.020 [2024-11-21 03:44:27.396281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.020 [2024-11-21 03:44:27.396306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.020 qpair failed and we were unable to recover it. 00:27:47.020 [2024-11-21 03:44:27.396444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.020 [2024-11-21 03:44:27.396573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.020 [2024-11-21 03:44:27.396600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.020 qpair failed and we were unable to recover it. 00:27:47.020 [2024-11-21 03:44:27.396706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.020 [2024-11-21 03:44:27.396806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.020 [2024-11-21 03:44:27.396831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.020 qpair failed and we were unable to recover it. 00:27:47.020 [2024-11-21 03:44:27.396961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.020 [2024-11-21 03:44:27.397066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.020 [2024-11-21 03:44:27.397100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.020 qpair failed and we were unable to recover it. 00:27:47.020 [2024-11-21 03:44:27.397261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.020 [2024-11-21 03:44:27.397384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.020 [2024-11-21 03:44:27.397410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.020 qpair failed and we were unable to recover it. 00:27:47.020 [2024-11-21 03:44:27.397517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.020 [2024-11-21 03:44:27.397675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.020 [2024-11-21 03:44:27.397701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.020 qpair failed and we were unable to recover it. 00:27:47.020 [2024-11-21 03:44:27.397837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.020 [2024-11-21 03:44:27.397967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.020 [2024-11-21 03:44:27.397992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.020 qpair failed and we were unable to recover it. 00:27:47.020 [2024-11-21 03:44:27.398119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.020 [2024-11-21 03:44:27.398256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.020 [2024-11-21 03:44:27.398283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.020 qpair failed and we were unable to recover it. 00:27:47.020 [2024-11-21 03:44:27.398442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.020 [2024-11-21 03:44:27.398563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.020 [2024-11-21 03:44:27.398588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.020 qpair failed and we were unable to recover it. 00:27:47.020 [2024-11-21 03:44:27.398743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.020 [2024-11-21 03:44:27.398856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.020 [2024-11-21 03:44:27.398884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.020 qpair failed and we were unable to recover it. 00:27:47.020 [2024-11-21 03:44:27.399022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.020 [2024-11-21 03:44:27.399212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.020 [2024-11-21 03:44:27.399238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.020 qpair failed and we were unable to recover it. 00:27:47.020 [2024-11-21 03:44:27.399377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.020 [2024-11-21 03:44:27.399535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.020 [2024-11-21 03:44:27.399560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.020 qpair failed and we were unable to recover it. 00:27:47.020 [2024-11-21 03:44:27.399693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.020 [2024-11-21 03:44:27.399813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.020 [2024-11-21 03:44:27.399839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.020 qpair failed and we were unable to recover it. 00:27:47.020 [2024-11-21 03:44:27.399971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.020 [2024-11-21 03:44:27.400101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.020 [2024-11-21 03:44:27.400127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.020 qpair failed and we were unable to recover it. 00:27:47.020 [2024-11-21 03:44:27.400225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.020 [2024-11-21 03:44:27.400357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.020 [2024-11-21 03:44:27.400382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.020 qpair failed and we were unable to recover it. 00:27:47.020 [2024-11-21 03:44:27.400487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.020 [2024-11-21 03:44:27.400646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.020 [2024-11-21 03:44:27.400672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.020 qpair failed and we were unable to recover it. 00:27:47.020 [2024-11-21 03:44:27.400778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.020 [2024-11-21 03:44:27.400922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.020 [2024-11-21 03:44:27.400951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.020 qpair failed and we were unable to recover it. 00:27:47.021 [2024-11-21 03:44:27.401106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.021 [2024-11-21 03:44:27.401263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.021 [2024-11-21 03:44:27.401289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.021 qpair failed and we were unable to recover it. 00:27:47.021 [2024-11-21 03:44:27.401426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.021 [2024-11-21 03:44:27.401554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.021 [2024-11-21 03:44:27.401580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.021 qpair failed and we were unable to recover it. 00:27:47.021 [2024-11-21 03:44:27.401739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.021 [2024-11-21 03:44:27.401840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.021 [2024-11-21 03:44:27.401867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.021 qpair failed and we were unable to recover it. 00:27:47.021 [2024-11-21 03:44:27.401998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.021 [2024-11-21 03:44:27.402143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.021 [2024-11-21 03:44:27.402170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.021 qpair failed and we were unable to recover it. 00:27:47.021 [2024-11-21 03:44:27.402338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.021 [2024-11-21 03:44:27.402438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.021 [2024-11-21 03:44:27.402463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.021 qpair failed and we were unable to recover it. 00:27:47.021 [2024-11-21 03:44:27.402589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.021 [2024-11-21 03:44:27.402718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.021 [2024-11-21 03:44:27.402744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.021 qpair failed and we were unable to recover it. 00:27:47.021 [2024-11-21 03:44:27.402838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.021 [2024-11-21 03:44:27.402981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.021 [2024-11-21 03:44:27.403009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.021 qpair failed and we were unable to recover it. 00:27:47.021 [2024-11-21 03:44:27.403193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.021 [2024-11-21 03:44:27.403299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.021 [2024-11-21 03:44:27.403325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.021 qpair failed and we were unable to recover it. 00:27:47.021 [2024-11-21 03:44:27.403439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.021 [2024-11-21 03:44:27.403593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.021 [2024-11-21 03:44:27.403619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.021 qpair failed and we were unable to recover it. 00:27:47.021 [2024-11-21 03:44:27.403717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.021 [2024-11-21 03:44:27.403848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.021 [2024-11-21 03:44:27.403873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.021 qpair failed and we were unable to recover it. 00:27:47.021 [2024-11-21 03:44:27.404043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.021 [2024-11-21 03:44:27.404181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.021 [2024-11-21 03:44:27.404207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.021 qpair failed and we were unable to recover it. 00:27:47.021 [2024-11-21 03:44:27.404343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.021 [2024-11-21 03:44:27.404470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.021 [2024-11-21 03:44:27.404495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.021 qpair failed and we were unable to recover it. 00:27:47.021 [2024-11-21 03:44:27.404633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.021 [2024-11-21 03:44:27.404757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.021 [2024-11-21 03:44:27.404783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.021 qpair failed and we were unable to recover it. 00:27:47.021 [2024-11-21 03:44:27.404915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.021 [2024-11-21 03:44:27.405067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.021 [2024-11-21 03:44:27.405097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.021 qpair failed and we were unable to recover it. 00:27:47.021 [2024-11-21 03:44:27.405225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.021 [2024-11-21 03:44:27.405354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.021 [2024-11-21 03:44:27.405379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.021 qpair failed and we were unable to recover it. 00:27:47.021 [2024-11-21 03:44:27.405471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.021 [2024-11-21 03:44:27.405601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.021 [2024-11-21 03:44:27.405626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.021 qpair failed and we were unable to recover it. 00:27:47.021 [2024-11-21 03:44:27.405759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.021 [2024-11-21 03:44:27.405908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.021 [2024-11-21 03:44:27.405934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.021 qpair failed and we were unable to recover it. 00:27:47.021 [2024-11-21 03:44:27.406029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.021 [2024-11-21 03:44:27.406199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.021 [2024-11-21 03:44:27.406226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.021 qpair failed and we were unable to recover it. 00:27:47.021 [2024-11-21 03:44:27.406352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.021 [2024-11-21 03:44:27.406505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.021 [2024-11-21 03:44:27.406530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.021 qpair failed and we were unable to recover it. 00:27:47.021 [2024-11-21 03:44:27.406681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.021 [2024-11-21 03:44:27.406809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.021 [2024-11-21 03:44:27.406834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.021 qpair failed and we were unable to recover it. 00:27:47.021 [2024-11-21 03:44:27.406970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.021 [2024-11-21 03:44:27.407100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.021 [2024-11-21 03:44:27.407126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.021 qpair failed and we were unable to recover it. 00:27:47.021 [2024-11-21 03:44:27.407254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.021 [2024-11-21 03:44:27.407421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.021 [2024-11-21 03:44:27.407447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.021 qpair failed and we were unable to recover it. 00:27:47.021 [2024-11-21 03:44:27.407578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.021 [2024-11-21 03:44:27.407706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.021 [2024-11-21 03:44:27.407731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.021 qpair failed and we were unable to recover it. 00:27:47.021 [2024-11-21 03:44:27.407863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.021 [2024-11-21 03:44:27.408043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.021 [2024-11-21 03:44:27.408076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.021 qpair failed and we were unable to recover it. 00:27:47.021 [2024-11-21 03:44:27.408237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.021 [2024-11-21 03:44:27.408402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.021 [2024-11-21 03:44:27.408427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.021 qpair failed and we were unable to recover it. 00:27:47.021 [2024-11-21 03:44:27.408555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.021 [2024-11-21 03:44:27.408688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.021 [2024-11-21 03:44:27.408714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.021 qpair failed and we were unable to recover it. 00:27:47.021 [2024-11-21 03:44:27.408846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.021 [2024-11-21 03:44:27.408994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.021 [2024-11-21 03:44:27.409022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.021 qpair failed and we were unable to recover it. 00:27:47.021 [2024-11-21 03:44:27.409146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.021 [2024-11-21 03:44:27.409252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.021 [2024-11-21 03:44:27.409278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.021 qpair failed and we were unable to recover it. 00:27:47.021 [2024-11-21 03:44:27.409435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.021 [2024-11-21 03:44:27.409561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.021 [2024-11-21 03:44:27.409586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.021 qpair failed and we were unable to recover it. 00:27:47.021 [2024-11-21 03:44:27.409681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.021 [2024-11-21 03:44:27.409805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.021 [2024-11-21 03:44:27.409830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.021 qpair failed and we were unable to recover it. 00:27:47.021 [2024-11-21 03:44:27.409963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.021 [2024-11-21 03:44:27.410055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.021 [2024-11-21 03:44:27.410085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.021 qpair failed and we were unable to recover it. 00:27:47.021 [2024-11-21 03:44:27.410240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.021 [2024-11-21 03:44:27.410370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.021 [2024-11-21 03:44:27.410397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.021 qpair failed and we were unable to recover it. 00:27:47.021 [2024-11-21 03:44:27.410525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.021 [2024-11-21 03:44:27.410676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.021 [2024-11-21 03:44:27.410701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.021 qpair failed and we were unable to recover it. 00:27:47.021 [2024-11-21 03:44:27.410802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.021 [2024-11-21 03:44:27.410999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.021 [2024-11-21 03:44:27.411027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.021 qpair failed and we were unable to recover it. 00:27:47.021 [2024-11-21 03:44:27.411180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.021 [2024-11-21 03:44:27.411305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.021 [2024-11-21 03:44:27.411331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.021 qpair failed and we were unable to recover it. 00:27:47.021 [2024-11-21 03:44:27.411430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.021 [2024-11-21 03:44:27.411554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.021 [2024-11-21 03:44:27.411580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.021 qpair failed and we were unable to recover it. 00:27:47.021 [2024-11-21 03:44:27.411711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.021 [2024-11-21 03:44:27.411872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.021 [2024-11-21 03:44:27.411897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.021 qpair failed and we were unable to recover it. 00:27:47.021 [2024-11-21 03:44:27.412003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.021 [2024-11-21 03:44:27.412114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.021 [2024-11-21 03:44:27.412141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.021 qpair failed and we were unable to recover it. 00:27:47.021 [2024-11-21 03:44:27.412265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.021 [2024-11-21 03:44:27.412398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.021 [2024-11-21 03:44:27.412423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.021 qpair failed and we were unable to recover it. 00:27:47.021 [2024-11-21 03:44:27.412546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.021 [2024-11-21 03:44:27.412669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.021 [2024-11-21 03:44:27.412695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.021 qpair failed and we were unable to recover it. 00:27:47.021 [2024-11-21 03:44:27.412825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.021 [2024-11-21 03:44:27.412953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.021 [2024-11-21 03:44:27.412978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.021 qpair failed and we were unable to recover it. 00:27:47.021 [2024-11-21 03:44:27.413118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.021 [2024-11-21 03:44:27.413243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.021 [2024-11-21 03:44:27.413268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.021 qpair failed and we were unable to recover it. 00:27:47.021 [2024-11-21 03:44:27.413363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.021 [2024-11-21 03:44:27.413493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.021 [2024-11-21 03:44:27.413519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.021 qpair failed and we were unable to recover it. 00:27:47.021 [2024-11-21 03:44:27.413627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.021 [2024-11-21 03:44:27.413757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.021 [2024-11-21 03:44:27.413782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.021 qpair failed and we were unable to recover it. 00:27:47.021 [2024-11-21 03:44:27.413966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.021 [2024-11-21 03:44:27.414121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.021 [2024-11-21 03:44:27.414148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.021 qpair failed and we were unable to recover it. 00:27:47.022 [2024-11-21 03:44:27.414280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.414425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.414450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.022 qpair failed and we were unable to recover it. 00:27:47.022 [2024-11-21 03:44:27.414557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.414682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.414707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.022 qpair failed and we were unable to recover it. 00:27:47.022 [2024-11-21 03:44:27.414851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.414973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.414998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.022 qpair failed and we were unable to recover it. 00:27:47.022 [2024-11-21 03:44:27.415164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.415269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.415295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.022 qpair failed and we were unable to recover it. 00:27:47.022 [2024-11-21 03:44:27.415433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.415536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.415562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.022 qpair failed and we were unable to recover it. 00:27:47.022 [2024-11-21 03:44:27.415722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.415854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.415880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.022 qpair failed and we were unable to recover it. 00:27:47.022 [2024-11-21 03:44:27.416010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.416137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.416164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.022 qpair failed and we were unable to recover it. 00:27:47.022 [2024-11-21 03:44:27.416332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.416430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.416455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.022 qpair failed and we were unable to recover it. 00:27:47.022 [2024-11-21 03:44:27.416582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.416710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.416736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.022 qpair failed and we were unable to recover it. 00:27:47.022 [2024-11-21 03:44:27.416861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.416969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.416995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.022 qpair failed and we were unable to recover it. 00:27:47.022 [2024-11-21 03:44:27.417114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.417272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.417298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.022 qpair failed and we were unable to recover it. 00:27:47.022 [2024-11-21 03:44:27.417456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.417583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.417608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.022 qpair failed and we were unable to recover it. 00:27:47.022 [2024-11-21 03:44:27.417744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.417841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.417867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.022 qpair failed and we were unable to recover it. 00:27:47.022 [2024-11-21 03:44:27.417992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.418095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.418121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.022 qpair failed and we were unable to recover it. 00:27:47.022 [2024-11-21 03:44:27.418276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.418379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.418405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.022 qpair failed and we were unable to recover it. 00:27:47.022 [2024-11-21 03:44:27.418537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.418689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.418715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.022 qpair failed and we were unable to recover it. 00:27:47.022 [2024-11-21 03:44:27.418871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.419011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.419041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.022 qpair failed and we were unable to recover it. 00:27:47.022 [2024-11-21 03:44:27.419197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.419331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.419356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.022 qpair failed and we were unable to recover it. 00:27:47.022 [2024-11-21 03:44:27.419488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.419595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.419620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.022 qpair failed and we were unable to recover it. 00:27:47.022 [2024-11-21 03:44:27.419729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.419881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.419910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.022 qpair failed and we were unable to recover it. 00:27:47.022 [2024-11-21 03:44:27.420053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.420213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.420239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.022 qpair failed and we were unable to recover it. 00:27:47.022 [2024-11-21 03:44:27.420340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.420435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.420461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.022 qpair failed and we were unable to recover it. 00:27:47.022 [2024-11-21 03:44:27.420586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.420685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.420710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.022 qpair failed and we were unable to recover it. 00:27:47.022 [2024-11-21 03:44:27.420870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.421003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.421029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.022 qpair failed and we were unable to recover it. 00:27:47.022 [2024-11-21 03:44:27.421169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.421296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.421321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.022 qpair failed and we were unable to recover it. 00:27:47.022 [2024-11-21 03:44:27.421451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.421540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.421566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.022 qpair failed and we were unable to recover it. 00:27:47.022 [2024-11-21 03:44:27.421687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.421819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.421844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.022 qpair failed and we were unable to recover it. 00:27:47.022 [2024-11-21 03:44:27.422019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.422165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.422191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.022 qpair failed and we were unable to recover it. 00:27:47.022 [2024-11-21 03:44:27.422328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.422426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.422451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.022 qpair failed and we were unable to recover it. 00:27:47.022 [2024-11-21 03:44:27.422582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.422678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.422708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.022 qpair failed and we were unable to recover it. 00:27:47.022 [2024-11-21 03:44:27.422862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.422964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.422989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.022 qpair failed and we were unable to recover it. 00:27:47.022 [2024-11-21 03:44:27.423094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.423222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.423248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.022 qpair failed and we were unable to recover it. 00:27:47.022 [2024-11-21 03:44:27.423372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.423502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.423526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.022 qpair failed and we were unable to recover it. 00:27:47.022 [2024-11-21 03:44:27.423663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.423790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.423815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.022 qpair failed and we were unable to recover it. 00:27:47.022 [2024-11-21 03:44:27.423944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.424079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.424105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.022 qpair failed and we were unable to recover it. 00:27:47.022 [2024-11-21 03:44:27.424216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.424345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.424370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.022 qpair failed and we were unable to recover it. 00:27:47.022 [2024-11-21 03:44:27.424469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.424599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.424624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.022 qpair failed and we were unable to recover it. 00:27:47.022 [2024-11-21 03:44:27.424750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.424863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.424891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.022 qpair failed and we were unable to recover it. 00:27:47.022 [2024-11-21 03:44:27.425039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.425190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.425216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.022 qpair failed and we were unable to recover it. 00:27:47.022 [2024-11-21 03:44:27.425350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.425478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.425508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.022 qpair failed and we were unable to recover it. 00:27:47.022 [2024-11-21 03:44:27.425640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.425770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.425796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.022 qpair failed and we were unable to recover it. 00:27:47.022 [2024-11-21 03:44:27.425888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.426007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.426035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.022 qpair failed and we were unable to recover it. 00:27:47.022 [2024-11-21 03:44:27.426213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.426358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.426388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.022 qpair failed and we were unable to recover it. 00:27:47.022 [2024-11-21 03:44:27.426529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.426658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.426685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.022 qpair failed and we were unable to recover it. 00:27:47.022 [2024-11-21 03:44:27.426822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.426992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.427020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.022 qpair failed and we were unable to recover it. 00:27:47.022 [2024-11-21 03:44:27.427179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.427278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.427304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.022 qpair failed and we were unable to recover it. 00:27:47.022 [2024-11-21 03:44:27.427430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.427523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.427549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.022 qpair failed and we were unable to recover it. 00:27:47.022 [2024-11-21 03:44:27.427684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.427811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.427836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.022 qpair failed and we were unable to recover it. 00:27:47.022 [2024-11-21 03:44:27.427963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.428067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.428101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.022 qpair failed and we were unable to recover it. 00:27:47.022 [2024-11-21 03:44:27.428230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.428360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.022 [2024-11-21 03:44:27.428391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.022 qpair failed and we were unable to recover it. 00:27:47.023 [2024-11-21 03:44:27.428503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.023 [2024-11-21 03:44:27.428604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.023 [2024-11-21 03:44:27.428630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.023 qpair failed and we were unable to recover it. 00:27:47.023 [2024-11-21 03:44:27.428734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.023 [2024-11-21 03:44:27.428854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.023 [2024-11-21 03:44:27.428882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.023 qpair failed and we were unable to recover it. 00:27:47.023 [2024-11-21 03:44:27.429053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.023 [2024-11-21 03:44:27.429155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.023 [2024-11-21 03:44:27.429181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.023 qpair failed and we were unable to recover it. 00:27:47.023 [2024-11-21 03:44:27.429286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.023 [2024-11-21 03:44:27.429418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.023 [2024-11-21 03:44:27.429443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.023 qpair failed and we were unable to recover it. 00:27:47.023 [2024-11-21 03:44:27.429574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.023 [2024-11-21 03:44:27.429702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.023 [2024-11-21 03:44:27.429727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.023 qpair failed and we were unable to recover it. 00:27:47.023 [2024-11-21 03:44:27.429861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.023 [2024-11-21 03:44:27.429986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.023 [2024-11-21 03:44:27.430012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.023 qpair failed and we were unable to recover it. 00:27:47.023 [2024-11-21 03:44:27.430116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.023 [2024-11-21 03:44:27.430224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.023 [2024-11-21 03:44:27.430250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.023 qpair failed and we were unable to recover it. 00:27:47.023 [2024-11-21 03:44:27.430383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.023 [2024-11-21 03:44:27.430476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.023 [2024-11-21 03:44:27.430502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.023 qpair failed and we were unable to recover it. 00:27:47.023 [2024-11-21 03:44:27.430655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.023 [2024-11-21 03:44:27.430784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.023 [2024-11-21 03:44:27.430810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.023 qpair failed and we were unable to recover it. 00:27:47.023 [2024-11-21 03:44:27.430966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.023 [2024-11-21 03:44:27.431112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.023 [2024-11-21 03:44:27.431142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.023 qpair failed and we were unable to recover it. 00:27:47.023 [2024-11-21 03:44:27.431267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.023 [2024-11-21 03:44:27.431426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.023 [2024-11-21 03:44:27.431452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.023 qpair failed and we were unable to recover it. 00:27:47.023 [2024-11-21 03:44:27.431576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.023 [2024-11-21 03:44:27.431706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.023 [2024-11-21 03:44:27.431731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.023 qpair failed and we were unable to recover it. 00:27:47.023 [2024-11-21 03:44:27.431860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.023 [2024-11-21 03:44:27.431988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.023 [2024-11-21 03:44:27.432014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.023 qpair failed and we were unable to recover it. 00:27:47.023 [2024-11-21 03:44:27.432145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.023 [2024-11-21 03:44:27.432276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.023 [2024-11-21 03:44:27.432301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.023 qpair failed and we were unable to recover it. 00:27:47.023 [2024-11-21 03:44:27.432434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.023 [2024-11-21 03:44:27.432591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.023 [2024-11-21 03:44:27.432617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.023 qpair failed and we were unable to recover it. 00:27:47.023 [2024-11-21 03:44:27.432749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.023 [2024-11-21 03:44:27.432896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.023 [2024-11-21 03:44:27.432925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.023 qpair failed and we were unable to recover it. 00:27:47.023 [2024-11-21 03:44:27.433075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.023 [2024-11-21 03:44:27.433218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.023 [2024-11-21 03:44:27.433244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.023 qpair failed and we were unable to recover it. 00:27:47.023 [2024-11-21 03:44:27.433347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.023 [2024-11-21 03:44:27.433505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.023 [2024-11-21 03:44:27.433530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.023 qpair failed and we were unable to recover it. 00:27:47.023 [2024-11-21 03:44:27.433631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.023 [2024-11-21 03:44:27.433733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.023 [2024-11-21 03:44:27.433758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.023 qpair failed and we were unable to recover it. 00:27:47.023 [2024-11-21 03:44:27.433879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.023 [2024-11-21 03:44:27.433981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.023 [2024-11-21 03:44:27.434008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.023 qpair failed and we were unable to recover it. 00:27:47.023 [2024-11-21 03:44:27.434146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.023 [2024-11-21 03:44:27.434273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.023 [2024-11-21 03:44:27.434299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.023 qpair failed and we were unable to recover it. 00:27:47.023 [2024-11-21 03:44:27.434405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.023 [2024-11-21 03:44:27.434563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.023 [2024-11-21 03:44:27.434589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.023 qpair failed and we were unable to recover it. 00:27:47.023 [2024-11-21 03:44:27.434722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.023 [2024-11-21 03:44:27.434848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.023 [2024-11-21 03:44:27.434875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.023 qpair failed and we were unable to recover it. 00:27:47.023 [2024-11-21 03:44:27.434995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.023 [2024-11-21 03:44:27.435140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.023 [2024-11-21 03:44:27.435167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.023 qpair failed and we were unable to recover it. 00:27:47.023 [2024-11-21 03:44:27.435324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.023 [2024-11-21 03:44:27.435427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.023 [2024-11-21 03:44:27.435452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.023 qpair failed and we were unable to recover it. 00:27:47.023 [2024-11-21 03:44:27.435598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.023 [2024-11-21 03:44:27.435728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.023 [2024-11-21 03:44:27.435753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.023 qpair failed and we were unable to recover it. 00:27:47.023 [2024-11-21 03:44:27.435849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.023 [2024-11-21 03:44:27.436002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.023 [2024-11-21 03:44:27.436028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.023 qpair failed and we were unable to recover it. 00:27:47.023 [2024-11-21 03:44:27.436163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.023 [2024-11-21 03:44:27.436291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.023 [2024-11-21 03:44:27.436317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.023 qpair failed and we were unable to recover it. 00:27:47.023 [2024-11-21 03:44:27.436475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.023 [2024-11-21 03:44:27.436578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.023 [2024-11-21 03:44:27.436603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.023 qpair failed and we were unable to recover it. 00:27:47.023 [2024-11-21 03:44:27.436698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.023 [2024-11-21 03:44:27.436796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.023 [2024-11-21 03:44:27.436822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.023 qpair failed and we were unable to recover it. 00:27:47.023 [2024-11-21 03:44:27.436987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.023 [2024-11-21 03:44:27.437120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.023 [2024-11-21 03:44:27.437146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.023 qpair failed and we were unable to recover it. 00:27:47.023 [2024-11-21 03:44:27.437270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.023 [2024-11-21 03:44:27.437427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.023 [2024-11-21 03:44:27.437452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.023 qpair failed and we were unable to recover it. 00:27:47.023 [2024-11-21 03:44:27.437586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.023 [2024-11-21 03:44:27.437716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.023 [2024-11-21 03:44:27.437742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.023 qpair failed and we were unable to recover it. 00:27:47.023 [2024-11-21 03:44:27.437875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.023 [2024-11-21 03:44:27.438000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.023 [2024-11-21 03:44:27.438025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.023 qpair failed and we were unable to recover it. 00:27:47.023 [2024-11-21 03:44:27.438171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.023 [2024-11-21 03:44:27.438296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.023 [2024-11-21 03:44:27.438321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.023 qpair failed and we were unable to recover it. 00:27:47.023 [2024-11-21 03:44:27.438422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.023 [2024-11-21 03:44:27.438575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.023 [2024-11-21 03:44:27.438600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.023 qpair failed and we were unable to recover it. 00:27:47.023 [2024-11-21 03:44:27.438732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.023 [2024-11-21 03:44:27.438831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.023 [2024-11-21 03:44:27.438857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.023 qpair failed and we were unable to recover it. 00:27:47.023 [2024-11-21 03:44:27.438964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.023 [2024-11-21 03:44:27.439094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.023 [2024-11-21 03:44:27.439121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.023 qpair failed and we were unable to recover it. 00:27:47.023 [2024-11-21 03:44:27.439252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.023 [2024-11-21 03:44:27.439350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.023 [2024-11-21 03:44:27.439376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.023 qpair failed and we were unable to recover it. 00:27:47.023 [2024-11-21 03:44:27.439483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.023 [2024-11-21 03:44:27.439615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.023 [2024-11-21 03:44:27.439639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.023 qpair failed and we were unable to recover it. 00:27:47.023 [2024-11-21 03:44:27.439778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.023 [2024-11-21 03:44:27.439880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.023 [2024-11-21 03:44:27.439906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.023 qpair failed and we were unable to recover it. 00:27:47.023 [2024-11-21 03:44:27.440014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.023 [2024-11-21 03:44:27.440123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.023 [2024-11-21 03:44:27.440150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.024 qpair failed and we were unable to recover it. 00:27:47.024 [2024-11-21 03:44:27.440262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.440395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.440420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.024 qpair failed and we were unable to recover it. 00:27:47.024 [2024-11-21 03:44:27.440552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.440651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.440677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.024 qpair failed and we were unable to recover it. 00:27:47.024 [2024-11-21 03:44:27.440774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.440908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.440933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.024 qpair failed and we were unable to recover it. 00:27:47.024 [2024-11-21 03:44:27.441035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.441143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.441169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.024 qpair failed and we were unable to recover it. 00:27:47.024 [2024-11-21 03:44:27.441273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.441372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.441397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.024 qpair failed and we were unable to recover it. 00:27:47.024 [2024-11-21 03:44:27.441524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.441652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.441677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.024 qpair failed and we were unable to recover it. 00:27:47.024 [2024-11-21 03:44:27.441776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.441903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.441932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.024 qpair failed and we were unable to recover it. 00:27:47.024 [2024-11-21 03:44:27.442080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.442198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.442224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.024 qpair failed and we were unable to recover it. 00:27:47.024 [2024-11-21 03:44:27.442341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.442465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.442490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.024 qpair failed and we were unable to recover it. 00:27:47.024 [2024-11-21 03:44:27.442587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.442691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.442717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.024 qpair failed and we were unable to recover it. 00:27:47.024 [2024-11-21 03:44:27.442841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.442964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.442990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.024 qpair failed and we were unable to recover it. 00:27:47.024 [2024-11-21 03:44:27.443096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.443198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.443224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.024 qpair failed and we were unable to recover it. 00:27:47.024 [2024-11-21 03:44:27.443353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.443481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.443506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.024 qpair failed and we were unable to recover it. 00:27:47.024 [2024-11-21 03:44:27.443606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.443711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.443737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.024 qpair failed and we were unable to recover it. 00:27:47.024 [2024-11-21 03:44:27.443865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.443996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.444021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.024 qpair failed and we were unable to recover it. 00:27:47.024 [2024-11-21 03:44:27.444163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.444294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.444319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.024 qpair failed and we were unable to recover it. 00:27:47.024 [2024-11-21 03:44:27.444426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.444585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.444611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.024 qpair failed and we were unable to recover it. 00:27:47.024 [2024-11-21 03:44:27.444780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.444877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.444903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.024 qpair failed and we were unable to recover it. 00:27:47.024 [2024-11-21 03:44:27.445050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.445208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.445233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.024 qpair failed and we were unable to recover it. 00:27:47.024 [2024-11-21 03:44:27.445333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.445489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.445514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.024 qpair failed and we were unable to recover it. 00:27:47.024 [2024-11-21 03:44:27.445642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.445799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.445824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.024 qpair failed and we were unable to recover it. 00:27:47.024 [2024-11-21 03:44:27.446008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.446182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.446207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.024 qpair failed and we were unable to recover it. 00:27:47.024 [2024-11-21 03:44:27.446342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.446491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.446516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.024 qpair failed and we were unable to recover it. 00:27:47.024 [2024-11-21 03:44:27.446616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.446738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.446763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.024 qpair failed and we were unable to recover it. 00:27:47.024 [2024-11-21 03:44:27.446852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.446988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.447013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.024 qpair failed and we were unable to recover it. 00:27:47.024 [2024-11-21 03:44:27.447148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.447278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.447304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.024 qpair failed and we were unable to recover it. 00:27:47.024 [2024-11-21 03:44:27.447442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.447602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.447627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.024 qpair failed and we were unable to recover it. 00:27:47.024 [2024-11-21 03:44:27.447772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.447956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.447984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.024 qpair failed and we were unable to recover it. 00:27:47.024 [2024-11-21 03:44:27.448163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.448319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.448344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.024 qpair failed and we were unable to recover it. 00:27:47.024 [2024-11-21 03:44:27.448476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.448608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.448633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.024 qpair failed and we were unable to recover it. 00:27:47.024 [2024-11-21 03:44:27.448761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.448867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.448892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.024 qpair failed and we were unable to recover it. 00:27:47.024 [2024-11-21 03:44:27.449048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.449197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.449224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.024 qpair failed and we were unable to recover it. 00:27:47.024 [2024-11-21 03:44:27.449379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.449507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.449534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.024 qpair failed and we were unable to recover it. 00:27:47.024 [2024-11-21 03:44:27.449638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.449737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.449763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.024 qpair failed and we were unable to recover it. 00:27:47.024 [2024-11-21 03:44:27.449890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.450043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.450074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.024 qpair failed and we were unable to recover it. 00:27:47.024 [2024-11-21 03:44:27.450201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.450312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.450337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.024 qpair failed and we were unable to recover it. 00:27:47.024 [2024-11-21 03:44:27.450463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.450601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.450626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.024 qpair failed and we were unable to recover it. 00:27:47.024 [2024-11-21 03:44:27.450751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.450875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.450904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.024 qpair failed and we were unable to recover it. 00:27:47.024 [2024-11-21 03:44:27.451046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.451169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.451195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.024 qpair failed and we were unable to recover it. 00:27:47.024 [2024-11-21 03:44:27.451357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.451455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.451480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.024 qpair failed and we were unable to recover it. 00:27:47.024 [2024-11-21 03:44:27.451584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.451711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.451738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.024 qpair failed and we were unable to recover it. 00:27:47.024 [2024-11-21 03:44:27.451870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.451992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.452017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.024 qpair failed and we were unable to recover it. 00:27:47.024 [2024-11-21 03:44:27.452174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.452276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.452301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.024 qpair failed and we were unable to recover it. 00:27:47.024 [2024-11-21 03:44:27.452402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.452528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.452554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.024 qpair failed and we were unable to recover it. 00:27:47.024 [2024-11-21 03:44:27.452677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.452836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.452861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.024 qpair failed and we were unable to recover it. 00:27:47.024 [2024-11-21 03:44:27.453017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.453121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.453148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.024 qpair failed and we were unable to recover it. 00:27:47.024 [2024-11-21 03:44:27.453283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.453408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.453434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.024 qpair failed and we were unable to recover it. 00:27:47.024 [2024-11-21 03:44:27.453540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.024 [2024-11-21 03:44:27.453704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.453729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.025 qpair failed and we were unable to recover it. 00:27:47.025 [2024-11-21 03:44:27.453893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.454037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.454065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.025 qpair failed and we were unable to recover it. 00:27:47.025 [2024-11-21 03:44:27.454245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.454401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.454426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.025 qpair failed and we were unable to recover it. 00:27:47.025 [2024-11-21 03:44:27.454524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.454635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.454661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.025 qpair failed and we were unable to recover it. 00:27:47.025 [2024-11-21 03:44:27.454792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.454968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.454996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.025 qpair failed and we were unable to recover it. 00:27:47.025 [2024-11-21 03:44:27.455112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.455245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.455270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.025 qpair failed and we were unable to recover it. 00:27:47.025 [2024-11-21 03:44:27.455376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.455504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.455530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.025 qpair failed and we were unable to recover it. 00:27:47.025 [2024-11-21 03:44:27.455657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.455787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.455813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.025 qpair failed and we were unable to recover it. 00:27:47.025 [2024-11-21 03:44:27.455950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.456050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.456083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.025 qpair failed and we were unable to recover it. 00:27:47.025 [2024-11-21 03:44:27.456208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.456341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.456366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.025 qpair failed and we were unable to recover it. 00:27:47.025 [2024-11-21 03:44:27.456461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.456589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.456614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.025 qpair failed and we were unable to recover it. 00:27:47.025 [2024-11-21 03:44:27.456747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.456874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.456900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.025 qpair failed and we were unable to recover it. 00:27:47.025 [2024-11-21 03:44:27.457009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.457167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.457194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.025 qpair failed and we were unable to recover it. 00:27:47.025 [2024-11-21 03:44:27.457301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.457434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.457460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.025 qpair failed and we were unable to recover it. 00:27:47.025 [2024-11-21 03:44:27.457561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.457689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.457715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.025 qpair failed and we were unable to recover it. 00:27:47.025 [2024-11-21 03:44:27.457814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.457930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.457960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.025 qpair failed and we were unable to recover it. 00:27:47.025 [2024-11-21 03:44:27.458111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.458218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.458243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.025 qpair failed and we were unable to recover it. 00:27:47.025 [2024-11-21 03:44:27.458398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.458531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.458556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.025 qpair failed and we were unable to recover it. 00:27:47.025 [2024-11-21 03:44:27.458652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.458753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.458778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.025 qpair failed and we were unable to recover it. 00:27:47.025 [2024-11-21 03:44:27.458915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.459012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.459038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.025 qpair failed and we were unable to recover it. 00:27:47.025 [2024-11-21 03:44:27.459141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.459309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.459334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.025 qpair failed and we were unable to recover it. 00:27:47.025 [2024-11-21 03:44:27.459435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.459564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.459590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.025 qpair failed and we were unable to recover it. 00:27:47.025 [2024-11-21 03:44:27.459715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.459841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.459866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.025 qpair failed and we were unable to recover it. 00:27:47.025 [2024-11-21 03:44:27.459990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.460140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.460167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.025 qpair failed and we were unable to recover it. 00:27:47.025 [2024-11-21 03:44:27.460308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.460438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.460463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.025 qpair failed and we were unable to recover it. 00:27:47.025 [2024-11-21 03:44:27.460620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.460775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.460801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.025 qpair failed and we were unable to recover it. 00:27:47.025 [2024-11-21 03:44:27.460911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.461063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.461101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.025 qpair failed and we were unable to recover it. 00:27:47.025 [2024-11-21 03:44:27.461211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.461345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.461370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.025 qpair failed and we were unable to recover it. 00:27:47.025 [2024-11-21 03:44:27.461494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.461588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.461615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.025 qpair failed and we were unable to recover it. 00:27:47.025 [2024-11-21 03:44:27.461772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.461930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.461958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.025 qpair failed and we were unable to recover it. 00:27:47.025 [2024-11-21 03:44:27.462076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.462253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.462279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.025 qpair failed and we were unable to recover it. 00:27:47.025 [2024-11-21 03:44:27.462377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.462516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.462542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.025 qpair failed and we were unable to recover it. 00:27:47.025 [2024-11-21 03:44:27.462716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.462839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.462864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.025 qpair failed and we were unable to recover it. 00:27:47.025 [2024-11-21 03:44:27.463002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.463099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.463126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.025 qpair failed and we were unable to recover it. 00:27:47.025 [2024-11-21 03:44:27.463253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.463407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.463432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.025 qpair failed and we were unable to recover it. 00:27:47.025 [2024-11-21 03:44:27.463588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.463720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.463745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.025 qpair failed and we were unable to recover it. 00:27:47.025 [2024-11-21 03:44:27.463926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.464046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.464091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.025 qpair failed and we were unable to recover it. 00:27:47.025 [2024-11-21 03:44:27.464216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.464314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.464341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.025 qpair failed and we were unable to recover it. 00:27:47.025 [2024-11-21 03:44:27.464475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.464627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.464652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.025 qpair failed and we were unable to recover it. 00:27:47.025 [2024-11-21 03:44:27.464779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.464956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.464985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.025 qpair failed and we were unable to recover it. 00:27:47.025 [2024-11-21 03:44:27.465160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.465291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.465318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.025 qpair failed and we were unable to recover it. 00:27:47.025 [2024-11-21 03:44:27.465480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.465611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.465638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.025 qpair failed and we were unable to recover it. 00:27:47.025 [2024-11-21 03:44:27.465729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.465858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.465883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.025 qpair failed and we were unable to recover it. 00:27:47.025 [2024-11-21 03:44:27.466039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.466171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.466197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.025 qpair failed and we were unable to recover it. 00:27:47.025 [2024-11-21 03:44:27.466340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.466440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.466466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.025 qpair failed and we were unable to recover it. 00:27:47.025 [2024-11-21 03:44:27.466602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.466742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.466767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.025 qpair failed and we were unable to recover it. 00:27:47.025 [2024-11-21 03:44:27.466884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.467034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.467059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.025 qpair failed and we were unable to recover it. 00:27:47.025 [2024-11-21 03:44:27.467170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.467304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.467330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.025 qpair failed and we were unable to recover it. 00:27:47.025 [2024-11-21 03:44:27.467431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.467559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.467584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.025 qpair failed and we were unable to recover it. 00:27:47.025 [2024-11-21 03:44:27.467724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.025 [2024-11-21 03:44:27.467824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.026 [2024-11-21 03:44:27.467849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.026 qpair failed and we were unable to recover it. 00:27:47.026 [2024-11-21 03:44:27.467944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.026 [2024-11-21 03:44:27.468101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.026 [2024-11-21 03:44:27.468127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.026 qpair failed and we were unable to recover it. 00:27:47.026 [2024-11-21 03:44:27.468258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.026 [2024-11-21 03:44:27.468391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.026 [2024-11-21 03:44:27.468422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.026 qpair failed and we were unable to recover it. 00:27:47.026 [2024-11-21 03:44:27.468586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.026 [2024-11-21 03:44:27.468750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.026 [2024-11-21 03:44:27.468775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.026 qpair failed and we were unable to recover it. 00:27:47.026 [2024-11-21 03:44:27.468916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.026 [2024-11-21 03:44:27.469063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.026 [2024-11-21 03:44:27.469097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.026 qpair failed and we were unable to recover it. 00:27:47.026 [2024-11-21 03:44:27.469257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.026 [2024-11-21 03:44:27.469385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.026 [2024-11-21 03:44:27.469410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.026 qpair failed and we were unable to recover it. 00:27:47.026 [2024-11-21 03:44:27.469567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.026 [2024-11-21 03:44:27.469697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.026 [2024-11-21 03:44:27.469722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.026 qpair failed and we were unable to recover it. 00:27:47.026 [2024-11-21 03:44:27.469856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.026 [2024-11-21 03:44:27.469983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.026 [2024-11-21 03:44:27.470010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.026 qpair failed and we were unable to recover it. 00:27:47.026 [2024-11-21 03:44:27.470173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.026 [2024-11-21 03:44:27.470281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.026 [2024-11-21 03:44:27.470306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.026 qpair failed and we were unable to recover it. 00:27:47.026 [2024-11-21 03:44:27.470434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.026 [2024-11-21 03:44:27.470555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.026 [2024-11-21 03:44:27.470580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.026 qpair failed and we were unable to recover it. 00:27:47.026 [2024-11-21 03:44:27.470683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.026 [2024-11-21 03:44:27.470805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.026 [2024-11-21 03:44:27.470831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.026 qpair failed and we were unable to recover it. 00:27:47.026 [2024-11-21 03:44:27.470932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.026 [2024-11-21 03:44:27.471026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.026 [2024-11-21 03:44:27.471051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.026 qpair failed and we were unable to recover it. 00:27:47.026 [2024-11-21 03:44:27.471183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.026 [2024-11-21 03:44:27.471314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.026 [2024-11-21 03:44:27.471344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.026 qpair failed and we were unable to recover it. 00:27:47.026 [2024-11-21 03:44:27.471445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.026 [2024-11-21 03:44:27.471577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.026 [2024-11-21 03:44:27.471603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.026 qpair failed and we were unable to recover it. 00:27:47.026 [2024-11-21 03:44:27.471710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.026 [2024-11-21 03:44:27.471813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.026 [2024-11-21 03:44:27.471840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.026 qpair failed and we were unable to recover it. 00:27:47.026 [2024-11-21 03:44:27.471988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.026 [2024-11-21 03:44:27.472118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.026 [2024-11-21 03:44:27.472145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.026 qpair failed and we were unable to recover it. 00:27:47.026 [2024-11-21 03:44:27.472241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.026 [2024-11-21 03:44:27.472365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.026 [2024-11-21 03:44:27.472390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.026 qpair failed and we were unable to recover it. 00:27:47.026 [2024-11-21 03:44:27.472518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.026 [2024-11-21 03:44:27.472643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.026 [2024-11-21 03:44:27.472669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.026 qpair failed and we were unable to recover it. 00:27:47.026 [2024-11-21 03:44:27.472831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.026 [2024-11-21 03:44:27.472962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.026 [2024-11-21 03:44:27.472987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.026 qpair failed and we were unable to recover it. 00:27:47.026 [2024-11-21 03:44:27.473112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.026 [2024-11-21 03:44:27.473216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.026 [2024-11-21 03:44:27.473241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.026 qpair failed and we were unable to recover it. 00:27:47.026 [2024-11-21 03:44:27.473367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.026 [2024-11-21 03:44:27.473473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.026 [2024-11-21 03:44:27.473499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.026 qpair failed and we were unable to recover it. 00:27:47.026 [2024-11-21 03:44:27.473599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.026 [2024-11-21 03:44:27.473700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.026 [2024-11-21 03:44:27.473726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.026 qpair failed and we were unable to recover it. 00:27:47.026 [2024-11-21 03:44:27.473827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.026 [2024-11-21 03:44:27.473984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.026 [2024-11-21 03:44:27.474017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.026 qpair failed and we were unable to recover it. 00:27:47.026 [2024-11-21 03:44:27.474214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.026 [2024-11-21 03:44:27.474315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.026 [2024-11-21 03:44:27.474340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.026 qpair failed and we were unable to recover it. 00:27:47.026 [2024-11-21 03:44:27.474442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.026 [2024-11-21 03:44:27.474551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.026 [2024-11-21 03:44:27.474578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.026 qpair failed and we were unable to recover it. 00:27:47.026 [2024-11-21 03:44:27.474708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.026 [2024-11-21 03:44:27.474836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.026 [2024-11-21 03:44:27.474861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.026 qpair failed and we were unable to recover it. 00:27:47.026 [2024-11-21 03:44:27.475010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.026 [2024-11-21 03:44:27.475153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.026 [2024-11-21 03:44:27.475179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.026 qpair failed and we were unable to recover it. 00:27:47.026 [2024-11-21 03:44:27.475314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.026 [2024-11-21 03:44:27.475473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.026 [2024-11-21 03:44:27.475498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.026 qpair failed and we were unable to recover it. 00:27:47.026 [2024-11-21 03:44:27.475633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.026 [2024-11-21 03:44:27.475759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.026 [2024-11-21 03:44:27.475786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.026 qpair failed and we were unable to recover it. 00:27:47.026 [2024-11-21 03:44:27.475885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.026 [2024-11-21 03:44:27.476012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.026 [2024-11-21 03:44:27.476038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.026 qpair failed and we were unable to recover it. 00:27:47.026 [2024-11-21 03:44:27.476177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.026 [2024-11-21 03:44:27.476279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.026 [2024-11-21 03:44:27.476305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.026 qpair failed and we were unable to recover it. 00:27:47.026 [2024-11-21 03:44:27.476467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.026 [2024-11-21 03:44:27.476597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.026 [2024-11-21 03:44:27.476623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.026 qpair failed and we were unable to recover it. 00:27:47.026 [2024-11-21 03:44:27.476722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.026 [2024-11-21 03:44:27.476823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.026 [2024-11-21 03:44:27.476853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.026 qpair failed and we were unable to recover it. 00:27:47.026 [2024-11-21 03:44:27.476958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.026 [2024-11-21 03:44:27.477058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.026 [2024-11-21 03:44:27.477091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.026 qpair failed and we were unable to recover it. 00:27:47.026 [2024-11-21 03:44:27.477205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.026 [2024-11-21 03:44:27.477303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.026 [2024-11-21 03:44:27.477328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.026 qpair failed and we were unable to recover it. 00:27:47.026 [2024-11-21 03:44:27.477432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.026 [2024-11-21 03:44:27.477564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.026 [2024-11-21 03:44:27.477589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.026 qpair failed and we were unable to recover it. 00:27:47.026 [2024-11-21 03:44:27.477691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.026 [2024-11-21 03:44:27.477818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.026 [2024-11-21 03:44:27.477845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.026 qpair failed and we were unable to recover it. 00:27:47.026 [2024-11-21 03:44:27.477975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.026 [2024-11-21 03:44:27.478100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.026 [2024-11-21 03:44:27.478125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.026 qpair failed and we were unable to recover it. 00:27:47.026 [2024-11-21 03:44:27.478252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.026 [2024-11-21 03:44:27.478356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.026 [2024-11-21 03:44:27.478381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.026 qpair failed and we were unable to recover it. 00:27:47.026 [2024-11-21 03:44:27.478506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.026 [2024-11-21 03:44:27.478635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.026 [2024-11-21 03:44:27.478660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.026 qpair failed and we were unable to recover it. 00:27:47.026 [2024-11-21 03:44:27.478790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.026 [2024-11-21 03:44:27.478920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.026 [2024-11-21 03:44:27.478946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.026 qpair failed and we were unable to recover it. 00:27:47.026 [2024-11-21 03:44:27.479045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.026 [2024-11-21 03:44:27.479182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.026 [2024-11-21 03:44:27.479207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.026 qpair failed and we were unable to recover it. 00:27:47.026 [2024-11-21 03:44:27.479367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.026 [2024-11-21 03:44:27.479463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.026 [2024-11-21 03:44:27.479488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.026 qpair failed and we were unable to recover it. 00:27:47.026 [2024-11-21 03:44:27.479600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.026 [2024-11-21 03:44:27.479751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.026 [2024-11-21 03:44:27.479776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.026 qpair failed and we were unable to recover it. 00:27:47.026 [2024-11-21 03:44:27.479953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.026 [2024-11-21 03:44:27.480073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.026 [2024-11-21 03:44:27.480099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.026 qpair failed and we were unable to recover it. 00:27:47.026 [2024-11-21 03:44:27.480208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.026 [2024-11-21 03:44:27.480311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.026 [2024-11-21 03:44:27.480335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.026 qpair failed and we were unable to recover it. 00:27:47.026 [2024-11-21 03:44:27.480434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.026 [2024-11-21 03:44:27.480567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.026 [2024-11-21 03:44:27.480592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.026 qpair failed and we were unable to recover it. 00:27:47.027 [2024-11-21 03:44:27.480715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.480846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.480871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.027 qpair failed and we were unable to recover it. 00:27:47.027 [2024-11-21 03:44:27.481007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.481129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.481155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.027 qpair failed and we were unable to recover it. 00:27:47.027 [2024-11-21 03:44:27.481284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.481383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.481408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.027 qpair failed and we were unable to recover it. 00:27:47.027 [2024-11-21 03:44:27.481512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.481612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.481639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.027 qpair failed and we were unable to recover it. 00:27:47.027 [2024-11-21 03:44:27.481780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.481935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.481961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.027 qpair failed and we were unable to recover it. 00:27:47.027 [2024-11-21 03:44:27.482121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.482277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.482302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.027 qpair failed and we were unable to recover it. 00:27:47.027 [2024-11-21 03:44:27.482471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.482601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.482626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.027 qpair failed and we were unable to recover it. 00:27:47.027 [2024-11-21 03:44:27.482756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.482856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.482881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.027 qpair failed and we were unable to recover it. 00:27:47.027 [2024-11-21 03:44:27.483015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.483120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.483147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.027 qpair failed and we were unable to recover it. 00:27:47.027 [2024-11-21 03:44:27.483305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.483430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.483455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.027 qpair failed and we were unable to recover it. 00:27:47.027 [2024-11-21 03:44:27.483584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.483719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.483744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.027 qpair failed and we were unable to recover it. 00:27:47.027 [2024-11-21 03:44:27.483929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.484066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.484136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.027 qpair failed and we were unable to recover it. 00:27:47.027 [2024-11-21 03:44:27.484267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.484399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.484426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.027 qpair failed and we were unable to recover it. 00:27:47.027 [2024-11-21 03:44:27.484532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.484631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.484657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.027 qpair failed and we were unable to recover it. 00:27:47.027 [2024-11-21 03:44:27.484794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.484923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.484948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.027 qpair failed and we were unable to recover it. 00:27:47.027 [2024-11-21 03:44:27.485089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.485245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.485270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.027 qpair failed and we were unable to recover it. 00:27:47.027 [2024-11-21 03:44:27.485399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.485497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.485523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.027 qpair failed and we were unable to recover it. 00:27:47.027 [2024-11-21 03:44:27.485661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.485760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.485786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.027 qpair failed and we were unable to recover it. 00:27:47.027 [2024-11-21 03:44:27.485940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.486043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.486075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.027 qpair failed and we were unable to recover it. 00:27:47.027 [2024-11-21 03:44:27.486185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.486287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.486312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.027 qpair failed and we were unable to recover it. 00:27:47.027 [2024-11-21 03:44:27.486450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.486578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.486603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.027 qpair failed and we were unable to recover it. 00:27:47.027 [2024-11-21 03:44:27.486742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.486885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.486913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.027 qpair failed and we were unable to recover it. 00:27:47.027 [2024-11-21 03:44:27.487028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.487183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.487209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.027 qpair failed and we were unable to recover it. 00:27:47.027 [2024-11-21 03:44:27.487314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.487466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.487491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.027 qpair failed and we were unable to recover it. 00:27:47.027 [2024-11-21 03:44:27.487629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.487760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.487785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.027 qpair failed and we were unable to recover it. 00:27:47.027 [2024-11-21 03:44:27.487875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.488012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.488037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.027 qpair failed and we were unable to recover it. 00:27:47.027 [2024-11-21 03:44:27.488208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.488338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.488363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.027 qpair failed and we were unable to recover it. 00:27:47.027 [2024-11-21 03:44:27.488519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.488616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.488641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.027 qpair failed and we were unable to recover it. 00:27:47.027 [2024-11-21 03:44:27.488773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.488874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.488901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.027 qpair failed and we were unable to recover it. 00:27:47.027 [2024-11-21 03:44:27.489089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.489222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.489248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.027 qpair failed and we were unable to recover it. 00:27:47.027 [2024-11-21 03:44:27.489370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.489472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.489497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.027 qpair failed and we were unable to recover it. 00:27:47.027 [2024-11-21 03:44:27.489614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.489740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.489765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.027 qpair failed and we were unable to recover it. 00:27:47.027 [2024-11-21 03:44:27.489872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.489998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.490023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.027 qpair failed and we were unable to recover it. 00:27:47.027 [2024-11-21 03:44:27.490156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.490277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.490303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.027 qpair failed and we were unable to recover it. 00:27:47.027 [2024-11-21 03:44:27.490404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.490535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.490561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.027 qpair failed and we were unable to recover it. 00:27:47.027 [2024-11-21 03:44:27.490657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.490760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.490785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.027 qpair failed and we were unable to recover it. 00:27:47.027 [2024-11-21 03:44:27.490952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.491083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.491109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.027 qpair failed and we were unable to recover it. 00:27:47.027 [2024-11-21 03:44:27.491262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.491393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.491418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.027 qpair failed and we were unable to recover it. 00:27:47.027 [2024-11-21 03:44:27.491517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.491646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.491671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.027 qpair failed and we were unable to recover it. 00:27:47.027 [2024-11-21 03:44:27.491836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.491958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.491983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.027 qpair failed and we were unable to recover it. 00:27:47.027 [2024-11-21 03:44:27.492118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.492272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.492297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.027 qpair failed and we were unable to recover it. 00:27:47.027 [2024-11-21 03:44:27.492429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.492590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.492615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.027 qpair failed and we were unable to recover it. 00:27:47.027 [2024-11-21 03:44:27.492746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.492876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.492901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.027 qpair failed and we were unable to recover it. 00:27:47.027 [2024-11-21 03:44:27.493027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.493154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.493181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.027 qpair failed and we were unable to recover it. 00:27:47.027 [2024-11-21 03:44:27.493343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.493477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.493503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.027 qpair failed and we were unable to recover it. 00:27:47.027 [2024-11-21 03:44:27.493633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.493733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.493759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.027 qpair failed and we were unable to recover it. 00:27:47.027 [2024-11-21 03:44:27.493899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.494014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.494042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.027 qpair failed and we were unable to recover it. 00:27:47.027 [2024-11-21 03:44:27.494184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.494319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.494344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.027 qpair failed and we were unable to recover it. 00:27:47.027 [2024-11-21 03:44:27.494452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.494574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.494599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.027 qpair failed and we were unable to recover it. 00:27:47.027 [2024-11-21 03:44:27.494739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.027 [2024-11-21 03:44:27.494863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.494888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.028 qpair failed and we were unable to recover it. 00:27:47.028 [2024-11-21 03:44:27.494991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.495101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.495128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.028 qpair failed and we were unable to recover it. 00:27:47.028 [2024-11-21 03:44:27.495256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.495385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.495409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.028 qpair failed and we were unable to recover it. 00:27:47.028 [2024-11-21 03:44:27.495543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.495640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.495667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.028 qpair failed and we were unable to recover it. 00:27:47.028 [2024-11-21 03:44:27.495802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.495936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.495962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.028 qpair failed and we were unable to recover it. 00:27:47.028 [2024-11-21 03:44:27.496122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.496252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.496277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.028 qpair failed and we were unable to recover it. 00:27:47.028 [2024-11-21 03:44:27.496404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.496502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.496528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.028 qpair failed and we were unable to recover it. 00:27:47.028 [2024-11-21 03:44:27.496706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.496821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.496851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.028 qpair failed and we were unable to recover it. 00:27:47.028 [2024-11-21 03:44:27.497013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.497151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.497178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.028 qpair failed and we were unable to recover it. 00:27:47.028 [2024-11-21 03:44:27.497330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.497469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.497517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.028 qpair failed and we were unable to recover it. 00:27:47.028 [2024-11-21 03:44:27.497639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.497800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.497843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.028 qpair failed and we were unable to recover it. 00:27:47.028 [2024-11-21 03:44:27.497949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.498080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.498106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.028 qpair failed and we were unable to recover it. 00:27:47.028 [2024-11-21 03:44:27.498252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.498390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.498418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.028 qpair failed and we were unable to recover it. 00:27:47.028 [2024-11-21 03:44:27.498581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.498758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.498784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.028 qpair failed and we were unable to recover it. 00:27:47.028 [2024-11-21 03:44:27.498891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.499046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.499080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.028 qpair failed and we were unable to recover it. 00:27:47.028 [2024-11-21 03:44:27.499214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.499349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.499394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.028 qpair failed and we were unable to recover it. 00:27:47.028 [2024-11-21 03:44:27.499546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.499696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.499722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.028 qpair failed and we were unable to recover it. 00:27:47.028 [2024-11-21 03:44:27.499905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.500084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.500133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.028 qpair failed and we were unable to recover it. 00:27:47.028 [2024-11-21 03:44:27.500285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.500403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.500431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.028 qpair failed and we were unable to recover it. 00:27:47.028 [2024-11-21 03:44:27.500569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.500719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.500747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.028 qpair failed and we were unable to recover it. 00:27:47.028 [2024-11-21 03:44:27.500859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.500991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.501019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.028 qpair failed and we were unable to recover it. 00:27:47.028 [2024-11-21 03:44:27.501200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.501304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.501330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.028 qpair failed and we were unable to recover it. 00:27:47.028 [2024-11-21 03:44:27.501500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.501662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.501687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.028 qpair failed and we were unable to recover it. 00:27:47.028 [2024-11-21 03:44:27.501836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.501974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.502002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.028 qpair failed and we were unable to recover it. 00:27:47.028 [2024-11-21 03:44:27.502136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.502271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.502296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.028 qpair failed and we were unable to recover it. 00:27:47.028 [2024-11-21 03:44:27.502468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.502608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.502636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.028 qpair failed and we were unable to recover it. 00:27:47.028 [2024-11-21 03:44:27.502782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.502938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.502963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.028 qpair failed and we were unable to recover it. 00:27:47.028 [2024-11-21 03:44:27.503116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.503224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.503250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.028 qpair failed and we were unable to recover it. 00:27:47.028 [2024-11-21 03:44:27.503362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.503500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.503528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.028 qpair failed and we were unable to recover it. 00:27:47.028 [2024-11-21 03:44:27.503691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.503810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.503838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.028 qpair failed and we were unable to recover it. 00:27:47.028 [2024-11-21 03:44:27.503997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.504135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.504161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.028 qpair failed and we were unable to recover it. 00:27:47.028 [2024-11-21 03:44:27.504263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.504402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.504430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.028 qpair failed and we were unable to recover it. 00:27:47.028 [2024-11-21 03:44:27.504572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.504719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.504760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.028 qpair failed and we were unable to recover it. 00:27:47.028 [2024-11-21 03:44:27.504879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.505045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.505076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.028 qpair failed and we were unable to recover it. 00:27:47.028 [2024-11-21 03:44:27.505236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.505383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.505411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.028 qpair failed and we were unable to recover it. 00:27:47.028 [2024-11-21 03:44:27.505552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.505666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.505694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.028 qpair failed and we were unable to recover it. 00:27:47.028 [2024-11-21 03:44:27.505865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.505982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.506007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.028 qpair failed and we were unable to recover it. 00:27:47.028 [2024-11-21 03:44:27.506170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.506270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.506300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.028 qpair failed and we were unable to recover it. 00:27:47.028 [2024-11-21 03:44:27.506399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.506546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.506573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.028 qpair failed and we were unable to recover it. 00:27:47.028 [2024-11-21 03:44:27.506683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.506822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.506849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.028 qpair failed and we were unable to recover it. 00:27:47.028 [2024-11-21 03:44:27.506988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.507119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.507145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.028 qpair failed and we were unable to recover it. 00:27:47.028 [2024-11-21 03:44:27.507267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.507398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.507423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.028 qpair failed and we were unable to recover it. 00:27:47.028 [2024-11-21 03:44:27.507580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.507745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.507773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.028 qpair failed and we were unable to recover it. 00:27:47.028 [2024-11-21 03:44:27.507886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.508021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.508048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.028 qpair failed and we were unable to recover it. 00:27:47.028 [2024-11-21 03:44:27.508186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.508286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.508311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.028 qpair failed and we were unable to recover it. 00:27:47.028 [2024-11-21 03:44:27.508411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.508534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.508559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.028 qpair failed and we were unable to recover it. 00:27:47.028 [2024-11-21 03:44:27.508721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.508879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.508907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.028 qpair failed and we were unable to recover it. 00:27:47.028 [2024-11-21 03:44:27.509050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.509210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.509235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.028 qpair failed and we were unable to recover it. 00:27:47.028 [2024-11-21 03:44:27.509378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.509532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.509560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.028 qpair failed and we were unable to recover it. 00:27:47.028 [2024-11-21 03:44:27.509695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.509827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.028 [2024-11-21 03:44:27.509855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.028 qpair failed and we were unable to recover it. 00:27:47.029 [2024-11-21 03:44:27.509975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.029 [2024-11-21 03:44:27.510125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.029 [2024-11-21 03:44:27.510152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.029 qpair failed and we were unable to recover it. 00:27:47.029 [2024-11-21 03:44:27.510254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.029 [2024-11-21 03:44:27.510351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.029 [2024-11-21 03:44:27.510376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.029 qpair failed and we were unable to recover it. 00:27:47.029 [2024-11-21 03:44:27.510500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.029 [2024-11-21 03:44:27.510652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.029 [2024-11-21 03:44:27.510680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.029 qpair failed and we were unable to recover it. 00:27:47.029 [2024-11-21 03:44:27.510847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.029 [2024-11-21 03:44:27.510989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.029 [2024-11-21 03:44:27.511017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.029 qpair failed and we were unable to recover it. 00:27:47.029 [2024-11-21 03:44:27.511210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.029 [2024-11-21 03:44:27.511301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.029 [2024-11-21 03:44:27.511326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.029 qpair failed and we were unable to recover it. 00:27:47.029 [2024-11-21 03:44:27.511453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.029 [2024-11-21 03:44:27.511621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.029 [2024-11-21 03:44:27.511649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.029 qpair failed and we were unable to recover it. 00:27:47.029 [2024-11-21 03:44:27.511753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.029 [2024-11-21 03:44:27.511901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.029 [2024-11-21 03:44:27.511942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.029 qpair failed and we were unable to recover it. 00:27:47.029 [2024-11-21 03:44:27.512082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.029 [2024-11-21 03:44:27.512202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.029 [2024-11-21 03:44:27.512228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.029 qpair failed and we were unable to recover it. 00:27:47.029 [2024-11-21 03:44:27.512338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.029 [2024-11-21 03:44:27.512520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.029 [2024-11-21 03:44:27.512548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.029 qpair failed and we were unable to recover it. 00:27:47.029 [2024-11-21 03:44:27.512718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.029 [2024-11-21 03:44:27.512892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.029 [2024-11-21 03:44:27.512920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.029 qpair failed and we were unable to recover it. 00:27:47.029 [2024-11-21 03:44:27.513056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.029 [2024-11-21 03:44:27.513174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.029 [2024-11-21 03:44:27.513199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.029 qpair failed and we were unable to recover it. 00:27:47.029 [2024-11-21 03:44:27.513327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.029 [2024-11-21 03:44:27.513423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.029 [2024-11-21 03:44:27.513448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.029 qpair failed and we were unable to recover it. 00:27:47.029 [2024-11-21 03:44:27.513574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.029 [2024-11-21 03:44:27.513688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.029 [2024-11-21 03:44:27.513716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.029 qpair failed and we were unable to recover it. 00:27:47.029 [2024-11-21 03:44:27.513826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.029 [2024-11-21 03:44:27.513963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.029 [2024-11-21 03:44:27.513990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.029 qpair failed and we were unable to recover it. 00:27:47.029 [2024-11-21 03:44:27.514150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.029 [2024-11-21 03:44:27.514254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.029 [2024-11-21 03:44:27.514281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.029 qpair failed and we were unable to recover it. 00:27:47.029 [2024-11-21 03:44:27.514437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.029 [2024-11-21 03:44:27.514569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.029 [2024-11-21 03:44:27.514612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.029 qpair failed and we were unable to recover it. 00:27:47.029 [2024-11-21 03:44:27.514751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.029 [2024-11-21 03:44:27.514941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.029 [2024-11-21 03:44:27.514969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.029 qpair failed and we were unable to recover it. 00:27:47.029 [2024-11-21 03:44:27.515104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.029 [2024-11-21 03:44:27.515226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.029 [2024-11-21 03:44:27.515252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.029 qpair failed and we were unable to recover it. 00:27:47.029 [2024-11-21 03:44:27.515348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.029 [2024-11-21 03:44:27.515528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.029 [2024-11-21 03:44:27.515556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.029 qpair failed and we were unable to recover it. 00:27:47.029 [2024-11-21 03:44:27.515679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.029 [2024-11-21 03:44:27.515812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.029 [2024-11-21 03:44:27.515837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.029 qpair failed and we were unable to recover it. 00:27:47.029 [2024-11-21 03:44:27.515995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.029 [2024-11-21 03:44:27.516158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.029 [2024-11-21 03:44:27.516187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.029 qpair failed and we were unable to recover it. 00:27:47.029 [2024-11-21 03:44:27.516368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.029 [2024-11-21 03:44:27.516490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.029 [2024-11-21 03:44:27.516514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.029 qpair failed and we were unable to recover it. 00:27:47.029 [2024-11-21 03:44:27.516692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.029 [2024-11-21 03:44:27.516811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.029 [2024-11-21 03:44:27.516837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.029 qpair failed and we were unable to recover it. 00:27:47.029 [2024-11-21 03:44:27.516934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.029 [2024-11-21 03:44:27.517053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.029 [2024-11-21 03:44:27.517083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.029 qpair failed and we were unable to recover it. 00:27:47.029 [2024-11-21 03:44:27.517214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.029 [2024-11-21 03:44:27.517334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.029 [2024-11-21 03:44:27.517364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.029 qpair failed and we were unable to recover it. 00:27:47.029 [2024-11-21 03:44:27.517535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.029 [2024-11-21 03:44:27.517639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.029 [2024-11-21 03:44:27.517667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.029 qpair failed and we were unable to recover it. 00:27:47.029 [2024-11-21 03:44:27.517825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.029 [2024-11-21 03:44:27.517948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.029 [2024-11-21 03:44:27.517973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.029 qpair failed and we were unable to recover it. 00:27:47.029 [2024-11-21 03:44:27.518103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.029 [2024-11-21 03:44:27.518192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.029 [2024-11-21 03:44:27.518217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.029 qpair failed and we were unable to recover it. 00:27:47.029 [2024-11-21 03:44:27.518381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.029 [2024-11-21 03:44:27.518552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.029 [2024-11-21 03:44:27.518580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.029 qpair failed and we were unable to recover it. 00:27:47.029 [2024-11-21 03:44:27.518714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.029 [2024-11-21 03:44:27.518832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.029 [2024-11-21 03:44:27.518859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.029 qpair failed and we were unable to recover it. 00:27:47.029 [2024-11-21 03:44:27.519037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.029 [2024-11-21 03:44:27.519169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.029 [2024-11-21 03:44:27.519194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.029 qpair failed and we were unable to recover it. 00:27:47.029 [2024-11-21 03:44:27.519318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.029 [2024-11-21 03:44:27.519411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.029 [2024-11-21 03:44:27.519436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.029 qpair failed and we were unable to recover it. 00:27:47.029 [2024-11-21 03:44:27.519557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.029 [2024-11-21 03:44:27.519687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.029 [2024-11-21 03:44:27.519714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.029 qpair failed and we were unable to recover it. 00:27:47.029 [2024-11-21 03:44:27.519858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.029 [2024-11-21 03:44:27.519963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.029 [2024-11-21 03:44:27.519991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.029 qpair failed and we were unable to recover it. 00:27:47.029 [2024-11-21 03:44:27.520107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.029 [2024-11-21 03:44:27.520246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.029 [2024-11-21 03:44:27.520274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.029 qpair failed and we were unable to recover it. 00:27:47.029 [2024-11-21 03:44:27.520428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.029 [2024-11-21 03:44:27.520528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.029 [2024-11-21 03:44:27.520553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.029 qpair failed and we were unable to recover it. 00:27:47.029 [2024-11-21 03:44:27.520688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.029 [2024-11-21 03:44:27.520836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.029 [2024-11-21 03:44:27.520864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.029 qpair failed and we were unable to recover it. 00:27:47.029 [2024-11-21 03:44:27.520974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.029 [2024-11-21 03:44:27.521132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.029 [2024-11-21 03:44:27.521157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.029 qpair failed and we were unable to recover it. 00:27:47.029 [2024-11-21 03:44:27.521284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.029 [2024-11-21 03:44:27.521431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.029 [2024-11-21 03:44:27.521464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.029 qpair failed and we were unable to recover it. 00:27:47.029 [2024-11-21 03:44:27.521637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.029 [2024-11-21 03:44:27.521801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.029 [2024-11-21 03:44:27.521844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.029 qpair failed and we were unable to recover it. 00:27:47.029 [2024-11-21 03:44:27.521951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.029 [2024-11-21 03:44:27.522087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.029 [2024-11-21 03:44:27.522116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.029 qpair failed and we were unable to recover it. 00:27:47.029 [2024-11-21 03:44:27.522285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.029 [2024-11-21 03:44:27.522404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.029 [2024-11-21 03:44:27.522432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.029 qpair failed and we were unable to recover it. 00:27:47.029 [2024-11-21 03:44:27.522565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.029 [2024-11-21 03:44:27.522708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.029 [2024-11-21 03:44:27.522736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.029 qpair failed and we were unable to recover it. 00:27:47.029 [2024-11-21 03:44:27.522890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.029 [2024-11-21 03:44:27.523010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.029 [2024-11-21 03:44:27.523035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.029 qpair failed and we were unable to recover it. 00:27:47.029 [2024-11-21 03:44:27.523239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.029 [2024-11-21 03:44:27.523379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.029 [2024-11-21 03:44:27.523406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.029 qpair failed and we were unable to recover it. 00:27:47.029 [2024-11-21 03:44:27.523529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.029 [2024-11-21 03:44:27.523649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.029 [2024-11-21 03:44:27.523677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.029 qpair failed and we were unable to recover it. 00:27:47.029 [2024-11-21 03:44:27.523813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.029 [2024-11-21 03:44:27.523949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.029 [2024-11-21 03:44:27.523977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.029 qpair failed and we were unable to recover it. 00:27:47.030 [2024-11-21 03:44:27.524125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.524232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.524258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.030 qpair failed and we were unable to recover it. 00:27:47.030 [2024-11-21 03:44:27.524421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.524567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.524599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.030 qpair failed and we were unable to recover it. 00:27:47.030 [2024-11-21 03:44:27.524753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.524880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.524905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.030 qpair failed and we were unable to recover it. 00:27:47.030 [2024-11-21 03:44:27.525015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.525175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.525204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.030 qpair failed and we were unable to recover it. 00:27:47.030 [2024-11-21 03:44:27.525329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.525425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.525450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.030 qpair failed and we were unable to recover it. 00:27:47.030 [2024-11-21 03:44:27.525633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.525770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.525810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.030 qpair failed and we were unable to recover it. 00:27:47.030 [2024-11-21 03:44:27.525933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.526038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.526063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.030 qpair failed and we were unable to recover it. 00:27:47.030 [2024-11-21 03:44:27.526176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.526269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.526294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.030 qpair failed and we were unable to recover it. 00:27:47.030 [2024-11-21 03:44:27.526391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.526547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.526572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.030 qpair failed and we were unable to recover it. 00:27:47.030 [2024-11-21 03:44:27.526726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.526901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.526927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.030 qpair failed and we were unable to recover it. 00:27:47.030 [2024-11-21 03:44:27.527095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.527224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.527249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.030 qpair failed and we were unable to recover it. 00:27:47.030 [2024-11-21 03:44:27.527379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.527508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.527533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.030 qpair failed and we were unable to recover it. 00:27:47.030 [2024-11-21 03:44:27.527664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.527785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.527810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.030 qpair failed and we were unable to recover it. 00:27:47.030 [2024-11-21 03:44:27.527970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.528073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.528099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.030 qpair failed and we were unable to recover it. 00:27:47.030 [2024-11-21 03:44:27.528217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.528351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.528376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.030 qpair failed and we were unable to recover it. 00:27:47.030 [2024-11-21 03:44:27.528513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.528687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.528715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.030 qpair failed and we were unable to recover it. 00:27:47.030 [2024-11-21 03:44:27.528863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.528982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.529008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.030 qpair failed and we were unable to recover it. 00:27:47.030 [2024-11-21 03:44:27.529161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.529305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.529333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.030 qpair failed and we were unable to recover it. 00:27:47.030 [2024-11-21 03:44:27.529492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.529627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.529652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.030 qpair failed and we were unable to recover it. 00:27:47.030 [2024-11-21 03:44:27.529807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.529938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.529966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.030 qpair failed and we were unable to recover it. 00:27:47.030 [2024-11-21 03:44:27.530127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.530258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.530283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.030 qpair failed and we were unable to recover it. 00:27:47.030 [2024-11-21 03:44:27.530484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.530638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.530663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.030 qpair failed and we were unable to recover it. 00:27:47.030 [2024-11-21 03:44:27.530819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.530960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.530988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.030 qpair failed and we were unable to recover it. 00:27:47.030 [2024-11-21 03:44:27.531102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.531226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.531254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.030 qpair failed and we were unable to recover it. 00:27:47.030 [2024-11-21 03:44:27.531377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.531500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.531525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.030 qpair failed and we were unable to recover it. 00:27:47.030 [2024-11-21 03:44:27.531676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.531858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.531884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.030 qpair failed and we were unable to recover it. 00:27:47.030 [2024-11-21 03:44:27.532010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.532142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.532168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.030 qpair failed and we were unable to recover it. 00:27:47.030 [2024-11-21 03:44:27.532289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.532419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.532444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.030 qpair failed and we were unable to recover it. 00:27:47.030 [2024-11-21 03:44:27.532536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.532670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.532695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.030 qpair failed and we were unable to recover it. 00:27:47.030 [2024-11-21 03:44:27.532870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.533034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.533062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.030 qpair failed and we were unable to recover it. 00:27:47.030 [2024-11-21 03:44:27.533215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.533348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.533372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.030 qpair failed and we were unable to recover it. 00:27:47.030 [2024-11-21 03:44:27.533493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.533642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.533684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.030 qpair failed and we were unable to recover it. 00:27:47.030 [2024-11-21 03:44:27.533817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.533923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.533948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.030 qpair failed and we were unable to recover it. 00:27:47.030 [2024-11-21 03:44:27.534080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.534231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.534259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.030 qpair failed and we were unable to recover it. 00:27:47.030 [2024-11-21 03:44:27.534374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.534499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.534524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.030 qpair failed and we were unable to recover it. 00:27:47.030 [2024-11-21 03:44:27.534679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.534825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.534868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.030 qpair failed and we were unable to recover it. 00:27:47.030 [2024-11-21 03:44:27.534962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.535102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.535129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.030 qpair failed and we were unable to recover it. 00:27:47.030 [2024-11-21 03:44:27.535297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.535434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.535474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.030 qpair failed and we were unable to recover it. 00:27:47.030 [2024-11-21 03:44:27.535628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.535803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.535831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.030 qpair failed and we were unable to recover it. 00:27:47.030 [2024-11-21 03:44:27.535935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.536050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.536084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.030 qpair failed and we were unable to recover it. 00:27:47.030 [2024-11-21 03:44:27.536215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.536314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.536339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.030 qpair failed and we were unable to recover it. 00:27:47.030 [2024-11-21 03:44:27.536528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.536640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.536668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.030 qpair failed and we were unable to recover it. 00:27:47.030 [2024-11-21 03:44:27.536848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.536992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.537020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.030 qpair failed and we were unable to recover it. 00:27:47.030 [2024-11-21 03:44:27.537177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.537304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.537329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.030 qpair failed and we were unable to recover it. 00:27:47.030 [2024-11-21 03:44:27.537456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.537581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.537606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.030 qpair failed and we were unable to recover it. 00:27:47.030 [2024-11-21 03:44:27.537742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.537889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.537930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.030 qpair failed and we were unable to recover it. 00:27:47.030 [2024-11-21 03:44:27.538053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.538152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.538177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.030 qpair failed and we were unable to recover it. 00:27:47.030 [2024-11-21 03:44:27.538271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.538442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.538470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.030 qpair failed and we were unable to recover it. 00:27:47.030 [2024-11-21 03:44:27.538646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.538742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.538767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.030 qpair failed and we were unable to recover it. 00:27:47.030 [2024-11-21 03:44:27.538919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.539021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.539049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.030 qpair failed and we were unable to recover it. 00:27:47.030 [2024-11-21 03:44:27.539240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.030 [2024-11-21 03:44:27.539347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.539389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.031 qpair failed and we were unable to recover it. 00:27:47.031 [2024-11-21 03:44:27.539530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.539683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.539708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.031 qpair failed and we were unable to recover it. 00:27:47.031 [2024-11-21 03:44:27.539863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.540032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.540065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.031 qpair failed and we were unable to recover it. 00:27:47.031 [2024-11-21 03:44:27.540196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.540361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.540389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.031 qpair failed and we were unable to recover it. 00:27:47.031 [2024-11-21 03:44:27.540542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.540664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.540688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.031 qpair failed and we were unable to recover it. 00:27:47.031 [2024-11-21 03:44:27.540816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.540984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.541012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.031 qpair failed and we were unable to recover it. 00:27:47.031 [2024-11-21 03:44:27.541163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.541276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.541301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.031 qpair failed and we were unable to recover it. 00:27:47.031 [2024-11-21 03:44:27.541434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.541545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.541573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.031 qpair failed and we were unable to recover it. 00:27:47.031 [2024-11-21 03:44:27.541716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.541854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.541881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.031 qpair failed and we were unable to recover it. 00:27:47.031 [2024-11-21 03:44:27.542021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.542168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.542209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.031 qpair failed and we were unable to recover it. 00:27:47.031 [2024-11-21 03:44:27.542338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.542491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.542516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.031 qpair failed and we were unable to recover it. 00:27:47.031 [2024-11-21 03:44:27.542694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.542791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.542817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.031 qpair failed and we were unable to recover it. 00:27:47.031 [2024-11-21 03:44:27.542941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.543097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.543123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.031 qpair failed and we were unable to recover it. 00:27:47.031 [2024-11-21 03:44:27.543320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.543463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.543491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.031 qpair failed and we were unable to recover it. 00:27:47.031 [2024-11-21 03:44:27.543611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.543710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.543735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.031 qpair failed and we were unable to recover it. 00:27:47.031 [2024-11-21 03:44:27.543836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.543968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.543993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.031 qpair failed and we were unable to recover it. 00:27:47.031 [2024-11-21 03:44:27.544109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.544265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.544290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.031 qpair failed and we were unable to recover it. 00:27:47.031 [2024-11-21 03:44:27.544422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.544531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.544559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.031 qpair failed and we were unable to recover it. 00:27:47.031 [2024-11-21 03:44:27.544733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.544853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.544878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.031 qpair failed and we were unable to recover it. 00:27:47.031 [2024-11-21 03:44:27.545046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.545189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.545215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.031 qpair failed and we were unable to recover it. 00:27:47.031 [2024-11-21 03:44:27.545342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.545473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.545498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.031 qpair failed and we were unable to recover it. 00:27:47.031 [2024-11-21 03:44:27.545604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.545753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.545782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.031 qpair failed and we were unable to recover it. 00:27:47.031 [2024-11-21 03:44:27.545920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.546080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.546106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.031 qpair failed and we were unable to recover it. 00:27:47.031 [2024-11-21 03:44:27.546271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.546414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.546442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.031 qpair failed and we were unable to recover it. 00:27:47.031 [2024-11-21 03:44:27.546579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.546697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.546725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.031 qpair failed and we were unable to recover it. 00:27:47.031 [2024-11-21 03:44:27.546906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.547030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.547055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.031 qpair failed and we were unable to recover it. 00:27:47.031 [2024-11-21 03:44:27.547257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.547411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.547454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.031 qpair failed and we were unable to recover it. 00:27:47.031 [2024-11-21 03:44:27.547615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.547738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.547763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.031 qpair failed and we were unable to recover it. 00:27:47.031 [2024-11-21 03:44:27.547893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.548000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.548028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.031 qpair failed and we were unable to recover it. 00:27:47.031 [2024-11-21 03:44:27.548178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.548317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.548345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.031 qpair failed and we were unable to recover it. 00:27:47.031 [2024-11-21 03:44:27.548524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.548646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.548672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.031 qpair failed and we were unable to recover it. 00:27:47.031 [2024-11-21 03:44:27.548842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.548995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.549020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.031 qpair failed and we were unable to recover it. 00:27:47.031 [2024-11-21 03:44:27.549184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.549343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.549371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.031 qpair failed and we were unable to recover it. 00:27:47.031 [2024-11-21 03:44:27.549493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.549658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.549686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.031 qpair failed and we were unable to recover it. 00:27:47.031 [2024-11-21 03:44:27.549815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.549975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.550000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.031 qpair failed and we were unable to recover it. 00:27:47.031 [2024-11-21 03:44:27.550154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.550294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.550322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.031 qpair failed and we were unable to recover it. 00:27:47.031 [2024-11-21 03:44:27.550444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.550592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.550618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.031 qpair failed and we were unable to recover it. 00:27:47.031 [2024-11-21 03:44:27.550752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.550894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.550922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.031 qpair failed and we were unable to recover it. 00:27:47.031 [2024-11-21 03:44:27.551043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.551163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.551188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.031 qpair failed and we were unable to recover it. 00:27:47.031 [2024-11-21 03:44:27.551303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.551404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.551432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.031 qpair failed and we were unable to recover it. 00:27:47.031 [2024-11-21 03:44:27.551549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.551716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.551744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.031 qpair failed and we were unable to recover it. 00:27:47.031 [2024-11-21 03:44:27.551862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.552007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.552034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.031 qpair failed and we were unable to recover it. 00:27:47.031 [2024-11-21 03:44:27.552166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.552262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.552287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.031 qpair failed and we were unable to recover it. 00:27:47.031 [2024-11-21 03:44:27.552460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.552605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.552633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.031 qpair failed and we were unable to recover it. 00:27:47.031 [2024-11-21 03:44:27.552736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.552870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.552898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.031 qpair failed and we were unable to recover it. 00:27:47.031 [2024-11-21 03:44:27.553018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.553161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.553190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.031 qpair failed and we were unable to recover it. 00:27:47.031 [2024-11-21 03:44:27.553313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.553417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.553443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.031 qpair failed and we were unable to recover it. 00:27:47.031 [2024-11-21 03:44:27.553550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.553706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.031 [2024-11-21 03:44:27.553731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.032 qpair failed and we were unable to recover it. 00:27:47.032 [2024-11-21 03:44:27.553881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.554041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.554066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.032 qpair failed and we were unable to recover it. 00:27:47.032 [2024-11-21 03:44:27.554232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.554404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.554429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.032 qpair failed and we were unable to recover it. 00:27:47.032 [2024-11-21 03:44:27.554556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.554711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.554735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.032 qpair failed and we were unable to recover it. 00:27:47.032 [2024-11-21 03:44:27.554893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.555016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.555044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.032 qpair failed and we were unable to recover it. 00:27:47.032 [2024-11-21 03:44:27.555202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.555354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.555395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.032 qpair failed and we were unable to recover it. 00:27:47.032 [2024-11-21 03:44:27.555530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.555637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.555669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.032 qpair failed and we were unable to recover it. 00:27:47.032 [2024-11-21 03:44:27.555805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.555927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.555952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.032 qpair failed and we were unable to recover it. 00:27:47.032 [2024-11-21 03:44:27.556164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.556299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.556324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.032 qpair failed and we were unable to recover it. 00:27:47.032 [2024-11-21 03:44:27.556489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.556610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.556636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.032 qpair failed and we were unable to recover it. 00:27:47.032 [2024-11-21 03:44:27.556757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.556925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.556953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.032 qpair failed and we were unable to recover it. 00:27:47.032 [2024-11-21 03:44:27.557128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.557280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.557322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.032 qpair failed and we were unable to recover it. 00:27:47.032 [2024-11-21 03:44:27.557438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.557579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.557607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.032 qpair failed and we were unable to recover it. 00:27:47.032 [2024-11-21 03:44:27.557736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.557872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.557900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.032 qpair failed and we were unable to recover it. 00:27:47.032 [2024-11-21 03:44:27.558038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.558193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.558221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.032 qpair failed and we were unable to recover it. 00:27:47.032 [2024-11-21 03:44:27.558350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.558474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.558499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.032 qpair failed and we were unable to recover it. 00:27:47.032 [2024-11-21 03:44:27.558630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.558749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.558774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.032 qpair failed and we were unable to recover it. 00:27:47.032 [2024-11-21 03:44:27.558909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.559064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.559104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.032 qpair failed and we were unable to recover it. 00:27:47.032 [2024-11-21 03:44:27.559253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.559377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.559402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.032 qpair failed and we were unable to recover it. 00:27:47.032 [2024-11-21 03:44:27.559529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.559666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.559691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.032 qpair failed and we were unable to recover it. 00:27:47.032 [2024-11-21 03:44:27.559855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.560010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.560035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.032 qpair failed and we were unable to recover it. 00:27:47.032 [2024-11-21 03:44:27.560203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.560324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.560365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.032 qpair failed and we were unable to recover it. 00:27:47.032 [2024-11-21 03:44:27.560548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.560702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.560727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.032 qpair failed and we were unable to recover it. 00:27:47.032 [2024-11-21 03:44:27.560836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.560968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.560993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.032 qpair failed and we were unable to recover it. 00:27:47.032 [2024-11-21 03:44:27.561098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.561228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.561254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.032 qpair failed and we were unable to recover it. 00:27:47.032 [2024-11-21 03:44:27.561350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.561469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.561495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.032 qpair failed and we were unable to recover it. 00:27:47.032 [2024-11-21 03:44:27.561637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.561780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.561807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.032 qpair failed and we were unable to recover it. 00:27:47.032 [2024-11-21 03:44:27.561987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.562094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.562121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.032 qpair failed and we were unable to recover it. 00:27:47.032 [2024-11-21 03:44:27.562281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.562396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.562424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.032 qpair failed and we were unable to recover it. 00:27:47.032 [2024-11-21 03:44:27.562609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.562729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.562754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.032 qpair failed and we were unable to recover it. 00:27:47.032 [2024-11-21 03:44:27.562901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.563008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.563036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.032 qpair failed and we were unable to recover it. 00:27:47.032 [2024-11-21 03:44:27.563166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.563289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.563314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.032 qpair failed and we were unable to recover it. 00:27:47.032 [2024-11-21 03:44:27.563435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.563531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.563559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.032 qpair failed and we were unable to recover it. 00:27:47.032 [2024-11-21 03:44:27.563694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.563831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.563859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.032 qpair failed and we were unable to recover it. 00:27:47.032 [2024-11-21 03:44:27.564044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.564179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.564205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.032 qpair failed and we were unable to recover it. 00:27:47.032 [2024-11-21 03:44:27.564303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.564434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.564461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.032 qpair failed and we were unable to recover it. 00:27:47.032 [2024-11-21 03:44:27.564586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.564691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.564719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.032 qpair failed and we were unable to recover it. 00:27:47.032 [2024-11-21 03:44:27.564861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.565005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.565033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.032 qpair failed and we were unable to recover it. 00:27:47.032 [2024-11-21 03:44:27.565219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.565349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.565374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.032 qpair failed and we were unable to recover it. 00:27:47.032 [2024-11-21 03:44:27.565529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.565648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.565673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.032 qpair failed and we were unable to recover it. 00:27:47.032 [2024-11-21 03:44:27.565871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.566000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.566025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.032 qpair failed and we were unable to recover it. 00:27:47.032 [2024-11-21 03:44:27.566204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.566335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.566360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.032 qpair failed and we were unable to recover it. 00:27:47.032 [2024-11-21 03:44:27.566541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.566679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.566707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.032 qpair failed and we were unable to recover it. 00:27:47.032 [2024-11-21 03:44:27.566858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.566998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.567023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.032 qpair failed and we were unable to recover it. 00:27:47.032 [2024-11-21 03:44:27.567198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.567308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.567336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.032 qpair failed and we were unable to recover it. 00:27:47.032 [2024-11-21 03:44:27.567473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.567642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.567670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.032 qpair failed and we were unable to recover it. 00:27:47.032 [2024-11-21 03:44:27.567780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.567951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.567979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.032 qpair failed and we were unable to recover it. 00:27:47.032 [2024-11-21 03:44:27.568096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.568206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.568231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.032 qpair failed and we were unable to recover it. 00:27:47.032 [2024-11-21 03:44:27.568360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.568513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.568538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.032 qpair failed and we were unable to recover it. 00:27:47.032 [2024-11-21 03:44:27.568680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.568857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.568882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.032 qpair failed and we were unable to recover it. 00:27:47.032 [2024-11-21 03:44:27.569011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.569131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.569159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.032 qpair failed and we were unable to recover it. 00:27:47.032 [2024-11-21 03:44:27.569289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.032 [2024-11-21 03:44:27.569399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.569424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.033 qpair failed and we were unable to recover it. 00:27:47.033 [2024-11-21 03:44:27.569556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.569671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.569699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.033 qpair failed and we were unable to recover it. 00:27:47.033 [2024-11-21 03:44:27.569801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.569919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.569959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.033 qpair failed and we were unable to recover it. 00:27:47.033 [2024-11-21 03:44:27.570090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.570228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.570255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.033 qpair failed and we were unable to recover it. 00:27:47.033 [2024-11-21 03:44:27.570381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.570535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.570560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.033 qpair failed and we were unable to recover it. 00:27:47.033 [2024-11-21 03:44:27.570712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.570819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.570847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.033 qpair failed and we were unable to recover it. 00:27:47.033 [2024-11-21 03:44:27.570986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.571134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.571164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.033 qpair failed and we were unable to recover it. 00:27:47.033 [2024-11-21 03:44:27.571287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.571464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.571492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.033 qpair failed and we were unable to recover it. 00:27:47.033 [2024-11-21 03:44:27.571645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.571741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.571766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.033 qpair failed and we were unable to recover it. 00:27:47.033 [2024-11-21 03:44:27.571916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.572063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.572096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.033 qpair failed and we were unable to recover it. 00:27:47.033 [2024-11-21 03:44:27.572198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.572301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.572326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.033 qpair failed and we were unable to recover it. 00:27:47.033 [2024-11-21 03:44:27.572455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.572598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.572627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.033 qpair failed and we were unable to recover it. 00:27:47.033 [2024-11-21 03:44:27.572772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.572913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.572941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.033 qpair failed and we were unable to recover it. 00:27:47.033 [2024-11-21 03:44:27.573090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.573262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.573287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.033 qpair failed and we were unable to recover it. 00:27:47.033 [2024-11-21 03:44:27.573443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.573592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.573619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.033 qpair failed and we were unable to recover it. 00:27:47.033 [2024-11-21 03:44:27.573793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.573916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.573941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.033 qpair failed and we were unable to recover it. 00:27:47.033 [2024-11-21 03:44:27.574075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.574171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.574196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.033 qpair failed and we were unable to recover it. 00:27:47.033 [2024-11-21 03:44:27.574348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.574495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.574522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.033 qpair failed and we were unable to recover it. 00:27:47.033 [2024-11-21 03:44:27.574696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.574826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.574850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.033 qpair failed and we were unable to recover it. 00:27:47.033 [2024-11-21 03:44:27.574990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.575115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.575141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.033 qpair failed and we were unable to recover it. 00:27:47.033 [2024-11-21 03:44:27.575297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.575423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.575448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.033 qpair failed and we were unable to recover it. 00:27:47.033 [2024-11-21 03:44:27.575579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.575672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.575697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.033 qpair failed and we were unable to recover it. 00:27:47.033 [2024-11-21 03:44:27.575827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.575968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.575995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.033 qpair failed and we were unable to recover it. 00:27:47.033 [2024-11-21 03:44:27.576127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.576275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.576303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.033 qpair failed and we were unable to recover it. 00:27:47.033 [2024-11-21 03:44:27.576429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.576559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.576584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.033 qpair failed and we were unable to recover it. 00:27:47.033 [2024-11-21 03:44:27.576738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.576873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.576914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.033 qpair failed and we were unable to recover it. 00:27:47.033 [2024-11-21 03:44:27.577077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.577195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.577224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.033 qpair failed and we were unable to recover it. 00:27:47.033 [2024-11-21 03:44:27.577378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.577508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.577534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.033 qpair failed and we were unable to recover it. 00:27:47.033 [2024-11-21 03:44:27.577626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.577748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.577773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.033 qpair failed and we were unable to recover it. 00:27:47.033 [2024-11-21 03:44:27.577976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.578128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.578154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.033 qpair failed and we were unable to recover it. 00:27:47.033 [2024-11-21 03:44:27.578288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.578410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.578437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.033 qpair failed and we were unable to recover it. 00:27:47.033 [2024-11-21 03:44:27.578545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.578657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.578685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.033 qpair failed and we were unable to recover it. 00:27:47.033 [2024-11-21 03:44:27.578831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.578918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.578942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.033 qpair failed and we were unable to recover it. 00:27:47.033 [2024-11-21 03:44:27.579088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.579211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.579236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.033 qpair failed and we were unable to recover it. 00:27:47.033 [2024-11-21 03:44:27.579331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.579435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.579460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.033 qpair failed and we were unable to recover it. 00:27:47.033 [2024-11-21 03:44:27.579585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.579722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.579747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.033 qpair failed and we were unable to recover it. 00:27:47.033 [2024-11-21 03:44:27.579875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.579969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.579994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.033 qpair failed and we were unable to recover it. 00:27:47.033 [2024-11-21 03:44:27.580142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.580277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.580306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.033 qpair failed and we were unable to recover it. 00:27:47.033 [2024-11-21 03:44:27.580472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.580609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.580636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.033 qpair failed and we were unable to recover it. 00:27:47.033 [2024-11-21 03:44:27.580792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.580919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.580945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.033 qpair failed and we were unable to recover it. 00:27:47.033 [2024-11-21 03:44:27.581056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.581179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.581206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.033 qpair failed and we were unable to recover it. 00:27:47.033 [2024-11-21 03:44:27.581365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.581492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.581517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.033 qpair failed and we were unable to recover it. 00:27:47.033 [2024-11-21 03:44:27.581653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.581749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.581775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.033 qpair failed and we were unable to recover it. 00:27:47.033 [2024-11-21 03:44:27.581875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.582004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.582030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.033 qpair failed and we were unable to recover it. 00:27:47.033 [2024-11-21 03:44:27.582174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.582269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.582294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.033 qpair failed and we were unable to recover it. 00:27:47.033 [2024-11-21 03:44:27.582422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.582579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.582604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.033 qpair failed and we were unable to recover it. 00:27:47.033 [2024-11-21 03:44:27.582767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.582906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.582934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.033 qpair failed and we were unable to recover it. 00:27:47.033 [2024-11-21 03:44:27.583102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.583205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.583231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.033 qpair failed and we were unable to recover it. 00:27:47.033 [2024-11-21 03:44:27.583389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.583549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.583574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.033 qpair failed and we were unable to recover it. 00:27:47.033 [2024-11-21 03:44:27.583729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.583861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.033 [2024-11-21 03:44:27.583886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.033 qpair failed and we were unable to recover it. 00:27:47.033 [2024-11-21 03:44:27.584017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.034 [2024-11-21 03:44:27.584150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.034 [2024-11-21 03:44:27.584177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.034 qpair failed and we were unable to recover it. 00:27:47.034 [2024-11-21 03:44:27.584308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.034 [2024-11-21 03:44:27.584405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.034 [2024-11-21 03:44:27.584431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.034 qpair failed and we were unable to recover it. 00:27:47.034 [2024-11-21 03:44:27.584578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.034 [2024-11-21 03:44:27.584703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.034 [2024-11-21 03:44:27.584728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.034 qpair failed and we were unable to recover it. 00:27:47.034 [2024-11-21 03:44:27.584832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.034 [2024-11-21 03:44:27.584977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.034 [2024-11-21 03:44:27.585006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.034 qpair failed and we were unable to recover it. 00:27:47.034 [2024-11-21 03:44:27.585161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.034 [2024-11-21 03:44:27.585291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.034 [2024-11-21 03:44:27.585316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.034 qpair failed and we were unable to recover it. 00:27:47.034 [2024-11-21 03:44:27.585418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.034 [2024-11-21 03:44:27.585571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.034 [2024-11-21 03:44:27.585596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.034 qpair failed and we were unable to recover it. 00:27:47.034 [2024-11-21 03:44:27.585694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.034 [2024-11-21 03:44:27.585818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.034 [2024-11-21 03:44:27.585844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.034 qpair failed and we were unable to recover it. 00:27:47.034 [2024-11-21 03:44:27.585966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.034 [2024-11-21 03:44:27.586104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.034 [2024-11-21 03:44:27.586131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.034 qpair failed and we were unable to recover it. 00:27:47.034 [2024-11-21 03:44:27.586271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.034 [2024-11-21 03:44:27.586408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.034 [2024-11-21 03:44:27.586433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.034 qpair failed and we were unable to recover it. 00:27:47.034 [2024-11-21 03:44:27.586534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.034 [2024-11-21 03:44:27.586687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.034 [2024-11-21 03:44:27.586712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.034 qpair failed and we were unable to recover it. 00:27:47.034 [2024-11-21 03:44:27.586846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.034 [2024-11-21 03:44:27.586992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.034 [2024-11-21 03:44:27.587021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.034 qpair failed and we were unable to recover it. 00:27:47.034 [2024-11-21 03:44:27.587200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.034 [2024-11-21 03:44:27.587334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.034 [2024-11-21 03:44:27.587359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.034 qpair failed and we were unable to recover it. 00:27:47.034 [2024-11-21 03:44:27.587518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.034 [2024-11-21 03:44:27.587620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.034 [2024-11-21 03:44:27.587646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.034 qpair failed and we were unable to recover it. 00:27:47.034 [2024-11-21 03:44:27.587754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.034 [2024-11-21 03:44:27.587881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.034 [2024-11-21 03:44:27.587906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.034 qpair failed and we were unable to recover it. 00:27:47.034 [2024-11-21 03:44:27.588012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.034 [2024-11-21 03:44:27.588137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.034 [2024-11-21 03:44:27.588164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.034 qpair failed and we were unable to recover it. 00:27:47.034 [2024-11-21 03:44:27.588287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.034 [2024-11-21 03:44:27.588399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.034 [2024-11-21 03:44:27.588424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.034 qpair failed and we were unable to recover it. 00:27:47.034 [2024-11-21 03:44:27.588526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.034 [2024-11-21 03:44:27.588654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.034 [2024-11-21 03:44:27.588680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.034 qpair failed and we were unable to recover it. 00:27:47.034 [2024-11-21 03:44:27.588814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.034 [2024-11-21 03:44:27.588969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.034 [2024-11-21 03:44:27.588999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.034 qpair failed and we were unable to recover it. 00:27:47.034 [2024-11-21 03:44:27.589160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.034 [2024-11-21 03:44:27.589321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.034 [2024-11-21 03:44:27.589346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.034 qpair failed and we were unable to recover it. 00:27:47.034 [2024-11-21 03:44:27.589474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.034 [2024-11-21 03:44:27.589604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.034 [2024-11-21 03:44:27.589629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.034 qpair failed and we were unable to recover it. 00:27:47.034 [2024-11-21 03:44:27.589769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.034 [2024-11-21 03:44:27.589876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.034 [2024-11-21 03:44:27.589901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.034 qpair failed and we were unable to recover it. 00:27:47.034 [2024-11-21 03:44:27.590025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.034 [2024-11-21 03:44:27.590148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.034 [2024-11-21 03:44:27.590174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.034 qpair failed and we were unable to recover it. 00:27:47.034 [2024-11-21 03:44:27.590305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.034 [2024-11-21 03:44:27.590463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.034 [2024-11-21 03:44:27.590489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.034 qpair failed and we were unable to recover it. 00:27:47.034 [2024-11-21 03:44:27.590596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.034 [2024-11-21 03:44:27.590700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.034 [2024-11-21 03:44:27.590726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.034 qpair failed and we were unable to recover it. 00:27:47.034 [2024-11-21 03:44:27.590854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.034 [2024-11-21 03:44:27.590974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.034 [2024-11-21 03:44:27.591004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.034 qpair failed and we were unable to recover it. 00:27:47.034 [2024-11-21 03:44:27.591157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.034 [2024-11-21 03:44:27.591316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.034 [2024-11-21 03:44:27.591342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.034 qpair failed and we were unable to recover it. 00:27:47.034 [2024-11-21 03:44:27.591439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.034 [2024-11-21 03:44:27.591536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.034 [2024-11-21 03:44:27.591563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.034 qpair failed and we were unable to recover it. 00:27:47.034 [2024-11-21 03:44:27.591666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.034 [2024-11-21 03:44:27.591764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.034 [2024-11-21 03:44:27.591790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.034 qpair failed and we were unable to recover it. 00:27:47.034 [2024-11-21 03:44:27.591917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.034 [2024-11-21 03:44:27.592016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.034 [2024-11-21 03:44:27.592043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.034 qpair failed and we were unable to recover it. 00:27:47.034 [2024-11-21 03:44:27.592159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.034 [2024-11-21 03:44:27.592259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.034 [2024-11-21 03:44:27.592284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.034 qpair failed and we were unable to recover it. 00:27:47.034 [2024-11-21 03:44:27.592448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.034 [2024-11-21 03:44:27.592573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.034 [2024-11-21 03:44:27.592598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.034 qpair failed and we were unable to recover it. 00:27:47.034 [2024-11-21 03:44:27.592726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.034 [2024-11-21 03:44:27.592823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.034 [2024-11-21 03:44:27.592849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.034 qpair failed and we were unable to recover it. 00:27:47.034 [2024-11-21 03:44:27.593029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.034 [2024-11-21 03:44:27.593173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.034 [2024-11-21 03:44:27.593200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.034 qpair failed and we were unable to recover it. 00:27:47.034 [2024-11-21 03:44:27.593332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.034 [2024-11-21 03:44:27.593483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.034 [2024-11-21 03:44:27.593512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.034 qpair failed and we were unable to recover it. 00:27:47.034 [2024-11-21 03:44:27.593704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.034 [2024-11-21 03:44:27.593848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.034 [2024-11-21 03:44:27.593874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.034 qpair failed and we were unable to recover it. 00:27:47.034 [2024-11-21 03:44:27.594034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.034 [2024-11-21 03:44:27.594169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.034 [2024-11-21 03:44:27.594195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.034 qpair failed and we were unable to recover it. 00:27:47.034 [2024-11-21 03:44:27.594293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.034 [2024-11-21 03:44:27.594401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.034 [2024-11-21 03:44:27.594427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.034 qpair failed and we were unable to recover it. 00:27:47.034 [2024-11-21 03:44:27.594555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.034 [2024-11-21 03:44:27.594721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.034 [2024-11-21 03:44:27.594747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.034 qpair failed and we were unable to recover it. 00:27:47.034 [2024-11-21 03:44:27.594895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.034 [2024-11-21 03:44:27.595126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.034 [2024-11-21 03:44:27.595153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.034 qpair failed and we were unable to recover it. 00:27:47.034 [2024-11-21 03:44:27.595285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.034 [2024-11-21 03:44:27.595407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.034 [2024-11-21 03:44:27.595433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.034 qpair failed and we were unable to recover it. 00:27:47.034 [2024-11-21 03:44:27.595536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.034 [2024-11-21 03:44:27.595694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.034 [2024-11-21 03:44:27.595719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.034 qpair failed and we were unable to recover it. 00:27:47.034 [2024-11-21 03:44:27.595853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.034 [2024-11-21 03:44:27.596013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.034 [2024-11-21 03:44:27.596038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.034 qpair failed and we were unable to recover it. 00:27:47.034 [2024-11-21 03:44:27.596154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.034 [2024-11-21 03:44:27.596256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.034 [2024-11-21 03:44:27.596281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.034 qpair failed and we were unable to recover it. 00:27:47.034 [2024-11-21 03:44:27.596409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.034 [2024-11-21 03:44:27.596505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.034 [2024-11-21 03:44:27.596530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.034 qpair failed and we were unable to recover it. 00:27:47.034 [2024-11-21 03:44:27.596655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.034 [2024-11-21 03:44:27.596747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.034 [2024-11-21 03:44:27.596773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.034 qpair failed and we were unable to recover it. 00:27:47.034 [2024-11-21 03:44:27.596893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.034 [2024-11-21 03:44:27.597020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.034 [2024-11-21 03:44:27.597047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.034 qpair failed and we were unable to recover it. 00:27:47.034 [2024-11-21 03:44:27.597152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.034 [2024-11-21 03:44:27.597276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.034 [2024-11-21 03:44:27.597302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.034 qpair failed and we were unable to recover it. 00:27:47.035 [2024-11-21 03:44:27.597436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.035 [2024-11-21 03:44:27.597535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.035 [2024-11-21 03:44:27.597566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.035 qpair failed and we were unable to recover it. 00:27:47.035 [2024-11-21 03:44:27.597724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.035 [2024-11-21 03:44:27.597858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.035 [2024-11-21 03:44:27.597883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.035 qpair failed and we were unable to recover it. 00:27:47.035 [2024-11-21 03:44:27.598024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.035 [2024-11-21 03:44:27.598181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.035 [2024-11-21 03:44:27.598208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.035 qpair failed and we were unable to recover it. 00:27:47.035 [2024-11-21 03:44:27.598340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.035 [2024-11-21 03:44:27.598470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.035 [2024-11-21 03:44:27.598497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.035 qpair failed and we were unable to recover it. 00:27:47.035 [2024-11-21 03:44:27.598624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.035 [2024-11-21 03:44:27.598721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.035 [2024-11-21 03:44:27.598746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.035 qpair failed and we were unable to recover it. 00:27:47.035 [2024-11-21 03:44:27.598900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.035 [2024-11-21 03:44:27.599030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.035 [2024-11-21 03:44:27.599055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.035 qpair failed and we were unable to recover it. 00:27:47.035 [2024-11-21 03:44:27.599191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.035 [2024-11-21 03:44:27.599321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.035 [2024-11-21 03:44:27.599346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.035 qpair failed and we were unable to recover it. 00:27:47.035 [2024-11-21 03:44:27.599477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.035 [2024-11-21 03:44:27.599598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.035 [2024-11-21 03:44:27.599624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.035 qpair failed and we were unable to recover it. 00:27:47.035 [2024-11-21 03:44:27.599780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.035 [2024-11-21 03:44:27.599887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.035 [2024-11-21 03:44:27.599912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.035 qpair failed and we were unable to recover it. 00:27:47.035 [2024-11-21 03:44:27.600029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.035 [2024-11-21 03:44:27.600190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.035 [2024-11-21 03:44:27.600217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.035 qpair failed and we were unable to recover it. 00:27:47.035 [2024-11-21 03:44:27.600352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.035 [2024-11-21 03:44:27.600485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.035 [2024-11-21 03:44:27.600518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.035 qpair failed and we were unable to recover it. 00:27:47.035 [2024-11-21 03:44:27.600656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.035 [2024-11-21 03:44:27.600783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.035 [2024-11-21 03:44:27.600808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.035 qpair failed and we were unable to recover it. 00:27:47.035 [2024-11-21 03:44:27.600942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.035 [2024-11-21 03:44:27.601100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.035 [2024-11-21 03:44:27.601126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.035 qpair failed and we were unable to recover it. 00:27:47.035 [2024-11-21 03:44:27.601235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.035 [2024-11-21 03:44:27.601390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.035 [2024-11-21 03:44:27.601415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.035 qpair failed and we were unable to recover it. 00:27:47.035 [2024-11-21 03:44:27.601543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.035 [2024-11-21 03:44:27.601669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.035 [2024-11-21 03:44:27.601694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.035 qpair failed and we were unable to recover it. 00:27:47.035 [2024-11-21 03:44:27.601828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.035 [2024-11-21 03:44:27.601939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.035 [2024-11-21 03:44:27.601981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.035 qpair failed and we were unable to recover it. 00:27:47.035 [2024-11-21 03:44:27.602112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.035 [2024-11-21 03:44:27.602268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.035 [2024-11-21 03:44:27.602294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.035 qpair failed and we were unable to recover it. 00:27:47.035 [2024-11-21 03:44:27.602420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.035 [2024-11-21 03:44:27.602549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.035 [2024-11-21 03:44:27.602574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.035 qpair failed and we were unable to recover it. 00:27:47.035 [2024-11-21 03:44:27.602730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.035 [2024-11-21 03:44:27.602883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.035 [2024-11-21 03:44:27.602909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.035 qpair failed and we were unable to recover it. 00:27:47.035 [2024-11-21 03:44:27.603045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.035 [2024-11-21 03:44:27.603238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.035 [2024-11-21 03:44:27.603264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.035 qpair failed and we were unable to recover it. 00:27:47.035 [2024-11-21 03:44:27.603399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.035 [2024-11-21 03:44:27.603499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.035 [2024-11-21 03:44:27.603530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.035 qpair failed and we were unable to recover it. 00:27:47.035 [2024-11-21 03:44:27.603692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.035 [2024-11-21 03:44:27.603815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.035 [2024-11-21 03:44:27.603840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.035 qpair failed and we were unable to recover it. 00:27:47.035 [2024-11-21 03:44:27.603971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.035 [2024-11-21 03:44:27.604079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.035 [2024-11-21 03:44:27.604105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.035 qpair failed and we were unable to recover it. 00:27:47.035 [2024-11-21 03:44:27.604207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.035 [2024-11-21 03:44:27.604333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.035 [2024-11-21 03:44:27.604358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.035 qpair failed and we were unable to recover it. 00:27:47.035 [2024-11-21 03:44:27.604513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.035 [2024-11-21 03:44:27.604608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.035 [2024-11-21 03:44:27.604634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.035 qpair failed and we were unable to recover it. 00:27:47.035 [2024-11-21 03:44:27.604756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.035 [2024-11-21 03:44:27.604859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.035 [2024-11-21 03:44:27.604885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.035 qpair failed and we were unable to recover it. 00:27:47.035 [2024-11-21 03:44:27.604996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.035 [2024-11-21 03:44:27.605126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.035 [2024-11-21 03:44:27.605154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.035 qpair failed and we were unable to recover it. 00:27:47.035 [2024-11-21 03:44:27.605260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.035 [2024-11-21 03:44:27.605416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.035 [2024-11-21 03:44:27.605442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.035 qpair failed and we were unable to recover it. 00:27:47.035 [2024-11-21 03:44:27.605574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.035 [2024-11-21 03:44:27.605672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.035 [2024-11-21 03:44:27.605698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.035 qpair failed and we were unable to recover it. 00:27:47.035 [2024-11-21 03:44:27.605857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.035 [2024-11-21 03:44:27.606012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.035 [2024-11-21 03:44:27.606041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.035 qpair failed and we were unable to recover it. 00:27:47.035 [2024-11-21 03:44:27.606160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.035 [2024-11-21 03:44:27.606252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.035 [2024-11-21 03:44:27.606283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.035 qpair failed and we were unable to recover it. 00:27:47.035 [2024-11-21 03:44:27.606379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.035 [2024-11-21 03:44:27.606536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.035 [2024-11-21 03:44:27.606561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.035 qpair failed and we were unable to recover it. 00:27:47.035 [2024-11-21 03:44:27.606658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.035 [2024-11-21 03:44:27.606787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.035 [2024-11-21 03:44:27.606813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.035 qpair failed and we were unable to recover it. 00:27:47.035 [2024-11-21 03:44:27.606959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.035 [2024-11-21 03:44:27.607108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.035 [2024-11-21 03:44:27.607134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.035 qpair failed and we were unable to recover it. 00:27:47.035 [2024-11-21 03:44:27.607241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.035 [2024-11-21 03:44:27.607384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.035 [2024-11-21 03:44:27.607410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.035 qpair failed and we were unable to recover it. 00:27:47.035 [2024-11-21 03:44:27.607566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.035 [2024-11-21 03:44:27.607691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.035 [2024-11-21 03:44:27.607716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.035 qpair failed and we were unable to recover it. 00:27:47.035 [2024-11-21 03:44:27.607875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.035 [2024-11-21 03:44:27.608001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.035 [2024-11-21 03:44:27.608026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.035 qpair failed and we were unable to recover it. 00:27:47.035 [2024-11-21 03:44:27.608169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.035 [2024-11-21 03:44:27.608298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.035 [2024-11-21 03:44:27.608324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.035 qpair failed and we were unable to recover it. 00:27:47.035 [2024-11-21 03:44:27.608428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.035 [2024-11-21 03:44:27.608555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.035 [2024-11-21 03:44:27.608581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.035 qpair failed and we were unable to recover it. 00:27:47.035 [2024-11-21 03:44:27.608690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.035 [2024-11-21 03:44:27.608788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.035 [2024-11-21 03:44:27.608814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.035 qpair failed and we were unable to recover it. 00:27:47.035 [2024-11-21 03:44:27.608912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.035 [2024-11-21 03:44:27.609085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.035 [2024-11-21 03:44:27.609128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.035 qpair failed and we were unable to recover it. 00:27:47.035 [2024-11-21 03:44:27.609264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.035 [2024-11-21 03:44:27.609429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.035 [2024-11-21 03:44:27.609454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.035 qpair failed and we were unable to recover it. 00:27:47.035 [2024-11-21 03:44:27.609598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.035 [2024-11-21 03:44:27.609729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.035 [2024-11-21 03:44:27.609755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.035 qpair failed and we were unable to recover it. 00:27:47.035 [2024-11-21 03:44:27.609886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.035 [2024-11-21 03:44:27.610038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.035 [2024-11-21 03:44:27.610064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.035 qpair failed and we were unable to recover it. 00:27:47.035 [2024-11-21 03:44:27.610199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.035 [2024-11-21 03:44:27.610335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.035 [2024-11-21 03:44:27.610360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.035 qpair failed and we were unable to recover it. 00:27:47.035 [2024-11-21 03:44:27.610493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.035 [2024-11-21 03:44:27.610600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.036 [2024-11-21 03:44:27.610626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.036 qpair failed and we were unable to recover it. 00:27:47.036 [2024-11-21 03:44:27.610722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.036 [2024-11-21 03:44:27.610827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.036 [2024-11-21 03:44:27.610852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.036 qpair failed and we were unable to recover it. 00:27:47.036 [2024-11-21 03:44:27.610983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.036 [2024-11-21 03:44:27.611142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.036 [2024-11-21 03:44:27.611169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.036 qpair failed and we were unable to recover it. 00:27:47.036 [2024-11-21 03:44:27.611262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.036 [2024-11-21 03:44:27.611385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.036 [2024-11-21 03:44:27.611411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.036 qpair failed and we were unable to recover it. 00:27:47.036 [2024-11-21 03:44:27.611544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.036 [2024-11-21 03:44:27.611669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.036 [2024-11-21 03:44:27.611695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.036 qpair failed and we were unable to recover it. 00:27:47.036 [2024-11-21 03:44:27.611826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.036 [2024-11-21 03:44:27.611960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.036 [2024-11-21 03:44:27.611985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.036 qpair failed and we were unable to recover it. 00:27:47.036 [2024-11-21 03:44:27.612121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.036 [2024-11-21 03:44:27.612250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.036 [2024-11-21 03:44:27.612275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.036 qpair failed and we were unable to recover it. 00:27:47.036 [2024-11-21 03:44:27.612431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.036 [2024-11-21 03:44:27.612560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.036 [2024-11-21 03:44:27.612585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.036 qpair failed and we were unable to recover it. 00:27:47.036 [2024-11-21 03:44:27.612685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.036 [2024-11-21 03:44:27.612806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.036 [2024-11-21 03:44:27.612832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.036 qpair failed and we were unable to recover it. 00:27:47.036 [2024-11-21 03:44:27.612979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.036 [2024-11-21 03:44:27.613090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.036 [2024-11-21 03:44:27.613116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.036 qpair failed and we were unable to recover it. 00:27:47.036 [2024-11-21 03:44:27.613278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.036 [2024-11-21 03:44:27.613407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.036 [2024-11-21 03:44:27.613433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.036 qpair failed and we were unable to recover it. 00:27:47.036 [2024-11-21 03:44:27.613565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.036 [2024-11-21 03:44:27.613696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.036 [2024-11-21 03:44:27.613721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.036 qpair failed and we were unable to recover it. 00:27:47.036 [2024-11-21 03:44:27.613814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.036 [2024-11-21 03:44:27.613937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.036 [2024-11-21 03:44:27.613963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.036 qpair failed and we were unable to recover it. 00:27:47.036 [2024-11-21 03:44:27.614085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.036 [2024-11-21 03:44:27.614185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.036 [2024-11-21 03:44:27.614210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.036 qpair failed and we were unable to recover it. 00:27:47.036 [2024-11-21 03:44:27.614343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.036 [2024-11-21 03:44:27.614462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.036 [2024-11-21 03:44:27.614488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.036 qpair failed and we were unable to recover it. 00:27:47.036 [2024-11-21 03:44:27.614621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.036 [2024-11-21 03:44:27.614711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.036 [2024-11-21 03:44:27.614736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.036 qpair failed and we were unable to recover it. 00:27:47.036 [2024-11-21 03:44:27.614895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.036 [2024-11-21 03:44:27.615050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.036 [2024-11-21 03:44:27.615094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.036 qpair failed and we were unable to recover it. 00:27:47.036 [2024-11-21 03:44:27.615226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.036 [2024-11-21 03:44:27.615350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.036 [2024-11-21 03:44:27.615375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.036 qpair failed and we were unable to recover it. 00:27:47.036 [2024-11-21 03:44:27.615512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.036 [2024-11-21 03:44:27.615611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.036 [2024-11-21 03:44:27.615637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.036 qpair failed and we were unable to recover it. 00:27:47.036 [2024-11-21 03:44:27.615764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.036 [2024-11-21 03:44:27.615885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.036 [2024-11-21 03:44:27.615915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.036 qpair failed and we were unable to recover it. 00:27:47.036 [2024-11-21 03:44:27.616059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.036 [2024-11-21 03:44:27.616214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.036 [2024-11-21 03:44:27.616239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.036 qpair failed and we were unable to recover it. 00:27:47.036 [2024-11-21 03:44:27.616392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.036 [2024-11-21 03:44:27.616517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.036 [2024-11-21 03:44:27.616543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.036 qpair failed and we were unable to recover it. 00:27:47.036 [2024-11-21 03:44:27.616674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.036 [2024-11-21 03:44:27.616823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.036 [2024-11-21 03:44:27.616848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.036 qpair failed and we were unable to recover it. 00:27:47.036 [2024-11-21 03:44:27.616969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.036 [2024-11-21 03:44:27.617092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.036 [2024-11-21 03:44:27.617118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.036 qpair failed and we were unable to recover it. 00:27:47.036 [2024-11-21 03:44:27.617249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.036 [2024-11-21 03:44:27.617353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.036 [2024-11-21 03:44:27.617379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.036 qpair failed and we were unable to recover it. 00:27:47.036 [2024-11-21 03:44:27.617505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.036 [2024-11-21 03:44:27.617632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.036 [2024-11-21 03:44:27.617658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.036 qpair failed and we were unable to recover it. 00:27:47.036 [2024-11-21 03:44:27.617825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.036 [2024-11-21 03:44:27.617977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.036 [2024-11-21 03:44:27.618005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.036 qpair failed and we were unable to recover it. 00:27:47.036 [2024-11-21 03:44:27.618160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.036 [2024-11-21 03:44:27.618319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.036 [2024-11-21 03:44:27.618344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.036 qpair failed and we were unable to recover it. 00:27:47.036 [2024-11-21 03:44:27.618449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.036 [2024-11-21 03:44:27.618606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.036 [2024-11-21 03:44:27.618632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.036 qpair failed and we were unable to recover it. 00:27:47.036 [2024-11-21 03:44:27.618732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.036 [2024-11-21 03:44:27.618866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.036 [2024-11-21 03:44:27.618891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.036 qpair failed and we were unable to recover it. 00:27:47.036 [2024-11-21 03:44:27.618996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.036 [2024-11-21 03:44:27.619130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.036 [2024-11-21 03:44:27.619156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.036 qpair failed and we were unable to recover it. 00:27:47.036 [2024-11-21 03:44:27.619290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.036 [2024-11-21 03:44:27.619389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.036 [2024-11-21 03:44:27.619414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.036 qpair failed and we were unable to recover it. 00:27:47.036 [2024-11-21 03:44:27.619547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.036 [2024-11-21 03:44:27.619680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.036 [2024-11-21 03:44:27.619706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.036 qpair failed and we were unable to recover it. 00:27:47.036 [2024-11-21 03:44:27.619871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.036 [2024-11-21 03:44:27.620023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.036 [2024-11-21 03:44:27.620052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.036 qpair failed and we were unable to recover it. 00:27:47.036 [2024-11-21 03:44:27.620204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.036 [2024-11-21 03:44:27.620331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.036 [2024-11-21 03:44:27.620357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.036 qpair failed and we were unable to recover it. 00:27:47.036 [2024-11-21 03:44:27.620514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.036 [2024-11-21 03:44:27.620645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.036 [2024-11-21 03:44:27.620671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.036 qpair failed and we were unable to recover it. 00:27:47.036 [2024-11-21 03:44:27.620806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.036 [2024-11-21 03:44:27.621008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.036 [2024-11-21 03:44:27.621037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.036 qpair failed and we were unable to recover it. 00:27:47.036 [2024-11-21 03:44:27.621192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.036 [2024-11-21 03:44:27.621330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.036 [2024-11-21 03:44:27.621356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.036 qpair failed and we were unable to recover it. 00:27:47.036 [2024-11-21 03:44:27.621519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.036 [2024-11-21 03:44:27.621616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.036 [2024-11-21 03:44:27.621642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.036 qpair failed and we were unable to recover it. 00:27:47.036 [2024-11-21 03:44:27.621744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.036 [2024-11-21 03:44:27.621870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.036 [2024-11-21 03:44:27.621895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.036 qpair failed and we were unable to recover it. 00:27:47.036 [2024-11-21 03:44:27.621991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.036 [2024-11-21 03:44:27.622154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.036 [2024-11-21 03:44:27.622180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.036 qpair failed and we were unable to recover it. 00:27:47.036 [2024-11-21 03:44:27.622281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.036 [2024-11-21 03:44:27.622417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.036 [2024-11-21 03:44:27.622443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.036 qpair failed and we were unable to recover it. 00:27:47.036 [2024-11-21 03:44:27.622569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.036 [2024-11-21 03:44:27.622697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.036 [2024-11-21 03:44:27.622722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.036 qpair failed and we were unable to recover it. 00:27:47.036 [2024-11-21 03:44:27.622856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.036 [2024-11-21 03:44:27.622982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.036 [2024-11-21 03:44:27.623007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.036 qpair failed and we were unable to recover it. 00:27:47.036 [2024-11-21 03:44:27.623149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.036 [2024-11-21 03:44:27.623250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.036 [2024-11-21 03:44:27.623276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.036 qpair failed and we were unable to recover it. 00:27:47.036 [2024-11-21 03:44:27.623408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.036 [2024-11-21 03:44:27.623540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.036 [2024-11-21 03:44:27.623566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.037 qpair failed and we were unable to recover it. 00:27:47.037 [2024-11-21 03:44:27.623704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.037 [2024-11-21 03:44:27.623804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.037 [2024-11-21 03:44:27.623831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.037 qpair failed and we were unable to recover it. 00:27:47.037 [2024-11-21 03:44:27.623956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.037 [2024-11-21 03:44:27.624074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.037 [2024-11-21 03:44:27.624100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.037 qpair failed and we were unable to recover it. 00:27:47.037 [2024-11-21 03:44:27.624211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.037 [2024-11-21 03:44:27.624338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.037 [2024-11-21 03:44:27.624364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.037 qpair failed and we were unable to recover it. 00:27:47.037 [2024-11-21 03:44:27.624504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.037 [2024-11-21 03:44:27.624635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.037 [2024-11-21 03:44:27.624661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.037 qpair failed and we were unable to recover it. 00:27:47.037 [2024-11-21 03:44:27.624792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.037 [2024-11-21 03:44:27.624951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.037 [2024-11-21 03:44:27.624976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.037 qpair failed and we were unable to recover it. 00:27:47.037 [2024-11-21 03:44:27.625114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.037 [2024-11-21 03:44:27.625222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.037 [2024-11-21 03:44:27.625248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.037 qpair failed and we were unable to recover it. 00:27:47.037 [2024-11-21 03:44:27.625347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.037 [2024-11-21 03:44:27.625478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.037 [2024-11-21 03:44:27.625503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.037 qpair failed and we were unable to recover it. 00:27:47.037 [2024-11-21 03:44:27.625612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.037 [2024-11-21 03:44:27.625743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.037 [2024-11-21 03:44:27.625769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.037 qpair failed and we were unable to recover it. 00:27:47.037 [2024-11-21 03:44:27.625888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.037 [2024-11-21 03:44:27.626085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.037 [2024-11-21 03:44:27.626128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.037 qpair failed and we were unable to recover it. 00:27:47.037 [2024-11-21 03:44:27.626233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.037 [2024-11-21 03:44:27.626367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.037 [2024-11-21 03:44:27.626393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:47.037 qpair failed and we were unable to recover it. 00:27:47.037 [2024-11-21 03:44:27.626532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.037 [2024-11-21 03:44:27.626677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.037 [2024-11-21 03:44:27.626706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.037 qpair failed and we were unable to recover it. 00:27:47.037 [2024-11-21 03:44:27.626866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.037 [2024-11-21 03:44:27.626996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.037 [2024-11-21 03:44:27.627022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.037 qpair failed and we were unable to recover it. 00:27:47.037 [2024-11-21 03:44:27.627172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.037 [2024-11-21 03:44:27.627334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.037 [2024-11-21 03:44:27.627361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.037 qpair failed and we were unable to recover it. 00:27:47.037 [2024-11-21 03:44:27.627468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.037 [2024-11-21 03:44:27.627592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.037 [2024-11-21 03:44:27.627618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.037 qpair failed and we were unable to recover it. 00:27:47.037 [2024-11-21 03:44:27.627773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.037 [2024-11-21 03:44:27.627953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.037 [2024-11-21 03:44:27.627981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.037 qpair failed and we were unable to recover it. 00:27:47.037 [2024-11-21 03:44:27.628098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.037 [2024-11-21 03:44:27.628230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.037 [2024-11-21 03:44:27.628256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.037 qpair failed and we were unable to recover it. 00:27:47.037 [2024-11-21 03:44:27.628389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.037 [2024-11-21 03:44:27.628522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.037 [2024-11-21 03:44:27.628547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.037 qpair failed and we were unable to recover it. 00:27:47.037 [2024-11-21 03:44:27.628651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.037 [2024-11-21 03:44:27.628758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.037 [2024-11-21 03:44:27.628783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.037 qpair failed and we were unable to recover it. 00:27:47.037 [2024-11-21 03:44:27.628919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.037 [2024-11-21 03:44:27.629046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.037 [2024-11-21 03:44:27.629078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.037 qpair failed and we were unable to recover it. 00:27:47.037 [2024-11-21 03:44:27.629181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.037 [2024-11-21 03:44:27.629340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.037 [2024-11-21 03:44:27.629366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:47.037 qpair failed and we were unable to recover it. 00:27:47.037 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh: line 44: 3174358 Killed "${NVMF_APP[@]}" "$@" 00:27:47.037 [2024-11-21 03:44:27.629493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.037 [2024-11-21 03:44:27.629611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.037 [2024-11-21 03:44:27.629640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.037 qpair failed and we were unable to recover it. 00:27:47.037 [2024-11-21 03:44:27.629751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.037 03:44:27 -- host/target_disconnect.sh@56 -- # disconnect_init 10.0.0.2 00:27:47.037 [2024-11-21 03:44:27.629880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.037 [2024-11-21 03:44:27.629907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.037 03:44:27 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:27:47.037 qpair failed and we were unable to recover it. 00:27:47.037 [2024-11-21 03:44:27.630057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.037 03:44:27 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:47.037 [2024-11-21 03:44:27.630201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.037 [2024-11-21 03:44:27.630227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.037 03:44:27 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:47.037 qpair failed and we were unable to recover it. 00:27:47.037 03:44:27 -- common/autotest_common.sh@10 -- # set +x 00:27:47.037 [2024-11-21 03:44:27.630410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.037 [2024-11-21 03:44:27.630546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.037 [2024-11-21 03:44:27.630590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.037 qpair failed and we were unable to recover it. 00:27:47.037 [2024-11-21 03:44:27.630707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.037 [2024-11-21 03:44:27.630870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.037 [2024-11-21 03:44:27.630895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.037 qpair failed and we were unable to recover it. 00:27:47.037 [2024-11-21 03:44:27.631006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.037 [2024-11-21 03:44:27.631132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.037 [2024-11-21 03:44:27.631159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.037 qpair failed and we were unable to recover it. 00:27:47.037 [2024-11-21 03:44:27.631268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.037 [2024-11-21 03:44:27.631369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.037 [2024-11-21 03:44:27.631394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.037 qpair failed and we were unable to recover it. 00:27:47.037 [2024-11-21 03:44:27.631490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.037 [2024-11-21 03:44:27.631586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.037 [2024-11-21 03:44:27.631612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.037 qpair failed and we were unable to recover it. 00:27:47.037 [2024-11-21 03:44:27.631720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.037 [2024-11-21 03:44:27.631871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.037 [2024-11-21 03:44:27.631897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.037 qpair failed and we were unable to recover it. 00:27:47.037 [2024-11-21 03:44:27.632012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.037 [2024-11-21 03:44:27.632154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.037 [2024-11-21 03:44:27.632182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.037 qpair failed and we were unable to recover it. 00:27:47.037 [2024-11-21 03:44:27.632287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.037 [2024-11-21 03:44:27.632411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.037 [2024-11-21 03:44:27.632437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.037 qpair failed and we were unable to recover it. 00:27:47.037 [2024-11-21 03:44:27.632568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.037 [2024-11-21 03:44:27.632695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.037 [2024-11-21 03:44:27.632720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.037 qpair failed and we were unable to recover it. 00:27:47.037 [2024-11-21 03:44:27.632825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.037 [2024-11-21 03:44:27.632930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.037 [2024-11-21 03:44:27.632956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.037 qpair failed and we were unable to recover it. 00:27:47.037 [2024-11-21 03:44:27.633054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.037 [2024-11-21 03:44:27.633201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.037 [2024-11-21 03:44:27.633227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.037 qpair failed and we were unable to recover it. 00:27:47.037 [2024-11-21 03:44:27.633368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.037 [2024-11-21 03:44:27.633483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.037 [2024-11-21 03:44:27.633508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.037 qpair failed and we were unable to recover it. 00:27:47.037 03:44:27 -- nvmf/common.sh@469 -- # nvmfpid=3174947 00:27:47.037 [2024-11-21 03:44:27.633640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.037 03:44:27 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:27:47.037 [2024-11-21 03:44:27.633750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.037 03:44:27 -- nvmf/common.sh@470 -- # waitforlisten 3174947 00:27:47.037 [2024-11-21 03:44:27.633775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.037 qpair failed and we were unable to recover it. 00:27:47.037 [2024-11-21 03:44:27.633889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.037 03:44:27 -- common/autotest_common.sh@829 -- # '[' -z 3174947 ']' 00:27:47.037 [2024-11-21 03:44:27.634019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.037 [2024-11-21 03:44:27.634045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.037 qpair failed and we were unable to recover it. 00:27:47.037 03:44:27 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:47.037 [2024-11-21 03:44:27.634195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.037 03:44:27 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:47.037 [2024-11-21 03:44:27.634336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.037 [2024-11-21 03:44:27.634366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.037 qpair failed and we were unable to recover it. 00:27:47.037 03:44:27 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:47.037 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:47.037 [2024-11-21 03:44:27.634519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.038 03:44:27 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:47.038 03:44:27 -- common/autotest_common.sh@10 -- # set +x 00:27:47.038 [2024-11-21 03:44:27.634653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.038 [2024-11-21 03:44:27.634680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.038 qpair failed and we were unable to recover it. 00:27:47.038 [2024-11-21 03:44:27.634808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.038 [2024-11-21 03:44:27.634921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.038 [2024-11-21 03:44:27.634948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.038 qpair failed and we were unable to recover it. 00:27:47.038 [2024-11-21 03:44:27.635046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.038 [2024-11-21 03:44:27.635173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.038 [2024-11-21 03:44:27.635219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.038 qpair failed and we were unable to recover it. 00:27:47.038 [2024-11-21 03:44:27.635348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.038 [2024-11-21 03:44:27.635479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.038 [2024-11-21 03:44:27.635505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.038 qpair failed and we were unable to recover it. 00:27:47.038 [2024-11-21 03:44:27.635642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.038 [2024-11-21 03:44:27.635766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.038 [2024-11-21 03:44:27.635792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.038 qpair failed and we were unable to recover it. 00:27:47.038 [2024-11-21 03:44:27.635929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.038 [2024-11-21 03:44:27.636076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.038 [2024-11-21 03:44:27.636101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.038 qpair failed and we were unable to recover it. 00:27:47.038 [2024-11-21 03:44:27.636248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.038 [2024-11-21 03:44:27.636367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.038 [2024-11-21 03:44:27.636393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.038 qpair failed and we were unable to recover it. 00:27:47.038 [2024-11-21 03:44:27.636550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.038 [2024-11-21 03:44:27.636713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.038 [2024-11-21 03:44:27.636739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.038 qpair failed and we were unable to recover it. 00:27:47.038 [2024-11-21 03:44:27.636874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.038 [2024-11-21 03:44:27.636980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.038 [2024-11-21 03:44:27.637006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.038 qpair failed and we were unable to recover it. 00:27:47.038 [2024-11-21 03:44:27.637115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.038 [2024-11-21 03:44:27.637216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.038 [2024-11-21 03:44:27.637242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.038 qpair failed and we were unable to recover it. 00:27:47.038 [2024-11-21 03:44:27.637400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.038 [2024-11-21 03:44:27.637576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.038 [2024-11-21 03:44:27.637605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.038 qpair failed and we were unable to recover it. 00:27:47.038 [2024-11-21 03:44:27.637752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.038 [2024-11-21 03:44:27.637858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.038 [2024-11-21 03:44:27.637883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.038 qpair failed and we were unable to recover it. 00:27:47.038 [2024-11-21 03:44:27.638017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.038 [2024-11-21 03:44:27.638137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.038 [2024-11-21 03:44:27.638184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.038 qpair failed and we were unable to recover it. 00:27:47.038 [2024-11-21 03:44:27.638315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.038 [2024-11-21 03:44:27.638423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.038 [2024-11-21 03:44:27.638449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.038 qpair failed and we were unable to recover it. 00:27:47.038 [2024-11-21 03:44:27.638582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.038 [2024-11-21 03:44:27.638684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.038 [2024-11-21 03:44:27.638711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.038 qpair failed and we were unable to recover it. 00:27:47.038 [2024-11-21 03:44:27.638836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.038 [2024-11-21 03:44:27.638967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.038 [2024-11-21 03:44:27.638993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.038 qpair failed and we were unable to recover it. 00:27:47.038 [2024-11-21 03:44:27.639098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.038 [2024-11-21 03:44:27.639200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.038 [2024-11-21 03:44:27.639225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.038 qpair failed and we were unable to recover it. 00:27:47.038 [2024-11-21 03:44:27.639355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.038 [2024-11-21 03:44:27.639455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.038 [2024-11-21 03:44:27.639482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.038 qpair failed and we were unable to recover it. 00:27:47.038 [2024-11-21 03:44:27.639587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.038 [2024-11-21 03:44:27.639727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.038 [2024-11-21 03:44:27.639752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.038 qpair failed and we were unable to recover it. 00:27:47.038 [2024-11-21 03:44:27.639883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.038 [2024-11-21 03:44:27.640022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.038 [2024-11-21 03:44:27.640047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.038 qpair failed and we were unable to recover it. 00:27:47.038 [2024-11-21 03:44:27.640189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.038 [2024-11-21 03:44:27.640326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.038 [2024-11-21 03:44:27.640368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.038 qpair failed and we were unable to recover it. 00:27:47.038 [2024-11-21 03:44:27.640524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.038 [2024-11-21 03:44:27.640668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.038 [2024-11-21 03:44:27.640694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.038 qpair failed and we were unable to recover it. 00:27:47.038 [2024-11-21 03:44:27.640823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.038 [2024-11-21 03:44:27.640947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.038 [2024-11-21 03:44:27.640972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.038 qpair failed and we were unable to recover it. 00:27:47.038 [2024-11-21 03:44:27.641108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.038 [2024-11-21 03:44:27.641240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.038 [2024-11-21 03:44:27.641266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.038 qpair failed and we were unable to recover it. 00:27:47.038 [2024-11-21 03:44:27.641425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.038 [2024-11-21 03:44:27.641558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.038 [2024-11-21 03:44:27.641585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.038 qpair failed and we were unable to recover it. 00:27:47.038 [2024-11-21 03:44:27.641721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.038 [2024-11-21 03:44:27.641822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.038 [2024-11-21 03:44:27.641847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.038 qpair failed and we were unable to recover it. 00:27:47.038 [2024-11-21 03:44:27.641982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.038 [2024-11-21 03:44:27.642092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.038 [2024-11-21 03:44:27.642118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.038 qpair failed and we were unable to recover it. 00:27:47.038 [2024-11-21 03:44:27.642249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.038 [2024-11-21 03:44:27.642422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.038 [2024-11-21 03:44:27.642466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.038 qpair failed and we were unable to recover it. 00:27:47.038 [2024-11-21 03:44:27.642609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.038 [2024-11-21 03:44:27.642742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.038 [2024-11-21 03:44:27.642767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.038 qpair failed and we were unable to recover it. 00:27:47.038 [2024-11-21 03:44:27.642909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.038 [2024-11-21 03:44:27.643040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.038 [2024-11-21 03:44:27.643065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.038 qpair failed and we were unable to recover it. 00:27:47.038 [2024-11-21 03:44:27.643194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.038 [2024-11-21 03:44:27.643329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.038 [2024-11-21 03:44:27.643359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.038 qpair failed and we were unable to recover it. 00:27:47.038 [2024-11-21 03:44:27.643533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.038 [2024-11-21 03:44:27.643667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.038 [2024-11-21 03:44:27.643693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.038 qpair failed and we were unable to recover it. 00:27:47.038 [2024-11-21 03:44:27.643795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.038 [2024-11-21 03:44:27.643904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.038 [2024-11-21 03:44:27.643929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.038 qpair failed and we were unable to recover it. 00:27:47.038 [2024-11-21 03:44:27.644088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.038 [2024-11-21 03:44:27.644200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.038 [2024-11-21 03:44:27.644225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.038 qpair failed and we were unable to recover it. 00:27:47.038 [2024-11-21 03:44:27.644328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.038 [2024-11-21 03:44:27.644441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.038 [2024-11-21 03:44:27.644466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.038 qpair failed and we were unable to recover it. 00:27:47.038 [2024-11-21 03:44:27.644597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.038 [2024-11-21 03:44:27.644729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.038 [2024-11-21 03:44:27.644754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.038 qpair failed and we were unable to recover it. 00:27:47.038 [2024-11-21 03:44:27.644882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.038 [2024-11-21 03:44:27.644984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.038 [2024-11-21 03:44:27.645010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.038 qpair failed and we were unable to recover it. 00:27:47.038 [2024-11-21 03:44:27.645143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.038 [2024-11-21 03:44:27.645255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.038 [2024-11-21 03:44:27.645280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.038 qpair failed and we were unable to recover it. 00:27:47.038 [2024-11-21 03:44:27.645378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.038 [2024-11-21 03:44:27.645513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.038 [2024-11-21 03:44:27.645538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.038 qpair failed and we were unable to recover it. 00:27:47.038 [2024-11-21 03:44:27.645646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.038 [2024-11-21 03:44:27.645751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.038 [2024-11-21 03:44:27.645778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.038 qpair failed and we were unable to recover it. 00:27:47.038 [2024-11-21 03:44:27.645915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.038 [2024-11-21 03:44:27.646075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.038 [2024-11-21 03:44:27.646101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.038 qpair failed and we were unable to recover it. 00:27:47.038 [2024-11-21 03:44:27.646223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.038 [2024-11-21 03:44:27.646325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.038 [2024-11-21 03:44:27.646351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.038 qpair failed and we were unable to recover it. 00:27:47.038 [2024-11-21 03:44:27.646481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.038 [2024-11-21 03:44:27.646584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.038 [2024-11-21 03:44:27.646609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.038 qpair failed and we were unable to recover it. 00:27:47.038 [2024-11-21 03:44:27.646713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.038 [2024-11-21 03:44:27.646818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.038 [2024-11-21 03:44:27.646845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.038 qpair failed and we were unable to recover it. 00:27:47.038 [2024-11-21 03:44:27.646978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.038 [2024-11-21 03:44:27.647108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.038 [2024-11-21 03:44:27.647136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.038 qpair failed and we were unable to recover it. 00:27:47.038 [2024-11-21 03:44:27.647237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.038 [2024-11-21 03:44:27.647331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.038 [2024-11-21 03:44:27.647357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.038 qpair failed and we were unable to recover it. 00:27:47.320 [2024-11-21 03:44:27.647459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.320 [2024-11-21 03:44:27.647558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.320 [2024-11-21 03:44:27.647584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.320 qpair failed and we were unable to recover it. 00:27:47.320 [2024-11-21 03:44:27.647684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.320 [2024-11-21 03:44:27.647812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.320 [2024-11-21 03:44:27.647839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.320 qpair failed and we were unable to recover it. 00:27:47.320 [2024-11-21 03:44:27.647971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.320 [2024-11-21 03:44:27.648120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.320 [2024-11-21 03:44:27.648147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.320 qpair failed and we were unable to recover it. 00:27:47.320 [2024-11-21 03:44:27.648303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.320 [2024-11-21 03:44:27.648432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.320 [2024-11-21 03:44:27.648457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.320 qpair failed and we were unable to recover it. 00:27:47.320 [2024-11-21 03:44:27.648563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.320 [2024-11-21 03:44:27.648691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.320 [2024-11-21 03:44:27.648717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.320 qpair failed and we were unable to recover it. 00:27:47.321 [2024-11-21 03:44:27.648813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-21 03:44:27.648916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-21 03:44:27.648941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.321 qpair failed and we were unable to recover it. 00:27:47.321 [2024-11-21 03:44:27.649081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-21 03:44:27.649183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-21 03:44:27.649208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.321 qpair failed and we were unable to recover it. 00:27:47.321 [2024-11-21 03:44:27.649307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-21 03:44:27.649408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-21 03:44:27.649433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.321 qpair failed and we were unable to recover it. 00:27:47.321 [2024-11-21 03:44:27.649595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-21 03:44:27.649754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-21 03:44:27.649779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.321 qpair failed and we were unable to recover it. 00:27:47.321 [2024-11-21 03:44:27.649906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-21 03:44:27.650032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-21 03:44:27.650058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.321 qpair failed and we were unable to recover it. 00:27:47.321 [2024-11-21 03:44:27.650167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-21 03:44:27.650269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-21 03:44:27.650295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.321 qpair failed and we were unable to recover it. 00:27:47.321 [2024-11-21 03:44:27.650424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-21 03:44:27.650557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-21 03:44:27.650583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.321 qpair failed and we were unable to recover it. 00:27:47.321 [2024-11-21 03:44:27.650683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-21 03:44:27.650789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-21 03:44:27.650814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.321 qpair failed and we were unable to recover it. 00:27:47.321 [2024-11-21 03:44:27.650913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-21 03:44:27.651039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-21 03:44:27.651091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.321 qpair failed and we were unable to recover it. 00:27:47.321 [2024-11-21 03:44:27.651239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-21 03:44:27.651340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-21 03:44:27.651365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.321 qpair failed and we were unable to recover it. 00:27:47.321 [2024-11-21 03:44:27.651496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-21 03:44:27.651619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-21 03:44:27.651644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.321 qpair failed and we were unable to recover it. 00:27:47.321 [2024-11-21 03:44:27.651751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-21 03:44:27.651906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-21 03:44:27.651932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.321 qpair failed and we were unable to recover it. 00:27:47.321 [2024-11-21 03:44:27.652029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-21 03:44:27.652140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-21 03:44:27.652167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.321 qpair failed and we were unable to recover it. 00:27:47.321 [2024-11-21 03:44:27.652293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-21 03:44:27.652423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-21 03:44:27.652449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.321 qpair failed and we were unable to recover it. 00:27:47.321 [2024-11-21 03:44:27.652583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-21 03:44:27.652711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-21 03:44:27.652736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.321 qpair failed and we were unable to recover it. 00:27:47.321 [2024-11-21 03:44:27.652833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-21 03:44:27.652956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-21 03:44:27.652981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.321 qpair failed and we were unable to recover it. 00:27:47.321 [2024-11-21 03:44:27.653109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-21 03:44:27.653217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-21 03:44:27.653244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.321 qpair failed and we were unable to recover it. 00:27:47.321 [2024-11-21 03:44:27.653413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-21 03:44:27.653508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-21 03:44:27.653533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.321 qpair failed and we were unable to recover it. 00:27:47.321 [2024-11-21 03:44:27.653644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-21 03:44:27.653803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-21 03:44:27.653833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.321 qpair failed and we were unable to recover it. 00:27:47.321 [2024-11-21 03:44:27.653935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-21 03:44:27.654039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-21 03:44:27.654064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.321 qpair failed and we were unable to recover it. 00:27:47.321 [2024-11-21 03:44:27.654174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-21 03:44:27.654296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-21 03:44:27.654322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.321 qpair failed and we were unable to recover it. 00:27:47.321 [2024-11-21 03:44:27.654421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-21 03:44:27.654543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-21 03:44:27.654569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.321 qpair failed and we were unable to recover it. 00:27:47.321 [2024-11-21 03:44:27.654725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-21 03:44:27.654821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-21 03:44:27.654847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.321 qpair failed and we were unable to recover it. 00:27:47.321 [2024-11-21 03:44:27.654962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.321 [2024-11-21 03:44:27.655074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-21 03:44:27.655100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.322 qpair failed and we were unable to recover it. 00:27:47.322 [2024-11-21 03:44:27.655200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-21 03:44:27.655305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-21 03:44:27.655332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.322 qpair failed and we were unable to recover it. 00:27:47.322 [2024-11-21 03:44:27.655465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-21 03:44:27.655597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-21 03:44:27.655622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.322 qpair failed and we were unable to recover it. 00:27:47.322 [2024-11-21 03:44:27.655739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-21 03:44:27.655872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-21 03:44:27.655897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.322 qpair failed and we were unable to recover it. 00:27:47.322 [2024-11-21 03:44:27.655995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-21 03:44:27.656126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-21 03:44:27.656153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.322 qpair failed and we were unable to recover it. 00:27:47.322 [2024-11-21 03:44:27.656310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-21 03:44:27.656443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-21 03:44:27.656475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.322 qpair failed and we were unable to recover it. 00:27:47.322 [2024-11-21 03:44:27.656611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-21 03:44:27.656738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-21 03:44:27.656763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.322 qpair failed and we were unable to recover it. 00:27:47.322 [2024-11-21 03:44:27.656905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-21 03:44:27.657062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-21 03:44:27.657096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.322 qpair failed and we were unable to recover it. 00:27:47.322 [2024-11-21 03:44:27.657208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-21 03:44:27.657343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-21 03:44:27.657369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.322 qpair failed and we were unable to recover it. 00:27:47.322 [2024-11-21 03:44:27.657497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-21 03:44:27.657653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-21 03:44:27.657679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.322 qpair failed and we were unable to recover it. 00:27:47.322 [2024-11-21 03:44:27.657812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-21 03:44:27.657937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-21 03:44:27.657963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.322 qpair failed and we were unable to recover it. 00:27:47.322 [2024-11-21 03:44:27.658099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-21 03:44:27.658207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-21 03:44:27.658233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.322 qpair failed and we were unable to recover it. 00:27:47.322 [2024-11-21 03:44:27.658332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-21 03:44:27.658460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-21 03:44:27.658486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.322 qpair failed and we were unable to recover it. 00:27:47.322 [2024-11-21 03:44:27.658624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-21 03:44:27.658727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-21 03:44:27.658753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.322 qpair failed and we were unable to recover it. 00:27:47.322 [2024-11-21 03:44:27.658918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-21 03:44:27.659048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-21 03:44:27.659080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.322 qpair failed and we were unable to recover it. 00:27:47.322 [2024-11-21 03:44:27.659182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-21 03:44:27.659285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-21 03:44:27.659316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.322 qpair failed and we were unable to recover it. 00:27:47.322 [2024-11-21 03:44:27.659422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-21 03:44:27.659552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-21 03:44:27.659579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.322 qpair failed and we were unable to recover it. 00:27:47.322 [2024-11-21 03:44:27.659715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-21 03:44:27.659842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-21 03:44:27.659868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.322 qpair failed and we were unable to recover it. 00:27:47.322 [2024-11-21 03:44:27.659987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-21 03:44:27.660144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-21 03:44:27.660169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.322 qpair failed and we were unable to recover it. 00:27:47.322 [2024-11-21 03:44:27.660302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-21 03:44:27.660407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-21 03:44:27.660434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.322 qpair failed and we were unable to recover it. 00:27:47.322 [2024-11-21 03:44:27.660557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-21 03:44:27.660685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-21 03:44:27.660711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.322 qpair failed and we were unable to recover it. 00:27:47.322 [2024-11-21 03:44:27.660839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-21 03:44:27.660943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-21 03:44:27.660969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.322 qpair failed and we were unable to recover it. 00:27:47.322 [2024-11-21 03:44:27.661080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-21 03:44:27.661185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.322 [2024-11-21 03:44:27.661211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.323 qpair failed and we were unable to recover it. 00:27:47.323 [2024-11-21 03:44:27.661321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-21 03:44:27.661445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-21 03:44:27.661471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.323 qpair failed and we were unable to recover it. 00:27:47.323 [2024-11-21 03:44:27.661598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-21 03:44:27.661703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-21 03:44:27.661729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.323 qpair failed and we were unable to recover it. 00:27:47.323 [2024-11-21 03:44:27.661833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-21 03:44:27.661962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-21 03:44:27.661987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.323 qpair failed and we were unable to recover it. 00:27:47.323 [2024-11-21 03:44:27.662152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-21 03:44:27.662257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-21 03:44:27.662283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.323 qpair failed and we were unable to recover it. 00:27:47.323 [2024-11-21 03:44:27.662390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-21 03:44:27.662517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-21 03:44:27.662542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.323 qpair failed and we were unable to recover it. 00:27:47.323 [2024-11-21 03:44:27.662647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-21 03:44:27.662748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-21 03:44:27.662775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.323 qpair failed and we were unable to recover it. 00:27:47.323 [2024-11-21 03:44:27.662906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-21 03:44:27.663007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-21 03:44:27.663033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.323 qpair failed and we were unable to recover it. 00:27:47.323 [2024-11-21 03:44:27.663195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-21 03:44:27.663326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-21 03:44:27.663352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.323 qpair failed and we were unable to recover it. 00:27:47.323 [2024-11-21 03:44:27.663463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-21 03:44:27.663566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-21 03:44:27.663591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.323 qpair failed and we were unable to recover it. 00:27:47.323 [2024-11-21 03:44:27.663720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-21 03:44:27.663848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-21 03:44:27.663875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.323 qpair failed and we were unable to recover it. 00:27:47.323 [2024-11-21 03:44:27.663975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-21 03:44:27.664097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-21 03:44:27.664123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.323 qpair failed and we were unable to recover it. 00:27:47.323 [2024-11-21 03:44:27.664256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-21 03:44:27.664373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-21 03:44:27.664399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.323 qpair failed and we were unable to recover it. 00:27:47.323 [2024-11-21 03:44:27.664534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-21 03:44:27.664641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-21 03:44:27.664668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.323 qpair failed and we were unable to recover it. 00:27:47.323 [2024-11-21 03:44:27.664804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-21 03:44:27.664931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-21 03:44:27.664957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.323 qpair failed and we were unable to recover it. 00:27:47.323 [2024-11-21 03:44:27.665054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-21 03:44:27.665192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-21 03:44:27.665219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.323 qpair failed and we were unable to recover it. 00:27:47.323 [2024-11-21 03:44:27.665347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-21 03:44:27.665504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-21 03:44:27.665529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.323 qpair failed and we were unable to recover it. 00:27:47.323 [2024-11-21 03:44:27.665661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-21 03:44:27.665759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-21 03:44:27.665784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.323 qpair failed and we were unable to recover it. 00:27:47.323 [2024-11-21 03:44:27.665880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-21 03:44:27.666007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-21 03:44:27.666034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.323 qpair failed and we were unable to recover it. 00:27:47.323 [2024-11-21 03:44:27.666165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-21 03:44:27.666273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-21 03:44:27.666300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.323 qpair failed and we were unable to recover it. 00:27:47.323 [2024-11-21 03:44:27.666473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-21 03:44:27.666598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-21 03:44:27.666623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.323 qpair failed and we were unable to recover it. 00:27:47.323 [2024-11-21 03:44:27.666734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-21 03:44:27.666867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-21 03:44:27.666892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.323 qpair failed and we were unable to recover it. 00:27:47.323 [2024-11-21 03:44:27.666993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-21 03:44:27.667125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-21 03:44:27.667152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.323 qpair failed and we were unable to recover it. 00:27:47.323 [2024-11-21 03:44:27.667318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-21 03:44:27.667449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-21 03:44:27.667475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.323 qpair failed and we were unable to recover it. 00:27:47.323 [2024-11-21 03:44:27.667585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-21 03:44:27.667708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.323 [2024-11-21 03:44:27.667734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.323 qpair failed and we were unable to recover it. 00:27:47.324 [2024-11-21 03:44:27.667857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-21 03:44:27.667964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-21 03:44:27.667989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.324 qpair failed and we were unable to recover it. 00:27:47.324 [2024-11-21 03:44:27.668147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-21 03:44:27.668277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-21 03:44:27.668302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.324 qpair failed and we were unable to recover it. 00:27:47.324 [2024-11-21 03:44:27.668404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-21 03:44:27.668538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-21 03:44:27.668564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.324 qpair failed and we were unable to recover it. 00:27:47.324 [2024-11-21 03:44:27.668676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-21 03:44:27.668787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-21 03:44:27.668813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.324 qpair failed and we were unable to recover it. 00:27:47.324 [2024-11-21 03:44:27.668942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-21 03:44:27.669066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-21 03:44:27.669097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.324 qpair failed and we were unable to recover it. 00:27:47.324 [2024-11-21 03:44:27.669226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-21 03:44:27.669357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-21 03:44:27.669384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.324 qpair failed and we were unable to recover it. 00:27:47.324 [2024-11-21 03:44:27.669480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-21 03:44:27.669632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-21 03:44:27.669658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.324 qpair failed and we were unable to recover it. 00:27:47.324 [2024-11-21 03:44:27.669819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-21 03:44:27.669974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-21 03:44:27.670000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.324 qpair failed and we were unable to recover it. 00:27:47.324 [2024-11-21 03:44:27.670140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-21 03:44:27.670285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-21 03:44:27.670311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.324 qpair failed and we were unable to recover it. 00:27:47.324 [2024-11-21 03:44:27.670445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-21 03:44:27.670610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-21 03:44:27.670635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.324 qpair failed and we were unable to recover it. 00:27:47.324 [2024-11-21 03:44:27.670743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-21 03:44:27.670832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-21 03:44:27.670857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.324 qpair failed and we were unable to recover it. 00:27:47.324 [2024-11-21 03:44:27.670991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-21 03:44:27.671100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-21 03:44:27.671128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.324 qpair failed and we were unable to recover it. 00:27:47.324 [2024-11-21 03:44:27.671264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-21 03:44:27.671397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-21 03:44:27.671425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.324 qpair failed and we were unable to recover it. 00:27:47.324 [2024-11-21 03:44:27.671562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-21 03:44:27.671721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-21 03:44:27.671747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.324 qpair failed and we were unable to recover it. 00:27:47.324 [2024-11-21 03:44:27.671854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-21 03:44:27.671997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-21 03:44:27.672023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.324 qpair failed and we were unable to recover it. 00:27:47.324 [2024-11-21 03:44:27.672165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-21 03:44:27.672296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-21 03:44:27.672321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.324 qpair failed and we were unable to recover it. 00:27:47.324 [2024-11-21 03:44:27.672458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-21 03:44:27.672566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-21 03:44:27.672591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.324 qpair failed and we were unable to recover it. 00:27:47.324 [2024-11-21 03:44:27.672720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-21 03:44:27.672878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-21 03:44:27.672903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.324 qpair failed and we were unable to recover it. 00:27:47.324 [2024-11-21 03:44:27.673061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-21 03:44:27.673187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-21 03:44:27.673213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.324 qpair failed and we were unable to recover it. 00:27:47.324 [2024-11-21 03:44:27.673329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-21 03:44:27.673460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-21 03:44:27.673485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.324 qpair failed and we were unable to recover it. 00:27:47.324 [2024-11-21 03:44:27.673643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-21 03:44:27.673747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-21 03:44:27.673773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.324 qpair failed and we were unable to recover it. 00:27:47.324 [2024-11-21 03:44:27.673907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-21 03:44:27.674041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-21 03:44:27.674066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.324 qpair failed and we were unable to recover it. 00:27:47.324 [2024-11-21 03:44:27.674227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.324 [2024-11-21 03:44:27.674352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.325 [2024-11-21 03:44:27.674378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.325 qpair failed and we were unable to recover it. 00:27:47.325 [2024-11-21 03:44:27.674481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.325 [2024-11-21 03:44:27.674625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.325 [2024-11-21 03:44:27.674651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.325 qpair failed and we were unable to recover it. 00:27:47.325 [2024-11-21 03:44:27.674778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.325 [2024-11-21 03:44:27.674909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.325 [2024-11-21 03:44:27.674935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.325 qpair failed and we were unable to recover it. 00:27:47.325 [2024-11-21 03:44:27.675040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.325 [2024-11-21 03:44:27.675192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.325 [2024-11-21 03:44:27.675219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.325 qpair failed and we were unable to recover it. 00:27:47.325 [2024-11-21 03:44:27.675377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.325 [2024-11-21 03:44:27.675519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.325 [2024-11-21 03:44:27.675544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.325 qpair failed and we were unable to recover it. 00:27:47.325 [2024-11-21 03:44:27.675679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.325 [2024-11-21 03:44:27.675818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.325 [2024-11-21 03:44:27.675844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.325 qpair failed and we were unable to recover it. 00:27:47.325 [2024-11-21 03:44:27.675950] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:47.325 [2024-11-21 03:44:27.675978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.325 [2024-11-21 03:44:27.676011] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:47.325 [2024-11-21 03:44:27.676129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.325 [2024-11-21 03:44:27.676154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.325 qpair failed and we were unable to recover it. 00:27:47.325 [2024-11-21 03:44:27.676262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.325 [2024-11-21 03:44:27.676390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.325 [2024-11-21 03:44:27.676414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.325 qpair failed and we were unable to recover it. 00:27:47.325 [2024-11-21 03:44:27.676519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.325 [2024-11-21 03:44:27.676648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.325 [2024-11-21 03:44:27.676675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.325 qpair failed and we were unable to recover it. 00:27:47.325 [2024-11-21 03:44:27.676812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.325 [2024-11-21 03:44:27.676953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.325 [2024-11-21 03:44:27.676979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.325 qpair failed and we were unable to recover it. 00:27:47.325 [2024-11-21 03:44:27.677086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.325 [2024-11-21 03:44:27.677186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.325 [2024-11-21 03:44:27.677213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.325 qpair failed and we were unable to recover it. 00:27:47.325 [2024-11-21 03:44:27.677351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.325 [2024-11-21 03:44:27.677482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.325 [2024-11-21 03:44:27.677509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.325 qpair failed and we were unable to recover it. 00:27:47.325 [2024-11-21 03:44:27.677617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.325 [2024-11-21 03:44:27.677742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.325 [2024-11-21 03:44:27.677768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.325 qpair failed and we were unable to recover it. 00:27:47.325 [2024-11-21 03:44:27.677869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.325 [2024-11-21 03:44:27.677975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.325 [2024-11-21 03:44:27.678000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.325 qpair failed and we were unable to recover it. 00:27:47.325 [2024-11-21 03:44:27.678129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.325 [2024-11-21 03:44:27.678264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.325 [2024-11-21 03:44:27.678289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.325 qpair failed and we were unable to recover it. 00:27:47.325 [2024-11-21 03:44:27.678425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.325 [2024-11-21 03:44:27.678556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.325 [2024-11-21 03:44:27.678581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.325 qpair failed and we were unable to recover it. 00:27:47.325 [2024-11-21 03:44:27.678707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.325 [2024-11-21 03:44:27.678840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.325 [2024-11-21 03:44:27.678866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.325 qpair failed and we were unable to recover it. 00:27:47.325 [2024-11-21 03:44:27.678970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.325 [2024-11-21 03:44:27.679079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.325 [2024-11-21 03:44:27.679105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.325 qpair failed and we were unable to recover it. 00:27:47.325 [2024-11-21 03:44:27.679211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.325 [2024-11-21 03:44:27.679335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.325 [2024-11-21 03:44:27.679361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.325 qpair failed and we were unable to recover it. 00:27:47.325 [2024-11-21 03:44:27.679456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.325 [2024-11-21 03:44:27.679583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.325 [2024-11-21 03:44:27.679609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.325 qpair failed and we were unable to recover it. 00:27:47.325 [2024-11-21 03:44:27.679733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.325 [2024-11-21 03:44:27.679829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.325 [2024-11-21 03:44:27.679855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.325 qpair failed and we were unable to recover it. 00:27:47.325 [2024-11-21 03:44:27.679982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.325 [2024-11-21 03:44:27.680102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.326 [2024-11-21 03:44:27.680129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.326 qpair failed and we were unable to recover it. 00:27:47.326 [2024-11-21 03:44:27.680257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.326 [2024-11-21 03:44:27.680354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.326 [2024-11-21 03:44:27.680381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.326 qpair failed and we were unable to recover it. 00:27:47.326 [2024-11-21 03:44:27.680485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.326 [2024-11-21 03:44:27.680612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.326 [2024-11-21 03:44:27.680637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.326 qpair failed and we were unable to recover it. 00:27:47.326 [2024-11-21 03:44:27.680734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.326 [2024-11-21 03:44:27.680864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.326 [2024-11-21 03:44:27.680889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.326 qpair failed and we were unable to recover it. 00:27:47.326 [2024-11-21 03:44:27.680993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.326 [2024-11-21 03:44:27.681126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.326 [2024-11-21 03:44:27.681153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.326 qpair failed and we were unable to recover it. 00:27:47.326 [2024-11-21 03:44:27.681362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.326 [2024-11-21 03:44:27.681521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.326 [2024-11-21 03:44:27.681548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.326 qpair failed and we were unable to recover it. 00:27:47.326 [2024-11-21 03:44:27.681703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.326 [2024-11-21 03:44:27.681829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.326 [2024-11-21 03:44:27.681856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.326 qpair failed and we were unable to recover it. 00:27:47.326 [2024-11-21 03:44:27.682037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.326 [2024-11-21 03:44:27.682168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.326 [2024-11-21 03:44:27.682194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.326 qpair failed and we were unable to recover it. 00:27:47.326 [2024-11-21 03:44:27.682326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.326 [2024-11-21 03:44:27.682453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.326 [2024-11-21 03:44:27.682479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.326 qpair failed and we were unable to recover it. 00:27:47.326 [2024-11-21 03:44:27.682590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.326 [2024-11-21 03:44:27.682713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.326 [2024-11-21 03:44:27.682738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.326 qpair failed and we were unable to recover it. 00:27:47.326 [2024-11-21 03:44:27.682845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.326 [2024-11-21 03:44:27.682943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.326 [2024-11-21 03:44:27.682968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.326 qpair failed and we were unable to recover it. 00:27:47.326 [2024-11-21 03:44:27.683101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.326 [2024-11-21 03:44:27.683205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.326 [2024-11-21 03:44:27.683230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.326 qpair failed and we were unable to recover it. 00:27:47.326 [2024-11-21 03:44:27.683334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.326 [2024-11-21 03:44:27.683431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.326 [2024-11-21 03:44:27.683457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.326 qpair failed and we were unable to recover it. 00:27:47.326 [2024-11-21 03:44:27.683580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.326 [2024-11-21 03:44:27.683669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.326 [2024-11-21 03:44:27.683694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.326 qpair failed and we were unable to recover it. 00:27:47.326 [2024-11-21 03:44:27.683795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.326 [2024-11-21 03:44:27.683927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.326 [2024-11-21 03:44:27.683953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.326 qpair failed and we were unable to recover it. 00:27:47.326 [2024-11-21 03:44:27.684084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.326 [2024-11-21 03:44:27.684245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.326 [2024-11-21 03:44:27.684271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.326 qpair failed and we were unable to recover it. 00:27:47.326 [2024-11-21 03:44:27.684374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.326 [2024-11-21 03:44:27.684468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.326 [2024-11-21 03:44:27.684493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.326 qpair failed and we were unable to recover it. 00:27:47.327 [2024-11-21 03:44:27.684648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-21 03:44:27.684787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-21 03:44:27.684812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.327 qpair failed and we were unable to recover it. 00:27:47.327 [2024-11-21 03:44:27.684942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-21 03:44:27.685052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-21 03:44:27.685082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.327 qpair failed and we were unable to recover it. 00:27:47.327 [2024-11-21 03:44:27.685261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-21 03:44:27.685364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-21 03:44:27.685390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.327 qpair failed and we were unable to recover it. 00:27:47.327 [2024-11-21 03:44:27.685498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-21 03:44:27.685650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-21 03:44:27.685675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.327 qpair failed and we were unable to recover it. 00:27:47.327 [2024-11-21 03:44:27.685832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-21 03:44:27.685960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-21 03:44:27.685986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.327 qpair failed and we were unable to recover it. 00:27:47.327 [2024-11-21 03:44:27.686118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-21 03:44:27.686242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-21 03:44:27.686268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.327 qpair failed and we were unable to recover it. 00:27:47.327 [2024-11-21 03:44:27.686401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-21 03:44:27.686532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-21 03:44:27.686557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.327 qpair failed and we were unable to recover it. 00:27:47.327 [2024-11-21 03:44:27.686692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-21 03:44:27.686786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-21 03:44:27.686811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.327 qpair failed and we were unable to recover it. 00:27:47.327 [2024-11-21 03:44:27.686920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-21 03:44:27.687050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-21 03:44:27.687087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.327 qpair failed and we were unable to recover it. 00:27:47.327 [2024-11-21 03:44:27.687190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-21 03:44:27.687343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-21 03:44:27.687368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.327 qpair failed and we were unable to recover it. 00:27:47.327 [2024-11-21 03:44:27.687465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-21 03:44:27.687607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-21 03:44:27.687633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.327 qpair failed and we were unable to recover it. 00:27:47.327 [2024-11-21 03:44:27.687742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-21 03:44:27.687843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-21 03:44:27.687870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.327 qpair failed and we were unable to recover it. 00:27:47.327 [2024-11-21 03:44:27.688031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-21 03:44:27.688167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-21 03:44:27.688193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.327 qpair failed and we were unable to recover it. 00:27:47.327 [2024-11-21 03:44:27.688327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-21 03:44:27.688456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-21 03:44:27.688483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.327 qpair failed and we were unable to recover it. 00:27:47.327 [2024-11-21 03:44:27.688625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-21 03:44:27.688784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-21 03:44:27.688810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.327 qpair failed and we were unable to recover it. 00:27:47.327 [2024-11-21 03:44:27.688972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-21 03:44:27.689128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-21 03:44:27.689154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.327 qpair failed and we were unable to recover it. 00:27:47.327 [2024-11-21 03:44:27.689314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-21 03:44:27.689423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-21 03:44:27.689448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.327 qpair failed and we were unable to recover it. 00:27:47.327 [2024-11-21 03:44:27.689552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-21 03:44:27.689683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-21 03:44:27.689709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.327 qpair failed and we were unable to recover it. 00:27:47.327 [2024-11-21 03:44:27.689813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-21 03:44:27.689947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-21 03:44:27.689976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.327 qpair failed and we were unable to recover it. 00:27:47.327 [2024-11-21 03:44:27.690129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-21 03:44:27.690231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-21 03:44:27.690257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.327 qpair failed and we were unable to recover it. 00:27:47.327 [2024-11-21 03:44:27.690383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-21 03:44:27.690521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-21 03:44:27.690547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.327 qpair failed and we were unable to recover it. 00:27:47.327 [2024-11-21 03:44:27.690672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-21 03:44:27.690777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-21 03:44:27.690803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.327 qpair failed and we were unable to recover it. 00:27:47.327 [2024-11-21 03:44:27.690934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.327 [2024-11-21 03:44:27.691062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-21 03:44:27.691112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.328 qpair failed and we were unable to recover it. 00:27:47.328 [2024-11-21 03:44:27.691262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-21 03:44:27.691390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-21 03:44:27.691416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.328 qpair failed and we were unable to recover it. 00:27:47.328 [2024-11-21 03:44:27.691574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-21 03:44:27.691701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-21 03:44:27.691726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.328 qpair failed and we were unable to recover it. 00:27:47.328 [2024-11-21 03:44:27.691824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-21 03:44:27.691958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-21 03:44:27.691983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.328 qpair failed and we were unable to recover it. 00:27:47.328 [2024-11-21 03:44:27.692107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-21 03:44:27.692205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-21 03:44:27.692231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.328 qpair failed and we were unable to recover it. 00:27:47.328 [2024-11-21 03:44:27.692362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-21 03:44:27.692482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-21 03:44:27.692507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.328 qpair failed and we were unable to recover it. 00:27:47.328 [2024-11-21 03:44:27.692636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-21 03:44:27.692767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-21 03:44:27.692797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.328 qpair failed and we were unable to recover it. 00:27:47.328 [2024-11-21 03:44:27.692953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-21 03:44:27.693085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-21 03:44:27.693111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.328 qpair failed and we were unable to recover it. 00:27:47.328 [2024-11-21 03:44:27.693235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-21 03:44:27.693378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-21 03:44:27.693403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.328 qpair failed and we were unable to recover it. 00:27:47.328 [2024-11-21 03:44:27.693535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-21 03:44:27.693661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-21 03:44:27.693687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.328 qpair failed and we were unable to recover it. 00:27:47.328 [2024-11-21 03:44:27.693791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-21 03:44:27.693916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-21 03:44:27.693942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.328 qpair failed and we were unable to recover it. 00:27:47.328 [2024-11-21 03:44:27.694075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-21 03:44:27.694205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-21 03:44:27.694231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.328 qpair failed and we were unable to recover it. 00:27:47.328 [2024-11-21 03:44:27.694331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-21 03:44:27.694458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-21 03:44:27.694483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.328 qpair failed and we were unable to recover it. 00:27:47.328 [2024-11-21 03:44:27.694643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-21 03:44:27.694799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-21 03:44:27.694824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.328 qpair failed and we were unable to recover it. 00:27:47.328 [2024-11-21 03:44:27.694954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-21 03:44:27.695079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-21 03:44:27.695105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.328 qpair failed and we were unable to recover it. 00:27:47.328 [2024-11-21 03:44:27.695217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-21 03:44:27.695322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-21 03:44:27.695349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.328 qpair failed and we were unable to recover it. 00:27:47.328 [2024-11-21 03:44:27.695457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-21 03:44:27.695588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-21 03:44:27.695618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.328 qpair failed and we were unable to recover it. 00:27:47.328 [2024-11-21 03:44:27.695748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-21 03:44:27.695890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-21 03:44:27.695915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.328 qpair failed and we were unable to recover it. 00:27:47.328 [2024-11-21 03:44:27.696016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-21 03:44:27.696127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-21 03:44:27.696154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.328 qpair failed and we were unable to recover it. 00:27:47.328 [2024-11-21 03:44:27.696286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-21 03:44:27.696395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-21 03:44:27.696420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.328 qpair failed and we were unable to recover it. 00:27:47.328 [2024-11-21 03:44:27.696551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-21 03:44:27.696653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-21 03:44:27.696679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.328 qpair failed and we were unable to recover it. 00:27:47.328 [2024-11-21 03:44:27.696789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-21 03:44:27.696917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-21 03:44:27.696942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.328 qpair failed and we were unable to recover it. 00:27:47.328 [2024-11-21 03:44:27.697045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-21 03:44:27.697207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-21 03:44:27.697233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.328 qpair failed and we were unable to recover it. 00:27:47.328 [2024-11-21 03:44:27.697390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.328 [2024-11-21 03:44:27.697493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-21 03:44:27.697518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.329 qpair failed and we were unable to recover it. 00:27:47.329 [2024-11-21 03:44:27.697614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-21 03:44:27.697741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-21 03:44:27.697766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.329 qpair failed and we were unable to recover it. 00:27:47.329 [2024-11-21 03:44:27.697932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-21 03:44:27.698060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-21 03:44:27.698093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.329 qpair failed and we were unable to recover it. 00:27:47.329 [2024-11-21 03:44:27.698234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-21 03:44:27.698373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-21 03:44:27.698398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.329 qpair failed and we were unable to recover it. 00:27:47.329 [2024-11-21 03:44:27.698531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-21 03:44:27.698637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-21 03:44:27.698663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.329 qpair failed and we were unable to recover it. 00:27:47.329 [2024-11-21 03:44:27.698793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-21 03:44:27.698890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-21 03:44:27.698916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.329 qpair failed and we were unable to recover it. 00:27:47.329 [2024-11-21 03:44:27.699081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-21 03:44:27.699210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-21 03:44:27.699236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.329 qpair failed and we were unable to recover it. 00:27:47.329 [2024-11-21 03:44:27.699373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-21 03:44:27.699504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-21 03:44:27.699530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.329 qpair failed and we were unable to recover it. 00:27:47.329 [2024-11-21 03:44:27.699636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-21 03:44:27.699792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-21 03:44:27.699817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.329 qpair failed and we were unable to recover it. 00:27:47.329 [2024-11-21 03:44:27.699976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-21 03:44:27.700103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-21 03:44:27.700129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.329 qpair failed and we were unable to recover it. 00:27:47.329 [2024-11-21 03:44:27.700228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-21 03:44:27.700351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-21 03:44:27.700376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.329 qpair failed and we were unable to recover it. 00:27:47.329 [2024-11-21 03:44:27.700512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-21 03:44:27.700664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-21 03:44:27.700688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.329 qpair failed and we were unable to recover it. 00:27:47.329 [2024-11-21 03:44:27.700801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-21 03:44:27.700955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-21 03:44:27.700980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.329 qpair failed and we were unable to recover it. 00:27:47.329 [2024-11-21 03:44:27.701108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-21 03:44:27.701241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-21 03:44:27.701267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.329 qpair failed and we were unable to recover it. 00:27:47.329 [2024-11-21 03:44:27.701419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-21 03:44:27.701554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-21 03:44:27.701581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.329 qpair failed and we were unable to recover it. 00:27:47.329 [2024-11-21 03:44:27.701720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-21 03:44:27.701875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-21 03:44:27.701901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.329 qpair failed and we were unable to recover it. 00:27:47.329 [2024-11-21 03:44:27.702060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-21 03:44:27.702166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-21 03:44:27.702192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.329 qpair failed and we were unable to recover it. 00:27:47.329 [2024-11-21 03:44:27.702295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-21 03:44:27.702452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-21 03:44:27.702478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.329 qpair failed and we were unable to recover it. 00:27:47.329 [2024-11-21 03:44:27.702587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-21 03:44:27.702689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-21 03:44:27.702715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.329 qpair failed and we were unable to recover it. 00:27:47.329 [2024-11-21 03:44:27.702874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-21 03:44:27.702979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-21 03:44:27.703006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.329 qpair failed and we were unable to recover it. 00:27:47.329 [2024-11-21 03:44:27.703141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-21 03:44:27.703268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-21 03:44:27.703294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.329 qpair failed and we were unable to recover it. 00:27:47.329 [2024-11-21 03:44:27.703431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-21 03:44:27.703561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-21 03:44:27.703586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.329 qpair failed and we were unable to recover it. 00:27:47.329 [2024-11-21 03:44:27.703691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-21 03:44:27.703818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.329 [2024-11-21 03:44:27.703843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.329 qpair failed and we were unable to recover it. 00:27:47.330 [2024-11-21 03:44:27.703975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.330 [2024-11-21 03:44:27.704106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.330 [2024-11-21 03:44:27.704132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.330 qpair failed and we were unable to recover it. 00:27:47.330 [2024-11-21 03:44:27.704239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.330 [2024-11-21 03:44:27.704370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.330 [2024-11-21 03:44:27.704396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.330 qpair failed and we were unable to recover it. 00:27:47.330 [2024-11-21 03:44:27.704525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.330 [2024-11-21 03:44:27.704622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.330 [2024-11-21 03:44:27.704647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.330 qpair failed and we were unable to recover it. 00:27:47.330 [2024-11-21 03:44:27.704781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.330 [2024-11-21 03:44:27.704909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.330 [2024-11-21 03:44:27.704934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.330 qpair failed and we were unable to recover it. 00:27:47.330 [2024-11-21 03:44:27.705092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.330 [2024-11-21 03:44:27.705220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.330 [2024-11-21 03:44:27.705246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.330 qpair failed and we were unable to recover it. 00:27:47.330 [2024-11-21 03:44:27.705385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.330 [2024-11-21 03:44:27.705513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.330 [2024-11-21 03:44:27.705538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.330 qpair failed and we were unable to recover it. 00:27:47.330 [2024-11-21 03:44:27.705673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.330 [2024-11-21 03:44:27.705802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.330 [2024-11-21 03:44:27.705827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.330 qpair failed and we were unable to recover it. 00:27:47.330 [2024-11-21 03:44:27.705993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.330 [2024-11-21 03:44:27.706158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.330 [2024-11-21 03:44:27.706184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.330 qpair failed and we were unable to recover it. 00:27:47.330 [2024-11-21 03:44:27.706294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.330 [2024-11-21 03:44:27.706437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.330 [2024-11-21 03:44:27.706462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.330 qpair failed and we were unable to recover it. 00:27:47.330 [2024-11-21 03:44:27.706596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.330 [2024-11-21 03:44:27.706747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.330 [2024-11-21 03:44:27.706773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.330 qpair failed and we were unable to recover it. 00:27:47.330 [2024-11-21 03:44:27.706902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.330 [2024-11-21 03:44:27.707034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.330 [2024-11-21 03:44:27.707059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.330 qpair failed and we were unable to recover it. 00:27:47.330 [2024-11-21 03:44:27.707170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.330 [2024-11-21 03:44:27.707297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.330 [2024-11-21 03:44:27.707324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.330 qpair failed and we were unable to recover it. 00:27:47.330 [2024-11-21 03:44:27.707465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.330 [2024-11-21 03:44:27.707562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.330 [2024-11-21 03:44:27.707587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.330 qpair failed and we were unable to recover it. 00:27:47.330 [2024-11-21 03:44:27.707691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.330 [2024-11-21 03:44:27.707820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.330 [2024-11-21 03:44:27.707845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.330 qpair failed and we were unable to recover it. 00:27:47.330 [2024-11-21 03:44:27.707972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.330 [2024-11-21 03:44:27.708102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.330 [2024-11-21 03:44:27.708129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.330 qpair failed and we were unable to recover it. 00:27:47.330 [2024-11-21 03:44:27.708231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.330 [2024-11-21 03:44:27.708331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.330 [2024-11-21 03:44:27.708358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.330 qpair failed and we were unable to recover it. 00:27:47.330 [2024-11-21 03:44:27.708491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.330 [2024-11-21 03:44:27.708604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.330 [2024-11-21 03:44:27.708629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.330 qpair failed and we were unable to recover it. 00:27:47.330 [2024-11-21 03:44:27.708758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.330 [2024-11-21 03:44:27.708887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.330 [2024-11-21 03:44:27.708914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.330 qpair failed and we were unable to recover it. 00:27:47.330 [2024-11-21 03:44:27.709014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.330 [2024-11-21 03:44:27.709148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.330 [2024-11-21 03:44:27.709174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.330 qpair failed and we were unable to recover it. 00:27:47.330 [2024-11-21 03:44:27.709330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.330 [2024-11-21 03:44:27.709488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.330 [2024-11-21 03:44:27.709513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.330 qpair failed and we were unable to recover it. 00:27:47.330 [2024-11-21 03:44:27.709605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.330 [2024-11-21 03:44:27.709760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.330 [2024-11-21 03:44:27.709785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.330 qpair failed and we were unable to recover it. 00:27:47.330 [2024-11-21 03:44:27.709944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.330 [2024-11-21 03:44:27.710081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.330 [2024-11-21 03:44:27.710108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.331 qpair failed and we were unable to recover it. 00:27:47.331 [2024-11-21 03:44:27.710241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-21 03:44:27.710334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-21 03:44:27.710359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.331 qpair failed and we were unable to recover it. 00:27:47.331 [2024-11-21 03:44:27.710466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-21 03:44:27.710569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-21 03:44:27.710594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.331 qpair failed and we were unable to recover it. 00:27:47.331 [2024-11-21 03:44:27.710699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-21 03:44:27.710827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-21 03:44:27.710852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.331 qpair failed and we were unable to recover it. 00:27:47.331 [2024-11-21 03:44:27.711006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-21 03:44:27.711140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-21 03:44:27.711167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.331 qpair failed and we were unable to recover it. 00:27:47.331 [2024-11-21 03:44:27.711297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-21 03:44:27.711403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-21 03:44:27.711428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.331 qpair failed and we were unable to recover it. 00:27:47.331 [2024-11-21 03:44:27.711587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-21 03:44:27.711688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-21 03:44:27.711713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.331 qpair failed and we were unable to recover it. 00:27:47.331 [2024-11-21 03:44:27.711813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-21 03:44:27.711911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-21 03:44:27.711937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.331 qpair failed and we were unable to recover it. 00:27:47.331 [2024-11-21 03:44:27.712067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-21 03:44:27.712207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-21 03:44:27.712232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.331 qpair failed and we were unable to recover it. 00:27:47.331 [2024-11-21 03:44:27.712361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-21 03:44:27.712516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-21 03:44:27.712541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.331 qpair failed and we were unable to recover it. 00:27:47.331 [2024-11-21 03:44:27.712652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-21 03:44:27.712787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-21 03:44:27.712812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.331 qpair failed and we were unable to recover it. 00:27:47.331 [2024-11-21 03:44:27.712942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-21 03:44:27.713099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-21 03:44:27.713126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.331 qpair failed and we were unable to recover it. 00:27:47.331 [2024-11-21 03:44:27.713228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-21 03:44:27.713338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-21 03:44:27.713364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.331 qpair failed and we were unable to recover it. 00:27:47.331 [2024-11-21 03:44:27.713489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-21 03:44:27.713622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-21 03:44:27.713647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.331 qpair failed and we were unable to recover it. 00:27:47.331 [2024-11-21 03:44:27.713777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-21 03:44:27.713906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-21 03:44:27.713932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b9EAL: No free 2048 kB hugepages reported on node 1 00:27:47.331 0 with addr=10.0.0.2, port=4420 00:27:47.331 qpair failed and we were unable to recover it. 00:27:47.331 [2024-11-21 03:44:27.714062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-21 03:44:27.714202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-21 03:44:27.714227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.331 qpair failed and we were unable to recover it. 00:27:47.331 [2024-11-21 03:44:27.714331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-21 03:44:27.714459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-21 03:44:27.714485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.331 qpair failed and we were unable to recover it. 00:27:47.331 [2024-11-21 03:44:27.714618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-21 03:44:27.714773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-21 03:44:27.714799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.331 qpair failed and we were unable to recover it. 00:27:47.331 [2024-11-21 03:44:27.714910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-21 03:44:27.715037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-21 03:44:27.715062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.331 qpair failed and we were unable to recover it. 00:27:47.331 [2024-11-21 03:44:27.715171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-21 03:44:27.715304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-21 03:44:27.715328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.331 qpair failed and we were unable to recover it. 00:27:47.331 [2024-11-21 03:44:27.715477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-21 03:44:27.715573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-21 03:44:27.715598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.331 qpair failed and we were unable to recover it. 00:27:47.331 [2024-11-21 03:44:27.715729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-21 03:44:27.715857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-21 03:44:27.715883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.331 qpair failed and we were unable to recover it. 00:27:47.331 [2024-11-21 03:44:27.716053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-21 03:44:27.716202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-21 03:44:27.716229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.331 qpair failed and we were unable to recover it. 00:27:47.331 [2024-11-21 03:44:27.716364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-21 03:44:27.716494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-21 03:44:27.716519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.331 qpair failed and we were unable to recover it. 00:27:47.331 [2024-11-21 03:44:27.716652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-21 03:44:27.716785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-21 03:44:27.716812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.331 qpair failed and we were unable to recover it. 00:27:47.331 [2024-11-21 03:44:27.716942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-21 03:44:27.717081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.331 [2024-11-21 03:44:27.717108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.331 qpair failed and we were unable to recover it. 00:27:47.331 [2024-11-21 03:44:27.717217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.332 [2024-11-21 03:44:27.717364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.332 [2024-11-21 03:44:27.717390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.332 qpair failed and we were unable to recover it. 00:27:47.332 [2024-11-21 03:44:27.717501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.332 [2024-11-21 03:44:27.717607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.332 [2024-11-21 03:44:27.717633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.332 qpair failed and we were unable to recover it. 00:27:47.332 [2024-11-21 03:44:27.717768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.332 [2024-11-21 03:44:27.717904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.332 [2024-11-21 03:44:27.717929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.332 qpair failed and we were unable to recover it. 00:27:47.332 [2024-11-21 03:44:27.718034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.332 [2024-11-21 03:44:27.718201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.332 [2024-11-21 03:44:27.718227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.332 qpair failed and we were unable to recover it. 00:27:47.332 [2024-11-21 03:44:27.718340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.332 [2024-11-21 03:44:27.718461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.332 [2024-11-21 03:44:27.718488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.332 qpair failed and we were unable to recover it. 00:27:47.332 [2024-11-21 03:44:27.718612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.332 [2024-11-21 03:44:27.718740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.332 [2024-11-21 03:44:27.718765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.332 qpair failed and we were unable to recover it. 00:27:47.332 [2024-11-21 03:44:27.718908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.332 [2024-11-21 03:44:27.719004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.332 [2024-11-21 03:44:27.719029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.332 qpair failed and we were unable to recover it. 00:27:47.332 [2024-11-21 03:44:27.719165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.332 [2024-11-21 03:44:27.719276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.332 [2024-11-21 03:44:27.719301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.332 qpair failed and we were unable to recover it. 00:27:47.332 [2024-11-21 03:44:27.719461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.332 [2024-11-21 03:44:27.719573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.332 [2024-11-21 03:44:27.719598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.332 qpair failed and we were unable to recover it. 00:27:47.332 [2024-11-21 03:44:27.719722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.332 [2024-11-21 03:44:27.719848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.332 [2024-11-21 03:44:27.719873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.332 qpair failed and we were unable to recover it. 00:27:47.332 [2024-11-21 03:44:27.719974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.332 [2024-11-21 03:44:27.720108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.332 [2024-11-21 03:44:27.720134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.332 qpair failed and we were unable to recover it. 00:27:47.332 [2024-11-21 03:44:27.720291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.332 [2024-11-21 03:44:27.720422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.332 [2024-11-21 03:44:27.720447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.332 qpair failed and we were unable to recover it. 00:27:47.332 [2024-11-21 03:44:27.720558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.332 [2024-11-21 03:44:27.720654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.332 [2024-11-21 03:44:27.720679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.332 qpair failed and we were unable to recover it. 00:27:47.332 [2024-11-21 03:44:27.720841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.332 [2024-11-21 03:44:27.720971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.332 [2024-11-21 03:44:27.720997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.332 qpair failed and we were unable to recover it. 00:27:47.332 [2024-11-21 03:44:27.721107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.332 [2024-11-21 03:44:27.721261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.332 [2024-11-21 03:44:27.721287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.332 qpair failed and we were unable to recover it. 00:27:47.332 [2024-11-21 03:44:27.721414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.332 [2024-11-21 03:44:27.721569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.332 [2024-11-21 03:44:27.721595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.332 qpair failed and we were unable to recover it. 00:27:47.332 [2024-11-21 03:44:27.721754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.332 [2024-11-21 03:44:27.721881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.332 [2024-11-21 03:44:27.721906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.332 qpair failed and we were unable to recover it. 00:27:47.332 [2024-11-21 03:44:27.722031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.332 [2024-11-21 03:44:27.722169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.332 [2024-11-21 03:44:27.722195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.332 qpair failed and we were unable to recover it. 00:27:47.332 [2024-11-21 03:44:27.722324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.332 [2024-11-21 03:44:27.722451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.332 [2024-11-21 03:44:27.722476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.332 qpair failed and we were unable to recover it. 00:27:47.333 [2024-11-21 03:44:27.722633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-21 03:44:27.722761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-21 03:44:27.722787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.333 qpair failed and we were unable to recover it. 00:27:47.333 [2024-11-21 03:44:27.722919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-21 03:44:27.723055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-21 03:44:27.723086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.333 qpair failed and we were unable to recover it. 00:27:47.333 [2024-11-21 03:44:27.723220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-21 03:44:27.723317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-21 03:44:27.723343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.333 qpair failed and we were unable to recover it. 00:27:47.333 [2024-11-21 03:44:27.723439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-21 03:44:27.723541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-21 03:44:27.723567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.333 qpair failed and we were unable to recover it. 00:27:47.333 [2024-11-21 03:44:27.723666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-21 03:44:27.723807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-21 03:44:27.723832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.333 qpair failed and we were unable to recover it. 00:27:47.333 [2024-11-21 03:44:27.723974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-21 03:44:27.724105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-21 03:44:27.724132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.333 qpair failed and we were unable to recover it. 00:27:47.333 [2024-11-21 03:44:27.724243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-21 03:44:27.724363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-21 03:44:27.724388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.333 qpair failed and we were unable to recover it. 00:27:47.333 [2024-11-21 03:44:27.724491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-21 03:44:27.724593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-21 03:44:27.724618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.333 qpair failed and we were unable to recover it. 00:27:47.333 [2024-11-21 03:44:27.724741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-21 03:44:27.724869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-21 03:44:27.724894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.333 qpair failed and we were unable to recover it. 00:27:47.333 [2024-11-21 03:44:27.724997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-21 03:44:27.725101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-21 03:44:27.725127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.333 qpair failed and we were unable to recover it. 00:27:47.333 [2024-11-21 03:44:27.725283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-21 03:44:27.725443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-21 03:44:27.725468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.333 qpair failed and we were unable to recover it. 00:27:47.333 [2024-11-21 03:44:27.725568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-21 03:44:27.725697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-21 03:44:27.725723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.333 qpair failed and we were unable to recover it. 00:27:47.333 [2024-11-21 03:44:27.725855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-21 03:44:27.725960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-21 03:44:27.725985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.333 qpair failed and we were unable to recover it. 00:27:47.333 [2024-11-21 03:44:27.726130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-21 03:44:27.726262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-21 03:44:27.726288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.333 qpair failed and we were unable to recover it. 00:27:47.333 [2024-11-21 03:44:27.726388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-21 03:44:27.726548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-21 03:44:27.726574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.333 qpair failed and we were unable to recover it. 00:27:47.333 [2024-11-21 03:44:27.726706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-21 03:44:27.726837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-21 03:44:27.726863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.333 qpair failed and we were unable to recover it. 00:27:47.333 [2024-11-21 03:44:27.726965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-21 03:44:27.727092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-21 03:44:27.727117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.333 qpair failed and we were unable to recover it. 00:27:47.333 [2024-11-21 03:44:27.727220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-21 03:44:27.727346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-21 03:44:27.727372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.333 qpair failed and we were unable to recover it. 00:27:47.333 [2024-11-21 03:44:27.727505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-21 03:44:27.727667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-21 03:44:27.727692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.333 qpair failed and we were unable to recover it. 00:27:47.333 [2024-11-21 03:44:27.727793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-21 03:44:27.727898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-21 03:44:27.727924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.333 qpair failed and we were unable to recover it. 00:27:47.333 [2024-11-21 03:44:27.728034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-21 03:44:27.728174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-21 03:44:27.728201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.333 qpair failed and we were unable to recover it. 00:27:47.333 [2024-11-21 03:44:27.728309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-21 03:44:27.728464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-21 03:44:27.728490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.333 qpair failed and we were unable to recover it. 00:27:47.333 [2024-11-21 03:44:27.728590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-21 03:44:27.728687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-21 03:44:27.728713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.333 qpair failed and we were unable to recover it. 00:27:47.333 [2024-11-21 03:44:27.728867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-21 03:44:27.728996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-21 03:44:27.729022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.333 qpair failed and we were unable to recover it. 00:27:47.333 [2024-11-21 03:44:27.729181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-21 03:44:27.729314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-21 03:44:27.729339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.333 qpair failed and we were unable to recover it. 00:27:47.333 [2024-11-21 03:44:27.729499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-21 03:44:27.729597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.333 [2024-11-21 03:44:27.729623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.333 qpair failed and we were unable to recover it. 00:27:47.333 [2024-11-21 03:44:27.729722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-21 03:44:27.729821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-21 03:44:27.729848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.334 qpair failed and we were unable to recover it. 00:27:47.334 [2024-11-21 03:44:27.730008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-21 03:44:27.730161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-21 03:44:27.730187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.334 qpair failed and we were unable to recover it. 00:27:47.334 [2024-11-21 03:44:27.730338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-21 03:44:27.730463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-21 03:44:27.730489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.334 qpair failed and we were unable to recover it. 00:27:47.334 [2024-11-21 03:44:27.730592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-21 03:44:27.730747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-21 03:44:27.730772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.334 qpair failed and we were unable to recover it. 00:27:47.334 [2024-11-21 03:44:27.730900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-21 03:44:27.731027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-21 03:44:27.731053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.334 qpair failed and we were unable to recover it. 00:27:47.334 [2024-11-21 03:44:27.731198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-21 03:44:27.731330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-21 03:44:27.731356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.334 qpair failed and we were unable to recover it. 00:27:47.334 [2024-11-21 03:44:27.731487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-21 03:44:27.731621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-21 03:44:27.731646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.334 qpair failed and we were unable to recover it. 00:27:47.334 [2024-11-21 03:44:27.731778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-21 03:44:27.731935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-21 03:44:27.731961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.334 qpair failed and we were unable to recover it. 00:27:47.334 [2024-11-21 03:44:27.732100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-21 03:44:27.732229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-21 03:44:27.732254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.334 qpair failed and we were unable to recover it. 00:27:47.334 [2024-11-21 03:44:27.732353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-21 03:44:27.732489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-21 03:44:27.732515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.334 qpair failed and we were unable to recover it. 00:27:47.334 [2024-11-21 03:44:27.732611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-21 03:44:27.732737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-21 03:44:27.732763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.334 qpair failed and we were unable to recover it. 00:27:47.334 [2024-11-21 03:44:27.732922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-21 03:44:27.733055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-21 03:44:27.733088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.334 qpair failed and we were unable to recover it. 00:27:47.334 [2024-11-21 03:44:27.733223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-21 03:44:27.733361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-21 03:44:27.733386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.334 qpair failed and we were unable to recover it. 00:27:47.334 [2024-11-21 03:44:27.733513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-21 03:44:27.733642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-21 03:44:27.733668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.334 qpair failed and we were unable to recover it. 00:27:47.334 [2024-11-21 03:44:27.733790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-21 03:44:27.733904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-21 03:44:27.733930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.334 qpair failed and we were unable to recover it. 00:27:47.334 [2024-11-21 03:44:27.734029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-21 03:44:27.734165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-21 03:44:27.734192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.334 qpair failed and we were unable to recover it. 00:27:47.334 [2024-11-21 03:44:27.734296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-21 03:44:27.734424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-21 03:44:27.734449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.334 qpair failed and we were unable to recover it. 00:27:47.334 [2024-11-21 03:44:27.734561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-21 03:44:27.734664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-21 03:44:27.734691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.334 qpair failed and we were unable to recover it. 00:27:47.334 [2024-11-21 03:44:27.734825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-21 03:44:27.734953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-21 03:44:27.734979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.334 qpair failed and we were unable to recover it. 00:27:47.334 [2024-11-21 03:44:27.735114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-21 03:44:27.735262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-21 03:44:27.735287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.334 qpair failed and we were unable to recover it. 00:27:47.334 [2024-11-21 03:44:27.735419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-21 03:44:27.735548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-21 03:44:27.735573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.334 qpair failed and we were unable to recover it. 00:27:47.334 [2024-11-21 03:44:27.735701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-21 03:44:27.735829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-21 03:44:27.735856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.334 qpair failed and we were unable to recover it. 00:27:47.334 [2024-11-21 03:44:27.735987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-21 03:44:27.736110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.334 [2024-11-21 03:44:27.736137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.334 qpair failed and we were unable to recover it. 00:27:47.334 [2024-11-21 03:44:27.736251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-21 03:44:27.736385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-21 03:44:27.736412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.335 qpair failed and we were unable to recover it. 00:27:47.335 [2024-11-21 03:44:27.736572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-21 03:44:27.736705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-21 03:44:27.736731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.335 qpair failed and we were unable to recover it. 00:27:47.335 [2024-11-21 03:44:27.736863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-21 03:44:27.736986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-21 03:44:27.737011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.335 qpair failed and we were unable to recover it. 00:27:47.335 [2024-11-21 03:44:27.737115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-21 03:44:27.737276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-21 03:44:27.737302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.335 qpair failed and we were unable to recover it. 00:27:47.335 [2024-11-21 03:44:27.737440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-21 03:44:27.737573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-21 03:44:27.737600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.335 qpair failed and we were unable to recover it. 00:27:47.335 [2024-11-21 03:44:27.737726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-21 03:44:27.737882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-21 03:44:27.737907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.335 qpair failed and we were unable to recover it. 00:27:47.335 [2024-11-21 03:44:27.738045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-21 03:44:27.738184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-21 03:44:27.738214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.335 qpair failed and we were unable to recover it. 00:27:47.335 [2024-11-21 03:44:27.738345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-21 03:44:27.738496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-21 03:44:27.738522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.335 qpair failed and we were unable to recover it. 00:27:47.335 [2024-11-21 03:44:27.738626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-21 03:44:27.738728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-21 03:44:27.738754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.335 qpair failed and we were unable to recover it. 00:27:47.335 [2024-11-21 03:44:27.738861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-21 03:44:27.739003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-21 03:44:27.739028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.335 qpair failed and we were unable to recover it. 00:27:47.335 [2024-11-21 03:44:27.739168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-21 03:44:27.739344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-21 03:44:27.739369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.335 qpair failed and we were unable to recover it. 00:27:47.335 [2024-11-21 03:44:27.739494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-21 03:44:27.739597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-21 03:44:27.739622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.335 qpair failed and we were unable to recover it. 00:27:47.335 [2024-11-21 03:44:27.739755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-21 03:44:27.739857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-21 03:44:27.739884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.335 qpair failed and we were unable to recover it. 00:27:47.335 [2024-11-21 03:44:27.740011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-21 03:44:27.740139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-21 03:44:27.740166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.335 qpair failed and we were unable to recover it. 00:27:47.335 [2024-11-21 03:44:27.740321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-21 03:44:27.740422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-21 03:44:27.740448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.335 qpair failed and we were unable to recover it. 00:27:47.335 [2024-11-21 03:44:27.740576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-21 03:44:27.740683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-21 03:44:27.740708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.335 qpair failed and we were unable to recover it. 00:27:47.335 [2024-11-21 03:44:27.740845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-21 03:44:27.740986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-21 03:44:27.741016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.335 qpair failed and we were unable to recover it. 00:27:47.335 [2024-11-21 03:44:27.741120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-21 03:44:27.741248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-21 03:44:27.741273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.335 qpair failed and we were unable to recover it. 00:27:47.335 [2024-11-21 03:44:27.741428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-21 03:44:27.741556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-21 03:44:27.741581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.335 qpair failed and we were unable to recover it. 00:27:47.335 [2024-11-21 03:44:27.741711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-21 03:44:27.741842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-21 03:44:27.741867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.335 qpair failed and we were unable to recover it. 00:27:47.335 [2024-11-21 03:44:27.741970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-21 03:44:27.742101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-21 03:44:27.742126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.335 qpair failed and we were unable to recover it. 00:27:47.335 [2024-11-21 03:44:27.742238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-21 03:44:27.742369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-21 03:44:27.742394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.335 qpair failed and we were unable to recover it. 00:27:47.335 [2024-11-21 03:44:27.742530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-21 03:44:27.742628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-21 03:44:27.742654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.335 qpair failed and we were unable to recover it. 00:27:47.335 [2024-11-21 03:44:27.742755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-21 03:44:27.742913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-21 03:44:27.742939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.335 qpair failed and we were unable to recover it. 00:27:47.335 [2024-11-21 03:44:27.743095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-21 03:44:27.743226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.335 [2024-11-21 03:44:27.743252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.335 qpair failed and we were unable to recover it. 00:27:47.336 [2024-11-21 03:44:27.743378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.336 [2024-11-21 03:44:27.743506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.336 [2024-11-21 03:44:27.743531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.336 qpair failed and we were unable to recover it. 00:27:47.336 [2024-11-21 03:44:27.743661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.336 [2024-11-21 03:44:27.743786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.336 [2024-11-21 03:44:27.743815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.336 qpair failed and we were unable to recover it. 00:27:47.336 [2024-11-21 03:44:27.743918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.336 [2024-11-21 03:44:27.744081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.336 [2024-11-21 03:44:27.744107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.336 qpair failed and we were unable to recover it. 00:27:47.336 [2024-11-21 03:44:27.744212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.336 [2024-11-21 03:44:27.744365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.336 [2024-11-21 03:44:27.744390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.336 qpair failed and we were unable to recover it. 00:27:47.336 [2024-11-21 03:44:27.744523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.336 [2024-11-21 03:44:27.744644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.336 [2024-11-21 03:44:27.744670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.336 qpair failed and we were unable to recover it. 00:27:47.336 [2024-11-21 03:44:27.744800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.336 [2024-11-21 03:44:27.744931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.336 [2024-11-21 03:44:27.744956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.336 qpair failed and we were unable to recover it. 00:27:47.336 [2024-11-21 03:44:27.745100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.336 [2024-11-21 03:44:27.745260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.336 [2024-11-21 03:44:27.745286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.336 qpair failed and we were unable to recover it. 00:27:47.336 [2024-11-21 03:44:27.745428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.336 [2024-11-21 03:44:27.745566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.336 [2024-11-21 03:44:27.745591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.336 qpair failed and we were unable to recover it. 00:27:47.336 [2024-11-21 03:44:27.745746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.336 [2024-11-21 03:44:27.745845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.336 [2024-11-21 03:44:27.745871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.336 qpair failed and we were unable to recover it. 00:27:47.336 [2024-11-21 03:44:27.746027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.336 [2024-11-21 03:44:27.746159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.336 [2024-11-21 03:44:27.746185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.336 qpair failed and we were unable to recover it. 00:27:47.336 [2024-11-21 03:44:27.746308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.336 [2024-11-21 03:44:27.746404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.336 [2024-11-21 03:44:27.746429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.336 qpair failed and we were unable to recover it. 00:27:47.336 [2024-11-21 03:44:27.746532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.336 [2024-11-21 03:44:27.746654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.336 [2024-11-21 03:44:27.746684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.336 qpair failed and we were unable to recover it. 00:27:47.336 [2024-11-21 03:44:27.746846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.336 [2024-11-21 03:44:27.746943] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:27:47.336 [2024-11-21 03:44:27.746974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.336 [2024-11-21 03:44:27.746999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.336 qpair failed and we were unable to recover it. 00:27:47.336 [2024-11-21 03:44:27.747143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.336 [2024-11-21 03:44:27.747269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.336 [2024-11-21 03:44:27.747295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.336 qpair failed and we were unable to recover it. 00:27:47.336 [2024-11-21 03:44:27.747451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.336 [2024-11-21 03:44:27.747605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.336 [2024-11-21 03:44:27.747630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.336 qpair failed and we were unable to recover it. 00:27:47.336 [2024-11-21 03:44:27.747742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.336 [2024-11-21 03:44:27.747898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.336 [2024-11-21 03:44:27.747923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.336 qpair failed and we were unable to recover it. 00:27:47.336 [2024-11-21 03:44:27.748031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.336 [2024-11-21 03:44:27.748139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.336 [2024-11-21 03:44:27.748164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.336 qpair failed and we were unable to recover it. 00:27:47.336 [2024-11-21 03:44:27.748266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.336 [2024-11-21 03:44:27.748373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.336 [2024-11-21 03:44:27.748398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.336 qpair failed and we were unable to recover it. 00:27:47.336 [2024-11-21 03:44:27.748524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.336 [2024-11-21 03:44:27.748648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.336 [2024-11-21 03:44:27.748673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.336 qpair failed and we were unable to recover it. 00:27:47.336 [2024-11-21 03:44:27.748836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.336 [2024-11-21 03:44:27.748978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.336 [2024-11-21 03:44:27.749004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.336 qpair failed and we were unable to recover it. 00:27:47.336 [2024-11-21 03:44:27.749105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.336 [2024-11-21 03:44:27.749229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.336 [2024-11-21 03:44:27.749255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.336 qpair failed and we were unable to recover it. 00:27:47.336 [2024-11-21 03:44:27.749383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.336 [2024-11-21 03:44:27.749487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.336 [2024-11-21 03:44:27.749517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.336 qpair failed and we were unable to recover it. 00:27:47.337 [2024-11-21 03:44:27.749649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-21 03:44:27.749793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-21 03:44:27.749819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.337 qpair failed and we were unable to recover it. 00:27:47.337 [2024-11-21 03:44:27.749951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-21 03:44:27.750105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-21 03:44:27.750131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.337 qpair failed and we were unable to recover it. 00:27:47.337 [2024-11-21 03:44:27.750255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-21 03:44:27.750384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-21 03:44:27.750409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.337 qpair failed and we were unable to recover it. 00:27:47.337 [2024-11-21 03:44:27.750538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-21 03:44:27.750664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-21 03:44:27.750689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.337 qpair failed and we were unable to recover it. 00:27:47.337 [2024-11-21 03:44:27.750821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-21 03:44:27.750958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-21 03:44:27.750983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.337 qpair failed and we were unable to recover it. 00:27:47.337 [2024-11-21 03:44:27.751147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-21 03:44:27.751279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-21 03:44:27.751304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.337 qpair failed and we were unable to recover it. 00:27:47.337 [2024-11-21 03:44:27.751406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-21 03:44:27.751510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-21 03:44:27.751538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.337 qpair failed and we were unable to recover it. 00:27:47.337 [2024-11-21 03:44:27.751648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-21 03:44:27.751783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-21 03:44:27.751809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.337 qpair failed and we were unable to recover it. 00:27:47.337 [2024-11-21 03:44:27.751967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-21 03:44:27.752117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-21 03:44:27.752143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.337 qpair failed and we were unable to recover it. 00:27:47.337 [2024-11-21 03:44:27.752282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-21 03:44:27.752411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-21 03:44:27.752442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.337 qpair failed and we were unable to recover it. 00:27:47.337 [2024-11-21 03:44:27.752554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-21 03:44:27.752654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-21 03:44:27.752679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.337 qpair failed and we were unable to recover it. 00:27:47.337 [2024-11-21 03:44:27.752782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-21 03:44:27.752876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-21 03:44:27.752901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.337 qpair failed and we were unable to recover it. 00:27:47.337 [2024-11-21 03:44:27.752998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-21 03:44:27.753126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-21 03:44:27.753153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.337 qpair failed and we were unable to recover it. 00:27:47.337 [2024-11-21 03:44:27.753289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-21 03:44:27.753389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-21 03:44:27.753414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.337 qpair failed and we were unable to recover it. 00:27:47.337 [2024-11-21 03:44:27.753541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-21 03:44:27.753632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-21 03:44:27.753658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.337 qpair failed and we were unable to recover it. 00:27:47.337 [2024-11-21 03:44:27.753758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-21 03:44:27.753920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-21 03:44:27.753945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.337 qpair failed and we were unable to recover it. 00:27:47.337 [2024-11-21 03:44:27.754043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-21 03:44:27.754196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-21 03:44:27.754222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.337 qpair failed and we were unable to recover it. 00:27:47.337 [2024-11-21 03:44:27.754322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-21 03:44:27.754423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-21 03:44:27.754449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.337 qpair failed and we were unable to recover it. 00:27:47.337 [2024-11-21 03:44:27.754608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-21 03:44:27.754761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-21 03:44:27.754787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.337 qpair failed and we were unable to recover it. 00:27:47.337 [2024-11-21 03:44:27.754917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-21 03:44:27.755016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-21 03:44:27.755046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.337 qpair failed and we were unable to recover it. 00:27:47.337 [2024-11-21 03:44:27.755192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.337 [2024-11-21 03:44:27.755296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-21 03:44:27.755323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.338 qpair failed and we were unable to recover it. 00:27:47.338 [2024-11-21 03:44:27.755479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-21 03:44:27.755612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-21 03:44:27.755638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.338 qpair failed and we were unable to recover it. 00:27:47.338 [2024-11-21 03:44:27.755741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-21 03:44:27.755877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-21 03:44:27.755902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.338 qpair failed and we were unable to recover it. 00:27:47.338 [2024-11-21 03:44:27.756033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-21 03:44:27.756171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-21 03:44:27.756197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.338 qpair failed and we were unable to recover it. 00:27:47.338 [2024-11-21 03:44:27.756325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-21 03:44:27.756429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-21 03:44:27.756456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.338 qpair failed and we were unable to recover it. 00:27:47.338 [2024-11-21 03:44:27.756592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-21 03:44:27.756693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-21 03:44:27.756719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.338 qpair failed and we were unable to recover it. 00:27:47.338 [2024-11-21 03:44:27.756822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-21 03:44:27.756992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-21 03:44:27.757017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.338 qpair failed and we were unable to recover it. 00:27:47.338 [2024-11-21 03:44:27.757148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-21 03:44:27.757304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-21 03:44:27.757330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.338 qpair failed and we were unable to recover it. 00:27:47.338 [2024-11-21 03:44:27.757475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-21 03:44:27.757632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-21 03:44:27.757658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.338 qpair failed and we were unable to recover it. 00:27:47.338 [2024-11-21 03:44:27.757791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-21 03:44:27.757955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-21 03:44:27.757980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.338 qpair failed and we were unable to recover it. 00:27:47.338 [2024-11-21 03:44:27.758113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-21 03:44:27.758248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-21 03:44:27.758274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.338 qpair failed and we were unable to recover it. 00:27:47.338 [2024-11-21 03:44:27.758406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-21 03:44:27.758534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-21 03:44:27.758559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.338 qpair failed and we were unable to recover it. 00:27:47.338 [2024-11-21 03:44:27.758688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-21 03:44:27.758812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-21 03:44:27.758838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.338 qpair failed and we were unable to recover it. 00:27:47.338 [2024-11-21 03:44:27.758946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-21 03:44:27.759090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-21 03:44:27.759116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.338 qpair failed and we were unable to recover it. 00:27:47.338 [2024-11-21 03:44:27.759245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-21 03:44:27.759386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-21 03:44:27.759412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.338 qpair failed and we were unable to recover it. 00:27:47.338 [2024-11-21 03:44:27.759544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-21 03:44:27.759679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-21 03:44:27.759704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.338 qpair failed and we were unable to recover it. 00:27:47.338 [2024-11-21 03:44:27.759831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-21 03:44:27.759989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-21 03:44:27.760014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.338 qpair failed and we were unable to recover it. 00:27:47.338 [2024-11-21 03:44:27.760175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-21 03:44:27.760311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-21 03:44:27.760338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.338 qpair failed and we were unable to recover it. 00:27:47.338 [2024-11-21 03:44:27.760441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-21 03:44:27.760599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-21 03:44:27.760625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.338 qpair failed and we were unable to recover it. 00:27:47.338 [2024-11-21 03:44:27.760757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-21 03:44:27.760851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-21 03:44:27.760876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.338 qpair failed and we were unable to recover it. 00:27:47.338 [2024-11-21 03:44:27.761027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-21 03:44:27.761167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-21 03:44:27.761193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.338 qpair failed and we were unable to recover it. 00:27:47.338 [2024-11-21 03:44:27.761366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-21 03:44:27.761475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-21 03:44:27.761501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.338 qpair failed and we were unable to recover it. 00:27:47.338 [2024-11-21 03:44:27.761605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-21 03:44:27.761708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.338 [2024-11-21 03:44:27.761736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.338 qpair failed and we were unable to recover it. 00:27:47.339 [2024-11-21 03:44:27.761842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.339 [2024-11-21 03:44:27.761943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.339 [2024-11-21 03:44:27.761968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.339 qpair failed and we were unable to recover it. 00:27:47.339 [2024-11-21 03:44:27.762095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.339 [2024-11-21 03:44:27.762228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.339 [2024-11-21 03:44:27.762253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.339 qpair failed and we were unable to recover it. 00:27:47.339 [2024-11-21 03:44:27.762386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.339 [2024-11-21 03:44:27.762491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.339 [2024-11-21 03:44:27.762517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.339 qpair failed and we were unable to recover it. 00:27:47.339 [2024-11-21 03:44:27.762624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.339 [2024-11-21 03:44:27.762747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.339 [2024-11-21 03:44:27.762773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.339 qpair failed and we were unable to recover it. 00:27:47.339 [2024-11-21 03:44:27.762903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.339 [2024-11-21 03:44:27.763032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.339 [2024-11-21 03:44:27.763057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.339 qpair failed and we were unable to recover it. 00:27:47.339 [2024-11-21 03:44:27.763173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.339 [2024-11-21 03:44:27.763309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.339 [2024-11-21 03:44:27.763334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.339 qpair failed and we were unable to recover it. 00:27:47.339 [2024-11-21 03:44:27.763440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.339 [2024-11-21 03:44:27.763544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.339 [2024-11-21 03:44:27.763571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.339 qpair failed and we were unable to recover it. 00:27:47.339 [2024-11-21 03:44:27.763707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.339 [2024-11-21 03:44:27.763805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.339 [2024-11-21 03:44:27.763830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.339 qpair failed and we were unable to recover it. 00:27:47.339 [2024-11-21 03:44:27.763968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.339 [2024-11-21 03:44:27.764107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.339 [2024-11-21 03:44:27.764133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.339 qpair failed and we were unable to recover it. 00:27:47.339 [2024-11-21 03:44:27.764238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.339 [2024-11-21 03:44:27.764364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.339 [2024-11-21 03:44:27.764389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.339 qpair failed and we were unable to recover it. 00:27:47.339 [2024-11-21 03:44:27.764524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.339 [2024-11-21 03:44:27.764655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.339 [2024-11-21 03:44:27.764680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.339 qpair failed and we were unable to recover it. 00:27:47.339 [2024-11-21 03:44:27.764834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.339 [2024-11-21 03:44:27.764964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.339 [2024-11-21 03:44:27.764989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.339 qpair failed and we were unable to recover it. 00:27:47.339 [2024-11-21 03:44:27.765119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.339 [2024-11-21 03:44:27.765256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.339 [2024-11-21 03:44:27.765282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.339 qpair failed and we were unable to recover it. 00:27:47.339 [2024-11-21 03:44:27.765405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.339 [2024-11-21 03:44:27.765501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.339 [2024-11-21 03:44:27.765531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.339 qpair failed and we were unable to recover it. 00:27:47.339 [2024-11-21 03:44:27.765667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.339 [2024-11-21 03:44:27.765828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.339 [2024-11-21 03:44:27.765854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.339 qpair failed and we were unable to recover it. 00:27:47.339 [2024-11-21 03:44:27.766014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.339 [2024-11-21 03:44:27.766147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.339 [2024-11-21 03:44:27.766173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.339 qpair failed and we were unable to recover it. 00:27:47.339 [2024-11-21 03:44:27.766282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.339 [2024-11-21 03:44:27.766423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.339 [2024-11-21 03:44:27.766450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.339 qpair failed and we were unable to recover it. 00:27:47.339 [2024-11-21 03:44:27.766590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.339 [2024-11-21 03:44:27.766729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.339 [2024-11-21 03:44:27.766754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.339 qpair failed and we were unable to recover it. 00:27:47.339 [2024-11-21 03:44:27.766889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.339 [2024-11-21 03:44:27.767043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.339 [2024-11-21 03:44:27.767074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.339 qpair failed and we were unable to recover it. 00:27:47.339 [2024-11-21 03:44:27.767186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.339 [2024-11-21 03:44:27.767290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.339 [2024-11-21 03:44:27.767315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.339 qpair failed and we were unable to recover it. 00:27:47.339 [2024-11-21 03:44:27.767426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.339 [2024-11-21 03:44:27.767581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.339 [2024-11-21 03:44:27.767607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.339 qpair failed and we were unable to recover it. 00:27:47.339 [2024-11-21 03:44:27.767737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.339 [2024-11-21 03:44:27.767890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.339 [2024-11-21 03:44:27.767915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.339 qpair failed and we were unable to recover it. 00:27:47.340 [2024-11-21 03:44:27.768079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.340 [2024-11-21 03:44:27.768183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.340 [2024-11-21 03:44:27.768210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.340 qpair failed and we were unable to recover it. 00:27:47.340 [2024-11-21 03:44:27.768344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.340 [2024-11-21 03:44:27.768440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.340 [2024-11-21 03:44:27.768465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.340 qpair failed and we were unable to recover it. 00:27:47.340 [2024-11-21 03:44:27.768563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.340 [2024-11-21 03:44:27.768721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.340 [2024-11-21 03:44:27.768747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.340 qpair failed and we were unable to recover it. 00:27:47.340 [2024-11-21 03:44:27.768874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.340 [2024-11-21 03:44:27.768987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.340 [2024-11-21 03:44:27.769013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.340 qpair failed and we were unable to recover it. 00:27:47.340 [2024-11-21 03:44:27.769178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.340 [2024-11-21 03:44:27.769339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.340 [2024-11-21 03:44:27.769364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.340 qpair failed and we were unable to recover it. 00:27:47.340 [2024-11-21 03:44:27.769505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.340 [2024-11-21 03:44:27.769641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.340 [2024-11-21 03:44:27.769667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.340 qpair failed and we were unable to recover it. 00:27:47.340 [2024-11-21 03:44:27.769774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.340 [2024-11-21 03:44:27.769879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.340 [2024-11-21 03:44:27.769906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.340 qpair failed and we were unable to recover it. 00:27:47.340 [2024-11-21 03:44:27.770009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.340 [2024-11-21 03:44:27.770171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.340 [2024-11-21 03:44:27.770198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.340 qpair failed and we were unable to recover it. 00:27:47.340 [2024-11-21 03:44:27.770306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.340 [2024-11-21 03:44:27.770435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.340 [2024-11-21 03:44:27.770461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.340 qpair failed and we were unable to recover it. 00:27:47.340 [2024-11-21 03:44:27.770596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.340 [2024-11-21 03:44:27.770700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.340 [2024-11-21 03:44:27.770725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.340 qpair failed and we were unable to recover it. 00:27:47.340 [2024-11-21 03:44:27.770833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.340 [2024-11-21 03:44:27.770961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.340 [2024-11-21 03:44:27.770988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.340 qpair failed and we were unable to recover it. 00:27:47.340 [2024-11-21 03:44:27.771128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.340 [2024-11-21 03:44:27.771283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.340 [2024-11-21 03:44:27.771308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.340 qpair failed and we were unable to recover it. 00:27:47.340 [2024-11-21 03:44:27.771415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.340 [2024-11-21 03:44:27.771546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.340 [2024-11-21 03:44:27.771573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.340 qpair failed and we were unable to recover it. 00:27:47.340 [2024-11-21 03:44:27.771713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.340 [2024-11-21 03:44:27.771840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.340 [2024-11-21 03:44:27.771867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.340 qpair failed and we were unable to recover it. 00:27:47.340 [2024-11-21 03:44:27.771967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.340 [2024-11-21 03:44:27.772101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.340 [2024-11-21 03:44:27.772127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.340 qpair failed and we were unable to recover it. 00:27:47.340 [2024-11-21 03:44:27.772256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.340 [2024-11-21 03:44:27.772357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.340 [2024-11-21 03:44:27.772382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.340 qpair failed and we were unable to recover it. 00:27:47.340 [2024-11-21 03:44:27.772514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.340 [2024-11-21 03:44:27.772641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.340 [2024-11-21 03:44:27.772666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.340 qpair failed and we were unable to recover it. 00:27:47.340 [2024-11-21 03:44:27.772800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.340 [2024-11-21 03:44:27.772933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.340 [2024-11-21 03:44:27.772959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.340 qpair failed and we were unable to recover it. 00:27:47.340 [2024-11-21 03:44:27.773091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.340 [2024-11-21 03:44:27.773213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.340 [2024-11-21 03:44:27.773239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.340 qpair failed and we were unable to recover it. 00:27:47.340 [2024-11-21 03:44:27.773403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.340 [2024-11-21 03:44:27.773506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.340 [2024-11-21 03:44:27.773532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.340 qpair failed and we were unable to recover it. 00:27:47.340 [2024-11-21 03:44:27.773664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.340 [2024-11-21 03:44:27.773758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.340 [2024-11-21 03:44:27.773785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.340 qpair failed and we were unable to recover it. 00:27:47.340 [2024-11-21 03:44:27.773944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.340 [2024-11-21 03:44:27.774065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.340 [2024-11-21 03:44:27.774100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.340 qpair failed and we were unable to recover it. 00:27:47.340 [2024-11-21 03:44:27.774260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.340 [2024-11-21 03:44:27.774365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.340 [2024-11-21 03:44:27.774390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.340 qpair failed and we were unable to recover it. 00:27:47.340 [2024-11-21 03:44:27.774520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.341 [2024-11-21 03:44:27.774643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.341 [2024-11-21 03:44:27.774668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.341 qpair failed and we were unable to recover it. 00:27:47.341 [2024-11-21 03:44:27.774804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.341 [2024-11-21 03:44:27.774904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.341 [2024-11-21 03:44:27.774931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.341 qpair failed and we were unable to recover it. 00:27:47.341 [2024-11-21 03:44:27.775064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.341 [2024-11-21 03:44:27.775204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.341 [2024-11-21 03:44:27.775230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.341 qpair failed and we were unable to recover it. 00:27:47.341 [2024-11-21 03:44:27.775365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.341 [2024-11-21 03:44:27.775496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.341 [2024-11-21 03:44:27.775522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.341 qpair failed and we were unable to recover it. 00:27:47.341 [2024-11-21 03:44:27.775618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.341 [2024-11-21 03:44:27.775747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.341 [2024-11-21 03:44:27.775773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.341 qpair failed and we were unable to recover it. 00:27:47.341 [2024-11-21 03:44:27.775891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.341 [2024-11-21 03:44:27.775991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.341 [2024-11-21 03:44:27.776018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.341 qpair failed and we were unable to recover it. 00:27:47.341 [2024-11-21 03:44:27.776155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.341 [2024-11-21 03:44:27.776260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.341 [2024-11-21 03:44:27.776285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.341 qpair failed and we were unable to recover it. 00:27:47.341 [2024-11-21 03:44:27.776390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.341 [2024-11-21 03:44:27.776517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.341 [2024-11-21 03:44:27.776543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.341 qpair failed and we were unable to recover it. 00:27:47.341 [2024-11-21 03:44:27.776670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.341 [2024-11-21 03:44:27.776802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.341 [2024-11-21 03:44:27.776828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.341 qpair failed and we were unable to recover it. 00:27:47.341 [2024-11-21 03:44:27.776929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.341 [2024-11-21 03:44:27.777096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.341 [2024-11-21 03:44:27.777122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.341 qpair failed and we were unable to recover it. 00:27:47.341 [2024-11-21 03:44:27.777253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.341 [2024-11-21 03:44:27.777381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.341 [2024-11-21 03:44:27.777407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.341 qpair failed and we were unable to recover it. 00:27:47.341 [2024-11-21 03:44:27.777567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.341 [2024-11-21 03:44:27.777692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.341 [2024-11-21 03:44:27.777718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.341 qpair failed and we were unable to recover it. 00:27:47.341 [2024-11-21 03:44:27.777876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.341 [2024-11-21 03:44:27.778024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.341 [2024-11-21 03:44:27.778054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.341 qpair failed and we were unable to recover it. 00:27:47.341 [2024-11-21 03:44:27.778231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.341 [2024-11-21 03:44:27.778333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.341 [2024-11-21 03:44:27.778359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.341 qpair failed and we were unable to recover it. 00:27:47.341 [2024-11-21 03:44:27.778455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.341 [2024-11-21 03:44:27.778583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.341 [2024-11-21 03:44:27.778609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.341 qpair failed and we were unable to recover it. 00:27:47.341 [2024-11-21 03:44:27.778701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.341 [2024-11-21 03:44:27.778803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.341 [2024-11-21 03:44:27.778830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.341 qpair failed and we were unable to recover it. 00:27:47.341 [2024-11-21 03:44:27.778932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.341 [2024-11-21 03:44:27.779060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.341 [2024-11-21 03:44:27.779096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.341 qpair failed and we were unable to recover it. 00:27:47.341 [2024-11-21 03:44:27.779210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.341 [2024-11-21 03:44:27.779340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.341 [2024-11-21 03:44:27.779366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.341 qpair failed and we were unable to recover it. 00:27:47.341 [2024-11-21 03:44:27.779466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.341 [2024-11-21 03:44:27.779562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.341 [2024-11-21 03:44:27.779587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.341 qpair failed and we were unable to recover it. 00:27:47.341 [2024-11-21 03:44:27.779715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.341 [2024-11-21 03:44:27.779818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.341 [2024-11-21 03:44:27.779844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.341 qpair failed and we were unable to recover it. 00:27:47.341 [2024-11-21 03:44:27.779938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.341 [2024-11-21 03:44:27.780066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.341 [2024-11-21 03:44:27.780099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.341 qpair failed and we were unable to recover it. 00:27:47.341 [2024-11-21 03:44:27.780259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.341 [2024-11-21 03:44:27.780365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.341 [2024-11-21 03:44:27.780391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.341 qpair failed and we were unable to recover it. 00:27:47.341 [2024-11-21 03:44:27.780488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.341 [2024-11-21 03:44:27.780626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.342 [2024-11-21 03:44:27.780651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.342 qpair failed and we were unable to recover it. 00:27:47.342 [2024-11-21 03:44:27.780753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.342 [2024-11-21 03:44:27.780853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.342 [2024-11-21 03:44:27.780881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.342 qpair failed and we were unable to recover it. 00:27:47.342 [2024-11-21 03:44:27.781013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.342 [2024-11-21 03:44:27.781149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.342 [2024-11-21 03:44:27.781175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.342 qpair failed and we were unable to recover it. 00:27:47.342 [2024-11-21 03:44:27.781273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.342 [2024-11-21 03:44:27.781427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.342 [2024-11-21 03:44:27.781452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.342 qpair failed and we were unable to recover it. 00:27:47.342 [2024-11-21 03:44:27.781592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.342 [2024-11-21 03:44:27.781685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.342 [2024-11-21 03:44:27.781711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.342 qpair failed and we were unable to recover it. 00:27:47.342 [2024-11-21 03:44:27.781868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.342 [2024-11-21 03:44:27.781998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.342 [2024-11-21 03:44:27.782023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.342 qpair failed and we were unable to recover it. 00:27:47.342 [2024-11-21 03:44:27.782138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.342 [2024-11-21 03:44:27.782238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.342 [2024-11-21 03:44:27.782264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.342 qpair failed and we were unable to recover it. 00:27:47.342 [2024-11-21 03:44:27.782397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.342 [2024-11-21 03:44:27.782527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.342 [2024-11-21 03:44:27.782552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.342 qpair failed and we were unable to recover it. 00:27:47.342 [2024-11-21 03:44:27.782665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.342 [2024-11-21 03:44:27.782762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.342 [2024-11-21 03:44:27.782786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.342 qpair failed and we were unable to recover it. 00:27:47.342 [2024-11-21 03:44:27.782880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.342 [2024-11-21 03:44:27.783003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.342 [2024-11-21 03:44:27.783027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.342 qpair failed and we were unable to recover it. 00:27:47.342 [2024-11-21 03:44:27.783169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.342 [2024-11-21 03:44:27.783302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.342 [2024-11-21 03:44:27.783332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.342 qpair failed and we were unable to recover it. 00:27:47.342 [2024-11-21 03:44:27.783441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.342 [2024-11-21 03:44:27.783571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.342 [2024-11-21 03:44:27.783597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.342 qpair failed and we were unable to recover it. 00:27:47.342 [2024-11-21 03:44:27.783753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.342 [2024-11-21 03:44:27.783889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.342 [2024-11-21 03:44:27.783914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.342 qpair failed and we were unable to recover it. 00:27:47.342 [2024-11-21 03:44:27.784039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.342 [2024-11-21 03:44:27.784170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.342 [2024-11-21 03:44:27.784195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.342 qpair failed and we were unable to recover it. 00:27:47.342 [2024-11-21 03:44:27.784303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.342 [2024-11-21 03:44:27.784458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.342 [2024-11-21 03:44:27.784483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.342 qpair failed and we were unable to recover it. 00:27:47.342 [2024-11-21 03:44:27.784613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.342 [2024-11-21 03:44:27.784766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.342 [2024-11-21 03:44:27.784791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.342 qpair failed and we were unable to recover it. 00:27:47.342 [2024-11-21 03:44:27.784947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.342 [2024-11-21 03:44:27.785042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.342 [2024-11-21 03:44:27.785067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.342 qpair failed and we were unable to recover it. 00:27:47.342 [2024-11-21 03:44:27.785193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.342 [2024-11-21 03:44:27.785334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.342 [2024-11-21 03:44:27.785359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.342 qpair failed and we were unable to recover it. 00:27:47.342 [2024-11-21 03:44:27.785466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.342 [2024-11-21 03:44:27.785600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.342 [2024-11-21 03:44:27.785626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.342 qpair failed and we were unable to recover it. 00:27:47.342 [2024-11-21 03:44:27.785763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.342 [2024-11-21 03:44:27.785885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.342 [2024-11-21 03:44:27.785910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.342 qpair failed and we were unable to recover it. 00:27:47.342 [2024-11-21 03:44:27.786018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.342 [2024-11-21 03:44:27.786120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.342 [2024-11-21 03:44:27.786146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.342 qpair failed and we were unable to recover it. 00:27:47.342 [2024-11-21 03:44:27.786251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.342 [2024-11-21 03:44:27.786382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.342 [2024-11-21 03:44:27.786407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.342 qpair failed and we were unable to recover it. 00:27:47.342 [2024-11-21 03:44:27.786579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.342 [2024-11-21 03:44:27.786673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.342 [2024-11-21 03:44:27.786698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.342 qpair failed and we were unable to recover it. 00:27:47.342 [2024-11-21 03:44:27.786804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.342 [2024-11-21 03:44:27.786957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.342 [2024-11-21 03:44:27.786983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.342 qpair failed and we were unable to recover it. 00:27:47.342 [2024-11-21 03:44:27.787112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.342 [2024-11-21 03:44:27.787242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.342 [2024-11-21 03:44:27.787266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.342 qpair failed and we were unable to recover it. 00:27:47.343 [2024-11-21 03:44:27.787374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.343 [2024-11-21 03:44:27.787497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.343 [2024-11-21 03:44:27.787521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.343 qpair failed and we were unable to recover it. 00:27:47.343 [2024-11-21 03:44:27.787680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.343 [2024-11-21 03:44:27.787835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.343 [2024-11-21 03:44:27.787861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.343 qpair failed and we were unable to recover it. 00:27:47.343 [2024-11-21 03:44:27.787990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.343 [2024-11-21 03:44:27.788086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.343 [2024-11-21 03:44:27.788111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.343 qpair failed and we were unable to recover it. 00:27:47.343 [2024-11-21 03:44:27.788217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.343 [2024-11-21 03:44:27.788314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.343 [2024-11-21 03:44:27.788340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.343 qpair failed and we were unable to recover it. 00:27:47.343 [2024-11-21 03:44:27.788469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.343 [2024-11-21 03:44:27.788590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.343 [2024-11-21 03:44:27.788615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.343 qpair failed and we were unable to recover it. 00:27:47.343 [2024-11-21 03:44:27.788720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.343 [2024-11-21 03:44:27.788813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.343 [2024-11-21 03:44:27.788838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.343 qpair failed and we were unable to recover it. 00:27:47.343 [2024-11-21 03:44:27.788946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.343 [2024-11-21 03:44:27.789082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.343 [2024-11-21 03:44:27.789109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.343 qpair failed and we were unable to recover it. 00:27:47.343 [2024-11-21 03:44:27.789242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.343 [2024-11-21 03:44:27.789371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.343 [2024-11-21 03:44:27.789398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.343 qpair failed and we were unable to recover it. 00:27:47.343 [2024-11-21 03:44:27.789499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.343 [2024-11-21 03:44:27.789602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.343 [2024-11-21 03:44:27.789627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.343 qpair failed and we were unable to recover it. 00:27:47.343 [2024-11-21 03:44:27.789756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.343 [2024-11-21 03:44:27.789891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.343 [2024-11-21 03:44:27.789916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.343 qpair failed and we were unable to recover it. 00:27:47.343 [2024-11-21 03:44:27.790014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.343 [2024-11-21 03:44:27.790126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.343 [2024-11-21 03:44:27.790175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.343 qpair failed and we were unable to recover it. 00:27:47.343 [2024-11-21 03:44:27.790320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.343 [2024-11-21 03:44:27.790417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.343 [2024-11-21 03:44:27.790443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.343 qpair failed and we were unable to recover it. 00:27:47.343 [2024-11-21 03:44:27.790548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.343 [2024-11-21 03:44:27.790684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.343 [2024-11-21 03:44:27.790709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.343 qpair failed and we were unable to recover it. 00:27:47.343 [2024-11-21 03:44:27.790847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.343 [2024-11-21 03:44:27.790950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.343 [2024-11-21 03:44:27.790975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.343 qpair failed and we were unable to recover it. 00:27:47.343 [2024-11-21 03:44:27.791108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.343 [2024-11-21 03:44:27.791206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.343 [2024-11-21 03:44:27.791231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.343 qpair failed and we were unable to recover it. 00:27:47.343 [2024-11-21 03:44:27.791358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.343 [2024-11-21 03:44:27.791447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.343 [2024-11-21 03:44:27.791472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.343 qpair failed and we were unable to recover it. 00:27:47.343 [2024-11-21 03:44:27.791603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.343 [2024-11-21 03:44:27.791726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.343 [2024-11-21 03:44:27.791751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.343 qpair failed and we were unable to recover it. 00:27:47.343 [2024-11-21 03:44:27.791909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.343 [2024-11-21 03:44:27.792073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.343 [2024-11-21 03:44:27.792099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.343 qpair failed and we were unable to recover it. 00:27:47.343 [2024-11-21 03:44:27.792234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.343 [2024-11-21 03:44:27.792361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.343 [2024-11-21 03:44:27.792386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.343 qpair failed and we were unable to recover it. 00:27:47.343 [2024-11-21 03:44:27.792491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.343 [2024-11-21 03:44:27.792595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.343 [2024-11-21 03:44:27.792620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.343 qpair failed and we were unable to recover it. 00:27:47.343 [2024-11-21 03:44:27.792757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.343 [2024-11-21 03:44:27.792910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.343 [2024-11-21 03:44:27.792936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.343 qpair failed and we were unable to recover it. 00:27:47.343 [2024-11-21 03:44:27.793037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.343 [2024-11-21 03:44:27.793178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.343 [2024-11-21 03:44:27.793204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.343 qpair failed and we were unable to recover it. 00:27:47.344 [2024-11-21 03:44:27.793316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.344 [2024-11-21 03:44:27.793414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.344 [2024-11-21 03:44:27.793439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.344 qpair failed and we were unable to recover it. 00:27:47.344 [2024-11-21 03:44:27.793541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.344 [2024-11-21 03:44:27.793698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.344 [2024-11-21 03:44:27.793724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.344 qpair failed and we were unable to recover it. 00:27:47.344 [2024-11-21 03:44:27.793847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.344 [2024-11-21 03:44:27.793950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.344 [2024-11-21 03:44:27.793975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.344 qpair failed and we were unable to recover it. 00:27:47.344 [2024-11-21 03:44:27.794083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.344 [2024-11-21 03:44:27.794212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.344 [2024-11-21 03:44:27.794237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.344 qpair failed and we were unable to recover it. 00:27:47.344 [2024-11-21 03:44:27.794342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.344 [2024-11-21 03:44:27.794474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.344 [2024-11-21 03:44:27.794500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.344 qpair failed and we were unable to recover it. 00:27:47.344 [2024-11-21 03:44:27.794626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.344 [2024-11-21 03:44:27.794754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.344 [2024-11-21 03:44:27.794780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.344 qpair failed and we were unable to recover it. 00:27:47.344 [2024-11-21 03:44:27.794882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.344 [2024-11-21 03:44:27.795040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.344 [2024-11-21 03:44:27.795065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.344 qpair failed and we were unable to recover it. 00:27:47.344 [2024-11-21 03:44:27.795206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.344 [2024-11-21 03:44:27.795361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.344 [2024-11-21 03:44:27.795387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.344 qpair failed and we were unable to recover it. 00:27:47.344 [2024-11-21 03:44:27.795486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.344 [2024-11-21 03:44:27.795639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.344 [2024-11-21 03:44:27.795664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.344 qpair failed and we were unable to recover it. 00:27:47.344 [2024-11-21 03:44:27.795765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.344 [2024-11-21 03:44:27.795900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.344 [2024-11-21 03:44:27.795926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.344 qpair failed and we were unable to recover it. 00:27:47.344 [2024-11-21 03:44:27.796058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.344 [2024-11-21 03:44:27.796200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.344 [2024-11-21 03:44:27.796226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.344 qpair failed and we were unable to recover it. 00:27:47.344 [2024-11-21 03:44:27.796336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.344 [2024-11-21 03:44:27.796466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.344 [2024-11-21 03:44:27.796491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.344 qpair failed and we were unable to recover it. 00:27:47.344 [2024-11-21 03:44:27.796604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.344 [2024-11-21 03:44:27.796766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.344 [2024-11-21 03:44:27.796792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.344 qpair failed and we were unable to recover it. 00:27:47.344 [2024-11-21 03:44:27.796950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.344 [2024-11-21 03:44:27.797094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.344 [2024-11-21 03:44:27.797120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.344 qpair failed and we were unable to recover it. 00:27:47.344 [2024-11-21 03:44:27.797215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.344 [2024-11-21 03:44:27.797338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.344 [2024-11-21 03:44:27.797368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.344 qpair failed and we were unable to recover it. 00:27:47.344 [2024-11-21 03:44:27.797526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.344 [2024-11-21 03:44:27.797664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.344 [2024-11-21 03:44:27.797690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.344 qpair failed and we were unable to recover it. 00:27:47.344 [2024-11-21 03:44:27.797847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.344 [2024-11-21 03:44:27.797950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.344 [2024-11-21 03:44:27.797977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.344 qpair failed and we were unable to recover it. 00:27:47.344 [2024-11-21 03:44:27.798082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.344 [2024-11-21 03:44:27.798206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.344 [2024-11-21 03:44:27.798231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.344 qpair failed and we were unable to recover it. 00:27:47.344 [2024-11-21 03:44:27.798358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.344 [2024-11-21 03:44:27.798452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.344 [2024-11-21 03:44:27.798477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.344 qpair failed and we were unable to recover it. 00:27:47.344 [2024-11-21 03:44:27.798578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.344 [2024-11-21 03:44:27.798703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.344 [2024-11-21 03:44:27.798729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.344 qpair failed and we were unable to recover it. 00:27:47.344 [2024-11-21 03:44:27.798869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.344 [2024-11-21 03:44:27.799000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.344 [2024-11-21 03:44:27.799025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.344 qpair failed and we were unable to recover it. 00:27:47.344 [2024-11-21 03:44:27.799166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.344 [2024-11-21 03:44:27.799295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.344 [2024-11-21 03:44:27.799320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.344 qpair failed and we were unable to recover it. 00:27:47.344 [2024-11-21 03:44:27.799413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.344 [2024-11-21 03:44:27.799519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.344 [2024-11-21 03:44:27.799545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.344 qpair failed and we were unable to recover it. 00:27:47.344 [2024-11-21 03:44:27.799638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.344 [2024-11-21 03:44:27.799750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.344 [2024-11-21 03:44:27.799775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.344 qpair failed and we were unable to recover it. 00:27:47.344 [2024-11-21 03:44:27.799910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.344 [2024-11-21 03:44:27.800039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.344 [2024-11-21 03:44:27.800074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.344 qpair failed and we were unable to recover it. 00:27:47.344 [2024-11-21 03:44:27.800181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.344 [2024-11-21 03:44:27.800290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.344 [2024-11-21 03:44:27.800316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.344 qpair failed and we were unable to recover it. 00:27:47.344 [2024-11-21 03:44:27.800424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.345 [2024-11-21 03:44:27.800548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.345 [2024-11-21 03:44:27.800574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.345 qpair failed and we were unable to recover it. 00:27:47.345 [2024-11-21 03:44:27.800687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.345 [2024-11-21 03:44:27.800853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.345 [2024-11-21 03:44:27.800878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.345 qpair failed and we were unable to recover it. 00:27:47.345 [2024-11-21 03:44:27.800993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.345 [2024-11-21 03:44:27.801113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.345 [2024-11-21 03:44:27.801140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.345 qpair failed and we were unable to recover it. 00:27:47.345 [2024-11-21 03:44:27.801269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.345 [2024-11-21 03:44:27.801425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.345 [2024-11-21 03:44:27.801452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.345 qpair failed and we were unable to recover it. 00:27:47.345 [2024-11-21 03:44:27.801586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.345 [2024-11-21 03:44:27.801742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.345 [2024-11-21 03:44:27.801768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.345 qpair failed and we were unable to recover it. 00:27:47.345 [2024-11-21 03:44:27.801867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.345 [2024-11-21 03:44:27.801994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.345 [2024-11-21 03:44:27.802019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.345 qpair failed and we were unable to recover it. 00:27:47.345 [2024-11-21 03:44:27.802121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.345 [2024-11-21 03:44:27.802257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.345 [2024-11-21 03:44:27.802282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.345 qpair failed and we were unable to recover it. 00:27:47.345 [2024-11-21 03:44:27.802410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.345 [2024-11-21 03:44:27.802509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.345 [2024-11-21 03:44:27.802534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.345 qpair failed and we were unable to recover it. 00:27:47.345 [2024-11-21 03:44:27.802629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.345 [2024-11-21 03:44:27.802723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.345 [2024-11-21 03:44:27.802748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.345 qpair failed and we were unable to recover it. 00:27:47.345 [2024-11-21 03:44:27.802884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.345 [2024-11-21 03:44:27.803010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.345 [2024-11-21 03:44:27.803034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.345 qpair failed and we were unable to recover it. 00:27:47.345 [2024-11-21 03:44:27.803174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.345 [2024-11-21 03:44:27.803307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.345 [2024-11-21 03:44:27.803332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.345 qpair failed and we were unable to recover it. 00:27:47.345 [2024-11-21 03:44:27.803433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.345 [2024-11-21 03:44:27.803555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.345 [2024-11-21 03:44:27.803581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.345 qpair failed and we were unable to recover it. 00:27:47.345 [2024-11-21 03:44:27.803704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.345 [2024-11-21 03:44:27.803803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.345 [2024-11-21 03:44:27.803828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.345 qpair failed and we were unable to recover it. 00:27:47.345 [2024-11-21 03:44:27.803953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.345 [2024-11-21 03:44:27.804081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.345 [2024-11-21 03:44:27.804107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.345 qpair failed and we were unable to recover it. 00:27:47.345 [2024-11-21 03:44:27.804242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.345 [2024-11-21 03:44:27.804400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.345 [2024-11-21 03:44:27.804425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.345 qpair failed and we were unable to recover it. 00:27:47.345 [2024-11-21 03:44:27.804549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.345 [2024-11-21 03:44:27.804684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.345 [2024-11-21 03:44:27.804709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.345 qpair failed and we were unable to recover it. 00:27:47.345 [2024-11-21 03:44:27.804841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.345 [2024-11-21 03:44:27.804943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.345 [2024-11-21 03:44:27.804969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.345 qpair failed and we were unable to recover it. 00:27:47.345 [2024-11-21 03:44:27.805100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.345 [2024-11-21 03:44:27.805200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.345 [2024-11-21 03:44:27.805226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.345 qpair failed and we were unable to recover it. 00:27:47.345 [2024-11-21 03:44:27.805358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.345 [2024-11-21 03:44:27.805526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.345 [2024-11-21 03:44:27.805551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.345 qpair failed and we were unable to recover it. 00:27:47.345 [2024-11-21 03:44:27.805711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.345 [2024-11-21 03:44:27.805835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.345 [2024-11-21 03:44:27.805860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.345 qpair failed and we were unable to recover it. 00:27:47.345 [2024-11-21 03:44:27.805989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.345 [2024-11-21 03:44:27.806155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.345 [2024-11-21 03:44:27.806181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.345 qpair failed and we were unable to recover it. 00:27:47.345 [2024-11-21 03:44:27.806277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.345 [2024-11-21 03:44:27.806400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.346 [2024-11-21 03:44:27.806425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.346 qpair failed and we were unable to recover it. 00:27:47.346 [2024-11-21 03:44:27.806543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.346 [2024-11-21 03:44:27.806635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.346 [2024-11-21 03:44:27.806660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.346 qpair failed and we were unable to recover it. 00:27:47.346 [2024-11-21 03:44:27.806760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.346 [2024-11-21 03:44:27.806912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.346 [2024-11-21 03:44:27.806938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.346 qpair failed and we were unable to recover it. 00:27:47.346 [2024-11-21 03:44:27.807037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.346 [2024-11-21 03:44:27.807164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.346 [2024-11-21 03:44:27.807191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.346 qpair failed and we were unable to recover it. 00:27:47.346 [2024-11-21 03:44:27.807289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.346 [2024-11-21 03:44:27.807425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.346 [2024-11-21 03:44:27.807450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.346 qpair failed and we were unable to recover it. 00:27:47.346 [2024-11-21 03:44:27.807611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.346 [2024-11-21 03:44:27.807711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.346 [2024-11-21 03:44:27.807736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.346 qpair failed and we were unable to recover it. 00:27:47.346 [2024-11-21 03:44:27.807840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.346 [2024-11-21 03:44:27.807965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.346 [2024-11-21 03:44:27.807990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.346 qpair failed and we were unable to recover it. 00:27:47.346 [2024-11-21 03:44:27.808080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.346 [2024-11-21 03:44:27.808206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.346 [2024-11-21 03:44:27.808231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.346 qpair failed and we were unable to recover it. 00:27:47.346 [2024-11-21 03:44:27.808338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.346 [2024-11-21 03:44:27.808451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.346 [2024-11-21 03:44:27.808476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.346 qpair failed and we were unable to recover it. 00:27:47.346 [2024-11-21 03:44:27.808614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.346 [2024-11-21 03:44:27.808725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.346 [2024-11-21 03:44:27.808751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.346 qpair failed and we were unable to recover it. 00:27:47.346 [2024-11-21 03:44:27.808880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.346 [2024-11-21 03:44:27.809010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.346 [2024-11-21 03:44:27.809036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.346 qpair failed and we were unable to recover it. 00:27:47.346 [2024-11-21 03:44:27.809140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.346 [2024-11-21 03:44:27.809268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.346 [2024-11-21 03:44:27.809294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.346 qpair failed and we were unable to recover it. 00:27:47.346 [2024-11-21 03:44:27.809454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.346 [2024-11-21 03:44:27.809585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.346 [2024-11-21 03:44:27.809610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.346 qpair failed and we were unable to recover it. 00:27:47.346 [2024-11-21 03:44:27.809711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.346 [2024-11-21 03:44:27.809838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.346 [2024-11-21 03:44:27.809864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.346 qpair failed and we were unable to recover it. 00:27:47.346 [2024-11-21 03:44:27.809996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.346 [2024-11-21 03:44:27.810096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.346 [2024-11-21 03:44:27.810123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.346 qpair failed and we were unable to recover it. 00:27:47.346 [2024-11-21 03:44:27.810233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.346 [2024-11-21 03:44:27.810363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.346 [2024-11-21 03:44:27.810388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.346 qpair failed and we were unable to recover it. 00:27:47.346 [2024-11-21 03:44:27.810487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.346 [2024-11-21 03:44:27.810625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.346 [2024-11-21 03:44:27.810650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.346 qpair failed and we were unable to recover it. 00:27:47.346 [2024-11-21 03:44:27.810751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.346 [2024-11-21 03:44:27.810877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.346 [2024-11-21 03:44:27.810902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.346 qpair failed and we were unable to recover it. 00:27:47.346 [2024-11-21 03:44:27.811062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.346 [2024-11-21 03:44:27.811174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.346 [2024-11-21 03:44:27.811200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.346 qpair failed and we were unable to recover it. 00:27:47.346 [2024-11-21 03:44:27.811329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.346 [2024-11-21 03:44:27.811483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.346 [2024-11-21 03:44:27.811508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.346 qpair failed and we were unable to recover it. 00:27:47.346 [2024-11-21 03:44:27.811639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.346 [2024-11-21 03:44:27.811795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.346 [2024-11-21 03:44:27.811821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.346 qpair failed and we were unable to recover it. 00:27:47.346 [2024-11-21 03:44:27.811956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.346 [2024-11-21 03:44:27.812106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.346 [2024-11-21 03:44:27.812133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.346 qpair failed and we were unable to recover it. 00:27:47.346 [2024-11-21 03:44:27.812234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.346 [2024-11-21 03:44:27.812372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.346 [2024-11-21 03:44:27.812398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.346 qpair failed and we were unable to recover it. 00:27:47.346 [2024-11-21 03:44:27.812557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.346 [2024-11-21 03:44:27.812656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.346 [2024-11-21 03:44:27.812681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.346 qpair failed and we were unable to recover it. 00:27:47.346 [2024-11-21 03:44:27.812810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.346 [2024-11-21 03:44:27.812916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.346 [2024-11-21 03:44:27.812941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.346 qpair failed and we were unable to recover it. 00:27:47.346 [2024-11-21 03:44:27.813078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.346 [2024-11-21 03:44:27.813240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.346 [2024-11-21 03:44:27.813265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.346 qpair failed and we were unable to recover it. 00:27:47.346 [2024-11-21 03:44:27.813407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.346 [2024-11-21 03:44:27.813507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.347 [2024-11-21 03:44:27.813533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.347 qpair failed and we were unable to recover it. 00:27:47.347 [2024-11-21 03:44:27.813644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.347 [2024-11-21 03:44:27.813747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.347 [2024-11-21 03:44:27.813772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.347 qpair failed and we were unable to recover it. 00:27:47.347 [2024-11-21 03:44:27.813870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.347 [2024-11-21 03:44:27.813992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.347 [2024-11-21 03:44:27.814021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.347 qpair failed and we were unable to recover it. 00:27:47.347 [2024-11-21 03:44:27.814146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.347 [2024-11-21 03:44:27.814301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.347 [2024-11-21 03:44:27.814325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.347 qpair failed and we were unable to recover it. 00:27:47.347 [2024-11-21 03:44:27.814428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.347 [2024-11-21 03:44:27.814556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.347 [2024-11-21 03:44:27.814582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.347 qpair failed and we were unable to recover it. 00:27:47.347 [2024-11-21 03:44:27.814747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.347 [2024-11-21 03:44:27.814875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.347 [2024-11-21 03:44:27.814900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.347 qpair failed and we were unable to recover it. 00:27:47.347 [2024-11-21 03:44:27.815027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.347 [2024-11-21 03:44:27.815166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.347 [2024-11-21 03:44:27.815193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.347 qpair failed and we were unable to recover it. 00:27:47.347 [2024-11-21 03:44:27.815325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.347 [2024-11-21 03:44:27.815457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.347 [2024-11-21 03:44:27.815482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.347 qpair failed and we were unable to recover it. 00:27:47.347 [2024-11-21 03:44:27.815587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.347 [2024-11-21 03:44:27.815691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.347 [2024-11-21 03:44:27.815718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.347 qpair failed and we were unable to recover it. 00:27:47.347 [2024-11-21 03:44:27.815841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.347 [2024-11-21 03:44:27.815937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.347 [2024-11-21 03:44:27.815962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.347 qpair failed and we were unable to recover it. 00:27:47.347 [2024-11-21 03:44:27.816088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.347 [2024-11-21 03:44:27.816203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.347 [2024-11-21 03:44:27.816228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.347 qpair failed and we were unable to recover it. 00:27:47.347 [2024-11-21 03:44:27.816341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.347 [2024-11-21 03:44:27.816500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.347 [2024-11-21 03:44:27.816525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.347 qpair failed and we were unable to recover it. 00:27:47.347 [2024-11-21 03:44:27.816639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.347 [2024-11-21 03:44:27.816765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.347 [2024-11-21 03:44:27.816790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.347 qpair failed and we were unable to recover it. 00:27:47.347 [2024-11-21 03:44:27.816920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.347 [2024-11-21 03:44:27.817047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.347 [2024-11-21 03:44:27.817092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.347 qpair failed and we were unable to recover it. 00:27:47.347 [2024-11-21 03:44:27.817198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.347 [2024-11-21 03:44:27.817331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.347 [2024-11-21 03:44:27.817357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.347 qpair failed and we were unable to recover it. 00:27:47.347 [2024-11-21 03:44:27.817496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.347 [2024-11-21 03:44:27.817621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.347 [2024-11-21 03:44:27.817646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.347 qpair failed and we were unable to recover it. 00:27:47.347 [2024-11-21 03:44:27.817774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.347 [2024-11-21 03:44:27.817869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.347 [2024-11-21 03:44:27.817894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.347 qpair failed and we were unable to recover it. 00:27:47.347 [2024-11-21 03:44:27.818051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.347 [2024-11-21 03:44:27.818194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.347 [2024-11-21 03:44:27.818220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.347 qpair failed and we were unable to recover it. 00:27:47.347 [2024-11-21 03:44:27.818330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.347 [2024-11-21 03:44:27.818462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.347 [2024-11-21 03:44:27.818487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.347 qpair failed and we were unable to recover it. 00:27:47.347 [2024-11-21 03:44:27.818596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.347 [2024-11-21 03:44:27.818732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.347 [2024-11-21 03:44:27.818757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.347 qpair failed and we were unable to recover it. 00:27:47.347 [2024-11-21 03:44:27.818884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.347 [2024-11-21 03:44:27.819015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.347 [2024-11-21 03:44:27.819040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.347 qpair failed and we were unable to recover it. 00:27:47.347 [2024-11-21 03:44:27.819175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.347 [2024-11-21 03:44:27.819306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.347 [2024-11-21 03:44:27.819331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.347 qpair failed and we were unable to recover it. 00:27:47.347 [2024-11-21 03:44:27.819439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.347 [2024-11-21 03:44:27.819569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.347 [2024-11-21 03:44:27.819595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.347 qpair failed and we were unable to recover it. 00:27:47.347 [2024-11-21 03:44:27.819737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.347 [2024-11-21 03:44:27.819868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.347 [2024-11-21 03:44:27.819893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.347 qpair failed and we were unable to recover it. 00:27:47.347 [2024-11-21 03:44:27.819990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.347 [2024-11-21 03:44:27.820111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.347 [2024-11-21 03:44:27.820137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.347 qpair failed and we were unable to recover it. 00:27:47.347 [2024-11-21 03:44:27.820261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.347 [2024-11-21 03:44:27.820393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.347 [2024-11-21 03:44:27.820419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.347 qpair failed and we were unable to recover it. 00:27:47.347 [2024-11-21 03:44:27.820554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.347 [2024-11-21 03:44:27.820681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.348 [2024-11-21 03:44:27.820706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.348 qpair failed and we were unable to recover it. 00:27:47.348 [2024-11-21 03:44:27.820827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.348 [2024-11-21 03:44:27.820925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.348 [2024-11-21 03:44:27.820950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.348 qpair failed and we were unable to recover it. 00:27:47.348 [2024-11-21 03:44:27.821106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.348 [2024-11-21 03:44:27.821260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.348 [2024-11-21 03:44:27.821285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.348 qpair failed and we were unable to recover it. 00:27:47.348 [2024-11-21 03:44:27.821440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.348 [2024-11-21 03:44:27.821542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.348 [2024-11-21 03:44:27.821568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.348 qpair failed and we were unable to recover it. 00:27:47.348 [2024-11-21 03:44:27.821697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.348 [2024-11-21 03:44:27.821802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.348 [2024-11-21 03:44:27.821829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.348 qpair failed and we were unable to recover it. 00:27:47.348 [2024-11-21 03:44:27.821969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.348 [2024-11-21 03:44:27.822098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.348 [2024-11-21 03:44:27.822124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.348 qpair failed and we were unable to recover it. 00:27:47.348 [2024-11-21 03:44:27.822226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.348 [2024-11-21 03:44:27.822353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.348 [2024-11-21 03:44:27.822378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.348 qpair failed and we were unable to recover it. 00:27:47.348 [2024-11-21 03:44:27.822509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.348 [2024-11-21 03:44:27.822638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.348 [2024-11-21 03:44:27.822665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.348 qpair failed and we were unable to recover it. 00:27:47.348 [2024-11-21 03:44:27.822828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.348 [2024-11-21 03:44:27.822951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.348 [2024-11-21 03:44:27.822977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.348 qpair failed and we were unable to recover it. 00:27:47.348 [2024-11-21 03:44:27.823112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.348 [2024-11-21 03:44:27.823268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.348 [2024-11-21 03:44:27.823293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.348 qpair failed and we were unable to recover it. 00:27:47.348 [2024-11-21 03:44:27.823390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.348 [2024-11-21 03:44:27.823520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.348 [2024-11-21 03:44:27.823545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.348 qpair failed and we were unable to recover it. 00:27:47.348 [2024-11-21 03:44:27.823701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.348 [2024-11-21 03:44:27.823827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.348 [2024-11-21 03:44:27.823852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.348 qpair failed and we were unable to recover it. 00:27:47.348 [2024-11-21 03:44:27.824009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.348 [2024-11-21 03:44:27.824139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.348 [2024-11-21 03:44:27.824165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.348 qpair failed and we were unable to recover it. 00:27:47.348 [2024-11-21 03:44:27.824266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.348 [2024-11-21 03:44:27.824399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.348 [2024-11-21 03:44:27.824426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.348 qpair failed and we were unable to recover it. 00:27:47.348 [2024-11-21 03:44:27.824562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.348 [2024-11-21 03:44:27.824683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.348 [2024-11-21 03:44:27.824709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.348 qpair failed and we were unable to recover it. 00:27:47.348 [2024-11-21 03:44:27.824807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.348 [2024-11-21 03:44:27.824961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.348 [2024-11-21 03:44:27.824986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.348 qpair failed and we were unable to recover it. 00:27:47.348 [2024-11-21 03:44:27.825108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.348 [2024-11-21 03:44:27.825240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.348 [2024-11-21 03:44:27.825265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.348 qpair failed and we were unable to recover it. 00:27:47.348 [2024-11-21 03:44:27.825399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.348 [2024-11-21 03:44:27.825555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.348 [2024-11-21 03:44:27.825582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.348 qpair failed and we were unable to recover it. 00:27:47.348 [2024-11-21 03:44:27.825717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.348 [2024-11-21 03:44:27.825844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.348 [2024-11-21 03:44:27.825870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.348 qpair failed and we were unable to recover it. 00:27:47.348 [2024-11-21 03:44:27.825994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.348 [2024-11-21 03:44:27.826097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.348 [2024-11-21 03:44:27.826123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.348 qpair failed and we were unable to recover it. 00:27:47.348 [2024-11-21 03:44:27.826278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.349 [2024-11-21 03:44:27.826401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.349 [2024-11-21 03:44:27.826426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.349 qpair failed and we were unable to recover it. 00:27:47.349 [2024-11-21 03:44:27.826562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.349 [2024-11-21 03:44:27.826658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.349 [2024-11-21 03:44:27.826684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.349 qpair failed and we were unable to recover it. 00:27:47.349 [2024-11-21 03:44:27.826790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.349 [2024-11-21 03:44:27.826946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.349 [2024-11-21 03:44:27.826972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.349 qpair failed and we were unable to recover it. 00:27:47.349 [2024-11-21 03:44:27.827079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.349 [2024-11-21 03:44:27.827184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.349 [2024-11-21 03:44:27.827210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.349 qpair failed and we were unable to recover it. 00:27:47.349 [2024-11-21 03:44:27.827307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.349 [2024-11-21 03:44:27.827401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.349 [2024-11-21 03:44:27.827426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.349 qpair failed and we were unable to recover it. 00:27:47.349 [2024-11-21 03:44:27.827557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.349 [2024-11-21 03:44:27.827689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.349 [2024-11-21 03:44:27.827714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.349 qpair failed and we were unable to recover it. 00:27:47.349 [2024-11-21 03:44:27.827825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.349 [2024-11-21 03:44:27.827952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.349 [2024-11-21 03:44:27.827978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.349 qpair failed and we were unable to recover it. 00:27:47.349 [2024-11-21 03:44:27.828106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.349 [2024-11-21 03:44:27.828211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.349 [2024-11-21 03:44:27.828241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.349 qpair failed and we were unable to recover it. 00:27:47.349 [2024-11-21 03:44:27.828366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.349 [2024-11-21 03:44:27.828464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.349 [2024-11-21 03:44:27.828489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.349 qpair failed and we were unable to recover it. 00:27:47.349 [2024-11-21 03:44:27.828616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.349 [2024-11-21 03:44:27.828740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.349 [2024-11-21 03:44:27.828766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.349 qpair failed and we were unable to recover it. 00:27:47.349 [2024-11-21 03:44:27.828895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.349 [2024-11-21 03:44:27.829015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.349 [2024-11-21 03:44:27.829041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.349 qpair failed and we were unable to recover it. 00:27:47.349 [2024-11-21 03:44:27.829148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.349 [2024-11-21 03:44:27.829253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.349 [2024-11-21 03:44:27.829279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.349 qpair failed and we were unable to recover it. 00:27:47.349 [2024-11-21 03:44:27.829410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.349 [2024-11-21 03:44:27.829540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.349 [2024-11-21 03:44:27.829566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.349 qpair failed and we were unable to recover it. 00:27:47.349 [2024-11-21 03:44:27.829700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.349 [2024-11-21 03:44:27.829860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.349 [2024-11-21 03:44:27.829885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.349 qpair failed and we were unable to recover it. 00:27:47.349 [2024-11-21 03:44:27.830039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.349 [2024-11-21 03:44:27.830147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.349 [2024-11-21 03:44:27.830173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.349 qpair failed and we were unable to recover it. 00:27:47.349 [2024-11-21 03:44:27.830299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.349 [2024-11-21 03:44:27.830398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.349 [2024-11-21 03:44:27.830423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.349 qpair failed and we were unable to recover it. 00:27:47.349 [2024-11-21 03:44:27.830578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.349 [2024-11-21 03:44:27.830680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.349 [2024-11-21 03:44:27.830706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.349 qpair failed and we were unable to recover it. 00:27:47.349 [2024-11-21 03:44:27.830837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.349 [2024-11-21 03:44:27.830964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.349 [2024-11-21 03:44:27.830989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.349 qpair failed and we were unable to recover it. 00:27:47.349 [2024-11-21 03:44:27.831128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.349 [2024-11-21 03:44:27.831259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.349 [2024-11-21 03:44:27.831284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.349 qpair failed and we were unable to recover it. 00:27:47.349 [2024-11-21 03:44:27.831378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.349 [2024-11-21 03:44:27.831493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.349 [2024-11-21 03:44:27.831518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.349 qpair failed and we were unable to recover it. 00:27:47.349 [2024-11-21 03:44:27.831650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.349 [2024-11-21 03:44:27.831804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.349 [2024-11-21 03:44:27.831829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.349 qpair failed and we were unable to recover it. 00:27:47.349 [2024-11-21 03:44:27.831961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.349 [2024-11-21 03:44:27.832062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.349 [2024-11-21 03:44:27.832094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.349 qpair failed and we were unable to recover it. 00:27:47.349 [2024-11-21 03:44:27.832198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.349 [2024-11-21 03:44:27.832305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.349 [2024-11-21 03:44:27.832331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.349 qpair failed and we were unable to recover it. 00:27:47.349 [2024-11-21 03:44:27.832436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.349 [2024-11-21 03:44:27.832604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.349 [2024-11-21 03:44:27.832630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.350 qpair failed and we were unable to recover it. 00:27:47.350 [2024-11-21 03:44:27.832757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.350 [2024-11-21 03:44:27.832923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.350 [2024-11-21 03:44:27.832949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.350 qpair failed and we were unable to recover it. 00:27:47.350 [2024-11-21 03:44:27.833091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.350 [2024-11-21 03:44:27.833192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.350 [2024-11-21 03:44:27.833217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.350 qpair failed and we were unable to recover it. 00:27:47.350 [2024-11-21 03:44:27.833374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.350 [2024-11-21 03:44:27.833501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.350 [2024-11-21 03:44:27.833527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.350 qpair failed and we were unable to recover it. 00:27:47.350 [2024-11-21 03:44:27.833639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.350 [2024-11-21 03:44:27.833793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.350 [2024-11-21 03:44:27.833818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.350 qpair failed and we were unable to recover it. 00:27:47.350 [2024-11-21 03:44:27.833933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.350 [2024-11-21 03:44:27.834058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.350 [2024-11-21 03:44:27.834090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.350 qpair failed and we were unable to recover it. 00:27:47.350 [2024-11-21 03:44:27.834202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.350 [2024-11-21 03:44:27.834344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.350 [2024-11-21 03:44:27.834369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.350 qpair failed and we were unable to recover it. 00:27:47.350 [2024-11-21 03:44:27.834525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.350 [2024-11-21 03:44:27.834653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.350 [2024-11-21 03:44:27.834679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.350 qpair failed and we were unable to recover it. 00:27:47.350 [2024-11-21 03:44:27.834805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.350 [2024-11-21 03:44:27.834897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.350 [2024-11-21 03:44:27.834922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.350 qpair failed and we were unable to recover it. 00:27:47.350 [2024-11-21 03:44:27.835022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.350 [2024-11-21 03:44:27.835129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.350 [2024-11-21 03:44:27.835154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.350 qpair failed and we were unable to recover it. 00:27:47.350 [2024-11-21 03:44:27.835281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.350 [2024-11-21 03:44:27.835379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.350 [2024-11-21 03:44:27.835404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.350 qpair failed and we were unable to recover it. 00:27:47.350 [2024-11-21 03:44:27.835529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.350 [2024-11-21 03:44:27.835665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.350 [2024-11-21 03:44:27.835690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.350 qpair failed and we were unable to recover it. 00:27:47.350 [2024-11-21 03:44:27.835823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.350 [2024-11-21 03:44:27.835922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.350 [2024-11-21 03:44:27.835948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.350 qpair failed and we were unable to recover it. 00:27:47.350 [2024-11-21 03:44:27.836047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.350 [2024-11-21 03:44:27.836210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.350 [2024-11-21 03:44:27.836235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.350 qpair failed and we were unable to recover it. 00:27:47.350 [2024-11-21 03:44:27.836372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.350 [2024-11-21 03:44:27.836494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.350 [2024-11-21 03:44:27.836520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.350 qpair failed and we were unable to recover it. 00:27:47.350 [2024-11-21 03:44:27.836682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.350 [2024-11-21 03:44:27.836805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.350 [2024-11-21 03:44:27.836832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.350 qpair failed and we were unable to recover it. 00:27:47.350 [2024-11-21 03:44:27.836934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.350 [2024-11-21 03:44:27.837064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.350 [2024-11-21 03:44:27.837110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.350 qpair failed and we were unable to recover it. 00:27:47.350 [2024-11-21 03:44:27.837206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.350 [2024-11-21 03:44:27.837312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.350 [2024-11-21 03:44:27.837339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.350 qpair failed and we were unable to recover it. 00:27:47.350 [2024-11-21 03:44:27.837505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.350 [2024-11-21 03:44:27.837637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.350 [2024-11-21 03:44:27.837662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.350 qpair failed and we were unable to recover it. 00:27:47.350 [2024-11-21 03:44:27.837808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.350 [2024-11-21 03:44:27.837939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.350 [2024-11-21 03:44:27.837964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.350 qpair failed and we were unable to recover it. 00:27:47.350 [2024-11-21 03:44:27.838088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.350 [2024-11-21 03:44:27.838183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.350 [2024-11-21 03:44:27.838209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.350 qpair failed and we were unable to recover it. 00:27:47.350 [2024-11-21 03:44:27.838364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.350 [2024-11-21 03:44:27.838531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.350 [2024-11-21 03:44:27.838556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.350 qpair failed and we were unable to recover it. 00:27:47.350 [2024-11-21 03:44:27.838657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.350 [2024-11-21 03:44:27.838761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.350 [2024-11-21 03:44:27.838787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.350 qpair failed and we were unable to recover it. 00:27:47.350 [2024-11-21 03:44:27.838925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.350 [2024-11-21 03:44:27.839027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.350 [2024-11-21 03:44:27.839052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.350 qpair failed and we were unable to recover it. 00:27:47.350 [2024-11-21 03:44:27.839161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.350 [2024-11-21 03:44:27.839293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.351 [2024-11-21 03:44:27.839319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.351 qpair failed and we were unable to recover it. 00:27:47.351 [2024-11-21 03:44:27.839446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.351 [2024-11-21 03:44:27.839549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.351 [2024-11-21 03:44:27.839575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.351 qpair failed and we were unable to recover it. 00:27:47.351 [2024-11-21 03:44:27.839710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.351 [2024-11-21 03:44:27.839805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.351 [2024-11-21 03:44:27.839830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.351 qpair failed and we were unable to recover it. 00:27:47.351 [2024-11-21 03:44:27.839982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.351 [2024-11-21 03:44:27.840080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.351 [2024-11-21 03:44:27.840106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.351 qpair failed and we were unable to recover it. 00:27:47.351 [2024-11-21 03:44:27.840232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.351 [2024-11-21 03:44:27.840327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.351 [2024-11-21 03:44:27.840352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.351 qpair failed and we were unable to recover it. 00:27:47.351 [2024-11-21 03:44:27.840453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.351 [2024-11-21 03:44:27.840561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.351 [2024-11-21 03:44:27.840587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.351 qpair failed and we were unable to recover it. 00:27:47.351 [2024-11-21 03:44:27.840730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.351 [2024-11-21 03:44:27.840856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.351 [2024-11-21 03:44:27.840881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.351 qpair failed and we were unable to recover it. 00:27:47.351 [2024-11-21 03:44:27.841036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.351 [2024-11-21 03:44:27.841166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.351 [2024-11-21 03:44:27.841192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.351 qpair failed and we were unable to recover it. 00:27:47.351 [2024-11-21 03:44:27.841291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.351 [2024-11-21 03:44:27.841386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.351 [2024-11-21 03:44:27.841413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.351 qpair failed and we were unable to recover it. 00:27:47.351 [2024-11-21 03:44:27.841513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.351 [2024-11-21 03:44:27.841663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.351 [2024-11-21 03:44:27.841688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.351 qpair failed and we were unable to recover it. 00:27:47.351 [2024-11-21 03:44:27.841783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.351 [2024-11-21 03:44:27.841942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.351 [2024-11-21 03:44:27.841968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.351 qpair failed and we were unable to recover it. 00:27:47.351 [2024-11-21 03:44:27.842124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.351 [2024-11-21 03:44:27.842217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.351 [2024-11-21 03:44:27.842246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.351 qpair failed and we were unable to recover it. 00:27:47.351 [2024-11-21 03:44:27.842350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.351 [2024-11-21 03:44:27.842454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.351 [2024-11-21 03:44:27.842479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.351 qpair failed and we were unable to recover it. 00:27:47.351 [2024-11-21 03:44:27.842574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.351 [2024-11-21 03:44:27.842696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.351 [2024-11-21 03:44:27.842721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.351 qpair failed and we were unable to recover it. 00:27:47.351 [2024-11-21 03:44:27.842828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.351 [2024-11-21 03:44:27.842931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.351 [2024-11-21 03:44:27.842956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.351 qpair failed and we were unable to recover it. 00:27:47.351 [2024-11-21 03:44:27.843113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.351 [2024-11-21 03:44:27.843209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.351 [2024-11-21 03:44:27.843234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.351 qpair failed and we were unable to recover it. 00:27:47.351 [2024-11-21 03:44:27.843390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.351 [2024-11-21 03:44:27.843511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.351 [2024-11-21 03:44:27.843537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.351 qpair failed and we were unable to recover it. 00:27:47.351 [2024-11-21 03:44:27.843637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.351 [2024-11-21 03:44:27.843734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.351 [2024-11-21 03:44:27.843760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.351 qpair failed and we were unable to recover it. 00:27:47.351 [2024-11-21 03:44:27.843854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.351 [2024-11-21 03:44:27.843983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.351 [2024-11-21 03:44:27.844010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.351 qpair failed and we were unable to recover it. 00:27:47.351 [2024-11-21 03:44:27.844146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.351 [2024-11-21 03:44:27.844282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.351 [2024-11-21 03:44:27.844307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.351 qpair failed and we were unable to recover it. 00:27:47.351 [2024-11-21 03:44:27.844409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.351 [2024-11-21 03:44:27.844565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.351 [2024-11-21 03:44:27.844590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.351 qpair failed and we were unable to recover it. 00:27:47.351 [2024-11-21 03:44:27.844746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.351 [2024-11-21 03:44:27.844874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.351 [2024-11-21 03:44:27.844903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.351 qpair failed and we were unable to recover it. 00:27:47.351 [2024-11-21 03:44:27.845005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.351 [2024-11-21 03:44:27.845104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.351 [2024-11-21 03:44:27.845130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.351 qpair failed and we were unable to recover it. 00:27:47.351 [2024-11-21 03:44:27.845255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.351 [2024-11-21 03:44:27.845356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.351 [2024-11-21 03:44:27.845381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.351 qpair failed and we were unable to recover it. 00:27:47.351 [2024-11-21 03:44:27.845516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.351 [2024-11-21 03:44:27.845611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.351 [2024-11-21 03:44:27.845636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.351 qpair failed and we were unable to recover it. 00:27:47.351 [2024-11-21 03:44:27.845734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.351 [2024-11-21 03:44:27.845858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.351 [2024-11-21 03:44:27.845884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.351 qpair failed and we were unable to recover it. 00:27:47.351 [2024-11-21 03:44:27.846048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.352 [2024-11-21 03:44:27.846147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.352 [2024-11-21 03:44:27.846173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.352 qpair failed and we were unable to recover it. 00:27:47.352 [2024-11-21 03:44:27.846341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.352 [2024-11-21 03:44:27.846474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.352 [2024-11-21 03:44:27.846499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.352 qpair failed and we were unable to recover it. 00:27:47.352 [2024-11-21 03:44:27.846601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.352 [2024-11-21 03:44:27.846731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.352 [2024-11-21 03:44:27.846756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.352 qpair failed and we were unable to recover it. 00:27:47.352 [2024-11-21 03:44:27.846890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.352 [2024-11-21 03:44:27.847013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.352 [2024-11-21 03:44:27.847038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.352 qpair failed and we were unable to recover it. 00:27:47.352 [2024-11-21 03:44:27.847148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.352 [2024-11-21 03:44:27.847249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.352 [2024-11-21 03:44:27.847274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.352 qpair failed and we were unable to recover it. 00:27:47.352 [2024-11-21 03:44:27.847368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.352 [2024-11-21 03:44:27.847523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.352 [2024-11-21 03:44:27.847548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.352 qpair failed and we were unable to recover it. 00:27:47.352 [2024-11-21 03:44:27.847676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.352 [2024-11-21 03:44:27.847806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.352 [2024-11-21 03:44:27.847831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.352 qpair failed and we were unable to recover it. 00:27:47.352 [2024-11-21 03:44:27.847953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.352 [2024-11-21 03:44:27.848047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.352 [2024-11-21 03:44:27.848078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.352 qpair failed and we were unable to recover it. 00:27:47.352 [2024-11-21 03:44:27.848220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.352 [2024-11-21 03:44:27.848375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.352 [2024-11-21 03:44:27.848400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.352 qpair failed and we were unable to recover it. 00:27:47.352 [2024-11-21 03:44:27.848554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.352 [2024-11-21 03:44:27.848658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.352 [2024-11-21 03:44:27.848684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.352 qpair failed and we were unable to recover it. 00:27:47.352 [2024-11-21 03:44:27.848818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.352 [2024-11-21 03:44:27.848947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.352 [2024-11-21 03:44:27.848973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.352 qpair failed and we were unable to recover it. 00:27:47.352 [2024-11-21 03:44:27.849096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.352 [2024-11-21 03:44:27.849198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.352 [2024-11-21 03:44:27.849223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.352 qpair failed and we were unable to recover it. 00:27:47.352 [2024-11-21 03:44:27.849355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.352 [2024-11-21 03:44:27.849451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.352 [2024-11-21 03:44:27.849476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.352 qpair failed and we were unable to recover it. 00:27:47.352 [2024-11-21 03:44:27.849578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.352 [2024-11-21 03:44:27.849702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.352 [2024-11-21 03:44:27.849727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.352 qpair failed and we were unable to recover it. 00:27:47.352 [2024-11-21 03:44:27.849851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.352 [2024-11-21 03:44:27.850009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.352 [2024-11-21 03:44:27.850034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.352 qpair failed and we were unable to recover it. 00:27:47.352 [2024-11-21 03:44:27.850134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.352 [2024-11-21 03:44:27.850269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.352 [2024-11-21 03:44:27.850294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.352 qpair failed and we were unable to recover it. 00:27:47.352 [2024-11-21 03:44:27.850459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.352 [2024-11-21 03:44:27.850611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.352 [2024-11-21 03:44:27.850636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.352 qpair failed and we were unable to recover it. 00:27:47.352 [2024-11-21 03:44:27.850766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.352 [2024-11-21 03:44:27.850905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.352 [2024-11-21 03:44:27.850931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.352 qpair failed and we were unable to recover it. 00:27:47.352 [2024-11-21 03:44:27.851026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.352 [2024-11-21 03:44:27.851156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.352 [2024-11-21 03:44:27.851182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.352 qpair failed and we were unable to recover it. 00:27:47.352 [2024-11-21 03:44:27.851314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.352 [2024-11-21 03:44:27.851440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.352 [2024-11-21 03:44:27.851465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.352 qpair failed and we were unable to recover it. 00:27:47.352 [2024-11-21 03:44:27.851596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.352 [2024-11-21 03:44:27.851723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.352 [2024-11-21 03:44:27.851749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.352 qpair failed and we were unable to recover it. 00:27:47.352 [2024-11-21 03:44:27.851843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.352 [2024-11-21 03:44:27.851968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.352 [2024-11-21 03:44:27.851993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.352 qpair failed and we were unable to recover it. 00:27:47.352 [2024-11-21 03:44:27.852093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.352 [2024-11-21 03:44:27.852196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.352 [2024-11-21 03:44:27.852222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.352 qpair failed and we were unable to recover it. 00:27:47.352 [2024-11-21 03:44:27.852330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.352 [2024-11-21 03:44:27.852433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.352 [2024-11-21 03:44:27.852458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.352 qpair failed and we were unable to recover it. 00:27:47.352 [2024-11-21 03:44:27.852582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.353 [2024-11-21 03:44:27.852708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.353 [2024-11-21 03:44:27.852734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.353 qpair failed and we were unable to recover it. 00:27:47.353 [2024-11-21 03:44:27.852836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.353 [2024-11-21 03:44:27.852936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.353 [2024-11-21 03:44:27.852961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.353 qpair failed and we were unable to recover it. 00:27:47.353 [2024-11-21 03:44:27.853067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.353 [2024-11-21 03:44:27.853190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.353 [2024-11-21 03:44:27.853217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.353 qpair failed and we were unable to recover it. 00:27:47.353 [2024-11-21 03:44:27.853320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.353 [2024-11-21 03:44:27.853421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.353 [2024-11-21 03:44:27.853446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.353 qpair failed and we were unable to recover it. 00:27:47.353 [2024-11-21 03:44:27.853573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.353 [2024-11-21 03:44:27.853704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.353 [2024-11-21 03:44:27.853729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.353 qpair failed and we were unable to recover it. 00:27:47.353 [2024-11-21 03:44:27.853826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.353 [2024-11-21 03:44:27.853960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.353 [2024-11-21 03:44:27.853986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.353 qpair failed and we were unable to recover it. 00:27:47.353 [2024-11-21 03:44:27.854109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.353 [2024-11-21 03:44:27.854236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.353 [2024-11-21 03:44:27.854262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.353 qpair failed and we were unable to recover it. 00:27:47.353 [2024-11-21 03:44:27.854395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.353 [2024-11-21 03:44:27.854496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.353 [2024-11-21 03:44:27.854521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.353 qpair failed and we were unable to recover it. 00:27:47.353 [2024-11-21 03:44:27.854617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.353 [2024-11-21 03:44:27.854747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.353 [2024-11-21 03:44:27.854774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.353 qpair failed and we were unable to recover it. 00:27:47.353 [2024-11-21 03:44:27.854905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.353 [2024-11-21 03:44:27.855003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.353 [2024-11-21 03:44:27.855029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.353 qpair failed and we were unable to recover it. 00:27:47.353 [2024-11-21 03:44:27.855165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.353 [2024-11-21 03:44:27.855291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.353 [2024-11-21 03:44:27.855316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.353 qpair failed and we were unable to recover it. 00:27:47.353 [2024-11-21 03:44:27.855473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.353 [2024-11-21 03:44:27.855599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.353 [2024-11-21 03:44:27.855626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.353 qpair failed and we were unable to recover it. 00:27:47.353 [2024-11-21 03:44:27.855755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.353 [2024-11-21 03:44:27.855902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.353 [2024-11-21 03:44:27.855928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.353 qpair failed and we were unable to recover it. 00:27:47.353 [2024-11-21 03:44:27.856063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.353 [2024-11-21 03:44:27.856174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.353 [2024-11-21 03:44:27.856201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.353 qpair failed and we were unable to recover it. 00:27:47.353 [2024-11-21 03:44:27.856329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.353 [2024-11-21 03:44:27.856453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.353 [2024-11-21 03:44:27.856478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.353 qpair failed and we were unable to recover it. 00:27:47.353 [2024-11-21 03:44:27.856611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.353 [2024-11-21 03:44:27.856767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.353 [2024-11-21 03:44:27.856792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.353 qpair failed and we were unable to recover it. 00:27:47.353 [2024-11-21 03:44:27.856924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.353 [2024-11-21 03:44:27.857051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.353 [2024-11-21 03:44:27.857091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.353 qpair failed and we were unable to recover it. 00:27:47.353 [2024-11-21 03:44:27.857238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.353 [2024-11-21 03:44:27.857366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.353 [2024-11-21 03:44:27.857392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.353 qpair failed and we were unable to recover it. 00:27:47.353 [2024-11-21 03:44:27.857552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.353 [2024-11-21 03:44:27.857686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.353 [2024-11-21 03:44:27.857711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.353 qpair failed and we were unable to recover it. 00:27:47.353 [2024-11-21 03:44:27.857802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.353 [2024-11-21 03:44:27.857956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.353 [2024-11-21 03:44:27.857981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.353 qpair failed and we were unable to recover it. 00:27:47.353 [2024-11-21 03:44:27.858109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.353 [2024-11-21 03:44:27.858212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.353 [2024-11-21 03:44:27.858237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.353 qpair failed and we were unable to recover it. 00:27:47.353 [2024-11-21 03:44:27.858334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.353 [2024-11-21 03:44:27.858442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.353 [2024-11-21 03:44:27.858467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.353 qpair failed and we were unable to recover it. 00:27:47.353 [2024-11-21 03:44:27.858595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.353 [2024-11-21 03:44:27.858748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.353 [2024-11-21 03:44:27.858778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.353 qpair failed and we were unable to recover it. 00:27:47.353 [2024-11-21 03:44:27.858881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.353 [2024-11-21 03:44:27.859005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.353 [2024-11-21 03:44:27.859030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.353 qpair failed and we were unable to recover it. 00:27:47.354 [2024-11-21 03:44:27.859141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.354 [2024-11-21 03:44:27.859249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.354 [2024-11-21 03:44:27.859275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.354 qpair failed and we were unable to recover it. 00:27:47.354 [2024-11-21 03:44:27.859386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.354 [2024-11-21 03:44:27.859481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.354 [2024-11-21 03:44:27.859506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.354 qpair failed and we were unable to recover it. 00:27:47.354 [2024-11-21 03:44:27.859607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.354 [2024-11-21 03:44:27.859702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.354 [2024-11-21 03:44:27.859727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.354 qpair failed and we were unable to recover it. 00:27:47.354 [2024-11-21 03:44:27.859860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.354 [2024-11-21 03:44:27.859874] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:47.354 [2024-11-21 03:44:27.859959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.354 [2024-11-21 03:44:27.859984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.354 [2024-11-21 03:44:27.859995] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:47.354 qpair failed and we were unable to recover it. 00:27:47.354 [2024-11-21 03:44:27.860016] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:47.354 [2024-11-21 03:44:27.860029] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:47.354 [2024-11-21 03:44:27.860088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.354 [2024-11-21 03:44:27.860114] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:27:47.354 [2024-11-21 03:44:27.860194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.354 [2024-11-21 03:44:27.860218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.354 qpair failed and we were unable to recover it. 00:27:47.354 [2024-11-21 03:44:27.860137] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:27:47.354 [2024-11-21 03:44:27.860164] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:27:47.354 [2024-11-21 03:44:27.860167] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:27:47.354 [2024-11-21 03:44:27.860332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.354 [2024-11-21 03:44:27.860432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.354 [2024-11-21 03:44:27.860456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.354 qpair failed and we were unable to recover it. 00:27:47.354 [2024-11-21 03:44:27.860595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.354 [2024-11-21 03:44:27.860708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.354 [2024-11-21 03:44:27.860741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.354 qpair failed and we were unable to recover it. 00:27:47.354 [2024-11-21 03:44:27.860867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.354 [2024-11-21 03:44:27.860964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.354 [2024-11-21 03:44:27.860989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.354 qpair failed and we were unable to recover it. 00:27:47.354 [2024-11-21 03:44:27.861097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.354 [2024-11-21 03:44:27.861204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.354 [2024-11-21 03:44:27.861229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.354 qpair failed and we were unable to recover it. 00:27:47.354 [2024-11-21 03:44:27.861334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.354 [2024-11-21 03:44:27.861433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.354 [2024-11-21 03:44:27.861458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.354 qpair failed and we were unable to recover it. 00:27:47.354 [2024-11-21 03:44:27.861623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.354 [2024-11-21 03:44:27.861718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.354 [2024-11-21 03:44:27.861743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.354 qpair failed and we were unable to recover it. 00:27:47.354 [2024-11-21 03:44:27.861847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.354 [2024-11-21 03:44:27.862014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.354 [2024-11-21 03:44:27.862039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.354 qpair failed and we were unable to recover it. 00:27:47.354 [2024-11-21 03:44:27.862176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.354 [2024-11-21 03:44:27.862295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.354 [2024-11-21 03:44:27.862320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.354 qpair failed and we were unable to recover it. 00:27:47.354 [2024-11-21 03:44:27.862416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.354 [2024-11-21 03:44:27.862511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.354 [2024-11-21 03:44:27.862535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.354 qpair failed and we were unable to recover it. 00:27:47.354 [2024-11-21 03:44:27.862662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.354 [2024-11-21 03:44:27.862770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.354 [2024-11-21 03:44:27.862795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.354 qpair failed and we were unable to recover it. 00:27:47.354 [2024-11-21 03:44:27.862903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.354 [2024-11-21 03:44:27.863004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.354 [2024-11-21 03:44:27.863029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.354 qpair failed and we were unable to recover it. 00:27:47.354 [2024-11-21 03:44:27.863147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.354 [2024-11-21 03:44:27.863254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.354 [2024-11-21 03:44:27.863279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.354 qpair failed and we were unable to recover it. 00:27:47.354 [2024-11-21 03:44:27.863388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.354 [2024-11-21 03:44:27.863483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.354 [2024-11-21 03:44:27.863508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.354 qpair failed and we were unable to recover it. 00:27:47.354 [2024-11-21 03:44:27.863602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.354 [2024-11-21 03:44:27.863696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.354 [2024-11-21 03:44:27.863721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.354 qpair failed and we were unable to recover it. 00:27:47.355 [2024-11-21 03:44:27.863851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.355 [2024-11-21 03:44:27.864009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.355 [2024-11-21 03:44:27.864035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.355 qpair failed and we were unable to recover it. 00:27:47.355 [2024-11-21 03:44:27.864194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.355 [2024-11-21 03:44:27.864289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.355 [2024-11-21 03:44:27.864314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.355 qpair failed and we were unable to recover it. 00:27:47.355 [2024-11-21 03:44:27.864406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.355 [2024-11-21 03:44:27.864539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.355 [2024-11-21 03:44:27.864564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.355 qpair failed and we were unable to recover it. 00:27:47.355 [2024-11-21 03:44:27.864669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.355 [2024-11-21 03:44:27.864794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.355 [2024-11-21 03:44:27.864819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.355 qpair failed and we were unable to recover it. 00:27:47.355 [2024-11-21 03:44:27.864927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.355 [2024-11-21 03:44:27.865023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.355 [2024-11-21 03:44:27.865048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.355 qpair failed and we were unable to recover it. 00:27:47.355 [2024-11-21 03:44:27.865190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.355 [2024-11-21 03:44:27.865284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.355 [2024-11-21 03:44:27.865309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.355 qpair failed and we were unable to recover it. 00:27:47.355 [2024-11-21 03:44:27.865406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.355 [2024-11-21 03:44:27.865530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.355 [2024-11-21 03:44:27.865555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.355 qpair failed and we were unable to recover it. 00:27:47.355 [2024-11-21 03:44:27.865682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.355 [2024-11-21 03:44:27.865805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.355 [2024-11-21 03:44:27.865831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.355 qpair failed and we were unable to recover it. 00:27:47.355 [2024-11-21 03:44:27.865944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.355 [2024-11-21 03:44:27.866103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.355 [2024-11-21 03:44:27.866129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.355 qpair failed and we were unable to recover it. 00:27:47.355 [2024-11-21 03:44:27.866219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.355 [2024-11-21 03:44:27.866338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.355 [2024-11-21 03:44:27.866363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.355 qpair failed and we were unable to recover it. 00:27:47.355 [2024-11-21 03:44:27.866463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.355 [2024-11-21 03:44:27.866559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.355 [2024-11-21 03:44:27.866585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.355 qpair failed and we were unable to recover it. 00:27:47.355 [2024-11-21 03:44:27.866690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.355 [2024-11-21 03:44:27.866819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.355 [2024-11-21 03:44:27.866844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.355 qpair failed and we were unable to recover it. 00:27:47.355 [2024-11-21 03:44:27.866948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.355 [2024-11-21 03:44:27.867044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.355 [2024-11-21 03:44:27.867074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.355 qpair failed and we were unable to recover it. 00:27:47.355 [2024-11-21 03:44:27.867241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.355 [2024-11-21 03:44:27.867373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.355 [2024-11-21 03:44:27.867398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.355 qpair failed and we were unable to recover it. 00:27:47.355 [2024-11-21 03:44:27.867529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.355 [2024-11-21 03:44:27.867633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.355 [2024-11-21 03:44:27.867658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.355 qpair failed and we were unable to recover it. 00:27:47.355 [2024-11-21 03:44:27.867822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.355 [2024-11-21 03:44:27.867930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.355 [2024-11-21 03:44:27.867955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.355 qpair failed and we were unable to recover it. 00:27:47.355 [2024-11-21 03:44:27.868096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.355 [2024-11-21 03:44:27.868254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.355 [2024-11-21 03:44:27.868279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.355 qpair failed and we were unable to recover it. 00:27:47.355 [2024-11-21 03:44:27.868388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.355 [2024-11-21 03:44:27.868487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.355 [2024-11-21 03:44:27.868514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.355 qpair failed and we were unable to recover it. 00:27:47.355 [2024-11-21 03:44:27.868617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.355 [2024-11-21 03:44:27.868727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.355 [2024-11-21 03:44:27.868752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.355 qpair failed and we were unable to recover it. 00:27:47.355 [2024-11-21 03:44:27.868851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.355 [2024-11-21 03:44:27.868985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.355 [2024-11-21 03:44:27.869011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.355 qpair failed and we were unable to recover it. 00:27:47.355 [2024-11-21 03:44:27.869148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.355 [2024-11-21 03:44:27.869307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.355 [2024-11-21 03:44:27.869332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.355 qpair failed and we were unable to recover it. 00:27:47.355 [2024-11-21 03:44:27.869426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.355 [2024-11-21 03:44:27.869521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.355 [2024-11-21 03:44:27.869546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.355 qpair failed and we were unable to recover it. 00:27:47.355 [2024-11-21 03:44:27.869640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.355 [2024-11-21 03:44:27.869736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.355 [2024-11-21 03:44:27.869761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.356 qpair failed and we were unable to recover it. 00:27:47.356 [2024-11-21 03:44:27.869858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.356 [2024-11-21 03:44:27.869959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.356 [2024-11-21 03:44:27.869985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.356 qpair failed and we were unable to recover it. 00:27:47.356 [2024-11-21 03:44:27.870086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.356 [2024-11-21 03:44:27.870218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.356 [2024-11-21 03:44:27.870243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.356 qpair failed and we were unable to recover it. 00:27:47.356 [2024-11-21 03:44:27.870368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.356 [2024-11-21 03:44:27.870462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.356 [2024-11-21 03:44:27.870487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.356 qpair failed and we were unable to recover it. 00:27:47.356 [2024-11-21 03:44:27.870590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.356 [2024-11-21 03:44:27.870686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.356 [2024-11-21 03:44:27.870711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.356 qpair failed and we were unable to recover it. 00:27:47.356 [2024-11-21 03:44:27.870833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.356 [2024-11-21 03:44:27.870966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.356 [2024-11-21 03:44:27.870991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.356 qpair failed and we were unable to recover it. 00:27:47.356 [2024-11-21 03:44:27.871099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.356 [2024-11-21 03:44:27.871205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.356 [2024-11-21 03:44:27.871231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.356 qpair failed and we were unable to recover it. 00:27:47.356 [2024-11-21 03:44:27.871328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.356 [2024-11-21 03:44:27.871422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.356 [2024-11-21 03:44:27.871447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.356 qpair failed and we were unable to recover it. 00:27:47.356 [2024-11-21 03:44:27.871576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.356 [2024-11-21 03:44:27.871666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.356 [2024-11-21 03:44:27.871692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.356 qpair failed and we were unable to recover it. 00:27:47.356 [2024-11-21 03:44:27.871819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.356 [2024-11-21 03:44:27.871913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.356 [2024-11-21 03:44:27.871938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.356 qpair failed and we were unable to recover it. 00:27:47.356 [2024-11-21 03:44:27.872075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.356 [2024-11-21 03:44:27.872170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.356 [2024-11-21 03:44:27.872196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.356 qpair failed and we were unable to recover it. 00:27:47.356 [2024-11-21 03:44:27.872305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.356 [2024-11-21 03:44:27.872412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.356 [2024-11-21 03:44:27.872437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.356 qpair failed and we were unable to recover it. 00:27:47.356 [2024-11-21 03:44:27.872546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.356 [2024-11-21 03:44:27.872647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.356 [2024-11-21 03:44:27.872672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.356 qpair failed and we were unable to recover it. 00:27:47.356 [2024-11-21 03:44:27.872787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.356 [2024-11-21 03:44:27.872925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.356 [2024-11-21 03:44:27.872950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.356 qpair failed and we were unable to recover it. 00:27:47.356 [2024-11-21 03:44:27.873044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.356 [2024-11-21 03:44:27.873174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.356 [2024-11-21 03:44:27.873200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.356 qpair failed and we were unable to recover it. 00:27:47.356 [2024-11-21 03:44:27.873301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.356 [2024-11-21 03:44:27.873460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.356 [2024-11-21 03:44:27.873485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.356 qpair failed and we were unable to recover it. 00:27:47.356 [2024-11-21 03:44:27.873580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.356 [2024-11-21 03:44:27.873705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.356 [2024-11-21 03:44:27.873735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.356 qpair failed and we were unable to recover it. 00:27:47.356 [2024-11-21 03:44:27.873834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.356 [2024-11-21 03:44:27.873936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.356 [2024-11-21 03:44:27.873961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.356 qpair failed and we were unable to recover it. 00:27:47.356 [2024-11-21 03:44:27.874086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.356 [2024-11-21 03:44:27.874210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.356 [2024-11-21 03:44:27.874235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.356 qpair failed and we were unable to recover it. 00:27:47.356 [2024-11-21 03:44:27.874340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.356 [2024-11-21 03:44:27.874433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.356 [2024-11-21 03:44:27.874459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.356 qpair failed and we were unable to recover it. 00:27:47.356 [2024-11-21 03:44:27.874562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.356 [2024-11-21 03:44:27.874690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.356 [2024-11-21 03:44:27.874715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.356 qpair failed and we were unable to recover it. 00:27:47.356 [2024-11-21 03:44:27.874816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.356 [2024-11-21 03:44:27.874972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.356 [2024-11-21 03:44:27.874997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.356 qpair failed and we were unable to recover it. 00:27:47.356 [2024-11-21 03:44:27.875132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.356 [2024-11-21 03:44:27.875230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.356 [2024-11-21 03:44:27.875255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.356 qpair failed and we were unable to recover it. 00:27:47.356 [2024-11-21 03:44:27.875356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.356 [2024-11-21 03:44:27.875450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.356 [2024-11-21 03:44:27.875475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.356 qpair failed and we were unable to recover it. 00:27:47.356 [2024-11-21 03:44:27.875567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.356 [2024-11-21 03:44:27.875696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.356 [2024-11-21 03:44:27.875721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.356 qpair failed and we were unable to recover it. 00:27:47.356 [2024-11-21 03:44:27.875878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.356 [2024-11-21 03:44:27.875978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.356 [2024-11-21 03:44:27.876003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.356 qpair failed and we were unable to recover it. 00:27:47.356 [2024-11-21 03:44:27.876108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.357 [2024-11-21 03:44:27.876236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.357 [2024-11-21 03:44:27.876261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.357 qpair failed and we were unable to recover it. 00:27:47.357 [2024-11-21 03:44:27.876393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.357 [2024-11-21 03:44:27.876502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.357 [2024-11-21 03:44:27.876528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.357 qpair failed and we were unable to recover it. 00:27:47.357 [2024-11-21 03:44:27.876626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.357 [2024-11-21 03:44:27.876723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.357 [2024-11-21 03:44:27.876748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.357 qpair failed and we were unable to recover it. 00:27:47.357 [2024-11-21 03:44:27.876843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.357 [2024-11-21 03:44:27.876966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.357 [2024-11-21 03:44:27.876991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.357 qpair failed and we were unable to recover it. 00:27:47.357 [2024-11-21 03:44:27.877139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.357 [2024-11-21 03:44:27.877291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.357 [2024-11-21 03:44:27.877316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.357 qpair failed and we were unable to recover it. 00:27:47.357 [2024-11-21 03:44:27.877416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.357 [2024-11-21 03:44:27.877511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.357 [2024-11-21 03:44:27.877536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.357 qpair failed and we were unable to recover it. 00:27:47.357 [2024-11-21 03:44:27.877637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.357 [2024-11-21 03:44:27.877796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.357 [2024-11-21 03:44:27.877821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.357 qpair failed and we were unable to recover it. 00:27:47.357 [2024-11-21 03:44:27.877950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.357 [2024-11-21 03:44:27.878080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.357 [2024-11-21 03:44:27.878106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.357 qpair failed and we were unable to recover it. 00:27:47.357 [2024-11-21 03:44:27.878204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.357 [2024-11-21 03:44:27.878325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.357 [2024-11-21 03:44:27.878350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.357 qpair failed and we were unable to recover it. 00:27:47.357 [2024-11-21 03:44:27.878446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.357 [2024-11-21 03:44:27.878597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.357 [2024-11-21 03:44:27.878622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.357 qpair failed and we were unable to recover it. 00:27:47.357 [2024-11-21 03:44:27.878751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.357 [2024-11-21 03:44:27.878854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.357 [2024-11-21 03:44:27.878879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.357 qpair failed and we were unable to recover it. 00:27:47.357 [2024-11-21 03:44:27.878982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.357 [2024-11-21 03:44:27.879087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.357 [2024-11-21 03:44:27.879115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.357 qpair failed and we were unable to recover it. 00:27:47.357 [2024-11-21 03:44:27.879209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.357 [2024-11-21 03:44:27.879314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.357 [2024-11-21 03:44:27.879340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.357 qpair failed and we were unable to recover it. 00:27:47.357 [2024-11-21 03:44:27.879443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.357 [2024-11-21 03:44:27.879578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.357 [2024-11-21 03:44:27.879603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.357 qpair failed and we were unable to recover it. 00:27:47.357 [2024-11-21 03:44:27.879708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.357 [2024-11-21 03:44:27.879848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.357 [2024-11-21 03:44:27.879873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.357 qpair failed and we were unable to recover it. 00:27:47.357 [2024-11-21 03:44:27.879976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.357 [2024-11-21 03:44:27.880107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.357 [2024-11-21 03:44:27.880133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.357 qpair failed and we were unable to recover it. 00:27:47.357 [2024-11-21 03:44:27.880265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.357 [2024-11-21 03:44:27.880389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.357 [2024-11-21 03:44:27.880414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.357 qpair failed and we were unable to recover it. 00:27:47.357 [2024-11-21 03:44:27.880570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.357 [2024-11-21 03:44:27.880700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.357 [2024-11-21 03:44:27.880726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.357 qpair failed and we were unable to recover it. 00:27:47.357 [2024-11-21 03:44:27.880887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.357 [2024-11-21 03:44:27.880985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.357 [2024-11-21 03:44:27.881012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.357 qpair failed and we were unable to recover it. 00:27:47.357 [2024-11-21 03:44:27.881146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.357 [2024-11-21 03:44:27.881243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.357 [2024-11-21 03:44:27.881270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.357 qpair failed and we were unable to recover it. 00:27:47.357 [2024-11-21 03:44:27.881404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.357 [2024-11-21 03:44:27.881561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.357 [2024-11-21 03:44:27.881586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.357 qpair failed and we were unable to recover it. 00:27:47.357 [2024-11-21 03:44:27.881686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.357 [2024-11-21 03:44:27.881782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.357 [2024-11-21 03:44:27.881807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.357 qpair failed and we were unable to recover it. 00:27:47.357 [2024-11-21 03:44:27.881934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.357 [2024-11-21 03:44:27.882037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.357 [2024-11-21 03:44:27.882062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.357 qpair failed and we were unable to recover it. 00:27:47.357 [2024-11-21 03:44:27.882228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.357 [2024-11-21 03:44:27.882318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.357 [2024-11-21 03:44:27.882344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.358 qpair failed and we were unable to recover it. 00:27:47.358 [2024-11-21 03:44:27.882446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.358 [2024-11-21 03:44:27.882578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.358 [2024-11-21 03:44:27.882603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.358 qpair failed and we were unable to recover it. 00:27:47.358 [2024-11-21 03:44:27.882725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.358 [2024-11-21 03:44:27.882823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.358 [2024-11-21 03:44:27.882848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.358 qpair failed and we were unable to recover it. 00:27:47.358 [2024-11-21 03:44:27.882981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.358 [2024-11-21 03:44:27.883103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.358 [2024-11-21 03:44:27.883130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.358 qpair failed and we were unable to recover it. 00:27:47.358 [2024-11-21 03:44:27.883224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.358 [2024-11-21 03:44:27.883349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.358 [2024-11-21 03:44:27.883375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.358 qpair failed and we were unable to recover it. 00:27:47.358 [2024-11-21 03:44:27.883512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.358 [2024-11-21 03:44:27.883612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.358 [2024-11-21 03:44:27.883638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.358 qpair failed and we were unable to recover it. 00:27:47.358 [2024-11-21 03:44:27.883768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.358 [2024-11-21 03:44:27.883869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.358 [2024-11-21 03:44:27.883894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.358 qpair failed and we were unable to recover it. 00:27:47.358 [2024-11-21 03:44:27.883991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.358 [2024-11-21 03:44:27.884121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.358 [2024-11-21 03:44:27.884147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.358 qpair failed and we were unable to recover it. 00:27:47.358 [2024-11-21 03:44:27.884252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.358 [2024-11-21 03:44:27.884360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.358 [2024-11-21 03:44:27.884386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.358 qpair failed and we were unable to recover it. 00:27:47.358 [2024-11-21 03:44:27.884490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.358 [2024-11-21 03:44:27.884653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.358 [2024-11-21 03:44:27.884679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.358 qpair failed and we were unable to recover it. 00:27:47.358 [2024-11-21 03:44:27.884806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.358 [2024-11-21 03:44:27.884903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.358 [2024-11-21 03:44:27.884928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.358 qpair failed and we were unable to recover it. 00:27:47.358 [2024-11-21 03:44:27.885020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.358 [2024-11-21 03:44:27.885129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.358 [2024-11-21 03:44:27.885155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.358 qpair failed and we were unable to recover it. 00:27:47.358 [2024-11-21 03:44:27.885276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.358 [2024-11-21 03:44:27.885369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.358 [2024-11-21 03:44:27.885394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.358 qpair failed and we were unable to recover it. 00:27:47.358 [2024-11-21 03:44:27.885536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.358 [2024-11-21 03:44:27.885628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.358 [2024-11-21 03:44:27.885653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.358 qpair failed and we were unable to recover it. 00:27:47.358 [2024-11-21 03:44:27.885750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.358 [2024-11-21 03:44:27.885875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.358 [2024-11-21 03:44:27.885900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.358 qpair failed and we were unable to recover it. 00:27:47.358 [2024-11-21 03:44:27.886031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.358 [2024-11-21 03:44:27.886168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.358 [2024-11-21 03:44:27.886194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.358 qpair failed and we were unable to recover it. 00:27:47.358 [2024-11-21 03:44:27.886305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.358 [2024-11-21 03:44:27.886427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.358 [2024-11-21 03:44:27.886452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.358 qpair failed and we were unable to recover it. 00:27:47.358 [2024-11-21 03:44:27.886584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.358 [2024-11-21 03:44:27.886686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.358 [2024-11-21 03:44:27.886711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.358 qpair failed and we were unable to recover it. 00:27:47.358 [2024-11-21 03:44:27.886807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.358 [2024-11-21 03:44:27.886909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.358 [2024-11-21 03:44:27.886940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.358 qpair failed and we were unable to recover it. 00:27:47.358 [2024-11-21 03:44:27.887039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.358 [2024-11-21 03:44:27.887180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.358 [2024-11-21 03:44:27.887206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.358 qpair failed and we were unable to recover it. 00:27:47.358 [2024-11-21 03:44:27.887368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.358 [2024-11-21 03:44:27.887498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.358 [2024-11-21 03:44:27.887523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.358 qpair failed and we were unable to recover it. 00:27:47.358 [2024-11-21 03:44:27.887653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.358 [2024-11-21 03:44:27.887747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.358 [2024-11-21 03:44:27.887773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.358 qpair failed and we were unable to recover it. 00:27:47.358 [2024-11-21 03:44:27.887870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.358 [2024-11-21 03:44:27.887974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.358 [2024-11-21 03:44:27.888000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.358 qpair failed and we were unable to recover it. 00:27:47.358 [2024-11-21 03:44:27.888123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.358 [2024-11-21 03:44:27.888250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.358 [2024-11-21 03:44:27.888275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.358 qpair failed and we were unable to recover it. 00:27:47.358 [2024-11-21 03:44:27.888370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.358 [2024-11-21 03:44:27.888466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.358 [2024-11-21 03:44:27.888493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.358 qpair failed and we were unable to recover it. 00:27:47.358 [2024-11-21 03:44:27.888630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.358 [2024-11-21 03:44:27.888757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.358 [2024-11-21 03:44:27.888782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.358 qpair failed and we were unable to recover it. 00:27:47.358 [2024-11-21 03:44:27.888909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.358 [2024-11-21 03:44:27.889015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.358 [2024-11-21 03:44:27.889041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.358 qpair failed and we were unable to recover it. 00:27:47.358 [2024-11-21 03:44:27.889191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.358 [2024-11-21 03:44:27.889318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.359 [2024-11-21 03:44:27.889344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.359 qpair failed and we were unable to recover it. 00:27:47.359 [2024-11-21 03:44:27.889441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.359 [2024-11-21 03:44:27.889541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.359 [2024-11-21 03:44:27.889567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.359 qpair failed and we were unable to recover it. 00:27:47.359 [2024-11-21 03:44:27.889707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.359 [2024-11-21 03:44:27.889830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.359 [2024-11-21 03:44:27.889856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.359 qpair failed and we were unable to recover it. 00:27:47.359 [2024-11-21 03:44:27.889963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.359 [2024-11-21 03:44:27.890060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.359 [2024-11-21 03:44:27.890092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.359 qpair failed and we were unable to recover it. 00:27:47.359 [2024-11-21 03:44:27.890192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.359 [2024-11-21 03:44:27.890333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.359 [2024-11-21 03:44:27.890358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.359 qpair failed and we were unable to recover it. 00:27:47.359 [2024-11-21 03:44:27.890493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.359 [2024-11-21 03:44:27.890617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.359 [2024-11-21 03:44:27.890643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.359 qpair failed and we were unable to recover it. 00:27:47.359 [2024-11-21 03:44:27.890771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.359 [2024-11-21 03:44:27.890896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.359 [2024-11-21 03:44:27.890922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.359 qpair failed and we were unable to recover it. 00:27:47.359 [2024-11-21 03:44:27.891026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.359 [2024-11-21 03:44:27.891155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.359 [2024-11-21 03:44:27.891181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.359 qpair failed and we were unable to recover it. 00:27:47.359 [2024-11-21 03:44:27.891282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.359 [2024-11-21 03:44:27.891387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.359 [2024-11-21 03:44:27.891412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.359 qpair failed and we were unable to recover it. 00:27:47.359 [2024-11-21 03:44:27.891542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.359 [2024-11-21 03:44:27.891665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.359 [2024-11-21 03:44:27.891690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.359 qpair failed and we were unable to recover it. 00:27:47.359 [2024-11-21 03:44:27.891789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.359 [2024-11-21 03:44:27.891885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.359 [2024-11-21 03:44:27.891910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.359 qpair failed and we were unable to recover it. 00:27:47.359 [2024-11-21 03:44:27.892001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.359 [2024-11-21 03:44:27.892126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.359 [2024-11-21 03:44:27.892152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.359 qpair failed and we were unable to recover it. 00:27:47.359 [2024-11-21 03:44:27.892253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.359 [2024-11-21 03:44:27.892353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.359 [2024-11-21 03:44:27.892379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.359 qpair failed and we were unable to recover it. 00:27:47.359 [2024-11-21 03:44:27.892478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.359 [2024-11-21 03:44:27.892615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.359 [2024-11-21 03:44:27.892640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.359 qpair failed and we were unable to recover it. 00:27:47.359 [2024-11-21 03:44:27.892778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.359 [2024-11-21 03:44:27.892904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.359 [2024-11-21 03:44:27.892929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.359 qpair failed and we were unable to recover it. 00:27:47.359 [2024-11-21 03:44:27.893035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.359 [2024-11-21 03:44:27.893205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.359 [2024-11-21 03:44:27.893233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.359 qpair failed and we were unable to recover it. 00:27:47.359 [2024-11-21 03:44:27.893362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.359 [2024-11-21 03:44:27.893455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.359 [2024-11-21 03:44:27.893480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.359 qpair failed and we were unable to recover it. 00:27:47.359 [2024-11-21 03:44:27.893611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.359 [2024-11-21 03:44:27.893738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.359 [2024-11-21 03:44:27.893764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.359 qpair failed and we were unable to recover it. 00:27:47.359 [2024-11-21 03:44:27.893894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.359 [2024-11-21 03:44:27.894004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.359 [2024-11-21 03:44:27.894029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.359 qpair failed and we were unable to recover it. 00:27:47.359 [2024-11-21 03:44:27.894174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.359 [2024-11-21 03:44:27.894297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.359 [2024-11-21 03:44:27.894323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.359 qpair failed and we were unable to recover it. 00:27:47.359 [2024-11-21 03:44:27.894419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.359 [2024-11-21 03:44:27.894571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.359 [2024-11-21 03:44:27.894596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.359 qpair failed and we were unable to recover it. 00:27:47.360 [2024-11-21 03:44:27.894694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.360 [2024-11-21 03:44:27.894799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.360 [2024-11-21 03:44:27.894825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.360 qpair failed and we were unable to recover it. 00:27:47.360 [2024-11-21 03:44:27.894964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.360 [2024-11-21 03:44:27.895065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.360 [2024-11-21 03:44:27.895096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.360 qpair failed and we were unable to recover it. 00:27:47.360 [2024-11-21 03:44:27.895205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.360 [2024-11-21 03:44:27.895306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.360 [2024-11-21 03:44:27.895333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.360 qpair failed and we were unable to recover it. 00:27:47.360 [2024-11-21 03:44:27.895440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.360 [2024-11-21 03:44:27.895543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.360 [2024-11-21 03:44:27.895569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.360 qpair failed and we were unable to recover it. 00:27:47.360 [2024-11-21 03:44:27.895669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.360 [2024-11-21 03:44:27.895767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.360 [2024-11-21 03:44:27.895792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.360 qpair failed and we were unable to recover it. 00:27:47.360 [2024-11-21 03:44:27.895948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.360 [2024-11-21 03:44:27.896079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.360 [2024-11-21 03:44:27.896105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.360 qpair failed and we were unable to recover it. 00:27:47.360 [2024-11-21 03:44:27.896206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.360 [2024-11-21 03:44:27.896304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.360 [2024-11-21 03:44:27.896330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.360 qpair failed and we were unable to recover it. 00:27:47.360 [2024-11-21 03:44:27.896431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.360 [2024-11-21 03:44:27.896564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.360 [2024-11-21 03:44:27.896590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.360 qpair failed and we were unable to recover it. 00:27:47.360 [2024-11-21 03:44:27.896686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.360 [2024-11-21 03:44:27.896786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.360 [2024-11-21 03:44:27.896812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.360 qpair failed and we were unable to recover it. 00:27:47.360 [2024-11-21 03:44:27.896951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.360 [2024-11-21 03:44:27.897083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.360 [2024-11-21 03:44:27.897109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.360 qpair failed and we were unable to recover it. 00:27:47.360 [2024-11-21 03:44:27.897200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.360 [2024-11-21 03:44:27.897305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.360 [2024-11-21 03:44:27.897330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.360 qpair failed and we were unable to recover it. 00:27:47.360 [2024-11-21 03:44:27.897420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.360 [2024-11-21 03:44:27.897518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.360 [2024-11-21 03:44:27.897544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.360 qpair failed and we were unable to recover it. 00:27:47.360 [2024-11-21 03:44:27.897651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.360 [2024-11-21 03:44:27.897748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.360 [2024-11-21 03:44:27.897773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.360 qpair failed and we were unable to recover it. 00:27:47.360 [2024-11-21 03:44:27.897906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.360 [2024-11-21 03:44:27.898028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.360 [2024-11-21 03:44:27.898053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.360 qpair failed and we were unable to recover it. 00:27:47.360 [2024-11-21 03:44:27.898159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.360 [2024-11-21 03:44:27.898257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.360 [2024-11-21 03:44:27.898281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.360 qpair failed and we were unable to recover it. 00:27:47.360 [2024-11-21 03:44:27.898377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.360 [2024-11-21 03:44:27.898472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.360 [2024-11-21 03:44:27.898497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.360 qpair failed and we were unable to recover it. 00:27:47.360 [2024-11-21 03:44:27.898600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.360 [2024-11-21 03:44:27.898703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.360 [2024-11-21 03:44:27.898728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.360 qpair failed and we were unable to recover it. 00:27:47.360 [2024-11-21 03:44:27.898829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.360 [2024-11-21 03:44:27.898951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.360 [2024-11-21 03:44:27.898976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.360 qpair failed and we were unable to recover it. 00:27:47.360 [2024-11-21 03:44:27.899076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.360 [2024-11-21 03:44:27.899170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.360 [2024-11-21 03:44:27.899195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.360 qpair failed and we were unable to recover it. 00:27:47.360 [2024-11-21 03:44:27.899303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.360 [2024-11-21 03:44:27.899431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.360 [2024-11-21 03:44:27.899456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.360 qpair failed and we were unable to recover it. 00:27:47.360 [2024-11-21 03:44:27.899586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.360 [2024-11-21 03:44:27.899709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.360 [2024-11-21 03:44:27.899734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.360 qpair failed and we were unable to recover it. 00:27:47.360 [2024-11-21 03:44:27.899865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.360 [2024-11-21 03:44:27.899995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.360 [2024-11-21 03:44:27.900030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.360 qpair failed and we were unable to recover it. 00:27:47.360 [2024-11-21 03:44:27.900171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.360 [2024-11-21 03:44:27.900305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.360 [2024-11-21 03:44:27.900331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.360 qpair failed and we were unable to recover it. 00:27:47.360 [2024-11-21 03:44:27.900465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.360 [2024-11-21 03:44:27.900592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.360 [2024-11-21 03:44:27.900617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.360 qpair failed and we were unable to recover it. 00:27:47.360 [2024-11-21 03:44:27.900743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.360 [2024-11-21 03:44:27.900867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.360 [2024-11-21 03:44:27.900892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.360 qpair failed and we were unable to recover it. 00:27:47.360 [2024-11-21 03:44:27.901000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.360 [2024-11-21 03:44:27.901132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.360 [2024-11-21 03:44:27.901158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.360 qpair failed and we were unable to recover it. 00:27:47.360 [2024-11-21 03:44:27.901266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.360 [2024-11-21 03:44:27.901392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.360 [2024-11-21 03:44:27.901418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.360 qpair failed and we were unable to recover it. 00:27:47.360 [2024-11-21 03:44:27.901566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.360 [2024-11-21 03:44:27.901666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.360 [2024-11-21 03:44:27.901691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.360 qpair failed and we were unable to recover it. 00:27:47.360 [2024-11-21 03:44:27.901785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.360 [2024-11-21 03:44:27.901879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.361 [2024-11-21 03:44:27.901904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.361 qpair failed and we were unable to recover it. 00:27:47.361 [2024-11-21 03:44:27.902003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.361 [2024-11-21 03:44:27.902133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.361 [2024-11-21 03:44:27.902160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.361 qpair failed and we were unable to recover it. 00:27:47.361 [2024-11-21 03:44:27.902260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.361 [2024-11-21 03:44:27.902362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.361 [2024-11-21 03:44:27.902388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.361 qpair failed and we were unable to recover it. 00:27:47.361 [2024-11-21 03:44:27.902541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.361 [2024-11-21 03:44:27.902632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.361 [2024-11-21 03:44:27.902662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.361 qpair failed and we were unable to recover it. 00:27:47.361 [2024-11-21 03:44:27.902764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.361 [2024-11-21 03:44:27.902860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.361 [2024-11-21 03:44:27.902885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.361 qpair failed and we were unable to recover it. 00:27:47.361 [2024-11-21 03:44:27.902980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.361 [2024-11-21 03:44:27.903084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.361 [2024-11-21 03:44:27.903109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.361 qpair failed and we were unable to recover it. 00:27:47.361 [2024-11-21 03:44:27.903218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.361 [2024-11-21 03:44:27.903318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.361 [2024-11-21 03:44:27.903345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.361 qpair failed and we were unable to recover it. 00:27:47.361 [2024-11-21 03:44:27.903438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.361 [2024-11-21 03:44:27.903538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.361 [2024-11-21 03:44:27.903564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.361 qpair failed and we were unable to recover it. 00:27:47.361 [2024-11-21 03:44:27.903652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.361 [2024-11-21 03:44:27.903758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.361 [2024-11-21 03:44:27.903783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.361 qpair failed and we were unable to recover it. 00:27:47.361 [2024-11-21 03:44:27.903889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.361 [2024-11-21 03:44:27.904019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.361 [2024-11-21 03:44:27.904044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.361 qpair failed and we were unable to recover it. 00:27:47.361 [2024-11-21 03:44:27.904149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.361 [2024-11-21 03:44:27.904252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.361 [2024-11-21 03:44:27.904278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.361 qpair failed and we were unable to recover it. 00:27:47.361 [2024-11-21 03:44:27.904373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.361 [2024-11-21 03:44:27.904471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.361 [2024-11-21 03:44:27.904496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.361 qpair failed and we were unable to recover it. 00:27:47.361 [2024-11-21 03:44:27.904620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.361 [2024-11-21 03:44:27.904749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.361 [2024-11-21 03:44:27.904775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.361 qpair failed and we were unable to recover it. 00:27:47.361 [2024-11-21 03:44:27.904902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.361 [2024-11-21 03:44:27.905023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.361 [2024-11-21 03:44:27.905048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.361 qpair failed and we were unable to recover it. 00:27:47.361 [2024-11-21 03:44:27.905222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.361 [2024-11-21 03:44:27.905318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.361 [2024-11-21 03:44:27.905343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.361 qpair failed and we were unable to recover it. 00:27:47.361 [2024-11-21 03:44:27.905479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.361 [2024-11-21 03:44:27.905574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.361 [2024-11-21 03:44:27.905599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.361 qpair failed and we were unable to recover it. 00:27:47.361 [2024-11-21 03:44:27.905727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.361 [2024-11-21 03:44:27.905849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.361 [2024-11-21 03:44:27.905874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.361 qpair failed and we were unable to recover it. 00:27:47.361 [2024-11-21 03:44:27.905980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.361 [2024-11-21 03:44:27.906112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.361 [2024-11-21 03:44:27.906142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.361 qpair failed and we were unable to recover it. 00:27:47.361 [2024-11-21 03:44:27.906283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.361 [2024-11-21 03:44:27.906376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.361 [2024-11-21 03:44:27.906401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.361 qpair failed and we were unable to recover it. 00:27:47.361 [2024-11-21 03:44:27.906526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.361 [2024-11-21 03:44:27.906664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.361 [2024-11-21 03:44:27.906690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.361 qpair failed and we were unable to recover it. 00:27:47.361 [2024-11-21 03:44:27.906779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.361 [2024-11-21 03:44:27.906909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.361 [2024-11-21 03:44:27.906934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.361 qpair failed and we were unable to recover it. 00:27:47.361 [2024-11-21 03:44:27.907046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.361 [2024-11-21 03:44:27.907140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.361 [2024-11-21 03:44:27.907165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.361 qpair failed and we were unable to recover it. 00:27:47.361 [2024-11-21 03:44:27.907264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.361 [2024-11-21 03:44:27.907360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.361 [2024-11-21 03:44:27.907385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.361 qpair failed and we were unable to recover it. 00:27:47.361 [2024-11-21 03:44:27.907509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.361 [2024-11-21 03:44:27.907605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.361 [2024-11-21 03:44:27.907630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.361 qpair failed and we were unable to recover it. 00:27:47.361 [2024-11-21 03:44:27.907761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.361 [2024-11-21 03:44:27.907856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.361 [2024-11-21 03:44:27.907881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.361 qpair failed and we were unable to recover it. 00:27:47.361 [2024-11-21 03:44:27.907980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.361 [2024-11-21 03:44:27.908102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.361 [2024-11-21 03:44:27.908129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.361 qpair failed and we were unable to recover it. 00:27:47.361 [2024-11-21 03:44:27.908242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.361 [2024-11-21 03:44:27.908341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.361 [2024-11-21 03:44:27.908367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.362 qpair failed and we were unable to recover it. 00:27:47.362 [2024-11-21 03:44:27.908459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.362 [2024-11-21 03:44:27.908616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.362 [2024-11-21 03:44:27.908642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.362 qpair failed and we were unable to recover it. 00:27:47.362 [2024-11-21 03:44:27.908740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.362 [2024-11-21 03:44:27.908829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.362 [2024-11-21 03:44:27.908854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.362 qpair failed and we were unable to recover it. 00:27:47.362 [2024-11-21 03:44:27.908988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.362 [2024-11-21 03:44:27.909117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.362 [2024-11-21 03:44:27.909142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.362 qpair failed and we were unable to recover it. 00:27:47.362 [2024-11-21 03:44:27.909270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.362 [2024-11-21 03:44:27.909413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.362 [2024-11-21 03:44:27.909438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.362 qpair failed and we were unable to recover it. 00:27:47.362 [2024-11-21 03:44:27.909536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.362 [2024-11-21 03:44:27.909663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.362 [2024-11-21 03:44:27.909688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.362 qpair failed and we were unable to recover it. 00:27:47.362 [2024-11-21 03:44:27.909792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.362 [2024-11-21 03:44:27.909922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.362 [2024-11-21 03:44:27.909948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.362 qpair failed and we were unable to recover it. 00:27:47.362 [2024-11-21 03:44:27.910089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.362 [2024-11-21 03:44:27.910197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.362 [2024-11-21 03:44:27.910222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.362 qpair failed and we were unable to recover it. 00:27:47.362 [2024-11-21 03:44:27.910319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.362 [2024-11-21 03:44:27.910420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.362 [2024-11-21 03:44:27.910446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.362 qpair failed and we were unable to recover it. 00:27:47.362 [2024-11-21 03:44:27.910569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.362 [2024-11-21 03:44:27.910675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.362 [2024-11-21 03:44:27.910700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.362 qpair failed and we were unable to recover it. 00:27:47.362 [2024-11-21 03:44:27.910791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.362 [2024-11-21 03:44:27.910890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.362 [2024-11-21 03:44:27.910915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.362 qpair failed and we were unable to recover it. 00:27:47.362 [2024-11-21 03:44:27.911018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.362 [2024-11-21 03:44:27.911115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.362 [2024-11-21 03:44:27.911140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.362 qpair failed and we were unable to recover it. 00:27:47.362 [2024-11-21 03:44:27.911235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.362 [2024-11-21 03:44:27.911357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.362 [2024-11-21 03:44:27.911382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.362 qpair failed and we were unable to recover it. 00:27:47.362 [2024-11-21 03:44:27.911512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.362 [2024-11-21 03:44:27.911666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.362 [2024-11-21 03:44:27.911692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.362 qpair failed and we were unable to recover it. 00:27:47.362 [2024-11-21 03:44:27.911820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.362 [2024-11-21 03:44:27.911944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.362 [2024-11-21 03:44:27.911969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.362 qpair failed and we were unable to recover it. 00:27:47.362 [2024-11-21 03:44:27.912063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.362 [2024-11-21 03:44:27.912190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.362 [2024-11-21 03:44:27.912216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.362 qpair failed and we were unable to recover it. 00:27:47.362 [2024-11-21 03:44:27.912340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.362 [2024-11-21 03:44:27.912428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.362 [2024-11-21 03:44:27.912453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.362 qpair failed and we were unable to recover it. 00:27:47.362 [2024-11-21 03:44:27.912572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.362 [2024-11-21 03:44:27.912673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.362 [2024-11-21 03:44:27.912700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.362 qpair failed and we were unable to recover it. 00:27:47.362 [2024-11-21 03:44:27.912827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.362 [2024-11-21 03:44:27.912937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.362 [2024-11-21 03:44:27.912962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.362 qpair failed and we were unable to recover it. 00:27:47.362 [2024-11-21 03:44:27.913065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.362 [2024-11-21 03:44:27.913173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.362 [2024-11-21 03:44:27.913199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.362 qpair failed and we were unable to recover it. 00:27:47.362 [2024-11-21 03:44:27.913324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.362 [2024-11-21 03:44:27.913421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.362 [2024-11-21 03:44:27.913445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.362 qpair failed and we were unable to recover it. 00:27:47.362 [2024-11-21 03:44:27.913574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.362 [2024-11-21 03:44:27.913664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.362 [2024-11-21 03:44:27.913689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.362 qpair failed and we were unable to recover it. 00:27:47.362 [2024-11-21 03:44:27.913792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.362 [2024-11-21 03:44:27.913917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.362 [2024-11-21 03:44:27.913942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.362 qpair failed and we were unable to recover it. 00:27:47.362 [2024-11-21 03:44:27.914035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.362 [2024-11-21 03:44:27.914142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.362 [2024-11-21 03:44:27.914167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.362 qpair failed and we were unable to recover it. 00:27:47.362 [2024-11-21 03:44:27.914293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.362 [2024-11-21 03:44:27.914416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.362 [2024-11-21 03:44:27.914441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.362 qpair failed and we were unable to recover it. 00:27:47.362 [2024-11-21 03:44:27.914544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.362 [2024-11-21 03:44:27.914638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.362 [2024-11-21 03:44:27.914663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.362 qpair failed and we were unable to recover it. 00:27:47.362 [2024-11-21 03:44:27.914753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.362 [2024-11-21 03:44:27.914857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.362 [2024-11-21 03:44:27.914882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.362 qpair failed and we were unable to recover it. 00:27:47.362 [2024-11-21 03:44:27.915011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.362 [2024-11-21 03:44:27.915147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.362 [2024-11-21 03:44:27.915173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.362 qpair failed and we were unable to recover it. 00:27:47.362 [2024-11-21 03:44:27.915266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.362 [2024-11-21 03:44:27.915363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.362 [2024-11-21 03:44:27.915393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.362 qpair failed and we were unable to recover it. 00:27:47.362 [2024-11-21 03:44:27.915486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.362 [2024-11-21 03:44:27.915586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.362 [2024-11-21 03:44:27.915611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.362 qpair failed and we were unable to recover it. 00:27:47.362 [2024-11-21 03:44:27.915712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.362 [2024-11-21 03:44:27.915844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.363 [2024-11-21 03:44:27.915869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.363 qpair failed and we were unable to recover it. 00:27:47.363 [2024-11-21 03:44:27.915966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.363 [2024-11-21 03:44:27.916058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.363 [2024-11-21 03:44:27.916117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.363 qpair failed and we were unable to recover it. 00:27:47.363 [2024-11-21 03:44:27.916218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.363 [2024-11-21 03:44:27.916329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.363 [2024-11-21 03:44:27.916358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.363 qpair failed and we were unable to recover it. 00:27:47.363 [2024-11-21 03:44:27.916461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.363 [2024-11-21 03:44:27.916575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.363 [2024-11-21 03:44:27.916600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.363 qpair failed and we were unable to recover it. 00:27:47.363 [2024-11-21 03:44:27.916730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.363 [2024-11-21 03:44:27.916824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.363 [2024-11-21 03:44:27.916850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.363 qpair failed and we were unable to recover it. 00:27:47.363 [2024-11-21 03:44:27.916986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.363 [2024-11-21 03:44:27.917110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.363 [2024-11-21 03:44:27.917136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.363 qpair failed and we were unable to recover it. 00:27:47.363 [2024-11-21 03:44:27.917239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.363 [2024-11-21 03:44:27.917344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.363 [2024-11-21 03:44:27.917369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.363 qpair failed and we were unable to recover it. 00:27:47.363 [2024-11-21 03:44:27.917469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.363 [2024-11-21 03:44:27.917569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.363 [2024-11-21 03:44:27.917594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.363 qpair failed and we were unable to recover it. 00:27:47.363 [2024-11-21 03:44:27.917717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.363 [2024-11-21 03:44:27.917818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.363 [2024-11-21 03:44:27.917843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.363 qpair failed and we were unable to recover it. 00:27:47.363 [2024-11-21 03:44:27.917973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.363 [2024-11-21 03:44:27.918080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.363 [2024-11-21 03:44:27.918107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.363 qpair failed and we were unable to recover it. 00:27:47.363 [2024-11-21 03:44:27.918241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.363 [2024-11-21 03:44:27.918379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.363 [2024-11-21 03:44:27.918405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.363 qpair failed and we were unable to recover it. 00:27:47.363 [2024-11-21 03:44:27.918533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.363 [2024-11-21 03:44:27.918640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.363 [2024-11-21 03:44:27.918666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.363 qpair failed and we were unable to recover it. 00:27:47.363 [2024-11-21 03:44:27.918769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.363 [2024-11-21 03:44:27.918894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.363 [2024-11-21 03:44:27.918918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.363 qpair failed and we were unable to recover it. 00:27:47.363 [2024-11-21 03:44:27.919016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.363 [2024-11-21 03:44:27.919123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.363 [2024-11-21 03:44:27.919149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.363 qpair failed and we were unable to recover it. 00:27:47.363 [2024-11-21 03:44:27.919255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.363 [2024-11-21 03:44:27.919347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.363 [2024-11-21 03:44:27.919372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.363 qpair failed and we were unable to recover it. 00:27:47.363 [2024-11-21 03:44:27.919493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.363 [2024-11-21 03:44:27.919594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.363 [2024-11-21 03:44:27.919620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.363 qpair failed and we were unable to recover it. 00:27:47.363 [2024-11-21 03:44:27.919743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.363 [2024-11-21 03:44:27.919836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.363 [2024-11-21 03:44:27.919861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.363 qpair failed and we were unable to recover it. 00:27:47.363 [2024-11-21 03:44:27.919963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.363 [2024-11-21 03:44:27.920094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.363 [2024-11-21 03:44:27.920120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.363 qpair failed and we were unable to recover it. 00:27:47.363 [2024-11-21 03:44:27.920251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.363 [2024-11-21 03:44:27.920352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.363 [2024-11-21 03:44:27.920376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.363 qpair failed and we were unable to recover it. 00:27:47.363 [2024-11-21 03:44:27.920483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.363 [2024-11-21 03:44:27.920608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.363 [2024-11-21 03:44:27.920634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.363 qpair failed and we were unable to recover it. 00:27:47.363 [2024-11-21 03:44:27.920740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.363 [2024-11-21 03:44:27.920836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.363 [2024-11-21 03:44:27.920861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.363 qpair failed and we were unable to recover it. 00:27:47.363 [2024-11-21 03:44:27.920958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.363 [2024-11-21 03:44:27.921113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.363 [2024-11-21 03:44:27.921139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.363 qpair failed and we were unable to recover it. 00:27:47.363 [2024-11-21 03:44:27.921235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.363 [2024-11-21 03:44:27.921329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.363 [2024-11-21 03:44:27.921354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.363 qpair failed and we were unable to recover it. 00:27:47.363 [2024-11-21 03:44:27.921465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.363 [2024-11-21 03:44:27.921558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.363 [2024-11-21 03:44:27.921583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.363 qpair failed and we were unable to recover it. 00:27:47.363 [2024-11-21 03:44:27.921677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.363 [2024-11-21 03:44:27.921800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.363 [2024-11-21 03:44:27.921825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.363 qpair failed and we were unable to recover it. 00:27:47.363 [2024-11-21 03:44:27.921957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.363 [2024-11-21 03:44:27.922087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.363 [2024-11-21 03:44:27.922113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.363 qpair failed and we were unable to recover it. 00:27:47.363 [2024-11-21 03:44:27.922238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.363 [2024-11-21 03:44:27.922330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.363 [2024-11-21 03:44:27.922355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.363 qpair failed and we were unable to recover it. 00:27:47.363 [2024-11-21 03:44:27.922470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.363 [2024-11-21 03:44:27.922567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.363 [2024-11-21 03:44:27.922592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.363 qpair failed and we were unable to recover it. 00:27:47.363 [2024-11-21 03:44:27.922692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.363 [2024-11-21 03:44:27.922823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.363 [2024-11-21 03:44:27.922848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.363 qpair failed and we were unable to recover it. 00:27:47.363 [2024-11-21 03:44:27.922953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.363 [2024-11-21 03:44:27.923081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.363 [2024-11-21 03:44:27.923107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.363 qpair failed and we were unable to recover it. 00:27:47.363 [2024-11-21 03:44:27.923208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.363 [2024-11-21 03:44:27.923316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.363 [2024-11-21 03:44:27.923341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.363 qpair failed and we were unable to recover it. 00:27:47.363 [2024-11-21 03:44:27.923444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.363 [2024-11-21 03:44:27.923537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.363 [2024-11-21 03:44:27.923562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.363 qpair failed and we were unable to recover it. 00:27:47.364 [2024-11-21 03:44:27.923664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.364 [2024-11-21 03:44:27.923759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.364 [2024-11-21 03:44:27.923784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.364 qpair failed and we were unable to recover it. 00:27:47.364 [2024-11-21 03:44:27.923919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.364 [2024-11-21 03:44:27.924108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.364 [2024-11-21 03:44:27.924134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.364 qpair failed and we were unable to recover it. 00:27:47.364 [2024-11-21 03:44:27.924265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.364 [2024-11-21 03:44:27.924367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.364 [2024-11-21 03:44:27.924392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.364 qpair failed and we were unable to recover it. 00:27:47.364 [2024-11-21 03:44:27.924520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.364 [2024-11-21 03:44:27.924618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.364 [2024-11-21 03:44:27.924643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.364 qpair failed and we were unable to recover it. 00:27:47.364 [2024-11-21 03:44:27.924741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.364 [2024-11-21 03:44:27.924863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.364 [2024-11-21 03:44:27.924888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.364 qpair failed and we were unable to recover it. 00:27:47.364 [2024-11-21 03:44:27.924998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.364 [2024-11-21 03:44:27.925120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.364 [2024-11-21 03:44:27.925146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.364 qpair failed and we were unable to recover it. 00:27:47.364 [2024-11-21 03:44:27.925280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.364 [2024-11-21 03:44:27.925400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.364 [2024-11-21 03:44:27.925425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.364 qpair failed and we were unable to recover it. 00:27:47.364 [2024-11-21 03:44:27.925583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.364 [2024-11-21 03:44:27.925686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.364 [2024-11-21 03:44:27.925711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.364 qpair failed and we were unable to recover it. 00:27:47.364 [2024-11-21 03:44:27.925833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.364 [2024-11-21 03:44:27.925983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.364 [2024-11-21 03:44:27.926008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.364 qpair failed and we were unable to recover it. 00:27:47.364 [2024-11-21 03:44:27.926111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.364 [2024-11-21 03:44:27.926218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.364 [2024-11-21 03:44:27.926243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.364 qpair failed and we were unable to recover it. 00:27:47.364 [2024-11-21 03:44:27.926371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.364 [2024-11-21 03:44:27.926469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.364 [2024-11-21 03:44:27.926494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.364 qpair failed and we were unable to recover it. 00:27:47.364 [2024-11-21 03:44:27.926600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.364 [2024-11-21 03:44:27.926725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.364 [2024-11-21 03:44:27.926751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.364 qpair failed and we were unable to recover it. 00:27:47.364 [2024-11-21 03:44:27.926877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.364 [2024-11-21 03:44:27.926973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.364 [2024-11-21 03:44:27.926999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.364 qpair failed and we were unable to recover it. 00:27:47.364 [2024-11-21 03:44:27.927106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.364 [2024-11-21 03:44:27.927202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.364 [2024-11-21 03:44:27.927227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.364 qpair failed and we were unable to recover it. 00:27:47.364 [2024-11-21 03:44:27.927324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.364 [2024-11-21 03:44:27.927415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.364 [2024-11-21 03:44:27.927439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.364 qpair failed and we were unable to recover it. 00:27:47.364 [2024-11-21 03:44:27.927529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.364 [2024-11-21 03:44:27.927635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.364 [2024-11-21 03:44:27.927660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.364 qpair failed and we were unable to recover it. 00:27:47.364 [2024-11-21 03:44:27.927792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.364 [2024-11-21 03:44:27.927911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.364 [2024-11-21 03:44:27.927936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.364 qpair failed and we were unable to recover it. 00:27:47.364 [2024-11-21 03:44:27.928045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.364 [2024-11-21 03:44:27.928160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.364 [2024-11-21 03:44:27.928191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.364 qpair failed and we were unable to recover it. 00:27:47.364 [2024-11-21 03:44:27.928317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.364 [2024-11-21 03:44:27.928440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.364 [2024-11-21 03:44:27.928465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.364 qpair failed and we were unable to recover it. 00:27:47.364 [2024-11-21 03:44:27.928575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.364 [2024-11-21 03:44:27.928666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.364 [2024-11-21 03:44:27.928691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.364 qpair failed and we were unable to recover it. 00:27:47.364 [2024-11-21 03:44:27.928790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.364 [2024-11-21 03:44:27.928883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.364 [2024-11-21 03:44:27.928908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.364 qpair failed and we were unable to recover it. 00:27:47.364 [2024-11-21 03:44:27.929007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.364 [2024-11-21 03:44:27.929134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.364 [2024-11-21 03:44:27.929160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.364 qpair failed and we were unable to recover it. 00:27:47.364 [2024-11-21 03:44:27.929266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.364 [2024-11-21 03:44:27.929364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.364 [2024-11-21 03:44:27.929389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.364 qpair failed and we were unable to recover it. 00:27:47.364 [2024-11-21 03:44:27.929480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.364 [2024-11-21 03:44:27.929603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.364 [2024-11-21 03:44:27.929628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.364 qpair failed and we were unable to recover it. 00:27:47.365 [2024-11-21 03:44:27.929718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.365 [2024-11-21 03:44:27.929872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.365 [2024-11-21 03:44:27.929897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.365 qpair failed and we were unable to recover it. 00:27:47.365 [2024-11-21 03:44:27.930023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.365 [2024-11-21 03:44:27.930125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.365 [2024-11-21 03:44:27.930151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.365 qpair failed and we were unable to recover it. 00:27:47.365 [2024-11-21 03:44:27.930278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.365 [2024-11-21 03:44:27.930406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.365 [2024-11-21 03:44:27.930432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.365 qpair failed and we were unable to recover it. 00:27:47.365 [2024-11-21 03:44:27.930527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.365 [2024-11-21 03:44:27.930690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.365 [2024-11-21 03:44:27.930716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.365 qpair failed and we were unable to recover it. 00:27:47.365 [2024-11-21 03:44:27.930844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.365 [2024-11-21 03:44:27.930933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.365 [2024-11-21 03:44:27.930958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.365 qpair failed and we were unable to recover it. 00:27:47.365 [2024-11-21 03:44:27.931059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.365 [2024-11-21 03:44:27.931171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.365 [2024-11-21 03:44:27.931197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.365 qpair failed and we were unable to recover it. 00:27:47.365 [2024-11-21 03:44:27.931361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.365 [2024-11-21 03:44:27.931485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.365 [2024-11-21 03:44:27.931510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.365 qpair failed and we were unable to recover it. 00:27:47.365 [2024-11-21 03:44:27.931646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.365 [2024-11-21 03:44:27.931740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.365 [2024-11-21 03:44:27.931766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.365 qpair failed and we were unable to recover it. 00:27:47.365 [2024-11-21 03:44:27.931865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.365 [2024-11-21 03:44:27.931996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.365 [2024-11-21 03:44:27.932021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.365 qpair failed and we were unable to recover it. 00:27:47.365 [2024-11-21 03:44:27.932173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.365 [2024-11-21 03:44:27.932287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.365 [2024-11-21 03:44:27.932313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.365 qpair failed and we were unable to recover it. 00:27:47.365 [2024-11-21 03:44:27.932421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.365 [2024-11-21 03:44:27.932523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.365 [2024-11-21 03:44:27.932548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.365 qpair failed and we were unable to recover it. 00:27:47.365 [2024-11-21 03:44:27.932669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.365 [2024-11-21 03:44:27.932776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.365 [2024-11-21 03:44:27.932800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.365 qpair failed and we were unable to recover it. 00:27:47.365 [2024-11-21 03:44:27.932892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.365 [2024-11-21 03:44:27.932995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.365 [2024-11-21 03:44:27.933021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.365 qpair failed and we were unable to recover it. 00:27:47.365 [2024-11-21 03:44:27.933133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.365 [2024-11-21 03:44:27.933225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.365 [2024-11-21 03:44:27.933250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.365 qpair failed and we were unable to recover it. 00:27:47.365 [2024-11-21 03:44:27.933373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.365 [2024-11-21 03:44:27.933472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.365 [2024-11-21 03:44:27.933497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.365 qpair failed and we were unable to recover it. 00:27:47.365 [2024-11-21 03:44:27.933623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.365 [2024-11-21 03:44:27.933716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.365 [2024-11-21 03:44:27.933741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.365 qpair failed and we were unable to recover it. 00:27:47.365 [2024-11-21 03:44:27.933851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.365 [2024-11-21 03:44:27.933977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.365 [2024-11-21 03:44:27.934003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.365 qpair failed and we were unable to recover it. 00:27:47.365 [2024-11-21 03:44:27.934196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.365 [2024-11-21 03:44:27.934330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.365 [2024-11-21 03:44:27.934355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.365 qpair failed and we were unable to recover it. 00:27:47.365 [2024-11-21 03:44:27.934453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.365 [2024-11-21 03:44:27.934548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.365 [2024-11-21 03:44:27.934573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.365 qpair failed and we were unable to recover it. 00:27:47.365 [2024-11-21 03:44:27.934680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.365 [2024-11-21 03:44:27.934781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.365 [2024-11-21 03:44:27.934806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.365 qpair failed and we were unable to recover it. 00:27:47.365 [2024-11-21 03:44:27.934905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.365 [2024-11-21 03:44:27.935036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.365 [2024-11-21 03:44:27.935061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.365 qpair failed and we were unable to recover it. 00:27:47.365 [2024-11-21 03:44:27.935180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.365 [2024-11-21 03:44:27.935280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.365 [2024-11-21 03:44:27.935305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.365 qpair failed and we were unable to recover it. 00:27:47.365 [2024-11-21 03:44:27.935409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.365 [2024-11-21 03:44:27.935512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.365 [2024-11-21 03:44:27.935537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.365 qpair failed and we were unable to recover it. 00:27:47.365 [2024-11-21 03:44:27.935671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.365 [2024-11-21 03:44:27.935770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.365 [2024-11-21 03:44:27.935794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.365 qpair failed and we were unable to recover it. 00:27:47.365 [2024-11-21 03:44:27.935907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.365 [2024-11-21 03:44:27.935998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.365 [2024-11-21 03:44:27.936023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.365 qpair failed and we were unable to recover it. 00:27:47.365 [2024-11-21 03:44:27.936164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.365 [2024-11-21 03:44:27.936265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.366 [2024-11-21 03:44:27.936290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.366 qpair failed and we were unable to recover it. 00:27:47.366 [2024-11-21 03:44:27.936398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.366 [2024-11-21 03:44:27.936565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.366 [2024-11-21 03:44:27.936591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.366 qpair failed and we were unable to recover it. 00:27:47.366 [2024-11-21 03:44:27.936712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.366 [2024-11-21 03:44:27.936836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.366 [2024-11-21 03:44:27.936861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.366 qpair failed and we were unable to recover it. 00:27:47.366 [2024-11-21 03:44:27.936960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.366 [2024-11-21 03:44:27.937058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.366 [2024-11-21 03:44:27.937089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.366 qpair failed and we were unable to recover it. 00:27:47.366 [2024-11-21 03:44:27.937204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.366 [2024-11-21 03:44:27.937329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.366 [2024-11-21 03:44:27.937354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.366 qpair failed and we were unable to recover it. 00:27:47.366 [2024-11-21 03:44:27.937487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.366 [2024-11-21 03:44:27.937607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.366 [2024-11-21 03:44:27.937632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.366 qpair failed and we were unable to recover it. 00:27:47.366 [2024-11-21 03:44:27.937727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.366 [2024-11-21 03:44:27.937820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.366 [2024-11-21 03:44:27.937844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.366 qpair failed and we were unable to recover it. 00:27:47.366 [2024-11-21 03:44:27.937955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.366 [2024-11-21 03:44:27.938114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.366 [2024-11-21 03:44:27.938140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.366 qpair failed and we were unable to recover it. 00:27:47.366 [2024-11-21 03:44:27.938243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.366 [2024-11-21 03:44:27.938341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.366 [2024-11-21 03:44:27.938366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.366 qpair failed and we were unable to recover it. 00:27:47.366 [2024-11-21 03:44:27.938492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.366 [2024-11-21 03:44:27.938603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.366 [2024-11-21 03:44:27.938629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.366 qpair failed and we were unable to recover it. 00:27:47.366 [2024-11-21 03:44:27.938721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.366 [2024-11-21 03:44:27.938855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.366 [2024-11-21 03:44:27.938880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.366 qpair failed and we were unable to recover it. 00:27:47.366 [2024-11-21 03:44:27.938994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.366 [2024-11-21 03:44:27.939100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.366 [2024-11-21 03:44:27.939129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.366 qpair failed and we were unable to recover it. 00:27:47.366 [2024-11-21 03:44:27.939227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.366 [2024-11-21 03:44:27.939353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.366 [2024-11-21 03:44:27.939377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.366 qpair failed and we were unable to recover it. 00:27:47.366 [2024-11-21 03:44:27.939467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.366 [2024-11-21 03:44:27.939573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.366 [2024-11-21 03:44:27.939598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.366 qpair failed and we were unable to recover it. 00:27:47.366 [2024-11-21 03:44:27.939724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.366 [2024-11-21 03:44:27.939852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.366 [2024-11-21 03:44:27.939878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.366 qpair failed and we were unable to recover it. 00:27:47.366 [2024-11-21 03:44:27.940031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.366 [2024-11-21 03:44:27.940135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.366 [2024-11-21 03:44:27.940161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.366 qpair failed and we were unable to recover it. 00:27:47.366 [2024-11-21 03:44:27.940260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.366 [2024-11-21 03:44:27.940352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.366 [2024-11-21 03:44:27.940377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.366 qpair failed and we were unable to recover it. 00:27:47.366 [2024-11-21 03:44:27.940534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.366 [2024-11-21 03:44:27.940630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.366 [2024-11-21 03:44:27.940655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.366 qpair failed and we were unable to recover it. 00:27:47.366 [2024-11-21 03:44:27.940784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.366 [2024-11-21 03:44:27.940876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.366 [2024-11-21 03:44:27.940901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.366 qpair failed and we were unable to recover it. 00:27:47.366 [2024-11-21 03:44:27.941038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.366 [2024-11-21 03:44:27.941194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.366 [2024-11-21 03:44:27.941225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.366 qpair failed and we were unable to recover it. 00:27:47.366 [2024-11-21 03:44:27.941355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.366 [2024-11-21 03:44:27.941489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.366 [2024-11-21 03:44:27.941514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.366 qpair failed and we were unable to recover it. 00:27:47.366 [2024-11-21 03:44:27.941639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.366 [2024-11-21 03:44:27.941772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.366 [2024-11-21 03:44:27.941797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.366 qpair failed and we were unable to recover it. 00:27:47.366 [2024-11-21 03:44:27.941907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.366 [2024-11-21 03:44:27.941999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.366 [2024-11-21 03:44:27.942024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.366 qpair failed and we were unable to recover it. 00:27:47.366 [2024-11-21 03:44:27.942136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.366 [2024-11-21 03:44:27.942235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.366 [2024-11-21 03:44:27.942260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.366 qpair failed and we were unable to recover it. 00:27:47.366 [2024-11-21 03:44:27.942404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.366 [2024-11-21 03:44:27.942511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.366 [2024-11-21 03:44:27.942536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.366 qpair failed and we were unable to recover it. 00:27:47.366 [2024-11-21 03:44:27.942661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.366 [2024-11-21 03:44:27.942793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.366 [2024-11-21 03:44:27.942818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.366 qpair failed and we were unable to recover it. 00:27:47.366 [2024-11-21 03:44:27.942917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.366 [2024-11-21 03:44:27.943053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.366 [2024-11-21 03:44:27.943086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.366 qpair failed and we were unable to recover it. 00:27:47.366 [2024-11-21 03:44:27.943220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.367 [2024-11-21 03:44:27.943354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.367 [2024-11-21 03:44:27.943379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.367 qpair failed and we were unable to recover it. 00:27:47.367 [2024-11-21 03:44:27.943479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.367 [2024-11-21 03:44:27.943577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.367 [2024-11-21 03:44:27.943602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.367 qpair failed and we were unable to recover it. 00:27:47.367 [2024-11-21 03:44:27.943695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.367 [2024-11-21 03:44:27.943817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.367 [2024-11-21 03:44:27.943847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.367 qpair failed and we were unable to recover it. 00:27:47.367 [2024-11-21 03:44:27.943968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.367 [2024-11-21 03:44:27.944056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.367 [2024-11-21 03:44:27.944088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.367 qpair failed and we were unable to recover it. 00:27:47.367 [2024-11-21 03:44:27.944228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.367 [2024-11-21 03:44:27.944337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.367 [2024-11-21 03:44:27.944362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.367 qpair failed and we were unable to recover it. 00:27:47.367 [2024-11-21 03:44:27.944465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.367 [2024-11-21 03:44:27.944593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.660 [2024-11-21 03:44:27.944619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.660 qpair failed and we were unable to recover it. 00:27:47.661 [2024-11-21 03:44:27.944712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.661 [2024-11-21 03:44:27.944816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.661 [2024-11-21 03:44:27.944842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.661 qpair failed and we were unable to recover it. 00:27:47.661 [2024-11-21 03:44:27.944977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.661 [2024-11-21 03:44:27.945083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.661 [2024-11-21 03:44:27.945120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.661 qpair failed and we were unable to recover it. 00:27:47.661 [2024-11-21 03:44:27.945247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.661 [2024-11-21 03:44:27.945344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.661 [2024-11-21 03:44:27.945370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.661 qpair failed and we were unable to recover it. 00:27:47.661 [2024-11-21 03:44:27.945502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.661 [2024-11-21 03:44:27.945632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.661 [2024-11-21 03:44:27.945657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.661 qpair failed and we were unable to recover it. 00:27:47.661 [2024-11-21 03:44:27.945764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.661 [2024-11-21 03:44:27.945868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.661 [2024-11-21 03:44:27.945892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.661 qpair failed and we were unable to recover it. 00:27:47.661 [2024-11-21 03:44:27.946023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.661 [2024-11-21 03:44:27.946131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.661 [2024-11-21 03:44:27.946158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.661 qpair failed and we were unable to recover it. 00:27:47.661 [2024-11-21 03:44:27.946284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.661 [2024-11-21 03:44:27.946379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.661 [2024-11-21 03:44:27.946405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.661 qpair failed and we were unable to recover it. 00:27:47.661 [2024-11-21 03:44:27.946507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.661 [2024-11-21 03:44:27.946612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.661 [2024-11-21 03:44:27.946637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.661 qpair failed and we were unable to recover it. 00:27:47.661 [2024-11-21 03:44:27.946770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.661 [2024-11-21 03:44:27.946900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.661 [2024-11-21 03:44:27.946925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.661 qpair failed and we were unable to recover it. 00:27:47.661 [2024-11-21 03:44:27.947025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.661 [2024-11-21 03:44:27.947126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.661 [2024-11-21 03:44:27.947152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.661 qpair failed and we were unable to recover it. 00:27:47.661 [2024-11-21 03:44:27.947279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.661 [2024-11-21 03:44:27.947383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.661 [2024-11-21 03:44:27.947408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.661 qpair failed and we were unable to recover it. 00:27:47.661 [2024-11-21 03:44:27.947536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.661 [2024-11-21 03:44:27.947636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.661 [2024-11-21 03:44:27.947663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.661 qpair failed and we were unable to recover it. 00:27:47.661 [2024-11-21 03:44:27.947756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.661 [2024-11-21 03:44:27.947856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.661 [2024-11-21 03:44:27.947881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.661 qpair failed and we were unable to recover it. 00:27:47.661 [2024-11-21 03:44:27.948004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.661 [2024-11-21 03:44:27.948124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.661 [2024-11-21 03:44:27.948150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.661 qpair failed and we were unable to recover it. 00:27:47.661 [2024-11-21 03:44:27.948241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.661 [2024-11-21 03:44:27.948365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.661 [2024-11-21 03:44:27.948390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.661 qpair failed and we were unable to recover it. 00:27:47.661 [2024-11-21 03:44:27.948496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.661 [2024-11-21 03:44:27.948600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.661 [2024-11-21 03:44:27.948625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.661 qpair failed and we were unable to recover it. 00:27:47.661 [2024-11-21 03:44:27.948746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.661 [2024-11-21 03:44:27.948871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.661 [2024-11-21 03:44:27.948896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.661 qpair failed and we were unable to recover it. 00:27:47.661 [2024-11-21 03:44:27.948992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.661 [2024-11-21 03:44:27.949122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.661 [2024-11-21 03:44:27.949148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.661 qpair failed and we were unable to recover it. 00:27:47.661 [2024-11-21 03:44:27.949282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.661 [2024-11-21 03:44:27.949383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.661 [2024-11-21 03:44:27.949408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.661 qpair failed and we were unable to recover it. 00:27:47.661 [2024-11-21 03:44:27.949522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.661 [2024-11-21 03:44:27.949644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.661 [2024-11-21 03:44:27.949669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.661 qpair failed and we were unable to recover it. 00:27:47.661 [2024-11-21 03:44:27.949805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.661 [2024-11-21 03:44:27.949897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.661 [2024-11-21 03:44:27.949922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.661 qpair failed and we were unable to recover it. 00:27:47.661 [2024-11-21 03:44:27.950043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.661 [2024-11-21 03:44:27.950167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.661 [2024-11-21 03:44:27.950192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.661 qpair failed and we were unable to recover it. 00:27:47.661 [2024-11-21 03:44:27.950319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.661 [2024-11-21 03:44:27.950421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-21 03:44:27.950445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.662 qpair failed and we were unable to recover it. 00:27:47.662 [2024-11-21 03:44:27.950554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-21 03:44:27.950651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-21 03:44:27.950677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.662 qpair failed and we were unable to recover it. 00:27:47.662 [2024-11-21 03:44:27.950770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-21 03:44:27.950869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-21 03:44:27.950894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.662 qpair failed and we were unable to recover it. 00:27:47.662 [2024-11-21 03:44:27.950988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-21 03:44:27.951121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-21 03:44:27.951146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.662 qpair failed and we were unable to recover it. 00:27:47.662 [2024-11-21 03:44:27.951249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-21 03:44:27.951340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-21 03:44:27.951365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.662 qpair failed and we were unable to recover it. 00:27:47.662 [2024-11-21 03:44:27.951484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-21 03:44:27.951582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-21 03:44:27.951608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.662 qpair failed and we were unable to recover it. 00:27:47.662 [2024-11-21 03:44:27.951765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-21 03:44:27.951897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-21 03:44:27.951922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.662 qpair failed and we were unable to recover it. 00:27:47.662 [2024-11-21 03:44:27.952021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-21 03:44:27.952135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-21 03:44:27.952161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.662 qpair failed and we were unable to recover it. 00:27:47.662 [2024-11-21 03:44:27.952285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-21 03:44:27.952412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-21 03:44:27.952437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.662 qpair failed and we were unable to recover it. 00:27:47.662 [2024-11-21 03:44:27.952573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-21 03:44:27.952676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-21 03:44:27.952701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.662 qpair failed and we were unable to recover it. 00:27:47.662 [2024-11-21 03:44:27.952798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-21 03:44:27.952918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-21 03:44:27.952943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.662 qpair failed and we were unable to recover it. 00:27:47.662 [2024-11-21 03:44:27.953045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-21 03:44:27.953160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-21 03:44:27.953186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.662 qpair failed and we were unable to recover it. 00:27:47.662 [2024-11-21 03:44:27.953336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-21 03:44:27.953440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-21 03:44:27.953465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.662 qpair failed and we were unable to recover it. 00:27:47.662 [2024-11-21 03:44:27.953603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-21 03:44:27.953691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-21 03:44:27.953716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.662 qpair failed and we were unable to recover it. 00:27:47.662 [2024-11-21 03:44:27.953819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-21 03:44:27.953921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-21 03:44:27.953946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.662 qpair failed and we were unable to recover it. 00:27:47.662 [2024-11-21 03:44:27.954084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-21 03:44:27.954211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-21 03:44:27.954240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.662 qpair failed and we were unable to recover it. 00:27:47.662 [2024-11-21 03:44:27.954344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-21 03:44:27.954438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-21 03:44:27.954464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.662 qpair failed and we were unable to recover it. 00:27:47.662 [2024-11-21 03:44:27.954575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-21 03:44:27.954677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-21 03:44:27.954702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.662 qpair failed and we were unable to recover it. 00:27:47.662 [2024-11-21 03:44:27.954800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-21 03:44:27.954927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-21 03:44:27.954952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.662 qpair failed and we were unable to recover it. 00:27:47.662 [2024-11-21 03:44:27.955090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-21 03:44:27.955195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-21 03:44:27.955220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.662 qpair failed and we were unable to recover it. 00:27:47.662 [2024-11-21 03:44:27.955317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-21 03:44:27.955445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-21 03:44:27.955470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.662 qpair failed and we were unable to recover it. 00:27:47.662 [2024-11-21 03:44:27.955577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-21 03:44:27.955701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-21 03:44:27.955726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.662 qpair failed and we were unable to recover it. 00:27:47.662 [2024-11-21 03:44:27.955824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-21 03:44:27.955923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-21 03:44:27.955949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.662 qpair failed and we were unable to recover it. 00:27:47.662 [2024-11-21 03:44:27.956115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.662 [2024-11-21 03:44:27.956245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.663 [2024-11-21 03:44:27.956270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.663 qpair failed and we were unable to recover it. 00:27:47.663 [2024-11-21 03:44:27.956404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.663 [2024-11-21 03:44:27.956502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.663 [2024-11-21 03:44:27.956528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.663 qpair failed and we were unable to recover it. 00:27:47.663 [2024-11-21 03:44:27.956682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.663 [2024-11-21 03:44:27.956805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.663 [2024-11-21 03:44:27.956835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.663 qpair failed and we were unable to recover it. 00:27:47.663 [2024-11-21 03:44:27.956943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.663 [2024-11-21 03:44:27.957079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.663 [2024-11-21 03:44:27.957105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.663 qpair failed and we were unable to recover it. 00:27:47.663 [2024-11-21 03:44:27.957209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.663 [2024-11-21 03:44:27.957305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.663 [2024-11-21 03:44:27.957329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.663 qpair failed and we were unable to recover it. 00:27:47.663 [2024-11-21 03:44:27.957461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.663 [2024-11-21 03:44:27.957557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.663 [2024-11-21 03:44:27.957582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.663 qpair failed and we were unable to recover it. 00:27:47.663 [2024-11-21 03:44:27.957715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.663 [2024-11-21 03:44:27.957820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.663 [2024-11-21 03:44:27.957845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.663 qpair failed and we were unable to recover it. 00:27:47.663 [2024-11-21 03:44:27.957947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.663 [2024-11-21 03:44:27.958058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.663 [2024-11-21 03:44:27.958091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.663 qpair failed and we were unable to recover it. 00:27:47.663 [2024-11-21 03:44:27.958194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.663 [2024-11-21 03:44:27.958293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.663 [2024-11-21 03:44:27.958319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.663 qpair failed and we were unable to recover it. 00:27:47.663 [2024-11-21 03:44:27.958447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.663 [2024-11-21 03:44:27.958544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.663 [2024-11-21 03:44:27.958569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.663 qpair failed and we were unable to recover it. 00:27:47.663 [2024-11-21 03:44:27.958664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.663 [2024-11-21 03:44:27.958774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.663 [2024-11-21 03:44:27.958799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.663 qpair failed and we were unable to recover it. 00:27:47.663 [2024-11-21 03:44:27.958919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.663 [2024-11-21 03:44:27.959051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.663 [2024-11-21 03:44:27.959082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.663 qpair failed and we were unable to recover it. 00:27:47.663 [2024-11-21 03:44:27.959184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.663 [2024-11-21 03:44:27.959281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.663 [2024-11-21 03:44:27.959306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.663 qpair failed and we were unable to recover it. 00:27:47.663 [2024-11-21 03:44:27.959403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.663 [2024-11-21 03:44:27.959495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.663 [2024-11-21 03:44:27.959520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.663 qpair failed and we were unable to recover it. 00:27:47.663 [2024-11-21 03:44:27.959680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.663 [2024-11-21 03:44:27.959782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.663 [2024-11-21 03:44:27.959807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.663 qpair failed and we were unable to recover it. 00:27:47.663 [2024-11-21 03:44:27.959916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.663 [2024-11-21 03:44:27.960049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.663 [2024-11-21 03:44:27.960081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.663 qpair failed and we were unable to recover it. 00:27:47.663 [2024-11-21 03:44:27.960201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.663 [2024-11-21 03:44:27.960306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.663 [2024-11-21 03:44:27.960332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.663 qpair failed and we were unable to recover it. 00:27:47.663 [2024-11-21 03:44:27.960423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.663 [2024-11-21 03:44:27.960515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.663 [2024-11-21 03:44:27.960540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.663 qpair failed and we were unable to recover it. 00:27:47.663 [2024-11-21 03:44:27.960645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.663 [2024-11-21 03:44:27.960748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.663 [2024-11-21 03:44:27.960774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.663 qpair failed and we were unable to recover it. 00:27:47.663 [2024-11-21 03:44:27.960881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.663 [2024-11-21 03:44:27.961003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.663 [2024-11-21 03:44:27.961028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.663 qpair failed and we were unable to recover it. 00:27:47.663 [2024-11-21 03:44:27.961168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.663 [2024-11-21 03:44:27.961272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.663 [2024-11-21 03:44:27.961297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.663 qpair failed and we were unable to recover it. 00:27:47.663 [2024-11-21 03:44:27.961460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.663 [2024-11-21 03:44:27.961556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.663 [2024-11-21 03:44:27.961581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.663 qpair failed and we were unable to recover it. 00:27:47.663 [2024-11-21 03:44:27.961678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.663 [2024-11-21 03:44:27.961813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.663 [2024-11-21 03:44:27.961837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.663 qpair failed and we were unable to recover it. 00:27:47.663 [2024-11-21 03:44:27.961961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-21 03:44:27.962057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-21 03:44:27.962107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.664 qpair failed and we were unable to recover it. 00:27:47.664 [2024-11-21 03:44:27.962242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-21 03:44:27.962374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-21 03:44:27.962399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.664 qpair failed and we were unable to recover it. 00:27:47.664 [2024-11-21 03:44:27.962502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-21 03:44:27.962637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-21 03:44:27.962662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.664 qpair failed and we were unable to recover it. 00:27:47.664 [2024-11-21 03:44:27.962763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-21 03:44:27.962891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-21 03:44:27.962915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.664 qpair failed and we were unable to recover it. 00:27:47.664 [2024-11-21 03:44:27.963018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-21 03:44:27.963116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-21 03:44:27.963141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.664 qpair failed and we were unable to recover it. 00:27:47.664 [2024-11-21 03:44:27.963238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-21 03:44:27.963332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-21 03:44:27.963357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.664 qpair failed and we were unable to recover it. 00:27:47.664 [2024-11-21 03:44:27.963462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-21 03:44:27.963568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-21 03:44:27.963593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.664 qpair failed and we were unable to recover it. 00:27:47.664 [2024-11-21 03:44:27.963727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-21 03:44:27.963850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-21 03:44:27.963875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.664 qpair failed and we were unable to recover it. 00:27:47.664 [2024-11-21 03:44:27.963967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-21 03:44:27.964094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-21 03:44:27.964119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.664 qpair failed and we were unable to recover it. 00:27:47.664 [2024-11-21 03:44:27.964230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-21 03:44:27.964356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-21 03:44:27.964382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.664 qpair failed and we were unable to recover it. 00:27:47.664 [2024-11-21 03:44:27.964511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-21 03:44:27.964610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-21 03:44:27.964636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.664 qpair failed and we were unable to recover it. 00:27:47.664 [2024-11-21 03:44:27.964728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-21 03:44:27.964859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-21 03:44:27.964884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.664 qpair failed and we were unable to recover it. 00:27:47.664 [2024-11-21 03:44:27.965011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-21 03:44:27.965113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-21 03:44:27.965139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.664 qpair failed and we were unable to recover it. 00:27:47.664 [2024-11-21 03:44:27.965272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-21 03:44:27.965374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-21 03:44:27.965399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.664 qpair failed and we were unable to recover it. 00:27:47.664 [2024-11-21 03:44:27.965495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-21 03:44:27.965673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-21 03:44:27.965698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.664 qpair failed and we were unable to recover it. 00:27:47.664 [2024-11-21 03:44:27.965799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-21 03:44:27.965904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-21 03:44:27.965929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.664 qpair failed and we were unable to recover it. 00:27:47.664 [2024-11-21 03:44:27.966055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-21 03:44:27.966167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-21 03:44:27.966193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.664 qpair failed and we were unable to recover it. 00:27:47.664 [2024-11-21 03:44:27.966292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-21 03:44:27.966390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-21 03:44:27.966415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.664 qpair failed and we were unable to recover it. 00:27:47.664 [2024-11-21 03:44:27.966549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-21 03:44:27.966683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-21 03:44:27.966708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.664 qpair failed and we were unable to recover it. 00:27:47.664 [2024-11-21 03:44:27.966811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-21 03:44:27.966912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-21 03:44:27.966937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.664 qpair failed and we were unable to recover it. 00:27:47.664 [2024-11-21 03:44:27.967035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-21 03:44:27.967148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-21 03:44:27.967174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.664 qpair failed and we were unable to recover it. 00:27:47.664 [2024-11-21 03:44:27.967285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-21 03:44:27.967383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-21 03:44:27.967408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.664 qpair failed and we were unable to recover it. 00:27:47.664 [2024-11-21 03:44:27.967510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-21 03:44:27.967638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.664 [2024-11-21 03:44:27.967663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.664 qpair failed and we were unable to recover it. 00:27:47.664 [2024-11-21 03:44:27.967797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.665 [2024-11-21 03:44:27.967924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.665 [2024-11-21 03:44:27.967949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.665 qpair failed and we were unable to recover it. 00:27:47.665 [2024-11-21 03:44:27.968057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.665 [2024-11-21 03:44:27.968158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.665 [2024-11-21 03:44:27.968184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.665 qpair failed and we were unable to recover it. 00:27:47.665 [2024-11-21 03:44:27.968290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.665 [2024-11-21 03:44:27.968398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.665 [2024-11-21 03:44:27.968423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.665 qpair failed and we were unable to recover it. 00:27:47.665 [2024-11-21 03:44:27.968548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.665 [2024-11-21 03:44:27.968670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.665 [2024-11-21 03:44:27.968695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.665 qpair failed and we were unable to recover it. 00:27:47.665 [2024-11-21 03:44:27.968797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.665 [2024-11-21 03:44:27.968902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.665 [2024-11-21 03:44:27.968927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.665 qpair failed and we were unable to recover it. 00:27:47.665 [2024-11-21 03:44:27.969064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.665 [2024-11-21 03:44:27.969163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.665 [2024-11-21 03:44:27.969188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.665 qpair failed and we were unable to recover it. 00:27:47.665 [2024-11-21 03:44:27.969296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.665 [2024-11-21 03:44:27.969416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.665 [2024-11-21 03:44:27.969441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.665 qpair failed and we were unable to recover it. 00:27:47.665 [2024-11-21 03:44:27.969575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.665 [2024-11-21 03:44:27.969710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.665 [2024-11-21 03:44:27.969739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.665 qpair failed and we were unable to recover it. 00:27:47.665 [2024-11-21 03:44:27.969882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.665 [2024-11-21 03:44:27.969977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.665 [2024-11-21 03:44:27.970002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.665 qpair failed and we were unable to recover it. 00:27:47.665 [2024-11-21 03:44:27.970108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.665 [2024-11-21 03:44:27.970213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.665 [2024-11-21 03:44:27.970237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.665 qpair failed and we were unable to recover it. 00:27:47.665 [2024-11-21 03:44:27.970340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.665 [2024-11-21 03:44:27.970441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.665 [2024-11-21 03:44:27.970466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.665 qpair failed and we were unable to recover it. 00:27:47.665 [2024-11-21 03:44:27.970569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.665 [2024-11-21 03:44:27.970671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.665 [2024-11-21 03:44:27.970696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.665 qpair failed and we were unable to recover it. 00:27:47.665 [2024-11-21 03:44:27.970791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.665 [2024-11-21 03:44:27.970897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.665 [2024-11-21 03:44:27.970922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.665 qpair failed and we were unable to recover it. 00:27:47.665 [2024-11-21 03:44:27.971049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.665 [2024-11-21 03:44:27.971181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.665 [2024-11-21 03:44:27.971207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.665 qpair failed and we were unable to recover it. 00:27:47.665 [2024-11-21 03:44:27.971314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.665 [2024-11-21 03:44:27.971412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.665 [2024-11-21 03:44:27.971437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.665 qpair failed and we were unable to recover it. 00:27:47.665 [2024-11-21 03:44:27.971541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.665 [2024-11-21 03:44:27.971642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.665 [2024-11-21 03:44:27.971667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.665 qpair failed and we were unable to recover it. 00:27:47.665 [2024-11-21 03:44:27.971802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.665 [2024-11-21 03:44:27.971929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.665 [2024-11-21 03:44:27.971954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.665 qpair failed and we were unable to recover it. 00:27:47.665 [2024-11-21 03:44:27.972057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.665 [2024-11-21 03:44:27.972187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.665 [2024-11-21 03:44:27.972212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.665 qpair failed and we were unable to recover it. 00:27:47.665 [2024-11-21 03:44:27.972320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.665 [2024-11-21 03:44:27.972450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.665 [2024-11-21 03:44:27.972476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.665 qpair failed and we were unable to recover it. 00:27:47.665 [2024-11-21 03:44:27.972585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.665 [2024-11-21 03:44:27.972704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.665 [2024-11-21 03:44:27.972729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.665 qpair failed and we were unable to recover it. 00:27:47.665 [2024-11-21 03:44:27.972824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.665 [2024-11-21 03:44:27.972948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.665 [2024-11-21 03:44:27.972972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.665 qpair failed and we were unable to recover it. 00:27:47.665 [2024-11-21 03:44:27.973100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.665 [2024-11-21 03:44:27.973197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.665 [2024-11-21 03:44:27.973224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.665 qpair failed and we were unable to recover it. 00:27:47.665 [2024-11-21 03:44:27.973323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.665 [2024-11-21 03:44:27.973418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.665 [2024-11-21 03:44:27.973443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.665 qpair failed and we were unable to recover it. 00:27:47.665 [2024-11-21 03:44:27.973581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.665 [2024-11-21 03:44:27.973685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.665 [2024-11-21 03:44:27.973710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.665 qpair failed and we were unable to recover it. 00:27:47.665 [2024-11-21 03:44:27.973810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.665 [2024-11-21 03:44:27.973938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.665 [2024-11-21 03:44:27.973963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.665 qpair failed and we were unable to recover it. 00:27:47.666 [2024-11-21 03:44:27.974054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.666 [2024-11-21 03:44:27.974168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.666 [2024-11-21 03:44:27.974193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.666 qpair failed and we were unable to recover it. 00:27:47.666 [2024-11-21 03:44:27.974286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.666 [2024-11-21 03:44:27.974394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.666 [2024-11-21 03:44:27.974419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.666 qpair failed and we were unable to recover it. 00:27:47.666 [2024-11-21 03:44:27.974547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.666 [2024-11-21 03:44:27.974676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.666 [2024-11-21 03:44:27.974700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.666 qpair failed and we were unable to recover it. 00:27:47.666 [2024-11-21 03:44:27.974843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.666 [2024-11-21 03:44:27.974967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.666 [2024-11-21 03:44:27.974992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.666 qpair failed and we were unable to recover it. 00:27:47.666 [2024-11-21 03:44:27.975092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.666 [2024-11-21 03:44:27.975195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.666 [2024-11-21 03:44:27.975221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.666 qpair failed and we were unable to recover it. 00:27:47.666 [2024-11-21 03:44:27.975313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.666 [2024-11-21 03:44:27.975408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.666 [2024-11-21 03:44:27.975434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.666 qpair failed and we were unable to recover it. 00:27:47.666 [2024-11-21 03:44:27.975569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.666 [2024-11-21 03:44:27.975670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.666 [2024-11-21 03:44:27.975695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.666 qpair failed and we were unable to recover it. 00:27:47.666 [2024-11-21 03:44:27.975802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.666 [2024-11-21 03:44:27.975890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.666 [2024-11-21 03:44:27.975915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.666 qpair failed and we were unable to recover it. 00:27:47.666 [2024-11-21 03:44:27.976079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.666 [2024-11-21 03:44:27.976182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.666 [2024-11-21 03:44:27.976207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.666 qpair failed and we were unable to recover it. 00:27:47.666 [2024-11-21 03:44:27.976299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.666 [2024-11-21 03:44:27.976424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.666 [2024-11-21 03:44:27.976449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.666 qpair failed and we were unable to recover it. 00:27:47.666 [2024-11-21 03:44:27.976550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.666 [2024-11-21 03:44:27.976675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.666 [2024-11-21 03:44:27.976700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.666 qpair failed and we were unable to recover it. 00:27:47.666 [2024-11-21 03:44:27.976797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.666 [2024-11-21 03:44:27.976893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.666 [2024-11-21 03:44:27.976918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.666 qpair failed and we were unable to recover it. 00:27:47.666 [2024-11-21 03:44:27.977040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.666 [2024-11-21 03:44:27.977145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.666 [2024-11-21 03:44:27.977171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.666 qpair failed and we were unable to recover it. 00:27:47.666 [2024-11-21 03:44:27.977289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.666 [2024-11-21 03:44:27.977391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.666 [2024-11-21 03:44:27.977417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.666 qpair failed and we were unable to recover it. 00:27:47.666 [2024-11-21 03:44:27.977539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.666 [2024-11-21 03:44:27.977666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.666 [2024-11-21 03:44:27.977692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.666 qpair failed and we were unable to recover it. 00:27:47.666 [2024-11-21 03:44:27.977819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.666 [2024-11-21 03:44:27.977916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.666 [2024-11-21 03:44:27.977941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.666 qpair failed and we were unable to recover it. 00:27:47.666 [2024-11-21 03:44:27.978037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.666 [2024-11-21 03:44:27.978181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.666 [2024-11-21 03:44:27.978207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.666 qpair failed and we were unable to recover it. 00:27:47.666 [2024-11-21 03:44:27.978304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.666 [2024-11-21 03:44:27.978463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.666 [2024-11-21 03:44:27.978488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.666 qpair failed and we were unable to recover it. 00:27:47.666 [2024-11-21 03:44:27.978596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.666 [2024-11-21 03:44:27.978700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-21 03:44:27.978725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.667 qpair failed and we were unable to recover it. 00:27:47.667 [2024-11-21 03:44:27.978823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-21 03:44:27.978922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-21 03:44:27.978947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.667 qpair failed and we were unable to recover it. 00:27:47.667 [2024-11-21 03:44:27.979057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-21 03:44:27.979190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-21 03:44:27.979215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.667 qpair failed and we were unable to recover it. 00:27:47.667 [2024-11-21 03:44:27.979315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-21 03:44:27.979407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-21 03:44:27.979432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.667 qpair failed and we were unable to recover it. 00:27:47.667 [2024-11-21 03:44:27.979554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-21 03:44:27.979675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-21 03:44:27.979700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.667 qpair failed and we were unable to recover it. 00:27:47.667 [2024-11-21 03:44:27.979831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-21 03:44:27.979964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-21 03:44:27.979989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.667 qpair failed and we were unable to recover it. 00:27:47.667 [2024-11-21 03:44:27.980114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-21 03:44:27.980206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-21 03:44:27.980231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.667 qpair failed and we were unable to recover it. 00:27:47.667 [2024-11-21 03:44:27.980330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-21 03:44:27.980426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-21 03:44:27.980451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.667 qpair failed and we were unable to recover it. 00:27:47.667 [2024-11-21 03:44:27.980550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-21 03:44:27.980680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-21 03:44:27.980705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.667 qpair failed and we were unable to recover it. 00:27:47.667 [2024-11-21 03:44:27.980804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-21 03:44:27.980897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-21 03:44:27.980922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.667 qpair failed and we were unable to recover it. 00:27:47.667 [2024-11-21 03:44:27.981038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-21 03:44:27.981142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-21 03:44:27.981168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.667 qpair failed and we were unable to recover it. 00:27:47.667 [2024-11-21 03:44:27.981271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-21 03:44:27.981367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-21 03:44:27.981392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.667 qpair failed and we were unable to recover it. 00:27:47.667 [2024-11-21 03:44:27.981516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-21 03:44:27.981617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-21 03:44:27.981642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.667 qpair failed and we were unable to recover it. 00:27:47.667 [2024-11-21 03:44:27.981772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-21 03:44:27.981898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-21 03:44:27.981924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.667 qpair failed and we were unable to recover it. 00:27:47.667 [2024-11-21 03:44:27.982021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-21 03:44:27.982124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-21 03:44:27.982150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.667 qpair failed and we were unable to recover it. 00:27:47.667 [2024-11-21 03:44:27.982246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-21 03:44:27.982359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-21 03:44:27.982388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.667 qpair failed and we were unable to recover it. 00:27:47.667 [2024-11-21 03:44:27.982489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-21 03:44:27.982616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-21 03:44:27.982641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.667 qpair failed and we were unable to recover it. 00:27:47.667 [2024-11-21 03:44:27.982741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-21 03:44:27.982837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-21 03:44:27.982862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.667 qpair failed and we were unable to recover it. 00:27:47.667 [2024-11-21 03:44:27.982958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-21 03:44:27.983062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-21 03:44:27.983112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.667 qpair failed and we were unable to recover it. 00:27:47.667 [2024-11-21 03:44:27.983204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-21 03:44:27.983335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-21 03:44:27.983360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.667 qpair failed and we were unable to recover it. 00:27:47.667 [2024-11-21 03:44:27.983471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-21 03:44:27.983570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-21 03:44:27.983595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.667 qpair failed and we were unable to recover it. 00:27:47.667 [2024-11-21 03:44:27.983697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-21 03:44:27.983797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-21 03:44:27.983821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.667 qpair failed and we were unable to recover it. 00:27:47.667 [2024-11-21 03:44:27.983919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-21 03:44:27.984050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-21 03:44:27.984083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.667 qpair failed and we were unable to recover it. 00:27:47.667 [2024-11-21 03:44:27.984211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-21 03:44:27.984317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-21 03:44:27.984344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.667 qpair failed and we were unable to recover it. 00:27:47.667 [2024-11-21 03:44:27.984469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-21 03:44:27.984622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.667 [2024-11-21 03:44:27.984647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.667 qpair failed and we were unable to recover it. 00:27:47.667 [2024-11-21 03:44:27.984751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-21 03:44:27.984845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-21 03:44:27.984869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.668 qpair failed and we were unable to recover it. 00:27:47.668 [2024-11-21 03:44:27.984980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-21 03:44:27.985108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-21 03:44:27.985133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.668 qpair failed and we were unable to recover it. 00:27:47.668 [2024-11-21 03:44:27.985243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-21 03:44:27.985366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-21 03:44:27.985391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.668 qpair failed and we were unable to recover it. 00:27:47.668 [2024-11-21 03:44:27.985494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-21 03:44:27.985619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-21 03:44:27.985644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.668 qpair failed and we were unable to recover it. 00:27:47.668 [2024-11-21 03:44:27.985749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-21 03:44:27.985880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-21 03:44:27.985906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.668 qpair failed and we were unable to recover it. 00:27:47.668 [2024-11-21 03:44:27.986012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-21 03:44:27.986167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-21 03:44:27.986193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.668 qpair failed and we were unable to recover it. 00:27:47.668 [2024-11-21 03:44:27.986295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-21 03:44:27.986386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-21 03:44:27.986411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.668 qpair failed and we were unable to recover it. 00:27:47.668 [2024-11-21 03:44:27.986543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-21 03:44:27.986633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-21 03:44:27.986657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.668 qpair failed and we were unable to recover it. 00:27:47.668 [2024-11-21 03:44:27.986813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-21 03:44:27.986939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-21 03:44:27.986964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.668 qpair failed and we were unable to recover it. 00:27:47.668 [2024-11-21 03:44:27.987092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-21 03:44:27.987193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-21 03:44:27.987218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.668 qpair failed and we were unable to recover it. 00:27:47.668 [2024-11-21 03:44:27.987325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-21 03:44:27.987414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-21 03:44:27.987439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.668 qpair failed and we were unable to recover it. 00:27:47.668 [2024-11-21 03:44:27.987540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-21 03:44:27.987641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-21 03:44:27.987666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.668 qpair failed and we were unable to recover it. 00:27:47.668 [2024-11-21 03:44:27.987796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-21 03:44:27.987921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-21 03:44:27.987946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.668 qpair failed and we were unable to recover it. 00:27:47.668 [2024-11-21 03:44:27.988047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-21 03:44:27.988172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-21 03:44:27.988198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.668 qpair failed and we were unable to recover it. 00:27:47.668 [2024-11-21 03:44:27.988323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-21 03:44:27.988430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-21 03:44:27.988455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.668 qpair failed and we were unable to recover it. 00:27:47.668 [2024-11-21 03:44:27.988558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-21 03:44:27.988686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-21 03:44:27.988711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.668 qpair failed and we were unable to recover it. 00:27:47.668 [2024-11-21 03:44:27.988809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-21 03:44:27.988905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-21 03:44:27.988931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.668 qpair failed and we were unable to recover it. 00:27:47.668 [2024-11-21 03:44:27.989034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-21 03:44:27.989152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-21 03:44:27.989178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.668 qpair failed and we were unable to recover it. 00:27:47.668 [2024-11-21 03:44:27.989285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-21 03:44:27.989390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-21 03:44:27.989415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.668 qpair failed and we were unable to recover it. 00:27:47.668 [2024-11-21 03:44:27.989519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-21 03:44:27.989644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-21 03:44:27.989670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.668 qpair failed and we were unable to recover it. 00:27:47.668 [2024-11-21 03:44:27.989769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-21 03:44:27.989888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-21 03:44:27.989912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.668 qpair failed and we were unable to recover it. 00:27:47.668 [2024-11-21 03:44:27.990045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-21 03:44:27.990195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-21 03:44:27.990220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.668 qpair failed and we were unable to recover it. 00:27:47.668 [2024-11-21 03:44:27.990317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-21 03:44:27.990442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-21 03:44:27.990467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.668 qpair failed and we were unable to recover it. 00:27:47.668 [2024-11-21 03:44:27.990574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-21 03:44:27.990671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-21 03:44:27.990696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.668 qpair failed and we were unable to recover it. 00:27:47.668 [2024-11-21 03:44:27.990797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-21 03:44:27.990926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.668 [2024-11-21 03:44:27.990951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.669 qpair failed and we were unable to recover it. 00:27:47.669 [2024-11-21 03:44:27.991055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-21 03:44:27.991156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-21 03:44:27.991181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.669 qpair failed and we were unable to recover it. 00:27:47.669 [2024-11-21 03:44:27.991315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-21 03:44:27.991413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-21 03:44:27.991438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.669 qpair failed and we were unable to recover it. 00:27:47.669 [2024-11-21 03:44:27.991536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-21 03:44:27.991630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-21 03:44:27.991655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.669 qpair failed and we were unable to recover it. 00:27:47.669 [2024-11-21 03:44:27.991761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-21 03:44:27.991886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-21 03:44:27.991911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.669 qpair failed and we were unable to recover it. 00:27:47.669 [2024-11-21 03:44:27.992032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-21 03:44:27.992129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-21 03:44:27.992155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.669 qpair failed and we were unable to recover it. 00:27:47.669 [2024-11-21 03:44:27.992267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-21 03:44:27.992364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-21 03:44:27.992389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.669 qpair failed and we were unable to recover it. 00:27:47.669 [2024-11-21 03:44:27.992484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-21 03:44:27.992619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-21 03:44:27.992644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.669 qpair failed and we were unable to recover it. 00:27:47.669 [2024-11-21 03:44:27.992750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-21 03:44:27.992842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-21 03:44:27.992867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.669 qpair failed and we were unable to recover it. 00:27:47.669 [2024-11-21 03:44:27.992993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-21 03:44:27.993095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-21 03:44:27.993121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.669 qpair failed and we were unable to recover it. 00:27:47.669 [2024-11-21 03:44:27.993227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-21 03:44:27.993350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-21 03:44:27.993375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.669 qpair failed and we were unable to recover it. 00:27:47.669 [2024-11-21 03:44:27.993476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-21 03:44:27.993571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-21 03:44:27.993596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.669 qpair failed and we were unable to recover it. 00:27:47.669 [2024-11-21 03:44:27.993705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-21 03:44:27.993832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-21 03:44:27.993857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.669 qpair failed and we were unable to recover it. 00:27:47.669 [2024-11-21 03:44:27.994016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-21 03:44:27.994122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-21 03:44:27.994148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.669 qpair failed and we were unable to recover it. 00:27:47.669 [2024-11-21 03:44:27.994241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-21 03:44:27.994341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-21 03:44:27.994366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.669 qpair failed and we were unable to recover it. 00:27:47.669 [2024-11-21 03:44:27.994523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-21 03:44:27.994648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-21 03:44:27.994673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.669 qpair failed and we were unable to recover it. 00:27:47.669 [2024-11-21 03:44:27.994777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-21 03:44:27.994907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-21 03:44:27.994932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.669 qpair failed and we were unable to recover it. 00:27:47.669 [2024-11-21 03:44:27.995030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-21 03:44:27.995130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-21 03:44:27.995160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.669 qpair failed and we were unable to recover it. 00:27:47.669 [2024-11-21 03:44:27.995257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-21 03:44:27.995361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-21 03:44:27.995386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.669 qpair failed and we were unable to recover it. 00:27:47.669 [2024-11-21 03:44:27.995487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-21 03:44:27.995611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-21 03:44:27.995636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.669 qpair failed and we were unable to recover it. 00:27:47.669 [2024-11-21 03:44:27.995742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-21 03:44:27.995874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-21 03:44:27.995899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.669 qpair failed and we were unable to recover it. 00:27:47.669 [2024-11-21 03:44:27.996002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-21 03:44:27.996109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-21 03:44:27.996135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.669 qpair failed and we were unable to recover it. 00:27:47.669 [2024-11-21 03:44:27.996265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-21 03:44:27.996368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-21 03:44:27.996393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.669 qpair failed and we were unable to recover it. 00:27:47.669 [2024-11-21 03:44:27.996487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-21 03:44:27.996597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.669 [2024-11-21 03:44:27.996622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.670 qpair failed and we were unable to recover it. 00:27:47.670 [2024-11-21 03:44:27.996726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.670 [2024-11-21 03:44:27.996829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.670 [2024-11-21 03:44:27.996853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.670 qpair failed and we were unable to recover it. 00:27:47.670 [2024-11-21 03:44:27.996951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.670 [2024-11-21 03:44:27.997046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.670 [2024-11-21 03:44:27.997077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.670 qpair failed and we were unable to recover it. 00:27:47.670 [2024-11-21 03:44:27.997200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.670 [2024-11-21 03:44:27.997323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.670 [2024-11-21 03:44:27.997348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.670 qpair failed and we were unable to recover it. 00:27:47.670 [2024-11-21 03:44:27.997458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.670 [2024-11-21 03:44:27.997553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.670 [2024-11-21 03:44:27.997582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.670 qpair failed and we were unable to recover it. 00:27:47.670 [2024-11-21 03:44:27.997686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.670 [2024-11-21 03:44:27.997841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.670 [2024-11-21 03:44:27.997866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.670 qpair failed and we were unable to recover it. 00:27:47.670 [2024-11-21 03:44:27.997995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.670 [2024-11-21 03:44:27.998103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.670 [2024-11-21 03:44:27.998130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.670 qpair failed and we were unable to recover it. 00:27:47.670 [2024-11-21 03:44:27.998222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.670 [2024-11-21 03:44:27.998328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.670 [2024-11-21 03:44:27.998353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.670 qpair failed and we were unable to recover it. 00:27:47.670 [2024-11-21 03:44:27.998462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.670 [2024-11-21 03:44:27.998554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.670 [2024-11-21 03:44:27.998579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.670 qpair failed and we were unable to recover it. 00:27:47.670 [2024-11-21 03:44:27.998714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.670 [2024-11-21 03:44:27.998841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.670 [2024-11-21 03:44:27.998866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.670 qpair failed and we were unable to recover it. 00:27:47.670 [2024-11-21 03:44:27.998996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.670 [2024-11-21 03:44:27.999099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.670 [2024-11-21 03:44:27.999125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.670 qpair failed and we were unable to recover it. 00:27:47.670 [2024-11-21 03:44:27.999253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.670 [2024-11-21 03:44:27.999349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.670 [2024-11-21 03:44:27.999374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.670 qpair failed and we were unable to recover it. 00:27:47.670 [2024-11-21 03:44:27.999473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.670 [2024-11-21 03:44:27.999566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.670 [2024-11-21 03:44:27.999591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.670 qpair failed and we were unable to recover it. 00:27:47.670 [2024-11-21 03:44:27.999696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.670 [2024-11-21 03:44:27.999818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.670 [2024-11-21 03:44:27.999843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.670 qpair failed and we were unable to recover it. 00:27:47.670 [2024-11-21 03:44:27.999970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.670 [2024-11-21 03:44:28.000090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.670 [2024-11-21 03:44:28.000116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.670 qpair failed and we were unable to recover it. 00:27:47.670 [2024-11-21 03:44:28.000256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.670 [2024-11-21 03:44:28.000351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.670 [2024-11-21 03:44:28.000376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.670 qpair failed and we were unable to recover it. 00:27:47.670 [2024-11-21 03:44:28.000467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.670 [2024-11-21 03:44:28.000562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.670 [2024-11-21 03:44:28.000588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.670 qpair failed and we were unable to recover it. 00:27:47.670 [2024-11-21 03:44:28.000690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.670 [2024-11-21 03:44:28.000809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.670 [2024-11-21 03:44:28.000834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.670 qpair failed and we were unable to recover it. 00:27:47.670 [2024-11-21 03:44:28.000926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.670 [2024-11-21 03:44:28.001020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.670 [2024-11-21 03:44:28.001045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.670 qpair failed and we were unable to recover it. 00:27:47.670 [2024-11-21 03:44:28.001153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.670 [2024-11-21 03:44:28.001261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.670 [2024-11-21 03:44:28.001287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.670 qpair failed and we were unable to recover it. 00:27:47.670 [2024-11-21 03:44:28.001428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.670 [2024-11-21 03:44:28.001526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.670 [2024-11-21 03:44:28.001550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.670 qpair failed and we were unable to recover it. 00:27:47.670 [2024-11-21 03:44:28.001681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.670 [2024-11-21 03:44:28.001825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.670 [2024-11-21 03:44:28.001849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.670 qpair failed and we were unable to recover it. 00:27:47.670 [2024-11-21 03:44:28.001940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.670 [2024-11-21 03:44:28.002063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.670 [2024-11-21 03:44:28.002116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.670 qpair failed and we were unable to recover it. 00:27:47.670 [2024-11-21 03:44:28.002258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.670 [2024-11-21 03:44:28.002355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.670 [2024-11-21 03:44:28.002380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.670 qpair failed and we were unable to recover it. 00:27:47.670 [2024-11-21 03:44:28.002477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.670 [2024-11-21 03:44:28.002573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.670 [2024-11-21 03:44:28.002598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.670 qpair failed and we were unable to recover it. 00:27:47.670 [2024-11-21 03:44:28.002733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.670 [2024-11-21 03:44:28.002856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.670 [2024-11-21 03:44:28.002881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.670 qpair failed and we were unable to recover it. 00:27:47.670 [2024-11-21 03:44:28.002985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.671 [2024-11-21 03:44:28.003120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.671 [2024-11-21 03:44:28.003146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.671 qpair failed and we were unable to recover it. 00:27:47.671 [2024-11-21 03:44:28.003242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.671 [2024-11-21 03:44:28.003337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.671 [2024-11-21 03:44:28.003362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.671 qpair failed and we were unable to recover it. 00:27:47.671 [2024-11-21 03:44:28.003458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.671 [2024-11-21 03:44:28.003553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.671 [2024-11-21 03:44:28.003578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.671 qpair failed and we were unable to recover it. 00:27:47.671 [2024-11-21 03:44:28.003737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.671 [2024-11-21 03:44:28.003835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.671 [2024-11-21 03:44:28.003860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.671 qpair failed and we were unable to recover it. 00:27:47.671 [2024-11-21 03:44:28.003956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.671 [2024-11-21 03:44:28.004052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.671 [2024-11-21 03:44:28.004082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.671 qpair failed and we were unable to recover it. 00:27:47.671 [2024-11-21 03:44:28.004199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.671 [2024-11-21 03:44:28.004299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.671 [2024-11-21 03:44:28.004324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.671 qpair failed and we were unable to recover it. 00:27:47.671 [2024-11-21 03:44:28.004466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.671 [2024-11-21 03:44:28.004596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.671 [2024-11-21 03:44:28.004621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.671 qpair failed and we were unable to recover it. 00:27:47.671 [2024-11-21 03:44:28.004715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.671 [2024-11-21 03:44:28.004861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.671 [2024-11-21 03:44:28.004887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.671 qpair failed and we were unable to recover it. 00:27:47.671 [2024-11-21 03:44:28.005020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.671 [2024-11-21 03:44:28.005124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.671 [2024-11-21 03:44:28.005150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.671 qpair failed and we were unable to recover it. 00:27:47.671 [2024-11-21 03:44:28.005260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.671 [2024-11-21 03:44:28.005366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.671 [2024-11-21 03:44:28.005391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.671 qpair failed and we were unable to recover it. 00:27:47.671 [2024-11-21 03:44:28.005490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.671 [2024-11-21 03:44:28.005588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.671 [2024-11-21 03:44:28.005613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.671 qpair failed and we were unable to recover it. 00:27:47.671 [2024-11-21 03:44:28.005711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.671 [2024-11-21 03:44:28.005833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.671 [2024-11-21 03:44:28.005858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.671 qpair failed and we were unable to recover it. 00:27:47.671 [2024-11-21 03:44:28.005979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.671 [2024-11-21 03:44:28.006082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.671 [2024-11-21 03:44:28.006109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.671 qpair failed and we were unable to recover it. 00:27:47.671 [2024-11-21 03:44:28.006210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.671 [2024-11-21 03:44:28.006350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.671 [2024-11-21 03:44:28.006375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.671 qpair failed and we were unable to recover it. 00:27:47.671 [2024-11-21 03:44:28.006471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.671 [2024-11-21 03:44:28.006567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.671 [2024-11-21 03:44:28.006592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.671 qpair failed and we were unable to recover it. 00:27:47.671 [2024-11-21 03:44:28.006687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.671 [2024-11-21 03:44:28.006785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.671 [2024-11-21 03:44:28.006810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.671 qpair failed and we were unable to recover it. 00:27:47.671 [2024-11-21 03:44:28.006909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.671 [2024-11-21 03:44:28.007048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.671 [2024-11-21 03:44:28.007080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.671 qpair failed and we were unable to recover it. 00:27:47.671 [2024-11-21 03:44:28.007189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.671 [2024-11-21 03:44:28.007294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.671 [2024-11-21 03:44:28.007320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.671 qpair failed and we were unable to recover it. 00:27:47.671 [2024-11-21 03:44:28.007417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.671 [2024-11-21 03:44:28.007543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.671 [2024-11-21 03:44:28.007568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.671 qpair failed and we were unable to recover it. 00:27:47.671 [2024-11-21 03:44:28.007714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.671 [2024-11-21 03:44:28.007815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.671 [2024-11-21 03:44:28.007841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.671 qpair failed and we were unable to recover it. 00:27:47.671 [2024-11-21 03:44:28.007949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.671 [2024-11-21 03:44:28.008045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.671 [2024-11-21 03:44:28.008076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.671 qpair failed and we were unable to recover it. 00:27:47.671 [2024-11-21 03:44:28.008189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.671 [2024-11-21 03:44:28.008285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.671 [2024-11-21 03:44:28.008310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.671 qpair failed and we were unable to recover it. 00:27:47.671 [2024-11-21 03:44:28.008410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.671 [2024-11-21 03:44:28.008536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.671 [2024-11-21 03:44:28.008561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.671 qpair failed and we were unable to recover it. 00:27:47.671 [2024-11-21 03:44:28.008658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.671 [2024-11-21 03:44:28.008755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.671 [2024-11-21 03:44:28.008780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.671 qpair failed and we were unable to recover it. 00:27:47.671 [2024-11-21 03:44:28.008884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.671 [2024-11-21 03:44:28.008984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.672 [2024-11-21 03:44:28.009010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.672 qpair failed and we were unable to recover it. 00:27:47.672 [2024-11-21 03:44:28.009115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.672 [2024-11-21 03:44:28.009218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.672 [2024-11-21 03:44:28.009243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.672 qpair failed and we were unable to recover it. 00:27:47.672 [2024-11-21 03:44:28.009350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.672 [2024-11-21 03:44:28.009451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.672 [2024-11-21 03:44:28.009476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.672 qpair failed and we were unable to recover it. 00:27:47.672 [2024-11-21 03:44:28.009584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.672 [2024-11-21 03:44:28.009713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.672 [2024-11-21 03:44:28.009738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.672 qpair failed and we were unable to recover it. 00:27:47.672 [2024-11-21 03:44:28.009838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.672 [2024-11-21 03:44:28.009938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.672 [2024-11-21 03:44:28.009963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.672 qpair failed and we were unable to recover it. 00:27:47.672 [2024-11-21 03:44:28.010090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.672 [2024-11-21 03:44:28.010184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.672 [2024-11-21 03:44:28.010213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.672 qpair failed and we were unable to recover it. 00:27:47.672 [2024-11-21 03:44:28.010312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.672 [2024-11-21 03:44:28.010436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.672 [2024-11-21 03:44:28.010461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.672 qpair failed and we were unable to recover it. 00:27:47.672 [2024-11-21 03:44:28.010592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.672 [2024-11-21 03:44:28.010714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.672 [2024-11-21 03:44:28.010740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.672 qpair failed and we were unable to recover it. 00:27:47.672 [2024-11-21 03:44:28.010839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.672 [2024-11-21 03:44:28.010942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.672 [2024-11-21 03:44:28.010968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.672 qpair failed and we were unable to recover it. 00:27:47.672 [2024-11-21 03:44:28.011075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.672 [2024-11-21 03:44:28.011174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.672 [2024-11-21 03:44:28.011199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.672 qpair failed and we were unable to recover it. 00:27:47.672 [2024-11-21 03:44:28.011307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.672 [2024-11-21 03:44:28.011403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.672 [2024-11-21 03:44:28.011428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.672 qpair failed and we were unable to recover it. 00:27:47.672 [2024-11-21 03:44:28.011558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.672 [2024-11-21 03:44:28.011662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.672 [2024-11-21 03:44:28.011687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.672 qpair failed and we were unable to recover it. 00:27:47.672 [2024-11-21 03:44:28.011784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.672 [2024-11-21 03:44:28.011877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.672 [2024-11-21 03:44:28.011902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.672 qpair failed and we were unable to recover it. 00:27:47.672 [2024-11-21 03:44:28.012000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.672 [2024-11-21 03:44:28.012127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.672 [2024-11-21 03:44:28.012152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.672 qpair failed and we were unable to recover it. 00:27:47.672 [2024-11-21 03:44:28.012287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.672 [2024-11-21 03:44:28.012409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.672 [2024-11-21 03:44:28.012434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.672 qpair failed and we were unable to recover it. 00:27:47.672 [2024-11-21 03:44:28.012569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.672 [2024-11-21 03:44:28.012671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.672 [2024-11-21 03:44:28.012696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.672 qpair failed and we were unable to recover it. 00:27:47.672 [2024-11-21 03:44:28.012807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.672 [2024-11-21 03:44:28.012907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.672 [2024-11-21 03:44:28.012932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.672 qpair failed and we were unable to recover it. 00:27:47.672 [2024-11-21 03:44:28.013030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.672 [2024-11-21 03:44:28.013166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.672 [2024-11-21 03:44:28.013192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.672 qpair failed and we were unable to recover it. 00:27:47.672 [2024-11-21 03:44:28.013304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.672 [2024-11-21 03:44:28.013406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.672 [2024-11-21 03:44:28.013431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.672 qpair failed and we were unable to recover it. 00:27:47.672 [2024-11-21 03:44:28.013566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.672 [2024-11-21 03:44:28.013666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.672 [2024-11-21 03:44:28.013691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.672 qpair failed and we were unable to recover it. 00:27:47.672 [2024-11-21 03:44:28.013790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.673 [2024-11-21 03:44:28.013886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.673 [2024-11-21 03:44:28.013912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.673 qpair failed and we were unable to recover it. 00:27:47.673 [2024-11-21 03:44:28.014004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.673 [2024-11-21 03:44:28.014158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.673 [2024-11-21 03:44:28.014184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.673 qpair failed and we were unable to recover it. 00:27:47.673 [2024-11-21 03:44:28.014284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.673 [2024-11-21 03:44:28.014380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.673 [2024-11-21 03:44:28.014405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.673 qpair failed and we were unable to recover it. 00:27:47.673 [2024-11-21 03:44:28.014535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.673 [2024-11-21 03:44:28.014740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.673 [2024-11-21 03:44:28.014765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.673 qpair failed and we were unable to recover it. 00:27:47.673 [2024-11-21 03:44:28.014866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.673 [2024-11-21 03:44:28.014955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.673 [2024-11-21 03:44:28.014980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.673 qpair failed and we were unable to recover it. 00:27:47.673 [2024-11-21 03:44:28.015084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.673 [2024-11-21 03:44:28.015211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.673 [2024-11-21 03:44:28.015236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.673 qpair failed and we were unable to recover it. 00:27:47.673 [2024-11-21 03:44:28.015354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.673 [2024-11-21 03:44:28.015476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.673 [2024-11-21 03:44:28.015501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.673 qpair failed and we were unable to recover it. 00:27:47.673 [2024-11-21 03:44:28.015606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.673 [2024-11-21 03:44:28.015731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.673 [2024-11-21 03:44:28.015756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.673 qpair failed and we were unable to recover it. 00:27:47.673 [2024-11-21 03:44:28.015849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.673 [2024-11-21 03:44:28.015945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.673 [2024-11-21 03:44:28.015970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.673 qpair failed and we were unable to recover it. 00:27:47.673 [2024-11-21 03:44:28.016074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.673 [2024-11-21 03:44:28.016167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.673 [2024-11-21 03:44:28.016192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.673 qpair failed and we were unable to recover it. 00:27:47.673 [2024-11-21 03:44:28.016319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.673 [2024-11-21 03:44:28.016416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.673 [2024-11-21 03:44:28.016441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.673 qpair failed and we were unable to recover it. 00:27:47.673 [2024-11-21 03:44:28.016551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.673 [2024-11-21 03:44:28.016646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.673 [2024-11-21 03:44:28.016673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.673 qpair failed and we were unable to recover it. 00:27:47.673 [2024-11-21 03:44:28.016769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.673 [2024-11-21 03:44:28.016871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.673 [2024-11-21 03:44:28.016896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.673 qpair failed and we were unable to recover it. 00:27:47.673 [2024-11-21 03:44:28.017037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.673 [2024-11-21 03:44:28.017163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.673 [2024-11-21 03:44:28.017188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.673 qpair failed and we were unable to recover it. 00:27:47.673 [2024-11-21 03:44:28.017287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.673 [2024-11-21 03:44:28.017409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.673 [2024-11-21 03:44:28.017434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.673 qpair failed and we were unable to recover it. 00:27:47.673 [2024-11-21 03:44:28.017536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.673 [2024-11-21 03:44:28.017660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.673 [2024-11-21 03:44:28.017685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.673 qpair failed and we were unable to recover it. 00:27:47.673 [2024-11-21 03:44:28.017781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.673 [2024-11-21 03:44:28.017885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.673 [2024-11-21 03:44:28.017911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.673 qpair failed and we were unable to recover it. 00:27:47.673 [2024-11-21 03:44:28.018010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.673 [2024-11-21 03:44:28.018106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.673 [2024-11-21 03:44:28.018133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.673 qpair failed and we were unable to recover it. 00:27:47.673 [2024-11-21 03:44:28.018231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.673 [2024-11-21 03:44:28.018355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.673 [2024-11-21 03:44:28.018379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.673 qpair failed and we were unable to recover it. 00:27:47.673 [2024-11-21 03:44:28.018514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.673 [2024-11-21 03:44:28.018637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.673 [2024-11-21 03:44:28.018662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.673 qpair failed and we were unable to recover it. 00:27:47.673 [2024-11-21 03:44:28.018765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.673 [2024-11-21 03:44:28.018857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.673 [2024-11-21 03:44:28.018882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.673 qpair failed and we were unable to recover it. 00:27:47.673 [2024-11-21 03:44:28.018979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.673 [2024-11-21 03:44:28.019104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.673 [2024-11-21 03:44:28.019130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.673 qpair failed and we were unable to recover it. 00:27:47.673 [2024-11-21 03:44:28.019264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.673 [2024-11-21 03:44:28.019359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.673 [2024-11-21 03:44:28.019384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.673 qpair failed and we were unable to recover it. 00:27:47.673 [2024-11-21 03:44:28.019511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.673 [2024-11-21 03:44:28.019608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.674 [2024-11-21 03:44:28.019633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.674 qpair failed and we were unable to recover it. 00:27:47.674 [2024-11-21 03:44:28.019789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.674 [2024-11-21 03:44:28.019893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.674 [2024-11-21 03:44:28.019918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.674 qpair failed and we were unable to recover it. 00:27:47.674 [2024-11-21 03:44:28.020023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.674 [2024-11-21 03:44:28.020178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.674 [2024-11-21 03:44:28.020204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.674 qpair failed and we were unable to recover it. 00:27:47.674 [2024-11-21 03:44:28.020328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.674 [2024-11-21 03:44:28.020435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.674 [2024-11-21 03:44:28.020462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.674 qpair failed and we were unable to recover it. 00:27:47.674 [2024-11-21 03:44:28.020589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.674 [2024-11-21 03:44:28.020685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.674 [2024-11-21 03:44:28.020711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.674 qpair failed and we were unable to recover it. 00:27:47.674 [2024-11-21 03:44:28.020838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.674 [2024-11-21 03:44:28.020929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.674 [2024-11-21 03:44:28.020954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.674 qpair failed and we were unable to recover it. 00:27:47.674 [2024-11-21 03:44:28.021078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.674 [2024-11-21 03:44:28.021176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.674 [2024-11-21 03:44:28.021201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.674 qpair failed and we were unable to recover it. 00:27:47.674 [2024-11-21 03:44:28.021307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.674 [2024-11-21 03:44:28.021401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.674 [2024-11-21 03:44:28.021426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.674 qpair failed and we were unable to recover it. 00:27:47.674 [2024-11-21 03:44:28.021523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.674 [2024-11-21 03:44:28.021655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.674 [2024-11-21 03:44:28.021680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.674 qpair failed and we were unable to recover it. 00:27:47.674 [2024-11-21 03:44:28.021778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.674 [2024-11-21 03:44:28.021902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.674 [2024-11-21 03:44:28.021927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.674 qpair failed and we were unable to recover it. 00:27:47.674 [2024-11-21 03:44:28.022017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.674 [2024-11-21 03:44:28.022122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.674 [2024-11-21 03:44:28.022148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.674 qpair failed and we were unable to recover it. 00:27:47.674 [2024-11-21 03:44:28.022252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.674 [2024-11-21 03:44:28.022347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.674 [2024-11-21 03:44:28.022372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.674 qpair failed and we were unable to recover it. 00:27:47.674 [2024-11-21 03:44:28.022531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.674 [2024-11-21 03:44:28.022672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.674 [2024-11-21 03:44:28.022697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.674 qpair failed and we were unable to recover it. 00:27:47.674 [2024-11-21 03:44:28.022795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.674 [2024-11-21 03:44:28.022918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.674 [2024-11-21 03:44:28.022947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.674 qpair failed and we were unable to recover it. 00:27:47.674 [2024-11-21 03:44:28.023087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.674 [2024-11-21 03:44:28.023181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.674 [2024-11-21 03:44:28.023206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.674 qpair failed and we were unable to recover it. 00:27:47.674 [2024-11-21 03:44:28.023304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.674 [2024-11-21 03:44:28.023406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.674 [2024-11-21 03:44:28.023431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.674 qpair failed and we were unable to recover it. 00:27:47.674 [2024-11-21 03:44:28.023536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.674 [2024-11-21 03:44:28.023690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.674 [2024-11-21 03:44:28.023715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.674 qpair failed and we were unable to recover it. 00:27:47.674 [2024-11-21 03:44:28.023826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.674 [2024-11-21 03:44:28.023930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.674 [2024-11-21 03:44:28.023955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.674 qpair failed and we were unable to recover it. 00:27:47.674 [2024-11-21 03:44:28.024083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.674 [2024-11-21 03:44:28.024188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.674 [2024-11-21 03:44:28.024213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.674 qpair failed and we were unable to recover it. 00:27:47.674 [2024-11-21 03:44:28.024306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.674 [2024-11-21 03:44:28.024397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.674 [2024-11-21 03:44:28.024422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.674 qpair failed and we were unable to recover it. 00:27:47.674 [2024-11-21 03:44:28.024527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.674 [2024-11-21 03:44:28.024628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.674 [2024-11-21 03:44:28.024652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.674 qpair failed and we were unable to recover it. 00:27:47.674 [2024-11-21 03:44:28.024751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.674 [2024-11-21 03:44:28.024879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.674 [2024-11-21 03:44:28.024903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.674 qpair failed and we were unable to recover it. 00:27:47.674 [2024-11-21 03:44:28.025016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.674 [2024-11-21 03:44:28.025109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.674 [2024-11-21 03:44:28.025135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.675 qpair failed and we were unable to recover it. 00:27:47.675 [2024-11-21 03:44:28.025232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-21 03:44:28.025359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-21 03:44:28.025386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.675 qpair failed and we were unable to recover it. 00:27:47.675 [2024-11-21 03:44:28.025525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-21 03:44:28.025623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-21 03:44:28.025650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.675 qpair failed and we were unable to recover it. 00:27:47.675 [2024-11-21 03:44:28.025781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-21 03:44:28.025881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-21 03:44:28.025906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.675 qpair failed and we were unable to recover it. 00:27:47.675 [2024-11-21 03:44:28.026005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-21 03:44:28.026165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-21 03:44:28.026192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.675 qpair failed and we were unable to recover it. 00:27:47.675 [2024-11-21 03:44:28.026318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-21 03:44:28.026412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-21 03:44:28.026437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.675 qpair failed and we were unable to recover it. 00:27:47.675 [2024-11-21 03:44:28.026532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-21 03:44:28.026659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-21 03:44:28.026684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.675 qpair failed and we were unable to recover it. 00:27:47.675 [2024-11-21 03:44:28.026792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-21 03:44:28.026909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-21 03:44:28.026934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.675 qpair failed and we were unable to recover it. 00:27:47.675 [2024-11-21 03:44:28.027035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-21 03:44:28.027136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-21 03:44:28.027161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.675 qpair failed and we were unable to recover it. 00:27:47.675 [2024-11-21 03:44:28.027292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-21 03:44:28.027387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-21 03:44:28.027413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.675 qpair failed and we were unable to recover it. 00:27:47.675 [2024-11-21 03:44:28.027512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-21 03:44:28.027613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-21 03:44:28.027638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.675 qpair failed and we were unable to recover it. 00:27:47.675 [2024-11-21 03:44:28.027763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-21 03:44:28.027852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-21 03:44:28.027876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.675 qpair failed and we were unable to recover it. 00:27:47.675 [2024-11-21 03:44:28.027983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-21 03:44:28.028082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-21 03:44:28.028108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.675 qpair failed and we were unable to recover it. 00:27:47.675 [2024-11-21 03:44:28.028238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-21 03:44:28.028337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-21 03:44:28.028362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.675 qpair failed and we were unable to recover it. 00:27:47.675 [2024-11-21 03:44:28.028466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-21 03:44:28.028594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-21 03:44:28.028620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.675 qpair failed and we were unable to recover it. 00:27:47.675 [2024-11-21 03:44:28.028719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-21 03:44:28.028828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-21 03:44:28.028853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.675 qpair failed and we were unable to recover it. 00:27:47.675 [2024-11-21 03:44:28.029011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-21 03:44:28.029104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-21 03:44:28.029130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.675 qpair failed and we were unable to recover it. 00:27:47.675 [2024-11-21 03:44:28.029272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-21 03:44:28.029378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-21 03:44:28.029403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.675 qpair failed and we were unable to recover it. 00:27:47.675 [2024-11-21 03:44:28.029510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-21 03:44:28.029663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-21 03:44:28.029689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.675 qpair failed and we were unable to recover it. 00:27:47.675 [2024-11-21 03:44:28.029790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-21 03:44:28.029881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-21 03:44:28.029906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.675 qpair failed and we were unable to recover it. 00:27:47.675 [2024-11-21 03:44:28.030036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-21 03:44:28.030152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-21 03:44:28.030178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.675 qpair failed and we were unable to recover it. 00:27:47.675 [2024-11-21 03:44:28.030310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-21 03:44:28.030435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-21 03:44:28.030459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.675 qpair failed and we were unable to recover it. 00:27:47.675 [2024-11-21 03:44:28.030568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-21 03:44:28.030665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-21 03:44:28.030689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.675 qpair failed and we were unable to recover it. 00:27:47.675 [2024-11-21 03:44:28.030814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-21 03:44:28.030942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-21 03:44:28.030967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.675 qpair failed and we were unable to recover it. 00:27:47.675 [2024-11-21 03:44:28.031066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-21 03:44:28.031209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-21 03:44:28.031234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.675 qpair failed and we were unable to recover it. 00:27:47.675 [2024-11-21 03:44:28.031338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.675 [2024-11-21 03:44:28.031437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.676 [2024-11-21 03:44:28.031462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.676 qpair failed and we were unable to recover it. 00:27:47.676 [2024-11-21 03:44:28.031593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.676 [2024-11-21 03:44:28.031692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.676 [2024-11-21 03:44:28.031717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.676 qpair failed and we were unable to recover it. 00:27:47.676 [2024-11-21 03:44:28.031820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.676 [2024-11-21 03:44:28.031921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.676 [2024-11-21 03:44:28.031946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.676 qpair failed and we were unable to recover it. 00:27:47.676 [2024-11-21 03:44:28.032038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.676 [2024-11-21 03:44:28.032136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.676 [2024-11-21 03:44:28.032162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.676 qpair failed and we were unable to recover it. 00:27:47.676 [2024-11-21 03:44:28.032298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.676 [2024-11-21 03:44:28.032401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.676 [2024-11-21 03:44:28.032426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.676 qpair failed and we were unable to recover it. 00:27:47.676 [2024-11-21 03:44:28.032530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.676 [2024-11-21 03:44:28.032663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.676 [2024-11-21 03:44:28.032688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.676 qpair failed and we were unable to recover it. 00:27:47.676 [2024-11-21 03:44:28.032784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.676 [2024-11-21 03:44:28.032905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.676 [2024-11-21 03:44:28.032930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.676 qpair failed and we were unable to recover it. 00:27:47.676 [2024-11-21 03:44:28.033032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.676 [2024-11-21 03:44:28.033134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.676 [2024-11-21 03:44:28.033160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.676 qpair failed and we were unable to recover it. 00:27:47.676 [2024-11-21 03:44:28.033264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.676 [2024-11-21 03:44:28.033363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.676 [2024-11-21 03:44:28.033388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.676 qpair failed and we were unable to recover it. 00:27:47.676 [2024-11-21 03:44:28.033498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.676 [2024-11-21 03:44:28.033625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.676 [2024-11-21 03:44:28.033651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.676 qpair failed and we were unable to recover it. 00:27:47.676 [2024-11-21 03:44:28.033752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.676 [2024-11-21 03:44:28.033878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.676 [2024-11-21 03:44:28.033904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.676 qpair failed and we were unable to recover it. 00:27:47.676 [2024-11-21 03:44:28.034003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.676 [2024-11-21 03:44:28.034127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.676 [2024-11-21 03:44:28.034153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.676 qpair failed and we were unable to recover it. 00:27:47.676 [2024-11-21 03:44:28.034249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.676 [2024-11-21 03:44:28.034348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.676 [2024-11-21 03:44:28.034374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.676 qpair failed and we were unable to recover it. 00:27:47.676 [2024-11-21 03:44:28.034502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.676 [2024-11-21 03:44:28.034628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.676 [2024-11-21 03:44:28.034653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.676 qpair failed and we were unable to recover it. 00:27:47.676 [2024-11-21 03:44:28.034747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.676 [2024-11-21 03:44:28.034849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.676 [2024-11-21 03:44:28.034874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.676 qpair failed and we were unable to recover it. 00:27:47.676 [2024-11-21 03:44:28.034977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.676 [2024-11-21 03:44:28.035079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.676 [2024-11-21 03:44:28.035105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.676 qpair failed and we were unable to recover it. 00:27:47.676 [2024-11-21 03:44:28.035233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.676 [2024-11-21 03:44:28.035326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.676 [2024-11-21 03:44:28.035351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.676 qpair failed and we were unable to recover it. 00:27:47.676 [2024-11-21 03:44:28.035455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.676 [2024-11-21 03:44:28.035550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.676 [2024-11-21 03:44:28.035579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.676 qpair failed and we were unable to recover it. 00:27:47.676 [2024-11-21 03:44:28.035672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.676 [2024-11-21 03:44:28.035764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.676 [2024-11-21 03:44:28.035789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.676 qpair failed and we were unable to recover it. 00:27:47.676 [2024-11-21 03:44:28.035882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.676 [2024-11-21 03:44:28.036034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.676 [2024-11-21 03:44:28.036058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.676 qpair failed and we were unable to recover it. 00:27:47.676 [2024-11-21 03:44:28.036162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.676 [2024-11-21 03:44:28.036268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.676 [2024-11-21 03:44:28.036294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.676 qpair failed and we were unable to recover it. 00:27:47.676 [2024-11-21 03:44:28.036429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.676 [2024-11-21 03:44:28.036559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.676 [2024-11-21 03:44:28.036584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.676 qpair failed and we were unable to recover it. 00:27:47.676 [2024-11-21 03:44:28.036713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.676 [2024-11-21 03:44:28.036810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.676 [2024-11-21 03:44:28.036836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.676 qpair failed and we were unable to recover it. 00:27:47.676 [2024-11-21 03:44:28.036934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.677 [2024-11-21 03:44:28.037031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.677 [2024-11-21 03:44:28.037056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.677 qpair failed and we were unable to recover it. 00:27:47.677 [2024-11-21 03:44:28.037173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.677 [2024-11-21 03:44:28.037297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.677 [2024-11-21 03:44:28.037322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.677 qpair failed and we were unable to recover it. 00:27:47.677 [2024-11-21 03:44:28.037465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.677 [2024-11-21 03:44:28.037589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.677 [2024-11-21 03:44:28.037614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.677 qpair failed and we were unable to recover it. 00:27:47.677 [2024-11-21 03:44:28.037713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.677 [2024-11-21 03:44:28.037808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.677 [2024-11-21 03:44:28.037833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.677 qpair failed and we were unable to recover it. 00:27:47.677 [2024-11-21 03:44:28.037925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.677 [2024-11-21 03:44:28.038054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.677 [2024-11-21 03:44:28.038091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.677 qpair failed and we were unable to recover it. 00:27:47.677 [2024-11-21 03:44:28.038186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.677 [2024-11-21 03:44:28.038290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.677 [2024-11-21 03:44:28.038315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.677 qpair failed and we were unable to recover it. 00:27:47.677 [2024-11-21 03:44:28.038418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.677 [2024-11-21 03:44:28.038509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.677 [2024-11-21 03:44:28.038535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.677 qpair failed and we were unable to recover it. 00:27:47.677 [2024-11-21 03:44:28.038634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.677 [2024-11-21 03:44:28.038735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.677 [2024-11-21 03:44:28.038760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.677 qpair failed and we were unable to recover it. 00:27:47.677 [2024-11-21 03:44:28.038868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.677 [2024-11-21 03:44:28.038961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.677 [2024-11-21 03:44:28.038986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.677 qpair failed and we were unable to recover it. 00:27:47.677 [2024-11-21 03:44:28.039124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.677 [2024-11-21 03:44:28.039222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.677 [2024-11-21 03:44:28.039248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.677 qpair failed and we were unable to recover it. 00:27:47.677 [2024-11-21 03:44:28.039376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.677 [2024-11-21 03:44:28.039475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.677 [2024-11-21 03:44:28.039499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.677 qpair failed and we were unable to recover it. 00:27:47.677 [2024-11-21 03:44:28.039626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.677 [2024-11-21 03:44:28.039727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.677 [2024-11-21 03:44:28.039752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.677 qpair failed and we were unable to recover it. 00:27:47.677 [2024-11-21 03:44:28.039883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.677 [2024-11-21 03:44:28.040009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.677 [2024-11-21 03:44:28.040033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.677 qpair failed and we were unable to recover it. 00:27:47.677 [2024-11-21 03:44:28.040165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.677 [2024-11-21 03:44:28.040290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.677 [2024-11-21 03:44:28.040315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.677 qpair failed and we were unable to recover it. 00:27:47.677 [2024-11-21 03:44:28.040451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.677 [2024-11-21 03:44:28.040551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.677 [2024-11-21 03:44:28.040578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.677 qpair failed and we were unable to recover it. 00:27:47.677 [2024-11-21 03:44:28.040687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.677 [2024-11-21 03:44:28.040787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.677 [2024-11-21 03:44:28.040813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.677 qpair failed and we were unable to recover it. 00:27:47.677 [2024-11-21 03:44:28.040921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.677 [2024-11-21 03:44:28.041016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.677 [2024-11-21 03:44:28.041041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.677 qpair failed and we were unable to recover it. 00:27:47.677 [2024-11-21 03:44:28.041150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.677 [2024-11-21 03:44:28.041273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.677 [2024-11-21 03:44:28.041298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.677 qpair failed and we were unable to recover it. 00:27:47.677 [2024-11-21 03:44:28.041422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.677 [2024-11-21 03:44:28.041514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.677 [2024-11-21 03:44:28.041539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.677 qpair failed and we were unable to recover it. 00:27:47.677 [2024-11-21 03:44:28.041659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.677 [2024-11-21 03:44:28.041764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.677 [2024-11-21 03:44:28.041789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.677 qpair failed and we were unable to recover it. 00:27:47.677 [2024-11-21 03:44:28.041891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.677 [2024-11-21 03:44:28.042027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.677 [2024-11-21 03:44:28.042052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.677 qpair failed and we were unable to recover it. 00:27:47.677 [2024-11-21 03:44:28.042158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.677 [2024-11-21 03:44:28.042283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-21 03:44:28.042308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.678 qpair failed and we were unable to recover it. 00:27:47.678 [2024-11-21 03:44:28.042437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-21 03:44:28.042535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-21 03:44:28.042561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.678 qpair failed and we were unable to recover it. 00:27:47.678 [2024-11-21 03:44:28.042660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-21 03:44:28.042753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-21 03:44:28.042779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.678 qpair failed and we were unable to recover it. 00:27:47.678 [2024-11-21 03:44:28.042911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-21 03:44:28.043004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-21 03:44:28.043029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.678 qpair failed and we were unable to recover it. 00:27:47.678 [2024-11-21 03:44:28.043190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-21 03:44:28.043314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-21 03:44:28.043340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.678 qpair failed and we were unable to recover it. 00:27:47.678 [2024-11-21 03:44:28.043499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-21 03:44:28.043594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-21 03:44:28.043619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.678 qpair failed and we were unable to recover it. 00:27:47.678 [2024-11-21 03:44:28.043722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-21 03:44:28.043823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-21 03:44:28.043848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.678 qpair failed and we were unable to recover it. 00:27:47.678 [2024-11-21 03:44:28.043938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-21 03:44:28.044060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-21 03:44:28.044094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.678 qpair failed and we were unable to recover it. 00:27:47.678 [2024-11-21 03:44:28.044200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-21 03:44:28.044297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-21 03:44:28.044322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.678 qpair failed and we were unable to recover it. 00:27:47.678 [2024-11-21 03:44:28.044482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-21 03:44:28.044576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-21 03:44:28.044601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.678 qpair failed and we were unable to recover it. 00:27:47.678 [2024-11-21 03:44:28.044690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-21 03:44:28.044791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-21 03:44:28.044816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.678 qpair failed and we were unable to recover it. 00:27:47.678 [2024-11-21 03:44:28.044910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-21 03:44:28.045012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-21 03:44:28.045038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.678 qpair failed and we were unable to recover it. 00:27:47.678 [2024-11-21 03:44:28.045162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-21 03:44:28.045285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-21 03:44:28.045311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.678 qpair failed and we were unable to recover it. 00:27:47.678 [2024-11-21 03:44:28.045411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-21 03:44:28.045508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-21 03:44:28.045534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.678 qpair failed and we were unable to recover it. 00:27:47.678 [2024-11-21 03:44:28.045657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-21 03:44:28.045758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-21 03:44:28.045784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.678 qpair failed and we were unable to recover it. 00:27:47.678 [2024-11-21 03:44:28.045905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-21 03:44:28.046003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-21 03:44:28.046028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.678 qpair failed and we were unable to recover it. 00:27:47.678 [2024-11-21 03:44:28.046171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-21 03:44:28.046265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-21 03:44:28.046290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.678 qpair failed and we were unable to recover it. 00:27:47.678 [2024-11-21 03:44:28.046443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-21 03:44:28.046538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-21 03:44:28.046563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.678 qpair failed and we were unable to recover it. 00:27:47.678 [2024-11-21 03:44:28.046688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-21 03:44:28.046781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-21 03:44:28.046806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.678 qpair failed and we were unable to recover it. 00:27:47.678 [2024-11-21 03:44:28.046907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-21 03:44:28.047002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-21 03:44:28.047027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.678 qpair failed and we were unable to recover it. 00:27:47.678 [2024-11-21 03:44:28.047160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-21 03:44:28.047265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-21 03:44:28.047292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.678 qpair failed and we were unable to recover it. 00:27:47.678 [2024-11-21 03:44:28.047403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-21 03:44:28.047528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-21 03:44:28.047553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.678 qpair failed and we were unable to recover it. 00:27:47.678 [2024-11-21 03:44:28.047680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-21 03:44:28.047779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-21 03:44:28.047804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.678 qpair failed and we were unable to recover it. 00:27:47.678 [2024-11-21 03:44:28.047903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-21 03:44:28.048003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-21 03:44:28.048028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.678 qpair failed and we were unable to recover it. 00:27:47.678 [2024-11-21 03:44:28.048159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-21 03:44:28.048261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-21 03:44:28.048286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.678 qpair failed and we were unable to recover it. 00:27:47.678 [2024-11-21 03:44:28.048422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-21 03:44:28.048518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-21 03:44:28.048543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.678 qpair failed and we were unable to recover it. 00:27:47.678 [2024-11-21 03:44:28.048671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.678 [2024-11-21 03:44:28.048796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-21 03:44:28.048822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.679 qpair failed and we were unable to recover it. 00:27:47.679 [2024-11-21 03:44:28.048921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-21 03:44:28.049046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-21 03:44:28.049078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.679 qpair failed and we were unable to recover it. 00:27:47.679 [2024-11-21 03:44:28.049176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-21 03:44:28.049272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-21 03:44:28.049297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.679 qpair failed and we were unable to recover it. 00:27:47.679 [2024-11-21 03:44:28.049397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-21 03:44:28.049535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-21 03:44:28.049561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.679 qpair failed and we were unable to recover it. 00:27:47.679 [2024-11-21 03:44:28.049667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-21 03:44:28.049766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-21 03:44:28.049791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.679 qpair failed and we were unable to recover it. 00:27:47.679 [2024-11-21 03:44:28.049918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-21 03:44:28.050051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-21 03:44:28.050083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.679 qpair failed and we were unable to recover it. 00:27:47.679 [2024-11-21 03:44:28.050215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-21 03:44:28.050312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-21 03:44:28.050337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.679 qpair failed and we were unable to recover it. 00:27:47.679 [2024-11-21 03:44:28.050436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-21 03:44:28.050540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-21 03:44:28.050566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.679 qpair failed and we were unable to recover it. 00:27:47.679 [2024-11-21 03:44:28.050670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-21 03:44:28.050765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-21 03:44:28.050804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.679 qpair failed and we were unable to recover it. 00:27:47.679 [2024-11-21 03:44:28.050938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-21 03:44:28.051037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-21 03:44:28.051062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.679 qpair failed and we were unable to recover it. 00:27:47.679 [2024-11-21 03:44:28.051198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-21 03:44:28.051328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-21 03:44:28.051353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.679 qpair failed and we were unable to recover it. 00:27:47.679 [2024-11-21 03:44:28.051486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-21 03:44:28.051585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-21 03:44:28.051612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.679 qpair failed and we were unable to recover it. 00:27:47.679 [2024-11-21 03:44:28.051705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-21 03:44:28.051797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-21 03:44:28.051822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.679 qpair failed and we were unable to recover it. 00:27:47.679 [2024-11-21 03:44:28.051946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-21 03:44:28.052078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-21 03:44:28.052104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.679 qpair failed and we were unable to recover it. 00:27:47.679 [2024-11-21 03:44:28.052231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-21 03:44:28.052329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-21 03:44:28.052354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.679 qpair failed and we were unable to recover it. 00:27:47.679 [2024-11-21 03:44:28.052455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-21 03:44:28.052553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-21 03:44:28.052578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.679 qpair failed and we were unable to recover it. 00:27:47.679 [2024-11-21 03:44:28.052677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-21 03:44:28.052808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-21 03:44:28.052833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.679 qpair failed and we were unable to recover it. 00:27:47.679 [2024-11-21 03:44:28.052940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-21 03:44:28.053039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-21 03:44:28.053064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.679 qpair failed and we were unable to recover it. 00:27:47.679 [2024-11-21 03:44:28.053178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-21 03:44:28.053273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-21 03:44:28.053298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.679 qpair failed and we were unable to recover it. 00:27:47.679 [2024-11-21 03:44:28.053441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-21 03:44:28.053531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-21 03:44:28.053557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.679 qpair failed and we were unable to recover it. 00:27:47.679 [2024-11-21 03:44:28.053650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-21 03:44:28.053825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-21 03:44:28.053851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.679 qpair failed and we were unable to recover it. 00:27:47.679 [2024-11-21 03:44:28.053950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-21 03:44:28.054047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-21 03:44:28.054078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.679 qpair failed and we were unable to recover it. 00:27:47.679 [2024-11-21 03:44:28.054189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.679 [2024-11-21 03:44:28.054282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-21 03:44:28.054307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.680 qpair failed and we were unable to recover it. 00:27:47.680 [2024-11-21 03:44:28.054429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-21 03:44:28.054582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-21 03:44:28.054606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.680 qpair failed and we were unable to recover it. 00:27:47.680 [2024-11-21 03:44:28.054734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-21 03:44:28.054865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-21 03:44:28.054892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.680 qpair failed and we were unable to recover it. 00:27:47.680 [2024-11-21 03:44:28.054984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-21 03:44:28.055093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-21 03:44:28.055120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.680 qpair failed and we were unable to recover it. 00:27:47.680 [2024-11-21 03:44:28.055250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-21 03:44:28.055352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-21 03:44:28.055377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.680 qpair failed and we were unable to recover it. 00:27:47.680 [2024-11-21 03:44:28.055501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-21 03:44:28.055595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-21 03:44:28.055620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.680 qpair failed and we were unable to recover it. 00:27:47.680 [2024-11-21 03:44:28.055772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-21 03:44:28.055865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-21 03:44:28.055890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.680 qpair failed and we were unable to recover it. 00:27:47.680 [2024-11-21 03:44:28.055998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-21 03:44:28.056132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-21 03:44:28.056157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.680 qpair failed and we were unable to recover it. 00:27:47.680 [2024-11-21 03:44:28.056264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-21 03:44:28.056366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-21 03:44:28.056391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.680 qpair failed and we were unable to recover it. 00:27:47.680 [2024-11-21 03:44:28.056496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-21 03:44:28.056621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-21 03:44:28.056647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.680 qpair failed and we were unable to recover it. 00:27:47.680 [2024-11-21 03:44:28.056746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-21 03:44:28.056877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-21 03:44:28.056902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.680 qpair failed and we were unable to recover it. 00:27:47.680 [2024-11-21 03:44:28.057004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-21 03:44:28.057103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-21 03:44:28.057140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.680 qpair failed and we were unable to recover it. 00:27:47.680 [2024-11-21 03:44:28.057271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-21 03:44:28.057364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-21 03:44:28.057389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.680 qpair failed and we were unable to recover it. 00:27:47.680 [2024-11-21 03:44:28.057551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-21 03:44:28.057646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-21 03:44:28.057671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.680 qpair failed and we were unable to recover it. 00:27:47.680 [2024-11-21 03:44:28.057773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-21 03:44:28.057871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-21 03:44:28.057896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.680 qpair failed and we were unable to recover it. 00:27:47.680 [2024-11-21 03:44:28.058026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-21 03:44:28.058136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-21 03:44:28.058162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.680 qpair failed and we were unable to recover it. 00:27:47.680 [2024-11-21 03:44:28.058293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-21 03:44:28.058395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-21 03:44:28.058421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.680 qpair failed and we were unable to recover it. 00:27:47.680 [2024-11-21 03:44:28.058518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-21 03:44:28.058651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-21 03:44:28.058677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.680 qpair failed and we were unable to recover it. 00:27:47.680 [2024-11-21 03:44:28.058809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-21 03:44:28.058906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-21 03:44:28.058931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.680 qpair failed and we were unable to recover it. 00:27:47.680 [2024-11-21 03:44:28.059026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-21 03:44:28.059134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-21 03:44:28.059160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.680 qpair failed and we were unable to recover it. 00:27:47.680 [2024-11-21 03:44:28.059258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-21 03:44:28.059349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-21 03:44:28.059374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.680 qpair failed and we were unable to recover it. 00:27:47.680 [2024-11-21 03:44:28.059504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-21 03:44:28.059635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-21 03:44:28.059660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.680 qpair failed and we were unable to recover it. 00:27:47.680 [2024-11-21 03:44:28.059756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.680 [2024-11-21 03:44:28.059879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-21 03:44:28.059904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.681 qpair failed and we were unable to recover it. 00:27:47.681 [2024-11-21 03:44:28.059999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-21 03:44:28.060134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-21 03:44:28.060160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.681 qpair failed and we were unable to recover it. 00:27:47.681 [2024-11-21 03:44:28.060272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-21 03:44:28.060369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-21 03:44:28.060394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.681 qpair failed and we were unable to recover it. 00:27:47.681 [2024-11-21 03:44:28.060526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-21 03:44:28.060620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-21 03:44:28.060646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.681 qpair failed and we were unable to recover it. 00:27:47.681 [2024-11-21 03:44:28.060742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-21 03:44:28.060847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-21 03:44:28.060872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.681 qpair failed and we were unable to recover it. 00:27:47.681 [2024-11-21 03:44:28.061004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-21 03:44:28.061134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-21 03:44:28.061160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.681 qpair failed and we were unable to recover it. 00:27:47.681 [2024-11-21 03:44:28.061263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-21 03:44:28.061354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-21 03:44:28.061379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.681 qpair failed and we were unable to recover it. 00:27:47.681 [2024-11-21 03:44:28.061542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-21 03:44:28.061638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-21 03:44:28.061663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.681 qpair failed and we were unable to recover it. 00:27:47.681 [2024-11-21 03:44:28.061764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-21 03:44:28.061866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-21 03:44:28.061891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.681 qpair failed and we were unable to recover it. 00:27:47.681 [2024-11-21 03:44:28.062022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-21 03:44:28.062126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-21 03:44:28.062151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.681 qpair failed and we were unable to recover it. 00:27:47.681 [2024-11-21 03:44:28.062260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-21 03:44:28.062357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-21 03:44:28.062382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.681 qpair failed and we were unable to recover it. 00:27:47.681 [2024-11-21 03:44:28.062483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-21 03:44:28.062581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-21 03:44:28.062605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.681 qpair failed and we were unable to recover it. 00:27:47.681 [2024-11-21 03:44:28.062727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-21 03:44:28.062858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-21 03:44:28.062883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.681 qpair failed and we were unable to recover it. 00:27:47.681 [2024-11-21 03:44:28.063012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-21 03:44:28.063108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-21 03:44:28.063133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.681 qpair failed and we were unable to recover it. 00:27:47.681 [2024-11-21 03:44:28.063223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-21 03:44:28.063321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-21 03:44:28.063346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.681 qpair failed and we were unable to recover it. 00:27:47.681 [2024-11-21 03:44:28.063480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-21 03:44:28.063573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-21 03:44:28.063602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.681 qpair failed and we were unable to recover it. 00:27:47.681 [2024-11-21 03:44:28.063692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-21 03:44:28.063815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-21 03:44:28.063840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.681 qpair failed and we were unable to recover it. 00:27:47.681 [2024-11-21 03:44:28.063934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-21 03:44:28.064053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-21 03:44:28.064084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.681 qpair failed and we were unable to recover it. 00:27:47.681 [2024-11-21 03:44:28.064219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-21 03:44:28.064322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-21 03:44:28.064347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.681 qpair failed and we were unable to recover it. 00:27:47.681 [2024-11-21 03:44:28.064452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-21 03:44:28.064543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-21 03:44:28.064568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.681 qpair failed and we were unable to recover it. 00:27:47.681 [2024-11-21 03:44:28.064679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-21 03:44:28.064776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-21 03:44:28.064801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.681 qpair failed and we were unable to recover it. 00:27:47.681 [2024-11-21 03:44:28.064929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-21 03:44:28.065065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-21 03:44:28.065096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.681 qpair failed and we were unable to recover it. 00:27:47.681 [2024-11-21 03:44:28.065201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-21 03:44:28.065318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-21 03:44:28.065343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.681 qpair failed and we were unable to recover it. 00:27:47.681 [2024-11-21 03:44:28.065448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-21 03:44:28.065547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.681 [2024-11-21 03:44:28.065572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.681 qpair failed and we were unable to recover it. 00:27:47.681 [2024-11-21 03:44:28.065677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-21 03:44:28.065771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-21 03:44:28.065796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.682 qpair failed and we were unable to recover it. 00:27:47.682 [2024-11-21 03:44:28.065893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-21 03:44:28.066022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-21 03:44:28.066047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.682 qpair failed and we were unable to recover it. 00:27:47.682 [2024-11-21 03:44:28.066178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-21 03:44:28.066302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-21 03:44:28.066326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.682 qpair failed and we were unable to recover it. 00:27:47.682 [2024-11-21 03:44:28.066459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-21 03:44:28.066582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-21 03:44:28.066607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.682 qpair failed and we were unable to recover it. 00:27:47.682 [2024-11-21 03:44:28.066707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-21 03:44:28.066807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-21 03:44:28.066834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.682 qpair failed and we were unable to recover it. 00:27:47.682 [2024-11-21 03:44:28.066969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-21 03:44:28.067102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-21 03:44:28.067131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.682 qpair failed and we were unable to recover it. 00:27:47.682 [2024-11-21 03:44:28.067245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-21 03:44:28.067339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-21 03:44:28.067364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.682 qpair failed and we were unable to recover it. 00:27:47.682 [2024-11-21 03:44:28.067466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-21 03:44:28.067569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-21 03:44:28.067594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.682 qpair failed and we were unable to recover it. 00:27:47.682 [2024-11-21 03:44:28.067722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-21 03:44:28.067843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-21 03:44:28.067868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.682 qpair failed and we were unable to recover it. 00:27:47.682 [2024-11-21 03:44:28.067971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-21 03:44:28.068064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-21 03:44:28.068094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.682 qpair failed and we were unable to recover it. 00:27:47.682 [2024-11-21 03:44:28.068196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-21 03:44:28.068291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-21 03:44:28.068316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.682 qpair failed and we were unable to recover it. 00:27:47.682 [2024-11-21 03:44:28.068417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-21 03:44:28.068519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-21 03:44:28.068544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.682 qpair failed and we were unable to recover it. 00:27:47.682 [2024-11-21 03:44:28.068680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-21 03:44:28.068778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-21 03:44:28.068803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.682 qpair failed and we were unable to recover it. 00:27:47.682 [2024-11-21 03:44:28.068932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-21 03:44:28.069033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-21 03:44:28.069058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.682 qpair failed and we were unable to recover it. 00:27:47.682 [2024-11-21 03:44:28.069167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-21 03:44:28.069268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-21 03:44:28.069292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.682 qpair failed and we were unable to recover it. 00:27:47.682 [2024-11-21 03:44:28.069425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-21 03:44:28.069523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-21 03:44:28.069547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.682 qpair failed and we were unable to recover it. 00:27:47.682 [2024-11-21 03:44:28.069671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-21 03:44:28.069826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-21 03:44:28.069851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.682 qpair failed and we were unable to recover it. 00:27:47.682 [2024-11-21 03:44:28.069948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-21 03:44:28.070044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-21 03:44:28.070073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.682 qpair failed and we were unable to recover it. 00:27:47.682 [2024-11-21 03:44:28.070189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-21 03:44:28.070308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-21 03:44:28.070333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.682 qpair failed and we were unable to recover it. 00:27:47.682 [2024-11-21 03:44:28.070431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-21 03:44:28.070519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-21 03:44:28.070544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.682 qpair failed and we were unable to recover it. 00:27:47.682 [2024-11-21 03:44:28.070645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-21 03:44:28.070776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-21 03:44:28.070803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.682 qpair failed and we were unable to recover it. 00:27:47.682 [2024-11-21 03:44:28.070898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-21 03:44:28.071027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-21 03:44:28.071052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.682 qpair failed and we were unable to recover it. 00:27:47.682 [2024-11-21 03:44:28.071217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-21 03:44:28.071320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-21 03:44:28.071345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.682 qpair failed and we were unable to recover it. 00:27:47.682 [2024-11-21 03:44:28.071445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-21 03:44:28.071569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.682 [2024-11-21 03:44:28.071593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.682 qpair failed and we were unable to recover it. 00:27:47.682 [2024-11-21 03:44:28.071689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.683 [2024-11-21 03:44:28.071813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.683 [2024-11-21 03:44:28.071839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.683 qpair failed and we were unable to recover it. 00:27:47.683 [2024-11-21 03:44:28.071932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.683 [2024-11-21 03:44:28.072056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.683 [2024-11-21 03:44:28.072089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.683 qpair failed and we were unable to recover it. 00:27:47.683 [2024-11-21 03:44:28.072204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.683 [2024-11-21 03:44:28.072327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.683 [2024-11-21 03:44:28.072352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.683 qpair failed and we were unable to recover it. 00:27:47.683 [2024-11-21 03:44:28.072490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.683 [2024-11-21 03:44:28.072580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.683 [2024-11-21 03:44:28.072605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.683 qpair failed and we were unable to recover it. 00:27:47.683 [2024-11-21 03:44:28.072703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.683 [2024-11-21 03:44:28.072830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.683 [2024-11-21 03:44:28.072855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.683 qpair failed and we were unable to recover it. 00:27:47.683 [2024-11-21 03:44:28.072954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.683 [2024-11-21 03:44:28.073079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.683 [2024-11-21 03:44:28.073105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.683 qpair failed and we were unable to recover it. 00:27:47.683 [2024-11-21 03:44:28.073207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.683 [2024-11-21 03:44:28.073335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.683 [2024-11-21 03:44:28.073360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.683 qpair failed and we were unable to recover it. 00:27:47.683 [2024-11-21 03:44:28.073465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.683 [2024-11-21 03:44:28.073560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.683 [2024-11-21 03:44:28.073584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.683 qpair failed and we were unable to recover it. 00:27:47.683 [2024-11-21 03:44:28.073688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.683 [2024-11-21 03:44:28.073823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.683 [2024-11-21 03:44:28.073848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.683 qpair failed and we were unable to recover it. 00:27:47.683 [2024-11-21 03:44:28.073971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.683 [2024-11-21 03:44:28.074076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.683 [2024-11-21 03:44:28.074102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.683 qpair failed and we were unable to recover it. 00:27:47.683 [2024-11-21 03:44:28.074198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.683 [2024-11-21 03:44:28.074328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.683 [2024-11-21 03:44:28.074353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.683 qpair failed and we were unable to recover it. 00:27:47.683 [2024-11-21 03:44:28.074480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.683 [2024-11-21 03:44:28.074605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.683 [2024-11-21 03:44:28.074630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.683 qpair failed and we were unable to recover it. 00:27:47.683 [2024-11-21 03:44:28.074753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.683 [2024-11-21 03:44:28.074874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.683 [2024-11-21 03:44:28.074900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.683 qpair failed and we were unable to recover it. 00:27:47.683 [2024-11-21 03:44:28.075025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.683 [2024-11-21 03:44:28.075128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.683 [2024-11-21 03:44:28.075154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.683 qpair failed and we were unable to recover it. 00:27:47.683 [2024-11-21 03:44:28.075297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.683 [2024-11-21 03:44:28.075420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.683 [2024-11-21 03:44:28.075445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.683 qpair failed and we were unable to recover it. 00:27:47.683 [2024-11-21 03:44:28.075540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.683 [2024-11-21 03:44:28.075637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.683 [2024-11-21 03:44:28.075662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.683 qpair failed and we were unable to recover it. 00:27:47.683 [2024-11-21 03:44:28.075790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.683 [2024-11-21 03:44:28.075897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.683 [2024-11-21 03:44:28.075921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.683 qpair failed and we were unable to recover it. 00:27:47.683 [2024-11-21 03:44:28.076040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.683 [2024-11-21 03:44:28.076159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.683 [2024-11-21 03:44:28.076185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.683 qpair failed and we were unable to recover it. 00:27:47.683 [2024-11-21 03:44:28.076283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.683 [2024-11-21 03:44:28.076420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-21 03:44:28.076450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.684 qpair failed and we were unable to recover it. 00:27:47.684 [2024-11-21 03:44:28.076559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-21 03:44:28.076685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-21 03:44:28.076710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.684 qpair failed and we were unable to recover it. 00:27:47.684 [2024-11-21 03:44:28.076813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-21 03:44:28.076934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-21 03:44:28.076959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.684 qpair failed and we were unable to recover it. 00:27:47.684 [2024-11-21 03:44:28.077061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-21 03:44:28.077204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-21 03:44:28.077229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.684 qpair failed and we were unable to recover it. 00:27:47.684 [2024-11-21 03:44:28.077352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-21 03:44:28.077445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-21 03:44:28.077470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.684 qpair failed and we were unable to recover it. 00:27:47.684 [2024-11-21 03:44:28.077602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-21 03:44:28.077697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-21 03:44:28.077721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.684 qpair failed and we were unable to recover it. 00:27:47.684 [2024-11-21 03:44:28.077846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-21 03:44:28.077945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-21 03:44:28.077970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.684 qpair failed and we were unable to recover it. 00:27:47.684 [2024-11-21 03:44:28.078080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-21 03:44:28.078180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-21 03:44:28.078205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.684 qpair failed and we were unable to recover it. 00:27:47.684 [2024-11-21 03:44:28.078295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-21 03:44:28.078418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-21 03:44:28.078444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.684 qpair failed and we were unable to recover it. 00:27:47.684 [2024-11-21 03:44:28.078571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-21 03:44:28.078675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-21 03:44:28.078701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.684 qpair failed and we were unable to recover it. 00:27:47.684 [2024-11-21 03:44:28.078830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-21 03:44:28.078930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-21 03:44:28.078955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.684 qpair failed and we were unable to recover it. 00:27:47.684 [2024-11-21 03:44:28.079105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-21 03:44:28.079239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-21 03:44:28.079265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.684 qpair failed and we were unable to recover it. 00:27:47.684 [2024-11-21 03:44:28.079400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-21 03:44:28.079552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-21 03:44:28.079578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.684 qpair failed and we were unable to recover it. 00:27:47.684 [2024-11-21 03:44:28.079677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-21 03:44:28.079832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-21 03:44:28.079857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.684 qpair failed and we were unable to recover it. 00:27:47.684 [2024-11-21 03:44:28.079953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-21 03:44:28.080053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-21 03:44:28.080085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.684 qpair failed and we were unable to recover it. 00:27:47.684 [2024-11-21 03:44:28.080186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-21 03:44:28.080314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-21 03:44:28.080339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.684 qpair failed and we were unable to recover it. 00:27:47.684 [2024-11-21 03:44:28.080433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-21 03:44:28.080564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-21 03:44:28.080590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.684 qpair failed and we were unable to recover it. 00:27:47.684 [2024-11-21 03:44:28.080717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-21 03:44:28.080806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-21 03:44:28.080832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.684 qpair failed and we were unable to recover it. 00:27:47.684 [2024-11-21 03:44:28.080929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-21 03:44:28.081020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-21 03:44:28.081046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.684 qpair failed and we were unable to recover it. 00:27:47.684 [2024-11-21 03:44:28.081150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-21 03:44:28.081257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-21 03:44:28.081282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.684 qpair failed and we were unable to recover it. 00:27:47.684 [2024-11-21 03:44:28.081390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-21 03:44:28.081491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-21 03:44:28.081516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.684 qpair failed and we were unable to recover it. 00:27:47.684 [2024-11-21 03:44:28.081618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-21 03:44:28.081716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-21 03:44:28.081741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.684 qpair failed and we were unable to recover it. 00:27:47.684 [2024-11-21 03:44:28.081848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-21 03:44:28.081954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-21 03:44:28.081979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.684 qpair failed and we were unable to recover it. 00:27:47.684 [2024-11-21 03:44:28.082084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-21 03:44:28.082181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-21 03:44:28.082207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.684 qpair failed and we were unable to recover it. 00:27:47.684 [2024-11-21 03:44:28.082304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-21 03:44:28.082411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.684 [2024-11-21 03:44:28.082436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.685 qpair failed and we were unable to recover it. 00:27:47.685 [2024-11-21 03:44:28.082533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-21 03:44:28.082659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-21 03:44:28.082684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.685 qpair failed and we were unable to recover it. 00:27:47.685 [2024-11-21 03:44:28.082819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-21 03:44:28.082925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-21 03:44:28.082950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.685 qpair failed and we were unable to recover it. 00:27:47.685 [2024-11-21 03:44:28.083043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-21 03:44:28.083164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-21 03:44:28.083190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.685 qpair failed and we were unable to recover it. 00:27:47.685 [2024-11-21 03:44:28.083285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-21 03:44:28.083394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-21 03:44:28.083421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.685 qpair failed and we were unable to recover it. 00:27:47.685 [2024-11-21 03:44:28.083518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-21 03:44:28.083646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-21 03:44:28.083671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.685 qpair failed and we were unable to recover it. 00:27:47.685 [2024-11-21 03:44:28.083803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-21 03:44:28.083895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-21 03:44:28.083920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.685 qpair failed and we were unable to recover it. 00:27:47.685 [2024-11-21 03:44:28.084022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-21 03:44:28.084145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-21 03:44:28.084172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.685 qpair failed and we were unable to recover it. 00:27:47.685 [2024-11-21 03:44:28.084277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-21 03:44:28.084367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-21 03:44:28.084392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.685 qpair failed and we were unable to recover it. 00:27:47.685 [2024-11-21 03:44:28.084488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-21 03:44:28.084585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-21 03:44:28.084610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.685 qpair failed and we were unable to recover it. 00:27:47.685 [2024-11-21 03:44:28.084711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-21 03:44:28.084830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-21 03:44:28.084855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.685 qpair failed and we were unable to recover it. 00:27:47.685 [2024-11-21 03:44:28.084956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-21 03:44:28.085092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-21 03:44:28.085122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.685 qpair failed and we were unable to recover it. 00:27:47.685 [2024-11-21 03:44:28.085216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-21 03:44:28.085307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-21 03:44:28.085333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.685 qpair failed and we were unable to recover it. 00:27:47.685 [2024-11-21 03:44:28.085476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-21 03:44:28.085600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-21 03:44:28.085625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.685 qpair failed and we were unable to recover it. 00:27:47.685 [2024-11-21 03:44:28.085756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-21 03:44:28.085861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-21 03:44:28.085885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.685 qpair failed and we were unable to recover it. 00:27:47.685 [2024-11-21 03:44:28.086015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-21 03:44:28.086149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-21 03:44:28.086175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.685 qpair failed and we were unable to recover it. 00:27:47.685 [2024-11-21 03:44:28.086268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-21 03:44:28.086390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-21 03:44:28.086416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.685 qpair failed and we were unable to recover it. 00:27:47.685 [2024-11-21 03:44:28.086553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-21 03:44:28.086660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-21 03:44:28.086685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.685 qpair failed and we were unable to recover it. 00:27:47.685 [2024-11-21 03:44:28.086814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-21 03:44:28.086912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-21 03:44:28.086938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.685 qpair failed and we were unable to recover it. 00:27:47.685 [2024-11-21 03:44:28.087066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-21 03:44:28.087217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-21 03:44:28.087243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.685 qpair failed and we were unable to recover it. 00:27:47.685 [2024-11-21 03:44:28.087346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-21 03:44:28.087485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-21 03:44:28.087510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.685 qpair failed and we were unable to recover it. 00:27:47.685 [2024-11-21 03:44:28.087613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-21 03:44:28.087735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-21 03:44:28.087761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.685 qpair failed and we were unable to recover it. 00:27:47.685 [2024-11-21 03:44:28.087870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-21 03:44:28.087990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.685 [2024-11-21 03:44:28.088015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.685 qpair failed and we were unable to recover it. 00:27:47.686 [2024-11-21 03:44:28.088131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.686 [2024-11-21 03:44:28.088220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.686 [2024-11-21 03:44:28.088245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.686 qpair failed and we were unable to recover it. 00:27:47.686 [2024-11-21 03:44:28.088344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.686 [2024-11-21 03:44:28.088470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.686 [2024-11-21 03:44:28.088495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.686 qpair failed and we were unable to recover it. 00:27:47.686 [2024-11-21 03:44:28.088632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.686 [2024-11-21 03:44:28.088728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.686 [2024-11-21 03:44:28.088753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.686 qpair failed and we were unable to recover it. 00:27:47.686 [2024-11-21 03:44:28.088851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.686 [2024-11-21 03:44:28.089003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.686 [2024-11-21 03:44:28.089029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.686 qpair failed and we were unable to recover it. 00:27:47.686 [2024-11-21 03:44:28.089143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.686 [2024-11-21 03:44:28.089267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.686 [2024-11-21 03:44:28.089297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.686 qpair failed and we were unable to recover it. 00:27:47.686 [2024-11-21 03:44:28.089395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.686 [2024-11-21 03:44:28.089492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.686 [2024-11-21 03:44:28.089517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.686 qpair failed and we were unable to recover it. 00:27:47.686 [2024-11-21 03:44:28.089612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.686 [2024-11-21 03:44:28.089740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.686 [2024-11-21 03:44:28.089765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.686 qpair failed and we were unable to recover it. 00:27:47.686 [2024-11-21 03:44:28.089856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.686 [2024-11-21 03:44:28.089946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.686 [2024-11-21 03:44:28.089970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.686 qpair failed and we were unable to recover it. 00:27:47.686 [2024-11-21 03:44:28.090080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.686 [2024-11-21 03:44:28.090192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.686 [2024-11-21 03:44:28.090217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.686 qpair failed and we were unable to recover it. 00:27:47.686 [2024-11-21 03:44:28.090317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.686 [2024-11-21 03:44:28.090419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.686 [2024-11-21 03:44:28.090444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.686 qpair failed and we were unable to recover it. 00:27:47.686 [2024-11-21 03:44:28.090556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.686 [2024-11-21 03:44:28.090646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.686 [2024-11-21 03:44:28.090670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.686 qpair failed and we were unable to recover it. 00:27:47.686 [2024-11-21 03:44:28.090779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.686 [2024-11-21 03:44:28.090897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.686 [2024-11-21 03:44:28.090923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.686 qpair failed and we were unable to recover it. 00:27:47.686 [2024-11-21 03:44:28.091017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.686 [2024-11-21 03:44:28.091139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.686 [2024-11-21 03:44:28.091165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.686 qpair failed and we were unable to recover it. 00:27:47.686 [2024-11-21 03:44:28.091291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.686 [2024-11-21 03:44:28.091378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.686 [2024-11-21 03:44:28.091403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.686 qpair failed and we were unable to recover it. 00:27:47.686 [2024-11-21 03:44:28.091533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.686 [2024-11-21 03:44:28.091631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.686 [2024-11-21 03:44:28.091664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.686 qpair failed and we were unable to recover it. 00:27:47.686 [2024-11-21 03:44:28.091806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.686 [2024-11-21 03:44:28.091958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.686 [2024-11-21 03:44:28.091983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.686 qpair failed and we were unable to recover it. 00:27:47.686 [2024-11-21 03:44:28.092079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.686 [2024-11-21 03:44:28.092177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.686 [2024-11-21 03:44:28.092202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.686 qpair failed and we were unable to recover it. 00:27:47.686 [2024-11-21 03:44:28.092333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.686 [2024-11-21 03:44:28.092422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.686 [2024-11-21 03:44:28.092447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.686 qpair failed and we were unable to recover it. 00:27:47.686 [2024-11-21 03:44:28.092544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.686 [2024-11-21 03:44:28.092697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.686 [2024-11-21 03:44:28.092722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.686 qpair failed and we were unable to recover it. 00:27:47.686 [2024-11-21 03:44:28.092843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.686 [2024-11-21 03:44:28.092946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.686 [2024-11-21 03:44:28.092971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.686 qpair failed and we were unable to recover it. 00:27:47.686 [2024-11-21 03:44:28.093074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.686 [2024-11-21 03:44:28.093174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.686 [2024-11-21 03:44:28.093200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.686 qpair failed and we were unable to recover it. 00:27:47.686 [2024-11-21 03:44:28.093324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.686 [2024-11-21 03:44:28.093445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.686 [2024-11-21 03:44:28.093471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.686 qpair failed and we were unable to recover it. 00:27:47.686 [2024-11-21 03:44:28.093615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.686 [2024-11-21 03:44:28.093744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.686 [2024-11-21 03:44:28.093769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.686 qpair failed and we were unable to recover it. 00:27:47.686 [2024-11-21 03:44:28.093894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.686 [2024-11-21 03:44:28.093990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.686 [2024-11-21 03:44:28.094015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.686 qpair failed and we were unable to recover it. 00:27:47.686 [2024-11-21 03:44:28.094126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.686 [2024-11-21 03:44:28.094249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.687 [2024-11-21 03:44:28.094275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.687 qpair failed and we were unable to recover it. 00:27:47.687 [2024-11-21 03:44:28.094372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.687 [2024-11-21 03:44:28.094483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.687 [2024-11-21 03:44:28.094509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.687 qpair failed and we were unable to recover it. 00:27:47.687 [2024-11-21 03:44:28.094607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.687 [2024-11-21 03:44:28.094733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.687 [2024-11-21 03:44:28.094758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.687 qpair failed and we were unable to recover it. 00:27:47.687 [2024-11-21 03:44:28.094849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.687 [2024-11-21 03:44:28.094957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.687 [2024-11-21 03:44:28.094981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.687 qpair failed and we were unable to recover it. 00:27:47.687 [2024-11-21 03:44:28.095099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.687 [2024-11-21 03:44:28.095203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.687 [2024-11-21 03:44:28.095228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.687 qpair failed and we were unable to recover it. 00:27:47.687 [2024-11-21 03:44:28.095321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.687 [2024-11-21 03:44:28.095428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.687 [2024-11-21 03:44:28.095453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.687 qpair failed and we were unable to recover it. 00:27:47.687 [2024-11-21 03:44:28.095558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.687 [2024-11-21 03:44:28.095654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.687 [2024-11-21 03:44:28.095679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.687 qpair failed and we were unable to recover it. 00:27:47.687 [2024-11-21 03:44:28.095775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.687 [2024-11-21 03:44:28.095868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.687 [2024-11-21 03:44:28.095893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.687 qpair failed and we were unable to recover it. 00:27:47.687 [2024-11-21 03:44:28.095999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.687 [2024-11-21 03:44:28.096094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.687 [2024-11-21 03:44:28.096121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.687 qpair failed and we were unable to recover it. 00:27:47.687 [2024-11-21 03:44:28.096231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.687 [2024-11-21 03:44:28.096323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.687 [2024-11-21 03:44:28.096348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.687 qpair failed and we were unable to recover it. 00:27:47.687 [2024-11-21 03:44:28.096484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.687 [2024-11-21 03:44:28.096575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.687 [2024-11-21 03:44:28.096601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.687 qpair failed and we were unable to recover it. 00:27:47.687 [2024-11-21 03:44:28.096710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.687 [2024-11-21 03:44:28.096809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.687 [2024-11-21 03:44:28.096834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.687 qpair failed and we were unable to recover it. 00:27:47.687 [2024-11-21 03:44:28.096963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.687 [2024-11-21 03:44:28.097055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.687 [2024-11-21 03:44:28.097085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.687 qpair failed and we were unable to recover it. 00:27:47.687 [2024-11-21 03:44:28.097220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.687 [2024-11-21 03:44:28.097342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.687 [2024-11-21 03:44:28.097367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.687 qpair failed and we were unable to recover it. 00:27:47.687 [2024-11-21 03:44:28.097464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.687 [2024-11-21 03:44:28.097584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.687 [2024-11-21 03:44:28.097609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.687 qpair failed and we were unable to recover it. 00:27:47.687 [2024-11-21 03:44:28.097704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.687 [2024-11-21 03:44:28.097832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.687 [2024-11-21 03:44:28.097858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.687 qpair failed and we were unable to recover it. 00:27:47.687 [2024-11-21 03:44:28.097987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.687 [2024-11-21 03:44:28.098089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.687 [2024-11-21 03:44:28.098115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.687 qpair failed and we were unable to recover it. 00:27:47.687 [2024-11-21 03:44:28.098214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.687 [2024-11-21 03:44:28.098367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.687 [2024-11-21 03:44:28.098393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.687 qpair failed and we were unable to recover it. 00:27:47.687 [2024-11-21 03:44:28.098498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.687 [2024-11-21 03:44:28.098594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.687 [2024-11-21 03:44:28.098621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.687 qpair failed and we were unable to recover it. 00:27:47.687 [2024-11-21 03:44:28.098751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.687 [2024-11-21 03:44:28.098850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.687 [2024-11-21 03:44:28.098875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.687 qpair failed and we were unable to recover it. 00:27:47.687 [2024-11-21 03:44:28.099002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.687 [2024-11-21 03:44:28.099132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.687 [2024-11-21 03:44:28.099158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.687 qpair failed and we were unable to recover it. 00:27:47.687 [2024-11-21 03:44:28.099255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.687 [2024-11-21 03:44:28.099395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.687 [2024-11-21 03:44:28.099421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.687 qpair failed and we were unable to recover it. 00:27:47.687 [2024-11-21 03:44:28.099522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.687 [2024-11-21 03:44:28.099624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.687 [2024-11-21 03:44:28.099650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.687 qpair failed and we were unable to recover it. 00:27:47.687 [2024-11-21 03:44:28.099743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.687 [2024-11-21 03:44:28.099835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.687 [2024-11-21 03:44:28.099861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.687 qpair failed and we were unable to recover it. 00:27:47.687 [2024-11-21 03:44:28.099953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.687 [2024-11-21 03:44:28.100088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.687 [2024-11-21 03:44:28.100122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.687 qpair failed and we were unable to recover it. 00:27:47.687 [2024-11-21 03:44:28.100225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.687 [2024-11-21 03:44:28.100351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.687 [2024-11-21 03:44:28.100376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.688 qpair failed and we were unable to recover it. 00:27:47.688 [2024-11-21 03:44:28.100506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.688 [2024-11-21 03:44:28.100613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.688 [2024-11-21 03:44:28.100638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.688 qpair failed and we were unable to recover it. 00:27:47.688 [2024-11-21 03:44:28.100740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.688 [2024-11-21 03:44:28.100828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.688 [2024-11-21 03:44:28.100853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.688 qpair failed and we were unable to recover it. 00:27:47.688 [2024-11-21 03:44:28.100984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.688 [2024-11-21 03:44:28.101092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.688 [2024-11-21 03:44:28.101128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.688 qpair failed and we were unable to recover it. 00:27:47.688 [2024-11-21 03:44:28.101234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.688 [2024-11-21 03:44:28.101363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.688 [2024-11-21 03:44:28.101387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.688 qpair failed and we were unable to recover it. 00:27:47.688 [2024-11-21 03:44:28.101485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.688 [2024-11-21 03:44:28.101611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.688 [2024-11-21 03:44:28.101638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.688 qpair failed and we were unable to recover it. 00:27:47.688 [2024-11-21 03:44:28.101775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.688 [2024-11-21 03:44:28.101914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.688 [2024-11-21 03:44:28.101940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.688 qpair failed and we were unable to recover it. 00:27:47.688 [2024-11-21 03:44:28.102064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.688 [2024-11-21 03:44:28.102203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.688 [2024-11-21 03:44:28.102229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.688 qpair failed and we were unable to recover it. 00:27:47.688 [2024-11-21 03:44:28.102327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.688 [2024-11-21 03:44:28.102417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.688 [2024-11-21 03:44:28.102443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.688 qpair failed and we were unable to recover it. 00:27:47.688 [2024-11-21 03:44:28.102574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.688 [2024-11-21 03:44:28.102678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.688 [2024-11-21 03:44:28.102704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.688 qpair failed and we were unable to recover it. 00:27:47.688 [2024-11-21 03:44:28.102827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.688 [2024-11-21 03:44:28.102949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.688 [2024-11-21 03:44:28.102974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.688 qpair failed and we were unable to recover it. 00:27:47.688 [2024-11-21 03:44:28.103066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.688 [2024-11-21 03:44:28.103206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.688 [2024-11-21 03:44:28.103232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.688 qpair failed and we were unable to recover it. 00:27:47.688 [2024-11-21 03:44:28.103339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.688 [2024-11-21 03:44:28.103434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.688 [2024-11-21 03:44:28.103459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.688 qpair failed and we were unable to recover it. 00:27:47.688 [2024-11-21 03:44:28.103587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.688 [2024-11-21 03:44:28.103679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.688 [2024-11-21 03:44:28.103705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.688 qpair failed and we were unable to recover it. 00:27:47.688 [2024-11-21 03:44:28.103804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.688 [2024-11-21 03:44:28.103962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.688 [2024-11-21 03:44:28.103988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.688 qpair failed and we were unable to recover it. 00:27:47.688 [2024-11-21 03:44:28.104125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.688 [2024-11-21 03:44:28.104225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.688 [2024-11-21 03:44:28.104250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.688 qpair failed and we were unable to recover it. 00:27:47.688 [2024-11-21 03:44:28.104376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.688 [2024-11-21 03:44:28.104469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.688 [2024-11-21 03:44:28.104498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.688 qpair failed and we were unable to recover it. 00:27:47.688 [2024-11-21 03:44:28.104626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.688 [2024-11-21 03:44:28.104747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.688 [2024-11-21 03:44:28.104772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.688 qpair failed and we were unable to recover it. 00:27:47.688 [2024-11-21 03:44:28.104867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.688 [2024-11-21 03:44:28.104998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.688 [2024-11-21 03:44:28.105024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.688 qpair failed and we were unable to recover it. 00:27:47.688 [2024-11-21 03:44:28.105158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.688 [2024-11-21 03:44:28.105261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.688 [2024-11-21 03:44:28.105286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.688 qpair failed and we were unable to recover it. 00:27:47.688 [2024-11-21 03:44:28.105419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.688 [2024-11-21 03:44:28.105512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.688 [2024-11-21 03:44:28.105537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.688 qpair failed and we were unable to recover it. 00:27:47.688 [2024-11-21 03:44:28.105663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.688 [2024-11-21 03:44:28.105794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.688 [2024-11-21 03:44:28.105819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.688 qpair failed and we were unable to recover it. 00:27:47.688 [2024-11-21 03:44:28.105913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.688 [2024-11-21 03:44:28.106038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.688 [2024-11-21 03:44:28.106063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.688 qpair failed and we were unable to recover it. 00:27:47.688 [2024-11-21 03:44:28.106185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.689 [2024-11-21 03:44:28.106307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.689 [2024-11-21 03:44:28.106333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.689 qpair failed and we were unable to recover it. 00:27:47.689 [2024-11-21 03:44:28.106465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.689 [2024-11-21 03:44:28.106555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.689 [2024-11-21 03:44:28.106580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.689 qpair failed and we were unable to recover it. 00:27:47.689 [2024-11-21 03:44:28.106722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.689 [2024-11-21 03:44:28.106861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.689 [2024-11-21 03:44:28.106886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.689 qpair failed and we were unable to recover it. 00:27:47.689 [2024-11-21 03:44:28.106974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.689 [2024-11-21 03:44:28.107093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.689 [2024-11-21 03:44:28.107120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.689 qpair failed and we were unable to recover it. 00:27:47.689 [2024-11-21 03:44:28.107258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.689 [2024-11-21 03:44:28.107387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.689 [2024-11-21 03:44:28.107412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.689 qpair failed and we were unable to recover it. 00:27:47.689 [2024-11-21 03:44:28.107512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.689 [2024-11-21 03:44:28.107610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.689 [2024-11-21 03:44:28.107635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.689 qpair failed and we were unable to recover it. 00:27:47.689 [2024-11-21 03:44:28.107740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.689 [2024-11-21 03:44:28.107839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.689 [2024-11-21 03:44:28.107864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.689 qpair failed and we were unable to recover it. 00:27:47.689 [2024-11-21 03:44:28.107989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.689 [2024-11-21 03:44:28.108135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.689 [2024-11-21 03:44:28.108162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.689 qpair failed and we were unable to recover it. 00:27:47.689 [2024-11-21 03:44:28.108262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.689 [2024-11-21 03:44:28.108375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.689 [2024-11-21 03:44:28.108400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.689 qpair failed and we were unable to recover it. 00:27:47.689 [2024-11-21 03:44:28.108533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.689 [2024-11-21 03:44:28.108629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.689 [2024-11-21 03:44:28.108654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.689 qpair failed and we were unable to recover it. 00:27:47.689 [2024-11-21 03:44:28.108755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.689 [2024-11-21 03:44:28.108907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.689 [2024-11-21 03:44:28.108932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.689 qpair failed and we were unable to recover it. 00:27:47.689 [2024-11-21 03:44:28.109036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.689 [2024-11-21 03:44:28.109168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.689 [2024-11-21 03:44:28.109194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.689 qpair failed and we were unable to recover it. 00:27:47.689 [2024-11-21 03:44:28.109305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.689 [2024-11-21 03:44:28.109443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.689 [2024-11-21 03:44:28.109468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.689 qpair failed and we were unable to recover it. 00:27:47.689 [2024-11-21 03:44:28.109563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.689 [2024-11-21 03:44:28.109661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.689 [2024-11-21 03:44:28.109686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.689 qpair failed and we were unable to recover it. 00:27:47.689 [2024-11-21 03:44:28.109833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.689 [2024-11-21 03:44:28.109926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.689 [2024-11-21 03:44:28.109950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.689 qpair failed and we were unable to recover it. 00:27:47.689 [2024-11-21 03:44:28.110080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.689 [2024-11-21 03:44:28.110184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.689 [2024-11-21 03:44:28.110209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.689 qpair failed and we were unable to recover it. 00:27:47.689 [2024-11-21 03:44:28.110318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.689 [2024-11-21 03:44:28.110442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.689 [2024-11-21 03:44:28.110467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.689 qpair failed and we were unable to recover it. 00:27:47.689 [2024-11-21 03:44:28.110592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.689 [2024-11-21 03:44:28.110686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.689 [2024-11-21 03:44:28.110711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.689 qpair failed and we were unable to recover it. 00:27:47.689 [2024-11-21 03:44:28.110806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.689 [2024-11-21 03:44:28.110955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.689 [2024-11-21 03:44:28.110980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.689 qpair failed and we were unable to recover it. 00:27:47.689 [2024-11-21 03:44:28.111075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.689 [2024-11-21 03:44:28.111179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.689 [2024-11-21 03:44:28.111204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.689 qpair failed and we were unable to recover it. 00:27:47.689 [2024-11-21 03:44:28.111301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.689 [2024-11-21 03:44:28.111450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.689 [2024-11-21 03:44:28.111476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.689 qpair failed and we were unable to recover it. 00:27:47.689 [2024-11-21 03:44:28.111566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.689 [2024-11-21 03:44:28.111666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.689 [2024-11-21 03:44:28.111693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.689 qpair failed and we were unable to recover it. 00:27:47.689 [2024-11-21 03:44:28.111827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.689 [2024-11-21 03:44:28.111989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.690 [2024-11-21 03:44:28.112014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.690 qpair failed and we were unable to recover it. 00:27:47.690 [2024-11-21 03:44:28.112143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.690 [2024-11-21 03:44:28.112266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.690 [2024-11-21 03:44:28.112291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.690 qpair failed and we were unable to recover it. 00:27:47.690 [2024-11-21 03:44:28.112411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.690 [2024-11-21 03:44:28.112531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.690 [2024-11-21 03:44:28.112556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.690 qpair failed and we were unable to recover it. 00:27:47.690 [2024-11-21 03:44:28.112650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.690 [2024-11-21 03:44:28.112744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.690 [2024-11-21 03:44:28.112769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.690 qpair failed and we were unable to recover it. 00:27:47.690 [2024-11-21 03:44:28.112875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.690 [2024-11-21 03:44:28.112968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.690 [2024-11-21 03:44:28.112994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.690 qpair failed and we were unable to recover it. 00:27:47.690 [2024-11-21 03:44:28.113128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.690 [2024-11-21 03:44:28.113253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.690 [2024-11-21 03:44:28.113278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.690 qpair failed and we were unable to recover it. 00:27:47.690 [2024-11-21 03:44:28.113410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.690 [2024-11-21 03:44:28.113529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.690 [2024-11-21 03:44:28.113554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.690 qpair failed and we were unable to recover it. 00:27:47.690 [2024-11-21 03:44:28.113660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.690 [2024-11-21 03:44:28.113787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.690 [2024-11-21 03:44:28.113812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.690 qpair failed and we were unable to recover it. 00:27:47.690 [2024-11-21 03:44:28.113946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.690 [2024-11-21 03:44:28.114034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.690 [2024-11-21 03:44:28.114059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.690 qpair failed and we were unable to recover it. 00:27:47.690 [2024-11-21 03:44:28.114176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.690 [2024-11-21 03:44:28.114298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.690 [2024-11-21 03:44:28.114334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.690 qpair failed and we were unable to recover it. 00:27:47.690 [2024-11-21 03:44:28.114428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.690 [2024-11-21 03:44:28.114529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.690 [2024-11-21 03:44:28.114554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.690 qpair failed and we were unable to recover it. 00:27:47.690 [2024-11-21 03:44:28.114678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.690 [2024-11-21 03:44:28.114776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.690 [2024-11-21 03:44:28.114801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.690 qpair failed and we were unable to recover it. 00:27:47.690 [2024-11-21 03:44:28.114900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.690 [2024-11-21 03:44:28.115033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.690 [2024-11-21 03:44:28.115059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.690 qpair failed and we were unable to recover it. 00:27:47.690 [2024-11-21 03:44:28.115175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.690 [2024-11-21 03:44:28.115281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.690 [2024-11-21 03:44:28.115307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.690 qpair failed and we were unable to recover it. 00:27:47.690 [2024-11-21 03:44:28.115441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.690 [2024-11-21 03:44:28.115537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.690 [2024-11-21 03:44:28.115562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.690 qpair failed and we were unable to recover it. 00:27:47.690 [2024-11-21 03:44:28.115660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.690 [2024-11-21 03:44:28.115785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.690 [2024-11-21 03:44:28.115810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.690 qpair failed and we were unable to recover it. 00:27:47.690 [2024-11-21 03:44:28.115927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.690 [2024-11-21 03:44:28.116015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.690 [2024-11-21 03:44:28.116040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.690 qpair failed and we were unable to recover it. 00:27:47.690 [2024-11-21 03:44:28.116151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.690 [2024-11-21 03:44:28.116260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.690 [2024-11-21 03:44:28.116285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.690 qpair failed and we were unable to recover it. 00:27:47.690 [2024-11-21 03:44:28.116389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.690 [2024-11-21 03:44:28.116525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.690 [2024-11-21 03:44:28.116549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.690 qpair failed and we were unable to recover it. 00:27:47.690 [2024-11-21 03:44:28.116704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.690 [2024-11-21 03:44:28.116802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.690 [2024-11-21 03:44:28.116828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.690 qpair failed and we were unable to recover it. 00:27:47.690 [2024-11-21 03:44:28.116962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.690 [2024-11-21 03:44:28.117094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.690 [2024-11-21 03:44:28.117129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.690 qpair failed and we were unable to recover it. 00:27:47.690 [2024-11-21 03:44:28.117252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.690 [2024-11-21 03:44:28.117356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.690 [2024-11-21 03:44:28.117384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.690 qpair failed and we were unable to recover it. 00:27:47.690 [2024-11-21 03:44:28.117527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.690 [2024-11-21 03:44:28.117654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.690 [2024-11-21 03:44:28.117686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.690 qpair failed and we were unable to recover it. 00:27:47.690 [2024-11-21 03:44:28.117893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.690 [2024-11-21 03:44:28.117993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.691 [2024-11-21 03:44:28.118018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.691 qpair failed and we were unable to recover it. 00:27:47.691 [2024-11-21 03:44:28.118128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.691 [2024-11-21 03:44:28.118231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.691 [2024-11-21 03:44:28.118256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.691 qpair failed and we were unable to recover it. 00:27:47.691 [2024-11-21 03:44:28.118383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.691 [2024-11-21 03:44:28.118531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.691 [2024-11-21 03:44:28.118556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.691 qpair failed and we were unable to recover it. 00:27:47.691 [2024-11-21 03:44:28.118685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.691 [2024-11-21 03:44:28.118788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.691 [2024-11-21 03:44:28.118813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.691 qpair failed and we were unable to recover it. 00:27:47.691 [2024-11-21 03:44:28.118910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.691 [2024-11-21 03:44:28.119009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.691 [2024-11-21 03:44:28.119033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.691 qpair failed and we were unable to recover it. 00:27:47.691 [2024-11-21 03:44:28.119172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.691 [2024-11-21 03:44:28.119272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.691 [2024-11-21 03:44:28.119297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.691 qpair failed and we were unable to recover it. 00:27:47.691 [2024-11-21 03:44:28.119434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.691 [2024-11-21 03:44:28.119575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.691 [2024-11-21 03:44:28.119600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.691 qpair failed and we were unable to recover it. 00:27:47.691 [2024-11-21 03:44:28.119693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.691 [2024-11-21 03:44:28.119790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.691 [2024-11-21 03:44:28.119815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.691 qpair failed and we were unable to recover it. 00:27:47.691 [2024-11-21 03:44:28.119945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.691 [2024-11-21 03:44:28.120046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.691 [2024-11-21 03:44:28.120076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.691 qpair failed and we were unable to recover it. 00:27:47.691 [2024-11-21 03:44:28.120175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.691 [2024-11-21 03:44:28.120302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.691 [2024-11-21 03:44:28.120328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.691 qpair failed and we were unable to recover it. 00:27:47.691 [2024-11-21 03:44:28.120474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.691 [2024-11-21 03:44:28.120599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.691 [2024-11-21 03:44:28.120625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.691 qpair failed and we were unable to recover it. 00:27:47.691 [2024-11-21 03:44:28.120752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.691 [2024-11-21 03:44:28.120853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.691 [2024-11-21 03:44:28.120879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.691 qpair failed and we were unable to recover it. 00:27:47.691 [2024-11-21 03:44:28.120996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.691 [2024-11-21 03:44:28.121121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.691 [2024-11-21 03:44:28.121147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.691 qpair failed and we were unable to recover it. 00:27:47.691 [2024-11-21 03:44:28.121250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.691 [2024-11-21 03:44:28.121390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.691 [2024-11-21 03:44:28.121415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.691 qpair failed and we were unable to recover it. 00:27:47.691 [2024-11-21 03:44:28.121537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.691 [2024-11-21 03:44:28.121667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.691 [2024-11-21 03:44:28.121692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.691 qpair failed and we were unable to recover it. 00:27:47.691 [2024-11-21 03:44:28.121800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.691 [2024-11-21 03:44:28.121888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.691 [2024-11-21 03:44:28.121913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.691 qpair failed and we were unable to recover it. 00:27:47.691 [2024-11-21 03:44:28.122064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.691 [2024-11-21 03:44:28.122205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.691 [2024-11-21 03:44:28.122230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.691 qpair failed and we were unable to recover it. 00:27:47.691 [2024-11-21 03:44:28.122362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.691 [2024-11-21 03:44:28.122486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.691 [2024-11-21 03:44:28.122511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.691 qpair failed and we were unable to recover it. 00:27:47.691 [2024-11-21 03:44:28.122613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.691 [2024-11-21 03:44:28.122735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.691 [2024-11-21 03:44:28.122760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.691 qpair failed and we were unable to recover it. 00:27:47.691 [2024-11-21 03:44:28.122894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.691 [2024-11-21 03:44:28.122984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.691 [2024-11-21 03:44:28.123008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.691 qpair failed and we were unable to recover it. 00:27:47.691 [2024-11-21 03:44:28.123119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.691 [2024-11-21 03:44:28.123225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.691 [2024-11-21 03:44:28.123249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.691 qpair failed and we were unable to recover it. 00:27:47.691 [2024-11-21 03:44:28.123376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.691 [2024-11-21 03:44:28.123467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.691 [2024-11-21 03:44:28.123492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.691 qpair failed and we were unable to recover it. 00:27:47.691 [2024-11-21 03:44:28.123595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.691 [2024-11-21 03:44:28.123715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.691 [2024-11-21 03:44:28.123740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.691 qpair failed and we were unable to recover it. 00:27:47.691 [2024-11-21 03:44:28.123856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.692 [2024-11-21 03:44:28.123951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.692 [2024-11-21 03:44:28.123977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.692 qpair failed and we were unable to recover it. 00:27:47.692 [2024-11-21 03:44:28.124091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.692 [2024-11-21 03:44:28.124228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.692 [2024-11-21 03:44:28.124253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.692 qpair failed and we were unable to recover it. 00:27:47.692 [2024-11-21 03:44:28.124363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.692 [2024-11-21 03:44:28.124479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.692 [2024-11-21 03:44:28.124504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.692 qpair failed and we were unable to recover it. 00:27:47.692 [2024-11-21 03:44:28.124595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.692 [2024-11-21 03:44:28.124722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.692 [2024-11-21 03:44:28.124747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.692 qpair failed and we were unable to recover it. 00:27:47.692 [2024-11-21 03:44:28.124859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.692 [2024-11-21 03:44:28.124968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.692 [2024-11-21 03:44:28.124992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.692 qpair failed and we were unable to recover it. 00:27:47.692 [2024-11-21 03:44:28.125178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.692 [2024-11-21 03:44:28.125314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.692 [2024-11-21 03:44:28.125341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.692 qpair failed and we were unable to recover it. 00:27:47.692 [2024-11-21 03:44:28.125448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.692 [2024-11-21 03:44:28.125570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.692 [2024-11-21 03:44:28.125596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.692 qpair failed and we were unable to recover it. 00:27:47.692 [2024-11-21 03:44:28.125753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.692 [2024-11-21 03:44:28.125842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.692 [2024-11-21 03:44:28.125868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.692 qpair failed and we were unable to recover it. 00:27:47.692 [2024-11-21 03:44:28.125999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.692 [2024-11-21 03:44:28.126108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.692 [2024-11-21 03:44:28.126134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.692 qpair failed and we were unable to recover it. 00:27:47.692 [2024-11-21 03:44:28.126237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.692 [2024-11-21 03:44:28.126367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.692 [2024-11-21 03:44:28.126393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.692 qpair failed and we were unable to recover it. 00:27:47.692 [2024-11-21 03:44:28.126500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.692 [2024-11-21 03:44:28.126598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.692 [2024-11-21 03:44:28.126623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.692 qpair failed and we were unable to recover it. 00:27:47.692 [2024-11-21 03:44:28.126716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.692 [2024-11-21 03:44:28.126857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.692 [2024-11-21 03:44:28.126891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.692 qpair failed and we were unable to recover it. 00:27:47.692 [2024-11-21 03:44:28.126998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.692 [2024-11-21 03:44:28.127099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.692 [2024-11-21 03:44:28.127124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.692 qpair failed and we were unable to recover it. 00:27:47.692 [2024-11-21 03:44:28.127212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.692 [2024-11-21 03:44:28.127313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.692 [2024-11-21 03:44:28.127338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.692 qpair failed and we were unable to recover it. 00:27:47.692 [2024-11-21 03:44:28.127464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.692 [2024-11-21 03:44:28.127570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.692 [2024-11-21 03:44:28.127596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.692 qpair failed and we were unable to recover it. 00:27:47.692 [2024-11-21 03:44:28.127699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.692 [2024-11-21 03:44:28.127798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.692 [2024-11-21 03:44:28.127823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.692 qpair failed and we were unable to recover it. 00:27:47.692 [2024-11-21 03:44:28.127964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.692 [2024-11-21 03:44:28.128113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.692 [2024-11-21 03:44:28.128139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.692 qpair failed and we were unable to recover it. 00:27:47.692 [2024-11-21 03:44:28.128243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.692 [2024-11-21 03:44:28.128376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.692 [2024-11-21 03:44:28.128401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.692 qpair failed and we were unable to recover it. 00:27:47.692 [2024-11-21 03:44:28.128503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.692 [2024-11-21 03:44:28.128601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.692 [2024-11-21 03:44:28.128626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.692 qpair failed and we were unable to recover it. 00:27:47.692 [2024-11-21 03:44:28.128726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.692 [2024-11-21 03:44:28.128817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.692 [2024-11-21 03:44:28.128842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.692 qpair failed and we were unable to recover it. 00:27:47.692 [2024-11-21 03:44:28.128949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.692 [2024-11-21 03:44:28.129094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.692 [2024-11-21 03:44:28.129131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.692 qpair failed and we were unable to recover it. 00:27:47.692 [2024-11-21 03:44:28.129237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.692 [2024-11-21 03:44:28.129360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.692 [2024-11-21 03:44:28.129385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.693 qpair failed and we were unable to recover it. 00:27:47.693 [2024-11-21 03:44:28.129487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.693 [2024-11-21 03:44:28.129608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.693 [2024-11-21 03:44:28.129634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.693 qpair failed and we were unable to recover it. 00:27:47.693 [2024-11-21 03:44:28.129755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.693 [2024-11-21 03:44:28.129849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.693 [2024-11-21 03:44:28.129875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.693 qpair failed and we were unable to recover it. 00:27:47.693 [2024-11-21 03:44:28.129970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.693 [2024-11-21 03:44:28.130062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.693 [2024-11-21 03:44:28.130092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.693 qpair failed and we were unable to recover it. 00:27:47.693 [2024-11-21 03:44:28.130194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.693 [2024-11-21 03:44:28.130295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.693 [2024-11-21 03:44:28.130320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.693 qpair failed and we were unable to recover it. 00:27:47.693 [2024-11-21 03:44:28.130422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.693 [2024-11-21 03:44:28.130549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.693 [2024-11-21 03:44:28.130574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.693 qpair failed and we were unable to recover it. 00:27:47.693 [2024-11-21 03:44:28.130669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.693 [2024-11-21 03:44:28.130759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.693 [2024-11-21 03:44:28.130791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.693 qpair failed and we were unable to recover it. 00:27:47.693 [2024-11-21 03:44:28.130934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.693 [2024-11-21 03:44:28.131074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.693 [2024-11-21 03:44:28.131100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.693 qpair failed and we were unable to recover it. 00:27:47.693 [2024-11-21 03:44:28.131206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.693 [2024-11-21 03:44:28.131303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.693 [2024-11-21 03:44:28.131327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.693 qpair failed and we were unable to recover it. 00:27:47.693 [2024-11-21 03:44:28.131469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.693 [2024-11-21 03:44:28.131597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.693 [2024-11-21 03:44:28.131622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.693 qpair failed and we were unable to recover it. 00:27:47.693 [2024-11-21 03:44:28.131775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.693 [2024-11-21 03:44:28.131879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.693 [2024-11-21 03:44:28.131904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.693 qpair failed and we were unable to recover it. 00:27:47.693 [2024-11-21 03:44:28.132030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.693 [2024-11-21 03:44:28.132148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.693 [2024-11-21 03:44:28.132174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.693 qpair failed and we were unable to recover it. 00:27:47.693 [2024-11-21 03:44:28.132274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.693 [2024-11-21 03:44:28.132373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.693 [2024-11-21 03:44:28.132398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.693 qpair failed and we were unable to recover it. 00:27:47.693 [2024-11-21 03:44:28.132495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.693 [2024-11-21 03:44:28.132624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.693 [2024-11-21 03:44:28.132650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.693 qpair failed and we were unable to recover it. 00:27:47.693 [2024-11-21 03:44:28.132790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.693 [2024-11-21 03:44:28.132885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.693 [2024-11-21 03:44:28.132911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.693 qpair failed and we were unable to recover it. 00:27:47.693 [2024-11-21 03:44:28.133038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.693 [2024-11-21 03:44:28.133148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.693 [2024-11-21 03:44:28.133174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.693 qpair failed and we were unable to recover it. 00:27:47.693 [2024-11-21 03:44:28.133270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.693 [2024-11-21 03:44:28.133368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.693 [2024-11-21 03:44:28.133398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.693 qpair failed and we were unable to recover it. 00:27:47.693 [2024-11-21 03:44:28.133552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.693 [2024-11-21 03:44:28.133643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.693 [2024-11-21 03:44:28.133668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.693 qpair failed and we were unable to recover it. 00:27:47.693 [2024-11-21 03:44:28.133789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.693 [2024-11-21 03:44:28.133916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.693 [2024-11-21 03:44:28.133941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.693 qpair failed and we were unable to recover it. 00:27:47.693 [2024-11-21 03:44:28.134029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.693 [2024-11-21 03:44:28.134137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.693 [2024-11-21 03:44:28.134162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.693 qpair failed and we were unable to recover it. 00:27:47.693 [2024-11-21 03:44:28.134264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.693 [2024-11-21 03:44:28.134371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.693 [2024-11-21 03:44:28.134396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.693 qpair failed and we were unable to recover it. 00:27:47.693 [2024-11-21 03:44:28.134508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.693 [2024-11-21 03:44:28.134635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.693 [2024-11-21 03:44:28.134660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.693 qpair failed and we were unable to recover it. 00:27:47.693 [2024-11-21 03:44:28.134754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.693 [2024-11-21 03:44:28.134851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.693 [2024-11-21 03:44:28.134876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.693 qpair failed and we were unable to recover it. 00:27:47.693 [2024-11-21 03:44:28.135007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.693 [2024-11-21 03:44:28.135145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.694 [2024-11-21 03:44:28.135171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.694 qpair failed and we were unable to recover it. 00:27:47.694 [2024-11-21 03:44:28.135268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.694 [2024-11-21 03:44:28.135380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.694 [2024-11-21 03:44:28.135405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.694 qpair failed and we were unable to recover it. 00:27:47.694 [2024-11-21 03:44:28.135504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.694 [2024-11-21 03:44:28.135631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.694 [2024-11-21 03:44:28.135656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.694 qpair failed and we were unable to recover it. 00:27:47.694 [2024-11-21 03:44:28.135778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.694 [2024-11-21 03:44:28.135879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.694 [2024-11-21 03:44:28.135904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.694 qpair failed and we were unable to recover it. 00:27:47.694 [2024-11-21 03:44:28.136002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.694 [2024-11-21 03:44:28.136109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.694 [2024-11-21 03:44:28.136135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.694 qpair failed and we were unable to recover it. 00:27:47.694 [2024-11-21 03:44:28.136266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.694 [2024-11-21 03:44:28.136360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.694 [2024-11-21 03:44:28.136385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.694 qpair failed and we were unable to recover it. 00:27:47.694 [2024-11-21 03:44:28.136485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.694 [2024-11-21 03:44:28.136572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.694 [2024-11-21 03:44:28.136597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.694 qpair failed and we were unable to recover it. 00:27:47.694 [2024-11-21 03:44:28.136722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.694 [2024-11-21 03:44:28.136842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.694 [2024-11-21 03:44:28.136867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.694 qpair failed and we were unable to recover it. 00:27:47.694 [2024-11-21 03:44:28.136957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.694 [2024-11-21 03:44:28.137111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.694 [2024-11-21 03:44:28.137138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.694 qpair failed and we were unable to recover it. 00:27:47.694 [2024-11-21 03:44:28.137228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.694 [2024-11-21 03:44:28.137366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.694 [2024-11-21 03:44:28.137391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.694 qpair failed and we were unable to recover it. 00:27:47.694 [2024-11-21 03:44:28.137519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.694 [2024-11-21 03:44:28.137619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.694 [2024-11-21 03:44:28.137644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.694 qpair failed and we were unable to recover it. 00:27:47.694 [2024-11-21 03:44:28.137769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.694 [2024-11-21 03:44:28.137867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.694 [2024-11-21 03:44:28.137892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.694 qpair failed and we were unable to recover it. 00:27:47.694 [2024-11-21 03:44:28.137994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.694 [2024-11-21 03:44:28.138087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.694 [2024-11-21 03:44:28.138113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.694 qpair failed and we were unable to recover it. 00:27:47.694 [2024-11-21 03:44:28.138217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.694 [2024-11-21 03:44:28.138340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.694 [2024-11-21 03:44:28.138364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.694 qpair failed and we were unable to recover it. 00:27:47.694 [2024-11-21 03:44:28.138463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.694 [2024-11-21 03:44:28.138565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.694 [2024-11-21 03:44:28.138590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.694 qpair failed and we were unable to recover it. 00:27:47.694 [2024-11-21 03:44:28.138710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.694 [2024-11-21 03:44:28.138815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.694 [2024-11-21 03:44:28.138840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.694 qpair failed and we were unable to recover it. 00:27:47.694 [2024-11-21 03:44:28.138943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.694 [2024-11-21 03:44:28.139046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.694 [2024-11-21 03:44:28.139077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.694 qpair failed and we were unable to recover it. 00:27:47.694 [2024-11-21 03:44:28.139180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.694 [2024-11-21 03:44:28.139280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.694 [2024-11-21 03:44:28.139305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.694 qpair failed and we were unable to recover it. 00:27:47.694 [2024-11-21 03:44:28.139430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.694 [2024-11-21 03:44:28.139525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.694 [2024-11-21 03:44:28.139550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.694 qpair failed and we were unable to recover it. 00:27:47.695 [2024-11-21 03:44:28.139683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.695 [2024-11-21 03:44:28.139786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.695 [2024-11-21 03:44:28.139811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.695 qpair failed and we were unable to recover it. 00:27:47.695 [2024-11-21 03:44:28.139905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.695 [2024-11-21 03:44:28.140057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.695 [2024-11-21 03:44:28.140090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.695 qpair failed and we were unable to recover it. 00:27:47.695 [2024-11-21 03:44:28.140191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.695 [2024-11-21 03:44:28.140283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.695 [2024-11-21 03:44:28.140308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.695 qpair failed and we were unable to recover it. 00:27:47.695 [2024-11-21 03:44:28.140455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.695 [2024-11-21 03:44:28.140594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.695 [2024-11-21 03:44:28.140621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.695 qpair failed and we were unable to recover it. 00:27:47.695 [2024-11-21 03:44:28.140715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.695 [2024-11-21 03:44:28.140812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.695 [2024-11-21 03:44:28.140837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.695 qpair failed and we were unable to recover it. 00:27:47.695 [2024-11-21 03:44:28.140963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.695 [2024-11-21 03:44:28.141066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.695 [2024-11-21 03:44:28.141119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.695 qpair failed and we were unable to recover it. 00:27:47.695 [2024-11-21 03:44:28.141220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.695 [2024-11-21 03:44:28.141325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.695 [2024-11-21 03:44:28.141350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.695 qpair failed and we were unable to recover it. 00:27:47.695 [2024-11-21 03:44:28.141456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.695 [2024-11-21 03:44:28.141584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.695 [2024-11-21 03:44:28.141609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.695 qpair failed and we were unable to recover it. 00:27:47.695 [2024-11-21 03:44:28.141705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.695 [2024-11-21 03:44:28.141801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.695 [2024-11-21 03:44:28.141826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.695 qpair failed and we were unable to recover it. 00:27:47.695 [2024-11-21 03:44:28.141953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.695 [2024-11-21 03:44:28.142052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.695 [2024-11-21 03:44:28.142085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.695 qpair failed and we were unable to recover it. 00:27:47.695 [2024-11-21 03:44:28.142220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.695 [2024-11-21 03:44:28.142349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.695 [2024-11-21 03:44:28.142373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.695 qpair failed and we were unable to recover it. 00:27:47.695 [2024-11-21 03:44:28.142501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.695 [2024-11-21 03:44:28.142641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.695 [2024-11-21 03:44:28.142666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.695 qpair failed and we were unable to recover it. 00:27:47.695 [2024-11-21 03:44:28.142796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.695 [2024-11-21 03:44:28.142893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.695 [2024-11-21 03:44:28.142918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.695 qpair failed and we were unable to recover it. 00:27:47.695 [2024-11-21 03:44:28.143051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.695 [2024-11-21 03:44:28.143169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.695 [2024-11-21 03:44:28.143195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.695 qpair failed and we were unable to recover it. 00:27:47.695 [2024-11-21 03:44:28.143294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.695 [2024-11-21 03:44:28.143396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.695 [2024-11-21 03:44:28.143422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.695 qpair failed and we were unable to recover it. 00:27:47.695 [2024-11-21 03:44:28.143521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.695 [2024-11-21 03:44:28.143622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.695 [2024-11-21 03:44:28.143647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.695 qpair failed and we were unable to recover it. 00:27:47.695 [2024-11-21 03:44:28.143770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.695 [2024-11-21 03:44:28.143872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.695 [2024-11-21 03:44:28.143896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.695 qpair failed and we were unable to recover it. 00:27:47.695 [2024-11-21 03:44:28.143994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.695 [2024-11-21 03:44:28.144093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.695 [2024-11-21 03:44:28.144124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.695 qpair failed and we were unable to recover it. 00:27:47.695 [2024-11-21 03:44:28.144226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.695 [2024-11-21 03:44:28.144350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.695 [2024-11-21 03:44:28.144375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.695 qpair failed and we were unable to recover it. 00:27:47.695 [2024-11-21 03:44:28.144480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.695 [2024-11-21 03:44:28.144573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.695 [2024-11-21 03:44:28.144597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.695 qpair failed and we were unable to recover it. 00:27:47.695 [2024-11-21 03:44:28.144695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.695 [2024-11-21 03:44:28.144787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.695 [2024-11-21 03:44:28.144812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.695 qpair failed and we were unable to recover it. 00:27:47.695 [2024-11-21 03:44:28.144940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.695 [2024-11-21 03:44:28.145040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.695 [2024-11-21 03:44:28.145065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.695 qpair failed and we were unable to recover it. 00:27:47.695 [2024-11-21 03:44:28.145182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.695 [2024-11-21 03:44:28.145337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.695 [2024-11-21 03:44:28.145362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.695 qpair failed and we were unable to recover it. 00:27:47.695 [2024-11-21 03:44:28.145489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.695 [2024-11-21 03:44:28.145585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.695 [2024-11-21 03:44:28.145610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.695 qpair failed and we were unable to recover it. 00:27:47.695 [2024-11-21 03:44:28.145719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.695 [2024-11-21 03:44:28.145839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.695 [2024-11-21 03:44:28.145864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.695 qpair failed and we were unable to recover it. 00:27:47.695 [2024-11-21 03:44:28.146005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.695 [2024-11-21 03:44:28.146110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.695 [2024-11-21 03:44:28.146140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.695 qpair failed and we were unable to recover it. 00:27:47.695 [2024-11-21 03:44:28.146275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.695 [2024-11-21 03:44:28.146407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.695 [2024-11-21 03:44:28.146432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.696 qpair failed and we were unable to recover it. 00:27:47.696 [2024-11-21 03:44:28.146536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.696 [2024-11-21 03:44:28.146658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.696 [2024-11-21 03:44:28.146683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.696 qpair failed and we were unable to recover it. 00:27:47.696 [2024-11-21 03:44:28.146784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.696 [2024-11-21 03:44:28.146879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.696 [2024-11-21 03:44:28.146904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.696 qpair failed and we were unable to recover it. 00:27:47.696 [2024-11-21 03:44:28.147045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.696 [2024-11-21 03:44:28.147158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.696 [2024-11-21 03:44:28.147184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.696 qpair failed and we were unable to recover it. 00:27:47.696 [2024-11-21 03:44:28.147274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.696 [2024-11-21 03:44:28.147407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.696 [2024-11-21 03:44:28.147432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.696 qpair failed and we were unable to recover it. 00:27:47.696 [2024-11-21 03:44:28.147536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.696 [2024-11-21 03:44:28.147658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.696 [2024-11-21 03:44:28.147683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.696 qpair failed and we were unable to recover it. 00:27:47.696 [2024-11-21 03:44:28.147836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.696 [2024-11-21 03:44:28.147932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.696 [2024-11-21 03:44:28.147957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.696 qpair failed and we were unable to recover it. 00:27:47.696 [2024-11-21 03:44:28.148053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.696 [2024-11-21 03:44:28.148162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.696 [2024-11-21 03:44:28.148188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.696 qpair failed and we were unable to recover it. 00:27:47.696 [2024-11-21 03:44:28.148314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.696 [2024-11-21 03:44:28.148423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.696 [2024-11-21 03:44:28.148454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.696 qpair failed and we were unable to recover it. 00:27:47.696 [2024-11-21 03:44:28.148613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.696 [2024-11-21 03:44:28.148717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.696 [2024-11-21 03:44:28.148743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.696 qpair failed and we were unable to recover it. 00:27:47.696 [2024-11-21 03:44:28.148869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.696 [2024-11-21 03:44:28.149009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.696 [2024-11-21 03:44:28.149034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.696 qpair failed and we were unable to recover it. 00:27:47.696 [2024-11-21 03:44:28.149171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.696 [2024-11-21 03:44:28.149284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.696 [2024-11-21 03:44:28.149310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.696 qpair failed and we were unable to recover it. 00:27:47.696 [2024-11-21 03:44:28.149406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.696 [2024-11-21 03:44:28.149501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.696 [2024-11-21 03:44:28.149526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.696 qpair failed and we were unable to recover it. 00:27:47.696 [2024-11-21 03:44:28.149630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.696 [2024-11-21 03:44:28.149786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.696 [2024-11-21 03:44:28.149811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.696 qpair failed and we were unable to recover it. 00:27:47.696 [2024-11-21 03:44:28.149906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.696 [2024-11-21 03:44:28.150006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.696 [2024-11-21 03:44:28.150031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.696 qpair failed and we were unable to recover it. 00:27:47.696 [2024-11-21 03:44:28.150168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.696 [2024-11-21 03:44:28.150273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.696 [2024-11-21 03:44:28.150298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.696 qpair failed and we were unable to recover it. 00:27:47.696 [2024-11-21 03:44:28.150429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.696 [2024-11-21 03:44:28.150531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.696 [2024-11-21 03:44:28.150557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.696 qpair failed and we were unable to recover it. 00:27:47.696 [2024-11-21 03:44:28.150766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.696 [2024-11-21 03:44:28.150865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.696 [2024-11-21 03:44:28.150890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.696 qpair failed and we were unable to recover it. 00:27:47.696 [2024-11-21 03:44:28.151096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.696 [2024-11-21 03:44:28.151299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.696 [2024-11-21 03:44:28.151325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.696 qpair failed and we were unable to recover it. 00:27:47.696 [2024-11-21 03:44:28.151432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.696 [2024-11-21 03:44:28.151573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.696 [2024-11-21 03:44:28.151598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.696 qpair failed and we were unable to recover it. 00:27:47.696 [2024-11-21 03:44:28.151771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.696 [2024-11-21 03:44:28.151877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.696 [2024-11-21 03:44:28.151902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.696 qpair failed and we were unable to recover it. 00:27:47.696 [2024-11-21 03:44:28.152002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.696 [2024-11-21 03:44:28.152124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.696 [2024-11-21 03:44:28.152149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.696 qpair failed and we were unable to recover it. 00:27:47.696 [2024-11-21 03:44:28.152281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.696 [2024-11-21 03:44:28.152386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.696 [2024-11-21 03:44:28.152411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.696 qpair failed and we were unable to recover it. 00:27:47.696 [2024-11-21 03:44:28.152540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.696 [2024-11-21 03:44:28.152649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.696 [2024-11-21 03:44:28.152674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.696 qpair failed and we were unable to recover it. 00:27:47.697 [2024-11-21 03:44:28.152798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.697 [2024-11-21 03:44:28.152903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.697 [2024-11-21 03:44:28.152928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.697 qpair failed and we were unable to recover it. 00:27:47.697 [2024-11-21 03:44:28.153034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.697 [2024-11-21 03:44:28.153167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.697 [2024-11-21 03:44:28.153193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.697 qpair failed and we were unable to recover it. 00:27:47.697 [2024-11-21 03:44:28.153285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.697 [2024-11-21 03:44:28.153491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.697 [2024-11-21 03:44:28.153516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.697 qpair failed and we were unable to recover it. 00:27:47.697 [2024-11-21 03:44:28.153621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.697 [2024-11-21 03:44:28.153743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.697 [2024-11-21 03:44:28.153768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.697 qpair failed and we were unable to recover it. 00:27:47.697 [2024-11-21 03:44:28.153872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.697 [2024-11-21 03:44:28.153962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.697 [2024-11-21 03:44:28.153987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.697 qpair failed and we were unable to recover it. 00:27:47.697 [2024-11-21 03:44:28.154122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.697 [2024-11-21 03:44:28.154244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.697 [2024-11-21 03:44:28.154269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.697 qpair failed and we were unable to recover it. 00:27:47.697 [2024-11-21 03:44:28.154405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.697 [2024-11-21 03:44:28.154507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.697 [2024-11-21 03:44:28.154532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.697 qpair failed and we were unable to recover it. 00:27:47.697 [2024-11-21 03:44:28.154645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.697 [2024-11-21 03:44:28.154777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.697 [2024-11-21 03:44:28.154802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.697 qpair failed and we were unable to recover it. 00:27:47.697 [2024-11-21 03:44:28.154934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.697 [2024-11-21 03:44:28.155034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.697 [2024-11-21 03:44:28.155059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.697 qpair failed and we were unable to recover it. 00:27:47.697 [2024-11-21 03:44:28.155179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.697 [2024-11-21 03:44:28.155280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.697 [2024-11-21 03:44:28.155306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.697 qpair failed and we were unable to recover it. 00:27:47.697 [2024-11-21 03:44:28.155435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.697 [2024-11-21 03:44:28.155526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.697 [2024-11-21 03:44:28.155552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.697 qpair failed and we were unable to recover it. 00:27:47.697 [2024-11-21 03:44:28.155657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.697 [2024-11-21 03:44:28.155755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.697 [2024-11-21 03:44:28.155782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.697 qpair failed and we were unable to recover it. 00:27:47.697 [2024-11-21 03:44:28.155886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.697 [2024-11-21 03:44:28.155991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.697 [2024-11-21 03:44:28.156016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.697 qpair failed and we were unable to recover it. 00:27:47.697 [2024-11-21 03:44:28.156121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.697 [2024-11-21 03:44:28.156219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.697 [2024-11-21 03:44:28.156248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.697 qpair failed and we were unable to recover it. 00:27:47.697 [2024-11-21 03:44:28.156353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.697 [2024-11-21 03:44:28.156475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.697 [2024-11-21 03:44:28.156501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.697 qpair failed and we were unable to recover it. 00:27:47.697 [2024-11-21 03:44:28.156595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.697 [2024-11-21 03:44:28.156693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.697 [2024-11-21 03:44:28.156718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.697 qpair failed and we were unable to recover it. 00:27:47.697 [2024-11-21 03:44:28.156874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.697 [2024-11-21 03:44:28.157030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.697 [2024-11-21 03:44:28.157056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.697 qpair failed and we were unable to recover it. 00:27:47.697 [2024-11-21 03:44:28.157180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.697 [2024-11-21 03:44:28.157282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.697 [2024-11-21 03:44:28.157307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.697 qpair failed and we were unable to recover it. 00:27:47.697 [2024-11-21 03:44:28.157419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.697 [2024-11-21 03:44:28.157519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.697 [2024-11-21 03:44:28.157544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.697 qpair failed and we were unable to recover it. 00:27:47.697 [2024-11-21 03:44:28.157646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.697 [2024-11-21 03:44:28.157852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.697 [2024-11-21 03:44:28.157884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.697 qpair failed and we were unable to recover it. 00:27:47.697 [2024-11-21 03:44:28.158008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.697 [2024-11-21 03:44:28.158134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.697 [2024-11-21 03:44:28.158160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.697 qpair failed and we were unable to recover it. 00:27:47.697 [2024-11-21 03:44:28.158253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.697 [2024-11-21 03:44:28.158350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.697 [2024-11-21 03:44:28.158375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.697 qpair failed and we were unable to recover it. 00:27:47.697 [2024-11-21 03:44:28.158467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.697 [2024-11-21 03:44:28.158570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.697 [2024-11-21 03:44:28.158596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.697 qpair failed and we were unable to recover it. 00:27:47.697 [2024-11-21 03:44:28.158702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.697 [2024-11-21 03:44:28.158827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.697 [2024-11-21 03:44:28.158852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.697 qpair failed and we were unable to recover it. 00:27:47.697 [2024-11-21 03:44:28.158952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.697 [2024-11-21 03:44:28.159079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.698 [2024-11-21 03:44:28.159105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.698 qpair failed and we were unable to recover it. 00:27:47.698 [2024-11-21 03:44:28.159202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.698 [2024-11-21 03:44:28.159300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.698 [2024-11-21 03:44:28.159325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.698 qpair failed and we were unable to recover it. 00:27:47.698 [2024-11-21 03:44:28.159423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.698 [2024-11-21 03:44:28.159519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.698 [2024-11-21 03:44:28.159549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.698 qpair failed and we were unable to recover it. 00:27:47.698 [2024-11-21 03:44:28.159658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.698 [2024-11-21 03:44:28.159813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.698 [2024-11-21 03:44:28.159839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.698 qpair failed and we were unable to recover it. 00:27:47.698 [2024-11-21 03:44:28.159938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.698 [2024-11-21 03:44:28.160092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.698 [2024-11-21 03:44:28.160127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.698 qpair failed and we were unable to recover it. 00:27:47.698 [2024-11-21 03:44:28.160229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.698 [2024-11-21 03:44:28.160329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.698 [2024-11-21 03:44:28.160354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.698 qpair failed and we were unable to recover it. 00:27:47.698 [2024-11-21 03:44:28.160483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.698 [2024-11-21 03:44:28.160606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.698 [2024-11-21 03:44:28.160631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.698 qpair failed and we were unable to recover it. 00:27:47.698 [2024-11-21 03:44:28.160735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.698 [2024-11-21 03:44:28.160828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.698 [2024-11-21 03:44:28.160853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.698 qpair failed and we were unable to recover it. 00:27:47.698 [2024-11-21 03:44:28.160943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.698 [2024-11-21 03:44:28.161096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.698 [2024-11-21 03:44:28.161129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.698 qpair failed and we were unable to recover it. 00:27:47.698 [2024-11-21 03:44:28.161233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.698 [2024-11-21 03:44:28.161329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.698 [2024-11-21 03:44:28.161354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.698 qpair failed and we were unable to recover it. 00:27:47.698 [2024-11-21 03:44:28.161559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.698 [2024-11-21 03:44:28.161687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.698 [2024-11-21 03:44:28.161714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.698 qpair failed and we were unable to recover it. 00:27:47.698 [2024-11-21 03:44:28.161846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.698 [2024-11-21 03:44:28.161940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.698 [2024-11-21 03:44:28.161965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.698 qpair failed and we were unable to recover it. 00:27:47.698 [2024-11-21 03:44:28.162065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.698 [2024-11-21 03:44:28.162170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.698 [2024-11-21 03:44:28.162196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.698 qpair failed and we were unable to recover it. 00:27:47.698 [2024-11-21 03:44:28.162302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.698 [2024-11-21 03:44:28.162403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.698 [2024-11-21 03:44:28.162428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.698 qpair failed and we were unable to recover it. 00:27:47.698 [2024-11-21 03:44:28.162556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.698 [2024-11-21 03:44:28.162663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.698 [2024-11-21 03:44:28.162689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.698 qpair failed and we were unable to recover it. 00:27:47.698 [2024-11-21 03:44:28.162818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.698 [2024-11-21 03:44:28.162914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.698 [2024-11-21 03:44:28.162939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.698 qpair failed and we were unable to recover it. 00:27:47.698 [2024-11-21 03:44:28.163040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.698 [2024-11-21 03:44:28.163166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.698 [2024-11-21 03:44:28.163191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.698 qpair failed and we were unable to recover it. 00:27:47.698 [2024-11-21 03:44:28.163317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.698 [2024-11-21 03:44:28.163448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.698 [2024-11-21 03:44:28.163473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.698 qpair failed and we were unable to recover it. 00:27:47.698 [2024-11-21 03:44:28.163606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.698 [2024-11-21 03:44:28.163725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.698 [2024-11-21 03:44:28.163750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.698 qpair failed and we were unable to recover it. 00:27:47.698 [2024-11-21 03:44:28.163846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.698 [2024-11-21 03:44:28.163979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.698 [2024-11-21 03:44:28.164004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.698 qpair failed and we were unable to recover it. 00:27:47.698 [2024-11-21 03:44:28.164102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.698 [2024-11-21 03:44:28.164207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.698 [2024-11-21 03:44:28.164234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.698 qpair failed and we were unable to recover it. 00:27:47.698 [2024-11-21 03:44:28.164335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.698 [2024-11-21 03:44:28.164440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.698 [2024-11-21 03:44:28.164465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.698 qpair failed and we were unable to recover it. 00:27:47.698 [2024-11-21 03:44:28.164590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.698 [2024-11-21 03:44:28.164687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.698 [2024-11-21 03:44:28.164712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.698 qpair failed and we were unable to recover it. 00:27:47.698 [2024-11-21 03:44:28.164844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.698 [2024-11-21 03:44:28.165056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.698 [2024-11-21 03:44:28.165086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.698 qpair failed and we were unable to recover it. 00:27:47.698 [2024-11-21 03:44:28.165185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.699 [2024-11-21 03:44:28.165280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.699 [2024-11-21 03:44:28.165305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.699 qpair failed and we were unable to recover it. 00:27:47.699 [2024-11-21 03:44:28.165440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.699 [2024-11-21 03:44:28.165560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.699 [2024-11-21 03:44:28.165586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.699 qpair failed and we were unable to recover it. 00:27:47.699 [2024-11-21 03:44:28.165714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.699 [2024-11-21 03:44:28.165842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.699 [2024-11-21 03:44:28.165869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.699 qpair failed and we were unable to recover it. 00:27:47.699 [2024-11-21 03:44:28.165970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.699 [2024-11-21 03:44:28.166090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.699 [2024-11-21 03:44:28.166125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.699 qpair failed and we were unable to recover it. 00:27:47.699 [2024-11-21 03:44:28.166227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.699 [2024-11-21 03:44:28.166327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.699 [2024-11-21 03:44:28.166352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.699 qpair failed and we were unable to recover it. 00:27:47.699 [2024-11-21 03:44:28.166484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.699 [2024-11-21 03:44:28.166608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.699 [2024-11-21 03:44:28.166633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.699 qpair failed and we were unable to recover it. 00:27:47.699 [2024-11-21 03:44:28.166729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.699 [2024-11-21 03:44:28.166851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.699 [2024-11-21 03:44:28.166876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.699 qpair failed and we were unable to recover it. 00:27:47.699 [2024-11-21 03:44:28.166979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.699 [2024-11-21 03:44:28.167082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.699 [2024-11-21 03:44:28.167110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.699 qpair failed and we were unable to recover it. 00:27:47.699 [2024-11-21 03:44:28.167212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.699 [2024-11-21 03:44:28.167335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.699 [2024-11-21 03:44:28.167360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2462cb0 with addr=10.0.0.2, port=4420 00:27:47.699 qpair failed and we were unable to recover it. 00:27:47.699 [2024-11-21 03:44:28.167537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.699 [2024-11-21 03:44:28.167687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.699 [2024-11-21 03:44:28.167716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.699 qpair failed and we were unable to recover it. 00:27:47.699 [2024-11-21 03:44:28.167853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.699 [2024-11-21 03:44:28.167960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.699 [2024-11-21 03:44:28.167986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.699 qpair failed and we were unable to recover it. 00:27:47.699 [2024-11-21 03:44:28.168089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.699 [2024-11-21 03:44:28.168194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.699 [2024-11-21 03:44:28.168221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.699 qpair failed and we were unable to recover it. 00:27:47.699 [2024-11-21 03:44:28.168348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.699 [2024-11-21 03:44:28.168481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.699 [2024-11-21 03:44:28.168507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.699 qpair failed and we were unable to recover it. 00:27:47.699 [2024-11-21 03:44:28.168668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.699 [2024-11-21 03:44:28.168801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.699 [2024-11-21 03:44:28.168828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.699 qpair failed and we were unable to recover it. 00:27:47.699 [2024-11-21 03:44:28.168957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.699 [2024-11-21 03:44:28.169058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.699 [2024-11-21 03:44:28.169098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.699 qpair failed and we were unable to recover it. 00:27:47.699 [2024-11-21 03:44:28.169209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.699 [2024-11-21 03:44:28.169316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.699 [2024-11-21 03:44:28.169352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.699 qpair failed and we were unable to recover it. 00:27:47.699 [2024-11-21 03:44:28.169474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.699 [2024-11-21 03:44:28.169582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.699 [2024-11-21 03:44:28.169608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.699 qpair failed and we were unable to recover it. 00:27:47.699 [2024-11-21 03:44:28.169737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.699 [2024-11-21 03:44:28.169836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.699 [2024-11-21 03:44:28.169863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.699 qpair failed and we were unable to recover it. 00:27:47.699 [2024-11-21 03:44:28.169999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.699 [2024-11-21 03:44:28.170097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.699 [2024-11-21 03:44:28.170124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.699 qpair failed and we were unable to recover it. 00:27:47.699 [2024-11-21 03:44:28.170271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.699 [2024-11-21 03:44:28.170416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.699 [2024-11-21 03:44:28.170441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.699 qpair failed and we were unable to recover it. 00:27:47.699 [2024-11-21 03:44:28.170572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.699 [2024-11-21 03:44:28.170714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.699 [2024-11-21 03:44:28.170739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.699 qpair failed and we were unable to recover it. 00:27:47.699 [2024-11-21 03:44:28.170843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.699 [2024-11-21 03:44:28.170947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.699 [2024-11-21 03:44:28.170972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.699 qpair failed and we were unable to recover it. 00:27:47.699 [2024-11-21 03:44:28.171099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.699 [2024-11-21 03:44:28.171198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.699 [2024-11-21 03:44:28.171223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.699 qpair failed and we were unable to recover it. 00:27:47.700 [2024-11-21 03:44:28.171318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.700 [2024-11-21 03:44:28.171420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.700 [2024-11-21 03:44:28.171445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.700 qpair failed and we were unable to recover it. 00:27:47.700 [2024-11-21 03:44:28.171574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.700 [2024-11-21 03:44:28.171700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.700 [2024-11-21 03:44:28.171726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.700 qpair failed and we were unable to recover it. 00:27:47.700 [2024-11-21 03:44:28.171826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.700 [2024-11-21 03:44:28.171921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.700 [2024-11-21 03:44:28.171948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.700 qpair failed and we were unable to recover it. 00:27:47.700 [2024-11-21 03:44:28.172051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.700 [2024-11-21 03:44:28.172197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.700 [2024-11-21 03:44:28.172224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.700 qpair failed and we were unable to recover it. 00:27:47.700 [2024-11-21 03:44:28.172371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.700 [2024-11-21 03:44:28.172463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.700 [2024-11-21 03:44:28.172489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.700 qpair failed and we were unable to recover it. 00:27:47.700 [2024-11-21 03:44:28.172592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.700 [2024-11-21 03:44:28.172685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.700 [2024-11-21 03:44:28.172711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.700 qpair failed and we were unable to recover it. 00:27:47.700 [2024-11-21 03:44:28.172842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.700 [2024-11-21 03:44:28.172949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.700 [2024-11-21 03:44:28.172975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.700 qpair failed and we were unable to recover it. 00:27:47.700 [2024-11-21 03:44:28.173106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.700 [2024-11-21 03:44:28.173235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.700 [2024-11-21 03:44:28.173262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.700 qpair failed and we were unable to recover it. 00:27:47.700 [2024-11-21 03:44:28.173377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.700 [2024-11-21 03:44:28.173505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.700 [2024-11-21 03:44:28.173530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.700 qpair failed and we were unable to recover it. 00:27:47.700 [2024-11-21 03:44:28.173662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.700 [2024-11-21 03:44:28.173758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.700 [2024-11-21 03:44:28.173784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.700 qpair failed and we were unable to recover it. 00:27:47.700 [2024-11-21 03:44:28.173912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.700 [2024-11-21 03:44:28.174038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.700 [2024-11-21 03:44:28.174064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.700 qpair failed and we were unable to recover it. 00:27:47.700 [2024-11-21 03:44:28.174209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.700 [2024-11-21 03:44:28.174311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.700 [2024-11-21 03:44:28.174339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.700 qpair failed and we were unable to recover it. 00:27:47.700 [2024-11-21 03:44:28.174471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.700 [2024-11-21 03:44:28.174571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.700 [2024-11-21 03:44:28.174597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.700 qpair failed and we were unable to recover it. 00:27:47.700 [2024-11-21 03:44:28.174694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.700 [2024-11-21 03:44:28.174821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.700 [2024-11-21 03:44:28.174846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.700 qpair failed and we were unable to recover it. 00:27:47.700 [2024-11-21 03:44:28.174946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.700 [2024-11-21 03:44:28.175047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.700 [2024-11-21 03:44:28.175078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.700 qpair failed and we were unable to recover it. 00:27:47.700 [2024-11-21 03:44:28.175196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.700 [2024-11-21 03:44:28.175317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.700 [2024-11-21 03:44:28.175350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.700 qpair failed and we were unable to recover it. 00:27:47.700 [2024-11-21 03:44:28.175473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.700 [2024-11-21 03:44:28.175584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.700 [2024-11-21 03:44:28.175610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.700 qpair failed and we were unable to recover it. 00:27:47.700 [2024-11-21 03:44:28.175726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.700 [2024-11-21 03:44:28.175825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.700 [2024-11-21 03:44:28.175851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.700 qpair failed and we were unable to recover it. 00:27:47.700 [2024-11-21 03:44:28.175985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.700 [2024-11-21 03:44:28.176117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.700 [2024-11-21 03:44:28.176143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.700 qpair failed and we were unable to recover it. 00:27:47.700 [2024-11-21 03:44:28.176241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.700 [2024-11-21 03:44:28.176378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.700 [2024-11-21 03:44:28.176404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.700 qpair failed and we were unable to recover it. 00:27:47.700 [2024-11-21 03:44:28.176505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.700 [2024-11-21 03:44:28.176611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.701 [2024-11-21 03:44:28.176637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.701 qpair failed and we were unable to recover it. 00:27:47.701 [2024-11-21 03:44:28.176735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.701 [2024-11-21 03:44:28.176861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.701 [2024-11-21 03:44:28.176888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.701 qpair failed and we were unable to recover it. 00:27:47.701 [2024-11-21 03:44:28.177022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.701 [2024-11-21 03:44:28.177131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.701 [2024-11-21 03:44:28.177157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.701 qpair failed and we were unable to recover it. 00:27:47.701 [2024-11-21 03:44:28.177260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.701 [2024-11-21 03:44:28.177391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.701 [2024-11-21 03:44:28.177416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.701 qpair failed and we were unable to recover it. 00:27:47.701 [2024-11-21 03:44:28.177513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.701 [2024-11-21 03:44:28.177644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.701 [2024-11-21 03:44:28.177669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.701 qpair failed and we were unable to recover it. 00:27:47.701 [2024-11-21 03:44:28.177802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.701 [2024-11-21 03:44:28.177900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.701 [2024-11-21 03:44:28.177925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.701 qpair failed and we were unable to recover it. 00:27:47.701 [2024-11-21 03:44:28.178018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.701 [2024-11-21 03:44:28.178155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.701 [2024-11-21 03:44:28.178183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.701 qpair failed and we were unable to recover it. 00:27:47.701 [2024-11-21 03:44:28.178283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.701 [2024-11-21 03:44:28.178384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.701 [2024-11-21 03:44:28.178411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.701 qpair failed and we were unable to recover it. 00:27:47.701 [2024-11-21 03:44:28.178564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.701 [2024-11-21 03:44:28.178661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.701 [2024-11-21 03:44:28.178686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.701 qpair failed and we were unable to recover it. 00:27:47.701 [2024-11-21 03:44:28.178782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.701 [2024-11-21 03:44:28.178908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.701 [2024-11-21 03:44:28.178935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.701 qpair failed and we were unable to recover it. 00:27:47.701 [2024-11-21 03:44:28.179041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.701 [2024-11-21 03:44:28.179146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.701 [2024-11-21 03:44:28.179172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.701 qpair failed and we were unable to recover it. 00:27:47.701 [2024-11-21 03:44:28.179280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.701 [2024-11-21 03:44:28.179407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.701 [2024-11-21 03:44:28.179433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.701 qpair failed and we were unable to recover it. 00:27:47.701 [2024-11-21 03:44:28.179558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.701 [2024-11-21 03:44:28.179653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.701 [2024-11-21 03:44:28.179678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.701 qpair failed and we were unable to recover it. 00:27:47.701 [2024-11-21 03:44:28.179815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.701 [2024-11-21 03:44:28.179907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.701 [2024-11-21 03:44:28.179933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.701 qpair failed and we were unable to recover it. 00:27:47.701 [2024-11-21 03:44:28.180064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.701 [2024-11-21 03:44:28.180188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.701 [2024-11-21 03:44:28.180213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.701 qpair failed and we were unable to recover it. 00:27:47.701 [2024-11-21 03:44:28.180376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.701 [2024-11-21 03:44:28.180505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.701 [2024-11-21 03:44:28.180530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.701 qpair failed and we were unable to recover it. 00:27:47.701 [2024-11-21 03:44:28.180632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.701 [2024-11-21 03:44:28.180732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.701 [2024-11-21 03:44:28.180762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.701 qpair failed and we were unable to recover it. 00:27:47.701 [2024-11-21 03:44:28.180865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.701 [2024-11-21 03:44:28.180963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.701 [2024-11-21 03:44:28.180989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.701 qpair failed and we were unable to recover it. 00:27:47.701 [2024-11-21 03:44:28.181092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.701 [2024-11-21 03:44:28.181203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.701 [2024-11-21 03:44:28.181229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.701 qpair failed and we were unable to recover it. 00:27:47.701 [2024-11-21 03:44:28.181362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.701 [2024-11-21 03:44:28.181460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.701 [2024-11-21 03:44:28.181486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.701 qpair failed and we were unable to recover it. 00:27:47.701 [2024-11-21 03:44:28.181593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.701 [2024-11-21 03:44:28.181719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.701 [2024-11-21 03:44:28.181746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.701 qpair failed and we were unable to recover it. 00:27:47.701 [2024-11-21 03:44:28.181881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.701 [2024-11-21 03:44:28.181987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.701 [2024-11-21 03:44:28.182013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.701 qpair failed and we were unable to recover it. 00:27:47.701 [2024-11-21 03:44:28.182113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.701 [2024-11-21 03:44:28.182268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.701 [2024-11-21 03:44:28.182294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.701 qpair failed and we were unable to recover it. 00:27:47.701 [2024-11-21 03:44:28.182429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.701 [2024-11-21 03:44:28.182532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.701 [2024-11-21 03:44:28.182558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.701 qpair failed and we were unable to recover it. 00:27:47.701 [2024-11-21 03:44:28.182681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.701 [2024-11-21 03:44:28.182787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.701 [2024-11-21 03:44:28.182813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.701 qpair failed and we were unable to recover it. 00:27:47.701 [2024-11-21 03:44:28.182925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.702 [2024-11-21 03:44:28.183029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.702 [2024-11-21 03:44:28.183055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.702 qpair failed and we were unable to recover it. 00:27:47.702 [2024-11-21 03:44:28.183174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.702 [2024-11-21 03:44:28.183277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.702 [2024-11-21 03:44:28.183308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.702 qpair failed and we were unable to recover it. 00:27:47.702 [2024-11-21 03:44:28.183417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.702 [2024-11-21 03:44:28.183573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.702 [2024-11-21 03:44:28.183597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.702 qpair failed and we were unable to recover it. 00:27:47.702 [2024-11-21 03:44:28.183725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.702 [2024-11-21 03:44:28.183824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.702 [2024-11-21 03:44:28.183849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.702 qpair failed and we were unable to recover it. 00:27:47.702 [2024-11-21 03:44:28.183958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.702 [2024-11-21 03:44:28.184052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.702 [2024-11-21 03:44:28.184102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.702 qpair failed and we were unable to recover it. 00:27:47.702 [2024-11-21 03:44:28.184208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.702 [2024-11-21 03:44:28.184305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.702 [2024-11-21 03:44:28.184330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.702 qpair failed and we were unable to recover it. 00:27:47.702 [2024-11-21 03:44:28.184464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.702 [2024-11-21 03:44:28.184558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.702 [2024-11-21 03:44:28.184582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.702 qpair failed and we were unable to recover it. 00:27:47.702 [2024-11-21 03:44:28.184679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.702 [2024-11-21 03:44:28.184802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.702 [2024-11-21 03:44:28.184827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.702 qpair failed and we were unable to recover it. 00:27:47.702 [2024-11-21 03:44:28.184953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.702 [2024-11-21 03:44:28.185043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.702 [2024-11-21 03:44:28.185077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.702 qpair failed and we were unable to recover it. 00:27:47.702 [2024-11-21 03:44:28.185204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.702 [2024-11-21 03:44:28.185306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.702 [2024-11-21 03:44:28.185331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.702 qpair failed and we were unable to recover it. 00:27:47.702 [2024-11-21 03:44:28.185429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.702 [2024-11-21 03:44:28.185551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.702 [2024-11-21 03:44:28.185575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.702 qpair failed and we were unable to recover it. 00:27:47.702 [2024-11-21 03:44:28.185703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.702 [2024-11-21 03:44:28.185832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.702 [2024-11-21 03:44:28.185861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.702 qpair failed and we were unable to recover it. 00:27:47.702 [2024-11-21 03:44:28.185967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.702 [2024-11-21 03:44:28.186088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.702 [2024-11-21 03:44:28.186118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.702 qpair failed and we were unable to recover it. 00:27:47.702 [2024-11-21 03:44:28.186227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.702 [2024-11-21 03:44:28.186361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.702 [2024-11-21 03:44:28.186386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.702 qpair failed and we were unable to recover it. 00:27:47.702 [2024-11-21 03:44:28.186523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.702 [2024-11-21 03:44:28.186623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.702 [2024-11-21 03:44:28.186649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.702 qpair failed and we were unable to recover it. 00:27:47.702 [2024-11-21 03:44:28.186748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.702 [2024-11-21 03:44:28.186847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.702 [2024-11-21 03:44:28.186872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.702 qpair failed and we were unable to recover it. 00:27:47.702 [2024-11-21 03:44:28.186993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.702 [2024-11-21 03:44:28.187099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.702 [2024-11-21 03:44:28.187125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.702 qpair failed and we were unable to recover it. 00:27:47.702 [2024-11-21 03:44:28.187256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.702 [2024-11-21 03:44:28.187352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.702 [2024-11-21 03:44:28.187377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.702 qpair failed and we were unable to recover it. 00:27:47.702 [2024-11-21 03:44:28.187485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.702 [2024-11-21 03:44:28.187611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.702 [2024-11-21 03:44:28.187636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.702 qpair failed and we were unable to recover it. 00:27:47.702 [2024-11-21 03:44:28.187732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.702 [2024-11-21 03:44:28.187830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.702 [2024-11-21 03:44:28.187854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.702 qpair failed and we were unable to recover it. 00:27:47.702 [2024-11-21 03:44:28.187959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.702 [2024-11-21 03:44:28.188060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.702 [2024-11-21 03:44:28.188092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.702 qpair failed and we were unable to recover it. 00:27:47.702 [2024-11-21 03:44:28.188197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.702 [2024-11-21 03:44:28.188286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.702 [2024-11-21 03:44:28.188316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.702 qpair failed and we were unable to recover it. 00:27:47.702 [2024-11-21 03:44:28.188445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.702 [2024-11-21 03:44:28.188546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.702 [2024-11-21 03:44:28.188573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.702 qpair failed and we were unable to recover it. 00:27:47.702 [2024-11-21 03:44:28.188707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.702 [2024-11-21 03:44:28.188836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.702 [2024-11-21 03:44:28.188863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.702 qpair failed and we were unable to recover it. 00:27:47.702 [2024-11-21 03:44:28.188959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.702 [2024-11-21 03:44:28.189082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.702 [2024-11-21 03:44:28.189109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.702 qpair failed and we were unable to recover it. 00:27:47.702 [2024-11-21 03:44:28.189236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.703 [2024-11-21 03:44:28.189340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.703 [2024-11-21 03:44:28.189365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.703 qpair failed and we were unable to recover it. 00:27:47.703 [2024-11-21 03:44:28.189526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.703 [2024-11-21 03:44:28.189623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.703 [2024-11-21 03:44:28.189648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.703 qpair failed and we were unable to recover it. 00:27:47.703 [2024-11-21 03:44:28.189752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.703 [2024-11-21 03:44:28.189856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.703 [2024-11-21 03:44:28.189882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.703 qpair failed and we were unable to recover it. 00:27:47.703 [2024-11-21 03:44:28.190036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.703 [2024-11-21 03:44:28.190170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.703 [2024-11-21 03:44:28.190195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.703 qpair failed and we were unable to recover it. 00:27:47.703 [2024-11-21 03:44:28.190318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.703 [2024-11-21 03:44:28.190455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.703 [2024-11-21 03:44:28.190481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.703 qpair failed and we were unable to recover it. 00:27:47.703 [2024-11-21 03:44:28.190587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.703 [2024-11-21 03:44:28.190692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.703 [2024-11-21 03:44:28.190716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.703 qpair failed and we were unable to recover it. 00:27:47.703 [2024-11-21 03:44:28.190814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.703 [2024-11-21 03:44:28.190922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.703 [2024-11-21 03:44:28.190946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.703 qpair failed and we were unable to recover it. 00:27:47.703 [2024-11-21 03:44:28.191060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.703 [2024-11-21 03:44:28.191169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.703 [2024-11-21 03:44:28.191194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.703 qpair failed and we were unable to recover it. 00:27:47.703 [2024-11-21 03:44:28.191288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.703 [2024-11-21 03:44:28.191386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.703 [2024-11-21 03:44:28.191411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.703 qpair failed and we were unable to recover it. 00:27:47.703 [2024-11-21 03:44:28.191506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.703 [2024-11-21 03:44:28.191609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.703 [2024-11-21 03:44:28.191635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.703 qpair failed and we were unable to recover it. 00:27:47.703 [2024-11-21 03:44:28.191764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.703 [2024-11-21 03:44:28.191888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.703 [2024-11-21 03:44:28.191913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.703 qpair failed and we were unable to recover it. 00:27:47.703 [2024-11-21 03:44:28.192016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.703 [2024-11-21 03:44:28.192120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.703 [2024-11-21 03:44:28.192146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.703 qpair failed and we were unable to recover it. 00:27:47.703 [2024-11-21 03:44:28.192292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.703 [2024-11-21 03:44:28.192399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.703 [2024-11-21 03:44:28.192424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.703 qpair failed and we were unable to recover it. 00:27:47.703 [2024-11-21 03:44:28.192549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.703 [2024-11-21 03:44:28.192650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.703 [2024-11-21 03:44:28.192675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.703 qpair failed and we were unable to recover it. 00:27:47.703 [2024-11-21 03:44:28.192773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.703 [2024-11-21 03:44:28.192878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.703 [2024-11-21 03:44:28.192904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.703 qpair failed and we were unable to recover it. 00:27:47.703 [2024-11-21 03:44:28.193007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.703 [2024-11-21 03:44:28.193106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.703 [2024-11-21 03:44:28.193131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.703 qpair failed and we were unable to recover it. 00:27:47.703 [2024-11-21 03:44:28.193234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.703 [2024-11-21 03:44:28.193322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.703 [2024-11-21 03:44:28.193346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.703 qpair failed and we were unable to recover it. 00:27:47.703 [2024-11-21 03:44:28.193452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.703 [2024-11-21 03:44:28.193616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.703 [2024-11-21 03:44:28.193641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.703 qpair failed and we were unable to recover it. 00:27:47.703 [2024-11-21 03:44:28.193744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.703 [2024-11-21 03:44:28.193871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.703 [2024-11-21 03:44:28.193897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.703 qpair failed and we were unable to recover it. 00:27:47.703 [2024-11-21 03:44:28.193998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.703 [2024-11-21 03:44:28.194102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.703 [2024-11-21 03:44:28.194128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.703 qpair failed and we were unable to recover it. 00:27:47.703 [2024-11-21 03:44:28.194260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.703 [2024-11-21 03:44:28.194396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.703 [2024-11-21 03:44:28.194421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.703 qpair failed and we were unable to recover it. 00:27:47.703 [2024-11-21 03:44:28.194519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.703 [2024-11-21 03:44:28.194668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.703 [2024-11-21 03:44:28.194693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.703 qpair failed and we were unable to recover it. 00:27:47.703 [2024-11-21 03:44:28.194795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.703 [2024-11-21 03:44:28.194919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.703 [2024-11-21 03:44:28.194943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.703 qpair failed and we were unable to recover it. 00:27:47.703 [2024-11-21 03:44:28.195040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.703 [2024-11-21 03:44:28.195155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.703 [2024-11-21 03:44:28.195182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.703 qpair failed and we were unable to recover it. 00:27:47.703 [2024-11-21 03:44:28.195287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.703 [2024-11-21 03:44:28.195396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.703 [2024-11-21 03:44:28.195421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.703 qpair failed and we were unable to recover it. 00:27:47.703 [2024-11-21 03:44:28.195518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.703 [2024-11-21 03:44:28.195622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.704 [2024-11-21 03:44:28.195648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.704 qpair failed and we were unable to recover it. 00:27:47.704 [2024-11-21 03:44:28.195773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.704 [2024-11-21 03:44:28.195864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.704 [2024-11-21 03:44:28.195889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.704 qpair failed and we were unable to recover it. 00:27:47.704 [2024-11-21 03:44:28.195992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.704 [2024-11-21 03:44:28.196095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.704 [2024-11-21 03:44:28.196121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.704 qpair failed and we were unable to recover it. 00:27:47.704 [2024-11-21 03:44:28.196234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.704 [2024-11-21 03:44:28.196333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.704 [2024-11-21 03:44:28.196359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.704 qpair failed and we were unable to recover it. 00:27:47.704 [2024-11-21 03:44:28.196473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.704 [2024-11-21 03:44:28.196606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.704 [2024-11-21 03:44:28.196631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.704 qpair failed and we were unable to recover it. 00:27:47.704 [2024-11-21 03:44:28.196743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.704 [2024-11-21 03:44:28.196844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.704 [2024-11-21 03:44:28.196869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.704 qpair failed and we were unable to recover it. 00:27:47.704 [2024-11-21 03:44:28.196994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.704 [2024-11-21 03:44:28.197149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.704 [2024-11-21 03:44:28.197175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.704 qpair failed and we were unable to recover it. 00:27:47.704 [2024-11-21 03:44:28.197272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.704 [2024-11-21 03:44:28.197394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.704 [2024-11-21 03:44:28.197419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.704 qpair failed and we were unable to recover it. 00:27:47.704 [2024-11-21 03:44:28.197524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.704 [2024-11-21 03:44:28.197624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.704 [2024-11-21 03:44:28.197649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.704 qpair failed and we were unable to recover it. 00:27:47.704 [2024-11-21 03:44:28.197739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.704 [2024-11-21 03:44:28.197840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.704 [2024-11-21 03:44:28.197865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.704 qpair failed and we were unable to recover it. 00:27:47.704 [2024-11-21 03:44:28.197959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.704 [2024-11-21 03:44:28.198110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.704 [2024-11-21 03:44:28.198136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.704 qpair failed and we were unable to recover it. 00:27:47.704 [2024-11-21 03:44:28.198270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.704 [2024-11-21 03:44:28.198369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.704 [2024-11-21 03:44:28.198394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.704 qpair failed and we were unable to recover it. 00:27:47.704 [2024-11-21 03:44:28.198499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.704 [2024-11-21 03:44:28.198626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.704 [2024-11-21 03:44:28.198651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.704 qpair failed and we were unable to recover it. 00:27:47.704 [2024-11-21 03:44:28.198750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.704 [2024-11-21 03:44:28.198887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.704 [2024-11-21 03:44:28.198913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.704 qpair failed and we were unable to recover it. 00:27:47.704 [2024-11-21 03:44:28.199013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.704 [2024-11-21 03:44:28.199127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.704 [2024-11-21 03:44:28.199153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.704 qpair failed and we were unable to recover it. 00:27:47.704 [2024-11-21 03:44:28.199286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.704 [2024-11-21 03:44:28.199412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.704 [2024-11-21 03:44:28.199436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.704 qpair failed and we were unable to recover it. 00:27:47.704 [2024-11-21 03:44:28.199543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.704 [2024-11-21 03:44:28.199644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.704 [2024-11-21 03:44:28.199671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.704 qpair failed and we were unable to recover it. 00:27:47.704 [2024-11-21 03:44:28.199768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.704 [2024-11-21 03:44:28.199865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.704 [2024-11-21 03:44:28.199890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.704 qpair failed and we were unable to recover it. 00:27:47.704 [2024-11-21 03:44:28.199997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.704 [2024-11-21 03:44:28.200097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.704 [2024-11-21 03:44:28.200125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.704 qpair failed and we were unable to recover it. 00:27:47.704 [2024-11-21 03:44:28.200280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.704 [2024-11-21 03:44:28.200406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.704 [2024-11-21 03:44:28.200431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.704 qpair failed and we were unable to recover it. 00:27:47.704 [2024-11-21 03:44:28.200530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.704 [2024-11-21 03:44:28.200658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.704 [2024-11-21 03:44:28.200683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.704 qpair failed and we were unable to recover it. 00:27:47.704 [2024-11-21 03:44:28.200809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.704 [2024-11-21 03:44:28.200902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.704 [2024-11-21 03:44:28.200928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.704 qpair failed and we were unable to recover it. 00:27:47.704 [2024-11-21 03:44:28.201031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.704 [2024-11-21 03:44:28.201144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.704 [2024-11-21 03:44:28.201169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.704 qpair failed and we were unable to recover it. 00:27:47.704 [2024-11-21 03:44:28.201293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.704 [2024-11-21 03:44:28.201419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.704 [2024-11-21 03:44:28.201443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.704 qpair failed and we were unable to recover it. 00:27:47.704 [2024-11-21 03:44:28.201547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.704 [2024-11-21 03:44:28.201701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.704 [2024-11-21 03:44:28.201727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.704 qpair failed and we were unable to recover it. 00:27:47.704 [2024-11-21 03:44:28.201828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.704 [2024-11-21 03:44:28.201922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.704 [2024-11-21 03:44:28.201949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.704 qpair failed and we were unable to recover it. 00:27:47.704 [2024-11-21 03:44:28.202054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.704 [2024-11-21 03:44:28.202164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.705 [2024-11-21 03:44:28.202189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.705 qpair failed and we were unable to recover it. 00:27:47.705 [2024-11-21 03:44:28.202281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.705 [2024-11-21 03:44:28.202378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.705 [2024-11-21 03:44:28.202404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.705 qpair failed and we were unable to recover it. 00:27:47.705 [2024-11-21 03:44:28.202532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.705 [2024-11-21 03:44:28.202651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.705 [2024-11-21 03:44:28.202677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.705 qpair failed and we were unable to recover it. 00:27:47.705 [2024-11-21 03:44:28.202778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.705 [2024-11-21 03:44:28.202875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.705 [2024-11-21 03:44:28.202900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.705 qpair failed and we were unable to recover it. 00:27:47.705 [2024-11-21 03:44:28.203001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.705 [2024-11-21 03:44:28.203123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.705 [2024-11-21 03:44:28.203149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.705 qpair failed and we were unable to recover it. 00:27:47.705 [2024-11-21 03:44:28.203250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.705 [2024-11-21 03:44:28.203377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.705 [2024-11-21 03:44:28.203403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.705 qpair failed and we were unable to recover it. 00:27:47.705 [2024-11-21 03:44:28.203506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.705 [2024-11-21 03:44:28.203604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.705 [2024-11-21 03:44:28.203628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.705 qpair failed and we were unable to recover it. 00:27:47.705 [2024-11-21 03:44:28.203735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.705 [2024-11-21 03:44:28.203864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.705 [2024-11-21 03:44:28.203888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.705 qpair failed and we were unable to recover it. 00:27:47.705 [2024-11-21 03:44:28.204013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.705 [2024-11-21 03:44:28.204143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.705 [2024-11-21 03:44:28.204171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.705 qpair failed and we were unable to recover it. 00:27:47.705 [2024-11-21 03:44:28.204301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.705 [2024-11-21 03:44:28.204399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.705 [2024-11-21 03:44:28.204425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.705 qpair failed and we were unable to recover it. 00:27:47.705 [2024-11-21 03:44:28.204527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.705 [2024-11-21 03:44:28.204652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.705 [2024-11-21 03:44:28.204677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.705 qpair failed and we were unable to recover it. 00:27:47.705 [2024-11-21 03:44:28.204809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.705 [2024-11-21 03:44:28.204909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.705 [2024-11-21 03:44:28.204935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.705 qpair failed and we were unable to recover it. 00:27:47.705 [2024-11-21 03:44:28.205031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.705 [2024-11-21 03:44:28.205166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.705 [2024-11-21 03:44:28.205192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.705 qpair failed and we were unable to recover it. 00:27:47.705 [2024-11-21 03:44:28.205317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.705 [2024-11-21 03:44:28.205450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.705 [2024-11-21 03:44:28.205477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.705 qpair failed and we were unable to recover it. 00:27:47.705 [2024-11-21 03:44:28.205611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.705 [2024-11-21 03:44:28.205740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.705 [2024-11-21 03:44:28.205766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.705 qpair failed and we were unable to recover it. 00:27:47.705 [2024-11-21 03:44:28.205857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.705 [2024-11-21 03:44:28.205958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.705 [2024-11-21 03:44:28.205984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.705 qpair failed and we were unable to recover it. 00:27:47.705 [2024-11-21 03:44:28.206113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.705 [2024-11-21 03:44:28.206206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.705 [2024-11-21 03:44:28.206232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.705 qpair failed and we were unable to recover it. 00:27:47.705 [2024-11-21 03:44:28.206366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.705 [2024-11-21 03:44:28.206492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.705 [2024-11-21 03:44:28.206517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.705 qpair failed and we were unable to recover it. 00:27:47.705 [2024-11-21 03:44:28.206623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.705 [2024-11-21 03:44:28.206723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.705 [2024-11-21 03:44:28.206748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.705 qpair failed and we were unable to recover it. 00:27:47.705 [2024-11-21 03:44:28.206853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.705 [2024-11-21 03:44:28.206951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.705 [2024-11-21 03:44:28.206977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.705 qpair failed and we were unable to recover it. 00:27:47.705 [2024-11-21 03:44:28.207105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.705 [2024-11-21 03:44:28.207228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.705 [2024-11-21 03:44:28.207254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.705 qpair failed and we were unable to recover it. 00:27:47.705 [2024-11-21 03:44:28.207382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.705 [2024-11-21 03:44:28.207481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.705 [2024-11-21 03:44:28.207506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.705 qpair failed and we were unable to recover it. 00:27:47.705 [2024-11-21 03:44:28.207666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.705 [2024-11-21 03:44:28.207762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.705 [2024-11-21 03:44:28.207787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.705 qpair failed and we were unable to recover it. 00:27:47.705 [2024-11-21 03:44:28.207908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.705 [2024-11-21 03:44:28.208004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.705 [2024-11-21 03:44:28.208031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.705 qpair failed and we were unable to recover it. 00:27:47.705 [2024-11-21 03:44:28.208156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.705 [2024-11-21 03:44:28.208286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.705 [2024-11-21 03:44:28.208312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.705 qpair failed and we were unable to recover it. 00:27:47.705 [2024-11-21 03:44:28.208408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.705 [2024-11-21 03:44:28.208559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.705 [2024-11-21 03:44:28.208585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.706 qpair failed and we were unable to recover it. 00:27:47.706 [2024-11-21 03:44:28.208688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.706 [2024-11-21 03:44:28.208784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.706 [2024-11-21 03:44:28.208808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.706 qpair failed and we were unable to recover it. 00:27:47.706 [2024-11-21 03:44:28.208942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.706 [2024-11-21 03:44:28.209040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.706 [2024-11-21 03:44:28.209066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.706 qpair failed and we were unable to recover it. 00:27:47.706 [2024-11-21 03:44:28.209175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.706 [2024-11-21 03:44:28.209272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.706 [2024-11-21 03:44:28.209297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.706 qpair failed and we were unable to recover it. 00:27:47.706 [2024-11-21 03:44:28.209395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.706 [2024-11-21 03:44:28.209498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.706 [2024-11-21 03:44:28.209524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.706 qpair failed and we were unable to recover it. 00:27:47.706 [2024-11-21 03:44:28.209682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.706 [2024-11-21 03:44:28.209777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.706 [2024-11-21 03:44:28.209802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.706 qpair failed and we were unable to recover it. 00:27:47.706 [2024-11-21 03:44:28.209934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.706 [2024-11-21 03:44:28.210036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.706 [2024-11-21 03:44:28.210062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.706 qpair failed and we were unable to recover it. 00:27:47.706 [2024-11-21 03:44:28.210229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.706 [2024-11-21 03:44:28.210326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.706 [2024-11-21 03:44:28.210351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.706 qpair failed and we were unable to recover it. 00:27:47.706 [2024-11-21 03:44:28.210458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.706 [2024-11-21 03:44:28.210558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.706 [2024-11-21 03:44:28.210585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.706 qpair failed and we were unable to recover it. 00:27:47.706 [2024-11-21 03:44:28.210686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.706 [2024-11-21 03:44:28.210784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.706 [2024-11-21 03:44:28.210810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.706 qpair failed and we were unable to recover it. 00:27:47.706 [2024-11-21 03:44:28.210911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.706 [2024-11-21 03:44:28.211035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.706 [2024-11-21 03:44:28.211060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.706 qpair failed and we were unable to recover it. 00:27:47.706 [2024-11-21 03:44:28.211193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.706 [2024-11-21 03:44:28.211318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.706 [2024-11-21 03:44:28.211345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.706 qpair failed and we were unable to recover it. 00:27:47.706 [2024-11-21 03:44:28.211472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.706 [2024-11-21 03:44:28.211571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.706 [2024-11-21 03:44:28.211596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.706 qpair failed and we were unable to recover it. 00:27:47.706 [2024-11-21 03:44:28.211703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.706 [2024-11-21 03:44:28.211831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.706 [2024-11-21 03:44:28.211856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.706 qpair failed and we were unable to recover it. 00:27:47.706 [2024-11-21 03:44:28.211978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.706 [2024-11-21 03:44:28.212104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.706 [2024-11-21 03:44:28.212131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.706 qpair failed and we were unable to recover it. 00:27:47.706 [2024-11-21 03:44:28.212259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.706 [2024-11-21 03:44:28.212355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.706 [2024-11-21 03:44:28.212381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.706 qpair failed and we were unable to recover it. 00:27:47.706 [2024-11-21 03:44:28.212512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.706 [2024-11-21 03:44:28.212633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.706 [2024-11-21 03:44:28.212659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.706 qpair failed and we were unable to recover it. 00:27:47.706 [2024-11-21 03:44:28.212757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.706 [2024-11-21 03:44:28.212876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.706 [2024-11-21 03:44:28.212902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.706 qpair failed and we were unable to recover it. 00:27:47.706 [2024-11-21 03:44:28.213025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.706 [2024-11-21 03:44:28.213186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.706 [2024-11-21 03:44:28.213213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.706 qpair failed and we were unable to recover it. 00:27:47.706 [2024-11-21 03:44:28.213312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.706 [2024-11-21 03:44:28.213401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.706 [2024-11-21 03:44:28.213427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.706 qpair failed and we were unable to recover it. 00:27:47.706 [2024-11-21 03:44:28.213556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.706 [2024-11-21 03:44:28.213654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.706 [2024-11-21 03:44:28.213680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.706 qpair failed and we were unable to recover it. 00:27:47.706 [2024-11-21 03:44:28.213784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.706 [2024-11-21 03:44:28.213947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.706 [2024-11-21 03:44:28.213973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.706 qpair failed and we were unable to recover it. 00:27:47.706 [2024-11-21 03:44:28.214104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.706 [2024-11-21 03:44:28.214193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.706 [2024-11-21 03:44:28.214218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.706 qpair failed and we were unable to recover it. 00:27:47.706 [2024-11-21 03:44:28.214324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.706 [2024-11-21 03:44:28.214444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.706 [2024-11-21 03:44:28.214469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.706 qpair failed and we were unable to recover it. 00:27:47.706 [2024-11-21 03:44:28.214560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.706 [2024-11-21 03:44:28.214680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.706 [2024-11-21 03:44:28.214706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.706 qpair failed and we were unable to recover it. 00:27:47.706 [2024-11-21 03:44:28.214814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.706 [2024-11-21 03:44:28.214934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.706 [2024-11-21 03:44:28.214960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.706 qpair failed and we were unable to recover it. 00:27:47.706 [2024-11-21 03:44:28.215082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.706 [2024-11-21 03:44:28.215173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.706 [2024-11-21 03:44:28.215199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.706 qpair failed and we were unable to recover it. 00:27:47.706 [2024-11-21 03:44:28.215296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.706 [2024-11-21 03:44:28.215396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.706 [2024-11-21 03:44:28.215422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.706 qpair failed and we were unable to recover it. 00:27:47.706 [2024-11-21 03:44:28.215558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.706 [2024-11-21 03:44:28.215671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.706 [2024-11-21 03:44:28.215697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.706 qpair failed and we were unable to recover it. 00:27:47.707 [2024-11-21 03:44:28.215799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.707 [2024-11-21 03:44:28.215892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.707 [2024-11-21 03:44:28.215917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.707 qpair failed and we were unable to recover it. 00:27:47.707 [2024-11-21 03:44:28.216023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.707 [2024-11-21 03:44:28.216151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.707 [2024-11-21 03:44:28.216177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.707 qpair failed and we were unable to recover it. 00:27:47.707 [2024-11-21 03:44:28.216279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.707 [2024-11-21 03:44:28.216380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.707 [2024-11-21 03:44:28.216406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.707 qpair failed and we were unable to recover it. 00:27:47.707 [2024-11-21 03:44:28.216517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.707 [2024-11-21 03:44:28.216630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.707 [2024-11-21 03:44:28.216654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.707 qpair failed and we were unable to recover it. 00:27:47.707 [2024-11-21 03:44:28.216756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.707 [2024-11-21 03:44:28.216858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.707 [2024-11-21 03:44:28.216882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.707 qpair failed and we were unable to recover it. 00:27:47.707 [2024-11-21 03:44:28.216988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.707 [2024-11-21 03:44:28.217086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.707 [2024-11-21 03:44:28.217111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.707 qpair failed and we were unable to recover it. 00:27:47.707 [2024-11-21 03:44:28.217214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.707 [2024-11-21 03:44:28.217308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.707 [2024-11-21 03:44:28.217332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.707 qpair failed and we were unable to recover it. 00:27:47.707 [2024-11-21 03:44:28.217435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.707 [2024-11-21 03:44:28.217576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.707 [2024-11-21 03:44:28.217602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.707 qpair failed and we were unable to recover it. 00:27:47.707 [2024-11-21 03:44:28.217706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.707 [2024-11-21 03:44:28.217801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.707 [2024-11-21 03:44:28.217826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.707 qpair failed and we were unable to recover it. 00:27:47.707 [2024-11-21 03:44:28.217962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.707 [2024-11-21 03:44:28.218061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.707 [2024-11-21 03:44:28.218092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.707 qpair failed and we were unable to recover it. 00:27:47.707 [2024-11-21 03:44:28.218225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.707 [2024-11-21 03:44:28.218330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.707 [2024-11-21 03:44:28.218356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.707 qpair failed and we were unable to recover it. 00:27:47.707 [2024-11-21 03:44:28.218450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.707 [2024-11-21 03:44:28.218573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.707 [2024-11-21 03:44:28.218599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.707 qpair failed and we were unable to recover it. 00:27:47.707 [2024-11-21 03:44:28.218736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.707 [2024-11-21 03:44:28.218839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.707 [2024-11-21 03:44:28.218865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.707 qpair failed and we were unable to recover it. 00:27:47.707 [2024-11-21 03:44:28.218962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.707 [2024-11-21 03:44:28.219090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.707 [2024-11-21 03:44:28.219118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.707 qpair failed and we were unable to recover it. 00:27:47.707 [2024-11-21 03:44:28.219223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.707 [2024-11-21 03:44:28.219347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.707 [2024-11-21 03:44:28.219374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.707 qpair failed and we were unable to recover it. 00:27:47.707 [2024-11-21 03:44:28.219473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.707 [2024-11-21 03:44:28.219568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.707 [2024-11-21 03:44:28.219594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.707 qpair failed and we were unable to recover it. 00:27:47.707 [2024-11-21 03:44:28.219727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.707 [2024-11-21 03:44:28.219827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.707 [2024-11-21 03:44:28.219851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.707 qpair failed and we were unable to recover it. 00:27:47.707 [2024-11-21 03:44:28.219950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.707 [2024-11-21 03:44:28.220049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.707 [2024-11-21 03:44:28.220103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.707 qpair failed and we were unable to recover it. 00:27:47.707 [2024-11-21 03:44:28.220220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.707 [2024-11-21 03:44:28.220345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.707 [2024-11-21 03:44:28.220370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.707 qpair failed and we were unable to recover it. 00:27:47.707 [2024-11-21 03:44:28.220469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.707 [2024-11-21 03:44:28.220590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.707 [2024-11-21 03:44:28.220615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.707 qpair failed and we were unable to recover it. 00:27:47.707 [2024-11-21 03:44:28.220721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.707 [2024-11-21 03:44:28.220821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.707 [2024-11-21 03:44:28.220846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.707 qpair failed and we were unable to recover it. 00:27:47.707 [2024-11-21 03:44:28.220969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.707 [2024-11-21 03:44:28.221075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.707 [2024-11-21 03:44:28.221101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.707 qpair failed and we were unable to recover it. 00:27:47.707 [2024-11-21 03:44:28.221201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.707 [2024-11-21 03:44:28.221297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.707 [2024-11-21 03:44:28.221326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.707 qpair failed and we were unable to recover it. 00:27:47.707 [2024-11-21 03:44:28.221425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.707 [2024-11-21 03:44:28.221546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.707 [2024-11-21 03:44:28.221571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.707 qpair failed and we were unable to recover it. 00:27:47.707 [2024-11-21 03:44:28.221680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.707 [2024-11-21 03:44:28.221805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.707 [2024-11-21 03:44:28.221829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.707 qpair failed and we were unable to recover it. 00:27:47.707 [2024-11-21 03:44:28.221930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.707 [2024-11-21 03:44:28.222051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.707 [2024-11-21 03:44:28.222085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.707 qpair failed and we were unable to recover it. 00:27:47.707 [2024-11-21 03:44:28.222212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.707 [2024-11-21 03:44:28.222310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.707 [2024-11-21 03:44:28.222336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.707 qpair failed and we were unable to recover it. 00:27:47.707 [2024-11-21 03:44:28.222467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.707 [2024-11-21 03:44:28.222566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.707 [2024-11-21 03:44:28.222592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.707 qpair failed and we were unable to recover it. 00:27:47.707 [2024-11-21 03:44:28.222724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.707 [2024-11-21 03:44:28.222850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.707 [2024-11-21 03:44:28.222878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.707 qpair failed and we were unable to recover it. 00:27:47.707 [2024-11-21 03:44:28.222969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.707 [2024-11-21 03:44:28.223104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.707 [2024-11-21 03:44:28.223131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.707 qpair failed and we were unable to recover it. 00:27:47.707 [2024-11-21 03:44:28.223229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.707 [2024-11-21 03:44:28.223328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.707 [2024-11-21 03:44:28.223354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.707 qpair failed and we were unable to recover it. 00:27:47.708 [2024-11-21 03:44:28.223450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.708 [2024-11-21 03:44:28.223538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.708 [2024-11-21 03:44:28.223563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.708 qpair failed and we were unable to recover it. 00:27:47.708 [2024-11-21 03:44:28.223664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.708 [2024-11-21 03:44:28.223816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.708 [2024-11-21 03:44:28.223845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.708 qpair failed and we were unable to recover it. 00:27:47.708 [2024-11-21 03:44:28.223949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.708 [2024-11-21 03:44:28.224043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.708 [2024-11-21 03:44:28.224073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.708 qpair failed and we were unable to recover it. 00:27:47.708 [2024-11-21 03:44:28.224178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.708 [2024-11-21 03:44:28.224304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.708 [2024-11-21 03:44:28.224330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.708 qpair failed and we were unable to recover it. 00:27:47.708 [2024-11-21 03:44:28.224432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.708 [2024-11-21 03:44:28.224539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.708 [2024-11-21 03:44:28.224564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.708 qpair failed and we were unable to recover it. 00:27:47.708 [2024-11-21 03:44:28.224728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.708 [2024-11-21 03:44:28.224826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.708 [2024-11-21 03:44:28.224852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.708 qpair failed and we were unable to recover it. 00:27:47.708 [2024-11-21 03:44:28.224981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.708 [2024-11-21 03:44:28.225081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.708 [2024-11-21 03:44:28.225107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.708 qpair failed and we were unable to recover it. 00:27:47.708 [2024-11-21 03:44:28.225211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.708 [2024-11-21 03:44:28.225339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.708 [2024-11-21 03:44:28.225365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.708 qpair failed and we were unable to recover it. 00:27:47.708 [2024-11-21 03:44:28.225464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.708 [2024-11-21 03:44:28.225619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.708 [2024-11-21 03:44:28.225644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.708 qpair failed and we were unable to recover it. 00:27:47.708 [2024-11-21 03:44:28.225771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.708 [2024-11-21 03:44:28.225869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.708 [2024-11-21 03:44:28.225895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.708 qpair failed and we were unable to recover it. 00:27:47.708 [2024-11-21 03:44:28.225988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.708 [2024-11-21 03:44:28.226087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.708 [2024-11-21 03:44:28.226112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.708 qpair failed and we were unable to recover it. 00:27:47.708 [2024-11-21 03:44:28.226221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.708 [2024-11-21 03:44:28.226322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.708 [2024-11-21 03:44:28.226352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.708 qpair failed and we were unable to recover it. 00:27:47.708 [2024-11-21 03:44:28.226488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.708 [2024-11-21 03:44:28.226610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.708 [2024-11-21 03:44:28.226635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.708 qpair failed and we were unable to recover it. 00:27:47.708 [2024-11-21 03:44:28.226760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.708 [2024-11-21 03:44:28.226890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.708 [2024-11-21 03:44:28.226914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.708 qpair failed and we were unable to recover it. 00:27:47.708 [2024-11-21 03:44:28.227014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.708 [2024-11-21 03:44:28.227139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.708 [2024-11-21 03:44:28.227165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.708 qpair failed and we were unable to recover it. 00:27:47.708 [2024-11-21 03:44:28.227259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.708 [2024-11-21 03:44:28.227369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.708 [2024-11-21 03:44:28.227393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.708 qpair failed and we were unable to recover it. 00:27:47.708 [2024-11-21 03:44:28.227516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.708 [2024-11-21 03:44:28.227618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.708 [2024-11-21 03:44:28.227644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.708 qpair failed and we were unable to recover it. 00:27:47.708 [2024-11-21 03:44:28.227752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.708 [2024-11-21 03:44:28.227875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.708 [2024-11-21 03:44:28.227901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.708 qpair failed and we were unable to recover it. 00:27:47.708 [2024-11-21 03:44:28.228031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.708 [2024-11-21 03:44:28.228192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.708 [2024-11-21 03:44:28.228220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.708 qpair failed and we were unable to recover it. 00:27:47.708 [2024-11-21 03:44:28.228353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.708 [2024-11-21 03:44:28.228481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.708 [2024-11-21 03:44:28.228506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.708 qpair failed and we were unable to recover it. 00:27:47.708 [2024-11-21 03:44:28.228611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.708 [2024-11-21 03:44:28.228711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.708 [2024-11-21 03:44:28.228738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.708 qpair failed and we were unable to recover it. 00:27:47.708 [2024-11-21 03:44:28.228847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.708 [2024-11-21 03:44:28.228971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.708 [2024-11-21 03:44:28.229003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.708 qpair failed and we were unable to recover it. 00:27:47.708 [2024-11-21 03:44:28.229168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.708 [2024-11-21 03:44:28.229271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.708 [2024-11-21 03:44:28.229297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.708 qpair failed and we were unable to recover it. 00:27:47.708 [2024-11-21 03:44:28.229434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.708 [2024-11-21 03:44:28.229542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.708 [2024-11-21 03:44:28.229569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.708 qpair failed and we were unable to recover it. 00:27:47.708 [2024-11-21 03:44:28.229676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.708 [2024-11-21 03:44:28.229781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.708 [2024-11-21 03:44:28.229808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.708 qpair failed and we were unable to recover it. 00:27:47.708 [2024-11-21 03:44:28.229906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.708 [2024-11-21 03:44:28.229996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.708 [2024-11-21 03:44:28.230021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.708 qpair failed and we were unable to recover it. 00:27:47.708 [2024-11-21 03:44:28.230120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.709 [2024-11-21 03:44:28.230257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.709 [2024-11-21 03:44:28.230284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.709 qpair failed and we were unable to recover it. 00:27:47.709 [2024-11-21 03:44:28.230389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.709 [2024-11-21 03:44:28.230490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.709 [2024-11-21 03:44:28.230516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.709 qpair failed and we were unable to recover it. 00:27:47.709 [2024-11-21 03:44:28.230644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.709 [2024-11-21 03:44:28.230748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.709 [2024-11-21 03:44:28.230775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.709 qpair failed and we were unable to recover it. 00:27:47.709 [2024-11-21 03:44:28.230906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.709 [2024-11-21 03:44:28.231127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.709 [2024-11-21 03:44:28.231154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.709 qpair failed and we were unable to recover it. 00:27:47.709 [2024-11-21 03:44:28.231278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.709 [2024-11-21 03:44:28.231371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.709 [2024-11-21 03:44:28.231397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.709 qpair failed and we were unable to recover it. 00:27:47.709 [2024-11-21 03:44:28.231507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.709 [2024-11-21 03:44:28.231608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.709 [2024-11-21 03:44:28.231633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.709 qpair failed and we were unable to recover it. 00:27:47.709 [2024-11-21 03:44:28.231735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.709 [2024-11-21 03:44:28.231865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.709 [2024-11-21 03:44:28.231891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.709 qpair failed and we were unable to recover it. 00:27:47.709 [2024-11-21 03:44:28.232053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.709 [2024-11-21 03:44:28.232157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.709 [2024-11-21 03:44:28.232182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.709 qpair failed and we were unable to recover it. 00:27:47.709 [2024-11-21 03:44:28.232279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.709 [2024-11-21 03:44:28.232409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.709 [2024-11-21 03:44:28.232434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.709 qpair failed and we were unable to recover it. 00:27:47.709 [2024-11-21 03:44:28.232539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.709 [2024-11-21 03:44:28.232638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.709 [2024-11-21 03:44:28.232664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.709 qpair failed and we were unable to recover it. 00:27:47.709 [2024-11-21 03:44:28.232786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.709 [2024-11-21 03:44:28.232909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.709 [2024-11-21 03:44:28.232935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.709 qpair failed and we were unable to recover it. 00:27:47.709 [2024-11-21 03:44:28.233029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.709 [2024-11-21 03:44:28.233138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.709 [2024-11-21 03:44:28.233165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.709 qpair failed and we were unable to recover it. 00:27:47.709 [2024-11-21 03:44:28.233293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.709 [2024-11-21 03:44:28.233389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.709 [2024-11-21 03:44:28.233414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.709 qpair failed and we were unable to recover it. 00:27:47.709 [2024-11-21 03:44:28.233517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.709 [2024-11-21 03:44:28.233613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.709 [2024-11-21 03:44:28.233637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.709 qpair failed and we were unable to recover it. 00:27:47.709 [2024-11-21 03:44:28.233769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.709 [2024-11-21 03:44:28.233890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.709 [2024-11-21 03:44:28.233915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.709 qpair failed and we were unable to recover it. 00:27:47.709 [2024-11-21 03:44:28.234052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.709 [2024-11-21 03:44:28.234189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.709 [2024-11-21 03:44:28.234215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.709 qpair failed and we were unable to recover it. 00:27:47.709 [2024-11-21 03:44:28.234347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.709 [2024-11-21 03:44:28.234446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.709 [2024-11-21 03:44:28.234471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.709 qpair failed and we were unable to recover it. 00:27:47.709 [2024-11-21 03:44:28.234569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.709 [2024-11-21 03:44:28.234669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.709 [2024-11-21 03:44:28.234696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.709 qpair failed and we were unable to recover it. 00:27:47.709 [2024-11-21 03:44:28.234822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.709 [2024-11-21 03:44:28.234923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.709 [2024-11-21 03:44:28.234947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.709 qpair failed and we were unable to recover it. 00:27:47.709 [2024-11-21 03:44:28.235052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.709 [2024-11-21 03:44:28.235157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.709 [2024-11-21 03:44:28.235183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.709 qpair failed and we were unable to recover it. 00:27:47.709 [2024-11-21 03:44:28.235291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.709 [2024-11-21 03:44:28.235423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.709 [2024-11-21 03:44:28.235447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.709 qpair failed and we were unable to recover it. 00:27:47.709 [2024-11-21 03:44:28.235602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.709 [2024-11-21 03:44:28.235698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.709 [2024-11-21 03:44:28.235723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.709 qpair failed and we were unable to recover it. 00:27:47.709 [2024-11-21 03:44:28.235886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.709 [2024-11-21 03:44:28.235986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.709 [2024-11-21 03:44:28.236013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.709 qpair failed and we were unable to recover it. 00:27:47.709 [2024-11-21 03:44:28.236149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.709 [2024-11-21 03:44:28.236256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.709 [2024-11-21 03:44:28.236281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.710 qpair failed and we were unable to recover it. 00:27:47.710 [2024-11-21 03:44:28.236409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.710 [2024-11-21 03:44:28.236514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.710 [2024-11-21 03:44:28.236539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.710 qpair failed and we were unable to recover it. 00:27:47.710 [2024-11-21 03:44:28.236643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.710 [2024-11-21 03:44:28.236771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.710 [2024-11-21 03:44:28.236796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.710 qpair failed and we were unable to recover it. 00:27:47.710 [2024-11-21 03:44:28.236892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.710 [2024-11-21 03:44:28.236989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.710 [2024-11-21 03:44:28.237016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.710 qpair failed and we were unable to recover it. 00:27:47.710 [2024-11-21 03:44:28.237168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.710 [2024-11-21 03:44:28.237304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.710 [2024-11-21 03:44:28.237330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.710 qpair failed and we were unable to recover it. 00:27:47.710 [2024-11-21 03:44:28.237430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.710 [2024-11-21 03:44:28.237552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.710 [2024-11-21 03:44:28.237577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.710 qpair failed and we were unable to recover it. 00:27:47.710 [2024-11-21 03:44:28.237680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.710 [2024-11-21 03:44:28.237809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.710 [2024-11-21 03:44:28.237834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.710 qpair failed and we were unable to recover it. 00:27:47.710 [2024-11-21 03:44:28.237941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.710 [2024-11-21 03:44:28.238078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.710 [2024-11-21 03:44:28.238105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.710 qpair failed and we were unable to recover it. 00:27:47.710 [2024-11-21 03:44:28.238217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.710 [2024-11-21 03:44:28.238318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.710 [2024-11-21 03:44:28.238343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.710 qpair failed and we were unable to recover it. 00:27:47.710 [2024-11-21 03:44:28.238450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.710 [2024-11-21 03:44:28.238577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.710 [2024-11-21 03:44:28.238603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.710 qpair failed and we were unable to recover it. 00:27:47.710 [2024-11-21 03:44:28.238732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.710 [2024-11-21 03:44:28.238861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.710 [2024-11-21 03:44:28.238887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.710 qpair failed and we were unable to recover it. 00:27:47.710 [2024-11-21 03:44:28.239102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.710 [2024-11-21 03:44:28.239198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.710 [2024-11-21 03:44:28.239223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.710 qpair failed and we were unable to recover it. 00:27:47.710 [2024-11-21 03:44:28.239358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.710 [2024-11-21 03:44:28.239460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.710 [2024-11-21 03:44:28.239487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.710 qpair failed and we were unable to recover it. 00:27:47.710 [2024-11-21 03:44:28.239626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.710 [2024-11-21 03:44:28.239747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.710 [2024-11-21 03:44:28.239773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.710 qpair failed and we were unable to recover it. 00:27:47.710 [2024-11-21 03:44:28.239874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.710 [2024-11-21 03:44:28.240008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.710 [2024-11-21 03:44:28.240033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.710 qpair failed and we were unable to recover it. 00:27:47.710 [2024-11-21 03:44:28.240143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.710 [2024-11-21 03:44:28.240242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.710 [2024-11-21 03:44:28.240267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.710 qpair failed and we were unable to recover it. 00:27:47.710 [2024-11-21 03:44:28.240391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.710 [2024-11-21 03:44:28.240522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.710 [2024-11-21 03:44:28.240546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.710 qpair failed and we were unable to recover it. 00:27:47.710 [2024-11-21 03:44:28.240669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.710 [2024-11-21 03:44:28.240765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.710 [2024-11-21 03:44:28.240789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.710 qpair failed and we were unable to recover it. 00:27:47.710 [2024-11-21 03:44:28.240888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.710 [2024-11-21 03:44:28.240989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.710 [2024-11-21 03:44:28.241014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.710 qpair failed and we were unable to recover it. 00:27:47.710 [2024-11-21 03:44:28.241113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.710 [2024-11-21 03:44:28.241245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.710 [2024-11-21 03:44:28.241270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.710 qpair failed and we were unable to recover it. 00:27:47.710 [2024-11-21 03:44:28.241375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.710 [2024-11-21 03:44:28.241505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.710 [2024-11-21 03:44:28.241530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.710 qpair failed and we were unable to recover it. 00:27:47.710 [2024-11-21 03:44:28.241664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.710 [2024-11-21 03:44:28.241765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.710 [2024-11-21 03:44:28.241794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.710 qpair failed and we were unable to recover it. 00:27:47.710 [2024-11-21 03:44:28.241897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.710 [2024-11-21 03:44:28.242027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.710 [2024-11-21 03:44:28.242052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.710 qpair failed and we were unable to recover it. 00:27:47.710 [2024-11-21 03:44:28.242206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.710 [2024-11-21 03:44:28.242337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.710 [2024-11-21 03:44:28.242362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.710 qpair failed and we were unable to recover it. 00:27:47.710 [2024-11-21 03:44:28.242459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.710 [2024-11-21 03:44:28.242562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.710 [2024-11-21 03:44:28.242587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.710 qpair failed and we were unable to recover it. 00:27:47.710 [2024-11-21 03:44:28.242714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.710 [2024-11-21 03:44:28.242843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.710 [2024-11-21 03:44:28.242868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.710 qpair failed and we were unable to recover it. 00:27:47.710 [2024-11-21 03:44:28.243024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.710 [2024-11-21 03:44:28.243145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.710 [2024-11-21 03:44:28.243171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.710 qpair failed and we were unable to recover it. 00:27:47.710 [2024-11-21 03:44:28.243279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.710 [2024-11-21 03:44:28.243403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.710 [2024-11-21 03:44:28.243428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.710 qpair failed and we were unable to recover it. 00:27:47.711 [2024-11-21 03:44:28.243553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.711 [2024-11-21 03:44:28.243684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.711 [2024-11-21 03:44:28.243709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.711 qpair failed and we were unable to recover it. 00:27:47.711 [2024-11-21 03:44:28.243871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.711 [2024-11-21 03:44:28.243997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.711 [2024-11-21 03:44:28.244023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.711 qpair failed and we were unable to recover it. 00:27:47.711 [2024-11-21 03:44:28.244126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.711 [2024-11-21 03:44:28.244256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.711 [2024-11-21 03:44:28.244283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.711 qpair failed and we were unable to recover it. 00:27:47.711 [2024-11-21 03:44:28.244384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.711 [2024-11-21 03:44:28.244487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.711 [2024-11-21 03:44:28.244513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.711 qpair failed and we were unable to recover it. 00:27:47.711 [2024-11-21 03:44:28.244614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.711 [2024-11-21 03:44:28.244737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.711 [2024-11-21 03:44:28.244761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.711 qpair failed and we were unable to recover it. 00:27:47.711 [2024-11-21 03:44:28.244868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.711 [2024-11-21 03:44:28.244991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.711 [2024-11-21 03:44:28.245016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.711 qpair failed and we were unable to recover it. 00:27:47.711 [2024-11-21 03:44:28.245124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.711 [2024-11-21 03:44:28.245235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.711 [2024-11-21 03:44:28.245259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.711 qpair failed and we were unable to recover it. 00:27:47.711 [2024-11-21 03:44:28.245421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.711 [2024-11-21 03:44:28.245517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.711 [2024-11-21 03:44:28.245541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.711 qpair failed and we were unable to recover it. 00:27:47.711 [2024-11-21 03:44:28.245644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.711 [2024-11-21 03:44:28.245734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.711 [2024-11-21 03:44:28.245758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.711 qpair failed and we were unable to recover it. 00:27:47.711 [2024-11-21 03:44:28.245888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.711 [2024-11-21 03:44:28.245987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.711 [2024-11-21 03:44:28.246011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.711 qpair failed and we were unable to recover it. 00:27:47.711 [2024-11-21 03:44:28.246112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.711 [2024-11-21 03:44:28.246206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.711 [2024-11-21 03:44:28.246231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.711 qpair failed and we were unable to recover it. 00:27:47.711 [2024-11-21 03:44:28.246368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.711 [2024-11-21 03:44:28.246470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.711 [2024-11-21 03:44:28.246496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.711 qpair failed and we were unable to recover it. 00:27:47.711 [2024-11-21 03:44:28.246603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.711 [2024-11-21 03:44:28.246741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.711 [2024-11-21 03:44:28.246767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.711 qpair failed and we were unable to recover it. 00:27:47.711 [2024-11-21 03:44:28.246871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.711 [2024-11-21 03:44:28.246968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.711 [2024-11-21 03:44:28.246994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.711 qpair failed and we were unable to recover it. 00:27:47.711 [2024-11-21 03:44:28.247121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.711 [2024-11-21 03:44:28.247245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.711 [2024-11-21 03:44:28.247270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.711 qpair failed and we were unable to recover it. 00:27:47.711 [2024-11-21 03:44:28.247382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.711 [2024-11-21 03:44:28.247513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.711 [2024-11-21 03:44:28.247539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.711 qpair failed and we were unable to recover it. 00:27:47.711 [2024-11-21 03:44:28.247639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.711 [2024-11-21 03:44:28.247772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.711 [2024-11-21 03:44:28.247797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.711 qpair failed and we were unable to recover it. 00:27:47.711 [2024-11-21 03:44:28.247910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.711 [2024-11-21 03:44:28.248006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.711 [2024-11-21 03:44:28.248031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.711 qpair failed and we were unable to recover it. 00:27:47.711 [2024-11-21 03:44:28.248142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.711 [2024-11-21 03:44:28.248251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.711 [2024-11-21 03:44:28.248277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.711 qpair failed and we were unable to recover it. 00:27:47.711 [2024-11-21 03:44:28.248375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.711 [2024-11-21 03:44:28.248500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.711 [2024-11-21 03:44:28.248527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.711 qpair failed and we were unable to recover it. 00:27:47.711 [2024-11-21 03:44:28.248633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.711 [2024-11-21 03:44:28.248791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.711 [2024-11-21 03:44:28.248817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.711 qpair failed and we were unable to recover it. 00:27:47.711 [2024-11-21 03:44:28.248916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.711 [2024-11-21 03:44:28.249036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.711 [2024-11-21 03:44:28.249062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.711 qpair failed and we were unable to recover it. 00:27:47.711 [2024-11-21 03:44:28.249211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.711 [2024-11-21 03:44:28.249314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.711 [2024-11-21 03:44:28.249339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.711 qpair failed and we were unable to recover it. 00:27:47.711 [2024-11-21 03:44:28.249437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.711 [2024-11-21 03:44:28.249560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.711 [2024-11-21 03:44:28.249584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.711 qpair failed and we were unable to recover it. 00:27:47.711 [2024-11-21 03:44:28.249682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.711 [2024-11-21 03:44:28.249818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.711 [2024-11-21 03:44:28.249844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.711 qpair failed and we were unable to recover it. 00:27:47.711 [2024-11-21 03:44:28.249973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.711 [2024-11-21 03:44:28.250107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.711 [2024-11-21 03:44:28.250144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.711 qpair failed and we were unable to recover it. 00:27:47.711 [2024-11-21 03:44:28.250252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.711 [2024-11-21 03:44:28.250380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.711 [2024-11-21 03:44:28.250406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.711 qpair failed and we were unable to recover it. 00:27:47.711 [2024-11-21 03:44:28.250539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.711 [2024-11-21 03:44:28.250664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.711 [2024-11-21 03:44:28.250690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.711 qpair failed and we were unable to recover it. 00:27:47.711 [2024-11-21 03:44:28.250822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.711 [2024-11-21 03:44:28.250944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.711 [2024-11-21 03:44:28.250969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.711 qpair failed and we were unable to recover it. 00:27:47.712 [2024-11-21 03:44:28.251102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.712 [2024-11-21 03:44:28.251254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.712 [2024-11-21 03:44:28.251279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.712 qpair failed and we were unable to recover it. 00:27:47.712 [2024-11-21 03:44:28.251374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.712 [2024-11-21 03:44:28.251500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.712 [2024-11-21 03:44:28.251525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.712 qpair failed and we were unable to recover it. 00:27:47.712 [2024-11-21 03:44:28.251674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.712 [2024-11-21 03:44:28.251777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.712 [2024-11-21 03:44:28.251802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.712 qpair failed and we were unable to recover it. 00:27:47.712 [2024-11-21 03:44:28.251936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.712 [2024-11-21 03:44:28.252027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.712 [2024-11-21 03:44:28.252052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.712 qpair failed and we were unable to recover it. 00:27:47.712 [2024-11-21 03:44:28.252189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.712 [2024-11-21 03:44:28.252316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.712 [2024-11-21 03:44:28.252341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.712 qpair failed and we were unable to recover it. 00:27:47.712 [2024-11-21 03:44:28.252474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.712 [2024-11-21 03:44:28.252575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.712 [2024-11-21 03:44:28.252600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.712 qpair failed and we were unable to recover it. 00:27:47.712 [2024-11-21 03:44:28.252726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.712 [2024-11-21 03:44:28.252886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.712 [2024-11-21 03:44:28.252911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.712 qpair failed and we were unable to recover it. 00:27:47.712 [2024-11-21 03:44:28.253010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.712 [2024-11-21 03:44:28.253133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.712 [2024-11-21 03:44:28.253159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.712 qpair failed and we were unable to recover it. 00:27:47.712 [2024-11-21 03:44:28.253294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.712 [2024-11-21 03:44:28.253422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.712 [2024-11-21 03:44:28.253447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.712 qpair failed and we were unable to recover it. 00:27:47.712 [2024-11-21 03:44:28.253549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.712 [2024-11-21 03:44:28.253680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.712 [2024-11-21 03:44:28.253707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.712 qpair failed and we were unable to recover it. 00:27:47.712 [2024-11-21 03:44:28.253837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.712 [2024-11-21 03:44:28.253967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.712 [2024-11-21 03:44:28.253992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.712 qpair failed and we were unable to recover it. 00:27:47.712 [2024-11-21 03:44:28.254125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.712 [2024-11-21 03:44:28.254228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.712 [2024-11-21 03:44:28.254255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.712 qpair failed and we were unable to recover it. 00:27:47.712 [2024-11-21 03:44:28.254389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.712 [2024-11-21 03:44:28.254523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.712 [2024-11-21 03:44:28.254549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.712 qpair failed and we were unable to recover it. 00:27:47.712 [2024-11-21 03:44:28.254650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.712 [2024-11-21 03:44:28.254807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.712 [2024-11-21 03:44:28.254832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.712 qpair failed and we were unable to recover it. 00:27:47.712 [2024-11-21 03:44:28.254935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.712 [2024-11-21 03:44:28.255067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.712 [2024-11-21 03:44:28.255101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.712 qpair failed and we were unable to recover it. 00:27:47.712 [2024-11-21 03:44:28.255205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.712 [2024-11-21 03:44:28.255341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.712 [2024-11-21 03:44:28.255366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.712 qpair failed and we were unable to recover it. 00:27:47.712 [2024-11-21 03:44:28.255497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.712 [2024-11-21 03:44:28.255604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.712 [2024-11-21 03:44:28.255629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.712 qpair failed and we were unable to recover it. 00:27:47.712 [2024-11-21 03:44:28.255732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.712 [2024-11-21 03:44:28.255857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.712 [2024-11-21 03:44:28.255882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.712 qpair failed and we were unable to recover it. 00:27:47.712 [2024-11-21 03:44:28.255975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.712 [2024-11-21 03:44:28.256128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.712 [2024-11-21 03:44:28.256154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.712 qpair failed and we were unable to recover it. 00:27:47.712 [2024-11-21 03:44:28.256286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.712 [2024-11-21 03:44:28.256394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.712 [2024-11-21 03:44:28.256419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.712 qpair failed and we were unable to recover it. 00:27:47.712 [2024-11-21 03:44:28.256515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.712 [2024-11-21 03:44:28.256615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.712 [2024-11-21 03:44:28.256641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.712 qpair failed and we were unable to recover it. 00:27:47.712 [2024-11-21 03:44:28.256745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.712 [2024-11-21 03:44:28.256840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.712 [2024-11-21 03:44:28.256864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.712 qpair failed and we were unable to recover it. 00:27:47.712 [2024-11-21 03:44:28.256960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.712 [2024-11-21 03:44:28.257059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.712 [2024-11-21 03:44:28.257091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.712 qpair failed and we were unable to recover it. 00:27:47.712 [2024-11-21 03:44:28.257196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.712 [2024-11-21 03:44:28.257346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.712 [2024-11-21 03:44:28.257372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.712 qpair failed and we were unable to recover it. 00:27:47.712 [2024-11-21 03:44:28.257493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.712 [2024-11-21 03:44:28.257599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.712 [2024-11-21 03:44:28.257624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.712 qpair failed and we were unable to recover it. 00:27:47.712 [2024-11-21 03:44:28.257724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.712 [2024-11-21 03:44:28.257850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.712 [2024-11-21 03:44:28.257876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.712 qpair failed and we were unable to recover it. 00:27:47.712 [2024-11-21 03:44:28.257981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.712 [2024-11-21 03:44:28.258143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.712 [2024-11-21 03:44:28.258168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.712 qpair failed and we were unable to recover it. 00:27:47.712 [2024-11-21 03:44:28.258272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.712 [2024-11-21 03:44:28.258367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.712 [2024-11-21 03:44:28.258391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.712 qpair failed and we were unable to recover it. 00:27:47.712 [2024-11-21 03:44:28.258491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.712 [2024-11-21 03:44:28.258591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.712 [2024-11-21 03:44:28.258616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.712 qpair failed and we were unable to recover it. 00:27:47.712 [2024-11-21 03:44:28.258740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.712 [2024-11-21 03:44:28.258840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.712 [2024-11-21 03:44:28.258865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.712 qpair failed and we were unable to recover it. 00:27:47.712 [2024-11-21 03:44:28.258955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.712 [2024-11-21 03:44:28.259046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.713 [2024-11-21 03:44:28.259077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.713 qpair failed and we were unable to recover it. 00:27:47.713 [2024-11-21 03:44:28.259181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.713 [2024-11-21 03:44:28.259284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.713 [2024-11-21 03:44:28.259310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.713 qpair failed and we were unable to recover it. 00:27:47.713 [2024-11-21 03:44:28.259413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.713 [2024-11-21 03:44:28.259504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.713 [2024-11-21 03:44:28.259529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.713 qpair failed and we were unable to recover it. 00:27:47.713 [2024-11-21 03:44:28.259684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.713 [2024-11-21 03:44:28.259787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.713 [2024-11-21 03:44:28.259812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.713 qpair failed and we were unable to recover it. 00:27:47.713 [2024-11-21 03:44:28.259942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.713 [2024-11-21 03:44:28.260080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.713 [2024-11-21 03:44:28.260108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.713 qpair failed and we were unable to recover it. 00:27:47.713 [2024-11-21 03:44:28.260213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.713 [2024-11-21 03:44:28.260311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.713 [2024-11-21 03:44:28.260337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.713 qpair failed and we were unable to recover it. 00:27:47.713 [2024-11-21 03:44:28.260463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.713 [2024-11-21 03:44:28.260562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.713 [2024-11-21 03:44:28.260588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.713 qpair failed and we were unable to recover it. 00:27:47.713 [2024-11-21 03:44:28.260722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.713 [2024-11-21 03:44:28.260829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.713 [2024-11-21 03:44:28.260855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.713 qpair failed and we were unable to recover it. 00:27:47.713 [2024-11-21 03:44:28.260959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.713 [2024-11-21 03:44:28.261055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.713 [2024-11-21 03:44:28.261113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.713 qpair failed and we were unable to recover it. 00:27:47.713 [2024-11-21 03:44:28.261247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.713 [2024-11-21 03:44:28.261342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.713 [2024-11-21 03:44:28.261367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.713 qpair failed and we were unable to recover it. 00:27:47.713 [2024-11-21 03:44:28.261471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.713 [2024-11-21 03:44:28.261601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.713 [2024-11-21 03:44:28.261628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.713 qpair failed and we were unable to recover it. 00:27:47.713 [2024-11-21 03:44:28.261775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.713 [2024-11-21 03:44:28.261906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.713 [2024-11-21 03:44:28.261932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.713 qpair failed and we were unable to recover it. 00:27:47.713 [2024-11-21 03:44:28.262060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.713 [2024-11-21 03:44:28.262177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.713 [2024-11-21 03:44:28.262202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.713 qpair failed and we were unable to recover it. 00:27:47.713 [2024-11-21 03:44:28.262333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.713 [2024-11-21 03:44:28.262450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.713 [2024-11-21 03:44:28.262474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.713 qpair failed and we were unable to recover it. 00:27:47.713 [2024-11-21 03:44:28.262574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.713 [2024-11-21 03:44:28.262677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.713 [2024-11-21 03:44:28.262702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.713 qpair failed and we were unable to recover it. 00:27:47.713 [2024-11-21 03:44:28.262801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.713 [2024-11-21 03:44:28.262897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.713 [2024-11-21 03:44:28.262921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.713 qpair failed and we were unable to recover it. 00:27:47.713 [2024-11-21 03:44:28.263048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.713 [2024-11-21 03:44:28.263186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.713 [2024-11-21 03:44:28.263216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.713 qpair failed and we were unable to recover it. 00:27:47.713 [2024-11-21 03:44:28.263374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.713 [2024-11-21 03:44:28.263499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.713 [2024-11-21 03:44:28.263523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.713 qpair failed and we were unable to recover it. 00:27:47.713 [2024-11-21 03:44:28.263628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.713 [2024-11-21 03:44:28.263731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.713 [2024-11-21 03:44:28.263756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.713 qpair failed and we were unable to recover it. 00:27:47.713 [2024-11-21 03:44:28.263884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.713 [2024-11-21 03:44:28.263987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.713 [2024-11-21 03:44:28.264012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.713 qpair failed and we were unable to recover it. 00:27:47.713 [2024-11-21 03:44:28.264159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.713 [2024-11-21 03:44:28.264255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.713 [2024-11-21 03:44:28.264281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.713 qpair failed and we were unable to recover it. 00:27:47.713 [2024-11-21 03:44:28.264380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.713 [2024-11-21 03:44:28.264498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.713 [2024-11-21 03:44:28.264523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.713 qpair failed and we were unable to recover it. 00:27:47.713 [2024-11-21 03:44:28.264653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.713 [2024-11-21 03:44:28.264747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.713 [2024-11-21 03:44:28.264772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.713 qpair failed and we were unable to recover it. 00:27:47.713 [2024-11-21 03:44:28.264870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.713 [2024-11-21 03:44:28.264987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.713 [2024-11-21 03:44:28.265012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.713 qpair failed and we were unable to recover it. 00:27:47.713 [2024-11-21 03:44:28.265131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.713 [2024-11-21 03:44:28.265230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.713 [2024-11-21 03:44:28.265255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.713 qpair failed and we were unable to recover it. 00:27:47.713 [2024-11-21 03:44:28.265380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.713 [2024-11-21 03:44:28.265478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.713 [2024-11-21 03:44:28.265502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.713 qpair failed and we were unable to recover it. 00:27:47.713 [2024-11-21 03:44:28.265601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.713 [2024-11-21 03:44:28.265699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.713 [2024-11-21 03:44:28.265728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.713 qpair failed and we were unable to recover it. 00:27:47.713 [2024-11-21 03:44:28.265851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.713 [2024-11-21 03:44:28.265948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.713 [2024-11-21 03:44:28.265974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.713 qpair failed and we were unable to recover it. 00:27:47.713 [2024-11-21 03:44:28.266073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.713 [2024-11-21 03:44:28.266208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.713 [2024-11-21 03:44:28.266233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.713 qpair failed and we were unable to recover it. 00:27:47.713 [2024-11-21 03:44:28.266341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.714 [2024-11-21 03:44:28.266441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.714 [2024-11-21 03:44:28.266467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.714 qpair failed and we were unable to recover it. 00:27:47.714 [2024-11-21 03:44:28.266595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.714 [2024-11-21 03:44:28.266695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.714 [2024-11-21 03:44:28.266721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.714 qpair failed and we were unable to recover it. 00:27:47.714 [2024-11-21 03:44:28.266815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.714 [2024-11-21 03:44:28.266915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.714 [2024-11-21 03:44:28.266941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.714 qpair failed and we were unable to recover it. 00:27:47.714 [2024-11-21 03:44:28.267098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.714 [2024-11-21 03:44:28.267231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.714 [2024-11-21 03:44:28.267256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.714 qpair failed and we were unable to recover it. 00:27:47.714 [2024-11-21 03:44:28.267389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.714 [2024-11-21 03:44:28.267490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.714 [2024-11-21 03:44:28.267516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.714 qpair failed and we were unable to recover it. 00:27:47.714 [2024-11-21 03:44:28.267644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.714 [2024-11-21 03:44:28.267737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.714 [2024-11-21 03:44:28.267762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.714 qpair failed and we were unable to recover it. 00:27:47.714 [2024-11-21 03:44:28.267867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.714 [2024-11-21 03:44:28.267992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.714 [2024-11-21 03:44:28.268018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.714 qpair failed and we were unable to recover it. 00:27:47.714 [2024-11-21 03:44:28.268161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.714 [2024-11-21 03:44:28.268299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.714 [2024-11-21 03:44:28.268333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.714 qpair failed and we were unable to recover it. 00:27:47.714 [2024-11-21 03:44:28.268439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.714 [2024-11-21 03:44:28.268570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.714 [2024-11-21 03:44:28.268595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.714 qpair failed and we were unable to recover it. 00:27:47.714 [2024-11-21 03:44:28.268728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.714 [2024-11-21 03:44:28.268828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.714 [2024-11-21 03:44:28.268854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.714 qpair failed and we were unable to recover it. 00:27:47.714 [2024-11-21 03:44:28.268980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.714 [2024-11-21 03:44:28.269079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.714 [2024-11-21 03:44:28.269104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.714 qpair failed and we were unable to recover it. 00:27:47.714 [2024-11-21 03:44:28.269229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.714 [2024-11-21 03:44:28.269353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.714 [2024-11-21 03:44:28.269384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.714 qpair failed and we were unable to recover it. 00:27:47.714 [2024-11-21 03:44:28.269519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.714 [2024-11-21 03:44:28.269624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.714 [2024-11-21 03:44:28.269650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.714 qpair failed and we were unable to recover it. 00:27:47.714 [2024-11-21 03:44:28.269775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.714 [2024-11-21 03:44:28.269876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.714 [2024-11-21 03:44:28.269902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.714 qpair failed and we were unable to recover it. 00:27:47.714 [2024-11-21 03:44:28.270010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.714 [2024-11-21 03:44:28.270139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.714 [2024-11-21 03:44:28.270165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.714 qpair failed and we were unable to recover it. 00:27:47.714 [2024-11-21 03:44:28.270291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.714 [2024-11-21 03:44:28.270423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.714 [2024-11-21 03:44:28.270448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.714 qpair failed and we were unable to recover it. 00:27:47.714 [2024-11-21 03:44:28.270610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.714 [2024-11-21 03:44:28.270734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.714 [2024-11-21 03:44:28.270759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.714 qpair failed and we were unable to recover it. 00:27:47.714 [2024-11-21 03:44:28.270854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.714 [2024-11-21 03:44:28.270974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.714 [2024-11-21 03:44:28.271000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.714 qpair failed and we were unable to recover it. 00:27:47.714 [2024-11-21 03:44:28.271108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.714 [2024-11-21 03:44:28.271218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.714 [2024-11-21 03:44:28.271244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.714 qpair failed and we were unable to recover it. 00:27:47.714 [2024-11-21 03:44:28.271371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.714 [2024-11-21 03:44:28.271466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.714 [2024-11-21 03:44:28.271492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.714 qpair failed and we were unable to recover it. 00:27:47.714 [2024-11-21 03:44:28.271625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.714 [2024-11-21 03:44:28.271736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.714 [2024-11-21 03:44:28.271761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.714 qpair failed and we were unable to recover it. 00:27:47.714 [2024-11-21 03:44:28.271889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.714 [2024-11-21 03:44:28.272010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.714 [2024-11-21 03:44:28.272036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.714 qpair failed and we were unable to recover it. 00:27:47.714 [2024-11-21 03:44:28.272185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.714 [2024-11-21 03:44:28.272279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.714 [2024-11-21 03:44:28.272304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.714 qpair failed and we were unable to recover it. 00:27:47.714 [2024-11-21 03:44:28.272403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.714 [2024-11-21 03:44:28.272507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.714 [2024-11-21 03:44:28.272532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.714 qpair failed and we were unable to recover it. 00:27:47.714 [2024-11-21 03:44:28.272672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.714 [2024-11-21 03:44:28.272760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.714 [2024-11-21 03:44:28.272785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.714 qpair failed and we were unable to recover it. 00:27:47.714 [2024-11-21 03:44:28.272893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.714 [2024-11-21 03:44:28.272992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.714 [2024-11-21 03:44:28.273017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.714 qpair failed and we were unable to recover it. 00:27:47.714 [2024-11-21 03:44:28.273156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.714 [2024-11-21 03:44:28.273265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.714 [2024-11-21 03:44:28.273292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.714 qpair failed and we were unable to recover it. 00:27:47.714 [2024-11-21 03:44:28.273444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.714 [2024-11-21 03:44:28.273543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.714 [2024-11-21 03:44:28.273568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.714 qpair failed and we were unable to recover it. 00:27:47.714 [2024-11-21 03:44:28.273668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.714 [2024-11-21 03:44:28.273791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.714 [2024-11-21 03:44:28.273815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.714 qpair failed and we were unable to recover it. 00:27:47.714 [2024-11-21 03:44:28.273909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.714 [2024-11-21 03:44:28.274012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:47.714 [2024-11-21 03:44:28.274036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:47.714 qpair failed and we were unable to recover it. 00:27:47.714 [2024-11-21 03:44:28.274160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.000 [2024-11-21 03:44:28.274283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.000 [2024-11-21 03:44:28.274308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.000 qpair failed and we were unable to recover it. 00:27:48.000 [2024-11-21 03:44:28.274418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.000 [2024-11-21 03:44:28.274549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.000 [2024-11-21 03:44:28.274574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.000 qpair failed and we were unable to recover it. 00:27:48.000 [2024-11-21 03:44:28.274705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.000 [2024-11-21 03:44:28.274834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.000 [2024-11-21 03:44:28.274859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.000 qpair failed and we were unable to recover it. 00:27:48.000 [2024-11-21 03:44:28.274957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.000 [2024-11-21 03:44:28.275044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.000 [2024-11-21 03:44:28.275074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.000 qpair failed and we were unable to recover it. 00:27:48.000 [2024-11-21 03:44:28.275181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.000 [2024-11-21 03:44:28.275287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.000 [2024-11-21 03:44:28.275313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.000 qpair failed and we were unable to recover it. 00:27:48.000 [2024-11-21 03:44:28.275467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.000 [2024-11-21 03:44:28.275599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.000 [2024-11-21 03:44:28.275624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.000 qpair failed and we were unable to recover it. 00:27:48.000 [2024-11-21 03:44:28.275729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.000 [2024-11-21 03:44:28.275861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.000 [2024-11-21 03:44:28.275886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.000 qpair failed and we were unable to recover it. 00:27:48.000 [2024-11-21 03:44:28.276003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.000 [2024-11-21 03:44:28.276132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.000 [2024-11-21 03:44:28.276157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.000 qpair failed and we were unable to recover it. 00:27:48.000 [2024-11-21 03:44:28.276286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.000 [2024-11-21 03:44:28.276381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.000 [2024-11-21 03:44:28.276405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.000 qpair failed and we were unable to recover it. 00:27:48.000 [2024-11-21 03:44:28.276533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.000 [2024-11-21 03:44:28.276632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.000 [2024-11-21 03:44:28.276657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.000 qpair failed and we were unable to recover it. 00:27:48.000 [2024-11-21 03:44:28.276754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.000 [2024-11-21 03:44:28.276881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.000 [2024-11-21 03:44:28.276906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.000 qpair failed and we were unable to recover it. 00:27:48.000 [2024-11-21 03:44:28.277003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.000 [2024-11-21 03:44:28.277102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.000 [2024-11-21 03:44:28.277128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.000 qpair failed and we were unable to recover it. 00:27:48.000 [2024-11-21 03:44:28.277224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.000 [2024-11-21 03:44:28.277349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.000 [2024-11-21 03:44:28.277374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.000 qpair failed and we were unable to recover it. 00:27:48.000 [2024-11-21 03:44:28.277480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.000 [2024-11-21 03:44:28.277604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-21 03:44:28.277630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.001 qpair failed and we were unable to recover it. 00:27:48.001 [2024-11-21 03:44:28.277734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-21 03:44:28.277861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-21 03:44:28.277887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.001 qpair failed and we were unable to recover it. 00:27:48.001 [2024-11-21 03:44:28.278044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-21 03:44:28.278180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-21 03:44:28.278205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.001 qpair failed and we were unable to recover it. 00:27:48.001 [2024-11-21 03:44:28.278302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-21 03:44:28.278398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-21 03:44:28.278424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.001 qpair failed and we were unable to recover it. 00:27:48.001 [2024-11-21 03:44:28.278554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-21 03:44:28.278680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-21 03:44:28.278705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.001 qpair failed and we were unable to recover it. 00:27:48.001 [2024-11-21 03:44:28.278813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-21 03:44:28.278913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-21 03:44:28.278937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.001 qpair failed and we were unable to recover it. 00:27:48.001 [2024-11-21 03:44:28.279067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-21 03:44:28.279180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-21 03:44:28.279205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.001 qpair failed and we were unable to recover it. 00:27:48.001 [2024-11-21 03:44:28.279339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-21 03:44:28.279440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-21 03:44:28.279464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.001 qpair failed and we were unable to recover it. 00:27:48.001 [2024-11-21 03:44:28.279563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-21 03:44:28.279690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-21 03:44:28.279716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.001 qpair failed and we were unable to recover it. 00:27:48.001 [2024-11-21 03:44:28.279853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-21 03:44:28.279953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-21 03:44:28.279977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.001 qpair failed and we were unable to recover it. 00:27:48.001 [2024-11-21 03:44:28.280083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-21 03:44:28.280208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-21 03:44:28.280234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.001 qpair failed and we were unable to recover it. 00:27:48.001 [2024-11-21 03:44:28.280332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-21 03:44:28.280460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-21 03:44:28.280485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.001 qpair failed and we were unable to recover it. 00:27:48.001 [2024-11-21 03:44:28.280587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-21 03:44:28.280718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-21 03:44:28.280743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.001 qpair failed and we were unable to recover it. 00:27:48.001 [2024-11-21 03:44:28.280867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-21 03:44:28.280968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-21 03:44:28.280992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.001 qpair failed and we were unable to recover it. 00:27:48.001 [2024-11-21 03:44:28.281094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-21 03:44:28.281195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-21 03:44:28.281220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.001 qpair failed and we were unable to recover it. 00:27:48.001 [2024-11-21 03:44:28.281348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-21 03:44:28.281448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-21 03:44:28.281473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.001 qpair failed and we were unable to recover it. 00:27:48.001 [2024-11-21 03:44:28.281573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-21 03:44:28.281698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-21 03:44:28.281723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.001 qpair failed and we were unable to recover it. 00:27:48.001 [2024-11-21 03:44:28.281857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-21 03:44:28.281960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-21 03:44:28.281985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.001 qpair failed and we were unable to recover it. 00:27:48.001 [2024-11-21 03:44:28.282113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-21 03:44:28.282235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-21 03:44:28.282260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.001 qpair failed and we were unable to recover it. 00:27:48.001 [2024-11-21 03:44:28.282387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-21 03:44:28.282488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-21 03:44:28.282513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.001 qpair failed and we were unable to recover it. 00:27:48.001 [2024-11-21 03:44:28.282641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-21 03:44:28.282770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-21 03:44:28.282795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.001 qpair failed and we were unable to recover it. 00:27:48.001 [2024-11-21 03:44:28.282923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-21 03:44:28.283043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-21 03:44:28.283067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.001 qpair failed and we were unable to recover it. 00:27:48.001 [2024-11-21 03:44:28.283203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-21 03:44:28.283300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-21 03:44:28.283326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.001 qpair failed and we were unable to recover it. 00:27:48.001 [2024-11-21 03:44:28.283428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-21 03:44:28.283553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-21 03:44:28.283578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.001 qpair failed and we were unable to recover it. 00:27:48.001 [2024-11-21 03:44:28.283698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-21 03:44:28.283827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-21 03:44:28.283852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.001 qpair failed and we were unable to recover it. 00:27:48.001 [2024-11-21 03:44:28.283964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.001 [2024-11-21 03:44:28.284061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.002 [2024-11-21 03:44:28.284109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.002 qpair failed and we were unable to recover it. 00:27:48.002 [2024-11-21 03:44:28.284217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.002 [2024-11-21 03:44:28.284322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.002 [2024-11-21 03:44:28.284348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.002 qpair failed and we were unable to recover it. 00:27:48.002 [2024-11-21 03:44:28.284450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.002 [2024-11-21 03:44:28.284554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.002 [2024-11-21 03:44:28.284579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.002 qpair failed and we were unable to recover it. 00:27:48.002 [2024-11-21 03:44:28.284706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.002 [2024-11-21 03:44:28.284804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.002 [2024-11-21 03:44:28.284829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.002 qpair failed and we were unable to recover it. 00:27:48.002 [2024-11-21 03:44:28.284958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.002 [2024-11-21 03:44:28.285086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.002 [2024-11-21 03:44:28.285112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.002 qpair failed and we were unable to recover it. 00:27:48.002 [2024-11-21 03:44:28.285233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.002 [2024-11-21 03:44:28.285327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.002 [2024-11-21 03:44:28.285351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.002 qpair failed and we were unable to recover it. 00:27:48.002 [2024-11-21 03:44:28.285483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.002 [2024-11-21 03:44:28.285610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.002 [2024-11-21 03:44:28.285635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.002 qpair failed and we were unable to recover it. 00:27:48.002 [2024-11-21 03:44:28.285737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.002 [2024-11-21 03:44:28.285863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.002 [2024-11-21 03:44:28.285887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.002 qpair failed and we were unable to recover it. 00:27:48.002 [2024-11-21 03:44:28.285981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.002 [2024-11-21 03:44:28.286110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.002 [2024-11-21 03:44:28.286136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.002 qpair failed and we were unable to recover it. 00:27:48.002 [2024-11-21 03:44:28.286260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.002 [2024-11-21 03:44:28.286360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.002 [2024-11-21 03:44:28.286384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.002 qpair failed and we were unable to recover it. 00:27:48.002 [2024-11-21 03:44:28.286518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.002 [2024-11-21 03:44:28.286618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.002 [2024-11-21 03:44:28.286642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.002 qpair failed and we were unable to recover it. 00:27:48.002 [2024-11-21 03:44:28.286745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.002 [2024-11-21 03:44:28.286851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.002 [2024-11-21 03:44:28.286876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.002 qpair failed and we were unable to recover it. 00:27:48.002 [2024-11-21 03:44:28.286976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.002 [2024-11-21 03:44:28.287106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.002 [2024-11-21 03:44:28.287132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.002 qpair failed and we were unable to recover it. 00:27:48.002 [2024-11-21 03:44:28.287259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.002 [2024-11-21 03:44:28.287362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.002 [2024-11-21 03:44:28.287388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.002 qpair failed and we were unable to recover it. 00:27:48.002 [2024-11-21 03:44:28.287492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.002 [2024-11-21 03:44:28.287621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.002 [2024-11-21 03:44:28.287647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.002 qpair failed and we were unable to recover it. 00:27:48.002 [2024-11-21 03:44:28.287749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.002 [2024-11-21 03:44:28.287876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.002 [2024-11-21 03:44:28.287902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.002 qpair failed and we were unable to recover it. 00:27:48.002 [2024-11-21 03:44:28.288008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.002 [2024-11-21 03:44:28.288131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.002 [2024-11-21 03:44:28.288157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.002 qpair failed and we were unable to recover it. 00:27:48.002 [2024-11-21 03:44:28.288262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.002 [2024-11-21 03:44:28.288386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.002 [2024-11-21 03:44:28.288411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.002 qpair failed and we were unable to recover it. 00:27:48.002 [2024-11-21 03:44:28.288535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.002 [2024-11-21 03:44:28.288638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.002 [2024-11-21 03:44:28.288665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.002 qpair failed and we were unable to recover it. 00:27:48.002 [2024-11-21 03:44:28.288760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.002 [2024-11-21 03:44:28.288887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.002 [2024-11-21 03:44:28.288912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.002 qpair failed and we were unable to recover it. 00:27:48.002 [2024-11-21 03:44:28.289049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.002 [2024-11-21 03:44:28.289192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.002 [2024-11-21 03:44:28.289218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.002 qpair failed and we were unable to recover it. 00:27:48.002 [2024-11-21 03:44:28.289324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.002 [2024-11-21 03:44:28.289428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.002 [2024-11-21 03:44:28.289455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.002 qpair failed and we were unable to recover it. 00:27:48.002 [2024-11-21 03:44:28.289555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.002 [2024-11-21 03:44:28.289653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-21 03:44:28.289679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.003 qpair failed and we were unable to recover it. 00:27:48.003 [2024-11-21 03:44:28.289779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-21 03:44:28.289876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-21 03:44:28.289901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.003 qpair failed and we were unable to recover it. 00:27:48.003 [2024-11-21 03:44:28.290028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-21 03:44:28.290139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-21 03:44:28.290165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.003 qpair failed and we were unable to recover it. 00:27:48.003 [2024-11-21 03:44:28.290264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-21 03:44:28.290371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-21 03:44:28.290397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.003 qpair failed and we were unable to recover it. 00:27:48.003 [2024-11-21 03:44:28.290496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-21 03:44:28.290620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-21 03:44:28.290646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.003 qpair failed and we were unable to recover it. 00:27:48.003 [2024-11-21 03:44:28.290748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-21 03:44:28.290902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-21 03:44:28.290926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.003 qpair failed and we were unable to recover it. 00:27:48.003 [2024-11-21 03:44:28.291061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-21 03:44:28.291197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-21 03:44:28.291221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.003 qpair failed and we were unable to recover it. 00:27:48.003 [2024-11-21 03:44:28.291319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-21 03:44:28.291423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-21 03:44:28.291448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.003 qpair failed and we were unable to recover it. 00:27:48.003 [2024-11-21 03:44:28.291575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-21 03:44:28.291690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-21 03:44:28.291716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.003 qpair failed and we were unable to recover it. 00:27:48.003 [2024-11-21 03:44:28.291841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-21 03:44:28.291938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-21 03:44:28.291963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.003 qpair failed and we were unable to recover it. 00:27:48.003 [2024-11-21 03:44:28.292101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-21 03:44:28.292231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-21 03:44:28.292256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.003 qpair failed and we were unable to recover it. 00:27:48.003 [2024-11-21 03:44:28.292366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-21 03:44:28.292460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-21 03:44:28.292484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.003 qpair failed and we were unable to recover it. 00:27:48.003 [2024-11-21 03:44:28.292576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-21 03:44:28.292697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-21 03:44:28.292722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.003 qpair failed and we were unable to recover it. 00:27:48.003 [2024-11-21 03:44:28.292852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-21 03:44:28.292950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-21 03:44:28.292975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.003 qpair failed and we were unable to recover it. 00:27:48.003 [2024-11-21 03:44:28.293084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-21 03:44:28.293214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-21 03:44:28.293240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.003 qpair failed and we were unable to recover it. 00:27:48.003 [2024-11-21 03:44:28.293367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-21 03:44:28.293492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-21 03:44:28.293517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.003 qpair failed and we were unable to recover it. 00:27:48.003 [2024-11-21 03:44:28.293615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-21 03:44:28.293748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-21 03:44:28.293775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.003 qpair failed and we were unable to recover it. 00:27:48.003 [2024-11-21 03:44:28.293877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-21 03:44:28.294004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-21 03:44:28.294030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.003 qpair failed and we were unable to recover it. 00:27:48.003 [2024-11-21 03:44:28.294167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-21 03:44:28.294279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-21 03:44:28.294303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.003 qpair failed and we were unable to recover it. 00:27:48.003 [2024-11-21 03:44:28.294405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-21 03:44:28.294531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-21 03:44:28.294556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.003 qpair failed and we were unable to recover it. 00:27:48.003 [2024-11-21 03:44:28.294659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-21 03:44:28.294788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-21 03:44:28.294815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.003 qpair failed and we were unable to recover it. 00:27:48.003 [2024-11-21 03:44:28.294946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-21 03:44:28.295058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-21 03:44:28.295089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.003 qpair failed and we were unable to recover it. 00:27:48.003 [2024-11-21 03:44:28.295226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-21 03:44:28.295330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-21 03:44:28.295356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.003 qpair failed and we were unable to recover it. 00:27:48.003 [2024-11-21 03:44:28.295488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-21 03:44:28.295592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-21 03:44:28.295619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.003 qpair failed and we were unable to recover it. 00:27:48.003 [2024-11-21 03:44:28.295717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-21 03:44:28.295836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.003 [2024-11-21 03:44:28.295861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.004 qpair failed and we were unable to recover it. 00:27:48.004 [2024-11-21 03:44:28.295965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.004 [2024-11-21 03:44:28.296098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.004 [2024-11-21 03:44:28.296126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.004 qpair failed and we were unable to recover it. 00:27:48.004 [2024-11-21 03:44:28.296237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.004 [2024-11-21 03:44:28.296335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.004 [2024-11-21 03:44:28.296360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.004 qpair failed and we were unable to recover it. 00:27:48.004 [2024-11-21 03:44:28.296493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.004 [2024-11-21 03:44:28.296590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.004 [2024-11-21 03:44:28.296616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.004 qpair failed and we were unable to recover it. 00:27:48.004 [2024-11-21 03:44:28.296709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.004 [2024-11-21 03:44:28.296844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.004 [2024-11-21 03:44:28.296869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.004 qpair failed and we were unable to recover it. 00:27:48.004 [2024-11-21 03:44:28.296972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.004 [2024-11-21 03:44:28.297066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.004 [2024-11-21 03:44:28.297098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.004 qpair failed and we were unable to recover it. 00:27:48.004 [2024-11-21 03:44:28.297229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.004 [2024-11-21 03:44:28.297361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.004 [2024-11-21 03:44:28.297387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.004 qpair failed and we were unable to recover it. 00:27:48.004 [2024-11-21 03:44:28.297487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.004 [2024-11-21 03:44:28.297617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.004 [2024-11-21 03:44:28.297644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.004 qpair failed and we were unable to recover it. 00:27:48.004 [2024-11-21 03:44:28.297750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.004 [2024-11-21 03:44:28.297852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.004 [2024-11-21 03:44:28.297877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.004 qpair failed and we were unable to recover it. 00:27:48.004 [2024-11-21 03:44:28.297975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.004 [2024-11-21 03:44:28.298100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.004 [2024-11-21 03:44:28.298126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.004 qpair failed and we were unable to recover it. 00:27:48.004 [2024-11-21 03:44:28.298255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.004 [2024-11-21 03:44:28.298357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.004 [2024-11-21 03:44:28.298383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.004 qpair failed and we were unable to recover it. 00:27:48.004 [2024-11-21 03:44:28.298517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.004 [2024-11-21 03:44:28.298610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.004 [2024-11-21 03:44:28.298635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.004 qpair failed and we were unable to recover it. 00:27:48.004 [2024-11-21 03:44:28.298737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.004 [2024-11-21 03:44:28.298842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.004 [2024-11-21 03:44:28.298867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.004 qpair failed and we were unable to recover it. 00:27:48.004 [2024-11-21 03:44:28.298965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.004 [2024-11-21 03:44:28.299061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.004 [2024-11-21 03:44:28.299090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.004 qpair failed and we were unable to recover it. 00:27:48.004 [2024-11-21 03:44:28.299224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.004 [2024-11-21 03:44:28.299340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.004 [2024-11-21 03:44:28.299365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.004 qpair failed and we were unable to recover it. 00:27:48.004 [2024-11-21 03:44:28.299476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.004 [2024-11-21 03:44:28.299626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.004 [2024-11-21 03:44:28.299651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.004 qpair failed and we were unable to recover it. 00:27:48.004 [2024-11-21 03:44:28.299745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.004 [2024-11-21 03:44:28.299843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.004 [2024-11-21 03:44:28.299867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.004 qpair failed and we were unable to recover it. 00:27:48.004 [2024-11-21 03:44:28.299971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.004 [2024-11-21 03:44:28.300110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.004 [2024-11-21 03:44:28.300135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.004 qpair failed and we were unable to recover it. 00:27:48.004 [2024-11-21 03:44:28.300242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.004 [2024-11-21 03:44:28.300362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.004 [2024-11-21 03:44:28.300387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.004 qpair failed and we were unable to recover it. 00:27:48.004 [2024-11-21 03:44:28.300486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.004 [2024-11-21 03:44:28.300576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.004 [2024-11-21 03:44:28.300600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.004 qpair failed and we were unable to recover it. 00:27:48.004 [2024-11-21 03:44:28.300696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.004 [2024-11-21 03:44:28.300821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.004 [2024-11-21 03:44:28.300846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.004 qpair failed and we were unable to recover it. 00:27:48.004 [2024-11-21 03:44:28.300983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.004 [2024-11-21 03:44:28.301086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.005 [2024-11-21 03:44:28.301111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.005 qpair failed and we were unable to recover it. 00:27:48.005 [2024-11-21 03:44:28.301212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.005 [2024-11-21 03:44:28.301336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.005 [2024-11-21 03:44:28.301361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.005 qpair failed and we were unable to recover it. 00:27:48.005 [2024-11-21 03:44:28.301483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.005 [2024-11-21 03:44:28.301588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.005 [2024-11-21 03:44:28.301614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.005 qpair failed and we were unable to recover it. 00:27:48.005 [2024-11-21 03:44:28.301709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.005 [2024-11-21 03:44:28.301830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.005 [2024-11-21 03:44:28.301859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.005 qpair failed and we were unable to recover it. 00:27:48.005 [2024-11-21 03:44:28.301957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.005 [2024-11-21 03:44:28.302055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.005 [2024-11-21 03:44:28.302104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.005 qpair failed and we were unable to recover it. 00:27:48.005 [2024-11-21 03:44:28.302205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.005 [2024-11-21 03:44:28.302362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.005 [2024-11-21 03:44:28.302387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.005 qpair failed and we were unable to recover it. 00:27:48.005 [2024-11-21 03:44:28.302484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.005 [2024-11-21 03:44:28.302612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.005 [2024-11-21 03:44:28.302637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.005 qpair failed and we were unable to recover it. 00:27:48.005 [2024-11-21 03:44:28.302744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.005 [2024-11-21 03:44:28.302875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.005 [2024-11-21 03:44:28.302899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.005 qpair failed and we were unable to recover it. 00:27:48.005 [2024-11-21 03:44:28.303007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.005 [2024-11-21 03:44:28.303104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.005 [2024-11-21 03:44:28.303129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.005 qpair failed and we were unable to recover it. 00:27:48.005 [2024-11-21 03:44:28.303263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.005 [2024-11-21 03:44:28.303369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.005 [2024-11-21 03:44:28.303394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.005 qpair failed and we were unable to recover it. 00:27:48.005 [2024-11-21 03:44:28.303523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.005 [2024-11-21 03:44:28.303628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.005 [2024-11-21 03:44:28.303652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.005 qpair failed and we were unable to recover it. 00:27:48.005 [2024-11-21 03:44:28.303751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.005 [2024-11-21 03:44:28.303860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.005 [2024-11-21 03:44:28.303885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.005 qpair failed and we were unable to recover it. 00:27:48.005 [2024-11-21 03:44:28.304017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.005 [2024-11-21 03:44:28.304117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.005 [2024-11-21 03:44:28.304143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.005 qpair failed and we were unable to recover it. 00:27:48.005 [2024-11-21 03:44:28.304247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.005 [2024-11-21 03:44:28.304408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.005 [2024-11-21 03:44:28.304438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.005 qpair failed and we were unable to recover it. 00:27:48.005 [2024-11-21 03:44:28.304575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.005 [2024-11-21 03:44:28.304675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.005 [2024-11-21 03:44:28.304701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.005 qpair failed and we were unable to recover it. 00:27:48.005 [2024-11-21 03:44:28.304825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.005 [2024-11-21 03:44:28.304929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.005 [2024-11-21 03:44:28.304955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.005 qpair failed and we were unable to recover it. 00:27:48.005 [2024-11-21 03:44:28.305086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.005 [2024-11-21 03:44:28.305181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.005 [2024-11-21 03:44:28.305206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.005 qpair failed and we were unable to recover it. 00:27:48.005 [2024-11-21 03:44:28.305304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.005 [2024-11-21 03:44:28.305396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.005 [2024-11-21 03:44:28.305421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.005 qpair failed and we were unable to recover it. 00:27:48.005 [2024-11-21 03:44:28.305520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.005 [2024-11-21 03:44:28.305642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.005 [2024-11-21 03:44:28.305667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.005 qpair failed and we were unable to recover it. 00:27:48.005 [2024-11-21 03:44:28.305791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.005 [2024-11-21 03:44:28.305921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.005 [2024-11-21 03:44:28.305947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.005 qpair failed and we were unable to recover it. 00:27:48.005 [2024-11-21 03:44:28.306067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.005 [2024-11-21 03:44:28.306195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.005 [2024-11-21 03:44:28.306221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.005 qpair failed and we were unable to recover it. 00:27:48.005 [2024-11-21 03:44:28.306331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.005 [2024-11-21 03:44:28.306462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.005 [2024-11-21 03:44:28.306487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.005 qpair failed and we were unable to recover it. 00:27:48.005 [2024-11-21 03:44:28.306598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.005 [2024-11-21 03:44:28.306699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.005 [2024-11-21 03:44:28.306725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.006 qpair failed and we were unable to recover it. 00:27:48.006 [2024-11-21 03:44:28.306837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-21 03:44:28.306940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-21 03:44:28.306975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.006 qpair failed and we were unable to recover it. 00:27:48.006 [2024-11-21 03:44:28.307106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-21 03:44:28.307203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-21 03:44:28.307229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.006 qpair failed and we were unable to recover it. 00:27:48.006 [2024-11-21 03:44:28.307332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-21 03:44:28.307434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-21 03:44:28.307459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.006 qpair failed and we were unable to recover it. 00:27:48.006 [2024-11-21 03:44:28.307557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-21 03:44:28.307669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-21 03:44:28.307694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.006 qpair failed and we were unable to recover it. 00:27:48.006 [2024-11-21 03:44:28.307826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-21 03:44:28.307933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-21 03:44:28.307959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.006 qpair failed and we were unable to recover it. 00:27:48.006 [2024-11-21 03:44:28.308065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-21 03:44:28.308199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-21 03:44:28.308224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.006 qpair failed and we were unable to recover it. 00:27:48.006 [2024-11-21 03:44:28.308355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-21 03:44:28.308507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-21 03:44:28.308532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.006 qpair failed and we were unable to recover it. 00:27:48.006 [2024-11-21 03:44:28.308624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-21 03:44:28.308719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-21 03:44:28.308745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.006 qpair failed and we were unable to recover it. 00:27:48.006 [2024-11-21 03:44:28.308838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-21 03:44:28.308958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-21 03:44:28.308982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.006 qpair failed and we were unable to recover it. 00:27:48.006 [2024-11-21 03:44:28.309117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-21 03:44:28.309231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-21 03:44:28.309258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.006 qpair failed and we were unable to recover it. 00:27:48.006 [2024-11-21 03:44:28.309386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-21 03:44:28.309484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-21 03:44:28.309515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.006 qpair failed and we were unable to recover it. 00:27:48.006 [2024-11-21 03:44:28.309616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-21 03:44:28.309711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-21 03:44:28.309736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.006 qpair failed and we were unable to recover it. 00:27:48.006 [2024-11-21 03:44:28.309861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-21 03:44:28.309961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-21 03:44:28.309986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.006 qpair failed and we were unable to recover it. 00:27:48.006 [2024-11-21 03:44:28.310088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-21 03:44:28.310213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-21 03:44:28.310239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.006 qpair failed and we were unable to recover it. 00:27:48.006 [2024-11-21 03:44:28.310397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-21 03:44:28.310527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-21 03:44:28.310552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.006 qpair failed and we were unable to recover it. 00:27:48.006 [2024-11-21 03:44:28.310675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-21 03:44:28.310808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-21 03:44:28.310834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.006 qpair failed and we were unable to recover it. 00:27:48.006 [2024-11-21 03:44:28.310956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-21 03:44:28.311090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-21 03:44:28.311117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.006 qpair failed and we were unable to recover it. 00:27:48.006 [2024-11-21 03:44:28.311214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-21 03:44:28.311316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-21 03:44:28.311343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.006 qpair failed and we were unable to recover it. 00:27:48.006 [2024-11-21 03:44:28.311446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-21 03:44:28.311545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-21 03:44:28.311571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.006 qpair failed and we were unable to recover it. 00:27:48.006 [2024-11-21 03:44:28.311678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-21 03:44:28.311837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-21 03:44:28.311864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.006 qpair failed and we were unable to recover it. 00:27:48.006 [2024-11-21 03:44:28.311996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-21 03:44:28.312102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-21 03:44:28.312128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.006 qpair failed and we were unable to recover it. 00:27:48.006 [2024-11-21 03:44:28.312232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-21 03:44:28.312361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-21 03:44:28.312386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.006 qpair failed and we were unable to recover it. 00:27:48.006 [2024-11-21 03:44:28.312498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-21 03:44:28.312625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-21 03:44:28.312650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.006 qpair failed and we were unable to recover it. 00:27:48.006 [2024-11-21 03:44:28.312785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-21 03:44:28.312879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-21 03:44:28.312904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.006 qpair failed and we were unable to recover it. 00:27:48.006 [2024-11-21 03:44:28.313041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-21 03:44:28.313141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-21 03:44:28.313167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.006 qpair failed and we were unable to recover it. 00:27:48.006 [2024-11-21 03:44:28.313273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-21 03:44:28.313367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-21 03:44:28.313393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.006 qpair failed and we were unable to recover it. 00:27:48.006 [2024-11-21 03:44:28.313502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.006 [2024-11-21 03:44:28.313596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.007 [2024-11-21 03:44:28.313621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.007 qpair failed and we were unable to recover it. 00:27:48.007 [2024-11-21 03:44:28.313740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.007 [2024-11-21 03:44:28.313849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.007 [2024-11-21 03:44:28.313874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.007 qpair failed and we were unable to recover it. 00:27:48.007 [2024-11-21 03:44:28.313970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.007 [2024-11-21 03:44:28.314077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.007 [2024-11-21 03:44:28.314102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.007 qpair failed and we were unable to recover it. 00:27:48.007 [2024-11-21 03:44:28.314237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.007 [2024-11-21 03:44:28.314366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.007 [2024-11-21 03:44:28.314393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.007 qpair failed and we were unable to recover it. 00:27:48.007 [2024-11-21 03:44:28.314504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.007 [2024-11-21 03:44:28.314604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.007 [2024-11-21 03:44:28.314629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.007 qpair failed and we were unable to recover it. 00:27:48.007 [2024-11-21 03:44:28.314768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.007 [2024-11-21 03:44:28.314875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.007 [2024-11-21 03:44:28.314902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.007 qpair failed and we were unable to recover it. 00:27:48.007 [2024-11-21 03:44:28.315042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.007 [2024-11-21 03:44:28.315154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.007 [2024-11-21 03:44:28.315180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.007 qpair failed and we were unable to recover it. 00:27:48.007 [2024-11-21 03:44:28.315278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.007 [2024-11-21 03:44:28.315382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.007 [2024-11-21 03:44:28.315407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.007 qpair failed and we were unable to recover it. 00:27:48.007 [2024-11-21 03:44:28.315532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.007 [2024-11-21 03:44:28.315666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.007 [2024-11-21 03:44:28.315692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.007 qpair failed and we were unable to recover it. 00:27:48.007 [2024-11-21 03:44:28.315805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.007 [2024-11-21 03:44:28.315932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.007 [2024-11-21 03:44:28.315957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.007 qpair failed and we were unable to recover it. 00:27:48.007 [2024-11-21 03:44:28.316060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.007 [2024-11-21 03:44:28.316202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.007 [2024-11-21 03:44:28.316227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.007 qpair failed and we were unable to recover it. 00:27:48.007 [2024-11-21 03:44:28.316334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.007 [2024-11-21 03:44:28.316429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.007 [2024-11-21 03:44:28.316455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.007 qpair failed and we were unable to recover it. 00:27:48.007 [2024-11-21 03:44:28.316586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.007 [2024-11-21 03:44:28.316691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.007 [2024-11-21 03:44:28.316717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.007 qpair failed and we were unable to recover it. 00:27:48.007 [2024-11-21 03:44:28.316815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.007 [2024-11-21 03:44:28.316908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.007 [2024-11-21 03:44:28.316933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.007 qpair failed and we were unable to recover it. 00:27:48.007 [2024-11-21 03:44:28.317028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.007 [2024-11-21 03:44:28.317148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.007 [2024-11-21 03:44:28.317174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.007 qpair failed and we were unable to recover it. 00:27:48.007 [2024-11-21 03:44:28.317336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.007 [2024-11-21 03:44:28.317460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.007 [2024-11-21 03:44:28.317486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.007 qpair failed and we were unable to recover it. 00:27:48.007 [2024-11-21 03:44:28.317619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.007 [2024-11-21 03:44:28.317726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.007 [2024-11-21 03:44:28.317753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.007 qpair failed and we were unable to recover it. 00:27:48.007 [2024-11-21 03:44:28.317853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.007 [2024-11-21 03:44:28.317946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.007 [2024-11-21 03:44:28.317971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.007 qpair failed and we were unable to recover it. 00:27:48.007 [2024-11-21 03:44:28.318080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.007 [2024-11-21 03:44:28.318204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.007 [2024-11-21 03:44:28.318229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.007 qpair failed and we were unable to recover it. 00:27:48.007 [2024-11-21 03:44:28.318334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.007 [2024-11-21 03:44:28.318461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.007 [2024-11-21 03:44:28.318485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.007 qpair failed and we were unable to recover it. 00:27:48.007 [2024-11-21 03:44:28.318585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.007 [2024-11-21 03:44:28.318676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.007 [2024-11-21 03:44:28.318701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.007 qpair failed and we were unable to recover it. 00:27:48.007 [2024-11-21 03:44:28.318826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.007 [2024-11-21 03:44:28.318933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.007 [2024-11-21 03:44:28.318958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.007 qpair failed and we were unable to recover it. 00:27:48.007 [2024-11-21 03:44:28.319082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.007 [2024-11-21 03:44:28.319194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.007 [2024-11-21 03:44:28.319219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.007 qpair failed and we were unable to recover it. 00:27:48.007 [2024-11-21 03:44:28.319342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.007 [2024-11-21 03:44:28.319436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.007 [2024-11-21 03:44:28.319460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.008 qpair failed and we were unable to recover it. 00:27:48.008 [2024-11-21 03:44:28.319567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.008 [2024-11-21 03:44:28.319658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.008 [2024-11-21 03:44:28.319683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.008 qpair failed and we were unable to recover it. 00:27:48.008 [2024-11-21 03:44:28.319817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.008 [2024-11-21 03:44:28.319909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.008 [2024-11-21 03:44:28.319934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.008 qpair failed and we were unable to recover it. 00:27:48.008 [2024-11-21 03:44:28.320036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.008 [2024-11-21 03:44:28.320164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.008 [2024-11-21 03:44:28.320190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.008 qpair failed and we were unable to recover it. 00:27:48.008 [2024-11-21 03:44:28.320289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.008 [2024-11-21 03:44:28.320393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.008 [2024-11-21 03:44:28.320419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.008 qpair failed and we were unable to recover it. 00:27:48.008 [2024-11-21 03:44:28.320546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.008 [2024-11-21 03:44:28.320649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.008 [2024-11-21 03:44:28.320674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.008 qpair failed and we were unable to recover it. 00:27:48.008 [2024-11-21 03:44:28.320798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.008 [2024-11-21 03:44:28.320893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.008 [2024-11-21 03:44:28.320917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.008 qpair failed and we were unable to recover it. 00:27:48.008 [2024-11-21 03:44:28.321016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.008 [2024-11-21 03:44:28.321144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.008 [2024-11-21 03:44:28.321169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.008 qpair failed and we were unable to recover it. 00:27:48.008 [2024-11-21 03:44:28.321277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.008 [2024-11-21 03:44:28.321405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.008 [2024-11-21 03:44:28.321429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.008 qpair failed and we were unable to recover it. 00:27:48.008 [2024-11-21 03:44:28.321529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.008 [2024-11-21 03:44:28.321626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.008 [2024-11-21 03:44:28.321650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.008 qpair failed and we were unable to recover it. 00:27:48.008 [2024-11-21 03:44:28.321740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.008 [2024-11-21 03:44:28.321833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.008 [2024-11-21 03:44:28.321857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.008 qpair failed and we were unable to recover it. 00:27:48.008 [2024-11-21 03:44:28.321968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.008 [2024-11-21 03:44:28.322065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.008 [2024-11-21 03:44:28.322095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.008 qpair failed and we were unable to recover it. 00:27:48.008 [2024-11-21 03:44:28.322235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.008 [2024-11-21 03:44:28.322338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.008 [2024-11-21 03:44:28.322362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.008 qpair failed and we were unable to recover it. 00:27:48.008 [2024-11-21 03:44:28.322490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.008 [2024-11-21 03:44:28.322594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.008 [2024-11-21 03:44:28.322619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.008 qpair failed and we were unable to recover it. 00:27:48.008 [2024-11-21 03:44:28.322751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.008 [2024-11-21 03:44:28.322853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.008 [2024-11-21 03:44:28.322878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.008 qpair failed and we were unable to recover it. 00:27:48.008 [2024-11-21 03:44:28.323005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.008 [2024-11-21 03:44:28.323145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.008 [2024-11-21 03:44:28.323171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.008 qpair failed and we were unable to recover it. 00:27:48.008 [2024-11-21 03:44:28.323299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.008 [2024-11-21 03:44:28.323399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.008 [2024-11-21 03:44:28.323423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.008 qpair failed and we were unable to recover it. 00:27:48.008 [2024-11-21 03:44:28.323553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.008 [2024-11-21 03:44:28.323642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.008 [2024-11-21 03:44:28.323666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.008 qpair failed and we were unable to recover it. 00:27:48.008 [2024-11-21 03:44:28.323764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.008 [2024-11-21 03:44:28.323890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.008 [2024-11-21 03:44:28.323916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.008 qpair failed and we were unable to recover it. 00:27:48.008 [2024-11-21 03:44:28.324020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.008 [2024-11-21 03:44:28.324117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.008 [2024-11-21 03:44:28.324143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.008 qpair failed and we were unable to recover it. 00:27:48.008 [2024-11-21 03:44:28.324242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.008 [2024-11-21 03:44:28.324365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.008 [2024-11-21 03:44:28.324389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.008 qpair failed and we were unable to recover it. 00:27:48.008 [2024-11-21 03:44:28.324485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.008 [2024-11-21 03:44:28.324577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.008 [2024-11-21 03:44:28.324602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.008 qpair failed and we were unable to recover it. 00:27:48.008 [2024-11-21 03:44:28.324732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.008 [2024-11-21 03:44:28.324864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.008 [2024-11-21 03:44:28.324889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.008 qpair failed and we were unable to recover it. 00:27:48.008 [2024-11-21 03:44:28.324991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.009 [2024-11-21 03:44:28.325091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.009 [2024-11-21 03:44:28.325117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.009 qpair failed and we were unable to recover it. 00:27:48.009 [2024-11-21 03:44:28.325247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.009 [2024-11-21 03:44:28.325348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.009 [2024-11-21 03:44:28.325373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.009 qpair failed and we were unable to recover it. 00:27:48.009 [2024-11-21 03:44:28.325512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.009 [2024-11-21 03:44:28.325637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.009 [2024-11-21 03:44:28.325662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.009 qpair failed and we were unable to recover it. 00:27:48.009 [2024-11-21 03:44:28.325754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.009 [2024-11-21 03:44:28.325871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.009 [2024-11-21 03:44:28.325897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.009 qpair failed and we were unable to recover it. 00:27:48.009 [2024-11-21 03:44:28.326028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.009 [2024-11-21 03:44:28.326134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.009 [2024-11-21 03:44:28.326161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.009 qpair failed and we were unable to recover it. 00:27:48.009 [2024-11-21 03:44:28.326258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.009 [2024-11-21 03:44:28.326389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.009 [2024-11-21 03:44:28.326414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.009 qpair failed and we were unable to recover it. 00:27:48.009 [2024-11-21 03:44:28.326517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.009 [2024-11-21 03:44:28.326619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.009 [2024-11-21 03:44:28.326645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.009 qpair failed and we were unable to recover it. 00:27:48.009 [2024-11-21 03:44:28.326752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.009 [2024-11-21 03:44:28.326854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.009 [2024-11-21 03:44:28.326879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.009 qpair failed and we were unable to recover it. 00:27:48.009 [2024-11-21 03:44:28.326971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.009 [2024-11-21 03:44:28.327076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.009 [2024-11-21 03:44:28.327103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.009 qpair failed and we were unable to recover it. 00:27:48.009 [2024-11-21 03:44:28.327210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.009 [2024-11-21 03:44:28.327311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.009 [2024-11-21 03:44:28.327335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.009 qpair failed and we were unable to recover it. 00:27:48.009 [2024-11-21 03:44:28.327467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.009 [2024-11-21 03:44:28.327560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.009 [2024-11-21 03:44:28.327585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.009 qpair failed and we were unable to recover it. 00:27:48.009 [2024-11-21 03:44:28.327713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.009 [2024-11-21 03:44:28.327806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.009 [2024-11-21 03:44:28.327832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.009 qpair failed and we were unable to recover it. 00:27:48.009 [2024-11-21 03:44:28.327933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.009 [2024-11-21 03:44:28.328040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.009 [2024-11-21 03:44:28.328067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.009 qpair failed and we were unable to recover it. 00:27:48.009 [2024-11-21 03:44:28.328179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.009 [2024-11-21 03:44:28.328272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.009 [2024-11-21 03:44:28.328296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.009 qpair failed and we were unable to recover it. 00:27:48.009 [2024-11-21 03:44:28.328433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.009 [2024-11-21 03:44:28.328525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.009 [2024-11-21 03:44:28.328550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.009 qpair failed and we were unable to recover it. 00:27:48.009 [2024-11-21 03:44:28.328681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.009 [2024-11-21 03:44:28.328781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.009 [2024-11-21 03:44:28.328805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.009 qpair failed and we were unable to recover it. 00:27:48.009 [2024-11-21 03:44:28.328901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.009 [2024-11-21 03:44:28.329003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.009 [2024-11-21 03:44:28.329029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.009 qpair failed and we were unable to recover it. 00:27:48.009 [2024-11-21 03:44:28.329184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.009 [2024-11-21 03:44:28.329307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.009 [2024-11-21 03:44:28.329332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.009 qpair failed and we were unable to recover it. 00:27:48.009 [2024-11-21 03:44:28.329441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.009 [2024-11-21 03:44:28.329574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.009 [2024-11-21 03:44:28.329599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.009 qpair failed and we were unable to recover it. 00:27:48.009 [2024-11-21 03:44:28.329756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.009 [2024-11-21 03:44:28.329858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.009 [2024-11-21 03:44:28.329883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.009 qpair failed and we were unable to recover it. 00:27:48.009 [2024-11-21 03:44:28.329983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.009 [2024-11-21 03:44:28.330116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.009 [2024-11-21 03:44:28.330143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.009 qpair failed and we were unable to recover it. 00:27:48.009 [2024-11-21 03:44:28.330248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.009 [2024-11-21 03:44:28.330350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.010 [2024-11-21 03:44:28.330375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.010 qpair failed and we were unable to recover it. 00:27:48.010 [2024-11-21 03:44:28.330470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.010 [2024-11-21 03:44:28.330564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.010 [2024-11-21 03:44:28.330589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.010 qpair failed and we were unable to recover it. 00:27:48.010 [2024-11-21 03:44:28.330725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.010 [2024-11-21 03:44:28.330852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.010 [2024-11-21 03:44:28.330878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.010 qpair failed and we were unable to recover it. 00:27:48.010 [2024-11-21 03:44:28.330988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.010 [2024-11-21 03:44:28.331080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.010 [2024-11-21 03:44:28.331105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.010 qpair failed and we were unable to recover it. 00:27:48.010 [2024-11-21 03:44:28.331228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.010 [2024-11-21 03:44:28.331326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.010 [2024-11-21 03:44:28.331351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.010 qpair failed and we were unable to recover it. 00:27:48.010 [2024-11-21 03:44:28.331451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.010 [2024-11-21 03:44:28.331578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.010 [2024-11-21 03:44:28.331603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.010 qpair failed and we were unable to recover it. 00:27:48.010 [2024-11-21 03:44:28.331713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.010 [2024-11-21 03:44:28.331843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.010 [2024-11-21 03:44:28.331869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.010 qpair failed and we were unable to recover it. 00:27:48.010 [2024-11-21 03:44:28.331974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.010 [2024-11-21 03:44:28.332078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.010 [2024-11-21 03:44:28.332104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.010 qpair failed and we were unable to recover it. 00:27:48.010 [2024-11-21 03:44:28.332207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.010 [2024-11-21 03:44:28.332315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.010 [2024-11-21 03:44:28.332340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.010 qpair failed and we were unable to recover it. 00:27:48.010 [2024-11-21 03:44:28.332443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.010 [2024-11-21 03:44:28.332600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.010 [2024-11-21 03:44:28.332626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.010 qpair failed and we were unable to recover it. 00:27:48.010 [2024-11-21 03:44:28.332728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.010 [2024-11-21 03:44:28.332825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.010 [2024-11-21 03:44:28.332851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.010 qpair failed and we were unable to recover it. 00:27:48.010 [2024-11-21 03:44:28.332952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.010 [2024-11-21 03:44:28.333057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.010 [2024-11-21 03:44:28.333088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.010 qpair failed and we were unable to recover it. 00:27:48.010 [2024-11-21 03:44:28.333191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.010 [2024-11-21 03:44:28.333290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.010 [2024-11-21 03:44:28.333316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.010 qpair failed and we were unable to recover it. 00:27:48.010 [2024-11-21 03:44:28.333446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.010 [2024-11-21 03:44:28.333551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.010 [2024-11-21 03:44:28.333575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.010 qpair failed and we were unable to recover it. 00:27:48.010 [2024-11-21 03:44:28.333671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.010 [2024-11-21 03:44:28.333802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.010 [2024-11-21 03:44:28.333827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.010 qpair failed and we were unable to recover it. 00:27:48.010 [2024-11-21 03:44:28.333957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.010 [2024-11-21 03:44:28.334094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.010 [2024-11-21 03:44:28.334121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.010 qpair failed and we were unable to recover it. 00:27:48.010 [2024-11-21 03:44:28.334226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.010 [2024-11-21 03:44:28.334357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.010 [2024-11-21 03:44:28.334382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.010 qpair failed and we were unable to recover it. 00:27:48.010 [2024-11-21 03:44:28.334490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.010 [2024-11-21 03:44:28.334594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.010 [2024-11-21 03:44:28.334618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.010 qpair failed and we were unable to recover it. 00:27:48.010 [2024-11-21 03:44:28.334710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.010 [2024-11-21 03:44:28.334816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.010 [2024-11-21 03:44:28.334841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.010 qpair failed and we were unable to recover it. 00:27:48.010 [2024-11-21 03:44:28.334944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.010 [2024-11-21 03:44:28.335054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.010 [2024-11-21 03:44:28.335085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.010 qpair failed and we were unable to recover it. 00:27:48.010 [2024-11-21 03:44:28.335214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.010 [2024-11-21 03:44:28.335317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.010 [2024-11-21 03:44:28.335343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.010 qpair failed and we were unable to recover it. 00:27:48.010 [2024-11-21 03:44:28.335448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.010 [2024-11-21 03:44:28.335572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.010 [2024-11-21 03:44:28.335597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.010 qpair failed and we were unable to recover it. 00:27:48.010 [2024-11-21 03:44:28.335724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.010 [2024-11-21 03:44:28.335817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.010 [2024-11-21 03:44:28.335842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.010 qpair failed and we were unable to recover it. 00:27:48.010 [2024-11-21 03:44:28.335968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.010 [2024-11-21 03:44:28.336076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.010 [2024-11-21 03:44:28.336103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.011 qpair failed and we were unable to recover it. 00:27:48.011 [2024-11-21 03:44:28.336211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.011 [2024-11-21 03:44:28.336335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.011 [2024-11-21 03:44:28.336361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.011 qpair failed and we were unable to recover it. 00:27:48.011 [2024-11-21 03:44:28.336493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.011 [2024-11-21 03:44:28.336622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.011 [2024-11-21 03:44:28.336649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.011 qpair failed and we were unable to recover it. 00:27:48.011 [2024-11-21 03:44:28.336750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.011 [2024-11-21 03:44:28.336852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.011 [2024-11-21 03:44:28.336878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.011 qpair failed and we were unable to recover it. 00:27:48.011 [2024-11-21 03:44:28.337007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.011 [2024-11-21 03:44:28.337136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.011 [2024-11-21 03:44:28.337162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.011 qpair failed and we were unable to recover it. 00:27:48.011 [2024-11-21 03:44:28.337294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.011 [2024-11-21 03:44:28.337425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.011 [2024-11-21 03:44:28.337449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.011 qpair failed and we were unable to recover it. 00:27:48.011 [2024-11-21 03:44:28.337580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.011 [2024-11-21 03:44:28.337681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.011 [2024-11-21 03:44:28.337708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.011 qpair failed and we were unable to recover it. 00:27:48.011 [2024-11-21 03:44:28.337838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.011 [2024-11-21 03:44:28.337942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.011 [2024-11-21 03:44:28.337968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.011 qpair failed and we were unable to recover it. 00:27:48.011 [2024-11-21 03:44:28.338067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.011 [2024-11-21 03:44:28.338175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.011 [2024-11-21 03:44:28.338200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.011 qpair failed and we were unable to recover it. 00:27:48.011 [2024-11-21 03:44:28.338301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.011 [2024-11-21 03:44:28.338425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.011 [2024-11-21 03:44:28.338451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.011 qpair failed and we were unable to recover it. 00:27:48.011 [2024-11-21 03:44:28.338586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.011 [2024-11-21 03:44:28.338678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.011 [2024-11-21 03:44:28.338704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.011 qpair failed and we were unable to recover it. 00:27:48.011 [2024-11-21 03:44:28.338805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.011 [2024-11-21 03:44:28.338932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.011 [2024-11-21 03:44:28.338957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.011 qpair failed and we were unable to recover it. 00:27:48.011 [2024-11-21 03:44:28.339062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.011 [2024-11-21 03:44:28.339198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.011 [2024-11-21 03:44:28.339223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.011 qpair failed and we were unable to recover it. 00:27:48.011 [2024-11-21 03:44:28.339323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.011 [2024-11-21 03:44:28.339450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.011 [2024-11-21 03:44:28.339476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.011 qpair failed and we were unable to recover it. 00:27:48.011 [2024-11-21 03:44:28.339609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.011 [2024-11-21 03:44:28.339735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.011 [2024-11-21 03:44:28.339760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.011 qpair failed and we were unable to recover it. 00:27:48.011 [2024-11-21 03:44:28.339870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.011 [2024-11-21 03:44:28.340000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.011 [2024-11-21 03:44:28.340024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.011 qpair failed and we were unable to recover it. 00:27:48.011 [2024-11-21 03:44:28.340135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.011 [2024-11-21 03:44:28.340258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.011 [2024-11-21 03:44:28.340283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.011 qpair failed and we were unable to recover it. 00:27:48.011 [2024-11-21 03:44:28.340382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.011 [2024-11-21 03:44:28.340504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.011 [2024-11-21 03:44:28.340528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.011 qpair failed and we were unable to recover it. 00:27:48.011 [2024-11-21 03:44:28.340659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.012 [2024-11-21 03:44:28.340758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.012 [2024-11-21 03:44:28.340784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.012 qpair failed and we were unable to recover it. 00:27:48.012 [2024-11-21 03:44:28.340888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.012 [2024-11-21 03:44:28.340990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.012 [2024-11-21 03:44:28.341015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.012 qpair failed and we were unable to recover it. 00:27:48.012 [2024-11-21 03:44:28.341150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.012 [2024-11-21 03:44:28.341248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.012 [2024-11-21 03:44:28.341272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.012 qpair failed and we were unable to recover it. 00:27:48.012 [2024-11-21 03:44:28.341373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.012 [2024-11-21 03:44:28.341507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.012 [2024-11-21 03:44:28.341532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.012 qpair failed and we were unable to recover it. 00:27:48.012 [2024-11-21 03:44:28.341639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.012 [2024-11-21 03:44:28.341766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.012 [2024-11-21 03:44:28.341790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.012 qpair failed and we were unable to recover it. 00:27:48.012 [2024-11-21 03:44:28.341942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.012 [2024-11-21 03:44:28.342049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.012 [2024-11-21 03:44:28.342080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.012 qpair failed and we were unable to recover it. 00:27:48.012 [2024-11-21 03:44:28.342186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.012 [2024-11-21 03:44:28.342289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.012 [2024-11-21 03:44:28.342313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.012 qpair failed and we were unable to recover it. 00:27:48.012 [2024-11-21 03:44:28.342417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.012 [2024-11-21 03:44:28.342509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.012 [2024-11-21 03:44:28.342539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.012 qpair failed and we were unable to recover it. 00:27:48.012 [2024-11-21 03:44:28.342646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.012 [2024-11-21 03:44:28.342741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.012 [2024-11-21 03:44:28.342766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.012 qpair failed and we were unable to recover it. 00:27:48.012 [2024-11-21 03:44:28.342920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.012 [2024-11-21 03:44:28.343016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.012 [2024-11-21 03:44:28.343041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.012 qpair failed and we were unable to recover it. 00:27:48.012 [2024-11-21 03:44:28.343149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.012 [2024-11-21 03:44:28.343255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.012 [2024-11-21 03:44:28.343280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.012 qpair failed and we were unable to recover it. 00:27:48.012 [2024-11-21 03:44:28.343437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.012 [2024-11-21 03:44:28.343541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.012 [2024-11-21 03:44:28.343565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.012 qpair failed and we were unable to recover it. 00:27:48.012 [2024-11-21 03:44:28.343667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.012 [2024-11-21 03:44:28.343764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.012 [2024-11-21 03:44:28.343789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.012 qpair failed and we were unable to recover it. 00:27:48.012 [2024-11-21 03:44:28.343880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.012 [2024-11-21 03:44:28.343981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.012 [2024-11-21 03:44:28.344008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.012 qpair failed and we were unable to recover it. 00:27:48.012 [2024-11-21 03:44:28.344112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.012 [2024-11-21 03:44:28.344219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.012 [2024-11-21 03:44:28.344245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.012 qpair failed and we were unable to recover it. 00:27:48.012 [2024-11-21 03:44:28.344368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.012 [2024-11-21 03:44:28.344495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.012 [2024-11-21 03:44:28.344521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.012 qpair failed and we were unable to recover it. 00:27:48.012 [2024-11-21 03:44:28.344619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.012 [2024-11-21 03:44:28.344747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.012 [2024-11-21 03:44:28.344772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.012 qpair failed and we were unable to recover it. 00:27:48.012 [2024-11-21 03:44:28.344878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.012 [2024-11-21 03:44:28.344972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.012 [2024-11-21 03:44:28.345004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.012 qpair failed and we were unable to recover it. 00:27:48.012 [2024-11-21 03:44:28.345135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.012 [2024-11-21 03:44:28.345265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.012 [2024-11-21 03:44:28.345290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.012 qpair failed and we were unable to recover it. 00:27:48.012 [2024-11-21 03:44:28.345394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.012 [2024-11-21 03:44:28.345490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.012 [2024-11-21 03:44:28.345516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.012 qpair failed and we were unable to recover it. 00:27:48.012 [2024-11-21 03:44:28.345648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.012 [2024-11-21 03:44:28.345785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.012 [2024-11-21 03:44:28.345810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.012 qpair failed and we were unable to recover it. 00:27:48.012 [2024-11-21 03:44:28.345934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.012 [2024-11-21 03:44:28.346038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.012 [2024-11-21 03:44:28.346063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.012 qpair failed and we were unable to recover it. 00:27:48.012 [2024-11-21 03:44:28.346176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.013 [2024-11-21 03:44:28.346269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.013 [2024-11-21 03:44:28.346294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.013 qpair failed and we were unable to recover it. 00:27:48.013 [2024-11-21 03:44:28.346419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.013 [2024-11-21 03:44:28.346545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.013 [2024-11-21 03:44:28.346570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.013 qpair failed and we were unable to recover it. 00:27:48.013 [2024-11-21 03:44:28.346696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.013 [2024-11-21 03:44:28.346800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.013 [2024-11-21 03:44:28.346826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.013 qpair failed and we were unable to recover it. 00:27:48.013 [2024-11-21 03:44:28.346926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.013 [2024-11-21 03:44:28.347049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.013 [2024-11-21 03:44:28.347079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.013 qpair failed and we were unable to recover it. 00:27:48.013 [2024-11-21 03:44:28.347181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.013 [2024-11-21 03:44:28.347313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.013 [2024-11-21 03:44:28.347339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.013 qpair failed and we were unable to recover it. 00:27:48.013 [2024-11-21 03:44:28.347445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.013 [2024-11-21 03:44:28.347549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.013 [2024-11-21 03:44:28.347579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.013 qpair failed and we were unable to recover it. 00:27:48.013 [2024-11-21 03:44:28.347679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.013 [2024-11-21 03:44:28.347809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.013 [2024-11-21 03:44:28.347836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.013 qpair failed and we were unable to recover it. 00:27:48.013 [2024-11-21 03:44:28.347929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.013 [2024-11-21 03:44:28.348033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.013 [2024-11-21 03:44:28.348059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.013 qpair failed and we were unable to recover it. 00:27:48.013 [2024-11-21 03:44:28.348164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.013 [2024-11-21 03:44:28.348324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.013 [2024-11-21 03:44:28.348350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.013 qpair failed and we were unable to recover it. 00:27:48.013 [2024-11-21 03:44:28.348450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.013 [2024-11-21 03:44:28.348570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.013 [2024-11-21 03:44:28.348596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.013 qpair failed and we were unable to recover it. 00:27:48.013 [2024-11-21 03:44:28.348730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.013 [2024-11-21 03:44:28.348831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.013 [2024-11-21 03:44:28.348858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.013 qpair failed and we were unable to recover it. 00:27:48.013 [2024-11-21 03:44:28.348960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.013 [2024-11-21 03:44:28.349092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.013 [2024-11-21 03:44:28.349118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.013 qpair failed and we were unable to recover it. 00:27:48.013 [2024-11-21 03:44:28.349273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.013 [2024-11-21 03:44:28.349374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.013 [2024-11-21 03:44:28.349402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.013 qpair failed and we were unable to recover it. 00:27:48.013 [2024-11-21 03:44:28.349504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.013 [2024-11-21 03:44:28.349610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.013 [2024-11-21 03:44:28.349636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.013 qpair failed and we were unable to recover it. 00:27:48.013 [2024-11-21 03:44:28.349738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.013 [2024-11-21 03:44:28.349833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.013 [2024-11-21 03:44:28.349860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.013 qpair failed and we were unable to recover it. 00:27:48.013 [2024-11-21 03:44:28.349959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.013 [2024-11-21 03:44:28.350082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.013 [2024-11-21 03:44:28.350112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.013 qpair failed and we were unable to recover it. 00:27:48.013 [2024-11-21 03:44:28.350216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.013 [2024-11-21 03:44:28.350369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.013 [2024-11-21 03:44:28.350394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.013 qpair failed and we were unable to recover it. 00:27:48.013 [2024-11-21 03:44:28.350495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.013 [2024-11-21 03:44:28.350593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.013 [2024-11-21 03:44:28.350618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.013 qpair failed and we were unable to recover it. 00:27:48.013 [2024-11-21 03:44:28.350720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.013 [2024-11-21 03:44:28.350821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.013 [2024-11-21 03:44:28.350847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.013 qpair failed and we were unable to recover it. 00:27:48.013 [2024-11-21 03:44:28.350977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.013 [2024-11-21 03:44:28.351111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.013 [2024-11-21 03:44:28.351139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.013 qpair failed and we were unable to recover it. 00:27:48.013 [2024-11-21 03:44:28.351290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.013 [2024-11-21 03:44:28.351388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.013 [2024-11-21 03:44:28.351413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.013 qpair failed and we were unable to recover it. 00:27:48.013 [2024-11-21 03:44:28.351509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.013 [2024-11-21 03:44:28.351608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.013 [2024-11-21 03:44:28.351635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.013 qpair failed and we were unable to recover it. 00:27:48.013 [2024-11-21 03:44:28.351767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.013 [2024-11-21 03:44:28.351867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.014 [2024-11-21 03:44:28.351892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.014 qpair failed and we were unable to recover it. 00:27:48.014 [2024-11-21 03:44:28.352021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.014 [2024-11-21 03:44:28.352126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.014 [2024-11-21 03:44:28.352153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.014 qpair failed and we were unable to recover it. 00:27:48.014 [2024-11-21 03:44:28.352247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.014 [2024-11-21 03:44:28.352370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.014 [2024-11-21 03:44:28.352395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.014 qpair failed and we were unable to recover it. 00:27:48.014 [2024-11-21 03:44:28.352498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.014 [2024-11-21 03:44:28.352623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.014 [2024-11-21 03:44:28.352648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.014 qpair failed and we were unable to recover it. 00:27:48.014 [2024-11-21 03:44:28.352784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.014 [2024-11-21 03:44:28.352909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.014 [2024-11-21 03:44:28.352934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.014 qpair failed and we were unable to recover it. 00:27:48.014 [2024-11-21 03:44:28.353030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.014 [2024-11-21 03:44:28.353157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.014 [2024-11-21 03:44:28.353183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.014 qpair failed and we were unable to recover it. 00:27:48.014 [2024-11-21 03:44:28.353305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.014 [2024-11-21 03:44:28.353414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.014 [2024-11-21 03:44:28.353439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.014 qpair failed and we were unable to recover it. 00:27:48.014 [2024-11-21 03:44:28.353565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.014 [2024-11-21 03:44:28.353665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.014 [2024-11-21 03:44:28.353690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.014 qpair failed and we were unable to recover it. 00:27:48.014 [2024-11-21 03:44:28.353796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.014 [2024-11-21 03:44:28.353924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.014 [2024-11-21 03:44:28.353949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.014 qpair failed and we were unable to recover it. 00:27:48.014 [2024-11-21 03:44:28.354046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.014 [2024-11-21 03:44:28.354152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.014 [2024-11-21 03:44:28.354177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.014 qpair failed and we were unable to recover it. 00:27:48.014 [2024-11-21 03:44:28.354287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.014 [2024-11-21 03:44:28.354391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.014 [2024-11-21 03:44:28.354416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.014 qpair failed and we were unable to recover it. 00:27:48.014 [2024-11-21 03:44:28.354541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.014 [2024-11-21 03:44:28.354694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.014 [2024-11-21 03:44:28.354719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.014 qpair failed and we were unable to recover it. 00:27:48.014 [2024-11-21 03:44:28.354820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.014 [2024-11-21 03:44:28.354917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.014 [2024-11-21 03:44:28.354941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.014 qpair failed and we were unable to recover it. 00:27:48.014 [2024-11-21 03:44:28.355054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.014 [2024-11-21 03:44:28.355165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.014 [2024-11-21 03:44:28.355190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.014 qpair failed and we were unable to recover it. 00:27:48.014 [2024-11-21 03:44:28.355324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.014 [2024-11-21 03:44:28.355446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.014 [2024-11-21 03:44:28.355471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.014 qpair failed and we were unable to recover it. 00:27:48.014 [2024-11-21 03:44:28.355596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.014 [2024-11-21 03:44:28.355725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.014 [2024-11-21 03:44:28.355751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.014 qpair failed and we were unable to recover it. 00:27:48.014 [2024-11-21 03:44:28.355865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.014 [2024-11-21 03:44:28.355957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.014 [2024-11-21 03:44:28.355982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.014 qpair failed and we were unable to recover it. 00:27:48.014 [2024-11-21 03:44:28.356086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.014 [2024-11-21 03:44:28.356212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.014 [2024-11-21 03:44:28.356237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.014 qpair failed and we were unable to recover it. 00:27:48.014 [2024-11-21 03:44:28.356367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.014 [2024-11-21 03:44:28.356465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.014 [2024-11-21 03:44:28.356491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.014 qpair failed and we were unable to recover it. 00:27:48.014 [2024-11-21 03:44:28.356616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.014 [2024-11-21 03:44:28.356713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.014 [2024-11-21 03:44:28.356738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.014 qpair failed and we were unable to recover it. 00:27:48.014 [2024-11-21 03:44:28.356865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.014 [2024-11-21 03:44:28.356957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.014 [2024-11-21 03:44:28.356982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.014 qpair failed and we were unable to recover it. 00:27:48.014 [2024-11-21 03:44:28.357103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.014 [2024-11-21 03:44:28.357226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.014 [2024-11-21 03:44:28.357251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.014 qpair failed and we were unable to recover it. 00:27:48.014 [2024-11-21 03:44:28.357377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.014 [2024-11-21 03:44:28.357467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.014 [2024-11-21 03:44:28.357491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.014 qpair failed and we were unable to recover it. 00:27:48.014 [2024-11-21 03:44:28.357629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.014 [2024-11-21 03:44:28.357727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-21 03:44:28.357751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.015 qpair failed and we were unable to recover it. 00:27:48.015 [2024-11-21 03:44:28.357883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-21 03:44:28.358009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-21 03:44:28.358034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.015 qpair failed and we were unable to recover it. 00:27:48.015 [2024-11-21 03:44:28.358135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-21 03:44:28.358230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-21 03:44:28.358255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.015 qpair failed and we were unable to recover it. 00:27:48.015 [2024-11-21 03:44:28.358354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-21 03:44:28.358489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-21 03:44:28.358516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.015 qpair failed and we were unable to recover it. 00:27:48.015 [2024-11-21 03:44:28.358618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-21 03:44:28.358710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-21 03:44:28.358735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.015 qpair failed and we were unable to recover it. 00:27:48.015 [2024-11-21 03:44:28.358868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-21 03:44:28.358988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-21 03:44:28.359013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.015 qpair failed and we were unable to recover it. 00:27:48.015 [2024-11-21 03:44:28.359123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-21 03:44:28.359230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-21 03:44:28.359256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.015 qpair failed and we were unable to recover it. 00:27:48.015 [2024-11-21 03:44:28.359350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-21 03:44:28.359445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-21 03:44:28.359469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.015 qpair failed and we were unable to recover it. 00:27:48.015 [2024-11-21 03:44:28.359604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-21 03:44:28.359723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-21 03:44:28.359749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.015 qpair failed and we were unable to recover it. 00:27:48.015 [2024-11-21 03:44:28.359880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-21 03:44:28.360006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-21 03:44:28.360031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.015 qpair failed and we were unable to recover it. 00:27:48.015 [2024-11-21 03:44:28.360170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-21 03:44:28.360300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-21 03:44:28.360327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.015 qpair failed and we were unable to recover it. 00:27:48.015 [2024-11-21 03:44:28.360435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-21 03:44:28.360563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-21 03:44:28.360589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.015 qpair failed and we were unable to recover it. 00:27:48.015 [2024-11-21 03:44:28.360721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-21 03:44:28.360818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-21 03:44:28.360843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.015 qpair failed and we were unable to recover it. 00:27:48.015 [2024-11-21 03:44:28.360949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-21 03:44:28.361099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-21 03:44:28.361126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.015 qpair failed and we were unable to recover it. 00:27:48.015 [2024-11-21 03:44:28.361258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-21 03:44:28.361359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-21 03:44:28.361384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.015 qpair failed and we were unable to recover it. 00:27:48.015 [2024-11-21 03:44:28.361486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-21 03:44:28.361613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-21 03:44:28.361638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.015 qpair failed and we were unable to recover it. 00:27:48.015 [2024-11-21 03:44:28.361736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-21 03:44:28.361857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-21 03:44:28.361881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.015 qpair failed and we were unable to recover it. 00:27:48.015 [2024-11-21 03:44:28.361986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-21 03:44:28.362116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-21 03:44:28.362142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.015 qpair failed and we were unable to recover it. 00:27:48.015 [2024-11-21 03:44:28.362271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-21 03:44:28.362372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-21 03:44:28.362397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.015 qpair failed and we were unable to recover it. 00:27:48.015 [2024-11-21 03:44:28.362497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-21 03:44:28.362594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-21 03:44:28.362619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.015 qpair failed and we were unable to recover it. 00:27:48.015 [2024-11-21 03:44:28.362752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-21 03:44:28.362880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-21 03:44:28.362905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.015 qpair failed and we were unable to recover it. 00:27:48.015 [2024-11-21 03:44:28.363036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-21 03:44:28.363166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-21 03:44:28.363192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.015 qpair failed and we were unable to recover it. 00:27:48.015 [2024-11-21 03:44:28.363325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-21 03:44:28.363421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-21 03:44:28.363446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.015 qpair failed and we were unable to recover it. 00:27:48.015 [2024-11-21 03:44:28.363541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-21 03:44:28.363631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.015 [2024-11-21 03:44:28.363656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.015 qpair failed and we were unable to recover it. 00:27:48.016 [2024-11-21 03:44:28.363749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.016 [2024-11-21 03:44:28.363877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.016 [2024-11-21 03:44:28.363903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.016 qpair failed and we were unable to recover it. 00:27:48.016 [2024-11-21 03:44:28.364065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.016 [2024-11-21 03:44:28.364225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.016 [2024-11-21 03:44:28.364250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.016 qpair failed and we were unable to recover it. 00:27:48.016 [2024-11-21 03:44:28.364348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.016 [2024-11-21 03:44:28.364471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.016 [2024-11-21 03:44:28.364496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.016 qpair failed and we were unable to recover it. 00:27:48.016 [2024-11-21 03:44:28.364632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.016 [2024-11-21 03:44:28.364728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.016 [2024-11-21 03:44:28.364752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.016 qpair failed and we were unable to recover it. 00:27:48.016 [2024-11-21 03:44:28.364852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.016 [2024-11-21 03:44:28.364954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.016 [2024-11-21 03:44:28.364979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.016 qpair failed and we were unable to recover it. 00:27:48.016 [2024-11-21 03:44:28.365107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.016 [2024-11-21 03:44:28.365198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.016 [2024-11-21 03:44:28.365222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.016 qpair failed and we were unable to recover it. 00:27:48.016 [2024-11-21 03:44:28.365341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.016 [2024-11-21 03:44:28.365467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.016 [2024-11-21 03:44:28.365491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.016 qpair failed and we were unable to recover it. 00:27:48.016 [2024-11-21 03:44:28.365631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.016 [2024-11-21 03:44:28.365735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.016 [2024-11-21 03:44:28.365760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.016 qpair failed and we were unable to recover it. 00:27:48.016 [2024-11-21 03:44:28.365898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.016 [2024-11-21 03:44:28.366020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.016 [2024-11-21 03:44:28.366045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.016 qpair failed and we were unable to recover it. 00:27:48.016 [2024-11-21 03:44:28.366181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.016 [2024-11-21 03:44:28.366308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.016 [2024-11-21 03:44:28.366332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.016 qpair failed and we were unable to recover it. 00:27:48.016 [2024-11-21 03:44:28.366440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.016 [2024-11-21 03:44:28.366532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.016 [2024-11-21 03:44:28.366556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.016 qpair failed and we were unable to recover it. 00:27:48.016 [2024-11-21 03:44:28.366659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.016 [2024-11-21 03:44:28.366782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.016 [2024-11-21 03:44:28.366807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.016 qpair failed and we were unable to recover it. 00:27:48.016 [2024-11-21 03:44:28.366905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.016 [2024-11-21 03:44:28.367036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.016 [2024-11-21 03:44:28.367060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.016 qpair failed and we were unable to recover it. 00:27:48.016 [2024-11-21 03:44:28.367195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.016 [2024-11-21 03:44:28.367318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.016 [2024-11-21 03:44:28.367343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.016 qpair failed and we were unable to recover it. 00:27:48.016 [2024-11-21 03:44:28.367442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.016 [2024-11-21 03:44:28.367537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.016 [2024-11-21 03:44:28.367562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.016 qpair failed and we were unable to recover it. 00:27:48.016 [2024-11-21 03:44:28.367723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.016 [2024-11-21 03:44:28.367820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.016 [2024-11-21 03:44:28.367844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.016 qpair failed and we were unable to recover it. 00:27:48.016 [2024-11-21 03:44:28.367976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.016 [2024-11-21 03:44:28.368082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.016 [2024-11-21 03:44:28.368109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.016 qpair failed and we were unable to recover it. 00:27:48.016 [2024-11-21 03:44:28.368245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.016 [2024-11-21 03:44:28.368339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.016 [2024-11-21 03:44:28.368365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.016 qpair failed and we were unable to recover it. 00:27:48.016 [2024-11-21 03:44:28.368492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.016 [2024-11-21 03:44:28.368595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.016 [2024-11-21 03:44:28.368621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.016 qpair failed and we were unable to recover it. 00:27:48.016 [2024-11-21 03:44:28.368745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.016 [2024-11-21 03:44:28.368867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.016 [2024-11-21 03:44:28.368893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.016 qpair failed and we were unable to recover it. 00:27:48.016 [2024-11-21 03:44:28.368994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.016 [2024-11-21 03:44:28.369100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.016 [2024-11-21 03:44:28.369126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.016 qpair failed and we were unable to recover it. 00:27:48.016 [2024-11-21 03:44:28.369255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.016 [2024-11-21 03:44:28.369392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.016 [2024-11-21 03:44:28.369420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.016 qpair failed and we were unable to recover it. 00:27:48.016 [2024-11-21 03:44:28.369519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.016 [2024-11-21 03:44:28.369613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.016 [2024-11-21 03:44:28.369638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.017 qpair failed and we were unable to recover it. 00:27:48.017 [2024-11-21 03:44:28.369736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.017 [2024-11-21 03:44:28.369843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.017 [2024-11-21 03:44:28.369869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.017 qpair failed and we were unable to recover it. 00:27:48.017 [2024-11-21 03:44:28.369990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.017 [2024-11-21 03:44:28.370092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.017 [2024-11-21 03:44:28.370118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.017 qpair failed and we were unable to recover it. 00:27:48.017 [2024-11-21 03:44:28.370254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.017 [2024-11-21 03:44:28.370345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.017 [2024-11-21 03:44:28.370371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.017 qpair failed and we were unable to recover it. 00:27:48.017 [2024-11-21 03:44:28.370474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.017 [2024-11-21 03:44:28.370571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.017 [2024-11-21 03:44:28.370596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.017 qpair failed and we were unable to recover it. 00:27:48.017 [2024-11-21 03:44:28.370695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.017 [2024-11-21 03:44:28.370825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.017 [2024-11-21 03:44:28.370851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.017 qpair failed and we were unable to recover it. 00:27:48.017 [2024-11-21 03:44:28.370947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.017 [2024-11-21 03:44:28.371078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.017 [2024-11-21 03:44:28.371104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.017 qpair failed and we were unable to recover it. 00:27:48.017 [2024-11-21 03:44:28.371209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.017 [2024-11-21 03:44:28.371308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.017 [2024-11-21 03:44:28.371333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.017 qpair failed and we were unable to recover it. 00:27:48.017 [2024-11-21 03:44:28.371439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.017 [2024-11-21 03:44:28.371560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.017 [2024-11-21 03:44:28.371584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.017 qpair failed and we were unable to recover it. 00:27:48.017 [2024-11-21 03:44:28.371677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.017 [2024-11-21 03:44:28.371770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.017 [2024-11-21 03:44:28.371794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.017 qpair failed and we were unable to recover it. 00:27:48.017 [2024-11-21 03:44:28.371926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.017 [2024-11-21 03:44:28.372022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.017 [2024-11-21 03:44:28.372047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.017 qpair failed and we were unable to recover it. 00:27:48.017 [2024-11-21 03:44:28.372166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.017 [2024-11-21 03:44:28.372285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.017 [2024-11-21 03:44:28.372310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.017 qpair failed and we were unable to recover it. 00:27:48.017 [2024-11-21 03:44:28.372409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.017 [2024-11-21 03:44:28.372543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.017 [2024-11-21 03:44:28.372568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.017 qpair failed and we were unable to recover it. 00:27:48.017 [2024-11-21 03:44:28.372699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.017 [2024-11-21 03:44:28.372825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.017 [2024-11-21 03:44:28.372851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.017 qpair failed and we were unable to recover it. 00:27:48.017 [2024-11-21 03:44:28.372950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.017 [2024-11-21 03:44:28.373112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.017 [2024-11-21 03:44:28.373139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.017 qpair failed and we were unable to recover it. 00:27:48.017 [2024-11-21 03:44:28.373242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.017 [2024-11-21 03:44:28.373349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.017 [2024-11-21 03:44:28.373374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.017 qpair failed and we were unable to recover it. 00:27:48.017 [2024-11-21 03:44:28.373504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.017 [2024-11-21 03:44:28.373605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.017 [2024-11-21 03:44:28.373631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.017 qpair failed and we were unable to recover it. 00:27:48.017 [2024-11-21 03:44:28.373761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.017 [2024-11-21 03:44:28.373862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.017 [2024-11-21 03:44:28.373888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.017 qpair failed and we were unable to recover it. 00:27:48.017 [2024-11-21 03:44:28.374019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.017 [2024-11-21 03:44:28.374146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.017 [2024-11-21 03:44:28.374172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.017 qpair failed and we were unable to recover it. 00:27:48.017 [2024-11-21 03:44:28.374277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.017 [2024-11-21 03:44:28.374405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.017 [2024-11-21 03:44:28.374431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.017 qpair failed and we were unable to recover it. 00:27:48.018 [2024-11-21 03:44:28.374536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-21 03:44:28.374631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-21 03:44:28.374656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.018 qpair failed and we were unable to recover it. 00:27:48.018 [2024-11-21 03:44:28.374778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-21 03:44:28.374873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-21 03:44:28.374900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.018 qpair failed and we were unable to recover it. 00:27:48.018 [2024-11-21 03:44:28.375034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-21 03:44:28.375137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-21 03:44:28.375162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.018 qpair failed and we were unable to recover it. 00:27:48.018 [2024-11-21 03:44:28.375292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-21 03:44:28.375385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-21 03:44:28.375410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.018 qpair failed and we were unable to recover it. 00:27:48.018 [2024-11-21 03:44:28.375516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-21 03:44:28.375638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-21 03:44:28.375663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.018 qpair failed and we were unable to recover it. 00:27:48.018 [2024-11-21 03:44:28.375757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-21 03:44:28.375862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-21 03:44:28.375888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.018 qpair failed and we were unable to recover it. 00:27:48.018 [2024-11-21 03:44:28.376019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-21 03:44:28.376118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-21 03:44:28.376144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.018 qpair failed and we were unable to recover it. 00:27:48.018 [2024-11-21 03:44:28.376247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-21 03:44:28.376374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-21 03:44:28.376399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.018 qpair failed and we were unable to recover it. 00:27:48.018 [2024-11-21 03:44:28.376499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-21 03:44:28.376592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-21 03:44:28.376617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.018 qpair failed and we were unable to recover it. 00:27:48.018 [2024-11-21 03:44:28.376727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-21 03:44:28.376828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-21 03:44:28.376853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.018 qpair failed and we were unable to recover it. 00:27:48.018 [2024-11-21 03:44:28.376982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-21 03:44:28.377092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-21 03:44:28.377118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.018 qpair failed and we were unable to recover it. 00:27:48.018 [2024-11-21 03:44:28.377245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-21 03:44:28.377366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-21 03:44:28.377391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.018 qpair failed and we were unable to recover it. 00:27:48.018 [2024-11-21 03:44:28.377490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-21 03:44:28.377579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-21 03:44:28.377604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.018 qpair failed and we were unable to recover it. 00:27:48.018 [2024-11-21 03:44:28.377696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-21 03:44:28.377802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-21 03:44:28.377828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.018 qpair failed and we were unable to recover it. 00:27:48.018 [2024-11-21 03:44:28.377937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-21 03:44:28.378067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-21 03:44:28.378097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.018 qpair failed and we were unable to recover it. 00:27:48.018 [2024-11-21 03:44:28.378225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-21 03:44:28.378359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-21 03:44:28.378385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.018 qpair failed and we were unable to recover it. 00:27:48.018 [2024-11-21 03:44:28.378508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-21 03:44:28.378609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-21 03:44:28.378633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.018 qpair failed and we were unable to recover it. 00:27:48.018 [2024-11-21 03:44:28.378733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-21 03:44:28.378829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-21 03:44:28.378854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.018 qpair failed and we were unable to recover it. 00:27:48.018 [2024-11-21 03:44:28.378949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-21 03:44:28.379065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-21 03:44:28.379095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.018 qpair failed and we were unable to recover it. 00:27:48.018 [2024-11-21 03:44:28.379195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-21 03:44:28.379299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-21 03:44:28.379323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.018 qpair failed and we were unable to recover it. 00:27:48.018 [2024-11-21 03:44:28.379432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-21 03:44:28.379562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-21 03:44:28.379587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.018 qpair failed and we were unable to recover it. 00:27:48.018 [2024-11-21 03:44:28.379711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-21 03:44:28.379839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-21 03:44:28.379864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.018 qpair failed and we were unable to recover it. 00:27:48.018 [2024-11-21 03:44:28.379967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-21 03:44:28.380094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-21 03:44:28.380120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.018 qpair failed and we were unable to recover it. 00:27:48.018 [2024-11-21 03:44:28.380249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-21 03:44:28.380343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.018 [2024-11-21 03:44:28.380367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.018 qpair failed and we were unable to recover it. 00:27:48.019 [2024-11-21 03:44:28.380465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.019 [2024-11-21 03:44:28.380561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.019 [2024-11-21 03:44:28.380587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.019 qpair failed and we were unable to recover it. 00:27:48.019 [2024-11-21 03:44:28.380741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.019 [2024-11-21 03:44:28.380874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.019 [2024-11-21 03:44:28.380905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.019 qpair failed and we were unable to recover it. 00:27:48.019 [2024-11-21 03:44:28.381011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.019 [2024-11-21 03:44:28.381116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.019 [2024-11-21 03:44:28.381143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.019 qpair failed and we were unable to recover it. 00:27:48.019 [2024-11-21 03:44:28.381246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.019 [2024-11-21 03:44:28.381339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.019 [2024-11-21 03:44:28.381365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.019 qpair failed and we were unable to recover it. 00:27:48.019 [2024-11-21 03:44:28.381461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.019 [2024-11-21 03:44:28.381589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.019 [2024-11-21 03:44:28.381615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.019 qpair failed and we were unable to recover it. 00:27:48.019 [2024-11-21 03:44:28.381717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.019 [2024-11-21 03:44:28.381845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.019 [2024-11-21 03:44:28.381870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.019 qpair failed and we were unable to recover it. 00:27:48.019 [2024-11-21 03:44:28.382007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.019 [2024-11-21 03:44:28.382136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.019 [2024-11-21 03:44:28.382161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.019 qpair failed and we were unable to recover it. 00:27:48.019 [2024-11-21 03:44:28.382269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.019 [2024-11-21 03:44:28.382401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.019 [2024-11-21 03:44:28.382427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.019 qpair failed and we were unable to recover it. 00:27:48.019 [2024-11-21 03:44:28.382549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.019 [2024-11-21 03:44:28.382650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.019 [2024-11-21 03:44:28.382675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.019 qpair failed and we were unable to recover it. 00:27:48.019 [2024-11-21 03:44:28.382777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.019 [2024-11-21 03:44:28.382869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.019 [2024-11-21 03:44:28.382894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.019 qpair failed and we were unable to recover it. 00:27:48.019 [2024-11-21 03:44:28.382989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.019 [2024-11-21 03:44:28.383087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.019 [2024-11-21 03:44:28.383122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.019 qpair failed and we were unable to recover it. 00:27:48.019 [2024-11-21 03:44:28.383281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.019 [2024-11-21 03:44:28.383402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.019 [2024-11-21 03:44:28.383434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.019 qpair failed and we were unable to recover it. 00:27:48.019 [2024-11-21 03:44:28.383535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.019 [2024-11-21 03:44:28.383636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.019 [2024-11-21 03:44:28.383662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.019 qpair failed and we were unable to recover it. 00:27:48.019 [2024-11-21 03:44:28.383767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.019 [2024-11-21 03:44:28.383891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.019 [2024-11-21 03:44:28.383917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.019 qpair failed and we were unable to recover it. 00:27:48.019 [2024-11-21 03:44:28.384044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.019 [2024-11-21 03:44:28.384152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.019 [2024-11-21 03:44:28.384177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.019 qpair failed and we were unable to recover it. 00:27:48.019 [2024-11-21 03:44:28.384286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.019 [2024-11-21 03:44:28.384381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.019 [2024-11-21 03:44:28.384405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.019 qpair failed and we were unable to recover it. 00:27:48.019 [2024-11-21 03:44:28.384538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.019 [2024-11-21 03:44:28.384660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.019 [2024-11-21 03:44:28.384686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.019 qpair failed and we were unable to recover it. 00:27:48.019 [2024-11-21 03:44:28.384779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.019 [2024-11-21 03:44:28.384871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.019 [2024-11-21 03:44:28.384896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.019 qpair failed and we were unable to recover it. 00:27:48.019 [2024-11-21 03:44:28.384997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.019 [2024-11-21 03:44:28.385099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.019 [2024-11-21 03:44:28.385126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.019 qpair failed and we were unable to recover it. 00:27:48.019 [2024-11-21 03:44:28.385240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.019 [2024-11-21 03:44:28.385335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.019 [2024-11-21 03:44:28.385361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.019 qpair failed and we were unable to recover it. 00:27:48.019 [2024-11-21 03:44:28.385488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.019 [2024-11-21 03:44:28.385591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.019 [2024-11-21 03:44:28.385616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.019 qpair failed and we were unable to recover it. 00:27:48.019 [2024-11-21 03:44:28.385721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.019 [2024-11-21 03:44:28.385819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.019 [2024-11-21 03:44:28.385851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.020 qpair failed and we were unable to recover it. 00:27:48.020 [2024-11-21 03:44:28.385983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.020 [2024-11-21 03:44:28.386111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.020 [2024-11-21 03:44:28.386138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.020 qpair failed and we were unable to recover it. 00:27:48.020 [2024-11-21 03:44:28.386269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.020 [2024-11-21 03:44:28.386393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.020 [2024-11-21 03:44:28.386420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.020 qpair failed and we were unable to recover it. 00:27:48.020 [2024-11-21 03:44:28.386543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.020 [2024-11-21 03:44:28.386639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.020 [2024-11-21 03:44:28.386664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.020 qpair failed and we were unable to recover it. 00:27:48.020 [2024-11-21 03:44:28.386758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.020 [2024-11-21 03:44:28.386857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.020 [2024-11-21 03:44:28.386882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.020 qpair failed and we were unable to recover it. 00:27:48.020 [2024-11-21 03:44:28.387013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.020 [2024-11-21 03:44:28.387133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.020 [2024-11-21 03:44:28.387159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.020 qpair failed and we were unable to recover it. 00:27:48.020 [2024-11-21 03:44:28.387260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.020 [2024-11-21 03:44:28.387351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.020 [2024-11-21 03:44:28.387375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.020 qpair failed and we were unable to recover it. 00:27:48.020 [2024-11-21 03:44:28.387502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.020 [2024-11-21 03:44:28.387597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.020 [2024-11-21 03:44:28.387623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.020 qpair failed and we were unable to recover it. 00:27:48.020 [2024-11-21 03:44:28.387732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.020 [2024-11-21 03:44:28.387830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.020 [2024-11-21 03:44:28.387857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.020 qpair failed and we were unable to recover it. 00:27:48.020 [2024-11-21 03:44:28.387962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.020 [2024-11-21 03:44:28.388091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.020 [2024-11-21 03:44:28.388122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.020 qpair failed and we were unable to recover it. 00:27:48.020 [2024-11-21 03:44:28.388246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.020 [2024-11-21 03:44:28.388368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.020 [2024-11-21 03:44:28.388399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.020 qpair failed and we were unable to recover it. 00:27:48.020 [2024-11-21 03:44:28.388505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.020 [2024-11-21 03:44:28.388601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.020 [2024-11-21 03:44:28.388627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.020 qpair failed and we were unable to recover it. 00:27:48.020 [2024-11-21 03:44:28.388754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.020 [2024-11-21 03:44:28.388845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.020 [2024-11-21 03:44:28.388871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.020 qpair failed and we were unable to recover it. 00:27:48.020 [2024-11-21 03:44:28.388962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.020 [2024-11-21 03:44:28.389112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.020 [2024-11-21 03:44:28.389140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.020 qpair failed and we were unable to recover it. 00:27:48.020 [2024-11-21 03:44:28.389272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.020 [2024-11-21 03:44:28.389402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.020 [2024-11-21 03:44:28.389429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.020 qpair failed and we were unable to recover it. 00:27:48.020 [2024-11-21 03:44:28.389533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.020 [2024-11-21 03:44:28.389631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.020 [2024-11-21 03:44:28.389657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.020 qpair failed and we were unable to recover it. 00:27:48.020 [2024-11-21 03:44:28.389769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.020 [2024-11-21 03:44:28.389921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.020 [2024-11-21 03:44:28.389947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.020 qpair failed and we were unable to recover it. 00:27:48.020 [2024-11-21 03:44:28.390074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.020 [2024-11-21 03:44:28.390170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.020 [2024-11-21 03:44:28.390196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.020 qpair failed and we were unable to recover it. 00:27:48.020 [2024-11-21 03:44:28.390307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.020 [2024-11-21 03:44:28.390402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.020 [2024-11-21 03:44:28.390427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.020 qpair failed and we were unable to recover it. 00:27:48.020 [2024-11-21 03:44:28.390525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.020 [2024-11-21 03:44:28.390647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.020 [2024-11-21 03:44:28.390672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.020 qpair failed and we were unable to recover it. 00:27:48.020 [2024-11-21 03:44:28.390800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.020 [2024-11-21 03:44:28.390899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.020 [2024-11-21 03:44:28.390925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.020 qpair failed and we were unable to recover it. 00:27:48.020 [2024-11-21 03:44:28.391037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.020 [2024-11-21 03:44:28.391140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.020 [2024-11-21 03:44:28.391167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.021 qpair failed and we were unable to recover it. 00:27:48.021 [2024-11-21 03:44:28.391295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.021 [2024-11-21 03:44:28.391427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.021 [2024-11-21 03:44:28.391453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.021 qpair failed and we were unable to recover it. 00:27:48.021 [2024-11-21 03:44:28.391574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.021 [2024-11-21 03:44:28.391676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.021 [2024-11-21 03:44:28.391701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.021 qpair failed and we were unable to recover it. 00:27:48.021 [2024-11-21 03:44:28.391804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.021 [2024-11-21 03:44:28.391932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.021 [2024-11-21 03:44:28.391958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.021 qpair failed and we were unable to recover it. 00:27:48.021 [2024-11-21 03:44:28.392085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.021 [2024-11-21 03:44:28.392199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.021 [2024-11-21 03:44:28.392225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.021 qpair failed and we were unable to recover it. 00:27:48.021 [2024-11-21 03:44:28.392330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.021 [2024-11-21 03:44:28.392462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.021 [2024-11-21 03:44:28.392488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.021 qpair failed and we were unable to recover it. 00:27:48.021 [2024-11-21 03:44:28.392617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.021 [2024-11-21 03:44:28.392741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.021 [2024-11-21 03:44:28.392767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.021 qpair failed and we were unable to recover it. 00:27:48.021 [2024-11-21 03:44:28.392869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.021 [2024-11-21 03:44:28.392986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.021 [2024-11-21 03:44:28.393012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.021 qpair failed and we were unable to recover it. 00:27:48.021 [2024-11-21 03:44:28.393123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.021 [2024-11-21 03:44:28.393220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.021 [2024-11-21 03:44:28.393247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.021 qpair failed and we were unable to recover it. 00:27:48.021 [2024-11-21 03:44:28.393351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.021 [2024-11-21 03:44:28.393476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.021 [2024-11-21 03:44:28.393501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.021 qpair failed and we were unable to recover it. 00:27:48.021 [2024-11-21 03:44:28.393673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.021 [2024-11-21 03:44:28.393773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.021 [2024-11-21 03:44:28.393800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.021 qpair failed and we were unable to recover it. 00:27:48.021 [2024-11-21 03:44:28.393906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.021 [2024-11-21 03:44:28.394000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.021 [2024-11-21 03:44:28.394026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.021 qpair failed and we were unable to recover it. 00:27:48.021 [2024-11-21 03:44:28.394126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.021 [2024-11-21 03:44:28.394254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.021 [2024-11-21 03:44:28.394280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.021 qpair failed and we were unable to recover it. 00:27:48.021 [2024-11-21 03:44:28.394408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.021 [2024-11-21 03:44:28.394535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.021 [2024-11-21 03:44:28.394561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.021 qpair failed and we were unable to recover it. 00:27:48.021 [2024-11-21 03:44:28.394668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.021 [2024-11-21 03:44:28.394793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.021 [2024-11-21 03:44:28.394818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.021 qpair failed and we were unable to recover it. 00:27:48.021 [2024-11-21 03:44:28.394978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.021 [2024-11-21 03:44:28.395079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.021 [2024-11-21 03:44:28.395105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.021 qpair failed and we were unable to recover it. 00:27:48.021 [2024-11-21 03:44:28.395229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.021 [2024-11-21 03:44:28.395326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.021 [2024-11-21 03:44:28.395351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.021 qpair failed and we were unable to recover it. 00:27:48.021 [2024-11-21 03:44:28.395486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.021 [2024-11-21 03:44:28.395584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.021 [2024-11-21 03:44:28.395611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.021 qpair failed and we were unable to recover it. 00:27:48.021 [2024-11-21 03:44:28.395739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.021 [2024-11-21 03:44:28.395865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.021 [2024-11-21 03:44:28.395890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.021 qpair failed and we were unable to recover it. 00:27:48.021 [2024-11-21 03:44:28.395988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.021 [2024-11-21 03:44:28.396115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.021 [2024-11-21 03:44:28.396142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.021 qpair failed and we were unable to recover it. 00:27:48.021 [2024-11-21 03:44:28.396244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.021 [2024-11-21 03:44:28.396372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.021 [2024-11-21 03:44:28.396397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.021 qpair failed and we were unable to recover it. 00:27:48.021 [2024-11-21 03:44:28.396537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.021 [2024-11-21 03:44:28.396631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.021 [2024-11-21 03:44:28.396657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.021 qpair failed and we were unable to recover it. 00:27:48.021 [2024-11-21 03:44:28.396818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.021 [2024-11-21 03:44:28.396950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.021 [2024-11-21 03:44:28.396975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.021 qpair failed and we were unable to recover it. 00:27:48.021 [2024-11-21 03:44:28.397097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.021 [2024-11-21 03:44:28.397193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-21 03:44:28.397219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.022 qpair failed and we were unable to recover it. 00:27:48.022 [2024-11-21 03:44:28.397351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-21 03:44:28.397502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-21 03:44:28.397527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.022 qpair failed and we were unable to recover it. 00:27:48.022 [2024-11-21 03:44:28.397626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-21 03:44:28.397733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-21 03:44:28.397758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.022 qpair failed and we were unable to recover it. 00:27:48.022 [2024-11-21 03:44:28.397880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-21 03:44:28.397979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-21 03:44:28.398005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.022 qpair failed and we were unable to recover it. 00:27:48.022 [2024-11-21 03:44:28.398118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-21 03:44:28.398221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-21 03:44:28.398246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.022 qpair failed and we were unable to recover it. 00:27:48.022 [2024-11-21 03:44:28.398346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-21 03:44:28.398500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-21 03:44:28.398526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.022 qpair failed and we were unable to recover it. 00:27:48.022 [2024-11-21 03:44:28.398653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-21 03:44:28.398749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-21 03:44:28.398774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.022 qpair failed and we were unable to recover it. 00:27:48.022 [2024-11-21 03:44:28.398883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-21 03:44:28.399009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-21 03:44:28.399034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.022 qpair failed and we were unable to recover it. 00:27:48.022 [2024-11-21 03:44:28.399172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-21 03:44:28.399300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-21 03:44:28.399325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.022 qpair failed and we were unable to recover it. 00:27:48.022 [2024-11-21 03:44:28.399427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-21 03:44:28.399582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-21 03:44:28.399607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.022 qpair failed and we were unable to recover it. 00:27:48.022 [2024-11-21 03:44:28.399716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-21 03:44:28.399834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-21 03:44:28.399859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.022 qpair failed and we were unable to recover it. 00:27:48.022 [2024-11-21 03:44:28.399956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-21 03:44:28.400086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-21 03:44:28.400112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.022 qpair failed and we were unable to recover it. 00:27:48.022 [2024-11-21 03:44:28.400205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-21 03:44:28.400303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-21 03:44:28.400327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.022 qpair failed and we were unable to recover it. 00:27:48.022 [2024-11-21 03:44:28.400485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-21 03:44:28.400576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-21 03:44:28.400600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.022 qpair failed and we were unable to recover it. 00:27:48.022 [2024-11-21 03:44:28.400738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-21 03:44:28.400842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-21 03:44:28.400867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.022 qpair failed and we were unable to recover it. 00:27:48.022 [2024-11-21 03:44:28.400988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-21 03:44:28.401127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-21 03:44:28.401153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.022 qpair failed and we were unable to recover it. 00:27:48.022 [2024-11-21 03:44:28.401263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-21 03:44:28.401387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-21 03:44:28.401412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.022 qpair failed and we were unable to recover it. 00:27:48.022 [2024-11-21 03:44:28.401570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-21 03:44:28.401694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-21 03:44:28.401719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.022 qpair failed and we were unable to recover it. 00:27:48.022 [2024-11-21 03:44:28.401813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-21 03:44:28.401934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-21 03:44:28.401959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.022 qpair failed and we were unable to recover it. 00:27:48.022 [2024-11-21 03:44:28.402057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-21 03:44:28.402197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-21 03:44:28.402222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.022 qpair failed and we were unable to recover it. 00:27:48.022 [2024-11-21 03:44:28.402322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-21 03:44:28.402419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-21 03:44:28.402444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.022 qpair failed and we were unable to recover it. 00:27:48.022 [2024-11-21 03:44:28.402544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-21 03:44:28.402647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-21 03:44:28.402672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.022 qpair failed and we were unable to recover it. 00:27:48.022 [2024-11-21 03:44:28.402806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-21 03:44:28.402902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-21 03:44:28.402927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.022 qpair failed and we were unable to recover it. 00:27:48.022 [2024-11-21 03:44:28.403057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-21 03:44:28.403183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-21 03:44:28.403208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.022 qpair failed and we were unable to recover it. 00:27:48.022 [2024-11-21 03:44:28.403300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-21 03:44:28.403398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.022 [2024-11-21 03:44:28.403424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.023 qpair failed and we were unable to recover it. 00:27:48.023 [2024-11-21 03:44:28.403528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-21 03:44:28.403655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-21 03:44:28.403682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.023 qpair failed and we were unable to recover it. 00:27:48.023 [2024-11-21 03:44:28.403791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-21 03:44:28.403945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-21 03:44:28.403970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.023 qpair failed and we were unable to recover it. 00:27:48.023 [2024-11-21 03:44:28.404107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-21 03:44:28.404215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-21 03:44:28.404241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.023 qpair failed and we were unable to recover it. 00:27:48.023 [2024-11-21 03:44:28.404339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-21 03:44:28.404470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-21 03:44:28.404495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.023 qpair failed and we were unable to recover it. 00:27:48.023 [2024-11-21 03:44:28.404595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-21 03:44:28.404692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-21 03:44:28.404717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.023 qpair failed and we were unable to recover it. 00:27:48.023 [2024-11-21 03:44:28.404818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-21 03:44:28.404937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-21 03:44:28.404962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.023 qpair failed and we were unable to recover it. 00:27:48.023 [2024-11-21 03:44:28.405052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-21 03:44:28.405180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-21 03:44:28.405205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.023 qpair failed and we were unable to recover it. 00:27:48.023 [2024-11-21 03:44:28.405324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-21 03:44:28.405443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-21 03:44:28.405468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.023 qpair failed and we were unable to recover it. 00:27:48.023 [2024-11-21 03:44:28.405562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-21 03:44:28.405665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-21 03:44:28.405690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.023 qpair failed and we were unable to recover it. 00:27:48.023 [2024-11-21 03:44:28.405816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-21 03:44:28.405916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-21 03:44:28.405942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.023 qpair failed and we were unable to recover it. 00:27:48.023 [2024-11-21 03:44:28.406077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-21 03:44:28.406200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-21 03:44:28.406224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.023 qpair failed and we were unable to recover it. 00:27:48.023 [2024-11-21 03:44:28.406348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-21 03:44:28.406471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-21 03:44:28.406496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.023 qpair failed and we were unable to recover it. 00:27:48.023 [2024-11-21 03:44:28.406600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-21 03:44:28.406689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-21 03:44:28.406714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.023 qpair failed and we were unable to recover it. 00:27:48.023 [2024-11-21 03:44:28.406848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-21 03:44:28.406960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-21 03:44:28.406986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.023 qpair failed and we were unable to recover it. 00:27:48.023 [2024-11-21 03:44:28.407106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-21 03:44:28.407208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-21 03:44:28.407233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.023 qpair failed and we were unable to recover it. 00:27:48.023 [2024-11-21 03:44:28.407357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-21 03:44:28.407480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-21 03:44:28.407506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.023 qpair failed and we were unable to recover it. 00:27:48.023 [2024-11-21 03:44:28.407609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-21 03:44:28.407729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-21 03:44:28.407754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.023 qpair failed and we were unable to recover it. 00:27:48.023 [2024-11-21 03:44:28.407890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-21 03:44:28.408019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-21 03:44:28.408044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.023 qpair failed and we were unable to recover it. 00:27:48.023 [2024-11-21 03:44:28.408162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-21 03:44:28.408257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-21 03:44:28.408281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.023 qpair failed and we were unable to recover it. 00:27:48.023 [2024-11-21 03:44:28.408379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-21 03:44:28.408479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-21 03:44:28.408504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.023 qpair failed and we were unable to recover it. 00:27:48.023 [2024-11-21 03:44:28.408630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-21 03:44:28.408729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-21 03:44:28.408754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.023 qpair failed and we were unable to recover it. 00:27:48.023 [2024-11-21 03:44:28.408859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.023 [2024-11-21 03:44:28.408980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-21 03:44:28.409005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.024 qpair failed and we were unable to recover it. 00:27:48.024 [2024-11-21 03:44:28.409108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-21 03:44:28.409203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-21 03:44:28.409229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.024 qpair failed and we were unable to recover it. 00:27:48.024 [2024-11-21 03:44:28.409329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-21 03:44:28.409421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-21 03:44:28.409447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.024 qpair failed and we were unable to recover it. 00:27:48.024 [2024-11-21 03:44:28.409553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-21 03:44:28.409705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-21 03:44:28.409730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.024 qpair failed and we were unable to recover it. 00:27:48.024 [2024-11-21 03:44:28.409840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-21 03:44:28.409964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-21 03:44:28.409990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.024 qpair failed and we were unable to recover it. 00:27:48.024 [2024-11-21 03:44:28.410117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-21 03:44:28.410215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-21 03:44:28.410241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.024 qpair failed and we were unable to recover it. 00:27:48.024 [2024-11-21 03:44:28.410349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-21 03:44:28.410446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-21 03:44:28.410473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.024 qpair failed and we were unable to recover it. 00:27:48.024 [2024-11-21 03:44:28.410630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-21 03:44:28.410784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-21 03:44:28.410809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.024 qpair failed and we were unable to recover it. 00:27:48.024 [2024-11-21 03:44:28.410911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-21 03:44:28.411034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-21 03:44:28.411060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.024 qpair failed and we were unable to recover it. 00:27:48.024 [2024-11-21 03:44:28.411172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-21 03:44:28.411269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-21 03:44:28.411294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.024 qpair failed and we were unable to recover it. 00:27:48.024 [2024-11-21 03:44:28.411393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-21 03:44:28.411516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-21 03:44:28.411541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.024 qpair failed and we were unable to recover it. 00:27:48.024 [2024-11-21 03:44:28.411641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-21 03:44:28.411778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-21 03:44:28.411804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.024 qpair failed and we were unable to recover it. 00:27:48.024 [2024-11-21 03:44:28.411902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-21 03:44:28.411997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-21 03:44:28.412023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.024 qpair failed and we were unable to recover it. 00:27:48.024 [2024-11-21 03:44:28.412185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-21 03:44:28.412286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-21 03:44:28.412311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.024 qpair failed and we were unable to recover it. 00:27:48.024 [2024-11-21 03:44:28.412414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-21 03:44:28.412539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-21 03:44:28.412564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.024 qpair failed and we were unable to recover it. 00:27:48.024 [2024-11-21 03:44:28.412695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-21 03:44:28.412798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-21 03:44:28.412823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.024 qpair failed and we were unable to recover it. 00:27:48.024 [2024-11-21 03:44:28.412957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-21 03:44:28.413113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-21 03:44:28.413147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.024 qpair failed and we were unable to recover it. 00:27:48.024 [2024-11-21 03:44:28.413240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-21 03:44:28.413342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-21 03:44:28.413366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.024 qpair failed and we were unable to recover it. 00:27:48.024 [2024-11-21 03:44:28.413477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-21 03:44:28.413598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-21 03:44:28.413623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.024 qpair failed and we were unable to recover it. 00:27:48.024 [2024-11-21 03:44:28.413780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-21 03:44:28.413905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-21 03:44:28.413931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.024 qpair failed and we were unable to recover it. 00:27:48.024 [2024-11-21 03:44:28.414066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-21 03:44:28.414177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-21 03:44:28.414203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.024 qpair failed and we were unable to recover it. 00:27:48.024 [2024-11-21 03:44:28.414332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-21 03:44:28.414463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-21 03:44:28.414489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.024 qpair failed and we were unable to recover it. 00:27:48.024 [2024-11-21 03:44:28.414595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-21 03:44:28.414695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-21 03:44:28.414720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.024 qpair failed and we were unable to recover it. 00:27:48.024 [2024-11-21 03:44:28.414815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-21 03:44:28.414916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-21 03:44:28.414942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.024 qpair failed and we were unable to recover it. 00:27:48.024 [2024-11-21 03:44:28.415075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.024 [2024-11-21 03:44:28.415204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-21 03:44:28.415229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.025 qpair failed and we were unable to recover it. 00:27:48.025 [2024-11-21 03:44:28.415328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-21 03:44:28.415427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-21 03:44:28.415452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.025 qpair failed and we were unable to recover it. 00:27:48.025 [2024-11-21 03:44:28.415603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-21 03:44:28.415758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-21 03:44:28.415783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.025 qpair failed and we were unable to recover it. 00:27:48.025 [2024-11-21 03:44:28.415881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-21 03:44:28.416005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-21 03:44:28.416029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.025 qpair failed and we were unable to recover it. 00:27:48.025 [2024-11-21 03:44:28.416194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-21 03:44:28.416326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-21 03:44:28.416352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.025 qpair failed and we were unable to recover it. 00:27:48.025 [2024-11-21 03:44:28.416459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-21 03:44:28.416552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-21 03:44:28.416577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.025 qpair failed and we were unable to recover it. 00:27:48.025 [2024-11-21 03:44:28.416676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-21 03:44:28.416776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-21 03:44:28.416800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.025 qpair failed and we were unable to recover it. 00:27:48.025 [2024-11-21 03:44:28.416926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-21 03:44:28.417029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-21 03:44:28.417056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.025 qpair failed and we were unable to recover it. 00:27:48.025 [2024-11-21 03:44:28.417184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-21 03:44:28.417288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-21 03:44:28.417313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.025 qpair failed and we were unable to recover it. 00:27:48.025 [2024-11-21 03:44:28.417444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-21 03:44:28.417576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-21 03:44:28.417601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.025 qpair failed and we were unable to recover it. 00:27:48.025 [2024-11-21 03:44:28.417704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-21 03:44:28.417830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-21 03:44:28.417854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.025 qpair failed and we were unable to recover it. 00:27:48.025 [2024-11-21 03:44:28.417956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-21 03:44:28.418053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-21 03:44:28.418086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.025 qpair failed and we were unable to recover it. 00:27:48.025 [2024-11-21 03:44:28.418226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-21 03:44:28.418359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-21 03:44:28.418384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.025 qpair failed and we were unable to recover it. 00:27:48.025 [2024-11-21 03:44:28.418480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-21 03:44:28.418608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-21 03:44:28.418633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.025 qpair failed and we were unable to recover it. 00:27:48.025 [2024-11-21 03:44:28.418737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-21 03:44:28.418833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-21 03:44:28.418859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.025 qpair failed and we were unable to recover it. 00:27:48.025 [2024-11-21 03:44:28.418961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-21 03:44:28.419093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-21 03:44:28.419119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.025 qpair failed and we were unable to recover it. 00:27:48.025 [2024-11-21 03:44:28.419230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-21 03:44:28.419351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-21 03:44:28.419376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.025 qpair failed and we were unable to recover it. 00:27:48.025 [2024-11-21 03:44:28.419475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-21 03:44:28.419599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-21 03:44:28.419624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.025 qpair failed and we were unable to recover it. 00:27:48.025 [2024-11-21 03:44:28.419747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-21 03:44:28.419848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-21 03:44:28.419873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.025 qpair failed and we were unable to recover it. 00:27:48.025 [2024-11-21 03:44:28.420001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-21 03:44:28.420133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-21 03:44:28.420159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.025 qpair failed and we were unable to recover it. 00:27:48.025 [2024-11-21 03:44:28.420275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-21 03:44:28.420404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-21 03:44:28.420429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.025 qpair failed and we were unable to recover it. 00:27:48.025 [2024-11-21 03:44:28.420575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-21 03:44:28.420678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-21 03:44:28.420703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.025 qpair failed and we were unable to recover it. 00:27:48.025 [2024-11-21 03:44:28.420818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-21 03:44:28.420919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-21 03:44:28.420944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.025 qpair failed and we were unable to recover it. 00:27:48.025 [2024-11-21 03:44:28.421081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-21 03:44:28.421172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-21 03:44:28.421197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.025 qpair failed and we were unable to recover it. 00:27:48.025 [2024-11-21 03:44:28.421302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-21 03:44:28.421403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.025 [2024-11-21 03:44:28.421429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.025 qpair failed and we were unable to recover it. 00:27:48.026 [2024-11-21 03:44:28.421518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-21 03:44:28.421645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-21 03:44:28.421670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.026 qpair failed and we were unable to recover it. 00:27:48.026 [2024-11-21 03:44:28.421803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-21 03:44:28.421893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-21 03:44:28.421917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.026 qpair failed and we were unable to recover it. 00:27:48.026 [2024-11-21 03:44:28.422007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-21 03:44:28.422109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-21 03:44:28.422143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.026 qpair failed and we were unable to recover it. 00:27:48.026 [2024-11-21 03:44:28.422306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-21 03:44:28.422439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-21 03:44:28.422464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.026 qpair failed and we were unable to recover it. 00:27:48.026 [2024-11-21 03:44:28.422564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-21 03:44:28.422716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-21 03:44:28.422741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.026 qpair failed and we were unable to recover it. 00:27:48.026 [2024-11-21 03:44:28.422838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-21 03:44:28.422963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-21 03:44:28.422988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.026 qpair failed and we were unable to recover it. 00:27:48.026 [2024-11-21 03:44:28.423150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-21 03:44:28.423274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-21 03:44:28.423300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.026 qpair failed and we were unable to recover it. 00:27:48.026 [2024-11-21 03:44:28.423433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-21 03:44:28.423530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-21 03:44:28.423556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.026 qpair failed and we were unable to recover it. 00:27:48.026 [2024-11-21 03:44:28.423668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-21 03:44:28.423758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-21 03:44:28.423782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.026 qpair failed and we were unable to recover it. 00:27:48.026 [2024-11-21 03:44:28.423888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-21 03:44:28.423985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-21 03:44:28.424010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.026 qpair failed and we were unable to recover it. 00:27:48.026 [2024-11-21 03:44:28.424138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-21 03:44:28.424267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-21 03:44:28.424292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.026 qpair failed and we were unable to recover it. 00:27:48.026 [2024-11-21 03:44:28.424396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-21 03:44:28.424485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-21 03:44:28.424509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.026 qpair failed and we were unable to recover it. 00:27:48.026 [2024-11-21 03:44:28.424613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-21 03:44:28.424765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-21 03:44:28.424795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.026 qpair failed and we were unable to recover it. 00:27:48.026 [2024-11-21 03:44:28.424927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-21 03:44:28.425061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-21 03:44:28.425216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.026 qpair failed and we were unable to recover it. 00:27:48.026 [2024-11-21 03:44:28.425323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-21 03:44:28.425450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-21 03:44:28.425475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.026 qpair failed and we were unable to recover it. 00:27:48.026 [2024-11-21 03:44:28.425605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-21 03:44:28.425760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-21 03:44:28.425785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.026 qpair failed and we were unable to recover it. 00:27:48.026 [2024-11-21 03:44:28.425884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-21 03:44:28.425980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-21 03:44:28.426006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.026 qpair failed and we were unable to recover it. 00:27:48.026 [2024-11-21 03:44:28.426118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-21 03:44:28.426244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-21 03:44:28.426269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.026 qpair failed and we were unable to recover it. 00:27:48.026 [2024-11-21 03:44:28.426378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-21 03:44:28.426475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-21 03:44:28.426500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.026 qpair failed and we were unable to recover it. 00:27:48.026 [2024-11-21 03:44:28.426630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-21 03:44:28.426730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-21 03:44:28.426754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.026 qpair failed and we were unable to recover it. 00:27:48.026 [2024-11-21 03:44:28.426891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-21 03:44:28.426994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-21 03:44:28.427018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.026 qpair failed and we were unable to recover it. 00:27:48.026 [2024-11-21 03:44:28.427118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-21 03:44:28.427209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-21 03:44:28.427233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.026 qpair failed and we were unable to recover it. 00:27:48.026 [2024-11-21 03:44:28.427339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-21 03:44:28.427434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-21 03:44:28.427464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.026 qpair failed and we were unable to recover it. 00:27:48.026 [2024-11-21 03:44:28.427565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-21 03:44:28.427667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-21 03:44:28.427692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.026 qpair failed and we were unable to recover it. 00:27:48.026 [2024-11-21 03:44:28.427814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-21 03:44:28.427921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-21 03:44:28.427947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.026 qpair failed and we were unable to recover it. 00:27:48.026 [2024-11-21 03:44:28.428045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-21 03:44:28.428158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.026 [2024-11-21 03:44:28.428183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.027 qpair failed and we were unable to recover it. 00:27:48.027 [2024-11-21 03:44:28.428330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-21 03:44:28.428440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-21 03:44:28.428464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.027 qpair failed and we were unable to recover it. 00:27:48.027 [2024-11-21 03:44:28.428597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-21 03:44:28.428748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-21 03:44:28.428773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.027 qpair failed and we were unable to recover it. 00:27:48.027 [2024-11-21 03:44:28.428904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-21 03:44:28.429030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-21 03:44:28.429055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.027 qpair failed and we were unable to recover it. 00:27:48.027 [2024-11-21 03:44:28.429194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-21 03:44:28.429317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-21 03:44:28.429341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.027 qpair failed and we were unable to recover it. 00:27:48.027 [2024-11-21 03:44:28.429444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-21 03:44:28.429538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-21 03:44:28.429563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.027 qpair failed and we were unable to recover it. 00:27:48.027 [2024-11-21 03:44:28.429671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-21 03:44:28.429826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-21 03:44:28.429851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.027 qpair failed and we were unable to recover it. 00:27:48.027 [2024-11-21 03:44:28.429965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-21 03:44:28.430089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-21 03:44:28.430128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.027 qpair failed and we were unable to recover it. 00:27:48.027 [2024-11-21 03:44:28.430262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-21 03:44:28.430374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-21 03:44:28.430399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.027 qpair failed and we were unable to recover it. 00:27:48.027 [2024-11-21 03:44:28.430526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-21 03:44:28.430621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-21 03:44:28.430647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.027 qpair failed and we were unable to recover it. 00:27:48.027 [2024-11-21 03:44:28.430752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-21 03:44:28.430906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-21 03:44:28.430931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.027 qpair failed and we were unable to recover it. 00:27:48.027 [2024-11-21 03:44:28.431087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-21 03:44:28.431188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-21 03:44:28.431214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.027 qpair failed and we were unable to recover it. 00:27:48.027 [2024-11-21 03:44:28.431343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-21 03:44:28.431438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-21 03:44:28.431464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.027 qpair failed and we were unable to recover it. 00:27:48.027 [2024-11-21 03:44:28.431567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-21 03:44:28.431694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-21 03:44:28.431719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.027 qpair failed and we were unable to recover it. 00:27:48.027 [2024-11-21 03:44:28.431825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-21 03:44:28.431957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-21 03:44:28.431983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.027 qpair failed and we were unable to recover it. 00:27:48.027 [2024-11-21 03:44:28.432093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-21 03:44:28.432195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-21 03:44:28.432221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.027 qpair failed and we were unable to recover it. 00:27:48.027 [2024-11-21 03:44:28.432315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-21 03:44:28.432438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-21 03:44:28.432463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.027 qpair failed and we were unable to recover it. 00:27:48.027 [2024-11-21 03:44:28.432562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-21 03:44:28.432658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-21 03:44:28.432684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.027 qpair failed and we were unable to recover it. 00:27:48.027 [2024-11-21 03:44:28.432796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-21 03:44:28.432917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-21 03:44:28.432942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.027 qpair failed and we were unable to recover it. 00:27:48.027 [2024-11-21 03:44:28.433099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-21 03:44:28.433201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-21 03:44:28.433227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.027 qpair failed and we were unable to recover it. 00:27:48.027 [2024-11-21 03:44:28.433336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-21 03:44:28.433463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-21 03:44:28.433490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.027 qpair failed and we were unable to recover it. 00:27:48.027 [2024-11-21 03:44:28.433621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-21 03:44:28.433714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-21 03:44:28.433739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.027 qpair failed and we were unable to recover it. 00:27:48.027 [2024-11-21 03:44:28.433869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-21 03:44:28.433970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-21 03:44:28.433999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.027 qpair failed and we were unable to recover it. 00:27:48.027 [2024-11-21 03:44:28.434092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-21 03:44:28.434230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.027 [2024-11-21 03:44:28.434256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.027 qpair failed and we were unable to recover it. 00:27:48.027 [2024-11-21 03:44:28.434358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-21 03:44:28.434488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-21 03:44:28.434513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.028 qpair failed and we were unable to recover it. 00:27:48.028 [2024-11-21 03:44:28.434635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-21 03:44:28.434735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-21 03:44:28.434760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.028 qpair failed and we were unable to recover it. 00:27:48.028 [2024-11-21 03:44:28.434888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-21 03:44:28.434991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-21 03:44:28.435015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.028 qpair failed and we were unable to recover it. 00:27:48.028 [2024-11-21 03:44:28.435147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-21 03:44:28.435281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-21 03:44:28.435308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.028 qpair failed and we were unable to recover it. 00:27:48.028 [2024-11-21 03:44:28.435425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-21 03:44:28.435522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-21 03:44:28.435547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.028 qpair failed and we were unable to recover it. 00:27:48.028 [2024-11-21 03:44:28.435650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-21 03:44:28.435774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-21 03:44:28.435800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.028 qpair failed and we were unable to recover it. 00:27:48.028 [2024-11-21 03:44:28.435923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-21 03:44:28.436047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-21 03:44:28.436078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.028 qpair failed and we were unable to recover it. 00:27:48.028 [2024-11-21 03:44:28.436208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-21 03:44:28.436318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-21 03:44:28.436343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.028 qpair failed and we were unable to recover it. 00:27:48.028 [2024-11-21 03:44:28.436446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-21 03:44:28.436543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-21 03:44:28.436574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.028 qpair failed and we were unable to recover it. 00:27:48.028 [2024-11-21 03:44:28.436708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-21 03:44:28.436803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-21 03:44:28.436829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.028 qpair failed and we were unable to recover it. 00:27:48.028 [2024-11-21 03:44:28.436922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-21 03:44:28.437045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-21 03:44:28.437090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.028 qpair failed and we were unable to recover it. 00:27:48.028 [2024-11-21 03:44:28.437209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-21 03:44:28.437334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-21 03:44:28.437360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.028 qpair failed and we were unable to recover it. 00:27:48.028 [2024-11-21 03:44:28.437490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-21 03:44:28.437589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-21 03:44:28.437616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.028 qpair failed and we were unable to recover it. 00:27:48.028 [2024-11-21 03:44:28.437710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-21 03:44:28.437840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-21 03:44:28.437867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.028 qpair failed and we were unable to recover it. 00:27:48.028 [2024-11-21 03:44:28.438030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-21 03:44:28.438139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-21 03:44:28.438166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.028 qpair failed and we were unable to recover it. 00:27:48.028 [2024-11-21 03:44:28.438263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-21 03:44:28.438392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-21 03:44:28.438417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.028 qpair failed and we were unable to recover it. 00:27:48.028 [2024-11-21 03:44:28.438520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-21 03:44:28.438616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-21 03:44:28.438642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.028 qpair failed and we were unable to recover it. 00:27:48.028 [2024-11-21 03:44:28.438762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-21 03:44:28.438852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.028 [2024-11-21 03:44:28.438877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.028 qpair failed and we were unable to recover it. 00:27:48.029 [2024-11-21 03:44:28.438988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-21 03:44:28.439113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-21 03:44:28.439138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.029 qpair failed and we were unable to recover it. 00:27:48.029 [2024-11-21 03:44:28.439272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-21 03:44:28.439371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-21 03:44:28.439396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.029 qpair failed and we were unable to recover it. 00:27:48.029 [2024-11-21 03:44:28.439526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-21 03:44:28.439630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-21 03:44:28.439657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.029 qpair failed and we were unable to recover it. 00:27:48.029 [2024-11-21 03:44:28.439785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-21 03:44:28.439908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-21 03:44:28.439935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.029 qpair failed and we were unable to recover it. 00:27:48.029 [2024-11-21 03:44:28.440037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-21 03:44:28.440140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-21 03:44:28.440166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.029 qpair failed and we were unable to recover it. 00:27:48.029 [2024-11-21 03:44:28.440289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-21 03:44:28.440389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-21 03:44:28.440415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.029 qpair failed and we were unable to recover it. 00:27:48.029 [2024-11-21 03:44:28.440519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-21 03:44:28.440612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-21 03:44:28.440637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.029 qpair failed and we were unable to recover it. 00:27:48.029 [2024-11-21 03:44:28.440732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-21 03:44:28.440832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-21 03:44:28.440857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.029 qpair failed and we were unable to recover it. 00:27:48.029 [2024-11-21 03:44:28.440956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-21 03:44:28.441085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-21 03:44:28.441111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.029 qpair failed and we were unable to recover it. 00:27:48.029 [2024-11-21 03:44:28.441225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-21 03:44:28.441349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-21 03:44:28.441374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.029 qpair failed and we were unable to recover it. 00:27:48.029 [2024-11-21 03:44:28.441510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-21 03:44:28.441647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-21 03:44:28.441673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.029 qpair failed and we were unable to recover it. 00:27:48.029 [2024-11-21 03:44:28.441774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-21 03:44:28.441878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-21 03:44:28.441905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.029 qpair failed and we were unable to recover it. 00:27:48.029 [2024-11-21 03:44:28.442008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-21 03:44:28.442111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-21 03:44:28.442136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.029 qpair failed and we were unable to recover it. 00:27:48.029 [2024-11-21 03:44:28.442262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-21 03:44:28.442415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-21 03:44:28.442439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.029 qpair failed and we were unable to recover it. 00:27:48.029 [2024-11-21 03:44:28.442542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-21 03:44:28.442641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-21 03:44:28.442666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.029 qpair failed and we were unable to recover it. 00:27:48.029 [2024-11-21 03:44:28.442790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-21 03:44:28.442918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-21 03:44:28.442942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.029 qpair failed and we were unable to recover it. 00:27:48.029 [2024-11-21 03:44:28.443050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-21 03:44:28.443169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-21 03:44:28.443195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.029 qpair failed and we were unable to recover it. 00:27:48.029 [2024-11-21 03:44:28.443331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-21 03:44:28.443425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-21 03:44:28.443450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.029 qpair failed and we were unable to recover it. 00:27:48.029 [2024-11-21 03:44:28.443555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-21 03:44:28.443660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-21 03:44:28.443685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.029 qpair failed and we were unable to recover it. 00:27:48.029 [2024-11-21 03:44:28.443810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-21 03:44:28.443914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-21 03:44:28.443941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.029 qpair failed and we were unable to recover it. 00:27:48.029 [2024-11-21 03:44:28.444041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-21 03:44:28.444156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-21 03:44:28.444181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.029 qpair failed and we were unable to recover it. 00:27:48.029 [2024-11-21 03:44:28.444284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-21 03:44:28.444373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-21 03:44:28.444398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.029 qpair failed and we were unable to recover it. 00:27:48.029 [2024-11-21 03:44:28.444503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-21 03:44:28.444626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-21 03:44:28.444652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.029 qpair failed and we were unable to recover it. 00:27:48.029 [2024-11-21 03:44:28.444788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-21 03:44:28.444883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-21 03:44:28.444908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.029 qpair failed and we were unable to recover it. 00:27:48.029 [2024-11-21 03:44:28.445009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-21 03:44:28.445108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-21 03:44:28.445134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.029 qpair failed and we were unable to recover it. 00:27:48.029 [2024-11-21 03:44:28.445264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.029 [2024-11-21 03:44:28.445390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-21 03:44:28.445415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.030 qpair failed and we were unable to recover it. 00:27:48.030 [2024-11-21 03:44:28.445550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-21 03:44:28.445676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-21 03:44:28.445702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.030 qpair failed and we were unable to recover it. 00:27:48.030 [2024-11-21 03:44:28.445805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-21 03:44:28.445935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-21 03:44:28.445959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.030 qpair failed and we were unable to recover it. 00:27:48.030 [2024-11-21 03:44:28.446060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-21 03:44:28.446193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-21 03:44:28.446218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.030 qpair failed and we were unable to recover it. 00:27:48.030 [2024-11-21 03:44:28.446324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-21 03:44:28.446419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-21 03:44:28.446444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.030 qpair failed and we were unable to recover it. 00:27:48.030 [2024-11-21 03:44:28.446533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-21 03:44:28.446657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-21 03:44:28.446683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.030 qpair failed and we were unable to recover it. 00:27:48.030 [2024-11-21 03:44:28.446782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-21 03:44:28.446885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-21 03:44:28.446910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.030 qpair failed and we were unable to recover it. 00:27:48.030 [2024-11-21 03:44:28.447009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-21 03:44:28.447109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-21 03:44:28.447134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.030 qpair failed and we were unable to recover it. 00:27:48.030 [2024-11-21 03:44:28.447264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-21 03:44:28.447396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-21 03:44:28.447420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.030 qpair failed and we were unable to recover it. 00:27:48.030 [2024-11-21 03:44:28.447517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-21 03:44:28.447617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-21 03:44:28.447642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.030 qpair failed and we were unable to recover it. 00:27:48.030 [2024-11-21 03:44:28.447740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-21 03:44:28.447868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-21 03:44:28.447893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.030 qpair failed and we were unable to recover it. 00:27:48.030 [2024-11-21 03:44:28.448042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-21 03:44:28.448175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-21 03:44:28.448206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.030 qpair failed and we were unable to recover it. 00:27:48.030 [2024-11-21 03:44:28.448327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-21 03:44:28.448454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-21 03:44:28.448482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.030 qpair failed and we were unable to recover it. 00:27:48.030 [2024-11-21 03:44:28.448590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-21 03:44:28.448692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-21 03:44:28.448718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.030 qpair failed and we were unable to recover it. 00:27:48.030 [2024-11-21 03:44:28.448875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-21 03:44:28.448977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-21 03:44:28.449004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.030 qpair failed and we were unable to recover it. 00:27:48.030 [2024-11-21 03:44:28.449112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-21 03:44:28.449213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-21 03:44:28.449241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.030 qpair failed and we were unable to recover it. 00:27:48.030 [2024-11-21 03:44:28.449383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-21 03:44:28.449490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-21 03:44:28.449516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.030 qpair failed and we were unable to recover it. 00:27:48.030 [2024-11-21 03:44:28.449615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-21 03:44:28.449746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-21 03:44:28.449771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.030 qpair failed and we were unable to recover it. 00:27:48.030 [2024-11-21 03:44:28.449905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-21 03:44:28.450033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-21 03:44:28.450059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.030 qpair failed and we were unable to recover it. 00:27:48.030 [2024-11-21 03:44:28.450169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-21 03:44:28.450268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-21 03:44:28.450295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.030 qpair failed and we were unable to recover it. 00:27:48.030 [2024-11-21 03:44:28.450431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-21 03:44:28.450531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-21 03:44:28.450558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.030 qpair failed and we were unable to recover it. 00:27:48.030 [2024-11-21 03:44:28.450674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-21 03:44:28.450821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-21 03:44:28.450852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.030 qpair failed and we were unable to recover it. 00:27:48.030 [2024-11-21 03:44:28.450958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.030 [2024-11-21 03:44:28.451063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.031 [2024-11-21 03:44:28.451100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.031 qpair failed and we were unable to recover it. 00:27:48.031 [2024-11-21 03:44:28.451232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.031 [2024-11-21 03:44:28.451329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.031 [2024-11-21 03:44:28.451355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.031 qpair failed and we were unable to recover it. 00:27:48.031 [2024-11-21 03:44:28.451458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.031 [2024-11-21 03:44:28.451583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.031 [2024-11-21 03:44:28.451608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.031 qpair failed and we were unable to recover it. 00:27:48.031 [2024-11-21 03:44:28.451707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.031 [2024-11-21 03:44:28.451836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.031 [2024-11-21 03:44:28.451861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.031 qpair failed and we were unable to recover it. 00:27:48.031 [2024-11-21 03:44:28.451960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.031 [2024-11-21 03:44:28.452060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.031 [2024-11-21 03:44:28.452092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.031 qpair failed and we were unable to recover it. 00:27:48.031 [2024-11-21 03:44:28.452202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.031 [2024-11-21 03:44:28.452294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.031 [2024-11-21 03:44:28.452321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.031 qpair failed and we were unable to recover it. 00:27:48.031 [2024-11-21 03:44:28.452444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.031 [2024-11-21 03:44:28.452542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.031 [2024-11-21 03:44:28.452567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.031 qpair failed and we were unable to recover it. 00:27:48.031 [2024-11-21 03:44:28.452679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.031 [2024-11-21 03:44:28.452767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.031 [2024-11-21 03:44:28.452792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.031 qpair failed and we were unable to recover it. 00:27:48.031 [2024-11-21 03:44:28.452892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.031 [2024-11-21 03:44:28.453014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.031 [2024-11-21 03:44:28.453040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.031 qpair failed and we were unable to recover it. 00:27:48.031 [2024-11-21 03:44:28.453149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.031 [2024-11-21 03:44:28.453257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.031 [2024-11-21 03:44:28.453283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.031 qpair failed and we were unable to recover it. 00:27:48.031 [2024-11-21 03:44:28.453384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.031 [2024-11-21 03:44:28.453537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.031 [2024-11-21 03:44:28.453562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.031 qpair failed and we were unable to recover it. 00:27:48.031 [2024-11-21 03:44:28.453667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.031 [2024-11-21 03:44:28.453763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.031 [2024-11-21 03:44:28.453788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.031 qpair failed and we were unable to recover it. 00:27:48.031 [2024-11-21 03:44:28.453894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.031 [2024-11-21 03:44:28.453990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.031 [2024-11-21 03:44:28.454015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.031 qpair failed and we were unable to recover it. 00:27:48.031 [2024-11-21 03:44:28.454121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.031 [2024-11-21 03:44:28.454221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.031 [2024-11-21 03:44:28.454248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.031 qpair failed and we were unable to recover it. 00:27:48.031 [2024-11-21 03:44:28.454350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.031 [2024-11-21 03:44:28.454445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.031 [2024-11-21 03:44:28.454470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.031 qpair failed and we were unable to recover it. 00:27:48.031 [2024-11-21 03:44:28.454575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.031 [2024-11-21 03:44:28.454684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.031 [2024-11-21 03:44:28.454709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.031 qpair failed and we were unable to recover it. 00:27:48.031 [2024-11-21 03:44:28.454810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.031 [2024-11-21 03:44:28.454911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.031 [2024-11-21 03:44:28.454936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.031 qpair failed and we were unable to recover it. 00:27:48.031 [2024-11-21 03:44:28.455064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.031 [2024-11-21 03:44:28.455171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.031 [2024-11-21 03:44:28.455198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.031 qpair failed and we were unable to recover it. 00:27:48.031 [2024-11-21 03:44:28.455291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.031 [2024-11-21 03:44:28.455393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.031 [2024-11-21 03:44:28.455418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.031 qpair failed and we were unable to recover it. 00:27:48.031 [2024-11-21 03:44:28.455511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.031 [2024-11-21 03:44:28.455607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.031 [2024-11-21 03:44:28.455633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.031 qpair failed and we were unable to recover it. 00:27:48.031 [2024-11-21 03:44:28.455732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.031 [2024-11-21 03:44:28.455863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.031 [2024-11-21 03:44:28.455888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.031 qpair failed and we were unable to recover it. 00:27:48.031 [2024-11-21 03:44:28.455992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.031 [2024-11-21 03:44:28.456089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.031 [2024-11-21 03:44:28.456115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.031 qpair failed and we were unable to recover it. 00:27:48.031 [2024-11-21 03:44:28.456225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.031 [2024-11-21 03:44:28.456353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.031 [2024-11-21 03:44:28.456378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.031 qpair failed and we were unable to recover it. 00:27:48.031 [2024-11-21 03:44:28.456518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.031 [2024-11-21 03:44:28.456643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.031 [2024-11-21 03:44:28.456669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.031 qpair failed and we were unable to recover it. 00:27:48.031 [2024-11-21 03:44:28.456765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.031 [2024-11-21 03:44:28.456860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-21 03:44:28.456887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.032 qpair failed and we were unable to recover it. 00:27:48.032 [2024-11-21 03:44:28.457048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-21 03:44:28.457182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-21 03:44:28.457208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.032 qpair failed and we were unable to recover it. 00:27:48.032 [2024-11-21 03:44:28.457311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-21 03:44:28.457402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-21 03:44:28.457429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.032 qpair failed and we were unable to recover it. 00:27:48.032 [2024-11-21 03:44:28.457555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-21 03:44:28.457649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-21 03:44:28.457675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.032 qpair failed and we were unable to recover it. 00:27:48.032 [2024-11-21 03:44:28.457782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-21 03:44:28.457905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-21 03:44:28.457930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.032 qpair failed and we were unable to recover it. 00:27:48.032 [2024-11-21 03:44:28.458079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-21 03:44:28.458183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-21 03:44:28.458209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.032 qpair failed and we were unable to recover it. 00:27:48.032 [2024-11-21 03:44:28.458316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-21 03:44:28.458421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-21 03:44:28.458446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.032 qpair failed and we were unable to recover it. 00:27:48.032 [2024-11-21 03:44:28.458575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-21 03:44:28.458668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-21 03:44:28.458694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.032 qpair failed and we were unable to recover it. 00:27:48.032 [2024-11-21 03:44:28.458796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-21 03:44:28.458892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-21 03:44:28.458917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.032 qpair failed and we were unable to recover it. 00:27:48.032 [2024-11-21 03:44:28.459019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-21 03:44:28.459112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-21 03:44:28.459137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.032 qpair failed and we were unable to recover it. 00:27:48.032 [2024-11-21 03:44:28.459238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-21 03:44:28.459358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-21 03:44:28.459384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.032 qpair failed and we were unable to recover it. 00:27:48.032 [2024-11-21 03:44:28.459509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-21 03:44:28.459607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-21 03:44:28.459632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.032 qpair failed and we were unable to recover it. 00:27:48.032 [2024-11-21 03:44:28.459756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-21 03:44:28.459851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-21 03:44:28.459878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.032 qpair failed and we were unable to recover it. 00:27:48.032 [2024-11-21 03:44:28.460010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-21 03:44:28.460114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-21 03:44:28.460140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.032 qpair failed and we were unable to recover it. 00:27:48.032 [2024-11-21 03:44:28.460248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-21 03:44:28.460349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-21 03:44:28.460373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.032 qpair failed and we were unable to recover it. 00:27:48.032 [2024-11-21 03:44:28.460467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-21 03:44:28.460566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-21 03:44:28.460591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.032 qpair failed and we were unable to recover it. 00:27:48.032 [2024-11-21 03:44:28.460683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-21 03:44:28.460815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-21 03:44:28.460841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.032 qpair failed and we were unable to recover it. 00:27:48.032 [2024-11-21 03:44:28.460938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-21 03:44:28.461087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-21 03:44:28.461115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.032 qpair failed and we were unable to recover it. 00:27:48.032 [2024-11-21 03:44:28.461210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-21 03:44:28.461335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-21 03:44:28.461361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.032 qpair failed and we were unable to recover it. 00:27:48.032 [2024-11-21 03:44:28.461462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-21 03:44:28.461551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-21 03:44:28.461577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.032 qpair failed and we were unable to recover it. 00:27:48.032 [2024-11-21 03:44:28.461706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-21 03:44:28.461798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-21 03:44:28.461823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.032 qpair failed and we were unable to recover it. 00:27:48.032 [2024-11-21 03:44:28.461926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-21 03:44:28.462023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-21 03:44:28.462049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.032 qpair failed and we were unable to recover it. 00:27:48.032 [2024-11-21 03:44:28.462157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-21 03:44:28.462275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-21 03:44:28.462300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.032 qpair failed and we were unable to recover it. 00:27:48.032 [2024-11-21 03:44:28.462399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-21 03:44:28.462502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-21 03:44:28.462526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.032 qpair failed and we were unable to recover it. 00:27:48.032 [2024-11-21 03:44:28.462622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-21 03:44:28.462767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-21 03:44:28.462793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.032 qpair failed and we were unable to recover it. 00:27:48.032 [2024-11-21 03:44:28.462891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-21 03:44:28.462987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-21 03:44:28.463018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.032 qpair failed and we were unable to recover it. 00:27:48.032 [2024-11-21 03:44:28.463151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-21 03:44:28.463256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-21 03:44:28.463281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.032 qpair failed and we were unable to recover it. 00:27:48.032 [2024-11-21 03:44:28.463384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-21 03:44:28.463485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-21 03:44:28.463512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.032 qpair failed and we were unable to recover it. 00:27:48.032 [2024-11-21 03:44:28.463612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-21 03:44:28.463737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.032 [2024-11-21 03:44:28.463761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.032 qpair failed and we were unable to recover it. 00:27:48.032 [2024-11-21 03:44:28.463864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-21 03:44:28.463961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-21 03:44:28.463986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.033 qpair failed and we were unable to recover it. 00:27:48.033 [2024-11-21 03:44:28.464119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-21 03:44:28.464226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-21 03:44:28.464252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.033 qpair failed and we were unable to recover it. 00:27:48.033 [2024-11-21 03:44:28.464355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-21 03:44:28.464478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-21 03:44:28.464502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.033 qpair failed and we were unable to recover it. 00:27:48.033 [2024-11-21 03:44:28.464605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-21 03:44:28.464710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-21 03:44:28.464734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.033 qpair failed and we were unable to recover it. 00:27:48.033 [2024-11-21 03:44:28.464863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-21 03:44:28.464987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-21 03:44:28.465012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.033 qpair failed and we were unable to recover it. 00:27:48.033 [2024-11-21 03:44:28.465111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-21 03:44:28.465213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-21 03:44:28.465238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.033 qpair failed and we were unable to recover it. 00:27:48.033 [2024-11-21 03:44:28.465363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-21 03:44:28.465458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-21 03:44:28.465487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.033 qpair failed and we were unable to recover it. 00:27:48.033 [2024-11-21 03:44:28.465621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-21 03:44:28.465720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-21 03:44:28.465746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.033 qpair failed and we were unable to recover it. 00:27:48.033 [2024-11-21 03:44:28.465878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-21 03:44:28.466004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-21 03:44:28.466029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.033 qpair failed and we were unable to recover it. 00:27:48.033 [2024-11-21 03:44:28.466140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-21 03:44:28.466260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-21 03:44:28.466285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.033 qpair failed and we were unable to recover it. 00:27:48.033 [2024-11-21 03:44:28.466389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-21 03:44:28.466514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-21 03:44:28.466540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.033 qpair failed and we were unable to recover it. 00:27:48.033 [2024-11-21 03:44:28.466627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-21 03:44:28.466726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-21 03:44:28.466752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.033 qpair failed and we were unable to recover it. 00:27:48.033 [2024-11-21 03:44:28.466884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-21 03:44:28.466973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-21 03:44:28.466999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.033 qpair failed and we were unable to recover it. 00:27:48.033 [2024-11-21 03:44:28.467126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-21 03:44:28.467223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-21 03:44:28.467249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.033 qpair failed and we were unable to recover it. 00:27:48.033 [2024-11-21 03:44:28.467350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-21 03:44:28.467477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-21 03:44:28.467503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.033 qpair failed and we were unable to recover it. 00:27:48.033 [2024-11-21 03:44:28.467634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-21 03:44:28.467767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-21 03:44:28.467793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.033 qpair failed and we were unable to recover it. 00:27:48.033 [2024-11-21 03:44:28.467894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-21 03:44:28.467986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-21 03:44:28.468016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.033 qpair failed and we were unable to recover it. 00:27:48.033 [2024-11-21 03:44:28.468147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-21 03:44:28.468247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-21 03:44:28.468272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.033 qpair failed and we were unable to recover it. 00:27:48.033 [2024-11-21 03:44:28.468379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-21 03:44:28.468501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-21 03:44:28.468526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.033 qpair failed and we were unable to recover it. 00:27:48.033 [2024-11-21 03:44:28.468651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-21 03:44:28.468771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-21 03:44:28.468796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.033 qpair failed and we were unable to recover it. 00:27:48.033 [2024-11-21 03:44:28.468894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-21 03:44:28.469025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-21 03:44:28.469050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.033 qpair failed and we were unable to recover it. 00:27:48.033 [2024-11-21 03:44:28.469160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-21 03:44:28.469261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-21 03:44:28.469287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.033 qpair failed and we were unable to recover it. 00:27:48.033 [2024-11-21 03:44:28.469384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-21 03:44:28.469486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-21 03:44:28.469511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.033 qpair failed and we were unable to recover it. 00:27:48.033 [2024-11-21 03:44:28.469612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-21 03:44:28.469706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-21 03:44:28.469731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.033 qpair failed and we were unable to recover it. 00:27:48.033 [2024-11-21 03:44:28.469861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-21 03:44:28.469994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.033 [2024-11-21 03:44:28.470021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.033 qpair failed and we were unable to recover it. 00:27:48.034 [2024-11-21 03:44:28.470150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-21 03:44:28.470248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-21 03:44:28.470272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.034 qpair failed and we were unable to recover it. 00:27:48.034 [2024-11-21 03:44:28.470371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-21 03:44:28.470473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-21 03:44:28.470503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.034 qpair failed and we were unable to recover it. 00:27:48.034 [2024-11-21 03:44:28.470605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-21 03:44:28.470736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-21 03:44:28.470762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.034 qpair failed and we were unable to recover it. 00:27:48.034 [2024-11-21 03:44:28.470863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-21 03:44:28.470961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-21 03:44:28.470987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.034 qpair failed and we were unable to recover it. 00:27:48.034 [2024-11-21 03:44:28.471096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-21 03:44:28.471221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-21 03:44:28.471247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.034 qpair failed and we were unable to recover it. 00:27:48.034 [2024-11-21 03:44:28.471360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-21 03:44:28.471461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-21 03:44:28.471485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.034 qpair failed and we were unable to recover it. 00:27:48.034 [2024-11-21 03:44:28.471615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-21 03:44:28.471708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-21 03:44:28.471732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.034 qpair failed and we were unable to recover it. 00:27:48.034 [2024-11-21 03:44:28.471895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-21 03:44:28.471994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-21 03:44:28.472019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.034 qpair failed and we were unable to recover it. 00:27:48.034 [2024-11-21 03:44:28.472117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-21 03:44:28.472242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-21 03:44:28.472267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.034 qpair failed and we were unable to recover it. 00:27:48.034 [2024-11-21 03:44:28.472394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-21 03:44:28.472490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-21 03:44:28.472514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.034 qpair failed and we were unable to recover it. 00:27:48.034 [2024-11-21 03:44:28.472611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-21 03:44:28.472735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-21 03:44:28.472760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.034 qpair failed and we were unable to recover it. 00:27:48.034 [2024-11-21 03:44:28.472872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-21 03:44:28.473002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-21 03:44:28.473026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.034 qpair failed and we were unable to recover it. 00:27:48.034 [2024-11-21 03:44:28.473150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-21 03:44:28.473245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-21 03:44:28.473271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.034 qpair failed and we were unable to recover it. 00:27:48.034 [2024-11-21 03:44:28.473370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-21 03:44:28.473493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-21 03:44:28.473518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.034 qpair failed and we were unable to recover it. 00:27:48.034 [2024-11-21 03:44:28.473628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-21 03:44:28.473730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-21 03:44:28.473755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.034 qpair failed and we were unable to recover it. 00:27:48.034 [2024-11-21 03:44:28.473855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-21 03:44:28.473949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-21 03:44:28.473975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.034 qpair failed and we were unable to recover it. 00:27:48.034 [2024-11-21 03:44:28.474074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-21 03:44:28.474196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-21 03:44:28.474221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.034 qpair failed and we were unable to recover it. 00:27:48.034 [2024-11-21 03:44:28.474316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-21 03:44:28.474438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-21 03:44:28.474463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.034 qpair failed and we were unable to recover it. 00:27:48.034 [2024-11-21 03:44:28.474560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-21 03:44:28.474650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-21 03:44:28.474676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.034 qpair failed and we were unable to recover it. 00:27:48.034 [2024-11-21 03:44:28.474786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-21 03:44:28.474878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-21 03:44:28.474902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.034 qpair failed and we were unable to recover it. 00:27:48.034 [2024-11-21 03:44:28.475005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-21 03:44:28.475106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-21 03:44:28.475133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.034 qpair failed and we were unable to recover it. 00:27:48.034 [2024-11-21 03:44:28.475239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-21 03:44:28.475341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-21 03:44:28.475366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.034 qpair failed and we were unable to recover it. 00:27:48.034 [2024-11-21 03:44:28.475528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-21 03:44:28.475658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-21 03:44:28.475682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.034 qpair failed and we were unable to recover it. 00:27:48.034 [2024-11-21 03:44:28.475805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-21 03:44:28.475905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-21 03:44:28.475930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.034 qpair failed and we were unable to recover it. 00:27:48.034 [2024-11-21 03:44:28.476036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-21 03:44:28.476147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-21 03:44:28.476173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.034 qpair failed and we were unable to recover it. 00:27:48.034 [2024-11-21 03:44:28.476275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-21 03:44:28.476380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-21 03:44:28.476405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.034 qpair failed and we were unable to recover it. 00:27:48.034 [2024-11-21 03:44:28.476505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-21 03:44:28.476613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-21 03:44:28.476637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.034 qpair failed and we were unable to recover it. 00:27:48.034 [2024-11-21 03:44:28.476765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-21 03:44:28.476862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-21 03:44:28.476887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.034 qpair failed and we were unable to recover it. 00:27:48.034 [2024-11-21 03:44:28.476995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.034 [2024-11-21 03:44:28.477099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-21 03:44:28.477126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.035 qpair failed and we were unable to recover it. 00:27:48.035 [2024-11-21 03:44:28.477228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-21 03:44:28.477336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-21 03:44:28.477361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.035 qpair failed and we were unable to recover it. 00:27:48.035 [2024-11-21 03:44:28.477492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-21 03:44:28.477590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-21 03:44:28.477615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.035 qpair failed and we were unable to recover it. 00:27:48.035 [2024-11-21 03:44:28.477721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-21 03:44:28.477851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-21 03:44:28.477876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.035 qpair failed and we were unable to recover it. 00:27:48.035 [2024-11-21 03:44:28.477981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-21 03:44:28.478112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-21 03:44:28.478138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.035 qpair failed and we were unable to recover it. 00:27:48.035 [2024-11-21 03:44:28.478270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-21 03:44:28.478364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-21 03:44:28.478398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.035 qpair failed and we were unable to recover it. 00:27:48.035 [2024-11-21 03:44:28.478498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-21 03:44:28.478592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-21 03:44:28.478617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.035 qpair failed and we were unable to recover it. 00:27:48.035 [2024-11-21 03:44:28.478746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-21 03:44:28.478867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-21 03:44:28.478893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.035 qpair failed and we were unable to recover it. 00:27:48.035 [2024-11-21 03:44:28.478988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-21 03:44:28.479114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-21 03:44:28.479139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.035 qpair failed and we were unable to recover it. 00:27:48.035 [2024-11-21 03:44:28.479267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-21 03:44:28.479404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-21 03:44:28.479428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.035 qpair failed and we were unable to recover it. 00:27:48.035 [2024-11-21 03:44:28.479549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-21 03:44:28.479651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-21 03:44:28.479677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.035 qpair failed and we were unable to recover it. 00:27:48.035 [2024-11-21 03:44:28.479792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-21 03:44:28.479919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-21 03:44:28.479944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.035 qpair failed and we were unable to recover it. 00:27:48.035 [2024-11-21 03:44:28.480042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-21 03:44:28.480147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-21 03:44:28.480172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.035 qpair failed and we were unable to recover it. 00:27:48.035 [2024-11-21 03:44:28.480275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-21 03:44:28.480399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-21 03:44:28.480424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.035 qpair failed and we were unable to recover it. 00:27:48.035 [2024-11-21 03:44:28.480554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-21 03:44:28.480674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-21 03:44:28.480698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.035 qpair failed and we were unable to recover it. 00:27:48.035 [2024-11-21 03:44:28.480854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-21 03:44:28.480953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-21 03:44:28.480977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.035 qpair failed and we were unable to recover it. 00:27:48.035 [2024-11-21 03:44:28.481077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-21 03:44:28.481201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-21 03:44:28.481226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.035 qpair failed and we were unable to recover it. 00:27:48.035 [2024-11-21 03:44:28.481337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-21 03:44:28.481433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-21 03:44:28.481457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.035 qpair failed and we were unable to recover it. 00:27:48.035 [2024-11-21 03:44:28.481566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-21 03:44:28.481663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-21 03:44:28.481688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.035 qpair failed and we were unable to recover it. 00:27:48.035 [2024-11-21 03:44:28.481788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-21 03:44:28.481880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-21 03:44:28.481905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.035 qpair failed and we were unable to recover it. 00:27:48.035 [2024-11-21 03:44:28.482011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-21 03:44:28.482123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-21 03:44:28.482149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.035 qpair failed and we were unable to recover it. 00:27:48.035 [2024-11-21 03:44:28.482241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-21 03:44:28.482340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-21 03:44:28.482365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.035 qpair failed and we were unable to recover it. 00:27:48.035 [2024-11-21 03:44:28.482485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-21 03:44:28.482576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-21 03:44:28.482600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.035 qpair failed and we were unable to recover it. 00:27:48.035 [2024-11-21 03:44:28.482732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-21 03:44:28.482824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-21 03:44:28.482848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.035 qpair failed and we were unable to recover it. 00:27:48.035 [2024-11-21 03:44:28.482981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-21 03:44:28.483100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-21 03:44:28.483126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.035 qpair failed and we were unable to recover it. 00:27:48.035 [2024-11-21 03:44:28.483226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-21 03:44:28.483352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-21 03:44:28.483386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.035 qpair failed and we were unable to recover it. 00:27:48.035 [2024-11-21 03:44:28.483519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-21 03:44:28.483609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-21 03:44:28.483634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.035 qpair failed and we were unable to recover it. 00:27:48.035 [2024-11-21 03:44:28.483734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-21 03:44:28.483832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-21 03:44:28.483858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.035 qpair failed and we were unable to recover it. 00:27:48.035 [2024-11-21 03:44:28.484010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-21 03:44:28.484125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.035 [2024-11-21 03:44:28.484151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.035 qpair failed and we were unable to recover it. 00:27:48.036 [2024-11-21 03:44:28.484280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-21 03:44:28.484397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-21 03:44:28.484421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.036 qpair failed and we were unable to recover it. 00:27:48.036 [2024-11-21 03:44:28.484521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-21 03:44:28.484622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-21 03:44:28.484648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.036 qpair failed and we were unable to recover it. 00:27:48.036 [2024-11-21 03:44:28.484749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-21 03:44:28.484905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-21 03:44:28.484930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.036 qpair failed and we were unable to recover it. 00:27:48.036 [2024-11-21 03:44:28.485033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-21 03:44:28.485149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-21 03:44:28.485176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.036 qpair failed and we were unable to recover it. 00:27:48.036 [2024-11-21 03:44:28.485279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-21 03:44:28.485401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-21 03:44:28.485426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.036 qpair failed and we were unable to recover it. 00:27:48.036 [2024-11-21 03:44:28.485589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-21 03:44:28.485689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-21 03:44:28.485715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.036 qpair failed and we were unable to recover it. 00:27:48.036 [2024-11-21 03:44:28.485847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-21 03:44:28.485945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-21 03:44:28.485971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.036 qpair failed and we were unable to recover it. 00:27:48.036 [2024-11-21 03:44:28.486063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-21 03:44:28.486168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-21 03:44:28.486194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.036 qpair failed and we were unable to recover it. 00:27:48.036 [2024-11-21 03:44:28.486322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-21 03:44:28.486432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-21 03:44:28.486457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.036 qpair failed and we were unable to recover it. 00:27:48.036 [2024-11-21 03:44:28.486588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-21 03:44:28.486685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-21 03:44:28.486709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.036 qpair failed and we were unable to recover it. 00:27:48.036 [2024-11-21 03:44:28.486805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-21 03:44:28.486934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-21 03:44:28.486959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.036 qpair failed and we were unable to recover it. 00:27:48.036 [2024-11-21 03:44:28.487062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-21 03:44:28.487168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-21 03:44:28.487192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.036 qpair failed and we were unable to recover it. 00:27:48.036 [2024-11-21 03:44:28.487290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-21 03:44:28.487395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-21 03:44:28.487422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.036 qpair failed and we were unable to recover it. 00:27:48.036 [2024-11-21 03:44:28.487545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-21 03:44:28.487677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-21 03:44:28.487702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.036 qpair failed and we were unable to recover it. 00:27:48.036 [2024-11-21 03:44:28.487800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-21 03:44:28.487903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-21 03:44:28.487928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.036 qpair failed and we were unable to recover it. 00:27:48.036 [2024-11-21 03:44:28.488032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-21 03:44:28.488135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-21 03:44:28.488162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.036 qpair failed and we were unable to recover it. 00:27:48.036 [2024-11-21 03:44:28.488266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-21 03:44:28.488370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-21 03:44:28.488395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.036 qpair failed and we were unable to recover it. 00:27:48.036 [2024-11-21 03:44:28.488504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-21 03:44:28.488628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-21 03:44:28.488654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.036 qpair failed and we were unable to recover it. 00:27:48.036 [2024-11-21 03:44:28.488757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-21 03:44:28.488885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-21 03:44:28.488909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.036 qpair failed and we were unable to recover it. 00:27:48.036 [2024-11-21 03:44:28.489029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-21 03:44:28.489147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-21 03:44:28.489172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.036 qpair failed and we were unable to recover it. 00:27:48.036 [2024-11-21 03:44:28.489270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-21 03:44:28.489364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-21 03:44:28.489389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.036 qpair failed and we were unable to recover it. 00:27:48.036 [2024-11-21 03:44:28.489518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-21 03:44:28.489619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-21 03:44:28.489645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.036 qpair failed and we were unable to recover it. 00:27:48.036 [2024-11-21 03:44:28.489752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-21 03:44:28.489843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-21 03:44:28.489868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.036 qpair failed and we were unable to recover it. 00:27:48.036 [2024-11-21 03:44:28.490023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-21 03:44:28.490116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-21 03:44:28.490142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.036 qpair failed and we were unable to recover it. 00:27:48.036 [2024-11-21 03:44:28.490236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-21 03:44:28.490332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-21 03:44:28.490356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.036 qpair failed and we were unable to recover it. 00:27:48.036 [2024-11-21 03:44:28.490470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-21 03:44:28.490571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-21 03:44:28.490597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.036 qpair failed and we were unable to recover it. 00:27:48.036 [2024-11-21 03:44:28.490695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-21 03:44:28.490815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-21 03:44:28.490841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.036 qpair failed and we were unable to recover it. 00:27:48.036 [2024-11-21 03:44:28.490967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-21 03:44:28.491067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.036 [2024-11-21 03:44:28.491120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.036 qpair failed and we were unable to recover it. 00:27:48.036 [2024-11-21 03:44:28.491246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-21 03:44:28.491343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-21 03:44:28.491369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.037 qpair failed and we were unable to recover it. 00:27:48.037 [2024-11-21 03:44:28.491477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-21 03:44:28.491579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-21 03:44:28.491606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.037 qpair failed and we were unable to recover it. 00:27:48.037 [2024-11-21 03:44:28.491704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-21 03:44:28.491803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-21 03:44:28.491829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.037 qpair failed and we were unable to recover it. 00:27:48.037 [2024-11-21 03:44:28.491933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-21 03:44:28.492036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-21 03:44:28.492062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.037 qpair failed and we were unable to recover it. 00:27:48.037 [2024-11-21 03:44:28.492173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-21 03:44:28.492278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-21 03:44:28.492302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.037 qpair failed and we were unable to recover it. 00:27:48.037 [2024-11-21 03:44:28.492442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-21 03:44:28.492542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-21 03:44:28.492567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.037 qpair failed and we were unable to recover it. 00:27:48.037 [2024-11-21 03:44:28.492666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-21 03:44:28.492759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-21 03:44:28.492784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.037 qpair failed and we were unable to recover it. 00:27:48.037 [2024-11-21 03:44:28.492886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-21 03:44:28.493001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-21 03:44:28.493026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.037 qpair failed and we were unable to recover it. 00:27:48.037 [2024-11-21 03:44:28.493166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-21 03:44:28.493272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-21 03:44:28.493297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.037 qpair failed and we were unable to recover it. 00:27:48.037 [2024-11-21 03:44:28.493430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-21 03:44:28.493533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-21 03:44:28.493558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.037 qpair failed and we were unable to recover it. 00:27:48.037 [2024-11-21 03:44:28.493686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-21 03:44:28.493842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-21 03:44:28.493867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.037 qpair failed and we were unable to recover it. 00:27:48.037 [2024-11-21 03:44:28.493964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-21 03:44:28.494061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-21 03:44:28.494093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.037 qpair failed and we were unable to recover it. 00:27:48.037 [2024-11-21 03:44:28.494186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-21 03:44:28.494316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-21 03:44:28.494340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.037 qpair failed and we were unable to recover it. 00:27:48.037 [2024-11-21 03:44:28.494466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-21 03:44:28.494570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-21 03:44:28.494595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.037 qpair failed and we were unable to recover it. 00:27:48.037 [2024-11-21 03:44:28.494695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-21 03:44:28.494788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-21 03:44:28.494812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.037 qpair failed and we were unable to recover it. 00:27:48.037 [2024-11-21 03:44:28.494939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-21 03:44:28.495036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-21 03:44:28.495062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.037 qpair failed and we were unable to recover it. 00:27:48.037 [2024-11-21 03:44:28.495184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-21 03:44:28.495288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-21 03:44:28.495313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.037 qpair failed and we were unable to recover it. 00:27:48.037 [2024-11-21 03:44:28.495453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-21 03:44:28.495558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-21 03:44:28.495583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.037 qpair failed and we were unable to recover it. 00:27:48.037 [2024-11-21 03:44:28.495678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-21 03:44:28.495829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-21 03:44:28.495854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.037 qpair failed and we were unable to recover it. 00:27:48.037 [2024-11-21 03:44:28.495946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-21 03:44:28.496067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-21 03:44:28.496100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.037 qpair failed and we were unable to recover it. 00:27:48.037 [2024-11-21 03:44:28.496191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-21 03:44:28.496297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-21 03:44:28.496321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.037 qpair failed and we were unable to recover it. 00:27:48.037 [2024-11-21 03:44:28.496442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-21 03:44:28.496542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-21 03:44:28.496568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.037 qpair failed and we were unable to recover it. 00:27:48.037 [2024-11-21 03:44:28.496666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-21 03:44:28.496770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-21 03:44:28.496797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.037 qpair failed and we were unable to recover it. 00:27:48.037 [2024-11-21 03:44:28.496924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-21 03:44:28.497045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-21 03:44:28.497077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.037 qpair failed and we were unable to recover it. 00:27:48.037 [2024-11-21 03:44:28.497183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-21 03:44:28.497278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-21 03:44:28.497303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.037 qpair failed and we were unable to recover it. 00:27:48.037 [2024-11-21 03:44:28.497425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-21 03:44:28.497529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-21 03:44:28.497556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.037 qpair failed and we were unable to recover it. 00:27:48.037 [2024-11-21 03:44:28.497657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-21 03:44:28.497752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-21 03:44:28.497777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.037 qpair failed and we were unable to recover it. 00:27:48.037 [2024-11-21 03:44:28.497871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-21 03:44:28.497997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-21 03:44:28.498023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.037 qpair failed and we were unable to recover it. 00:27:48.037 [2024-11-21 03:44:28.498127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-21 03:44:28.498253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.037 [2024-11-21 03:44:28.498279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.037 qpair failed and we were unable to recover it. 00:27:48.038 [2024-11-21 03:44:28.498371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-21 03:44:28.498470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-21 03:44:28.498495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.038 qpair failed and we were unable to recover it. 00:27:48.038 [2024-11-21 03:44:28.498599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-21 03:44:28.498702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-21 03:44:28.498727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.038 qpair failed and we were unable to recover it. 00:27:48.038 [2024-11-21 03:44:28.498852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-21 03:44:28.498945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-21 03:44:28.498970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.038 qpair failed and we were unable to recover it. 00:27:48.038 [2024-11-21 03:44:28.499101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-21 03:44:28.499235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-21 03:44:28.499260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.038 qpair failed and we were unable to recover it. 00:27:48.038 [2024-11-21 03:44:28.499383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-21 03:44:28.499503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-21 03:44:28.499527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.038 qpair failed and we were unable to recover it. 00:27:48.038 [2024-11-21 03:44:28.499620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-21 03:44:28.499769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-21 03:44:28.499794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.038 qpair failed and we were unable to recover it. 00:27:48.038 [2024-11-21 03:44:28.499894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-21 03:44:28.499990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-21 03:44:28.500014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.038 qpair failed and we were unable to recover it. 00:27:48.038 [2024-11-21 03:44:28.500168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-21 03:44:28.500273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-21 03:44:28.500300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.038 qpair failed and we were unable to recover it. 00:27:48.038 [2024-11-21 03:44:28.500433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-21 03:44:28.500528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-21 03:44:28.500557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.038 qpair failed and we were unable to recover it. 00:27:48.038 [2024-11-21 03:44:28.500692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-21 03:44:28.500822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-21 03:44:28.500847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.038 qpair failed and we were unable to recover it. 00:27:48.038 [2024-11-21 03:44:28.501008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-21 03:44:28.501117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-21 03:44:28.501144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.038 qpair failed and we were unable to recover it. 00:27:48.038 [2024-11-21 03:44:28.501241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-21 03:44:28.501375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-21 03:44:28.501399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.038 qpair failed and we were unable to recover it. 00:27:48.038 [2024-11-21 03:44:28.501500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-21 03:44:28.501620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-21 03:44:28.501645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.038 qpair failed and we were unable to recover it. 00:27:48.038 [2024-11-21 03:44:28.501768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-21 03:44:28.501867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-21 03:44:28.501891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.038 qpair failed and we were unable to recover it. 00:27:48.038 [2024-11-21 03:44:28.502043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-21 03:44:28.502155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-21 03:44:28.502181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.038 qpair failed and we were unable to recover it. 00:27:48.038 [2024-11-21 03:44:28.502283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-21 03:44:28.502404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-21 03:44:28.502429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.038 qpair failed and we were unable to recover it. 00:27:48.038 [2024-11-21 03:44:28.502523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-21 03:44:28.502617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-21 03:44:28.502642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.038 qpair failed and we were unable to recover it. 00:27:48.038 [2024-11-21 03:44:28.502779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-21 03:44:28.502909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-21 03:44:28.502934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.038 qpair failed and we were unable to recover it. 00:27:48.038 [2024-11-21 03:44:28.503039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-21 03:44:28.503197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-21 03:44:28.503228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.038 qpair failed and we were unable to recover it. 00:27:48.038 [2024-11-21 03:44:28.503325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-21 03:44:28.503454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-21 03:44:28.503478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.038 qpair failed and we were unable to recover it. 00:27:48.038 [2024-11-21 03:44:28.503579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-21 03:44:28.503679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-21 03:44:28.503703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.038 qpair failed and we were unable to recover it. 00:27:48.038 [2024-11-21 03:44:28.503814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-21 03:44:28.503940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-21 03:44:28.503965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.038 qpair failed and we were unable to recover it. 00:27:48.038 [2024-11-21 03:44:28.504090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-21 03:44:28.504197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-21 03:44:28.504223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.038 qpair failed and we were unable to recover it. 00:27:48.038 [2024-11-21 03:44:28.504321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-21 03:44:28.504417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-21 03:44:28.504442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.038 qpair failed and we were unable to recover it. 00:27:48.038 [2024-11-21 03:44:28.504549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-21 03:44:28.504645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-21 03:44:28.504671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.038 qpair failed and we were unable to recover it. 00:27:48.038 [2024-11-21 03:44:28.504802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-21 03:44:28.504932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.038 [2024-11-21 03:44:28.504957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.039 qpair failed and we were unable to recover it. 00:27:48.039 [2024-11-21 03:44:28.505088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.039 [2024-11-21 03:44:28.505183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.039 [2024-11-21 03:44:28.505207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.039 qpair failed and we were unable to recover it. 00:27:48.039 [2024-11-21 03:44:28.505310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.039 [2024-11-21 03:44:28.505408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.039 [2024-11-21 03:44:28.505432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.039 qpair failed and we were unable to recover it. 00:27:48.039 [2024-11-21 03:44:28.505530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.039 [2024-11-21 03:44:28.505635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.039 [2024-11-21 03:44:28.505664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.039 qpair failed and we were unable to recover it. 00:27:48.039 [2024-11-21 03:44:28.505769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.039 [2024-11-21 03:44:28.505897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.039 [2024-11-21 03:44:28.505921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.039 qpair failed and we were unable to recover it. 00:27:48.039 [2024-11-21 03:44:28.506018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.039 [2024-11-21 03:44:28.506146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.039 [2024-11-21 03:44:28.506172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.039 qpair failed and we were unable to recover it. 00:27:48.039 [2024-11-21 03:44:28.506282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.039 [2024-11-21 03:44:28.506378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.039 [2024-11-21 03:44:28.506404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.039 qpair failed and we were unable to recover it. 00:27:48.039 [2024-11-21 03:44:28.506530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.039 [2024-11-21 03:44:28.506631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.039 [2024-11-21 03:44:28.506658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.039 qpair failed and we were unable to recover it. 00:27:48.039 [2024-11-21 03:44:28.506757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.039 [2024-11-21 03:44:28.506879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.039 [2024-11-21 03:44:28.506904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.039 qpair failed and we were unable to recover it. 00:27:48.039 [2024-11-21 03:44:28.507005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.039 [2024-11-21 03:44:28.507132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.039 [2024-11-21 03:44:28.507158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.039 qpair failed and we were unable to recover it. 00:27:48.039 [2024-11-21 03:44:28.507262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.039 [2024-11-21 03:44:28.507359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.039 [2024-11-21 03:44:28.507384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.039 qpair failed and we were unable to recover it. 00:27:48.039 [2024-11-21 03:44:28.507486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.039 [2024-11-21 03:44:28.507585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.039 [2024-11-21 03:44:28.507611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.039 qpair failed and we were unable to recover it. 00:27:48.039 [2024-11-21 03:44:28.507708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.039 [2024-11-21 03:44:28.507829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.039 [2024-11-21 03:44:28.507854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.039 qpair failed and we were unable to recover it. 00:27:48.039 [2024-11-21 03:44:28.507962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.039 [2024-11-21 03:44:28.508094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.039 [2024-11-21 03:44:28.508124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.039 qpair failed and we were unable to recover it. 00:27:48.039 [2024-11-21 03:44:28.508251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.039 [2024-11-21 03:44:28.508339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.039 [2024-11-21 03:44:28.508364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.039 qpair failed and we were unable to recover it. 00:27:48.039 [2024-11-21 03:44:28.508461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.039 [2024-11-21 03:44:28.508587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.039 [2024-11-21 03:44:28.508611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.039 qpair failed and we were unable to recover it. 00:27:48.039 [2024-11-21 03:44:28.508718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.039 [2024-11-21 03:44:28.508823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.039 [2024-11-21 03:44:28.508848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.039 qpair failed and we were unable to recover it. 00:27:48.039 [2024-11-21 03:44:28.508975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.039 [2024-11-21 03:44:28.509102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.039 [2024-11-21 03:44:28.509127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.039 qpair failed and we were unable to recover it. 00:27:48.039 [2024-11-21 03:44:28.509251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.039 [2024-11-21 03:44:28.509348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.039 [2024-11-21 03:44:28.509374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.039 qpair failed and we were unable to recover it. 00:27:48.039 [2024-11-21 03:44:28.509499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.039 [2024-11-21 03:44:28.509626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.039 [2024-11-21 03:44:28.509651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.039 qpair failed and we were unable to recover it. 00:27:48.039 [2024-11-21 03:44:28.509757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.039 [2024-11-21 03:44:28.509850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.039 [2024-11-21 03:44:28.509875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.039 qpair failed and we were unable to recover it. 00:27:48.039 [2024-11-21 03:44:28.509975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.039 [2024-11-21 03:44:28.510100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.039 [2024-11-21 03:44:28.510126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.039 qpair failed and we were unable to recover it. 00:27:48.039 [2024-11-21 03:44:28.510265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.039 [2024-11-21 03:44:28.510369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.039 [2024-11-21 03:44:28.510393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.039 qpair failed and we were unable to recover it. 00:27:48.039 [2024-11-21 03:44:28.510492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.039 [2024-11-21 03:44:28.510617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.039 [2024-11-21 03:44:28.510642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.039 qpair failed and we were unable to recover it. 00:27:48.039 [2024-11-21 03:44:28.510748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.039 [2024-11-21 03:44:28.510856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.039 [2024-11-21 03:44:28.510882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.039 qpair failed and we were unable to recover it. 00:27:48.039 [2024-11-21 03:44:28.510977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.039 [2024-11-21 03:44:28.511102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.039 [2024-11-21 03:44:28.511128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.039 qpair failed and we were unable to recover it. 00:27:48.039 [2024-11-21 03:44:28.511224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.039 [2024-11-21 03:44:28.511323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.039 [2024-11-21 03:44:28.511349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.039 qpair failed and we were unable to recover it. 00:27:48.039 [2024-11-21 03:44:28.511458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.039 [2024-11-21 03:44:28.511607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.039 [2024-11-21 03:44:28.511631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.039 qpair failed and we were unable to recover it. 00:27:48.039 [2024-11-21 03:44:28.511764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.039 [2024-11-21 03:44:28.511904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.039 [2024-11-21 03:44:28.511929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.039 qpair failed and we were unable to recover it. 00:27:48.039 [2024-11-21 03:44:28.512027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.039 [2024-11-21 03:44:28.512168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.040 [2024-11-21 03:44:28.512194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.040 qpair failed and we were unable to recover it. 00:27:48.040 [2024-11-21 03:44:28.512312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.040 [2024-11-21 03:44:28.512402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.040 [2024-11-21 03:44:28.512426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.040 qpair failed and we were unable to recover it. 00:27:48.040 [2024-11-21 03:44:28.512554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.040 [2024-11-21 03:44:28.512648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.040 [2024-11-21 03:44:28.512672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.040 qpair failed and we were unable to recover it. 00:27:48.040 [2024-11-21 03:44:28.512844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.040 [2024-11-21 03:44:28.512946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.040 [2024-11-21 03:44:28.512971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.040 qpair failed and we were unable to recover it. 00:27:48.040 [2024-11-21 03:44:28.513084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.040 [2024-11-21 03:44:28.513210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.040 [2024-11-21 03:44:28.513235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.040 qpair failed and we were unable to recover it. 00:27:48.040 [2024-11-21 03:44:28.513339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.040 [2024-11-21 03:44:28.513460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.040 [2024-11-21 03:44:28.513485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.040 qpair failed and we were unable to recover it. 00:27:48.040 [2024-11-21 03:44:28.513602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.040 [2024-11-21 03:44:28.513701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.040 [2024-11-21 03:44:28.513727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.040 qpair failed and we were unable to recover it. 00:27:48.040 [2024-11-21 03:44:28.513828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.040 [2024-11-21 03:44:28.513918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.040 [2024-11-21 03:44:28.513943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.040 qpair failed and we were unable to recover it. 00:27:48.040 [2024-11-21 03:44:28.514048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.040 [2024-11-21 03:44:28.514164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.040 [2024-11-21 03:44:28.514190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.040 qpair failed and we were unable to recover it. 00:27:48.040 [2024-11-21 03:44:28.514298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.040 [2024-11-21 03:44:28.514438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.040 [2024-11-21 03:44:28.514462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.040 qpair failed and we were unable to recover it. 00:27:48.040 [2024-11-21 03:44:28.514560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.040 [2024-11-21 03:44:28.514673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.040 [2024-11-21 03:44:28.514699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.040 qpair failed and we were unable to recover it. 00:27:48.040 [2024-11-21 03:44:28.514800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.040 [2024-11-21 03:44:28.514959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.040 [2024-11-21 03:44:28.514985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.040 qpair failed and we were unable to recover it. 00:27:48.040 [2024-11-21 03:44:28.515097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.040 [2024-11-21 03:44:28.515196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.040 [2024-11-21 03:44:28.515222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.040 qpair failed and we were unable to recover it. 00:27:48.040 [2024-11-21 03:44:28.515350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.040 [2024-11-21 03:44:28.515482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.040 [2024-11-21 03:44:28.515507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.040 qpair failed and we were unable to recover it. 00:27:48.040 [2024-11-21 03:44:28.515600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.040 [2024-11-21 03:44:28.515701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.040 [2024-11-21 03:44:28.515727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.040 qpair failed and we were unable to recover it. 00:27:48.040 [2024-11-21 03:44:28.515839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.040 [2024-11-21 03:44:28.515964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.040 [2024-11-21 03:44:28.515990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.040 qpair failed and we were unable to recover it. 00:27:48.040 [2024-11-21 03:44:28.516112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.040 [2024-11-21 03:44:28.516240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.040 [2024-11-21 03:44:28.516265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.040 qpair failed and we were unable to recover it. 00:27:48.040 [2024-11-21 03:44:28.516394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.040 [2024-11-21 03:44:28.516496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.040 [2024-11-21 03:44:28.516520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.040 qpair failed and we were unable to recover it. 00:27:48.040 [2024-11-21 03:44:28.516652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.040 [2024-11-21 03:44:28.516788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.040 [2024-11-21 03:44:28.516813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.040 qpair failed and we were unable to recover it. 00:27:48.040 [2024-11-21 03:44:28.516918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.040 [2024-11-21 03:44:28.517015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.040 [2024-11-21 03:44:28.517039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.040 qpair failed and we were unable to recover it. 00:27:48.040 [2024-11-21 03:44:28.517200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.040 [2024-11-21 03:44:28.517302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.040 [2024-11-21 03:44:28.517327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.040 qpair failed and we were unable to recover it. 00:27:48.040 [2024-11-21 03:44:28.517447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.040 [2024-11-21 03:44:28.517575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.040 [2024-11-21 03:44:28.517599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.040 qpair failed and we were unable to recover it. 00:27:48.040 [2024-11-21 03:44:28.517694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.040 [2024-11-21 03:44:28.517822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.040 [2024-11-21 03:44:28.517847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.040 qpair failed and we were unable to recover it. 00:27:48.040 [2024-11-21 03:44:28.517942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.040 [2024-11-21 03:44:28.518062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.040 [2024-11-21 03:44:28.518092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.040 qpair failed and we were unable to recover it. 00:27:48.040 [2024-11-21 03:44:28.518221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.040 [2024-11-21 03:44:28.518315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.040 [2024-11-21 03:44:28.518339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.040 qpair failed and we were unable to recover it. 00:27:48.040 [2024-11-21 03:44:28.518468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.040 [2024-11-21 03:44:28.518592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.040 [2024-11-21 03:44:28.518617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.040 qpair failed and we were unable to recover it. 00:27:48.040 [2024-11-21 03:44:28.518768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.040 [2024-11-21 03:44:28.518863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.040 [2024-11-21 03:44:28.518887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.040 qpair failed and we were unable to recover it. 00:27:48.040 [2024-11-21 03:44:28.519019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.040 [2024-11-21 03:44:28.519123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.040 [2024-11-21 03:44:28.519148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.040 qpair failed and we were unable to recover it. 00:27:48.040 [2024-11-21 03:44:28.519255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.040 [2024-11-21 03:44:28.519391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.040 [2024-11-21 03:44:28.519416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.040 qpair failed and we were unable to recover it. 00:27:48.040 [2024-11-21 03:44:28.519513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.041 [2024-11-21 03:44:28.519612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.041 [2024-11-21 03:44:28.519637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.041 qpair failed and we were unable to recover it. 00:27:48.041 [2024-11-21 03:44:28.519731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.041 [2024-11-21 03:44:28.519834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.041 [2024-11-21 03:44:28.519858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.041 qpair failed and we were unable to recover it. 00:27:48.041 [2024-11-21 03:44:28.519982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.041 [2024-11-21 03:44:28.520098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.041 [2024-11-21 03:44:28.520124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.041 qpair failed and we were unable to recover it. 00:27:48.041 [2024-11-21 03:44:28.520222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.041 [2024-11-21 03:44:28.520316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.041 [2024-11-21 03:44:28.520340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.041 qpair failed and we were unable to recover it. 00:27:48.041 [2024-11-21 03:44:28.520440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.041 [2024-11-21 03:44:28.520542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.041 [2024-11-21 03:44:28.520567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.041 qpair failed and we were unable to recover it. 00:27:48.041 [2024-11-21 03:44:28.520671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.041 [2024-11-21 03:44:28.520771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.041 [2024-11-21 03:44:28.520798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.041 qpair failed and we were unable to recover it. 00:27:48.041 [2024-11-21 03:44:28.520931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.041 [2024-11-21 03:44:28.521037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.041 [2024-11-21 03:44:28.521064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.041 qpair failed and we were unable to recover it. 00:27:48.041 [2024-11-21 03:44:28.521198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.041 [2024-11-21 03:44:28.521294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.041 [2024-11-21 03:44:28.521321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.041 qpair failed and we were unable to recover it. 00:27:48.041 [2024-11-21 03:44:28.521414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.041 [2024-11-21 03:44:28.521502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.041 [2024-11-21 03:44:28.521528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.041 qpair failed and we were unable to recover it. 00:27:48.041 [2024-11-21 03:44:28.521648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.041 [2024-11-21 03:44:28.521745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.041 [2024-11-21 03:44:28.521771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.041 qpair failed and we were unable to recover it. 00:27:48.041 [2024-11-21 03:44:28.521869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.041 [2024-11-21 03:44:28.522023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.041 [2024-11-21 03:44:28.522048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.041 qpair failed and we were unable to recover it. 00:27:48.041 [2024-11-21 03:44:28.522154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.041 [2024-11-21 03:44:28.522252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.041 [2024-11-21 03:44:28.522277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.041 qpair failed and we were unable to recover it. 00:27:48.041 [2024-11-21 03:44:28.522366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.041 [2024-11-21 03:44:28.522469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.041 [2024-11-21 03:44:28.522494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.041 qpair failed and we were unable to recover it. 00:27:48.041 [2024-11-21 03:44:28.522589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.041 [2024-11-21 03:44:28.522739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.041 [2024-11-21 03:44:28.522763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.041 qpair failed and we were unable to recover it. 00:27:48.041 [2024-11-21 03:44:28.522865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.041 [2024-11-21 03:44:28.522958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.041 [2024-11-21 03:44:28.522984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.041 qpair failed and we were unable to recover it. 00:27:48.041 [2024-11-21 03:44:28.523096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.041 [2024-11-21 03:44:28.523186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.041 [2024-11-21 03:44:28.523210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.041 qpair failed and we were unable to recover it. 00:27:48.041 [2024-11-21 03:44:28.523347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.041 [2024-11-21 03:44:28.523442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.041 [2024-11-21 03:44:28.523466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.041 qpair failed and we were unable to recover it. 00:27:48.041 [2024-11-21 03:44:28.523597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.041 [2024-11-21 03:44:28.523723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.041 [2024-11-21 03:44:28.523748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.041 qpair failed and we were unable to recover it. 00:27:48.041 [2024-11-21 03:44:28.523882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.041 [2024-11-21 03:44:28.523973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.041 [2024-11-21 03:44:28.523998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.041 qpair failed and we were unable to recover it. 00:27:48.041 [2024-11-21 03:44:28.524144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.041 [2024-11-21 03:44:28.524248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.041 [2024-11-21 03:44:28.524274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.041 qpair failed and we were unable to recover it. 00:27:48.041 [2024-11-21 03:44:28.524375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.041 [2024-11-21 03:44:28.524481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.041 [2024-11-21 03:44:28.524507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.041 qpair failed and we were unable to recover it. 00:27:48.041 [2024-11-21 03:44:28.524605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.041 [2024-11-21 03:44:28.524725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.041 [2024-11-21 03:44:28.524750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.041 qpair failed and we were unable to recover it. 00:27:48.041 [2024-11-21 03:44:28.524879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.041 [2024-11-21 03:44:28.525011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.041 [2024-11-21 03:44:28.525036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.041 qpair failed and we were unable to recover it. 00:27:48.041 [2024-11-21 03:44:28.525150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.041 [2024-11-21 03:44:28.525240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.041 [2024-11-21 03:44:28.525266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.041 qpair failed and we were unable to recover it. 00:27:48.041 [2024-11-21 03:44:28.525392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.041 [2024-11-21 03:44:28.525498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.041 [2024-11-21 03:44:28.525524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.041 qpair failed and we were unable to recover it. 00:27:48.041 [2024-11-21 03:44:28.525682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.041 [2024-11-21 03:44:28.525771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.041 [2024-11-21 03:44:28.525796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.041 qpair failed and we were unable to recover it. 00:27:48.041 [2024-11-21 03:44:28.525916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.041 [2024-11-21 03:44:28.526027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.041 [2024-11-21 03:44:28.526054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.041 qpair failed and we were unable to recover it. 00:27:48.041 [2024-11-21 03:44:28.526165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.041 [2024-11-21 03:44:28.526265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.041 [2024-11-21 03:44:28.526291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.041 qpair failed and we were unable to recover it. 00:27:48.041 [2024-11-21 03:44:28.526420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.041 [2024-11-21 03:44:28.526524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.041 [2024-11-21 03:44:28.526549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.041 qpair failed and we were unable to recover it. 00:27:48.042 [2024-11-21 03:44:28.526682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.042 [2024-11-21 03:44:28.526806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.042 [2024-11-21 03:44:28.526831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.042 qpair failed and we were unable to recover it. 00:27:48.042 [2024-11-21 03:44:28.526973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.042 [2024-11-21 03:44:28.527067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.042 [2024-11-21 03:44:28.527100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.042 qpair failed and we were unable to recover it. 00:27:48.042 [2024-11-21 03:44:28.527202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.042 [2024-11-21 03:44:28.527298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.042 [2024-11-21 03:44:28.527323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.042 qpair failed and we were unable to recover it. 00:27:48.042 [2024-11-21 03:44:28.527488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.042 [2024-11-21 03:44:28.527589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.042 [2024-11-21 03:44:28.527613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.042 qpair failed and we were unable to recover it. 00:27:48.042 [2024-11-21 03:44:28.527708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.042 [2024-11-21 03:44:28.527814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.042 [2024-11-21 03:44:28.527838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.042 qpair failed and we were unable to recover it. 00:27:48.042 [2024-11-21 03:44:28.527934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.042 [2024-11-21 03:44:28.528045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.042 [2024-11-21 03:44:28.528087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.042 qpair failed and we were unable to recover it. 00:27:48.042 [2024-11-21 03:44:28.528196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.042 [2024-11-21 03:44:28.528321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.042 [2024-11-21 03:44:28.528346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.042 qpair failed and we were unable to recover it. 00:27:48.042 [2024-11-21 03:44:28.528493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.042 [2024-11-21 03:44:28.528616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.042 [2024-11-21 03:44:28.528646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.042 qpair failed and we were unable to recover it. 00:27:48.042 [2024-11-21 03:44:28.528754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.042 [2024-11-21 03:44:28.528877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.042 [2024-11-21 03:44:28.528903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.042 qpair failed and we were unable to recover it. 00:27:48.042 [2024-11-21 03:44:28.529058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.042 [2024-11-21 03:44:28.529197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.042 [2024-11-21 03:44:28.529223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.042 qpair failed and we were unable to recover it. 00:27:48.042 [2024-11-21 03:44:28.529331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.042 [2024-11-21 03:44:28.529464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.042 [2024-11-21 03:44:28.529492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.042 qpair failed and we were unable to recover it. 00:27:48.042 [2024-11-21 03:44:28.529601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.042 [2024-11-21 03:44:28.529734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.042 [2024-11-21 03:44:28.529759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.042 qpair failed and we were unable to recover it. 00:27:48.042 [2024-11-21 03:44:28.529860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.042 [2024-11-21 03:44:28.529984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.042 [2024-11-21 03:44:28.530009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.042 qpair failed and we were unable to recover it. 00:27:48.042 [2024-11-21 03:44:28.530148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.042 [2024-11-21 03:44:28.530246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.042 [2024-11-21 03:44:28.530272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.042 qpair failed and we were unable to recover it. 00:27:48.042 [2024-11-21 03:44:28.530386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.042 [2024-11-21 03:44:28.530538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.042 [2024-11-21 03:44:28.530563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.042 qpair failed and we were unable to recover it. 00:27:48.042 [2024-11-21 03:44:28.530692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.042 [2024-11-21 03:44:28.530824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.042 [2024-11-21 03:44:28.530850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.042 qpair failed and we were unable to recover it. 00:27:48.042 [2024-11-21 03:44:28.530979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.042 [2024-11-21 03:44:28.531074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.042 [2024-11-21 03:44:28.531100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.042 qpair failed and we were unable to recover it. 00:27:48.042 [2024-11-21 03:44:28.531192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.042 [2024-11-21 03:44:28.531293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.042 [2024-11-21 03:44:28.531319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.042 qpair failed and we were unable to recover it. 00:27:48.042 [2024-11-21 03:44:28.531456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.042 [2024-11-21 03:44:28.531558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.042 [2024-11-21 03:44:28.531583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.042 qpair failed and we were unable to recover it. 00:27:48.042 [2024-11-21 03:44:28.531687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.042 [2024-11-21 03:44:28.531815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.042 [2024-11-21 03:44:28.531841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.042 qpair failed and we were unable to recover it. 00:27:48.042 [2024-11-21 03:44:28.531940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.042 [2024-11-21 03:44:28.532047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.042 [2024-11-21 03:44:28.532082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.042 qpair failed and we were unable to recover it. 00:27:48.042 [2024-11-21 03:44:28.532216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.042 [2024-11-21 03:44:28.532349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.042 [2024-11-21 03:44:28.532374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.042 qpair failed and we were unable to recover it. 00:27:48.042 [2024-11-21 03:44:28.532476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.042 [2024-11-21 03:44:28.532597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.042 [2024-11-21 03:44:28.532622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.042 qpair failed and we were unable to recover it. 00:27:48.042 [2024-11-21 03:44:28.532728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.042 [2024-11-21 03:44:28.532826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.042 [2024-11-21 03:44:28.532851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.042 qpair failed and we were unable to recover it. 00:27:48.042 [2024-11-21 03:44:28.532946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.043 [2024-11-21 03:44:28.533047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.043 [2024-11-21 03:44:28.533080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.043 qpair failed and we were unable to recover it. 00:27:48.043 [2024-11-21 03:44:28.533209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.043 [2024-11-21 03:44:28.533313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.043 [2024-11-21 03:44:28.533340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.043 qpair failed and we were unable to recover it. 00:27:48.043 [2024-11-21 03:44:28.533440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.043 [2024-11-21 03:44:28.533537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.043 [2024-11-21 03:44:28.533563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.043 qpair failed and we were unable to recover it. 00:27:48.043 [2024-11-21 03:44:28.533690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.043 [2024-11-21 03:44:28.533793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.043 [2024-11-21 03:44:28.533820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.043 qpair failed and we were unable to recover it. 00:27:48.043 [2024-11-21 03:44:28.533947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.043 [2024-11-21 03:44:28.534078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.043 [2024-11-21 03:44:28.534105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.043 qpair failed and we were unable to recover it. 00:27:48.043 [2024-11-21 03:44:28.534236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.043 [2024-11-21 03:44:28.534339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.043 [2024-11-21 03:44:28.534365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.043 qpair failed and we were unable to recover it. 00:27:48.043 [2024-11-21 03:44:28.534482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.043 [2024-11-21 03:44:28.534579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.043 [2024-11-21 03:44:28.534604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.043 qpair failed and we were unable to recover it. 00:27:48.043 [2024-11-21 03:44:28.534702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.043 [2024-11-21 03:44:28.534820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.043 [2024-11-21 03:44:28.534845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.043 qpair failed and we were unable to recover it. 00:27:48.043 [2024-11-21 03:44:28.534942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.043 [2024-11-21 03:44:28.535043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.043 [2024-11-21 03:44:28.535076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.043 qpair failed and we were unable to recover it. 00:27:48.043 [2024-11-21 03:44:28.535183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.043 [2024-11-21 03:44:28.535281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.043 [2024-11-21 03:44:28.535306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.043 qpair failed and we were unable to recover it. 00:27:48.043 [2024-11-21 03:44:28.535423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.043 [2024-11-21 03:44:28.535523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.043 [2024-11-21 03:44:28.535549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.043 qpair failed and we were unable to recover it. 00:27:48.043 [2024-11-21 03:44:28.535680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.043 [2024-11-21 03:44:28.535800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.043 [2024-11-21 03:44:28.535825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.043 qpair failed and we were unable to recover it. 00:27:48.043 [2024-11-21 03:44:28.535922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.043 [2024-11-21 03:44:28.536044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.043 [2024-11-21 03:44:28.536077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.043 qpair failed and we were unable to recover it. 00:27:48.043 [2024-11-21 03:44:28.536186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.043 [2024-11-21 03:44:28.536287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.043 [2024-11-21 03:44:28.536313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.043 qpair failed and we were unable to recover it. 00:27:48.043 [2024-11-21 03:44:28.536423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.043 [2024-11-21 03:44:28.536526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.043 [2024-11-21 03:44:28.536552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.043 qpair failed and we were unable to recover it. 00:27:48.043 [2024-11-21 03:44:28.536677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.043 [2024-11-21 03:44:28.536778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.043 [2024-11-21 03:44:28.536804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.043 qpair failed and we were unable to recover it. 00:27:48.043 [2024-11-21 03:44:28.536928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.043 [2024-11-21 03:44:28.537017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.043 [2024-11-21 03:44:28.537043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.043 qpair failed and we were unable to recover it. 00:27:48.043 [2024-11-21 03:44:28.537143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.043 [2024-11-21 03:44:28.537276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.043 [2024-11-21 03:44:28.537302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.043 qpair failed and we were unable to recover it. 00:27:48.043 [2024-11-21 03:44:28.537411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.043 [2024-11-21 03:44:28.537533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.043 [2024-11-21 03:44:28.537558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.043 qpair failed and we were unable to recover it. 00:27:48.043 [2024-11-21 03:44:28.537686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.043 [2024-11-21 03:44:28.537782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.043 [2024-11-21 03:44:28.537807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.043 qpair failed and we were unable to recover it. 00:27:48.043 [2024-11-21 03:44:28.537941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.043 [2024-11-21 03:44:28.538062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.043 [2024-11-21 03:44:28.538094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.043 qpair failed and we were unable to recover it. 00:27:48.043 [2024-11-21 03:44:28.538221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.043 [2024-11-21 03:44:28.538320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.043 [2024-11-21 03:44:28.538346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.043 qpair failed and we were unable to recover it. 00:27:48.043 [2024-11-21 03:44:28.538442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.043 [2024-11-21 03:44:28.538544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.043 [2024-11-21 03:44:28.538569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.043 qpair failed and we were unable to recover it. 00:27:48.043 [2024-11-21 03:44:28.538706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.043 [2024-11-21 03:44:28.538804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.043 [2024-11-21 03:44:28.538829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.043 qpair failed and we were unable to recover it. 00:27:48.043 [2024-11-21 03:44:28.538956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.043 [2024-11-21 03:44:28.539053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.043 [2024-11-21 03:44:28.539087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.043 qpair failed and we were unable to recover it. 00:27:48.043 [2024-11-21 03:44:28.539186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.043 [2024-11-21 03:44:28.539288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.043 [2024-11-21 03:44:28.539315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.043 qpair failed and we were unable to recover it. 00:27:48.043 [2024-11-21 03:44:28.539431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.043 [2024-11-21 03:44:28.539555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.043 [2024-11-21 03:44:28.539580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.043 qpair failed and we were unable to recover it. 00:27:48.043 [2024-11-21 03:44:28.539684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.043 [2024-11-21 03:44:28.539774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.043 [2024-11-21 03:44:28.539799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.043 qpair failed and we were unable to recover it. 00:27:48.043 [2024-11-21 03:44:28.539925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.043 [2024-11-21 03:44:28.540021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.043 [2024-11-21 03:44:28.540048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.043 qpair failed and we were unable to recover it. 00:27:48.043 [2024-11-21 03:44:28.540165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.043 [2024-11-21 03:44:28.540297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.043 [2024-11-21 03:44:28.540326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.043 qpair failed and we were unable to recover it. 00:27:48.043 [2024-11-21 03:44:28.540431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.043 [2024-11-21 03:44:28.540529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.043 [2024-11-21 03:44:28.540554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.043 qpair failed and we were unable to recover it. 00:27:48.043 [2024-11-21 03:44:28.540656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.043 [2024-11-21 03:44:28.540755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.044 [2024-11-21 03:44:28.540780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.044 qpair failed and we were unable to recover it. 00:27:48.044 [2024-11-21 03:44:28.540918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.044 [2024-11-21 03:44:28.541021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.044 [2024-11-21 03:44:28.541045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.044 qpair failed and we were unable to recover it. 00:27:48.044 [2024-11-21 03:44:28.541192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.044 [2024-11-21 03:44:28.541294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.044 [2024-11-21 03:44:28.541329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.044 qpair failed and we were unable to recover it. 00:27:48.044 [2024-11-21 03:44:28.541442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.044 [2024-11-21 03:44:28.541567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.044 [2024-11-21 03:44:28.541593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.044 qpair failed and we were unable to recover it. 00:27:48.044 [2024-11-21 03:44:28.541696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.044 [2024-11-21 03:44:28.541818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.044 [2024-11-21 03:44:28.541844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.044 qpair failed and we were unable to recover it. 00:27:48.044 [2024-11-21 03:44:28.541943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.044 [2024-11-21 03:44:28.542080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.044 [2024-11-21 03:44:28.542107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.044 qpair failed and we were unable to recover it. 00:27:48.044 [2024-11-21 03:44:28.542204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.044 [2024-11-21 03:44:28.542366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.044 [2024-11-21 03:44:28.542392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.044 qpair failed and we were unable to recover it. 00:27:48.044 [2024-11-21 03:44:28.542515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.044 [2024-11-21 03:44:28.542610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.044 [2024-11-21 03:44:28.542635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.044 qpair failed and we were unable to recover it. 00:27:48.044 [2024-11-21 03:44:28.542763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.044 [2024-11-21 03:44:28.542859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.044 [2024-11-21 03:44:28.542885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.044 qpair failed and we were unable to recover it. 00:27:48.044 [2024-11-21 03:44:28.542980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.044 [2024-11-21 03:44:28.543113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.044 [2024-11-21 03:44:28.543140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.044 qpair failed and we were unable to recover it. 00:27:48.044 [2024-11-21 03:44:28.543276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.044 [2024-11-21 03:44:28.543380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.044 [2024-11-21 03:44:28.543405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.044 qpair failed and we were unable to recover it. 00:27:48.044 [2024-11-21 03:44:28.543543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.044 [2024-11-21 03:44:28.543642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.044 [2024-11-21 03:44:28.543668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.044 qpair failed and we were unable to recover it. 00:27:48.044 [2024-11-21 03:44:28.543777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.044 [2024-11-21 03:44:28.543936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.044 [2024-11-21 03:44:28.543967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.044 qpair failed and we were unable to recover it. 00:27:48.044 [2024-11-21 03:44:28.544082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.044 [2024-11-21 03:44:28.544187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.044 [2024-11-21 03:44:28.544213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.044 qpair failed and we were unable to recover it. 00:27:48.044 [2024-11-21 03:44:28.544312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.044 [2024-11-21 03:44:28.544454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.044 [2024-11-21 03:44:28.544481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.044 qpair failed and we were unable to recover it. 00:27:48.044 [2024-11-21 03:44:28.544604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.044 [2024-11-21 03:44:28.544696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.044 [2024-11-21 03:44:28.544722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.044 qpair failed and we were unable to recover it. 00:27:48.044 [2024-11-21 03:44:28.544825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.044 [2024-11-21 03:44:28.544917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.044 [2024-11-21 03:44:28.544943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.044 qpair failed and we were unable to recover it. 00:27:48.044 [2024-11-21 03:44:28.545075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.044 [2024-11-21 03:44:28.545176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.044 [2024-11-21 03:44:28.545203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.044 qpair failed and we were unable to recover it. 00:27:48.044 [2024-11-21 03:44:28.545336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.044 [2024-11-21 03:44:28.545431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.044 [2024-11-21 03:44:28.545456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.044 qpair failed and we were unable to recover it. 00:27:48.044 [2024-11-21 03:44:28.545548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.044 [2024-11-21 03:44:28.545652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.044 [2024-11-21 03:44:28.545679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.044 qpair failed and we were unable to recover it. 00:27:48.044 [2024-11-21 03:44:28.545795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.044 [2024-11-21 03:44:28.545925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.044 [2024-11-21 03:44:28.545952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.044 qpair failed and we were unable to recover it. 00:27:48.044 [2024-11-21 03:44:28.546057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.044 [2024-11-21 03:44:28.546167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.044 [2024-11-21 03:44:28.546195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.044 qpair failed and we were unable to recover it. 00:27:48.044 [2024-11-21 03:44:28.546292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.044 [2024-11-21 03:44:28.546418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.044 [2024-11-21 03:44:28.546448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.044 qpair failed and we were unable to recover it. 00:27:48.044 [2024-11-21 03:44:28.546592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.044 [2024-11-21 03:44:28.546723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.044 [2024-11-21 03:44:28.546749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.044 qpair failed and we were unable to recover it. 00:27:48.044 [2024-11-21 03:44:28.546885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.044 [2024-11-21 03:44:28.547013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.044 [2024-11-21 03:44:28.547039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.044 qpair failed and we were unable to recover it. 00:27:48.044 [2024-11-21 03:44:28.547149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.044 [2024-11-21 03:44:28.547255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.044 [2024-11-21 03:44:28.547280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.044 qpair failed and we were unable to recover it. 00:27:48.044 [2024-11-21 03:44:28.547379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.044 [2024-11-21 03:44:28.547503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.044 [2024-11-21 03:44:28.547530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.044 qpair failed and we were unable to recover it. 00:27:48.044 [2024-11-21 03:44:28.547640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.044 [2024-11-21 03:44:28.547739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.044 [2024-11-21 03:44:28.547765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.044 qpair failed and we were unable to recover it. 00:27:48.044 [2024-11-21 03:44:28.547899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.044 [2024-11-21 03:44:28.548026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.044 [2024-11-21 03:44:28.548052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.044 qpair failed and we were unable to recover it. 00:27:48.044 [2024-11-21 03:44:28.548174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.044 [2024-11-21 03:44:28.548270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.044 [2024-11-21 03:44:28.548297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.044 qpair failed and we were unable to recover it. 00:27:48.044 [2024-11-21 03:44:28.548408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.044 [2024-11-21 03:44:28.548546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.044 [2024-11-21 03:44:28.548571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.044 qpair failed and we were unable to recover it. 00:27:48.044 [2024-11-21 03:44:28.548677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.044 [2024-11-21 03:44:28.548780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.045 [2024-11-21 03:44:28.548807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.045 qpair failed and we were unable to recover it. 00:27:48.045 [2024-11-21 03:44:28.548939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.045 [2024-11-21 03:44:28.549075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.045 [2024-11-21 03:44:28.549107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.045 qpair failed and we were unable to recover it. 00:27:48.045 [2024-11-21 03:44:28.549209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.045 [2024-11-21 03:44:28.549341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.045 [2024-11-21 03:44:28.549366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.045 qpair failed and we were unable to recover it. 00:27:48.045 [2024-11-21 03:44:28.549470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.045 [2024-11-21 03:44:28.549564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.045 [2024-11-21 03:44:28.549591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.045 qpair failed and we were unable to recover it. 00:27:48.045 [2024-11-21 03:44:28.549705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.045 [2024-11-21 03:44:28.549859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.045 [2024-11-21 03:44:28.549884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.045 qpair failed and we were unable to recover it. 00:27:48.045 [2024-11-21 03:44:28.549999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.045 [2024-11-21 03:44:28.550101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.045 [2024-11-21 03:44:28.550128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.045 qpair failed and we were unable to recover it. 00:27:48.045 [2024-11-21 03:44:28.550258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.045 [2024-11-21 03:44:28.550364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.045 [2024-11-21 03:44:28.550391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.045 qpair failed and we were unable to recover it. 00:27:48.045 [2024-11-21 03:44:28.550493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.045 [2024-11-21 03:44:28.550591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.045 [2024-11-21 03:44:28.550618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.045 qpair failed and we were unable to recover it. 00:27:48.045 [2024-11-21 03:44:28.550715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.045 [2024-11-21 03:44:28.550820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.045 [2024-11-21 03:44:28.550846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.045 qpair failed and we were unable to recover it. 00:27:48.045 [2024-11-21 03:44:28.550974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.045 [2024-11-21 03:44:28.551074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.045 [2024-11-21 03:44:28.551100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.045 qpair failed and we were unable to recover it. 00:27:48.045 [2024-11-21 03:44:28.551197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.045 [2024-11-21 03:44:28.551294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.045 [2024-11-21 03:44:28.551320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.045 qpair failed and we were unable to recover it. 00:27:48.045 [2024-11-21 03:44:28.551422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.045 [2024-11-21 03:44:28.551517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.045 [2024-11-21 03:44:28.551543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.045 qpair failed and we were unable to recover it. 00:27:48.045 [2024-11-21 03:44:28.551676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.045 [2024-11-21 03:44:28.551801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.045 [2024-11-21 03:44:28.551826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.045 qpair failed and we were unable to recover it. 00:27:48.045 [2024-11-21 03:44:28.551938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.045 [2024-11-21 03:44:28.552062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.045 [2024-11-21 03:44:28.552119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.045 qpair failed and we were unable to recover it. 00:27:48.045 [2024-11-21 03:44:28.552217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.045 [2024-11-21 03:44:28.552352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.045 [2024-11-21 03:44:28.552377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.045 qpair failed and we were unable to recover it. 00:27:48.045 [2024-11-21 03:44:28.552500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.045 [2024-11-21 03:44:28.552601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.045 [2024-11-21 03:44:28.552627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.045 qpair failed and we were unable to recover it. 00:27:48.045 [2024-11-21 03:44:28.552724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.045 [2024-11-21 03:44:28.552847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.045 [2024-11-21 03:44:28.552873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.045 qpair failed and we were unable to recover it. 00:27:48.045 [2024-11-21 03:44:28.552978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.045 [2024-11-21 03:44:28.553105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.045 [2024-11-21 03:44:28.553132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.045 qpair failed and we were unable to recover it. 00:27:48.045 [2024-11-21 03:44:28.553232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.045 [2024-11-21 03:44:28.553335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.045 [2024-11-21 03:44:28.553361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.045 qpair failed and we were unable to recover it. 00:27:48.045 [2024-11-21 03:44:28.553492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.045 [2024-11-21 03:44:28.553592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.045 [2024-11-21 03:44:28.553617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.045 qpair failed and we were unable to recover it. 00:27:48.045 [2024-11-21 03:44:28.553720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.045 [2024-11-21 03:44:28.553850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.045 [2024-11-21 03:44:28.553876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.045 qpair failed and we were unable to recover it. 00:27:48.045 [2024-11-21 03:44:28.553981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.045 [2024-11-21 03:44:28.554084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.045 [2024-11-21 03:44:28.554111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.045 qpair failed and we were unable to recover it. 00:27:48.045 [2024-11-21 03:44:28.554241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.045 [2024-11-21 03:44:28.554342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.045 [2024-11-21 03:44:28.554368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.045 qpair failed and we were unable to recover it. 00:27:48.045 [2024-11-21 03:44:28.554464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.045 [2024-11-21 03:44:28.554564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.045 [2024-11-21 03:44:28.554589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.045 qpair failed and we were unable to recover it. 00:27:48.045 [2024-11-21 03:44:28.554744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.045 [2024-11-21 03:44:28.554839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.045 [2024-11-21 03:44:28.554864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.045 qpair failed and we were unable to recover it. 00:27:48.045 [2024-11-21 03:44:28.554967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.045 [2024-11-21 03:44:28.555074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.045 [2024-11-21 03:44:28.555100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.045 qpair failed and we were unable to recover it. 00:27:48.045 [2024-11-21 03:44:28.555190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.045 [2024-11-21 03:44:28.555312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.045 [2024-11-21 03:44:28.555338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.045 qpair failed and we were unable to recover it. 00:27:48.045 [2024-11-21 03:44:28.555433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.045 [2024-11-21 03:44:28.555557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.045 [2024-11-21 03:44:28.555582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.045 qpair failed and we were unable to recover it. 00:27:48.045 [2024-11-21 03:44:28.555710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.045 [2024-11-21 03:44:28.555818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.045 [2024-11-21 03:44:28.555843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.045 qpair failed and we were unable to recover it. 00:27:48.045 [2024-11-21 03:44:28.555946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.045 [2024-11-21 03:44:28.556046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.045 [2024-11-21 03:44:28.556079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.045 qpair failed and we were unable to recover it. 00:27:48.045 [2024-11-21 03:44:28.556205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.045 [2024-11-21 03:44:28.556303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.045 [2024-11-21 03:44:28.556329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.045 qpair failed and we were unable to recover it. 00:27:48.045 [2024-11-21 03:44:28.556429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.045 [2024-11-21 03:44:28.556559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.045 [2024-11-21 03:44:28.556584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.046 qpair failed and we were unable to recover it. 00:27:48.046 [2024-11-21 03:44:28.556714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.046 [2024-11-21 03:44:28.556809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.046 [2024-11-21 03:44:28.556835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.046 qpair failed and we were unable to recover it. 00:27:48.046 [2024-11-21 03:44:28.556929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.046 [2024-11-21 03:44:28.557024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.046 [2024-11-21 03:44:28.557051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.046 qpair failed and we were unable to recover it. 00:27:48.046 [2024-11-21 03:44:28.557186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.046 [2024-11-21 03:44:28.557288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.046 [2024-11-21 03:44:28.557314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.046 qpair failed and we were unable to recover it. 00:27:48.046 [2024-11-21 03:44:28.557415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.046 [2024-11-21 03:44:28.557542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.046 [2024-11-21 03:44:28.557569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.046 qpair failed and we were unable to recover it. 00:27:48.046 [2024-11-21 03:44:28.557665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.046 [2024-11-21 03:44:28.557788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.046 [2024-11-21 03:44:28.557814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.046 qpair failed and we were unable to recover it. 00:27:48.046 [2024-11-21 03:44:28.557955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.046 [2024-11-21 03:44:28.558055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.046 [2024-11-21 03:44:28.558088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.046 qpair failed and we were unable to recover it. 00:27:48.046 [2024-11-21 03:44:28.558245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.046 [2024-11-21 03:44:28.558371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.046 [2024-11-21 03:44:28.558396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.046 qpair failed and we were unable to recover it. 00:27:48.046 [2024-11-21 03:44:28.558493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.046 [2024-11-21 03:44:28.558617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.046 [2024-11-21 03:44:28.558643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.046 qpair failed and we were unable to recover it. 00:27:48.046 [2024-11-21 03:44:28.558735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.046 [2024-11-21 03:44:28.558830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.046 [2024-11-21 03:44:28.558855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.046 qpair failed and we were unable to recover it. 00:27:48.046 [2024-11-21 03:44:28.558957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.046 [2024-11-21 03:44:28.559084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.046 [2024-11-21 03:44:28.559111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.046 qpair failed and we were unable to recover it. 00:27:48.046 [2024-11-21 03:44:28.559241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.046 [2024-11-21 03:44:28.559348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.046 [2024-11-21 03:44:28.559373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.046 qpair failed and we were unable to recover it. 00:27:48.046 [2024-11-21 03:44:28.559496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.046 [2024-11-21 03:44:28.559589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.046 [2024-11-21 03:44:28.559614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.046 qpair failed and we were unable to recover it. 00:27:48.046 [2024-11-21 03:44:28.559743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.046 [2024-11-21 03:44:28.559840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.046 [2024-11-21 03:44:28.559865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.046 qpair failed and we were unable to recover it. 00:27:48.046 [2024-11-21 03:44:28.559998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.046 [2024-11-21 03:44:28.560100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.046 [2024-11-21 03:44:28.560126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.046 qpair failed and we were unable to recover it. 00:27:48.046 [2024-11-21 03:44:28.560219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.046 [2024-11-21 03:44:28.560341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.046 [2024-11-21 03:44:28.560366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.046 qpair failed and we were unable to recover it. 00:27:48.046 [2024-11-21 03:44:28.560465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.046 [2024-11-21 03:44:28.560566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.046 [2024-11-21 03:44:28.560594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.046 qpair failed and we were unable to recover it. 00:27:48.046 [2024-11-21 03:44:28.560703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.046 [2024-11-21 03:44:28.560804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.046 [2024-11-21 03:44:28.560830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.046 qpair failed and we were unable to recover it. 00:27:48.046 [2024-11-21 03:44:28.560936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.046 [2024-11-21 03:44:28.561063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.046 [2024-11-21 03:44:28.561095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.046 qpair failed and we were unable to recover it. 00:27:48.046 [2024-11-21 03:44:28.561227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.046 [2024-11-21 03:44:28.561326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.046 [2024-11-21 03:44:28.561352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.046 qpair failed and we were unable to recover it. 00:27:48.046 [2024-11-21 03:44:28.561452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.046 [2024-11-21 03:44:28.561587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.046 [2024-11-21 03:44:28.561613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.046 qpair failed and we were unable to recover it. 00:27:48.046 [2024-11-21 03:44:28.561709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.046 [2024-11-21 03:44:28.561810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.046 [2024-11-21 03:44:28.561836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.046 qpair failed and we were unable to recover it. 00:27:48.046 [2024-11-21 03:44:28.561938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.046 [2024-11-21 03:44:28.562038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.046 [2024-11-21 03:44:28.562063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.046 qpair failed and we were unable to recover it. 00:27:48.046 [2024-11-21 03:44:28.562174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.046 [2024-11-21 03:44:28.562300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.046 [2024-11-21 03:44:28.562325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.046 qpair failed and we were unable to recover it. 00:27:48.046 [2024-11-21 03:44:28.562430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.046 [2024-11-21 03:44:28.562525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.046 [2024-11-21 03:44:28.562550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.046 qpair failed and we were unable to recover it. 00:27:48.046 [2024-11-21 03:44:28.562645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.046 [2024-11-21 03:44:28.562749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.046 [2024-11-21 03:44:28.562776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.046 qpair failed and we were unable to recover it. 00:27:48.046 [2024-11-21 03:44:28.562937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.046 [2024-11-21 03:44:28.563059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.046 [2024-11-21 03:44:28.563093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.046 qpair failed and we were unable to recover it. 00:27:48.046 [2024-11-21 03:44:28.563196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.046 [2024-11-21 03:44:28.563301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.046 [2024-11-21 03:44:28.563326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.046 qpair failed and we were unable to recover it. 00:27:48.046 [2024-11-21 03:44:28.563432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.046 [2024-11-21 03:44:28.563554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.046 [2024-11-21 03:44:28.563579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.046 qpair failed and we were unable to recover it. 00:27:48.046 [2024-11-21 03:44:28.563705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.046 [2024-11-21 03:44:28.563805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.046 [2024-11-21 03:44:28.563831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.047 qpair failed and we were unable to recover it. 00:27:48.047 [2024-11-21 03:44:28.563940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.047 [2024-11-21 03:44:28.564094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.047 [2024-11-21 03:44:28.564120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.047 qpair failed and we were unable to recover it. 00:27:48.047 [2024-11-21 03:44:28.564231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.047 [2024-11-21 03:44:28.564333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.047 [2024-11-21 03:44:28.564358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.047 qpair failed and we were unable to recover it. 00:27:48.047 [2024-11-21 03:44:28.564455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.047 [2024-11-21 03:44:28.564549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.047 [2024-11-21 03:44:28.564574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.047 qpair failed and we were unable to recover it. 00:27:48.047 [2024-11-21 03:44:28.564678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.047 [2024-11-21 03:44:28.564779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.047 [2024-11-21 03:44:28.564805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.047 qpair failed and we were unable to recover it. 00:27:48.047 [2024-11-21 03:44:28.564910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.047 [2024-11-21 03:44:28.565037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.047 [2024-11-21 03:44:28.565080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.047 qpair failed and we were unable to recover it. 00:27:48.047 [2024-11-21 03:44:28.565179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.047 [2024-11-21 03:44:28.565279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.047 [2024-11-21 03:44:28.565306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.047 qpair failed and we were unable to recover it. 00:27:48.047 [2024-11-21 03:44:28.565416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.047 [2024-11-21 03:44:28.565544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.047 [2024-11-21 03:44:28.565569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.047 qpair failed and we were unable to recover it. 00:27:48.047 [2024-11-21 03:44:28.565670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.047 [2024-11-21 03:44:28.565769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.047 [2024-11-21 03:44:28.565794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.047 qpair failed and we were unable to recover it. 00:27:48.047 [2024-11-21 03:44:28.565912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.047 [2024-11-21 03:44:28.566035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.047 [2024-11-21 03:44:28.566060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.047 qpair failed and we were unable to recover it. 00:27:48.047 [2024-11-21 03:44:28.566202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.047 [2024-11-21 03:44:28.566292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.047 [2024-11-21 03:44:28.566317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.047 qpair failed and we were unable to recover it. 00:27:48.047 [2024-11-21 03:44:28.566449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.047 [2024-11-21 03:44:28.566578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.047 [2024-11-21 03:44:28.566603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.047 qpair failed and we were unable to recover it. 00:27:48.047 [2024-11-21 03:44:28.566706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.047 [2024-11-21 03:44:28.566810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.047 [2024-11-21 03:44:28.566836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.047 qpair failed and we were unable to recover it. 00:27:48.047 [2024-11-21 03:44:28.566967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.047 [2024-11-21 03:44:28.567060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.047 [2024-11-21 03:44:28.567093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.047 qpair failed and we were unable to recover it. 00:27:48.047 [2024-11-21 03:44:28.567194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.047 [2024-11-21 03:44:28.567294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.047 [2024-11-21 03:44:28.567321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.047 qpair failed and we were unable to recover it. 00:27:48.047 [2024-11-21 03:44:28.567422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.047 [2024-11-21 03:44:28.567543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.047 [2024-11-21 03:44:28.567568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.047 qpair failed and we were unable to recover it. 00:27:48.047 [2024-11-21 03:44:28.567667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.047 [2024-11-21 03:44:28.567791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.047 [2024-11-21 03:44:28.567816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.047 qpair failed and we were unable to recover it. 00:27:48.047 [2024-11-21 03:44:28.567917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.047 [2024-11-21 03:44:28.568019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.047 [2024-11-21 03:44:28.568045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.047 qpair failed and we were unable to recover it. 00:27:48.047 [2024-11-21 03:44:28.568181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.047 [2024-11-21 03:44:28.568275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.047 [2024-11-21 03:44:28.568300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.047 qpair failed and we were unable to recover it. 00:27:48.047 [2024-11-21 03:44:28.568409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.047 [2024-11-21 03:44:28.568536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.047 [2024-11-21 03:44:28.568561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.047 qpair failed and we were unable to recover it. 00:27:48.047 [2024-11-21 03:44:28.568687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.047 [2024-11-21 03:44:28.568797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.047 [2024-11-21 03:44:28.568822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.047 qpair failed and we were unable to recover it. 00:27:48.047 [2024-11-21 03:44:28.568952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.047 [2024-11-21 03:44:28.569047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.047 [2024-11-21 03:44:28.569080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.047 qpair failed and we were unable to recover it. 00:27:48.047 [2024-11-21 03:44:28.569211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.047 [2024-11-21 03:44:28.569336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.047 [2024-11-21 03:44:28.569361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.047 qpair failed and we were unable to recover it. 00:27:48.047 [2024-11-21 03:44:28.569487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.047 [2024-11-21 03:44:28.569611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.047 [2024-11-21 03:44:28.569636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.047 qpair failed and we were unable to recover it. 00:27:48.047 [2024-11-21 03:44:28.569733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.047 [2024-11-21 03:44:28.569823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.047 [2024-11-21 03:44:28.569848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.047 qpair failed and we were unable to recover it. 00:27:48.047 [2024-11-21 03:44:28.569951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.047 [2024-11-21 03:44:28.570054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.047 [2024-11-21 03:44:28.570089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.047 qpair failed and we were unable to recover it. 00:27:48.047 [2024-11-21 03:44:28.570216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.047 [2024-11-21 03:44:28.570314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.047 [2024-11-21 03:44:28.570339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.047 qpair failed and we were unable to recover it. 00:27:48.047 [2024-11-21 03:44:28.570452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.047 [2024-11-21 03:44:28.570612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.047 [2024-11-21 03:44:28.570638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.047 qpair failed and we were unable to recover it. 00:27:48.047 [2024-11-21 03:44:28.570739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.047 [2024-11-21 03:44:28.570866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.047 [2024-11-21 03:44:28.570891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.047 qpair failed and we were unable to recover it. 00:27:48.047 [2024-11-21 03:44:28.570993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.047 [2024-11-21 03:44:28.571125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.047 [2024-11-21 03:44:28.571152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.047 qpair failed and we were unable to recover it. 00:27:48.047 [2024-11-21 03:44:28.571252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.047 [2024-11-21 03:44:28.571348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.047 [2024-11-21 03:44:28.571373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.047 qpair failed and we were unable to recover it. 00:27:48.047 [2024-11-21 03:44:28.571473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.047 [2024-11-21 03:44:28.571625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.047 [2024-11-21 03:44:28.571650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.047 qpair failed and we were unable to recover it. 00:27:48.047 [2024-11-21 03:44:28.571759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.047 [2024-11-21 03:44:28.571890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.047 [2024-11-21 03:44:28.571917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.047 qpair failed and we were unable to recover it. 00:27:48.047 [2024-11-21 03:44:28.572018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.047 [2024-11-21 03:44:28.572128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.047 [2024-11-21 03:44:28.572154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.047 qpair failed and we were unable to recover it. 00:27:48.047 [2024-11-21 03:44:28.572256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.048 [2024-11-21 03:44:28.572355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.048 [2024-11-21 03:44:28.572388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.048 qpair failed and we were unable to recover it. 00:27:48.048 [2024-11-21 03:44:28.572491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.048 [2024-11-21 03:44:28.572589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.048 [2024-11-21 03:44:28.572615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.048 qpair failed and we were unable to recover it. 00:27:48.048 [2024-11-21 03:44:28.572730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.048 [2024-11-21 03:44:28.572830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.048 [2024-11-21 03:44:28.572854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.048 qpair failed and we were unable to recover it. 00:27:48.048 [2024-11-21 03:44:28.572995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.048 [2024-11-21 03:44:28.573123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.048 [2024-11-21 03:44:28.573148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.048 qpair failed and we were unable to recover it. 00:27:48.048 [2024-11-21 03:44:28.573253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.048 [2024-11-21 03:44:28.573351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.048 [2024-11-21 03:44:28.573377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.048 qpair failed and we were unable to recover it. 00:27:48.048 [2024-11-21 03:44:28.573479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.048 [2024-11-21 03:44:28.573602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.048 [2024-11-21 03:44:28.573627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.048 qpair failed and we were unable to recover it. 00:27:48.048 [2024-11-21 03:44:28.573758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.048 [2024-11-21 03:44:28.573858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.048 [2024-11-21 03:44:28.573883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.048 qpair failed and we were unable to recover it. 00:27:48.048 [2024-11-21 03:44:28.573977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.048 [2024-11-21 03:44:28.574077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.048 [2024-11-21 03:44:28.574102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.048 qpair failed and we were unable to recover it. 00:27:48.048 [2024-11-21 03:44:28.574224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.048 [2024-11-21 03:44:28.574326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.048 [2024-11-21 03:44:28.574352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.048 qpair failed and we were unable to recover it. 00:27:48.048 [2024-11-21 03:44:28.574454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.048 [2024-11-21 03:44:28.574542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.048 [2024-11-21 03:44:28.574567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.048 qpair failed and we were unable to recover it. 00:27:48.048 [2024-11-21 03:44:28.574664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.048 [2024-11-21 03:44:28.574759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.048 [2024-11-21 03:44:28.574783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.048 qpair failed and we were unable to recover it. 00:27:48.048 [2024-11-21 03:44:28.574878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.048 [2024-11-21 03:44:28.574970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.048 [2024-11-21 03:44:28.574995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.048 qpair failed and we were unable to recover it. 00:27:48.048 [2024-11-21 03:44:28.575123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.048 [2024-11-21 03:44:28.575222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.048 [2024-11-21 03:44:28.575247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.048 qpair failed and we were unable to recover it. 00:27:48.048 [2024-11-21 03:44:28.575340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.048 [2024-11-21 03:44:28.575475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.048 [2024-11-21 03:44:28.575501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.048 qpair failed and we were unable to recover it. 00:27:48.048 [2024-11-21 03:44:28.575607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.048 [2024-11-21 03:44:28.575712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.048 [2024-11-21 03:44:28.575736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.048 qpair failed and we were unable to recover it. 00:27:48.048 [2024-11-21 03:44:28.575847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.048 [2024-11-21 03:44:28.575942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.048 [2024-11-21 03:44:28.575967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.048 qpair failed and we were unable to recover it. 00:27:48.048 [2024-11-21 03:44:28.576074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.048 [2024-11-21 03:44:28.576206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.048 [2024-11-21 03:44:28.576232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.048 qpair failed and we were unable to recover it. 00:27:48.048 [2024-11-21 03:44:28.576333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.048 [2024-11-21 03:44:28.576434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.048 [2024-11-21 03:44:28.576461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.048 qpair failed and we were unable to recover it. 00:27:48.048 [2024-11-21 03:44:28.576567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.048 [2024-11-21 03:44:28.576667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.048 [2024-11-21 03:44:28.576692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.048 qpair failed and we were unable to recover it. 00:27:48.048 [2024-11-21 03:44:28.576799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.048 [2024-11-21 03:44:28.576922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.048 [2024-11-21 03:44:28.576947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.048 qpair failed and we were unable to recover it. 00:27:48.048 [2024-11-21 03:44:28.577041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.048 [2024-11-21 03:44:28.577140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.048 [2024-11-21 03:44:28.577166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.048 qpair failed and we were unable to recover it. 00:27:48.048 [2024-11-21 03:44:28.577289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.048 [2024-11-21 03:44:28.577445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.048 [2024-11-21 03:44:28.577470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.048 qpair failed and we were unable to recover it. 00:27:48.048 [2024-11-21 03:44:28.577597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.048 [2024-11-21 03:44:28.577699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.048 [2024-11-21 03:44:28.577725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.048 qpair failed and we were unable to recover it. 00:27:48.048 [2024-11-21 03:44:28.577819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.048 [2024-11-21 03:44:28.577920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.048 [2024-11-21 03:44:28.577945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.048 qpair failed and we were unable to recover it. 00:27:48.048 [2024-11-21 03:44:28.578047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.048 [2024-11-21 03:44:28.578171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.048 [2024-11-21 03:44:28.578198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.048 qpair failed and we were unable to recover it. 00:27:48.048 [2024-11-21 03:44:28.578296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.048 [2024-11-21 03:44:28.578401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.048 [2024-11-21 03:44:28.578427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.048 qpair failed and we were unable to recover it. 00:27:48.048 [2024-11-21 03:44:28.578538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.048 [2024-11-21 03:44:28.578640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.048 [2024-11-21 03:44:28.578667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.048 qpair failed and we were unable to recover it. 00:27:48.048 [2024-11-21 03:44:28.578764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.048 [2024-11-21 03:44:28.578883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.048 [2024-11-21 03:44:28.578907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.048 qpair failed and we were unable to recover it. 00:27:48.048 [2024-11-21 03:44:28.579011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.048 [2024-11-21 03:44:28.579123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.048 [2024-11-21 03:44:28.579148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.048 qpair failed and we were unable to recover it. 00:27:48.048 [2024-11-21 03:44:28.579241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.048 [2024-11-21 03:44:28.579374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.048 [2024-11-21 03:44:28.579399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.048 qpair failed and we were unable to recover it. 00:27:48.048 [2024-11-21 03:44:28.579501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.048 [2024-11-21 03:44:28.579630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.048 [2024-11-21 03:44:28.579654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.048 qpair failed and we were unable to recover it. 00:27:48.048 [2024-11-21 03:44:28.579780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.048 [2024-11-21 03:44:28.579904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.048 [2024-11-21 03:44:28.579928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.048 qpair failed and we were unable to recover it. 00:27:48.048 [2024-11-21 03:44:28.580029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.048 [2024-11-21 03:44:28.580137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.048 [2024-11-21 03:44:28.580163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.048 qpair failed and we were unable to recover it. 00:27:48.048 [2024-11-21 03:44:28.580292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.048 [2024-11-21 03:44:28.580398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.049 [2024-11-21 03:44:28.580422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.049 qpair failed and we were unable to recover it. 00:27:48.049 [2024-11-21 03:44:28.580525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.049 [2024-11-21 03:44:28.580621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.049 [2024-11-21 03:44:28.580645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.049 qpair failed and we were unable to recover it. 00:27:48.049 [2024-11-21 03:44:28.580776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.049 [2024-11-21 03:44:28.580875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.049 [2024-11-21 03:44:28.580900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.049 qpair failed and we were unable to recover it. 00:27:48.049 [2024-11-21 03:44:28.581011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.049 [2024-11-21 03:44:28.581114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.049 [2024-11-21 03:44:28.581140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.049 qpair failed and we were unable to recover it. 00:27:48.049 [2024-11-21 03:44:28.581272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.049 [2024-11-21 03:44:28.581373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.049 [2024-11-21 03:44:28.581397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.049 qpair failed and we were unable to recover it. 00:27:48.049 [2024-11-21 03:44:28.581511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.049 [2024-11-21 03:44:28.581611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.049 [2024-11-21 03:44:28.581640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.049 qpair failed and we were unable to recover it. 00:27:48.049 [2024-11-21 03:44:28.581769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.049 [2024-11-21 03:44:28.581874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.049 [2024-11-21 03:44:28.581898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.049 qpair failed and we were unable to recover it. 00:27:48.049 [2024-11-21 03:44:28.581998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.049 [2024-11-21 03:44:28.582102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.049 [2024-11-21 03:44:28.582127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.049 qpair failed and we were unable to recover it. 00:27:48.049 [2024-11-21 03:44:28.582230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.049 [2024-11-21 03:44:28.582350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.049 [2024-11-21 03:44:28.582377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.049 qpair failed and we were unable to recover it. 00:27:48.049 [2024-11-21 03:44:28.582482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.049 [2024-11-21 03:44:28.582579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.049 [2024-11-21 03:44:28.582605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.049 qpair failed and we were unable to recover it. 00:27:48.049 [2024-11-21 03:44:28.582741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.049 [2024-11-21 03:44:28.582850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.049 [2024-11-21 03:44:28.582876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.049 qpair failed and we were unable to recover it. 00:27:48.049 [2024-11-21 03:44:28.583032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.049 [2024-11-21 03:44:28.583174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.049 [2024-11-21 03:44:28.583199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.049 qpair failed and we were unable to recover it. 00:27:48.049 [2024-11-21 03:44:28.583304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.049 [2024-11-21 03:44:28.583433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.049 [2024-11-21 03:44:28.583457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.049 qpair failed and we were unable to recover it. 00:27:48.049 [2024-11-21 03:44:28.583561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.049 [2024-11-21 03:44:28.583655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.049 [2024-11-21 03:44:28.583679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.049 qpair failed and we were unable to recover it. 00:27:48.049 [2024-11-21 03:44:28.583838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.049 [2024-11-21 03:44:28.583938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.049 [2024-11-21 03:44:28.583964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.049 qpair failed and we were unable to recover it. 00:27:48.049 [2024-11-21 03:44:28.584059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.049 [2024-11-21 03:44:28.584183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.049 [2024-11-21 03:44:28.584213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.049 qpair failed and we were unable to recover it. 00:27:48.049 [2024-11-21 03:44:28.584313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.049 [2024-11-21 03:44:28.584436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.049 [2024-11-21 03:44:28.584462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.049 qpair failed and we were unable to recover it. 00:27:48.049 [2024-11-21 03:44:28.584569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.049 [2024-11-21 03:44:28.584680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.049 [2024-11-21 03:44:28.584704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.049 qpair failed and we were unable to recover it. 00:27:48.049 [2024-11-21 03:44:28.584807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.049 [2024-11-21 03:44:28.584930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.049 [2024-11-21 03:44:28.584955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.049 qpair failed and we were unable to recover it. 00:27:48.049 [2024-11-21 03:44:28.585110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.049 [2024-11-21 03:44:28.585229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.049 [2024-11-21 03:44:28.585254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.049 qpair failed and we were unable to recover it. 00:27:48.049 [2024-11-21 03:44:28.585366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.049 [2024-11-21 03:44:28.585466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.049 [2024-11-21 03:44:28.585491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.049 qpair failed and we were unable to recover it. 00:27:48.049 [2024-11-21 03:44:28.585590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.049 [2024-11-21 03:44:28.585719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.049 [2024-11-21 03:44:28.585744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.049 qpair failed and we were unable to recover it. 00:27:48.049 [2024-11-21 03:44:28.585836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.049 [2024-11-21 03:44:28.585939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.049 [2024-11-21 03:44:28.585964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.049 qpair failed and we were unable to recover it. 00:27:48.049 [2024-11-21 03:44:28.586065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.049 [2024-11-21 03:44:28.586161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.049 [2024-11-21 03:44:28.586185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.049 qpair failed and we were unable to recover it. 00:27:48.049 [2024-11-21 03:44:28.586293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.049 [2024-11-21 03:44:28.586423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.049 [2024-11-21 03:44:28.586449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.049 qpair failed and we were unable to recover it. 00:27:48.049 [2024-11-21 03:44:28.586573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.049 [2024-11-21 03:44:28.586671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.049 [2024-11-21 03:44:28.586700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.049 qpair failed and we were unable to recover it. 00:27:48.049 [2024-11-21 03:44:28.586808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.049 [2024-11-21 03:44:28.586911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.049 [2024-11-21 03:44:28.586935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.049 qpair failed and we were unable to recover it. 00:27:48.049 [2024-11-21 03:44:28.587032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.049 [2024-11-21 03:44:28.587135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.049 [2024-11-21 03:44:28.587160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.049 qpair failed and we were unable to recover it. 00:27:48.049 [2024-11-21 03:44:28.587259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.049 [2024-11-21 03:44:28.587346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.049 [2024-11-21 03:44:28.587380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.049 qpair failed and we were unable to recover it. 00:27:48.049 [2024-11-21 03:44:28.587479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.049 [2024-11-21 03:44:28.587571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.049 [2024-11-21 03:44:28.587596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.049 qpair failed and we were unable to recover it. 00:27:48.049 [2024-11-21 03:44:28.587699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.049 [2024-11-21 03:44:28.587801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.049 [2024-11-21 03:44:28.587826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.049 qpair failed and we were unable to recover it. 00:27:48.049 [2024-11-21 03:44:28.587966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.049 [2024-11-21 03:44:28.588073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.049 [2024-11-21 03:44:28.588099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.049 qpair failed and we were unable to recover it. 00:27:48.049 [2024-11-21 03:44:28.588202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.049 [2024-11-21 03:44:28.588322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.049 [2024-11-21 03:44:28.588347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.049 qpair failed and we were unable to recover it. 00:27:48.049 [2024-11-21 03:44:28.588449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.049 [2024-11-21 03:44:28.588553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.049 [2024-11-21 03:44:28.588579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.049 qpair failed and we were unable to recover it. 00:27:48.049 [2024-11-21 03:44:28.588683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.050 [2024-11-21 03:44:28.588783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.050 [2024-11-21 03:44:28.588808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.050 qpair failed and we were unable to recover it. 00:27:48.050 [2024-11-21 03:44:28.588916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.050 [2024-11-21 03:44:28.589042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.050 [2024-11-21 03:44:28.589087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.050 qpair failed and we were unable to recover it. 00:27:48.050 [2024-11-21 03:44:28.589188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.050 [2024-11-21 03:44:28.589284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.050 [2024-11-21 03:44:28.589310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.050 qpair failed and we were unable to recover it. 00:27:48.050 [2024-11-21 03:44:28.589421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.050 [2024-11-21 03:44:28.589510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.050 [2024-11-21 03:44:28.589536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.050 qpair failed and we were unable to recover it. 00:27:48.050 [2024-11-21 03:44:28.589640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.050 [2024-11-21 03:44:28.589761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.050 [2024-11-21 03:44:28.589786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.050 qpair failed and we were unable to recover it. 00:27:48.050 [2024-11-21 03:44:28.589905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.050 [2024-11-21 03:44:28.590002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.050 [2024-11-21 03:44:28.590026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.050 qpair failed and we were unable to recover it. 00:27:48.050 [2024-11-21 03:44:28.590126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.050 [2024-11-21 03:44:28.590253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.050 [2024-11-21 03:44:28.590278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.050 qpair failed and we were unable to recover it. 00:27:48.050 [2024-11-21 03:44:28.590382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.050 [2024-11-21 03:44:28.590482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.050 [2024-11-21 03:44:28.590508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.050 qpair failed and we were unable to recover it. 00:27:48.050 [2024-11-21 03:44:28.590614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.050 [2024-11-21 03:44:28.590767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.050 [2024-11-21 03:44:28.590792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.050 qpair failed and we were unable to recover it. 00:27:48.050 [2024-11-21 03:44:28.590885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.050 [2024-11-21 03:44:28.591007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.050 [2024-11-21 03:44:28.591031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.050 qpair failed and we were unable to recover it. 00:27:48.050 [2024-11-21 03:44:28.591134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.050 [2024-11-21 03:44:28.591226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.050 [2024-11-21 03:44:28.591251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.050 qpair failed and we were unable to recover it. 00:27:48.050 [2024-11-21 03:44:28.591348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.050 [2024-11-21 03:44:28.591445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.050 [2024-11-21 03:44:28.591470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.050 qpair failed and we were unable to recover it. 00:27:48.050 [2024-11-21 03:44:28.591609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.050 [2024-11-21 03:44:28.591704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.050 [2024-11-21 03:44:28.591728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.050 qpair failed and we were unable to recover it. 00:27:48.050 [2024-11-21 03:44:28.591855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.050 [2024-11-21 03:44:28.591945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.050 [2024-11-21 03:44:28.591969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.050 qpair failed and we were unable to recover it. 00:27:48.050 [2024-11-21 03:44:28.592065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.050 [2024-11-21 03:44:28.592172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.050 [2024-11-21 03:44:28.592196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.050 qpair failed and we were unable to recover it. 00:27:48.050 [2024-11-21 03:44:28.592285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.050 [2024-11-21 03:44:28.592386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.050 [2024-11-21 03:44:28.592411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.050 qpair failed and we were unable to recover it. 00:27:48.050 [2024-11-21 03:44:28.592510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.050 [2024-11-21 03:44:28.592633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.050 [2024-11-21 03:44:28.592659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.050 qpair failed and we were unable to recover it. 00:27:48.050 [2024-11-21 03:44:28.592746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.050 [2024-11-21 03:44:28.592841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.050 [2024-11-21 03:44:28.592865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.050 qpair failed and we were unable to recover it. 00:27:48.050 [2024-11-21 03:44:28.592972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.050 [2024-11-21 03:44:28.593074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.050 [2024-11-21 03:44:28.593099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.050 qpair failed and we were unable to recover it. 00:27:48.050 [2024-11-21 03:44:28.593207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.050 [2024-11-21 03:44:28.593296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.050 [2024-11-21 03:44:28.593320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.050 qpair failed and we were unable to recover it. 00:27:48.050 [2024-11-21 03:44:28.593426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.050 [2024-11-21 03:44:28.593521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.050 [2024-11-21 03:44:28.593546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.050 qpair failed and we were unable to recover it. 00:27:48.050 [2024-11-21 03:44:28.593646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.050 [2024-11-21 03:44:28.593800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.050 [2024-11-21 03:44:28.593825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.050 qpair failed and we were unable to recover it. 00:27:48.050 [2024-11-21 03:44:28.593955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.050 [2024-11-21 03:44:28.594055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.050 [2024-11-21 03:44:28.594086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.050 qpair failed and we were unable to recover it. 00:27:48.050 [2024-11-21 03:44:28.594206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.050 [2024-11-21 03:44:28.594310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.050 [2024-11-21 03:44:28.594334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.050 qpair failed and we were unable to recover it. 00:27:48.050 [2024-11-21 03:44:28.594441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.050 [2024-11-21 03:44:28.594571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.050 [2024-11-21 03:44:28.594595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.050 qpair failed and we were unable to recover it. 00:27:48.050 [2024-11-21 03:44:28.594690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.050 [2024-11-21 03:44:28.594786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.050 [2024-11-21 03:44:28.594811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.050 qpair failed and we were unable to recover it. 00:27:48.050 [2024-11-21 03:44:28.594913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.050 [2024-11-21 03:44:28.595038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.050 [2024-11-21 03:44:28.595063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.050 qpair failed and we were unable to recover it. 00:27:48.050 [2024-11-21 03:44:28.595170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.050 [2024-11-21 03:44:28.595296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.050 [2024-11-21 03:44:28.595321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.050 qpair failed and we were unable to recover it. 00:27:48.050 [2024-11-21 03:44:28.595445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.050 [2024-11-21 03:44:28.595565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.050 [2024-11-21 03:44:28.595590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.050 qpair failed and we were unable to recover it. 00:27:48.050 [2024-11-21 03:44:28.595683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.050 [2024-11-21 03:44:28.595785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.051 [2024-11-21 03:44:28.595811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.051 qpair failed and we were unable to recover it. 00:27:48.051 [2024-11-21 03:44:28.595910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.051 [2024-11-21 03:44:28.596014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.051 [2024-11-21 03:44:28.596039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.051 qpair failed and we were unable to recover it. 00:27:48.051 [2024-11-21 03:44:28.596149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.051 [2024-11-21 03:44:28.596306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.051 [2024-11-21 03:44:28.596331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.051 qpair failed and we were unable to recover it. 00:27:48.051 [2024-11-21 03:44:28.596468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.051 [2024-11-21 03:44:28.596597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.051 [2024-11-21 03:44:28.596622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.051 qpair failed and we were unable to recover it. 00:27:48.051 [2024-11-21 03:44:28.596746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.051 [2024-11-21 03:44:28.596848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.051 [2024-11-21 03:44:28.596872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.051 qpair failed and we were unable to recover it. 00:27:48.051 [2024-11-21 03:44:28.596979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.051 [2024-11-21 03:44:28.597102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.051 [2024-11-21 03:44:28.597127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.051 qpair failed and we were unable to recover it. 00:27:48.051 [2024-11-21 03:44:28.597260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.051 [2024-11-21 03:44:28.597365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.051 [2024-11-21 03:44:28.597389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.051 qpair failed and we were unable to recover it. 00:27:48.051 [2024-11-21 03:44:28.597492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.051 [2024-11-21 03:44:28.597594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.051 [2024-11-21 03:44:28.597619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.051 qpair failed and we were unable to recover it. 00:27:48.051 [2024-11-21 03:44:28.597740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.051 [2024-11-21 03:44:28.597845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.051 [2024-11-21 03:44:28.597870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.051 qpair failed and we were unable to recover it. 00:27:48.051 [2024-11-21 03:44:28.597996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.051 [2024-11-21 03:44:28.598095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.051 [2024-11-21 03:44:28.598122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.051 qpair failed and we were unable to recover it. 00:27:48.051 [2024-11-21 03:44:28.598219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.051 [2024-11-21 03:44:28.598326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.051 [2024-11-21 03:44:28.598353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.051 qpair failed and we were unable to recover it. 00:27:48.051 [2024-11-21 03:44:28.598486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.051 [2024-11-21 03:44:28.598588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.051 [2024-11-21 03:44:28.598613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.051 qpair failed and we were unable to recover it. 00:27:48.051 [2024-11-21 03:44:28.598705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.051 [2024-11-21 03:44:28.598829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.051 [2024-11-21 03:44:28.598854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.051 qpair failed and we were unable to recover it. 00:27:48.051 [2024-11-21 03:44:28.598991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.051 [2024-11-21 03:44:28.599114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.051 [2024-11-21 03:44:28.599140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.051 qpair failed and we were unable to recover it. 00:27:48.051 [2024-11-21 03:44:28.599248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.051 [2024-11-21 03:44:28.599378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.051 [2024-11-21 03:44:28.599403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.051 qpair failed and we were unable to recover it. 00:27:48.051 [2024-11-21 03:44:28.599508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.051 [2024-11-21 03:44:28.599601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.051 [2024-11-21 03:44:28.599626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.051 qpair failed and we were unable to recover it. 00:27:48.051 [2024-11-21 03:44:28.599724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.051 [2024-11-21 03:44:28.599831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.051 [2024-11-21 03:44:28.599857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.051 qpair failed and we were unable to recover it. 00:27:48.051 [2024-11-21 03:44:28.599980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.051 [2024-11-21 03:44:28.600108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.051 [2024-11-21 03:44:28.600133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.051 qpair failed and we were unable to recover it. 00:27:48.051 [2024-11-21 03:44:28.600227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.051 [2024-11-21 03:44:28.600350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.051 [2024-11-21 03:44:28.600374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.051 qpair failed and we were unable to recover it. 00:27:48.051 [2024-11-21 03:44:28.600475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.051 [2024-11-21 03:44:28.600568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.051 [2024-11-21 03:44:28.600592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.051 qpair failed and we were unable to recover it. 00:27:48.051 [2024-11-21 03:44:28.600720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.051 [2024-11-21 03:44:28.600850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.051 [2024-11-21 03:44:28.600876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.051 qpair failed and we were unable to recover it. 00:27:48.051 [2024-11-21 03:44:28.601009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.051 [2024-11-21 03:44:28.601107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.051 [2024-11-21 03:44:28.601133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.051 qpair failed and we were unable to recover it. 00:27:48.051 [2024-11-21 03:44:28.601240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.051 [2024-11-21 03:44:28.601368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.051 [2024-11-21 03:44:28.601393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.051 qpair failed and we were unable to recover it. 00:27:48.051 [2024-11-21 03:44:28.601498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.052 [2024-11-21 03:44:28.601622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.052 [2024-11-21 03:44:28.601648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.052 qpair failed and we were unable to recover it. 00:27:48.052 [2024-11-21 03:44:28.601746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.052 [2024-11-21 03:44:28.601865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.052 [2024-11-21 03:44:28.601892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.052 qpair failed and we were unable to recover it. 00:27:48.052 [2024-11-21 03:44:28.601998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.052 [2024-11-21 03:44:28.602127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.052 [2024-11-21 03:44:28.602153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.052 qpair failed and we were unable to recover it. 00:27:48.052 [2024-11-21 03:44:28.602265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.052 [2024-11-21 03:44:28.602406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.052 [2024-11-21 03:44:28.602432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.052 qpair failed and we were unable to recover it. 00:27:48.052 [2024-11-21 03:44:28.602560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.052 [2024-11-21 03:44:28.602663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.052 [2024-11-21 03:44:28.602688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.052 qpair failed and we were unable to recover it. 00:27:48.052 [2024-11-21 03:44:28.602790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.052 [2024-11-21 03:44:28.602893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.052 [2024-11-21 03:44:28.602918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.052 qpair failed and we were unable to recover it. 00:27:48.052 [2024-11-21 03:44:28.603020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.052 [2024-11-21 03:44:28.603150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.052 [2024-11-21 03:44:28.603177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.052 qpair failed and we were unable to recover it. 00:27:48.052 [2024-11-21 03:44:28.603281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.052 [2024-11-21 03:44:28.603375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.052 [2024-11-21 03:44:28.603400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.052 qpair failed and we were unable to recover it. 00:27:48.052 [2024-11-21 03:44:28.603531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.052 [2024-11-21 03:44:28.603681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.052 [2024-11-21 03:44:28.603707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.052 qpair failed and we were unable to recover it. 00:27:48.052 [2024-11-21 03:44:28.603808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.052 [2024-11-21 03:44:28.603940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.052 [2024-11-21 03:44:28.603965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.052 qpair failed and we were unable to recover it. 00:27:48.052 [2024-11-21 03:44:28.604092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.052 [2024-11-21 03:44:28.604192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.052 [2024-11-21 03:44:28.604218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.052 qpair failed and we were unable to recover it. 00:27:48.052 [2024-11-21 03:44:28.604340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.052 [2024-11-21 03:44:28.604432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.052 [2024-11-21 03:44:28.604458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.052 qpair failed and we were unable to recover it. 00:27:48.052 [2024-11-21 03:44:28.604614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.052 [2024-11-21 03:44:28.604739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.052 [2024-11-21 03:44:28.604763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.052 qpair failed and we were unable to recover it. 00:27:48.052 [2024-11-21 03:44:28.604865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.052 [2024-11-21 03:44:28.604986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.052 [2024-11-21 03:44:28.605011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.052 qpair failed and we were unable to recover it. 00:27:48.052 [2024-11-21 03:44:28.605145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.052 [2024-11-21 03:44:28.605243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.052 [2024-11-21 03:44:28.605269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.052 qpair failed and we were unable to recover it. 00:27:48.052 [2024-11-21 03:44:28.605378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.052 [2024-11-21 03:44:28.605466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.052 [2024-11-21 03:44:28.605491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.052 qpair failed and we were unable to recover it. 00:27:48.052 [2024-11-21 03:44:28.605594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.052 [2024-11-21 03:44:28.605688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.052 [2024-11-21 03:44:28.605713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.052 qpair failed and we were unable to recover it. 00:27:48.052 [2024-11-21 03:44:28.605816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.052 [2024-11-21 03:44:28.605911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.052 [2024-11-21 03:44:28.605936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.052 qpair failed and we were unable to recover it. 00:27:48.052 [2024-11-21 03:44:28.606034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.052 [2024-11-21 03:44:28.606140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.052 [2024-11-21 03:44:28.606166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.052 qpair failed and we were unable to recover it. 00:27:48.052 [2024-11-21 03:44:28.606263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.052 [2024-11-21 03:44:28.606384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.052 [2024-11-21 03:44:28.606409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.052 qpair failed and we were unable to recover it. 00:27:48.052 [2024-11-21 03:44:28.606516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.052 [2024-11-21 03:44:28.606641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.052 [2024-11-21 03:44:28.606666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.052 qpair failed and we were unable to recover it. 00:27:48.052 [2024-11-21 03:44:28.606770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.052 [2024-11-21 03:44:28.606900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.052 [2024-11-21 03:44:28.606924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.052 qpair failed and we were unable to recover it. 00:27:48.052 [2024-11-21 03:44:28.607032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.052 [2024-11-21 03:44:28.607132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.052 [2024-11-21 03:44:28.607158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.052 qpair failed and we were unable to recover it. 00:27:48.052 [2024-11-21 03:44:28.607297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.052 [2024-11-21 03:44:28.607391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.052 [2024-11-21 03:44:28.607415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.052 qpair failed and we were unable to recover it. 00:27:48.052 [2024-11-21 03:44:28.607520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.052 [2024-11-21 03:44:28.607648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.052 [2024-11-21 03:44:28.607673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.052 qpair failed and we were unable to recover it. 00:27:48.052 [2024-11-21 03:44:28.607765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.053 [2024-11-21 03:44:28.607868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.053 [2024-11-21 03:44:28.607893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.053 qpair failed and we were unable to recover it. 00:27:48.053 [2024-11-21 03:44:28.607985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.053 [2024-11-21 03:44:28.608096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.053 [2024-11-21 03:44:28.608122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.053 qpair failed and we were unable to recover it. 00:27:48.053 [2024-11-21 03:44:28.608225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.053 [2024-11-21 03:44:28.608341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.053 [2024-11-21 03:44:28.608366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.053 qpair failed and we were unable to recover it. 00:27:48.053 [2024-11-21 03:44:28.608477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.053 [2024-11-21 03:44:28.608572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.053 [2024-11-21 03:44:28.608598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.053 qpair failed and we were unable to recover it. 00:27:48.053 [2024-11-21 03:44:28.608697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.053 [2024-11-21 03:44:28.608798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.053 [2024-11-21 03:44:28.608823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.053 qpair failed and we were unable to recover it. 00:27:48.053 [2024-11-21 03:44:28.608928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.053 [2024-11-21 03:44:28.609027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.053 [2024-11-21 03:44:28.609054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.053 qpair failed and we were unable to recover it. 00:27:48.053 [2024-11-21 03:44:28.609161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.053 [2024-11-21 03:44:28.609258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.053 [2024-11-21 03:44:28.609283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.053 qpair failed and we were unable to recover it. 00:27:48.053 [2024-11-21 03:44:28.609392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.053 [2024-11-21 03:44:28.609485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.053 [2024-11-21 03:44:28.609509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.053 qpair failed and we were unable to recover it. 00:27:48.053 [2024-11-21 03:44:28.609603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.053 [2024-11-21 03:44:28.609732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.053 [2024-11-21 03:44:28.609758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.053 qpair failed and we were unable to recover it. 00:27:48.053 [2024-11-21 03:44:28.609861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.053 [2024-11-21 03:44:28.609968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.053 [2024-11-21 03:44:28.609992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.053 qpair failed and we were unable to recover it. 00:27:48.053 [2024-11-21 03:44:28.610087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.053 [2024-11-21 03:44:28.610180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.053 [2024-11-21 03:44:28.610204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.053 qpair failed and we were unable to recover it. 00:27:48.053 [2024-11-21 03:44:28.610339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.053 [2024-11-21 03:44:28.610488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.053 [2024-11-21 03:44:28.610512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.053 qpair failed and we were unable to recover it. 00:27:48.053 [2024-11-21 03:44:28.610612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.053 [2024-11-21 03:44:28.610706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.053 [2024-11-21 03:44:28.610730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.053 qpair failed and we were unable to recover it. 00:27:48.053 [2024-11-21 03:44:28.610838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.053 [2024-11-21 03:44:28.610934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.053 [2024-11-21 03:44:28.610959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.053 qpair failed and we were unable to recover it. 00:27:48.053 [2024-11-21 03:44:28.611056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.053 [2024-11-21 03:44:28.611159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.053 [2024-11-21 03:44:28.611184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.053 qpair failed and we were unable to recover it. 00:27:48.053 [2024-11-21 03:44:28.611313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.053 [2024-11-21 03:44:28.611441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.053 [2024-11-21 03:44:28.611467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.053 qpair failed and we were unable to recover it. 00:27:48.053 [2024-11-21 03:44:28.611592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.053 [2024-11-21 03:44:28.611718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.053 [2024-11-21 03:44:28.611743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.053 qpair failed and we were unable to recover it. 00:27:48.053 [2024-11-21 03:44:28.611834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.053 [2024-11-21 03:44:28.611965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.053 [2024-11-21 03:44:28.611990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.053 qpair failed and we were unable to recover it. 00:27:48.053 [2024-11-21 03:44:28.612126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.053 [2024-11-21 03:44:28.612254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.053 [2024-11-21 03:44:28.612279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.053 qpair failed and we were unable to recover it. 00:27:48.053 [2024-11-21 03:44:28.612410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.053 [2024-11-21 03:44:28.612550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.053 [2024-11-21 03:44:28.612575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.053 qpair failed and we were unable to recover it. 00:27:48.053 [2024-11-21 03:44:28.612672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.053 [2024-11-21 03:44:28.612780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.053 [2024-11-21 03:44:28.612805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.053 qpair failed and we were unable to recover it. 00:27:48.053 [2024-11-21 03:44:28.612907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.053 [2024-11-21 03:44:28.613037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.053 [2024-11-21 03:44:28.613062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.053 qpair failed and we were unable to recover it. 00:27:48.053 [2024-11-21 03:44:28.613190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.053 [2024-11-21 03:44:28.613297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.053 [2024-11-21 03:44:28.613323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.053 qpair failed and we were unable to recover it. 00:27:48.053 [2024-11-21 03:44:28.613480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.053 [2024-11-21 03:44:28.613607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.053 [2024-11-21 03:44:28.613633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.053 qpair failed and we were unable to recover it. 00:27:48.053 [2024-11-21 03:44:28.613763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.053 [2024-11-21 03:44:28.613862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.053 [2024-11-21 03:44:28.613887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.053 qpair failed and we were unable to recover it. 00:27:48.053 [2024-11-21 03:44:28.614013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.053 [2024-11-21 03:44:28.614149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.053 [2024-11-21 03:44:28.614175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.054 qpair failed and we were unable to recover it. 00:27:48.054 [2024-11-21 03:44:28.614266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.054 [2024-11-21 03:44:28.614376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.054 [2024-11-21 03:44:28.614400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.054 qpair failed and we were unable to recover it. 00:27:48.054 [2024-11-21 03:44:28.614506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.054 [2024-11-21 03:44:28.614608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.054 [2024-11-21 03:44:28.614633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.054 qpair failed and we were unable to recover it. 00:27:48.054 [2024-11-21 03:44:28.614733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.054 [2024-11-21 03:44:28.614828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.054 [2024-11-21 03:44:28.614853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.054 qpair failed and we were unable to recover it. 00:27:48.054 [2024-11-21 03:44:28.614959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.054 [2024-11-21 03:44:28.615050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.054 [2024-11-21 03:44:28.615082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.054 qpair failed and we were unable to recover it. 00:27:48.054 [2024-11-21 03:44:28.615189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.054 [2024-11-21 03:44:28.615290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.054 [2024-11-21 03:44:28.615317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.054 qpair failed and we were unable to recover it. 00:27:48.054 [2024-11-21 03:44:28.615447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.054 [2024-11-21 03:44:28.615542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.054 [2024-11-21 03:44:28.615568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.054 qpair failed and we were unable to recover it. 00:27:48.054 [2024-11-21 03:44:28.615693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.054 [2024-11-21 03:44:28.615826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.054 [2024-11-21 03:44:28.615851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.054 qpair failed and we were unable to recover it. 00:27:48.054 [2024-11-21 03:44:28.615973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.054 [2024-11-21 03:44:28.616077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.054 [2024-11-21 03:44:28.616103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.054 qpair failed and we were unable to recover it. 00:27:48.054 [2024-11-21 03:44:28.616212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.054 [2024-11-21 03:44:28.616312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.054 [2024-11-21 03:44:28.616338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.054 qpair failed and we were unable to recover it. 00:27:48.054 [2024-11-21 03:44:28.616440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.054 [2024-11-21 03:44:28.616570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.054 [2024-11-21 03:44:28.616595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.054 qpair failed and we were unable to recover it. 00:27:48.054 [2024-11-21 03:44:28.616698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.054 [2024-11-21 03:44:28.616849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.054 [2024-11-21 03:44:28.616874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.054 qpair failed and we were unable to recover it. 00:27:48.054 [2024-11-21 03:44:28.616974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.054 [2024-11-21 03:44:28.617076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.054 [2024-11-21 03:44:28.617103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.054 qpair failed and we were unable to recover it. 00:27:48.054 [2024-11-21 03:44:28.617199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.054 [2024-11-21 03:44:28.617300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.054 [2024-11-21 03:44:28.617326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.054 qpair failed and we were unable to recover it. 00:27:48.054 [2024-11-21 03:44:28.617434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.054 [2024-11-21 03:44:28.617526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.054 [2024-11-21 03:44:28.617550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.054 qpair failed and we were unable to recover it. 00:27:48.054 [2024-11-21 03:44:28.617671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.054 [2024-11-21 03:44:28.617790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.054 [2024-11-21 03:44:28.617814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.054 qpair failed and we were unable to recover it. 00:27:48.054 [2024-11-21 03:44:28.617947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.054 [2024-11-21 03:44:28.618050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.054 [2024-11-21 03:44:28.618093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.054 qpair failed and we were unable to recover it. 00:27:48.054 [2024-11-21 03:44:28.618223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.054 [2024-11-21 03:44:28.618334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.054 [2024-11-21 03:44:28.618370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.054 qpair failed and we were unable to recover it. 00:27:48.054 [2024-11-21 03:44:28.618473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.054 [2024-11-21 03:44:28.618630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.054 [2024-11-21 03:44:28.618655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.054 qpair failed and we were unable to recover it. 00:27:48.054 [2024-11-21 03:44:28.618757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.054 [2024-11-21 03:44:28.618865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.054 [2024-11-21 03:44:28.618891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.054 qpair failed and we were unable to recover it. 00:27:48.054 [2024-11-21 03:44:28.619015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.054 [2024-11-21 03:44:28.619134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.054 [2024-11-21 03:44:28.619165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.054 qpair failed and we were unable to recover it. 00:27:48.054 [2024-11-21 03:44:28.619265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.054 [2024-11-21 03:44:28.619361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.054 [2024-11-21 03:44:28.619386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.054 qpair failed and we were unable to recover it. 00:27:48.054 [2024-11-21 03:44:28.619513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.054 [2024-11-21 03:44:28.619606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.054 [2024-11-21 03:44:28.619633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.054 qpair failed and we were unable to recover it. 00:27:48.054 [2024-11-21 03:44:28.619755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.054 [2024-11-21 03:44:28.619859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.054 [2024-11-21 03:44:28.619886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.054 qpair failed and we were unable to recover it. 00:27:48.055 [2024-11-21 03:44:28.619991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.326 [2024-11-21 03:44:28.620090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.326 [2024-11-21 03:44:28.620117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.326 qpair failed and we were unable to recover it. 00:27:48.326 [2024-11-21 03:44:28.620228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.326 [2024-11-21 03:44:28.620327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.326 [2024-11-21 03:44:28.620353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.326 qpair failed and we were unable to recover it. 00:27:48.326 [2024-11-21 03:44:28.620463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.326 [2024-11-21 03:44:28.620559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.326 [2024-11-21 03:44:28.620585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.326 qpair failed and we were unable to recover it. 00:27:48.326 [2024-11-21 03:44:28.620687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.326 [2024-11-21 03:44:28.620807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.326 [2024-11-21 03:44:28.620831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.326 qpair failed and we were unable to recover it. 00:27:48.326 [2024-11-21 03:44:28.620932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.326 [2024-11-21 03:44:28.621053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.326 [2024-11-21 03:44:28.621084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.326 qpair failed and we were unable to recover it. 00:27:48.326 [2024-11-21 03:44:28.621198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.326 [2024-11-21 03:44:28.621327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.326 [2024-11-21 03:44:28.621352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.326 qpair failed and we were unable to recover it. 00:27:48.326 [2024-11-21 03:44:28.621450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.326 [2024-11-21 03:44:28.621545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.326 [2024-11-21 03:44:28.621574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.326 qpair failed and we were unable to recover it. 00:27:48.326 [2024-11-21 03:44:28.621698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.326 [2024-11-21 03:44:28.621804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.326 [2024-11-21 03:44:28.621829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.326 qpair failed and we were unable to recover it. 00:27:48.326 [2024-11-21 03:44:28.621960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.326 [2024-11-21 03:44:28.622091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.326 [2024-11-21 03:44:28.622116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.326 qpair failed and we were unable to recover it. 00:27:48.326 [2024-11-21 03:44:28.622246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.326 [2024-11-21 03:44:28.622349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.326 [2024-11-21 03:44:28.622373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.326 qpair failed and we were unable to recover it. 00:27:48.326 [2024-11-21 03:44:28.622498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.326 [2024-11-21 03:44:28.622599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.326 [2024-11-21 03:44:28.622625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.326 qpair failed and we were unable to recover it. 00:27:48.326 [2024-11-21 03:44:28.622721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.326 [2024-11-21 03:44:28.622826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.326 [2024-11-21 03:44:28.622852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.326 qpair failed and we were unable to recover it. 00:27:48.326 [2024-11-21 03:44:28.622949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.326 [2024-11-21 03:44:28.623038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.326 [2024-11-21 03:44:28.623062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.326 qpair failed and we were unable to recover it. 00:27:48.326 [2024-11-21 03:44:28.623175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.326 [2024-11-21 03:44:28.623300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.326 [2024-11-21 03:44:28.623324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.326 qpair failed and we were unable to recover it. 00:27:48.326 [2024-11-21 03:44:28.623435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.326 [2024-11-21 03:44:28.623561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.326 [2024-11-21 03:44:28.623587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.326 qpair failed and we were unable to recover it. 00:27:48.326 [2024-11-21 03:44:28.623688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.326 [2024-11-21 03:44:28.623781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.326 [2024-11-21 03:44:28.623805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.326 qpair failed and we were unable to recover it. 00:27:48.326 [2024-11-21 03:44:28.623902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.326 [2024-11-21 03:44:28.624001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.326 [2024-11-21 03:44:28.624032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.326 qpair failed and we were unable to recover it. 00:27:48.326 [2024-11-21 03:44:28.624151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.326 [2024-11-21 03:44:28.624255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.326 [2024-11-21 03:44:28.624280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.326 qpair failed and we were unable to recover it. 00:27:48.326 [2024-11-21 03:44:28.624408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.326 [2024-11-21 03:44:28.624509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.326 [2024-11-21 03:44:28.624536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.326 qpair failed and we were unable to recover it. 00:27:48.326 [2024-11-21 03:44:28.624674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.326 [2024-11-21 03:44:28.624793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.326 [2024-11-21 03:44:28.624818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.326 qpair failed and we were unable to recover it. 00:27:48.326 [2024-11-21 03:44:28.624953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.326 [2024-11-21 03:44:28.625077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.326 [2024-11-21 03:44:28.625103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.326 qpair failed and we were unable to recover it. 00:27:48.326 [2024-11-21 03:44:28.625209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.326 [2024-11-21 03:44:28.625309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.326 [2024-11-21 03:44:28.625334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.326 qpair failed and we were unable to recover it. 00:27:48.326 [2024-11-21 03:44:28.625437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.326 [2024-11-21 03:44:28.625554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.326 [2024-11-21 03:44:28.625579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.326 qpair failed and we were unable to recover it. 00:27:48.326 [2024-11-21 03:44:28.625678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.326 [2024-11-21 03:44:28.625780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.326 [2024-11-21 03:44:28.625806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.326 qpair failed and we were unable to recover it. 00:27:48.326 [2024-11-21 03:44:28.625909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.326 [2024-11-21 03:44:28.626038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.326 [2024-11-21 03:44:28.626063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.326 qpair failed and we were unable to recover it. 00:27:48.327 [2024-11-21 03:44:28.626186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.327 [2024-11-21 03:44:28.626312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.327 [2024-11-21 03:44:28.626337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.327 qpair failed and we were unable to recover it. 00:27:48.327 [2024-11-21 03:44:28.626466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.327 [2024-11-21 03:44:28.626589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.327 [2024-11-21 03:44:28.626619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.327 qpair failed and we were unable to recover it. 00:27:48.327 [2024-11-21 03:44:28.626778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.327 [2024-11-21 03:44:28.626878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.327 [2024-11-21 03:44:28.626903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.327 qpair failed and we were unable to recover it. 00:27:48.327 [2024-11-21 03:44:28.627005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.327 [2024-11-21 03:44:28.627132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.327 [2024-11-21 03:44:28.627159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.327 qpair failed and we were unable to recover it. 00:27:48.327 [2024-11-21 03:44:28.627280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.327 [2024-11-21 03:44:28.627380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.327 [2024-11-21 03:44:28.627405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.327 qpair failed and we were unable to recover it. 00:27:48.327 [2024-11-21 03:44:28.627531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.327 [2024-11-21 03:44:28.627620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.327 [2024-11-21 03:44:28.627644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.327 qpair failed and we were unable to recover it. 00:27:48.327 [2024-11-21 03:44:28.627744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.327 [2024-11-21 03:44:28.627843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.327 [2024-11-21 03:44:28.627867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.327 qpair failed and we were unable to recover it. 00:27:48.327 [2024-11-21 03:44:28.627990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.327 [2024-11-21 03:44:28.628114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.327 [2024-11-21 03:44:28.628139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.327 qpair failed and we were unable to recover it. 00:27:48.327 [2024-11-21 03:44:28.628244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.327 [2024-11-21 03:44:28.628349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.327 [2024-11-21 03:44:28.628373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.327 qpair failed and we were unable to recover it. 00:27:48.327 [2024-11-21 03:44:28.628480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.327 [2024-11-21 03:44:28.628609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.327 [2024-11-21 03:44:28.628634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.327 qpair failed and we were unable to recover it. 00:27:48.327 [2024-11-21 03:44:28.628742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.327 [2024-11-21 03:44:28.628845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.327 [2024-11-21 03:44:28.628871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.327 qpair failed and we were unable to recover it. 00:27:48.327 [2024-11-21 03:44:28.629001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.327 [2024-11-21 03:44:28.629097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.327 [2024-11-21 03:44:28.629122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.327 qpair failed and we were unable to recover it. 00:27:48.327 [2024-11-21 03:44:28.629229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.327 [2024-11-21 03:44:28.629324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.327 [2024-11-21 03:44:28.629348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.327 qpair failed and we were unable to recover it. 00:27:48.327 [2024-11-21 03:44:28.629447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.327 [2024-11-21 03:44:28.629542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.327 [2024-11-21 03:44:28.629567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.327 qpair failed and we were unable to recover it. 00:27:48.327 [2024-11-21 03:44:28.629664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.327 [2024-11-21 03:44:28.629761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.327 [2024-11-21 03:44:28.629787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.327 qpair failed and we were unable to recover it. 00:27:48.327 [2024-11-21 03:44:28.629909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.327 [2024-11-21 03:44:28.630034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.327 [2024-11-21 03:44:28.630060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.327 qpair failed and we were unable to recover it. 00:27:48.327 [2024-11-21 03:44:28.630184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.327 [2024-11-21 03:44:28.630309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.327 [2024-11-21 03:44:28.630335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.327 qpair failed and we were unable to recover it. 00:27:48.327 [2024-11-21 03:44:28.630434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.327 [2024-11-21 03:44:28.630528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.327 [2024-11-21 03:44:28.630553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.327 qpair failed and we were unable to recover it. 00:27:48.327 [2024-11-21 03:44:28.630650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.327 [2024-11-21 03:44:28.630777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.327 [2024-11-21 03:44:28.630801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.327 qpair failed and we were unable to recover it. 00:27:48.327 [2024-11-21 03:44:28.630898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.327 [2024-11-21 03:44:28.630993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.327 [2024-11-21 03:44:28.631017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.327 qpair failed and we were unable to recover it. 00:27:48.327 [2024-11-21 03:44:28.631121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.327 [2024-11-21 03:44:28.631226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.327 [2024-11-21 03:44:28.631251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.327 qpair failed and we were unable to recover it. 00:27:48.327 [2024-11-21 03:44:28.631355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.327 [2024-11-21 03:44:28.631475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.327 [2024-11-21 03:44:28.631500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.327 qpair failed and we were unable to recover it. 00:27:48.327 [2024-11-21 03:44:28.631624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.327 [2024-11-21 03:44:28.631754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.327 [2024-11-21 03:44:28.631779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.327 qpair failed and we were unable to recover it. 00:27:48.327 [2024-11-21 03:44:28.631885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.327 [2024-11-21 03:44:28.631983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.327 [2024-11-21 03:44:28.632009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.327 qpair failed and we were unable to recover it. 00:27:48.327 [2024-11-21 03:44:28.632132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.327 [2024-11-21 03:44:28.632234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.327 [2024-11-21 03:44:28.632261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.327 qpair failed and we were unable to recover it. 00:27:48.327 [2024-11-21 03:44:28.632386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.327 [2024-11-21 03:44:28.632489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.327 [2024-11-21 03:44:28.632513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.327 qpair failed and we were unable to recover it. 00:27:48.327 [2024-11-21 03:44:28.632640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.327 [2024-11-21 03:44:28.632739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.327 [2024-11-21 03:44:28.632765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.327 qpair failed and we were unable to recover it. 00:27:48.327 [2024-11-21 03:44:28.632872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.327 [2024-11-21 03:44:28.632969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.327 [2024-11-21 03:44:28.632996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.327 qpair failed and we were unable to recover it. 00:27:48.327 [2024-11-21 03:44:28.633118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.327 [2024-11-21 03:44:28.633209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.327 [2024-11-21 03:44:28.633236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.328 qpair failed and we were unable to recover it. 00:27:48.328 [2024-11-21 03:44:28.633369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.328 [2024-11-21 03:44:28.633464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.328 [2024-11-21 03:44:28.633490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.328 qpair failed and we were unable to recover it. 00:27:48.328 [2024-11-21 03:44:28.633589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.328 [2024-11-21 03:44:28.633688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.328 [2024-11-21 03:44:28.633714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.328 qpair failed and we were unable to recover it. 00:27:48.328 [2024-11-21 03:44:28.633803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.328 [2024-11-21 03:44:28.633897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.328 [2024-11-21 03:44:28.633924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.328 qpair failed and we were unable to recover it. 00:27:48.328 [2024-11-21 03:44:28.634058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.328 [2024-11-21 03:44:28.634169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.328 [2024-11-21 03:44:28.634194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.328 qpair failed and we were unable to recover it. 00:27:48.328 [2024-11-21 03:44:28.634303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.328 [2024-11-21 03:44:28.634405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.328 [2024-11-21 03:44:28.634429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.328 qpair failed and we were unable to recover it. 00:27:48.328 [2024-11-21 03:44:28.634529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.328 [2024-11-21 03:44:28.634654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.328 [2024-11-21 03:44:28.634678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.328 qpair failed and we were unable to recover it. 00:27:48.328 [2024-11-21 03:44:28.634788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.328 [2024-11-21 03:44:28.634891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.328 [2024-11-21 03:44:28.634915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.328 qpair failed and we were unable to recover it. 00:27:48.328 [2024-11-21 03:44:28.635015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.328 [2024-11-21 03:44:28.635120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.328 [2024-11-21 03:44:28.635146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.328 qpair failed and we were unable to recover it. 00:27:48.328 [2024-11-21 03:44:28.635281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.328 [2024-11-21 03:44:28.635378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.328 [2024-11-21 03:44:28.635403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.328 qpair failed and we were unable to recover it. 00:27:48.328 [2024-11-21 03:44:28.635497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.328 [2024-11-21 03:44:28.635627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.328 [2024-11-21 03:44:28.635653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.328 qpair failed and we were unable to recover it. 00:27:48.328 [2024-11-21 03:44:28.635785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.328 [2024-11-21 03:44:28.635907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.328 [2024-11-21 03:44:28.635931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.328 qpair failed and we were unable to recover it. 00:27:48.328 [2024-11-21 03:44:28.636055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.328 [2024-11-21 03:44:28.636213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.328 [2024-11-21 03:44:28.636239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.328 qpair failed and we were unable to recover it. 00:27:48.328 [2024-11-21 03:44:28.636344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.328 [2024-11-21 03:44:28.636479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.328 [2024-11-21 03:44:28.636504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.328 qpair failed and we were unable to recover it. 00:27:48.328 [2024-11-21 03:44:28.636609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.328 [2024-11-21 03:44:28.636703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.328 [2024-11-21 03:44:28.636728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.328 qpair failed and we were unable to recover it. 00:27:48.328 [2024-11-21 03:44:28.636827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.328 [2024-11-21 03:44:28.636932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.328 [2024-11-21 03:44:28.636958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.328 qpair failed and we were unable to recover it. 00:27:48.328 [2024-11-21 03:44:28.637057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.328 [2024-11-21 03:44:28.637197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.328 [2024-11-21 03:44:28.637222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.328 qpair failed and we were unable to recover it. 00:27:48.328 [2024-11-21 03:44:28.637317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.328 [2024-11-21 03:44:28.637417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.328 [2024-11-21 03:44:28.637442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.328 qpair failed and we were unable to recover it. 00:27:48.328 [2024-11-21 03:44:28.637602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.328 [2024-11-21 03:44:28.637698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.328 [2024-11-21 03:44:28.637723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.328 qpair failed and we were unable to recover it. 00:27:48.328 [2024-11-21 03:44:28.637817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.328 [2024-11-21 03:44:28.637944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.328 [2024-11-21 03:44:28.637968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.328 qpair failed and we were unable to recover it. 00:27:48.328 [2024-11-21 03:44:28.638098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.328 [2024-11-21 03:44:28.638219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.328 [2024-11-21 03:44:28.638245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.328 qpair failed and we were unable to recover it. 00:27:48.328 [2024-11-21 03:44:28.638350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.328 [2024-11-21 03:44:28.638451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.328 [2024-11-21 03:44:28.638477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.328 qpair failed and we were unable to recover it. 00:27:48.328 [2024-11-21 03:44:28.638574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.328 [2024-11-21 03:44:28.638678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.328 [2024-11-21 03:44:28.638702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.328 qpair failed and we were unable to recover it. 00:27:48.328 [2024-11-21 03:44:28.638834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.328 [2024-11-21 03:44:28.638953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.328 [2024-11-21 03:44:28.638978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.328 qpair failed and we were unable to recover it. 00:27:48.328 [2024-11-21 03:44:28.639083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.328 [2024-11-21 03:44:28.639207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.328 [2024-11-21 03:44:28.639232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.328 qpair failed and we were unable to recover it. 00:27:48.328 [2024-11-21 03:44:28.639335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.328 [2024-11-21 03:44:28.639430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.328 [2024-11-21 03:44:28.639455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.328 qpair failed and we were unable to recover it. 00:27:48.328 [2024-11-21 03:44:28.639590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.328 [2024-11-21 03:44:28.639728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.328 [2024-11-21 03:44:28.639753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.328 qpair failed and we were unable to recover it. 00:27:48.328 [2024-11-21 03:44:28.639850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.328 [2024-11-21 03:44:28.639943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.328 [2024-11-21 03:44:28.639968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.328 qpair failed and we were unable to recover it. 00:27:48.328 [2024-11-21 03:44:28.640092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.328 [2024-11-21 03:44:28.640217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.328 [2024-11-21 03:44:28.640242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.328 qpair failed and we were unable to recover it. 00:27:48.328 [2024-11-21 03:44:28.640353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.328 [2024-11-21 03:44:28.640476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.329 [2024-11-21 03:44:28.640501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.329 qpair failed and we were unable to recover it. 00:27:48.329 [2024-11-21 03:44:28.640612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.329 [2024-11-21 03:44:28.640713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.329 [2024-11-21 03:44:28.640739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.329 qpair failed and we were unable to recover it. 00:27:48.329 [2024-11-21 03:44:28.640840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.329 [2024-11-21 03:44:28.640942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.329 [2024-11-21 03:44:28.640967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.329 qpair failed and we were unable to recover it. 00:27:48.329 [2024-11-21 03:44:28.641077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.329 [2024-11-21 03:44:28.641205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.329 [2024-11-21 03:44:28.641229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.329 qpair failed and we were unable to recover it. 00:27:48.329 [2024-11-21 03:44:28.641332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.329 [2024-11-21 03:44:28.641437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.329 [2024-11-21 03:44:28.641464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.329 qpair failed and we were unable to recover it. 00:27:48.329 [2024-11-21 03:44:28.641595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.329 [2024-11-21 03:44:28.641688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.329 [2024-11-21 03:44:28.641713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.329 qpair failed and we were unable to recover it. 00:27:48.329 [2024-11-21 03:44:28.641805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.329 [2024-11-21 03:44:28.641929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.329 [2024-11-21 03:44:28.641953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.329 qpair failed and we were unable to recover it. 00:27:48.329 [2024-11-21 03:44:28.642089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.329 [2024-11-21 03:44:28.642185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.329 [2024-11-21 03:44:28.642211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.329 qpair failed and we were unable to recover it. 00:27:48.329 [2024-11-21 03:44:28.642310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.329 [2024-11-21 03:44:28.642468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.329 [2024-11-21 03:44:28.642493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.329 qpair failed and we were unable to recover it. 00:27:48.329 [2024-11-21 03:44:28.642596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.329 [2024-11-21 03:44:28.642696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.329 [2024-11-21 03:44:28.642721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.329 qpair failed and we were unable to recover it. 00:27:48.329 [2024-11-21 03:44:28.642823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.329 [2024-11-21 03:44:28.642917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.329 [2024-11-21 03:44:28.642942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.329 qpair failed and we were unable to recover it. 00:27:48.329 [2024-11-21 03:44:28.643066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.329 [2024-11-21 03:44:28.643201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.329 [2024-11-21 03:44:28.643226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.329 qpair failed and we were unable to recover it. 00:27:48.329 [2024-11-21 03:44:28.643331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.329 [2024-11-21 03:44:28.643453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.329 [2024-11-21 03:44:28.643478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.329 qpair failed and we were unable to recover it. 00:27:48.329 [2024-11-21 03:44:28.643570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.329 [2024-11-21 03:44:28.643669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.329 [2024-11-21 03:44:28.643695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.329 qpair failed and we were unable to recover it. 00:27:48.329 [2024-11-21 03:44:28.643785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.329 [2024-11-21 03:44:28.643908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.329 [2024-11-21 03:44:28.643934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.329 qpair failed and we were unable to recover it. 00:27:48.329 [2024-11-21 03:44:28.644032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.329 [2024-11-21 03:44:28.644172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.329 [2024-11-21 03:44:28.644199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.329 qpair failed and we were unable to recover it. 00:27:48.329 [2024-11-21 03:44:28.644361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.329 [2024-11-21 03:44:28.644454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.329 [2024-11-21 03:44:28.644479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.329 qpair failed and we were unable to recover it. 00:27:48.329 [2024-11-21 03:44:28.644579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.329 [2024-11-21 03:44:28.644699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.329 [2024-11-21 03:44:28.644725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.329 qpair failed and we were unable to recover it. 00:27:48.329 [2024-11-21 03:44:28.644853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.329 [2024-11-21 03:44:28.644950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.329 [2024-11-21 03:44:28.644977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.329 qpair failed and we were unable to recover it. 00:27:48.329 [2024-11-21 03:44:28.645086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.329 [2024-11-21 03:44:28.645177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.329 [2024-11-21 03:44:28.645203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.329 qpair failed and we were unable to recover it. 00:27:48.329 [2024-11-21 03:44:28.645336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.329 [2024-11-21 03:44:28.645434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.329 [2024-11-21 03:44:28.645458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.329 qpair failed and we were unable to recover it. 00:27:48.329 [2024-11-21 03:44:28.645564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.329 [2024-11-21 03:44:28.645656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.329 [2024-11-21 03:44:28.645680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.329 qpair failed and we were unable to recover it. 00:27:48.329 [2024-11-21 03:44:28.645802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.329 [2024-11-21 03:44:28.645894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.329 [2024-11-21 03:44:28.645920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.329 qpair failed and we were unable to recover it. 00:27:48.329 [2024-11-21 03:44:28.646052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.329 [2024-11-21 03:44:28.646175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.329 [2024-11-21 03:44:28.646200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.329 qpair failed and we were unable to recover it. 00:27:48.329 [2024-11-21 03:44:28.646326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.329 [2024-11-21 03:44:28.646457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.329 [2024-11-21 03:44:28.646483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.329 qpair failed and we were unable to recover it. 00:27:48.329 [2024-11-21 03:44:28.646586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.329 [2024-11-21 03:44:28.646689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.329 [2024-11-21 03:44:28.646714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.329 qpair failed and we were unable to recover it. 00:27:48.329 [2024-11-21 03:44:28.646844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.329 [2024-11-21 03:44:28.646939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.329 [2024-11-21 03:44:28.646964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.329 qpair failed and we were unable to recover it. 00:27:48.329 [2024-11-21 03:44:28.647066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.329 [2024-11-21 03:44:28.647198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.329 [2024-11-21 03:44:28.647222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.329 qpair failed and we were unable to recover it. 00:27:48.329 [2024-11-21 03:44:28.647355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.329 [2024-11-21 03:44:28.647472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.330 [2024-11-21 03:44:28.647496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.330 qpair failed and we were unable to recover it. 00:27:48.330 [2024-11-21 03:44:28.647666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.330 [2024-11-21 03:44:28.647788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.330 [2024-11-21 03:44:28.647813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.330 qpair failed and we were unable to recover it. 00:27:48.330 [2024-11-21 03:44:28.647944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.330 [2024-11-21 03:44:28.648038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.330 [2024-11-21 03:44:28.648064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.330 qpair failed and we were unable to recover it. 00:27:48.330 [2024-11-21 03:44:28.648168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.330 [2024-11-21 03:44:28.648268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.330 [2024-11-21 03:44:28.648292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.330 qpair failed and we were unable to recover it. 00:27:48.330 [2024-11-21 03:44:28.648423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.330 [2024-11-21 03:44:28.648515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.330 [2024-11-21 03:44:28.648539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.330 qpair failed and we were unable to recover it. 00:27:48.330 [2024-11-21 03:44:28.648640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.330 [2024-11-21 03:44:28.648765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.330 [2024-11-21 03:44:28.648789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.330 qpair failed and we were unable to recover it. 00:27:48.330 [2024-11-21 03:44:28.648885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.330 [2024-11-21 03:44:28.649014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.330 [2024-11-21 03:44:28.649039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.330 qpair failed and we were unable to recover it. 00:27:48.330 [2024-11-21 03:44:28.649157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.330 [2024-11-21 03:44:28.649286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.330 [2024-11-21 03:44:28.649311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.330 qpair failed and we were unable to recover it. 00:27:48.330 [2024-11-21 03:44:28.649470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.330 [2024-11-21 03:44:28.649591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.330 [2024-11-21 03:44:28.649617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.330 qpair failed and we were unable to recover it. 00:27:48.330 [2024-11-21 03:44:28.649715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.330 [2024-11-21 03:44:28.649820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.330 [2024-11-21 03:44:28.649844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.330 qpair failed and we were unable to recover it. 00:27:48.330 [2024-11-21 03:44:28.649943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.330 [2024-11-21 03:44:28.650040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.330 [2024-11-21 03:44:28.650064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.330 qpair failed and we were unable to recover it. 00:27:48.330 [2024-11-21 03:44:28.650173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.330 [2024-11-21 03:44:28.650260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.330 [2024-11-21 03:44:28.650284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.330 qpair failed and we were unable to recover it. 00:27:48.330 [2024-11-21 03:44:28.650385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.330 [2024-11-21 03:44:28.650492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.330 [2024-11-21 03:44:28.650517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.330 qpair failed and we were unable to recover it. 00:27:48.330 [2024-11-21 03:44:28.650625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.330 [2024-11-21 03:44:28.650721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.330 [2024-11-21 03:44:28.650746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.330 qpair failed and we were unable to recover it. 00:27:48.330 [2024-11-21 03:44:28.650841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.330 [2024-11-21 03:44:28.650941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.330 [2024-11-21 03:44:28.650966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.330 qpair failed and we were unable to recover it. 00:27:48.330 [2024-11-21 03:44:28.651075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.330 [2024-11-21 03:44:28.651204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.330 [2024-11-21 03:44:28.651229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.330 qpair failed and we were unable to recover it. 00:27:48.330 [2024-11-21 03:44:28.651328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.330 [2024-11-21 03:44:28.651467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.330 [2024-11-21 03:44:28.651494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.330 qpair failed and we were unable to recover it. 00:27:48.330 [2024-11-21 03:44:28.651652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.330 [2024-11-21 03:44:28.651753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.330 [2024-11-21 03:44:28.651777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.330 qpair failed and we were unable to recover it. 00:27:48.330 [2024-11-21 03:44:28.651881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.330 [2024-11-21 03:44:28.651982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.330 [2024-11-21 03:44:28.652007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.330 qpair failed and we were unable to recover it. 00:27:48.330 [2024-11-21 03:44:28.652107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.330 [2024-11-21 03:44:28.652230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.330 [2024-11-21 03:44:28.652255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.330 qpair failed and we were unable to recover it. 00:27:48.330 [2024-11-21 03:44:28.652355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.330 [2024-11-21 03:44:28.652476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.330 [2024-11-21 03:44:28.652500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.330 qpair failed and we were unable to recover it. 00:27:48.330 [2024-11-21 03:44:28.652595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.330 [2024-11-21 03:44:28.652726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.330 [2024-11-21 03:44:28.652751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.330 qpair failed and we were unable to recover it. 00:27:48.330 [2024-11-21 03:44:28.652848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.330 [2024-11-21 03:44:28.652978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.330 [2024-11-21 03:44:28.653002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.330 qpair failed and we were unable to recover it. 00:27:48.330 [2024-11-21 03:44:28.653118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.330 [2024-11-21 03:44:28.653243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.330 [2024-11-21 03:44:28.653267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.330 qpair failed and we were unable to recover it. 00:27:48.330 [2024-11-21 03:44:28.653370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.330 [2024-11-21 03:44:28.653466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.331 [2024-11-21 03:44:28.653490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.331 qpair failed and we were unable to recover it. 00:27:48.331 [2024-11-21 03:44:28.653588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.331 [2024-11-21 03:44:28.653688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.331 [2024-11-21 03:44:28.653713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.331 qpair failed and we were unable to recover it. 00:27:48.331 [2024-11-21 03:44:28.653868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.331 [2024-11-21 03:44:28.653969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.331 [2024-11-21 03:44:28.653994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.331 qpair failed and we were unable to recover it. 00:27:48.331 [2024-11-21 03:44:28.654135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.331 [2024-11-21 03:44:28.654239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.331 [2024-11-21 03:44:28.654264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.331 qpair failed and we were unable to recover it. 00:27:48.331 [2024-11-21 03:44:28.654410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.331 [2024-11-21 03:44:28.654534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.331 [2024-11-21 03:44:28.654559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.331 qpair failed and we were unable to recover it. 00:27:48.331 [2024-11-21 03:44:28.654655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.331 [2024-11-21 03:44:28.654755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.331 [2024-11-21 03:44:28.654781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.331 qpair failed and we were unable to recover it. 00:27:48.331 [2024-11-21 03:44:28.654914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.331 [2024-11-21 03:44:28.655043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.331 [2024-11-21 03:44:28.655075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.331 qpair failed and we were unable to recover it. 00:27:48.331 [2024-11-21 03:44:28.655209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.331 [2024-11-21 03:44:28.655303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.331 [2024-11-21 03:44:28.655328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.331 qpair failed and we were unable to recover it. 00:27:48.331 [2024-11-21 03:44:28.655428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.331 [2024-11-21 03:44:28.655553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.331 [2024-11-21 03:44:28.655577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.331 qpair failed and we were unable to recover it. 00:27:48.331 [2024-11-21 03:44:28.655669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.331 [2024-11-21 03:44:28.655765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.331 [2024-11-21 03:44:28.655790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.331 qpair failed and we were unable to recover it. 00:27:48.331 [2024-11-21 03:44:28.655920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.331 [2024-11-21 03:44:28.656043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.331 [2024-11-21 03:44:28.656067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.331 qpair failed and we were unable to recover it. 00:27:48.331 [2024-11-21 03:44:28.656203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.331 [2024-11-21 03:44:28.656296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.331 [2024-11-21 03:44:28.656321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.331 qpair failed and we were unable to recover it. 00:27:48.331 [2024-11-21 03:44:28.656429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.331 [2024-11-21 03:44:28.656531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.331 [2024-11-21 03:44:28.656556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.331 qpair failed and we were unable to recover it. 00:27:48.331 [2024-11-21 03:44:28.656706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.331 [2024-11-21 03:44:28.656805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.331 [2024-11-21 03:44:28.656830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.331 qpair failed and we were unable to recover it. 00:27:48.331 [2024-11-21 03:44:28.656925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.331 [2024-11-21 03:44:28.657029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.331 [2024-11-21 03:44:28.657054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.331 qpair failed and we were unable to recover it. 00:27:48.331 [2024-11-21 03:44:28.657169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.331 [2024-11-21 03:44:28.657267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.331 [2024-11-21 03:44:28.657293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.331 qpair failed and we were unable to recover it. 00:27:48.331 [2024-11-21 03:44:28.657426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.331 [2024-11-21 03:44:28.657525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.331 [2024-11-21 03:44:28.657552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.331 qpair failed and we were unable to recover it. 00:27:48.331 [2024-11-21 03:44:28.657652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.331 [2024-11-21 03:44:28.657771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.331 [2024-11-21 03:44:28.657795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.331 qpair failed and we were unable to recover it. 00:27:48.331 [2024-11-21 03:44:28.657920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.331 [2024-11-21 03:44:28.658021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.331 [2024-11-21 03:44:28.658046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.331 qpair failed and we were unable to recover it. 00:27:48.331 [2024-11-21 03:44:28.658172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.331 [2024-11-21 03:44:28.658277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.331 [2024-11-21 03:44:28.658302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.331 qpair failed and we were unable to recover it. 00:27:48.331 [2024-11-21 03:44:28.658405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.331 [2024-11-21 03:44:28.658524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.331 [2024-11-21 03:44:28.658550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.331 qpair failed and we were unable to recover it. 00:27:48.331 [2024-11-21 03:44:28.658647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.331 [2024-11-21 03:44:28.658739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.331 [2024-11-21 03:44:28.658764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.331 qpair failed and we were unable to recover it. 00:27:48.331 [2024-11-21 03:44:28.658855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.331 [2024-11-21 03:44:28.658948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.331 [2024-11-21 03:44:28.658973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.331 qpair failed and we were unable to recover it. 00:27:48.331 [2024-11-21 03:44:28.659077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.331 [2024-11-21 03:44:28.659178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.331 [2024-11-21 03:44:28.659208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.331 qpair failed and we were unable to recover it. 00:27:48.331 [2024-11-21 03:44:28.659322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.331 [2024-11-21 03:44:28.659448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.331 [2024-11-21 03:44:28.659473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.331 qpair failed and we were unable to recover it. 00:27:48.331 [2024-11-21 03:44:28.659603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.331 [2024-11-21 03:44:28.659703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.331 [2024-11-21 03:44:28.659728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.331 qpair failed and we were unable to recover it. 00:27:48.331 [2024-11-21 03:44:28.659827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.331 [2024-11-21 03:44:28.659920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.331 [2024-11-21 03:44:28.659945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.331 qpair failed and we were unable to recover it. 00:27:48.331 [2024-11-21 03:44:28.660039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.331 [2024-11-21 03:44:28.660174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.331 [2024-11-21 03:44:28.660199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.331 qpair failed and we were unable to recover it. 00:27:48.331 [2024-11-21 03:44:28.660309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.331 [2024-11-21 03:44:28.660408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.331 [2024-11-21 03:44:28.660433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.331 qpair failed and we were unable to recover it. 00:27:48.332 [2024-11-21 03:44:28.660534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.332 [2024-11-21 03:44:28.660659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.332 [2024-11-21 03:44:28.660684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.332 qpair failed and we were unable to recover it. 00:27:48.332 [2024-11-21 03:44:28.660809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.332 [2024-11-21 03:44:28.660908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.332 [2024-11-21 03:44:28.660933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.332 qpair failed and we were unable to recover it. 00:27:48.332 [2024-11-21 03:44:28.661038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.332 [2024-11-21 03:44:28.661157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.332 [2024-11-21 03:44:28.661184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.332 qpair failed and we were unable to recover it. 00:27:48.332 [2024-11-21 03:44:28.661289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.332 [2024-11-21 03:44:28.661420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.332 [2024-11-21 03:44:28.661446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.332 qpair failed and we were unable to recover it. 00:27:48.332 [2024-11-21 03:44:28.661541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.332 [2024-11-21 03:44:28.661635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.332 [2024-11-21 03:44:28.661665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.332 qpair failed and we were unable to recover it. 00:27:48.332 [2024-11-21 03:44:28.661799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.332 [2024-11-21 03:44:28.661902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.332 [2024-11-21 03:44:28.661928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.332 qpair failed and we were unable to recover it. 00:27:48.332 [2024-11-21 03:44:28.662024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.332 [2024-11-21 03:44:28.662163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.332 [2024-11-21 03:44:28.662190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.332 qpair failed and we were unable to recover it. 00:27:48.332 [2024-11-21 03:44:28.662322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.332 [2024-11-21 03:44:28.662422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.332 [2024-11-21 03:44:28.662448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.332 qpair failed and we were unable to recover it. 00:27:48.332 [2024-11-21 03:44:28.662575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.332 [2024-11-21 03:44:28.662705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.332 [2024-11-21 03:44:28.662731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.332 qpair failed and we were unable to recover it. 00:27:48.332 [2024-11-21 03:44:28.662859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.332 [2024-11-21 03:44:28.662950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.332 [2024-11-21 03:44:28.662976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.332 qpair failed and we were unable to recover it. 00:27:48.332 [2024-11-21 03:44:28.663081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.332 [2024-11-21 03:44:28.663179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.332 [2024-11-21 03:44:28.663204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.332 qpair failed and we were unable to recover it. 00:27:48.332 [2024-11-21 03:44:28.663305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.332 [2024-11-21 03:44:28.663412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.332 [2024-11-21 03:44:28.663438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.332 qpair failed and we were unable to recover it. 00:27:48.332 [2024-11-21 03:44:28.663591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.332 [2024-11-21 03:44:28.663692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.332 [2024-11-21 03:44:28.663717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.332 qpair failed and we were unable to recover it. 00:27:48.332 [2024-11-21 03:44:28.663842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.332 [2024-11-21 03:44:28.663997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.332 [2024-11-21 03:44:28.664023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.332 qpair failed and we were unable to recover it. 00:27:48.332 [2024-11-21 03:44:28.664122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.332 [2024-11-21 03:44:28.664221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.332 [2024-11-21 03:44:28.664252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.332 qpair failed and we were unable to recover it. 00:27:48.332 [2024-11-21 03:44:28.664362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.332 [2024-11-21 03:44:28.664513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.332 [2024-11-21 03:44:28.664538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.332 qpair failed and we were unable to recover it. 00:27:48.332 [2024-11-21 03:44:28.664632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.332 [2024-11-21 03:44:28.664728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.332 [2024-11-21 03:44:28.664753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.332 qpair failed and we were unable to recover it. 00:27:48.332 [2024-11-21 03:44:28.664879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.332 [2024-11-21 03:44:28.665000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.332 [2024-11-21 03:44:28.665026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.332 qpair failed and we were unable to recover it. 00:27:48.332 [2024-11-21 03:44:28.665131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.332 [2024-11-21 03:44:28.665256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.332 [2024-11-21 03:44:28.665281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.332 qpair failed and we were unable to recover it. 00:27:48.332 [2024-11-21 03:44:28.665379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.332 [2024-11-21 03:44:28.665476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.332 [2024-11-21 03:44:28.665502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.332 qpair failed and we were unable to recover it. 00:27:48.332 [2024-11-21 03:44:28.665624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.332 [2024-11-21 03:44:28.665729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.332 [2024-11-21 03:44:28.665755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.332 qpair failed and we were unable to recover it. 00:27:48.332 [2024-11-21 03:44:28.665867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.332 [2024-11-21 03:44:28.665998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.332 [2024-11-21 03:44:28.666024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.332 qpair failed and we were unable to recover it. 00:27:48.332 [2024-11-21 03:44:28.666127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.332 [2024-11-21 03:44:28.666227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.332 [2024-11-21 03:44:28.666254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.332 qpair failed and we were unable to recover it. 00:27:48.332 [2024-11-21 03:44:28.666356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.332 [2024-11-21 03:44:28.666455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.332 [2024-11-21 03:44:28.666480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.332 qpair failed and we were unable to recover it. 00:27:48.332 [2024-11-21 03:44:28.666572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.332 [2024-11-21 03:44:28.666721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.332 [2024-11-21 03:44:28.666753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.332 qpair failed and we were unable to recover it. 00:27:48.332 [2024-11-21 03:44:28.666853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.332 [2024-11-21 03:44:28.666962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.332 [2024-11-21 03:44:28.666985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.332 qpair failed and we were unable to recover it. 00:27:48.332 [2024-11-21 03:44:28.667116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.332 [2024-11-21 03:44:28.667247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.332 [2024-11-21 03:44:28.667273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.332 qpair failed and we were unable to recover it. 00:27:48.332 [2024-11-21 03:44:28.667401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.332 [2024-11-21 03:44:28.667504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.332 [2024-11-21 03:44:28.667528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.332 qpair failed and we were unable to recover it. 00:27:48.332 [2024-11-21 03:44:28.667627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.332 [2024-11-21 03:44:28.667728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.332 [2024-11-21 03:44:28.667752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.333 qpair failed and we were unable to recover it. 00:27:48.333 [2024-11-21 03:44:28.667876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.333 [2024-11-21 03:44:28.667980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.333 [2024-11-21 03:44:28.668005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.333 qpair failed and we were unable to recover it. 00:27:48.333 [2024-11-21 03:44:28.668119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.333 [2024-11-21 03:44:28.668245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.333 [2024-11-21 03:44:28.668269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.333 qpair failed and we were unable to recover it. 00:27:48.333 [2024-11-21 03:44:28.668384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.333 [2024-11-21 03:44:28.668479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.333 [2024-11-21 03:44:28.668506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.333 qpair failed and we were unable to recover it. 00:27:48.333 [2024-11-21 03:44:28.668660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.333 [2024-11-21 03:44:28.668766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.333 [2024-11-21 03:44:28.668791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.333 qpair failed and we were unable to recover it. 00:27:48.333 [2024-11-21 03:44:28.668916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.333 [2024-11-21 03:44:28.669039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.333 [2024-11-21 03:44:28.669073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.333 qpair failed and we were unable to recover it. 00:27:48.333 [2024-11-21 03:44:28.669233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.333 [2024-11-21 03:44:28.669326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.333 [2024-11-21 03:44:28.669351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.333 qpair failed and we were unable to recover it. 00:27:48.333 [2024-11-21 03:44:28.669461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.333 [2024-11-21 03:44:28.669596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.333 [2024-11-21 03:44:28.669622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.333 qpair failed and we were unable to recover it. 00:27:48.333 [2024-11-21 03:44:28.669723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.333 [2024-11-21 03:44:28.669850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.333 [2024-11-21 03:44:28.669876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.333 qpair failed and we were unable to recover it. 00:27:48.333 [2024-11-21 03:44:28.670009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.333 [2024-11-21 03:44:28.670105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.333 [2024-11-21 03:44:28.670131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.333 qpair failed and we were unable to recover it. 00:27:48.333 [2024-11-21 03:44:28.670289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.333 [2024-11-21 03:44:28.670393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.333 [2024-11-21 03:44:28.670418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.333 qpair failed and we were unable to recover it. 00:27:48.333 [2024-11-21 03:44:28.670547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.333 [2024-11-21 03:44:28.670637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.333 [2024-11-21 03:44:28.670663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.333 qpair failed and we were unable to recover it. 00:27:48.333 [2024-11-21 03:44:28.670759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.333 [2024-11-21 03:44:28.670848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.333 [2024-11-21 03:44:28.670874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.333 qpair failed and we were unable to recover it. 00:27:48.333 [2024-11-21 03:44:28.670973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.333 [2024-11-21 03:44:28.671065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.333 [2024-11-21 03:44:28.671098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.333 qpair failed and we were unable to recover it. 00:27:48.333 [2024-11-21 03:44:28.671202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.333 [2024-11-21 03:44:28.671297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.333 [2024-11-21 03:44:28.671322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.333 qpair failed and we were unable to recover it. 00:27:48.333 [2024-11-21 03:44:28.671421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.333 [2024-11-21 03:44:28.671575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.333 [2024-11-21 03:44:28.671600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.333 qpair failed and we were unable to recover it. 00:27:48.333 [2024-11-21 03:44:28.671692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.333 [2024-11-21 03:44:28.671783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.333 [2024-11-21 03:44:28.671808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.333 qpair failed and we were unable to recover it. 00:27:48.333 [2024-11-21 03:44:28.671922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.333 [2024-11-21 03:44:28.672010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.333 [2024-11-21 03:44:28.672034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.333 qpair failed and we were unable to recover it. 00:27:48.333 [2024-11-21 03:44:28.672172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.333 [2024-11-21 03:44:28.672272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.333 [2024-11-21 03:44:28.672298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.333 qpair failed and we were unable to recover it. 00:27:48.333 [2024-11-21 03:44:28.672403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.333 [2024-11-21 03:44:28.672500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.333 [2024-11-21 03:44:28.672524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.333 qpair failed and we were unable to recover it. 00:27:48.333 [2024-11-21 03:44:28.672622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.333 [2024-11-21 03:44:28.672753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.333 [2024-11-21 03:44:28.672779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.333 qpair failed and we were unable to recover it. 00:27:48.333 [2024-11-21 03:44:28.672907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.333 [2024-11-21 03:44:28.673007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.333 [2024-11-21 03:44:28.673033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.333 qpair failed and we were unable to recover it. 00:27:48.333 [2024-11-21 03:44:28.673169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.333 [2024-11-21 03:44:28.673266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.333 [2024-11-21 03:44:28.673290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.333 qpair failed and we were unable to recover it. 00:27:48.333 [2024-11-21 03:44:28.673392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.333 [2024-11-21 03:44:28.673484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.333 [2024-11-21 03:44:28.673509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.333 qpair failed and we were unable to recover it. 00:27:48.333 [2024-11-21 03:44:28.673612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.333 [2024-11-21 03:44:28.673735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.333 [2024-11-21 03:44:28.673760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.333 qpair failed and we were unable to recover it. 00:27:48.333 [2024-11-21 03:44:28.673859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.333 [2024-11-21 03:44:28.673989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.333 [2024-11-21 03:44:28.674015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.333 qpair failed and we were unable to recover it. 00:27:48.333 [2024-11-21 03:44:28.674152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.333 [2024-11-21 03:44:28.674256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.333 [2024-11-21 03:44:28.674281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.333 qpair failed and we were unable to recover it. 00:27:48.333 [2024-11-21 03:44:28.674384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.333 [2024-11-21 03:44:28.674483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.333 [2024-11-21 03:44:28.674508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.333 qpair failed and we were unable to recover it. 00:27:48.333 [2024-11-21 03:44:28.674612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.333 [2024-11-21 03:44:28.674706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.333 [2024-11-21 03:44:28.674730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.333 qpair failed and we were unable to recover it. 00:27:48.333 [2024-11-21 03:44:28.674855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.333 [2024-11-21 03:44:28.674952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.334 [2024-11-21 03:44:28.674978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.334 qpair failed and we were unable to recover it. 00:27:48.334 [2024-11-21 03:44:28.675103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.334 [2024-11-21 03:44:28.675205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.334 [2024-11-21 03:44:28.675230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.334 qpair failed and we were unable to recover it. 00:27:48.334 [2024-11-21 03:44:28.675331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.334 [2024-11-21 03:44:28.675423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.334 [2024-11-21 03:44:28.675448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.334 qpair failed and we were unable to recover it. 00:27:48.334 [2024-11-21 03:44:28.675539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.334 [2024-11-21 03:44:28.675625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.334 [2024-11-21 03:44:28.675650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.334 qpair failed and we were unable to recover it. 00:27:48.334 [2024-11-21 03:44:28.675770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.334 [2024-11-21 03:44:28.675866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.334 [2024-11-21 03:44:28.675890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.334 qpair failed and we were unable to recover it. 00:27:48.334 [2024-11-21 03:44:28.675985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.334 [2024-11-21 03:44:28.676115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.334 [2024-11-21 03:44:28.676141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.334 qpair failed and we were unable to recover it. 00:27:48.334 [2024-11-21 03:44:28.676242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.334 [2024-11-21 03:44:28.676341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.334 [2024-11-21 03:44:28.676367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.334 qpair failed and we were unable to recover it. 00:27:48.334 [2024-11-21 03:44:28.676463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.334 [2024-11-21 03:44:28.676584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.334 [2024-11-21 03:44:28.676610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.334 qpair failed and we were unable to recover it. 00:27:48.334 [2024-11-21 03:44:28.676752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.334 [2024-11-21 03:44:28.676849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.334 [2024-11-21 03:44:28.676876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.334 qpair failed and we were unable to recover it. 00:27:48.334 [2024-11-21 03:44:28.677035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.334 [2024-11-21 03:44:28.677148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.334 [2024-11-21 03:44:28.677174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.334 qpair failed and we were unable to recover it. 00:27:48.334 [2024-11-21 03:44:28.677300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.334 [2024-11-21 03:44:28.677397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.334 [2024-11-21 03:44:28.677423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.334 qpair failed and we were unable to recover it. 00:27:48.334 [2024-11-21 03:44:28.677551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.334 [2024-11-21 03:44:28.677673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.334 [2024-11-21 03:44:28.677698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.334 qpair failed and we were unable to recover it. 00:27:48.334 [2024-11-21 03:44:28.677824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.334 [2024-11-21 03:44:28.677924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.334 [2024-11-21 03:44:28.677951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.334 qpair failed and we were unable to recover it. 00:27:48.334 [2024-11-21 03:44:28.678061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.334 [2024-11-21 03:44:28.678173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.334 [2024-11-21 03:44:28.678198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.334 qpair failed and we were unable to recover it. 00:27:48.334 [2024-11-21 03:44:28.678293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.334 [2024-11-21 03:44:28.678394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.334 [2024-11-21 03:44:28.678419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.334 qpair failed and we were unable to recover it. 00:27:48.334 [2024-11-21 03:44:28.678546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.334 [2024-11-21 03:44:28.678644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.334 [2024-11-21 03:44:28.678670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.334 qpair failed and we were unable to recover it. 00:27:48.334 [2024-11-21 03:44:28.678802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.334 [2024-11-21 03:44:28.678907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.334 [2024-11-21 03:44:28.678934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.334 qpair failed and we were unable to recover it. 00:27:48.334 [2024-11-21 03:44:28.679037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.334 [2024-11-21 03:44:28.679183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.334 [2024-11-21 03:44:28.679209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.334 qpair failed and we were unable to recover it. 00:27:48.334 [2024-11-21 03:44:28.679322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.334 [2024-11-21 03:44:28.679427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.334 [2024-11-21 03:44:28.679452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.334 qpair failed and we were unable to recover it. 00:27:48.334 [2024-11-21 03:44:28.679552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.334 [2024-11-21 03:44:28.679653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.334 [2024-11-21 03:44:28.679678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.334 qpair failed and we were unable to recover it. 00:27:48.334 [2024-11-21 03:44:28.679776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.334 [2024-11-21 03:44:28.679874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.334 [2024-11-21 03:44:28.679899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.334 qpair failed and we were unable to recover it. 00:27:48.334 [2024-11-21 03:44:28.680018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.334 [2024-11-21 03:44:28.680152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.334 [2024-11-21 03:44:28.680179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.334 qpair failed and we were unable to recover it. 00:27:48.334 [2024-11-21 03:44:28.680276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.334 [2024-11-21 03:44:28.680368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.334 [2024-11-21 03:44:28.680394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.334 qpair failed and we were unable to recover it. 00:27:48.334 [2024-11-21 03:44:28.680522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.334 [2024-11-21 03:44:28.680652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.334 [2024-11-21 03:44:28.680678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.334 qpair failed and we were unable to recover it. 00:27:48.334 [2024-11-21 03:44:28.680773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.334 [2024-11-21 03:44:28.680876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.334 [2024-11-21 03:44:28.680902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.334 qpair failed and we were unable to recover it. 00:27:48.334 [2024-11-21 03:44:28.681032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.334 [2024-11-21 03:44:28.681164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.334 [2024-11-21 03:44:28.681190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.334 qpair failed and we were unable to recover it. 00:27:48.334 [2024-11-21 03:44:28.681298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.334 [2024-11-21 03:44:28.681408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.334 [2024-11-21 03:44:28.681435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.334 qpair failed and we were unable to recover it. 00:27:48.334 [2024-11-21 03:44:28.681532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.334 [2024-11-21 03:44:28.681667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.334 [2024-11-21 03:44:28.681693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.334 qpair failed and we were unable to recover it. 00:27:48.334 [2024-11-21 03:44:28.681795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.334 [2024-11-21 03:44:28.681891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.334 [2024-11-21 03:44:28.681917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.334 qpair failed and we were unable to recover it. 00:27:48.334 [2024-11-21 03:44:28.682020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.335 [2024-11-21 03:44:28.682127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.335 [2024-11-21 03:44:28.682154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.335 qpair failed and we were unable to recover it. 00:27:48.335 [2024-11-21 03:44:28.682287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.335 [2024-11-21 03:44:28.682444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.335 [2024-11-21 03:44:28.682469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.335 qpair failed and we were unable to recover it. 00:27:48.335 [2024-11-21 03:44:28.682564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.335 [2024-11-21 03:44:28.682658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.335 [2024-11-21 03:44:28.682684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.335 qpair failed and we were unable to recover it. 00:27:48.335 [2024-11-21 03:44:28.682838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.335 [2024-11-21 03:44:28.682946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.335 [2024-11-21 03:44:28.682972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.335 qpair failed and we were unable to recover it. 00:27:48.335 [2024-11-21 03:44:28.683099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.335 [2024-11-21 03:44:28.683226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.335 [2024-11-21 03:44:28.683251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.335 qpair failed and we were unable to recover it. 00:27:48.335 [2024-11-21 03:44:28.683361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.335 [2024-11-21 03:44:28.683494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.335 [2024-11-21 03:44:28.683520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.335 qpair failed and we were unable to recover it. 00:27:48.335 [2024-11-21 03:44:28.683625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.335 [2024-11-21 03:44:28.683729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.335 [2024-11-21 03:44:28.683754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.335 qpair failed and we were unable to recover it. 00:27:48.335 [2024-11-21 03:44:28.683859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.335 [2024-11-21 03:44:28.683961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.335 [2024-11-21 03:44:28.683986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.335 qpair failed and we were unable to recover it. 00:27:48.335 [2024-11-21 03:44:28.684114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.335 [2024-11-21 03:44:28.684207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.335 [2024-11-21 03:44:28.684233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.335 qpair failed and we were unable to recover it. 00:27:48.335 [2024-11-21 03:44:28.684348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.335 [2024-11-21 03:44:28.684461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.335 [2024-11-21 03:44:28.684490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.335 qpair failed and we were unable to recover it. 00:27:48.335 [2024-11-21 03:44:28.684590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.335 [2024-11-21 03:44:28.684718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.335 [2024-11-21 03:44:28.684746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.335 qpair failed and we were unable to recover it. 00:27:48.335 [2024-11-21 03:44:28.684883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.335 [2024-11-21 03:44:28.685013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.335 [2024-11-21 03:44:28.685039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.335 qpair failed and we were unable to recover it. 00:27:48.335 [2024-11-21 03:44:28.685151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.335 [2024-11-21 03:44:28.685260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.335 [2024-11-21 03:44:28.685286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.335 qpair failed and we were unable to recover it. 00:27:48.335 [2024-11-21 03:44:28.685412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.335 [2024-11-21 03:44:28.685538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.335 [2024-11-21 03:44:28.685563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.335 qpair failed and we were unable to recover it. 00:27:48.335 [2024-11-21 03:44:28.685676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.335 [2024-11-21 03:44:28.685780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.335 [2024-11-21 03:44:28.685806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.335 qpair failed and we were unable to recover it. 00:27:48.335 [2024-11-21 03:44:28.685907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.335 [2024-11-21 03:44:28.686031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.335 [2024-11-21 03:44:28.686057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.335 qpair failed and we were unable to recover it. 00:27:48.335 [2024-11-21 03:44:28.686196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.335 [2024-11-21 03:44:28.686311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.335 [2024-11-21 03:44:28.686336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.335 qpair failed and we were unable to recover it. 00:27:48.335 [2024-11-21 03:44:28.686438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.335 [2024-11-21 03:44:28.686526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.335 [2024-11-21 03:44:28.686551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.335 qpair failed and we were unable to recover it. 00:27:48.335 [2024-11-21 03:44:28.686677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.335 [2024-11-21 03:44:28.686777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.335 [2024-11-21 03:44:28.686803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.335 qpair failed and we were unable to recover it. 00:27:48.335 [2024-11-21 03:44:28.686927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.335 [2024-11-21 03:44:28.687042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.335 [2024-11-21 03:44:28.687080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.335 qpair failed and we were unable to recover it. 00:27:48.335 [2024-11-21 03:44:28.687200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.335 [2024-11-21 03:44:28.687293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.335 [2024-11-21 03:44:28.687319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.335 qpair failed and we were unable to recover it. 00:27:48.335 [2024-11-21 03:44:28.687428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.335 [2024-11-21 03:44:28.687527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.335 [2024-11-21 03:44:28.687553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.335 qpair failed and we were unable to recover it. 00:27:48.335 [2024-11-21 03:44:28.687651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.335 [2024-11-21 03:44:28.687759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.335 [2024-11-21 03:44:28.687784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.335 qpair failed and we were unable to recover it. 00:27:48.335 [2024-11-21 03:44:28.687915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.335 [2024-11-21 03:44:28.688043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.335 [2024-11-21 03:44:28.688074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.335 qpair failed and we were unable to recover it. 00:27:48.335 [2024-11-21 03:44:28.688176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.335 [2024-11-21 03:44:28.688282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.335 [2024-11-21 03:44:28.688308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.335 qpair failed and we were unable to recover it. 00:27:48.335 [2024-11-21 03:44:28.688436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.335 [2024-11-21 03:44:28.688531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.336 [2024-11-21 03:44:28.688557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.336 qpair failed and we were unable to recover it. 00:27:48.336 [2024-11-21 03:44:28.688653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.336 [2024-11-21 03:44:28.688779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.336 [2024-11-21 03:44:28.688804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.336 qpair failed and we were unable to recover it. 00:27:48.336 [2024-11-21 03:44:28.688937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.336 [2024-11-21 03:44:28.689037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.336 [2024-11-21 03:44:28.689062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.336 qpair failed and we were unable to recover it. 00:27:48.336 [2024-11-21 03:44:28.689185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.336 [2024-11-21 03:44:28.689288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.336 [2024-11-21 03:44:28.689313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.336 qpair failed and we were unable to recover it. 00:27:48.336 [2024-11-21 03:44:28.689437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.336 [2024-11-21 03:44:28.689548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.336 [2024-11-21 03:44:28.689573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.336 qpair failed and we were unable to recover it. 00:27:48.336 [2024-11-21 03:44:28.689676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.336 [2024-11-21 03:44:28.689799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.336 [2024-11-21 03:44:28.689824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.336 qpair failed and we were unable to recover it. 00:27:48.336 [2024-11-21 03:44:28.689951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.336 [2024-11-21 03:44:28.690062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.336 [2024-11-21 03:44:28.690096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.336 qpair failed and we were unable to recover it. 00:27:48.336 [2024-11-21 03:44:28.690192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.336 [2024-11-21 03:44:28.690290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.336 [2024-11-21 03:44:28.690316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.336 qpair failed and we were unable to recover it. 00:27:48.336 [2024-11-21 03:44:28.690420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.336 [2024-11-21 03:44:28.690516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.336 [2024-11-21 03:44:28.690542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.336 qpair failed and we were unable to recover it. 00:27:48.336 [2024-11-21 03:44:28.690668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.336 [2024-11-21 03:44:28.690770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.336 [2024-11-21 03:44:28.690796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.336 qpair failed and we were unable to recover it. 00:27:48.336 [2024-11-21 03:44:28.690902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.336 [2024-11-21 03:44:28.691000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.336 [2024-11-21 03:44:28.691027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.336 qpair failed and we were unable to recover it. 00:27:48.336 [2024-11-21 03:44:28.691136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.336 [2024-11-21 03:44:28.691270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.336 [2024-11-21 03:44:28.691295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.336 qpair failed and we were unable to recover it. 00:27:48.336 [2024-11-21 03:44:28.691429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.336 [2024-11-21 03:44:28.691556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.336 [2024-11-21 03:44:28.691582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.336 qpair failed and we were unable to recover it. 00:27:48.336 [2024-11-21 03:44:28.691712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.336 [2024-11-21 03:44:28.691815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.336 [2024-11-21 03:44:28.691842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.336 qpair failed and we were unable to recover it. 00:27:48.336 [2024-11-21 03:44:28.691975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.336 [2024-11-21 03:44:28.692108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.336 [2024-11-21 03:44:28.692135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.336 qpair failed and we were unable to recover it. 00:27:48.336 [2024-11-21 03:44:28.692249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.336 [2024-11-21 03:44:28.692346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.336 [2024-11-21 03:44:28.692371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.336 qpair failed and we were unable to recover it. 00:27:48.336 [2024-11-21 03:44:28.692491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.336 [2024-11-21 03:44:28.692618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.336 [2024-11-21 03:44:28.692645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.336 qpair failed and we were unable to recover it. 00:27:48.336 [2024-11-21 03:44:28.692744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.336 [2024-11-21 03:44:28.692873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.336 [2024-11-21 03:44:28.692898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.336 qpair failed and we were unable to recover it. 00:27:48.336 [2024-11-21 03:44:28.693029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.336 [2024-11-21 03:44:28.693140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.336 [2024-11-21 03:44:28.693166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.336 qpair failed and we were unable to recover it. 00:27:48.336 [2024-11-21 03:44:28.693272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.336 [2024-11-21 03:44:28.693399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.336 [2024-11-21 03:44:28.693424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.336 qpair failed and we were unable to recover it. 00:27:48.336 [2024-11-21 03:44:28.693530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.336 [2024-11-21 03:44:28.693654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.336 [2024-11-21 03:44:28.693679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.336 qpair failed and we were unable to recover it. 00:27:48.336 [2024-11-21 03:44:28.693777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.336 [2024-11-21 03:44:28.693900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.336 [2024-11-21 03:44:28.693927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.336 qpair failed and we were unable to recover it. 00:27:48.336 [2024-11-21 03:44:28.694029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.336 [2024-11-21 03:44:28.694166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.336 [2024-11-21 03:44:28.694193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.336 qpair failed and we were unable to recover it. 00:27:48.336 [2024-11-21 03:44:28.694306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.336 [2024-11-21 03:44:28.694435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.336 [2024-11-21 03:44:28.694460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.336 qpair failed and we were unable to recover it. 00:27:48.336 [2024-11-21 03:44:28.694560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.336 [2024-11-21 03:44:28.694699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.336 [2024-11-21 03:44:28.694725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.336 qpair failed and we were unable to recover it. 00:27:48.336 [2024-11-21 03:44:28.694855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.336 [2024-11-21 03:44:28.694953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.336 [2024-11-21 03:44:28.694978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.336 qpair failed and we were unable to recover it. 00:27:48.336 [2024-11-21 03:44:28.695111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.336 [2024-11-21 03:44:28.695209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.336 [2024-11-21 03:44:28.695234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.336 qpair failed and we were unable to recover it. 00:27:48.336 [2024-11-21 03:44:28.695367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.336 [2024-11-21 03:44:28.695491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.336 [2024-11-21 03:44:28.695517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.336 qpair failed and we were unable to recover it. 00:27:48.336 [2024-11-21 03:44:28.695619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.336 [2024-11-21 03:44:28.695744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.336 [2024-11-21 03:44:28.695769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.336 qpair failed and we were unable to recover it. 00:27:48.336 [2024-11-21 03:44:28.695869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.336 [2024-11-21 03:44:28.695997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.337 [2024-11-21 03:44:28.696022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.337 qpair failed and we were unable to recover it. 00:27:48.337 [2024-11-21 03:44:28.696169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.337 [2024-11-21 03:44:28.696300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.337 [2024-11-21 03:44:28.696325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.337 qpair failed and we were unable to recover it. 00:27:48.337 [2024-11-21 03:44:28.696431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.337 [2024-11-21 03:44:28.696528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.337 [2024-11-21 03:44:28.696555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.337 qpair failed and we were unable to recover it. 00:27:48.337 [2024-11-21 03:44:28.696690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.337 [2024-11-21 03:44:28.696792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.337 [2024-11-21 03:44:28.696818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.337 qpair failed and we were unable to recover it. 00:27:48.337 [2024-11-21 03:44:28.696921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.337 [2024-11-21 03:44:28.697026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.337 [2024-11-21 03:44:28.697053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.337 qpair failed and we were unable to recover it. 00:27:48.337 [2024-11-21 03:44:28.697174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.337 [2024-11-21 03:44:28.697286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.337 [2024-11-21 03:44:28.697313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.337 qpair failed and we were unable to recover it. 00:27:48.337 [2024-11-21 03:44:28.697417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.337 [2024-11-21 03:44:28.697520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.337 [2024-11-21 03:44:28.697544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.337 qpair failed and we were unable to recover it. 00:27:48.337 [2024-11-21 03:44:28.697677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.337 [2024-11-21 03:44:28.697808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.337 [2024-11-21 03:44:28.697834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.337 qpair failed and we were unable to recover it. 00:27:48.337 [2024-11-21 03:44:28.697933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.337 [2024-11-21 03:44:28.698022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.337 [2024-11-21 03:44:28.698047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.337 qpair failed and we were unable to recover it. 00:27:48.337 [2024-11-21 03:44:28.698192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.337 [2024-11-21 03:44:28.698322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.337 [2024-11-21 03:44:28.698347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.337 qpair failed and we were unable to recover it. 00:27:48.337 [2024-11-21 03:44:28.698456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.337 [2024-11-21 03:44:28.698576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.337 [2024-11-21 03:44:28.698600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.337 qpair failed and we were unable to recover it. 00:27:48.337 [2024-11-21 03:44:28.698701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.337 [2024-11-21 03:44:28.698840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.337 [2024-11-21 03:44:28.698865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.337 qpair failed and we were unable to recover it. 00:27:48.337 [2024-11-21 03:44:28.698967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.337 [2024-11-21 03:44:28.699062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.337 [2024-11-21 03:44:28.699095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.337 qpair failed and we were unable to recover it. 00:27:48.337 [2024-11-21 03:44:28.699203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.337 [2024-11-21 03:44:28.699317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.337 [2024-11-21 03:44:28.699343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.337 qpair failed and we were unable to recover it. 00:27:48.337 [2024-11-21 03:44:28.699445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.337 [2024-11-21 03:44:28.699547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.337 [2024-11-21 03:44:28.699574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.337 qpair failed and we were unable to recover it. 00:27:48.337 [2024-11-21 03:44:28.699702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.337 [2024-11-21 03:44:28.699834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.337 [2024-11-21 03:44:28.699864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.337 qpair failed and we were unable to recover it. 00:27:48.337 [2024-11-21 03:44:28.699976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.337 [2024-11-21 03:44:28.700110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.337 [2024-11-21 03:44:28.700136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.337 qpair failed and we were unable to recover it. 00:27:48.337 [2024-11-21 03:44:28.700231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.337 [2024-11-21 03:44:28.700350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.337 [2024-11-21 03:44:28.700375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.337 qpair failed and we were unable to recover it. 00:27:48.337 [2024-11-21 03:44:28.700478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.337 [2024-11-21 03:44:28.700583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.337 [2024-11-21 03:44:28.700608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.337 qpair failed and we were unable to recover it. 00:27:48.337 [2024-11-21 03:44:28.700707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.337 [2024-11-21 03:44:28.700806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.337 [2024-11-21 03:44:28.700832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.337 qpair failed and we were unable to recover it. 00:27:48.337 [2024-11-21 03:44:28.700989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.337 [2024-11-21 03:44:28.701088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.337 [2024-11-21 03:44:28.701115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.337 qpair failed and we were unable to recover it. 00:27:48.337 [2024-11-21 03:44:28.701244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.337 [2024-11-21 03:44:28.701352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.337 [2024-11-21 03:44:28.701377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.337 qpair failed and we were unable to recover it. 00:27:48.337 [2024-11-21 03:44:28.701480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.337 [2024-11-21 03:44:28.701583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.337 [2024-11-21 03:44:28.701609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.337 qpair failed and we were unable to recover it. 00:27:48.337 [2024-11-21 03:44:28.701797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.337 [2024-11-21 03:44:28.701900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.337 [2024-11-21 03:44:28.701924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.337 qpair failed and we were unable to recover it. 00:27:48.337 [2024-11-21 03:44:28.702057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.337 [2024-11-21 03:44:28.702217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.337 [2024-11-21 03:44:28.702242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.337 qpair failed and we were unable to recover it. 00:27:48.337 [2024-11-21 03:44:28.702346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.337 [2024-11-21 03:44:28.702448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.337 [2024-11-21 03:44:28.702483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.337 qpair failed and we were unable to recover it. 00:27:48.337 [2024-11-21 03:44:28.702623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.337 [2024-11-21 03:44:28.702754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.337 [2024-11-21 03:44:28.702779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.337 qpair failed and we were unable to recover it. 00:27:48.337 [2024-11-21 03:44:28.702912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.337 [2024-11-21 03:44:28.703013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.337 [2024-11-21 03:44:28.703038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.337 qpair failed and we were unable to recover it. 00:27:48.337 [2024-11-21 03:44:28.703149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.337 [2024-11-21 03:44:28.703287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.337 [2024-11-21 03:44:28.703312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b9 03:44:28 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:48.338 0 with addr=10.0.0.2, port=4420 00:27:48.338 qpair failed and we were unable to recover it. 00:27:48.338 03:44:28 -- common/autotest_common.sh@862 -- # return 0 00:27:48.338 [2024-11-21 03:44:28.703452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.338 [2024-11-21 03:44:28.703564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.338 [2024-11-21 03:44:28.703588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.338 03:44:28 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:48.338 qpair failed and we were unable to recover it. 00:27:48.338 [2024-11-21 03:44:28.703683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.338 03:44:28 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:48.338 [2024-11-21 03:44:28.703770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.338 [2024-11-21 03:44:28.703795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.338 qpair failed and we were unable to recover it. 00:27:48.338 03:44:28 -- common/autotest_common.sh@10 -- # set +x 00:27:48.338 [2024-11-21 03:44:28.703898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.338 [2024-11-21 03:44:28.703997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.338 [2024-11-21 03:44:28.704022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.338 qpair failed and we were unable to recover it. 00:27:48.338 [2024-11-21 03:44:28.704127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.338 [2024-11-21 03:44:28.704258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.338 [2024-11-21 03:44:28.704283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.338 qpair failed and we were unable to recover it. 00:27:48.338 [2024-11-21 03:44:28.704422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.338 [2024-11-21 03:44:28.704522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.338 [2024-11-21 03:44:28.704548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.338 qpair failed and we were unable to recover it. 00:27:48.338 [2024-11-21 03:44:28.704705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.338 [2024-11-21 03:44:28.704832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.338 [2024-11-21 03:44:28.704856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.338 qpair failed and we were unable to recover it. 00:27:48.338 [2024-11-21 03:44:28.704970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.338 [2024-11-21 03:44:28.705102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.338 [2024-11-21 03:44:28.705128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.338 qpair failed and we were unable to recover it. 00:27:48.338 [2024-11-21 03:44:28.705220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.338 [2024-11-21 03:44:28.705323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.338 [2024-11-21 03:44:28.705348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.338 qpair failed and we were unable to recover it. 00:27:48.338 [2024-11-21 03:44:28.705481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.338 [2024-11-21 03:44:28.705637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.338 [2024-11-21 03:44:28.705662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.338 qpair failed and we were unable to recover it. 00:27:48.338 [2024-11-21 03:44:28.705761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.338 [2024-11-21 03:44:28.705866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.338 [2024-11-21 03:44:28.705892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.338 qpair failed and we were unable to recover it. 00:27:48.338 [2024-11-21 03:44:28.706004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.338 [2024-11-21 03:44:28.706107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.338 [2024-11-21 03:44:28.706134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.338 qpair failed and we were unable to recover it. 00:27:48.338 [2024-11-21 03:44:28.706259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.338 [2024-11-21 03:44:28.706361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.338 [2024-11-21 03:44:28.706386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.338 qpair failed and we were unable to recover it. 00:27:48.338 [2024-11-21 03:44:28.706536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.338 [2024-11-21 03:44:28.706631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.338 [2024-11-21 03:44:28.706656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.338 qpair failed and we were unable to recover it. 00:27:48.338 [2024-11-21 03:44:28.706753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.338 [2024-11-21 03:44:28.706866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.338 [2024-11-21 03:44:28.706892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.338 qpair failed and we were unable to recover it. 00:27:48.338 [2024-11-21 03:44:28.706989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.338 [2024-11-21 03:44:28.707121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.338 [2024-11-21 03:44:28.707147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.338 qpair failed and we were unable to recover it. 00:27:48.338 [2024-11-21 03:44:28.707248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.338 [2024-11-21 03:44:28.707347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.338 [2024-11-21 03:44:28.707384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.338 qpair failed and we were unable to recover it. 00:27:48.338 [2024-11-21 03:44:28.707524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.338 [2024-11-21 03:44:28.707652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.338 [2024-11-21 03:44:28.707678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.338 qpair failed and we were unable to recover it. 00:27:48.338 [2024-11-21 03:44:28.707806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.338 [2024-11-21 03:44:28.707919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.338 [2024-11-21 03:44:28.707944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.338 qpair failed and we were unable to recover it. 00:27:48.338 [2024-11-21 03:44:28.708045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.338 [2024-11-21 03:44:28.708192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.338 [2024-11-21 03:44:28.708219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.338 qpair failed and we were unable to recover it. 00:27:48.338 [2024-11-21 03:44:28.708352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.338 [2024-11-21 03:44:28.708464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.338 [2024-11-21 03:44:28.708489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.338 qpair failed and we were unable to recover it. 00:27:48.338 [2024-11-21 03:44:28.708621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.338 [2024-11-21 03:44:28.708742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.338 [2024-11-21 03:44:28.708769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.338 qpair failed and we were unable to recover it. 00:27:48.338 [2024-11-21 03:44:28.708894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.338 [2024-11-21 03:44:28.709015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.338 [2024-11-21 03:44:28.709040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.338 qpair failed and we were unable to recover it. 00:27:48.338 [2024-11-21 03:44:28.709185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.338 [2024-11-21 03:44:28.709313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.338 [2024-11-21 03:44:28.709338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.338 qpair failed and we were unable to recover it. 00:27:48.338 [2024-11-21 03:44:28.709472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.338 [2024-11-21 03:44:28.709575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.338 [2024-11-21 03:44:28.709602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.338 qpair failed and we were unable to recover it. 00:27:48.338 [2024-11-21 03:44:28.709767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.338 [2024-11-21 03:44:28.709892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.338 [2024-11-21 03:44:28.709917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.338 qpair failed and we were unable to recover it. 00:27:48.338 [2024-11-21 03:44:28.710014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.338 [2024-11-21 03:44:28.710117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.338 [2024-11-21 03:44:28.710143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.338 qpair failed and we were unable to recover it. 00:27:48.338 [2024-11-21 03:44:28.710277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.338 [2024-11-21 03:44:28.710441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.338 [2024-11-21 03:44:28.710466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.338 qpair failed and we were unable to recover it. 00:27:48.338 [2024-11-21 03:44:28.710561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.338 [2024-11-21 03:44:28.710685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.338 [2024-11-21 03:44:28.710710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.339 qpair failed and we were unable to recover it. 00:27:48.339 [2024-11-21 03:44:28.710817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.339 [2024-11-21 03:44:28.710946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.339 [2024-11-21 03:44:28.710971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.339 qpair failed and we were unable to recover it. 00:27:48.339 [2024-11-21 03:44:28.711096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.339 [2024-11-21 03:44:28.711191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.339 [2024-11-21 03:44:28.711215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.339 qpair failed and we were unable to recover it. 00:27:48.339 [2024-11-21 03:44:28.711325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.339 [2024-11-21 03:44:28.711441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.339 [2024-11-21 03:44:28.711466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.339 qpair failed and we were unable to recover it. 00:27:48.339 [2024-11-21 03:44:28.711598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.339 [2024-11-21 03:44:28.711735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.339 [2024-11-21 03:44:28.711760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.339 qpair failed and we were unable to recover it. 00:27:48.339 [2024-11-21 03:44:28.711862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.339 [2024-11-21 03:44:28.712011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.339 [2024-11-21 03:44:28.712037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.339 qpair failed and we were unable to recover it. 00:27:48.339 [2024-11-21 03:44:28.712146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.339 [2024-11-21 03:44:28.712240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.339 [2024-11-21 03:44:28.712265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.339 qpair failed and we were unable to recover it. 00:27:48.339 [2024-11-21 03:44:28.712409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.339 [2024-11-21 03:44:28.712514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.339 [2024-11-21 03:44:28.712539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.339 qpair failed and we were unable to recover it. 00:27:48.339 [2024-11-21 03:44:28.712677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.339 [2024-11-21 03:44:28.712775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.339 [2024-11-21 03:44:28.712802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.339 qpair failed and we were unable to recover it. 00:27:48.339 [2024-11-21 03:44:28.712942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.339 [2024-11-21 03:44:28.713034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.339 [2024-11-21 03:44:28.713060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.339 qpair failed and we were unable to recover it. 00:27:48.339 [2024-11-21 03:44:28.713172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.339 [2024-11-21 03:44:28.713269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.339 [2024-11-21 03:44:28.713294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.339 qpair failed and we were unable to recover it. 00:27:48.339 [2024-11-21 03:44:28.713429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.339 [2024-11-21 03:44:28.713573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.339 [2024-11-21 03:44:28.713598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.339 qpair failed and we were unable to recover it. 00:27:48.339 [2024-11-21 03:44:28.713698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.339 [2024-11-21 03:44:28.713797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.339 [2024-11-21 03:44:28.713823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.339 qpair failed and we were unable to recover it. 00:27:48.339 [2024-11-21 03:44:28.713983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.339 [2024-11-21 03:44:28.714082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.339 [2024-11-21 03:44:28.714110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.339 qpair failed and we were unable to recover it. 00:27:48.339 [2024-11-21 03:44:28.714240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.339 [2024-11-21 03:44:28.714401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.339 [2024-11-21 03:44:28.714426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.339 qpair failed and we were unable to recover it. 00:27:48.339 [2024-11-21 03:44:28.714535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.339 [2024-11-21 03:44:28.714645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.339 [2024-11-21 03:44:28.714669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.339 qpair failed and we were unable to recover it. 00:27:48.339 [2024-11-21 03:44:28.714808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.339 [2024-11-21 03:44:28.714906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.339 [2024-11-21 03:44:28.714930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.339 qpair failed and we were unable to recover it. 00:27:48.339 [2024-11-21 03:44:28.715041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.339 [2024-11-21 03:44:28.715187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.339 [2024-11-21 03:44:28.715213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.339 qpair failed and we were unable to recover it. 00:27:48.339 [2024-11-21 03:44:28.715345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.339 [2024-11-21 03:44:28.715451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.339 [2024-11-21 03:44:28.715475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.339 qpair failed and we were unable to recover it. 00:27:48.339 [2024-11-21 03:44:28.715584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.339 [2024-11-21 03:44:28.715675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.339 [2024-11-21 03:44:28.715700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.339 qpair failed and we were unable to recover it. 00:27:48.339 [2024-11-21 03:44:28.715838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.339 [2024-11-21 03:44:28.715927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.339 [2024-11-21 03:44:28.715952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.339 qpair failed and we were unable to recover it. 00:27:48.339 [2024-11-21 03:44:28.716116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.339 [2024-11-21 03:44:28.716239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.339 [2024-11-21 03:44:28.716265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.339 qpair failed and we were unable to recover it. 00:27:48.339 [2024-11-21 03:44:28.716371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.339 [2024-11-21 03:44:28.716466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.339 [2024-11-21 03:44:28.716491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.339 qpair failed and we were unable to recover it. 00:27:48.339 [2024-11-21 03:44:28.716592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.339 [2024-11-21 03:44:28.716716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.339 [2024-11-21 03:44:28.716740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.339 qpair failed and we were unable to recover it. 00:27:48.339 [2024-11-21 03:44:28.716838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.339 [2024-11-21 03:44:28.716940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.339 [2024-11-21 03:44:28.716964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.339 qpair failed and we were unable to recover it. 00:27:48.339 [2024-11-21 03:44:28.717105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.339 [2024-11-21 03:44:28.717236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.339 [2024-11-21 03:44:28.717260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.339 qpair failed and we were unable to recover it. 00:27:48.340 [2024-11-21 03:44:28.717356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.340 [2024-11-21 03:44:28.717497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.340 [2024-11-21 03:44:28.717522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.340 qpair failed and we were unable to recover it. 00:27:48.340 [2024-11-21 03:44:28.717623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.340 [2024-11-21 03:44:28.717759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.340 [2024-11-21 03:44:28.717784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.340 qpair failed and we were unable to recover it. 00:27:48.340 [2024-11-21 03:44:28.717883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.340 [2024-11-21 03:44:28.717990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.340 [2024-11-21 03:44:28.718015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.340 qpair failed and we were unable to recover it. 00:27:48.340 [2024-11-21 03:44:28.718131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.340 [2024-11-21 03:44:28.718240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.340 [2024-11-21 03:44:28.718266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.340 qpair failed and we were unable to recover it. 00:27:48.340 [2024-11-21 03:44:28.718394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.340 [2024-11-21 03:44:28.718499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.340 [2024-11-21 03:44:28.718525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.340 qpair failed and we were unable to recover it. 00:27:48.340 [2024-11-21 03:44:28.718630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.340 [2024-11-21 03:44:28.718754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.340 [2024-11-21 03:44:28.718779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.340 qpair failed and we were unable to recover it. 00:27:48.340 [2024-11-21 03:44:28.718871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.340 [2024-11-21 03:44:28.718988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.340 [2024-11-21 03:44:28.719013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.340 qpair failed and we were unable to recover it. 00:27:48.340 [2024-11-21 03:44:28.719128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.340 [2024-11-21 03:44:28.719251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.340 [2024-11-21 03:44:28.719277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.340 qpair failed and we were unable to recover it. 00:27:48.340 [2024-11-21 03:44:28.719404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.340 [2024-11-21 03:44:28.719499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.340 [2024-11-21 03:44:28.719524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.340 qpair failed and we were unable to recover it. 00:27:48.340 [2024-11-21 03:44:28.719646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.340 [2024-11-21 03:44:28.719772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.340 [2024-11-21 03:44:28.719798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.340 qpair failed and we were unable to recover it. 00:27:48.340 [2024-11-21 03:44:28.719905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.340 [2024-11-21 03:44:28.720054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.340 [2024-11-21 03:44:28.720091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.340 qpair failed and we were unable to recover it. 00:27:48.340 [2024-11-21 03:44:28.720221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.340 [2024-11-21 03:44:28.720350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.340 [2024-11-21 03:44:28.720381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.340 qpair failed and we were unable to recover it. 00:27:48.340 [2024-11-21 03:44:28.720493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.340 [2024-11-21 03:44:28.720602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.340 [2024-11-21 03:44:28.720626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.340 qpair failed and we were unable to recover it. 00:27:48.340 [2024-11-21 03:44:28.720729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.340 [2024-11-21 03:44:28.720861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.340 [2024-11-21 03:44:28.720888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.340 qpair failed and we were unable to recover it. 00:27:48.340 03:44:28 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:48.340 [2024-11-21 03:44:28.721015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.340 03:44:28 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:27:48.340 [2024-11-21 03:44:28.721151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.340 [2024-11-21 03:44:28.721179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.340 qpair failed and we were unable to recover it. 00:27:48.340 03:44:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:48.340 [2024-11-21 03:44:28.721283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.340 03:44:28 -- common/autotest_common.sh@10 -- # set +x 00:27:48.340 [2024-11-21 03:44:28.721374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.340 [2024-11-21 03:44:28.721399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.340 qpair failed and we were unable to recover it. 00:27:48.340 [2024-11-21 03:44:28.721515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.340 [2024-11-21 03:44:28.721614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.340 [2024-11-21 03:44:28.721639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.340 qpair failed and we were unable to recover it. 00:27:48.340 [2024-11-21 03:44:28.721745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.340 [2024-11-21 03:44:28.721898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.340 [2024-11-21 03:44:28.721923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.340 qpair failed and we were unable to recover it. 00:27:48.340 [2024-11-21 03:44:28.722054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.340 [2024-11-21 03:44:28.722188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.340 [2024-11-21 03:44:28.722214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.340 qpair failed and we were unable to recover it. 00:27:48.340 [2024-11-21 03:44:28.722316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.340 [2024-11-21 03:44:28.722454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.340 [2024-11-21 03:44:28.722480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.340 qpair failed and we were unable to recover it. 00:27:48.340 [2024-11-21 03:44:28.722615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.340 [2024-11-21 03:44:28.722740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.340 [2024-11-21 03:44:28.722765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.340 qpair failed and we were unable to recover it. 00:27:48.340 [2024-11-21 03:44:28.722886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.340 [2024-11-21 03:44:28.723018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.340 [2024-11-21 03:44:28.723044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.340 qpair failed and we were unable to recover it. 00:27:48.340 [2024-11-21 03:44:28.723150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.340 [2024-11-21 03:44:28.723282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.340 [2024-11-21 03:44:28.723312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.340 qpair failed and we were unable to recover it. 00:27:48.340 [2024-11-21 03:44:28.723423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.340 [2024-11-21 03:44:28.723546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.340 [2024-11-21 03:44:28.723572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.340 qpair failed and we were unable to recover it. 00:27:48.340 [2024-11-21 03:44:28.723677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.340 [2024-11-21 03:44:28.723785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.340 [2024-11-21 03:44:28.723811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.340 qpair failed and we were unable to recover it. 00:27:48.340 [2024-11-21 03:44:28.723907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.340 [2024-11-21 03:44:28.724006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.340 [2024-11-21 03:44:28.724032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.340 qpair failed and we were unable to recover it. 00:27:48.341 [2024-11-21 03:44:28.724202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.341 [2024-11-21 03:44:28.724301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.341 [2024-11-21 03:44:28.724327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.341 qpair failed and we were unable to recover it. 00:27:48.341 [2024-11-21 03:44:28.724442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.341 [2024-11-21 03:44:28.724545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.341 [2024-11-21 03:44:28.724572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.341 qpair failed and we were unable to recover it. 00:27:48.341 [2024-11-21 03:44:28.724675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.341 [2024-11-21 03:44:28.724781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.341 [2024-11-21 03:44:28.724806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.341 qpair failed and we were unable to recover it. 00:27:48.341 [2024-11-21 03:44:28.724931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.341 [2024-11-21 03:44:28.725055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.341 [2024-11-21 03:44:28.725088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.341 qpair failed and we were unable to recover it. 00:27:48.341 [2024-11-21 03:44:28.725209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.341 [2024-11-21 03:44:28.725299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.341 [2024-11-21 03:44:28.725324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.341 qpair failed and we were unable to recover it. 00:27:48.341 [2024-11-21 03:44:28.725458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.341 [2024-11-21 03:44:28.725580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.341 [2024-11-21 03:44:28.725605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.341 qpair failed and we were unable to recover it. 00:27:48.341 [2024-11-21 03:44:28.725695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.341 [2024-11-21 03:44:28.725819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.341 [2024-11-21 03:44:28.725849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.341 qpair failed and we were unable to recover it. 00:27:48.341 [2024-11-21 03:44:28.725956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.341 [2024-11-21 03:44:28.726082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.341 [2024-11-21 03:44:28.726108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.341 qpair failed and we were unable to recover it. 00:27:48.341 [2024-11-21 03:44:28.726211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.341 [2024-11-21 03:44:28.726309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.341 [2024-11-21 03:44:28.726334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.341 qpair failed and we were unable to recover it. 00:27:48.341 [2024-11-21 03:44:28.726465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.341 [2024-11-21 03:44:28.726613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.341 [2024-11-21 03:44:28.726639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.341 qpair failed and we were unable to recover it. 00:27:48.341 [2024-11-21 03:44:28.726764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.341 [2024-11-21 03:44:28.726861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.341 [2024-11-21 03:44:28.726886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.341 qpair failed and we were unable to recover it. 00:27:48.341 [2024-11-21 03:44:28.726995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.341 [2024-11-21 03:44:28.727127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.341 [2024-11-21 03:44:28.727153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.341 qpair failed and we were unable to recover it. 00:27:48.341 [2024-11-21 03:44:28.727257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.341 [2024-11-21 03:44:28.727349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.341 [2024-11-21 03:44:28.727374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.341 qpair failed and we were unable to recover it. 00:27:48.341 [2024-11-21 03:44:28.727507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.341 [2024-11-21 03:44:28.727628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.341 [2024-11-21 03:44:28.727653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.341 qpair failed and we were unable to recover it. 00:27:48.341 [2024-11-21 03:44:28.727758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.341 [2024-11-21 03:44:28.727879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.341 [2024-11-21 03:44:28.727905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.341 qpair failed and we were unable to recover it. 00:27:48.341 [2024-11-21 03:44:28.728002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.341 [2024-11-21 03:44:28.728116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.341 [2024-11-21 03:44:28.728141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.341 qpair failed and we were unable to recover it. 00:27:48.341 [2024-11-21 03:44:28.728243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.341 [2024-11-21 03:44:28.728352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.341 [2024-11-21 03:44:28.728393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.341 qpair failed and we were unable to recover it. 00:27:48.341 [2024-11-21 03:44:28.728493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.341 [2024-11-21 03:44:28.728594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.341 [2024-11-21 03:44:28.728619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.341 qpair failed and we were unable to recover it. 00:27:48.341 [2024-11-21 03:44:28.728723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.341 [2024-11-21 03:44:28.728857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.341 [2024-11-21 03:44:28.728883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.341 qpair failed and we were unable to recover it. 00:27:48.341 [2024-11-21 03:44:28.728982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.341 [2024-11-21 03:44:28.729113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.341 [2024-11-21 03:44:28.729139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.341 qpair failed and we were unable to recover it. 00:27:48.341 [2024-11-21 03:44:28.729241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.341 [2024-11-21 03:44:28.729341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.341 [2024-11-21 03:44:28.729366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.341 qpair failed and we were unable to recover it. 00:27:48.341 [2024-11-21 03:44:28.729478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.341 [2024-11-21 03:44:28.729635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.341 [2024-11-21 03:44:28.729660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.341 qpair failed and we were unable to recover it. 00:27:48.341 [2024-11-21 03:44:28.729790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.341 [2024-11-21 03:44:28.729893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.341 [2024-11-21 03:44:28.729920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.341 qpair failed and we were unable to recover it. 00:27:48.341 [2024-11-21 03:44:28.730049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.341 [2024-11-21 03:44:28.730201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.341 [2024-11-21 03:44:28.730227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.341 qpair failed and we were unable to recover it. 00:27:48.341 [2024-11-21 03:44:28.730328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.341 [2024-11-21 03:44:28.730467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.341 [2024-11-21 03:44:28.730493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.341 qpair failed and we were unable to recover it. 00:27:48.341 [2024-11-21 03:44:28.730623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.341 [2024-11-21 03:44:28.730724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.341 [2024-11-21 03:44:28.730750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.341 qpair failed and we were unable to recover it. 00:27:48.341 [2024-11-21 03:44:28.730910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.341 [2024-11-21 03:44:28.731034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.341 [2024-11-21 03:44:28.731060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.341 qpair failed and we were unable to recover it. 00:27:48.341 [2024-11-21 03:44:28.731187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.341 [2024-11-21 03:44:28.734155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.341 [2024-11-21 03:44:28.734199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.341 qpair failed and we were unable to recover it. 00:27:48.341 [2024-11-21 03:44:28.734360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.341 [2024-11-21 03:44:28.734502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.341 [2024-11-21 03:44:28.734528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.342 qpair failed and we were unable to recover it. 00:27:48.342 [2024-11-21 03:44:28.734657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.342 [2024-11-21 03:44:28.734754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.342 [2024-11-21 03:44:28.734780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.342 qpair failed and we were unable to recover it. 00:27:48.342 [2024-11-21 03:44:28.734884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.342 [2024-11-21 03:44:28.735001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.342 [2024-11-21 03:44:28.735026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.342 qpair failed and we were unable to recover it. 00:27:48.342 [2024-11-21 03:44:28.735146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.342 [2024-11-21 03:44:28.735240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.342 [2024-11-21 03:44:28.735266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.342 qpair failed and we were unable to recover it. 00:27:48.342 [2024-11-21 03:44:28.735359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.342 [2024-11-21 03:44:28.735456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.342 [2024-11-21 03:44:28.735482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.342 qpair failed and we were unable to recover it. 00:27:48.342 [2024-11-21 03:44:28.735622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.342 [2024-11-21 03:44:28.735777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.342 [2024-11-21 03:44:28.735802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.342 qpair failed and we were unable to recover it. 00:27:48.342 [2024-11-21 03:44:28.735936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.342 [2024-11-21 03:44:28.736047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.342 [2024-11-21 03:44:28.736081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.342 qpair failed and we were unable to recover it. 00:27:48.342 [2024-11-21 03:44:28.736216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.342 [2024-11-21 03:44:28.736314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.342 [2024-11-21 03:44:28.736339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.342 qpair failed and we were unable to recover it. 00:27:48.342 [2024-11-21 03:44:28.736447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.342 [2024-11-21 03:44:28.736545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.342 [2024-11-21 03:44:28.736571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.342 qpair failed and we were unable to recover it. 00:27:48.342 [2024-11-21 03:44:28.736710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.342 [2024-11-21 03:44:28.736804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.342 [2024-11-21 03:44:28.736830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.342 qpair failed and we were unable to recover it. 00:27:48.342 [2024-11-21 03:44:28.736960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.342 [2024-11-21 03:44:28.737099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.342 [2024-11-21 03:44:28.737125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.342 qpair failed and we were unable to recover it. 00:27:48.342 [2024-11-21 03:44:28.737221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.342 [2024-11-21 03:44:28.737318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.342 [2024-11-21 03:44:28.737345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.342 qpair failed and we were unable to recover it. 00:27:48.342 [2024-11-21 03:44:28.737447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.342 [2024-11-21 03:44:28.737580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.342 [2024-11-21 03:44:28.737605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.342 qpair failed and we were unable to recover it. 00:27:48.342 [2024-11-21 03:44:28.737735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.342 [2024-11-21 03:44:28.737864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.342 [2024-11-21 03:44:28.737890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.342 qpair failed and we were unable to recover it. 00:27:48.342 [2024-11-21 03:44:28.737989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.342 [2024-11-21 03:44:28.738101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.342 [2024-11-21 03:44:28.738127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.342 qpair failed and we were unable to recover it. 00:27:48.342 [2024-11-21 03:44:28.738268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.342 [2024-11-21 03:44:28.738393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.342 [2024-11-21 03:44:28.738419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.342 qpair failed and we were unable to recover it. 00:27:48.342 [2024-11-21 03:44:28.738523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.342 [2024-11-21 03:44:28.738622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.342 [2024-11-21 03:44:28.738649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.342 qpair failed and we were unable to recover it. 00:27:48.342 [2024-11-21 03:44:28.738763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.342 [2024-11-21 03:44:28.738893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.342 [2024-11-21 03:44:28.738918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.342 qpair failed and we were unable to recover it. 00:27:48.342 [2024-11-21 03:44:28.739044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.342 [2024-11-21 03:44:28.739155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.342 [2024-11-21 03:44:28.739182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.342 qpair failed and we were unable to recover it. 00:27:48.342 [2024-11-21 03:44:28.739294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.342 [2024-11-21 03:44:28.739407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.342 [2024-11-21 03:44:28.739433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.342 qpair failed and we were unable to recover it. 00:27:48.342 [2024-11-21 03:44:28.739540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.342 [2024-11-21 03:44:28.739642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.342 [2024-11-21 03:44:28.739667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.342 qpair failed and we were unable to recover it. 00:27:48.342 [2024-11-21 03:44:28.739824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.342 [2024-11-21 03:44:28.739949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.342 [2024-11-21 03:44:28.739974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.342 qpair failed and we were unable to recover it. 00:27:48.342 [2024-11-21 03:44:28.740110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.342 [2024-11-21 03:44:28.740219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.342 [2024-11-21 03:44:28.740244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.342 qpair failed and we were unable to recover it. 00:27:48.342 [2024-11-21 03:44:28.740375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.342 [2024-11-21 03:44:28.740480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.342 [2024-11-21 03:44:28.740505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.342 qpair failed and we were unable to recover it. 00:27:48.342 [2024-11-21 03:44:28.740632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.342 [2024-11-21 03:44:28.740757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.342 [2024-11-21 03:44:28.740783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.342 qpair failed and we were unable to recover it. 00:27:48.342 [2024-11-21 03:44:28.740887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.342 [2024-11-21 03:44:28.741006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.342 [2024-11-21 03:44:28.741031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.342 qpair failed and we were unable to recover it. 00:27:48.342 [2024-11-21 03:44:28.741178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.342 [2024-11-21 03:44:28.741299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.342 [2024-11-21 03:44:28.741324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.342 qpair failed and we were unable to recover it. 00:27:48.342 [2024-11-21 03:44:28.741450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.342 [2024-11-21 03:44:28.741551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.342 [2024-11-21 03:44:28.741576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.342 qpair failed and we were unable to recover it. 00:27:48.342 [2024-11-21 03:44:28.741682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.342 [2024-11-21 03:44:28.741782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.342 [2024-11-21 03:44:28.741807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.342 qpair failed and we were unable to recover it. 00:27:48.342 [2024-11-21 03:44:28.741952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.342 [2024-11-21 03:44:28.742050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.343 [2024-11-21 03:44:28.742085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.343 qpair failed and we were unable to recover it. 00:27:48.343 [2024-11-21 03:44:28.742212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.343 [2024-11-21 03:44:28.742340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.343 [2024-11-21 03:44:28.742366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.343 qpair failed and we were unable to recover it. 00:27:48.343 [2024-11-21 03:44:28.742465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.343 [2024-11-21 03:44:28.742590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.343 [2024-11-21 03:44:28.742616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.343 qpair failed and we were unable to recover it. 00:27:48.343 [2024-11-21 03:44:28.742743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.343 [2024-11-21 03:44:28.742897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.343 [2024-11-21 03:44:28.742923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.343 qpair failed and we were unable to recover it. 00:27:48.343 [2024-11-21 03:44:28.743032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.343 [2024-11-21 03:44:28.743174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.343 [2024-11-21 03:44:28.743201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.343 qpair failed and we were unable to recover it. 00:27:48.343 [2024-11-21 03:44:28.743301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.343 [2024-11-21 03:44:28.743418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.343 [2024-11-21 03:44:28.743444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.343 qpair failed and we were unable to recover it. 00:27:48.343 [2024-11-21 03:44:28.743548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.343 [2024-11-21 03:44:28.743647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.343 [2024-11-21 03:44:28.743672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.343 qpair failed and we were unable to recover it. 00:27:48.343 [2024-11-21 03:44:28.743771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.343 [2024-11-21 03:44:28.743871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.343 [2024-11-21 03:44:28.743896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.343 qpair failed and we were unable to recover it. 00:27:48.343 [2024-11-21 03:44:28.744055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.343 [2024-11-21 03:44:28.744171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.343 [2024-11-21 03:44:28.744197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.343 qpair failed and we were unable to recover it. 00:27:48.343 [2024-11-21 03:44:28.744305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.343 [2024-11-21 03:44:28.744434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.343 [2024-11-21 03:44:28.744469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.343 qpair failed and we were unable to recover it. 00:27:48.343 [2024-11-21 03:44:28.744637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.343 Malloc0 00:27:48.343 [2024-11-21 03:44:28.744751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.343 [2024-11-21 03:44:28.744776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.343 qpair failed and we were unable to recover it. 00:27:48.343 [2024-11-21 03:44:28.744873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.343 [2024-11-21 03:44:28.744969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.343 [2024-11-21 03:44:28.744993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.343 qpair failed and we were unable to recover it. 00:27:48.343 03:44:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:48.343 [2024-11-21 03:44:28.745122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.343 03:44:28 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:27:48.343 [2024-11-21 03:44:28.745223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.343 [2024-11-21 03:44:28.745249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.343 qpair failed and we were unable to recover it. 00:27:48.343 03:44:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:48.343 [2024-11-21 03:44:28.745354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.343 [2024-11-21 03:44:28.745458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.343 03:44:28 -- common/autotest_common.sh@10 -- # set +x 00:27:48.343 [2024-11-21 03:44:28.745486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.343 qpair failed and we were unable to recover it. 00:27:48.343 [2024-11-21 03:44:28.745584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.343 [2024-11-21 03:44:28.745712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.343 [2024-11-21 03:44:28.745750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.343 qpair failed and we were unable to recover it. 00:27:48.343 [2024-11-21 03:44:28.745888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.343 [2024-11-21 03:44:28.746043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.343 [2024-11-21 03:44:28.746091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0328000b90 with addr=10.0.0.2, port=4420 00:27:48.343 qpair failed and we were unable to recover it. 00:27:48.343 [2024-11-21 03:44:28.746237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.343 [2024-11-21 03:44:28.746370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.343 [2024-11-21 03:44:28.746400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.343 qpair failed and we were unable to recover it. 00:27:48.343 [2024-11-21 03:44:28.746542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.343 [2024-11-21 03:44:28.746654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.343 [2024-11-21 03:44:28.746680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.343 qpair failed and we were unable to recover it. 00:27:48.343 [2024-11-21 03:44:28.746838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.343 [2024-11-21 03:44:28.746932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.343 [2024-11-21 03:44:28.746957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.343 qpair failed and we were unable to recover it. 00:27:48.343 [2024-11-21 03:44:28.747073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.343 [2024-11-21 03:44:28.747212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.343 [2024-11-21 03:44:28.747239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.343 qpair failed and we were unable to recover it. 00:27:48.343 [2024-11-21 03:44:28.747353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.343 [2024-11-21 03:44:28.747451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.343 [2024-11-21 03:44:28.747477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.343 qpair failed and we were unable to recover it. 00:27:48.343 [2024-11-21 03:44:28.747584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.343 [2024-11-21 03:44:28.747707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.343 [2024-11-21 03:44:28.747732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.343 qpair failed and we were unable to recover it. 00:27:48.343 [2024-11-21 03:44:28.747838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.343 [2024-11-21 03:44:28.747939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.343 [2024-11-21 03:44:28.747965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.343 qpair failed and we were unable to recover it. 00:27:48.343 [2024-11-21 03:44:28.748102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.343 [2024-11-21 03:44:28.748203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.343 [2024-11-21 03:44:28.748229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.343 qpair failed and we were unable to recover it. 00:27:48.343 [2024-11-21 03:44:28.748342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.343 [2024-11-21 03:44:28.748362] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:48.343 [2024-11-21 03:44:28.748465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.343 [2024-11-21 03:44:28.748491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.343 qpair failed and we were unable to recover it. 00:27:48.343 [2024-11-21 03:44:28.748602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.343 [2024-11-21 03:44:28.748706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.343 [2024-11-21 03:44:28.748730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.343 qpair failed and we were unable to recover it. 00:27:48.343 [2024-11-21 03:44:28.748838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.343 [2024-11-21 03:44:28.748963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.343 [2024-11-21 03:44:28.748989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.343 qpair failed and we were unable to recover it. 00:27:48.343 [2024-11-21 03:44:28.749109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.343 [2024-11-21 03:44:28.749208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.344 [2024-11-21 03:44:28.749234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.344 qpair failed and we were unable to recover it. 00:27:48.344 [2024-11-21 03:44:28.749367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.344 [2024-11-21 03:44:28.749472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.344 [2024-11-21 03:44:28.749497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.344 qpair failed and we were unable to recover it. 00:27:48.344 [2024-11-21 03:44:28.749594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.344 [2024-11-21 03:44:28.749729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.344 [2024-11-21 03:44:28.749755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.344 qpair failed and we were unable to recover it. 00:27:48.344 [2024-11-21 03:44:28.749864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.344 [2024-11-21 03:44:28.749963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.344 [2024-11-21 03:44:28.749989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.344 qpair failed and we were unable to recover it. 00:27:48.344 [2024-11-21 03:44:28.750143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.344 [2024-11-21 03:44:28.750270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.344 [2024-11-21 03:44:28.750296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.344 qpair failed and we were unable to recover it. 00:27:48.344 [2024-11-21 03:44:28.750404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.344 [2024-11-21 03:44:28.750511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.344 [2024-11-21 03:44:28.750538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.344 qpair failed and we were unable to recover it. 00:27:48.344 [2024-11-21 03:44:28.750632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.344 [2024-11-21 03:44:28.750730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.344 [2024-11-21 03:44:28.750755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.344 qpair failed and we were unable to recover it. 00:27:48.344 [2024-11-21 03:44:28.750852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.344 [2024-11-21 03:44:28.750958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.344 [2024-11-21 03:44:28.750984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.344 qpair failed and we were unable to recover it. 00:27:48.344 [2024-11-21 03:44:28.751126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.344 [2024-11-21 03:44:28.751254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.344 [2024-11-21 03:44:28.751280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.344 qpair failed and we were unable to recover it. 00:27:48.344 [2024-11-21 03:44:28.751382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.344 [2024-11-21 03:44:28.751506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.344 [2024-11-21 03:44:28.751531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.344 qpair failed and we were unable to recover it. 00:27:48.344 [2024-11-21 03:44:28.751657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.344 [2024-11-21 03:44:28.751786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.344 [2024-11-21 03:44:28.751811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.344 qpair failed and we were unable to recover it. 00:27:48.344 [2024-11-21 03:44:28.751910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.344 [2024-11-21 03:44:28.752011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.344 [2024-11-21 03:44:28.752036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.344 qpair failed and we were unable to recover it. 00:27:48.344 [2024-11-21 03:44:28.752139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.344 [2024-11-21 03:44:28.752297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.344 [2024-11-21 03:44:28.752323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.344 qpair failed and we were unable to recover it. 00:27:48.344 [2024-11-21 03:44:28.752461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.344 [2024-11-21 03:44:28.752561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.344 [2024-11-21 03:44:28.752587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.344 qpair failed and we were unable to recover it. 00:27:48.344 [2024-11-21 03:44:28.752691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.344 [2024-11-21 03:44:28.752795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.344 [2024-11-21 03:44:28.752820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.344 qpair failed and we were unable to recover it. 00:27:48.344 [2024-11-21 03:44:28.752952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.344 [2024-11-21 03:44:28.753042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.344 [2024-11-21 03:44:28.753067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.344 qpair failed and we were unable to recover it. 00:27:48.344 [2024-11-21 03:44:28.753173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.344 [2024-11-21 03:44:28.753327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.344 [2024-11-21 03:44:28.753353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.344 qpair failed and we were unable to recover it. 00:27:48.344 [2024-11-21 03:44:28.753483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.344 [2024-11-21 03:44:28.753614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.344 [2024-11-21 03:44:28.753639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.344 qpair failed and we were unable to recover it. 00:27:48.344 [2024-11-21 03:44:28.753744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.344 [2024-11-21 03:44:28.753849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.344 [2024-11-21 03:44:28.753875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.344 qpair failed and we were unable to recover it. 00:27:48.344 [2024-11-21 03:44:28.754008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.344 [2024-11-21 03:44:28.754121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.344 [2024-11-21 03:44:28.754147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.344 qpair failed and we were unable to recover it. 00:27:48.344 [2024-11-21 03:44:28.754254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.344 [2024-11-21 03:44:28.754351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.344 [2024-11-21 03:44:28.754377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.344 qpair failed and we were unable to recover it. 00:27:48.344 [2024-11-21 03:44:28.754473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.344 [2024-11-21 03:44:28.754598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.344 [2024-11-21 03:44:28.754623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.344 qpair failed and we were unable to recover it. 00:27:48.344 [2024-11-21 03:44:28.754714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.344 [2024-11-21 03:44:28.754822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.344 [2024-11-21 03:44:28.754848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.344 qpair failed and we were unable to recover it. 00:27:48.344 [2024-11-21 03:44:28.755004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.344 [2024-11-21 03:44:28.755119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.344 [2024-11-21 03:44:28.755145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.344 qpair failed and we were unable to recover it. 00:27:48.344 [2024-11-21 03:44:28.755246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.344 [2024-11-21 03:44:28.755345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.344 [2024-11-21 03:44:28.755370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.344 qpair failed and we were unable to recover it. 00:27:48.344 [2024-11-21 03:44:28.755529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.344 [2024-11-21 03:44:28.755631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.344 [2024-11-21 03:44:28.755657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.345 qpair failed and we were unable to recover it. 00:27:48.345 [2024-11-21 03:44:28.755763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.345 [2024-11-21 03:44:28.755883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.345 [2024-11-21 03:44:28.755909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.345 qpair failed and we were unable to recover it. 00:27:48.345 [2024-11-21 03:44:28.756006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.345 [2024-11-21 03:44:28.756121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.345 [2024-11-21 03:44:28.756147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.345 qpair failed and we were unable to recover it. 00:27:48.345 [2024-11-21 03:44:28.756254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.345 [2024-11-21 03:44:28.756360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.345 [2024-11-21 03:44:28.756386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.345 qpair failed and we were unable to recover it. 00:27:48.345 [2024-11-21 03:44:28.756491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.345 03:44:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:48.345 [2024-11-21 03:44:28.756588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.345 [2024-11-21 03:44:28.756614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.345 qpair failed and we were unable to recover it. 00:27:48.345 03:44:28 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:48.345 [2024-11-21 03:44:28.756739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.345 03:44:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:48.345 [2024-11-21 03:44:28.756845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.345 [2024-11-21 03:44:28.756873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.345 qpair failed and we were unable to recover it. 00:27:48.345 03:44:28 -- common/autotest_common.sh@10 -- # set +x 00:27:48.345 [2024-11-21 03:44:28.757003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.345 [2024-11-21 03:44:28.757119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.345 [2024-11-21 03:44:28.757149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.345 qpair failed and we were unable to recover it. 00:27:48.345 [2024-11-21 03:44:28.757248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.345 [2024-11-21 03:44:28.757378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.345 [2024-11-21 03:44:28.757404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.345 qpair failed and we were unable to recover it. 00:27:48.345 [2024-11-21 03:44:28.757511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.345 [2024-11-21 03:44:28.757614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.345 [2024-11-21 03:44:28.757641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.345 qpair failed and we were unable to recover it. 00:27:48.345 [2024-11-21 03:44:28.757762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.345 [2024-11-21 03:44:28.757871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.345 [2024-11-21 03:44:28.757896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.345 qpair failed and we were unable to recover it. 00:27:48.345 [2024-11-21 03:44:28.757998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.345 [2024-11-21 03:44:28.758109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.345 [2024-11-21 03:44:28.758135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.345 qpair failed and we were unable to recover it. 00:27:48.345 [2024-11-21 03:44:28.758260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.345 [2024-11-21 03:44:28.758361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.345 [2024-11-21 03:44:28.758387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.345 qpair failed and we were unable to recover it. 00:27:48.345 [2024-11-21 03:44:28.758534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.345 [2024-11-21 03:44:28.758637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.345 [2024-11-21 03:44:28.758664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.345 qpair failed and we were unable to recover it. 00:27:48.345 [2024-11-21 03:44:28.758790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.345 [2024-11-21 03:44:28.758900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.345 [2024-11-21 03:44:28.758926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.345 qpair failed and we were unable to recover it. 00:27:48.345 [2024-11-21 03:44:28.759054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.345 [2024-11-21 03:44:28.759155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.345 [2024-11-21 03:44:28.759181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.345 qpair failed and we were unable to recover it. 00:27:48.345 [2024-11-21 03:44:28.759283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.345 [2024-11-21 03:44:28.759385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.345 [2024-11-21 03:44:28.759411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.345 qpair failed and we were unable to recover it. 00:27:48.345 [2024-11-21 03:44:28.759511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.345 [2024-11-21 03:44:28.759644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.345 [2024-11-21 03:44:28.759669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.345 qpair failed and we were unable to recover it. 00:27:48.345 [2024-11-21 03:44:28.759818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.345 [2024-11-21 03:44:28.759916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.345 [2024-11-21 03:44:28.759942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.345 qpair failed and we were unable to recover it. 00:27:48.345 [2024-11-21 03:44:28.760037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.345 [2024-11-21 03:44:28.760181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.345 [2024-11-21 03:44:28.760209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.345 qpair failed and we were unable to recover it. 00:27:48.345 [2024-11-21 03:44:28.760311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.345 [2024-11-21 03:44:28.760415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.345 [2024-11-21 03:44:28.760440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.345 qpair failed and we were unable to recover it. 00:27:48.345 [2024-11-21 03:44:28.760547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.345 [2024-11-21 03:44:28.760650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.345 [2024-11-21 03:44:28.760676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.345 qpair failed and we were unable to recover it. 00:27:48.345 [2024-11-21 03:44:28.760799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.345 [2024-11-21 03:44:28.760892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.345 [2024-11-21 03:44:28.760917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.345 qpair failed and we were unable to recover it. 00:27:48.345 [2024-11-21 03:44:28.761022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.345 [2024-11-21 03:44:28.761124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.345 [2024-11-21 03:44:28.761150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.345 qpair failed and we were unable to recover it. 00:27:48.345 [2024-11-21 03:44:28.761276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.345 [2024-11-21 03:44:28.761378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.345 [2024-11-21 03:44:28.761404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.345 qpair failed and we were unable to recover it. 00:27:48.345 [2024-11-21 03:44:28.761514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.345 [2024-11-21 03:44:28.761647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.345 [2024-11-21 03:44:28.761672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.345 qpair failed and we were unable to recover it. 00:27:48.345 [2024-11-21 03:44:28.761816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.345 [2024-11-21 03:44:28.761948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.345 [2024-11-21 03:44:28.761973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.345 qpair failed and we were unable to recover it. 00:27:48.345 [2024-11-21 03:44:28.762082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.345 [2024-11-21 03:44:28.762188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.345 [2024-11-21 03:44:28.762214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.345 qpair failed and we were unable to recover it. 00:27:48.345 [2024-11-21 03:44:28.762345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.345 [2024-11-21 03:44:28.762445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.345 [2024-11-21 03:44:28.762470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.345 qpair failed and we were unable to recover it. 00:27:48.345 [2024-11-21 03:44:28.762573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.345 [2024-11-21 03:44:28.762702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.345 [2024-11-21 03:44:28.762729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.346 qpair failed and we were unable to recover it. 00:27:48.346 [2024-11-21 03:44:28.762839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.346 [2024-11-21 03:44:28.762966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.346 [2024-11-21 03:44:28.762992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.346 qpair failed and we were unable to recover it. 00:27:48.346 [2024-11-21 03:44:28.763104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.346 [2024-11-21 03:44:28.763206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.346 [2024-11-21 03:44:28.763233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.346 qpair failed and we were unable to recover it. 00:27:48.346 [2024-11-21 03:44:28.763360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.346 [2024-11-21 03:44:28.763491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.346 [2024-11-21 03:44:28.763517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.346 qpair failed and we were unable to recover it. 00:27:48.346 [2024-11-21 03:44:28.763652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.346 [2024-11-21 03:44:28.763778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.346 [2024-11-21 03:44:28.763804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.346 qpair failed and we were unable to recover it. 00:27:48.346 [2024-11-21 03:44:28.763931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.346 [2024-11-21 03:44:28.764111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.346 [2024-11-21 03:44:28.764137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.346 qpair failed and we were unable to recover it. 00:27:48.346 [2024-11-21 03:44:28.764233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.346 [2024-11-21 03:44:28.764332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.346 [2024-11-21 03:44:28.764358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.346 qpair failed and we were unable to recover it. 00:27:48.346 [2024-11-21 03:44:28.764464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.346 [2024-11-21 03:44:28.764562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.346 [2024-11-21 03:44:28.764588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.346 qpair failed and we were unable to recover it. 00:27:48.346 03:44:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:48.346 [2024-11-21 03:44:28.764704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.346 03:44:28 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:27:48.346 [2024-11-21 03:44:28.764831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.346 [2024-11-21 03:44:28.764857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.346 qpair failed and we were unable to recover it. 00:27:48.346 03:44:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:48.346 [2024-11-21 03:44:28.764948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.346 03:44:28 -- common/autotest_common.sh@10 -- # set +x 00:27:48.346 [2024-11-21 03:44:28.765080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.346 [2024-11-21 03:44:28.765106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.346 qpair failed and we were unable to recover it. 00:27:48.346 [2024-11-21 03:44:28.765239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.346 [2024-11-21 03:44:28.765338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.346 [2024-11-21 03:44:28.765364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.346 qpair failed and we were unable to recover it. 00:27:48.346 [2024-11-21 03:44:28.765471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.346 [2024-11-21 03:44:28.765578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.346 [2024-11-21 03:44:28.765605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.346 qpair failed and we were unable to recover it. 00:27:48.346 [2024-11-21 03:44:28.765718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.346 [2024-11-21 03:44:28.765856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.346 [2024-11-21 03:44:28.765882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.346 qpair failed and we were unable to recover it. 00:27:48.346 [2024-11-21 03:44:28.765993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.346 [2024-11-21 03:44:28.766101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.346 [2024-11-21 03:44:28.766128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.346 qpair failed and we were unable to recover it. 00:27:48.346 [2024-11-21 03:44:28.766226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.346 [2024-11-21 03:44:28.766355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.346 [2024-11-21 03:44:28.766380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.346 qpair failed and we were unable to recover it. 00:27:48.346 [2024-11-21 03:44:28.766508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.346 [2024-11-21 03:44:28.766630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.346 [2024-11-21 03:44:28.766656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.346 qpair failed and we were unable to recover it. 00:27:48.346 [2024-11-21 03:44:28.766759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.346 [2024-11-21 03:44:28.766888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.346 [2024-11-21 03:44:28.766914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.346 qpair failed and we were unable to recover it. 00:27:48.346 [2024-11-21 03:44:28.767061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.346 [2024-11-21 03:44:28.767169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.346 [2024-11-21 03:44:28.767195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0324000b90 with addr=10.0.0.2, port=4420 00:27:48.346 qpair failed and we were unable to recover it. 00:27:48.346 [2024-11-21 03:44:28.767343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.346 [2024-11-21 03:44:28.767471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.346 [2024-11-21 03:44:28.767501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.346 qpair failed and we were unable to recover it. 00:27:48.346 [2024-11-21 03:44:28.767610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.346 [2024-11-21 03:44:28.767709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.346 [2024-11-21 03:44:28.767737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.346 qpair failed and we were unable to recover it. 00:27:48.346 [2024-11-21 03:44:28.767837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.346 [2024-11-21 03:44:28.767946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.346 [2024-11-21 03:44:28.767973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.346 qpair failed and we were unable to recover it. 00:27:48.346 [2024-11-21 03:44:28.768109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.346 [2024-11-21 03:44:28.768208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.346 [2024-11-21 03:44:28.768234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.346 qpair failed and we were unable to recover it. 00:27:48.346 [2024-11-21 03:44:28.768363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.346 [2024-11-21 03:44:28.768465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.346 [2024-11-21 03:44:28.768490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.346 qpair failed and we were unable to recover it. 00:27:48.346 [2024-11-21 03:44:28.768622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.346 [2024-11-21 03:44:28.768720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.346 [2024-11-21 03:44:28.768747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.346 qpair failed and we were unable to recover it. 00:27:48.346 [2024-11-21 03:44:28.768851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.346 [2024-11-21 03:44:28.768954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.346 [2024-11-21 03:44:28.768980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.346 qpair failed and we were unable to recover it. 00:27:48.346 [2024-11-21 03:44:28.769104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.346 [2024-11-21 03:44:28.769199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.346 [2024-11-21 03:44:28.769226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.346 qpair failed and we were unable to recover it. 00:27:48.346 [2024-11-21 03:44:28.769348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.346 [2024-11-21 03:44:28.769450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.346 [2024-11-21 03:44:28.769475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.346 qpair failed and we were unable to recover it. 00:27:48.346 [2024-11-21 03:44:28.769572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.346 [2024-11-21 03:44:28.769701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.346 [2024-11-21 03:44:28.769727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.346 qpair failed and we were unable to recover it. 00:27:48.346 [2024-11-21 03:44:28.769834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.346 [2024-11-21 03:44:28.769937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.347 [2024-11-21 03:44:28.769963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.347 qpair failed and we were unable to recover it. 00:27:48.347 [2024-11-21 03:44:28.770101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.347 [2024-11-21 03:44:28.770210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.347 [2024-11-21 03:44:28.770236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.347 qpair failed and we were unable to recover it. 00:27:48.347 [2024-11-21 03:44:28.770335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.347 [2024-11-21 03:44:28.770432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.347 [2024-11-21 03:44:28.770457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.347 qpair failed and we were unable to recover it. 00:27:48.347 [2024-11-21 03:44:28.770560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.347 [2024-11-21 03:44:28.770666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.347 [2024-11-21 03:44:28.770691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.347 qpair failed and we were unable to recover it. 00:27:48.347 [2024-11-21 03:44:28.770815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.347 [2024-11-21 03:44:28.770921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.347 [2024-11-21 03:44:28.770948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.347 qpair failed and we were unable to recover it. 00:27:48.347 [2024-11-21 03:44:28.771056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.347 [2024-11-21 03:44:28.771191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.347 [2024-11-21 03:44:28.771216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.347 qpair failed and we were unable to recover it. 00:27:48.347 [2024-11-21 03:44:28.771320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.347 [2024-11-21 03:44:28.771456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.347 [2024-11-21 03:44:28.771481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.347 qpair failed and we were unable to recover it. 00:27:48.347 [2024-11-21 03:44:28.771575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.347 [2024-11-21 03:44:28.771674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.347 [2024-11-21 03:44:28.771701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.347 qpair failed and we were unable to recover it. 00:27:48.347 [2024-11-21 03:44:28.771833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.347 [2024-11-21 03:44:28.771942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.347 [2024-11-21 03:44:28.771968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.347 qpair failed and we were unable to recover it. 00:27:48.347 [2024-11-21 03:44:28.772066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.347 [2024-11-21 03:44:28.772187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.347 [2024-11-21 03:44:28.772213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.347 qpair failed and we were unable to recover it. 00:27:48.347 [2024-11-21 03:44:28.772346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.347 [2024-11-21 03:44:28.772446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.347 [2024-11-21 03:44:28.772471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.347 qpair failed and we were unable to recover it. 00:27:48.347 [2024-11-21 03:44:28.772594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.347 03:44:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:48.347 [2024-11-21 03:44:28.772695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.347 [2024-11-21 03:44:28.772721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.347 qpair failed and we were unable to recover it. 00:27:48.347 03:44:28 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:48.347 [2024-11-21 03:44:28.772831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.347 03:44:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:48.347 [2024-11-21 03:44:28.772931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.347 [2024-11-21 03:44:28.772956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.347 qpair failed and we were unable to recover it. 00:27:48.347 03:44:28 -- common/autotest_common.sh@10 -- # set +x 00:27:48.347 [2024-11-21 03:44:28.773049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.347 [2024-11-21 03:44:28.773164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.347 [2024-11-21 03:44:28.773190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.347 qpair failed and we were unable to recover it. 00:27:48.347 [2024-11-21 03:44:28.773289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.347 [2024-11-21 03:44:28.773393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.347 [2024-11-21 03:44:28.773418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.347 qpair failed and we were unable to recover it. 00:27:48.347 [2024-11-21 03:44:28.773543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.347 [2024-11-21 03:44:28.773637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.347 [2024-11-21 03:44:28.773661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.347 qpair failed and we were unable to recover it. 00:27:48.347 [2024-11-21 03:44:28.773773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.347 [2024-11-21 03:44:28.773866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.347 [2024-11-21 03:44:28.773891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.347 qpair failed and we were unable to recover it. 00:27:48.347 [2024-11-21 03:44:28.773994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.347 [2024-11-21 03:44:28.774106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.347 [2024-11-21 03:44:28.774132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.347 qpair failed and we were unable to recover it. 00:27:48.347 [2024-11-21 03:44:28.774237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.347 [2024-11-21 03:44:28.774331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.347 [2024-11-21 03:44:28.774356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.347 qpair failed and we were unable to recover it. 00:27:48.347 [2024-11-21 03:44:28.774483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.347 [2024-11-21 03:44:28.774579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.347 [2024-11-21 03:44:28.774609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.347 qpair failed and we were unable to recover it. 00:27:48.347 [2024-11-21 03:44:28.774719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.347 [2024-11-21 03:44:28.774818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.347 [2024-11-21 03:44:28.774845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.347 qpair failed and we were unable to recover it. 00:27:48.347 [2024-11-21 03:44:28.774938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.347 [2024-11-21 03:44:28.775048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.347 [2024-11-21 03:44:28.775077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.347 qpair failed and we were unable to recover it. 00:27:48.347 [2024-11-21 03:44:28.775184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.347 [2024-11-21 03:44:28.775337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.347 [2024-11-21 03:44:28.775362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.347 qpair failed and we were unable to recover it. 00:27:48.347 [2024-11-21 03:44:28.775498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.347 [2024-11-21 03:44:28.775628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.347 [2024-11-21 03:44:28.775653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.347 qpair failed and we were unable to recover it. 00:27:48.347 [2024-11-21 03:44:28.775759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.347 [2024-11-21 03:44:28.775883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.347 [2024-11-21 03:44:28.775908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.347 qpair failed and we were unable to recover it. 00:27:48.347 [2024-11-21 03:44:28.776004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.347 [2024-11-21 03:44:28.776156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.347 [2024-11-21 03:44:28.776182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.347 qpair failed and we were unable to recover it. 00:27:48.347 [2024-11-21 03:44:28.776286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.347 [2024-11-21 03:44:28.776390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:48.347 [2024-11-21 03:44:28.776416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f0330000b90 with addr=10.0.0.2, port=4420 00:27:48.347 qpair failed and we were unable to recover it. 00:27:48.347 [2024-11-21 03:44:28.776705] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:48.347 [2024-11-21 03:44:28.779062] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.347 [2024-11-21 03:44:28.779226] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.347 [2024-11-21 03:44:28.779254] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.347 [2024-11-21 03:44:28.779268] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.348 [2024-11-21 03:44:28.779291] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:48.348 [2024-11-21 03:44:28.779326] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.348 qpair failed and we were unable to recover it. 00:27:48.348 03:44:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:48.348 03:44:28 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:27:48.348 03:44:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:48.348 03:44:28 -- common/autotest_common.sh@10 -- # set +x 00:27:48.348 03:44:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:48.348 03:44:28 -- host/target_disconnect.sh@58 -- # wait 3174481 00:27:48.348 [2024-11-21 03:44:28.788921] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.348 [2024-11-21 03:44:28.789042] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.348 [2024-11-21 03:44:28.789076] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.348 [2024-11-21 03:44:28.789098] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.348 [2024-11-21 03:44:28.789110] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:48.348 [2024-11-21 03:44:28.789141] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.348 qpair failed and we were unable to recover it. 00:27:48.348 [2024-11-21 03:44:28.798951] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.348 [2024-11-21 03:44:28.799058] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.348 [2024-11-21 03:44:28.799092] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.348 [2024-11-21 03:44:28.799107] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.348 [2024-11-21 03:44:28.799120] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:48.348 [2024-11-21 03:44:28.799150] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.348 qpair failed and we were unable to recover it. 00:27:48.348 [2024-11-21 03:44:28.808996] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.348 [2024-11-21 03:44:28.809121] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.348 [2024-11-21 03:44:28.809148] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.348 [2024-11-21 03:44:28.809162] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.348 [2024-11-21 03:44:28.809173] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:48.348 [2024-11-21 03:44:28.809203] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.348 qpair failed and we were unable to recover it. 00:27:48.348 [2024-11-21 03:44:28.818957] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.348 [2024-11-21 03:44:28.819092] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.348 [2024-11-21 03:44:28.819120] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.348 [2024-11-21 03:44:28.819136] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.348 [2024-11-21 03:44:28.819152] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:48.348 [2024-11-21 03:44:28.819183] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.348 qpair failed and we were unable to recover it. 00:27:48.348 [2024-11-21 03:44:28.829007] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.348 [2024-11-21 03:44:28.829119] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.348 [2024-11-21 03:44:28.829166] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.348 [2024-11-21 03:44:28.829181] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.348 [2024-11-21 03:44:28.829194] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:48.348 [2024-11-21 03:44:28.829236] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.348 qpair failed and we were unable to recover it. 00:27:48.348 [2024-11-21 03:44:28.838987] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.348 [2024-11-21 03:44:28.839094] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.348 [2024-11-21 03:44:28.839120] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.348 [2024-11-21 03:44:28.839135] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.348 [2024-11-21 03:44:28.839148] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:48.348 [2024-11-21 03:44:28.839177] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.348 qpair failed and we were unable to recover it. 00:27:48.348 [2024-11-21 03:44:28.849016] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.348 [2024-11-21 03:44:28.849147] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.348 [2024-11-21 03:44:28.849173] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.348 [2024-11-21 03:44:28.849187] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.348 [2024-11-21 03:44:28.849200] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:48.348 [2024-11-21 03:44:28.849230] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.348 qpair failed and we were unable to recover it. 00:27:48.348 [2024-11-21 03:44:28.859038] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.348 [2024-11-21 03:44:28.859154] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.348 [2024-11-21 03:44:28.859180] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.348 [2024-11-21 03:44:28.859194] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.348 [2024-11-21 03:44:28.859206] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:48.348 [2024-11-21 03:44:28.859235] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.348 qpair failed and we were unable to recover it. 00:27:48.348 [2024-11-21 03:44:28.869063] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.348 [2024-11-21 03:44:28.869174] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.348 [2024-11-21 03:44:28.869199] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.348 [2024-11-21 03:44:28.869219] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.348 [2024-11-21 03:44:28.869233] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:48.348 [2024-11-21 03:44:28.869262] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.348 qpair failed and we were unable to recover it. 00:27:48.348 [2024-11-21 03:44:28.879082] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.348 [2024-11-21 03:44:28.879211] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.348 [2024-11-21 03:44:28.879237] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.348 [2024-11-21 03:44:28.879252] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.348 [2024-11-21 03:44:28.879265] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:48.348 [2024-11-21 03:44:28.879295] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.348 qpair failed and we were unable to recover it. 00:27:48.348 [2024-11-21 03:44:28.889212] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.348 [2024-11-21 03:44:28.889324] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.348 [2024-11-21 03:44:28.889350] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.348 [2024-11-21 03:44:28.889364] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.348 [2024-11-21 03:44:28.889377] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:48.348 [2024-11-21 03:44:28.889409] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.348 qpair failed and we were unable to recover it. 00:27:48.348 [2024-11-21 03:44:28.899210] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.348 [2024-11-21 03:44:28.899319] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.349 [2024-11-21 03:44:28.899345] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.349 [2024-11-21 03:44:28.899362] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.349 [2024-11-21 03:44:28.899374] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:48.349 [2024-11-21 03:44:28.899404] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.349 qpair failed and we were unable to recover it. 00:27:48.349 [2024-11-21 03:44:28.909218] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.349 [2024-11-21 03:44:28.909321] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.349 [2024-11-21 03:44:28.909346] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.349 [2024-11-21 03:44:28.909360] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.349 [2024-11-21 03:44:28.909373] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:48.349 [2024-11-21 03:44:28.909401] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.349 qpair failed and we were unable to recover it. 00:27:48.349 [2024-11-21 03:44:28.919234] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.349 [2024-11-21 03:44:28.919336] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.349 [2024-11-21 03:44:28.919361] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.349 [2024-11-21 03:44:28.919375] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.349 [2024-11-21 03:44:28.919388] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:48.349 [2024-11-21 03:44:28.919419] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.349 qpair failed and we were unable to recover it. 00:27:48.349 [2024-11-21 03:44:28.929324] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.349 [2024-11-21 03:44:28.929433] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.349 [2024-11-21 03:44:28.929459] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.349 [2024-11-21 03:44:28.929472] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.349 [2024-11-21 03:44:28.929485] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:48.349 [2024-11-21 03:44:28.929515] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.349 qpair failed and we were unable to recover it. 00:27:48.349 [2024-11-21 03:44:28.939246] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.349 [2024-11-21 03:44:28.939350] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.349 [2024-11-21 03:44:28.939375] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.349 [2024-11-21 03:44:28.939389] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.349 [2024-11-21 03:44:28.939401] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:48.349 [2024-11-21 03:44:28.939432] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.349 qpair failed and we were unable to recover it. 00:27:48.349 [2024-11-21 03:44:28.949309] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.349 [2024-11-21 03:44:28.949417] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.349 [2024-11-21 03:44:28.949442] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.349 [2024-11-21 03:44:28.949456] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.349 [2024-11-21 03:44:28.949469] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:48.349 [2024-11-21 03:44:28.949497] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.349 qpair failed and we were unable to recover it. 00:27:48.349 [2024-11-21 03:44:28.959349] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.349 [2024-11-21 03:44:28.959457] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.609 [2024-11-21 03:44:28.959494] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.609 [2024-11-21 03:44:28.959513] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.609 [2024-11-21 03:44:28.959527] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:48.609 [2024-11-21 03:44:28.959556] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.609 qpair failed and we were unable to recover it. 00:27:48.609 [2024-11-21 03:44:28.969417] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.609 [2024-11-21 03:44:28.969527] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.609 [2024-11-21 03:44:28.969552] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.609 [2024-11-21 03:44:28.969566] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.609 [2024-11-21 03:44:28.969579] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:48.609 [2024-11-21 03:44:28.969610] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.609 qpair failed and we were unable to recover it. 00:27:48.609 [2024-11-21 03:44:28.979366] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.609 [2024-11-21 03:44:28.979497] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.609 [2024-11-21 03:44:28.979523] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.609 [2024-11-21 03:44:28.979537] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.609 [2024-11-21 03:44:28.979549] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:48.609 [2024-11-21 03:44:28.979579] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.609 qpair failed and we were unable to recover it. 00:27:48.609 [2024-11-21 03:44:28.989379] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.609 [2024-11-21 03:44:28.989480] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.609 [2024-11-21 03:44:28.989505] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.609 [2024-11-21 03:44:28.989519] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.609 [2024-11-21 03:44:28.989532] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:48.609 [2024-11-21 03:44:28.989562] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.609 qpair failed and we were unable to recover it. 00:27:48.609 [2024-11-21 03:44:28.999443] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.609 [2024-11-21 03:44:28.999571] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.609 [2024-11-21 03:44:28.999597] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.609 [2024-11-21 03:44:28.999611] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.609 [2024-11-21 03:44:28.999623] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:48.609 [2024-11-21 03:44:28.999653] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.609 qpair failed and we were unable to recover it. 00:27:48.609 [2024-11-21 03:44:29.009450] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.609 [2024-11-21 03:44:29.009556] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.609 [2024-11-21 03:44:29.009581] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.609 [2024-11-21 03:44:29.009595] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.609 [2024-11-21 03:44:29.009608] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:48.609 [2024-11-21 03:44:29.009638] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.609 qpair failed and we were unable to recover it. 00:27:48.609 [2024-11-21 03:44:29.019500] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.610 [2024-11-21 03:44:29.019597] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.610 [2024-11-21 03:44:29.019622] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.610 [2024-11-21 03:44:29.019636] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.610 [2024-11-21 03:44:29.019649] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:48.610 [2024-11-21 03:44:29.019678] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.610 qpair failed and we were unable to recover it. 00:27:48.610 [2024-11-21 03:44:29.029530] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.610 [2024-11-21 03:44:29.029638] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.610 [2024-11-21 03:44:29.029663] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.610 [2024-11-21 03:44:29.029678] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.610 [2024-11-21 03:44:29.029691] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:48.610 [2024-11-21 03:44:29.029720] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.610 qpair failed and we were unable to recover it. 00:27:48.610 [2024-11-21 03:44:29.039633] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.610 [2024-11-21 03:44:29.039738] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.610 [2024-11-21 03:44:29.039763] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.610 [2024-11-21 03:44:29.039777] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.610 [2024-11-21 03:44:29.039790] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:48.610 [2024-11-21 03:44:29.039820] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.610 qpair failed and we were unable to recover it. 00:27:48.610 [2024-11-21 03:44:29.049598] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.610 [2024-11-21 03:44:29.049709] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.610 [2024-11-21 03:44:29.049740] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.610 [2024-11-21 03:44:29.049755] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.610 [2024-11-21 03:44:29.049767] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:48.610 [2024-11-21 03:44:29.049796] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.610 qpair failed and we were unable to recover it. 00:27:48.610 [2024-11-21 03:44:29.059599] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.610 [2024-11-21 03:44:29.059710] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.610 [2024-11-21 03:44:29.059735] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.610 [2024-11-21 03:44:29.059760] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.610 [2024-11-21 03:44:29.059774] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:48.610 [2024-11-21 03:44:29.059803] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.610 qpair failed and we were unable to recover it. 00:27:48.610 [2024-11-21 03:44:29.069604] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.610 [2024-11-21 03:44:29.069707] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.610 [2024-11-21 03:44:29.069732] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.610 [2024-11-21 03:44:29.069746] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.610 [2024-11-21 03:44:29.069759] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:48.610 [2024-11-21 03:44:29.069787] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.610 qpair failed and we were unable to recover it. 00:27:48.610 [2024-11-21 03:44:29.079689] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.610 [2024-11-21 03:44:29.079812] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.610 [2024-11-21 03:44:29.079838] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.610 [2024-11-21 03:44:29.079853] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.610 [2024-11-21 03:44:29.079865] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:48.610 [2024-11-21 03:44:29.079908] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.610 qpair failed and we were unable to recover it. 00:27:48.610 [2024-11-21 03:44:29.089674] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.610 [2024-11-21 03:44:29.089780] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.610 [2024-11-21 03:44:29.089805] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.610 [2024-11-21 03:44:29.089819] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.610 [2024-11-21 03:44:29.089833] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:48.610 [2024-11-21 03:44:29.089869] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.610 qpair failed and we were unable to recover it. 00:27:48.610 [2024-11-21 03:44:29.099722] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.610 [2024-11-21 03:44:29.099838] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.610 [2024-11-21 03:44:29.099863] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.610 [2024-11-21 03:44:29.099878] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.610 [2024-11-21 03:44:29.099891] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:48.610 [2024-11-21 03:44:29.099919] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.610 qpair failed and we were unable to recover it. 00:27:48.610 [2024-11-21 03:44:29.109756] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.610 [2024-11-21 03:44:29.109872] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.610 [2024-11-21 03:44:29.109898] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.610 [2024-11-21 03:44:29.109912] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.610 [2024-11-21 03:44:29.109925] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:48.610 [2024-11-21 03:44:29.109966] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.610 qpair failed and we were unable to recover it. 00:27:48.610 [2024-11-21 03:44:29.119774] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.610 [2024-11-21 03:44:29.119879] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.610 [2024-11-21 03:44:29.119908] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.610 [2024-11-21 03:44:29.119923] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.610 [2024-11-21 03:44:29.119936] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:48.610 [2024-11-21 03:44:29.119968] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.610 qpair failed and we were unable to recover it. 00:27:48.611 [2024-11-21 03:44:29.129797] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.611 [2024-11-21 03:44:29.129908] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.611 [2024-11-21 03:44:29.129934] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.611 [2024-11-21 03:44:29.129948] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.611 [2024-11-21 03:44:29.129961] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:48.611 [2024-11-21 03:44:29.129991] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.611 qpair failed and we were unable to recover it. 00:27:48.611 [2024-11-21 03:44:29.139852] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.611 [2024-11-21 03:44:29.139958] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.611 [2024-11-21 03:44:29.139989] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.611 [2024-11-21 03:44:29.140004] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.611 [2024-11-21 03:44:29.140017] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:48.611 [2024-11-21 03:44:29.140045] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.611 qpair failed and we were unable to recover it. 00:27:48.611 [2024-11-21 03:44:29.149879] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.611 [2024-11-21 03:44:29.149994] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.611 [2024-11-21 03:44:29.150019] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.611 [2024-11-21 03:44:29.150033] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.611 [2024-11-21 03:44:29.150046] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:48.611 [2024-11-21 03:44:29.150085] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.611 qpair failed and we were unable to recover it. 00:27:48.611 [2024-11-21 03:44:29.159870] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.611 [2024-11-21 03:44:29.159977] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.611 [2024-11-21 03:44:29.160002] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.611 [2024-11-21 03:44:29.160016] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.611 [2024-11-21 03:44:29.160029] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:48.611 [2024-11-21 03:44:29.160058] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.611 qpair failed and we were unable to recover it. 00:27:48.611 [2024-11-21 03:44:29.169936] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.611 [2024-11-21 03:44:29.170087] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.611 [2024-11-21 03:44:29.170113] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.611 [2024-11-21 03:44:29.170127] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.611 [2024-11-21 03:44:29.170140] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:48.611 [2024-11-21 03:44:29.170171] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.611 qpair failed and we were unable to recover it. 00:27:48.611 [2024-11-21 03:44:29.179914] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.611 [2024-11-21 03:44:29.180019] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.611 [2024-11-21 03:44:29.180044] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.611 [2024-11-21 03:44:29.180059] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.611 [2024-11-21 03:44:29.180087] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:48.611 [2024-11-21 03:44:29.180119] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.611 qpair failed and we were unable to recover it. 00:27:48.611 [2024-11-21 03:44:29.189949] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.611 [2024-11-21 03:44:29.190056] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.611 [2024-11-21 03:44:29.190091] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.611 [2024-11-21 03:44:29.190107] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.611 [2024-11-21 03:44:29.190119] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:48.611 [2024-11-21 03:44:29.190150] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.611 qpair failed and we were unable to recover it. 00:27:48.611 [2024-11-21 03:44:29.199988] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.611 [2024-11-21 03:44:29.200102] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.611 [2024-11-21 03:44:29.200127] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.611 [2024-11-21 03:44:29.200141] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.611 [2024-11-21 03:44:29.200156] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:48.611 [2024-11-21 03:44:29.200186] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.611 qpair failed and we were unable to recover it. 00:27:48.611 [2024-11-21 03:44:29.210020] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.611 [2024-11-21 03:44:29.210147] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.611 [2024-11-21 03:44:29.210173] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.611 [2024-11-21 03:44:29.210188] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.611 [2024-11-21 03:44:29.210201] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:48.611 [2024-11-21 03:44:29.210233] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.611 qpair failed and we were unable to recover it. 00:27:48.611 [2024-11-21 03:44:29.220053] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.611 [2024-11-21 03:44:29.220164] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.611 [2024-11-21 03:44:29.220189] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.611 [2024-11-21 03:44:29.220203] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.611 [2024-11-21 03:44:29.220216] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:48.611 [2024-11-21 03:44:29.220248] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.611 qpair failed and we were unable to recover it. 00:27:48.611 [2024-11-21 03:44:29.230081] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.611 [2024-11-21 03:44:29.230191] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.611 [2024-11-21 03:44:29.230217] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.611 [2024-11-21 03:44:29.230231] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.611 [2024-11-21 03:44:29.230244] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:48.611 [2024-11-21 03:44:29.230273] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.611 qpair failed and we were unable to recover it. 00:27:48.611 [2024-11-21 03:44:29.240121] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.611 [2024-11-21 03:44:29.240229] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.611 [2024-11-21 03:44:29.240257] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.612 [2024-11-21 03:44:29.240272] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.612 [2024-11-21 03:44:29.240285] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:48.612 [2024-11-21 03:44:29.240316] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.612 qpair failed and we were unable to recover it. 00:27:48.612 [2024-11-21 03:44:29.250143] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.612 [2024-11-21 03:44:29.250251] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.612 [2024-11-21 03:44:29.250276] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.612 [2024-11-21 03:44:29.250291] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.612 [2024-11-21 03:44:29.250303] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:48.612 [2024-11-21 03:44:29.250331] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.612 qpair failed and we were unable to recover it. 00:27:48.873 [2024-11-21 03:44:29.260252] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.873 [2024-11-21 03:44:29.260407] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.873 [2024-11-21 03:44:29.260432] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.873 [2024-11-21 03:44:29.260450] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.873 [2024-11-21 03:44:29.260463] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:48.873 [2024-11-21 03:44:29.260491] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.873 qpair failed and we were unable to recover it. 00:27:48.873 [2024-11-21 03:44:29.270203] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.873 [2024-11-21 03:44:29.270306] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.873 [2024-11-21 03:44:29.270331] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.873 [2024-11-21 03:44:29.270345] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.873 [2024-11-21 03:44:29.270365] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:48.873 [2024-11-21 03:44:29.270395] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.873 qpair failed and we were unable to recover it. 00:27:48.873 [2024-11-21 03:44:29.280220] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.873 [2024-11-21 03:44:29.280319] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.873 [2024-11-21 03:44:29.280344] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.873 [2024-11-21 03:44:29.280366] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.873 [2024-11-21 03:44:29.280382] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:48.873 [2024-11-21 03:44:29.280412] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.873 qpair failed and we were unable to recover it. 00:27:48.873 [2024-11-21 03:44:29.290254] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.873 [2024-11-21 03:44:29.290360] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.873 [2024-11-21 03:44:29.290392] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.873 [2024-11-21 03:44:29.290406] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.873 [2024-11-21 03:44:29.290419] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:48.873 [2024-11-21 03:44:29.290448] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.873 qpair failed and we were unable to recover it. 00:27:48.873 [2024-11-21 03:44:29.300302] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.873 [2024-11-21 03:44:29.300412] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.873 [2024-11-21 03:44:29.300437] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.873 [2024-11-21 03:44:29.300452] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.873 [2024-11-21 03:44:29.300465] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:48.873 [2024-11-21 03:44:29.300495] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.873 qpair failed and we were unable to recover it. 00:27:48.873 [2024-11-21 03:44:29.310330] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.873 [2024-11-21 03:44:29.310435] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.873 [2024-11-21 03:44:29.310461] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.873 [2024-11-21 03:44:29.310475] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.873 [2024-11-21 03:44:29.310489] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:48.873 [2024-11-21 03:44:29.310531] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.873 qpair failed and we were unable to recover it. 00:27:48.873 [2024-11-21 03:44:29.320312] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.873 [2024-11-21 03:44:29.320417] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.873 [2024-11-21 03:44:29.320442] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.873 [2024-11-21 03:44:29.320457] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.873 [2024-11-21 03:44:29.320474] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:48.873 [2024-11-21 03:44:29.320505] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.873 qpair failed and we were unable to recover it. 00:27:48.873 [2024-11-21 03:44:29.330426] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.873 [2024-11-21 03:44:29.330574] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.873 [2024-11-21 03:44:29.330599] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.873 [2024-11-21 03:44:29.330614] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.873 [2024-11-21 03:44:29.330627] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:48.873 [2024-11-21 03:44:29.330655] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.873 qpair failed and we were unable to recover it. 00:27:48.873 [2024-11-21 03:44:29.340395] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.873 [2024-11-21 03:44:29.340512] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.873 [2024-11-21 03:44:29.340538] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.873 [2024-11-21 03:44:29.340552] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.873 [2024-11-21 03:44:29.340564] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:48.873 [2024-11-21 03:44:29.340594] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.873 qpair failed and we were unable to recover it. 00:27:48.873 [2024-11-21 03:44:29.350425] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.873 [2024-11-21 03:44:29.350565] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.873 [2024-11-21 03:44:29.350590] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.873 [2024-11-21 03:44:29.350604] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.873 [2024-11-21 03:44:29.350617] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:48.873 [2024-11-21 03:44:29.350647] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.873 qpair failed and we were unable to recover it. 00:27:48.873 [2024-11-21 03:44:29.360453] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.873 [2024-11-21 03:44:29.360554] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.873 [2024-11-21 03:44:29.360581] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.873 [2024-11-21 03:44:29.360606] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.873 [2024-11-21 03:44:29.360620] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:48.874 [2024-11-21 03:44:29.360651] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.874 qpair failed and we were unable to recover it. 00:27:48.874 [2024-11-21 03:44:29.370535] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.874 [2024-11-21 03:44:29.370639] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.874 [2024-11-21 03:44:29.370664] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.874 [2024-11-21 03:44:29.370679] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.874 [2024-11-21 03:44:29.370691] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:48.874 [2024-11-21 03:44:29.370720] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.874 qpair failed and we were unable to recover it. 00:27:48.874 [2024-11-21 03:44:29.380564] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.874 [2024-11-21 03:44:29.380667] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.874 [2024-11-21 03:44:29.380693] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.874 [2024-11-21 03:44:29.380707] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.874 [2024-11-21 03:44:29.380720] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:48.874 [2024-11-21 03:44:29.380760] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.874 qpair failed and we were unable to recover it. 00:27:48.874 [2024-11-21 03:44:29.390567] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.874 [2024-11-21 03:44:29.390663] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.874 [2024-11-21 03:44:29.390688] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.874 [2024-11-21 03:44:29.390702] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.874 [2024-11-21 03:44:29.390717] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:48.874 [2024-11-21 03:44:29.390747] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.874 qpair failed and we were unable to recover it. 00:27:48.874 [2024-11-21 03:44:29.400616] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.874 [2024-11-21 03:44:29.400726] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.874 [2024-11-21 03:44:29.400752] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.874 [2024-11-21 03:44:29.400766] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.874 [2024-11-21 03:44:29.400779] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:48.874 [2024-11-21 03:44:29.400810] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.874 qpair failed and we were unable to recover it. 00:27:48.874 [2024-11-21 03:44:29.410654] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.874 [2024-11-21 03:44:29.410759] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.874 [2024-11-21 03:44:29.410785] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.874 [2024-11-21 03:44:29.410799] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.874 [2024-11-21 03:44:29.410812] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:48.874 [2024-11-21 03:44:29.410855] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.874 qpair failed and we were unable to recover it. 00:27:48.874 [2024-11-21 03:44:29.420655] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.874 [2024-11-21 03:44:29.420760] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.874 [2024-11-21 03:44:29.420785] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.874 [2024-11-21 03:44:29.420799] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.874 [2024-11-21 03:44:29.420812] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:48.874 [2024-11-21 03:44:29.420855] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.874 qpair failed and we were unable to recover it. 00:27:48.874 [2024-11-21 03:44:29.430659] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.874 [2024-11-21 03:44:29.430762] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.874 [2024-11-21 03:44:29.430787] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.874 [2024-11-21 03:44:29.430801] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.874 [2024-11-21 03:44:29.430814] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:48.874 [2024-11-21 03:44:29.430843] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.874 qpair failed and we were unable to recover it. 00:27:48.874 [2024-11-21 03:44:29.440708] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.874 [2024-11-21 03:44:29.440812] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.874 [2024-11-21 03:44:29.440841] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.874 [2024-11-21 03:44:29.440857] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.874 [2024-11-21 03:44:29.440870] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:48.874 [2024-11-21 03:44:29.440901] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.874 qpair failed and we were unable to recover it. 00:27:48.874 [2024-11-21 03:44:29.450753] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.874 [2024-11-21 03:44:29.450870] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.874 [2024-11-21 03:44:29.450895] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.874 [2024-11-21 03:44:29.450916] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.874 [2024-11-21 03:44:29.450930] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:48.874 [2024-11-21 03:44:29.450959] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.874 qpair failed and we were unable to recover it. 00:27:48.874 [2024-11-21 03:44:29.460761] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.874 [2024-11-21 03:44:29.460861] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.874 [2024-11-21 03:44:29.460886] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.874 [2024-11-21 03:44:29.460899] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.874 [2024-11-21 03:44:29.460912] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:48.874 [2024-11-21 03:44:29.460942] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.874 qpair failed and we were unable to recover it. 00:27:48.874 [2024-11-21 03:44:29.470777] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.874 [2024-11-21 03:44:29.470879] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.874 [2024-11-21 03:44:29.470905] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.874 [2024-11-21 03:44:29.470919] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.874 [2024-11-21 03:44:29.470931] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:48.874 [2024-11-21 03:44:29.470963] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.874 qpair failed and we were unable to recover it. 00:27:48.874 [2024-11-21 03:44:29.480816] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.874 [2024-11-21 03:44:29.480918] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.874 [2024-11-21 03:44:29.480946] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.874 [2024-11-21 03:44:29.480962] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.874 [2024-11-21 03:44:29.480975] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:48.874 [2024-11-21 03:44:29.481006] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.874 qpair failed and we were unable to recover it. 00:27:48.874 [2024-11-21 03:44:29.490853] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.874 [2024-11-21 03:44:29.490967] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.874 [2024-11-21 03:44:29.490992] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.874 [2024-11-21 03:44:29.491006] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.874 [2024-11-21 03:44:29.491019] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:48.874 [2024-11-21 03:44:29.491050] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.874 qpair failed and we were unable to recover it. 00:27:48.874 [2024-11-21 03:44:29.500877] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.874 [2024-11-21 03:44:29.501004] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.875 [2024-11-21 03:44:29.501029] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.875 [2024-11-21 03:44:29.501043] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.875 [2024-11-21 03:44:29.501055] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:48.875 [2024-11-21 03:44:29.501092] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.875 qpair failed and we were unable to recover it. 00:27:48.875 [2024-11-21 03:44:29.510910] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:48.875 [2024-11-21 03:44:29.511013] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:48.875 [2024-11-21 03:44:29.511041] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:48.875 [2024-11-21 03:44:29.511057] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:48.875 [2024-11-21 03:44:29.511078] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:48.875 [2024-11-21 03:44:29.511113] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:48.875 qpair failed and we were unable to recover it. 00:27:49.135 [2024-11-21 03:44:29.520921] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.135 [2024-11-21 03:44:29.521029] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.135 [2024-11-21 03:44:29.521055] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.135 [2024-11-21 03:44:29.521076] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.135 [2024-11-21 03:44:29.521091] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:49.135 [2024-11-21 03:44:29.521123] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.135 qpair failed and we were unable to recover it. 00:27:49.135 [2024-11-21 03:44:29.530968] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.135 [2024-11-21 03:44:29.531084] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.135 [2024-11-21 03:44:29.531110] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.135 [2024-11-21 03:44:29.531124] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.135 [2024-11-21 03:44:29.531137] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:49.135 [2024-11-21 03:44:29.531166] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.135 qpair failed and we were unable to recover it. 00:27:49.135 [2024-11-21 03:44:29.541073] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.135 [2024-11-21 03:44:29.541183] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.135 [2024-11-21 03:44:29.541213] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.135 [2024-11-21 03:44:29.541229] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.135 [2024-11-21 03:44:29.541242] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:49.135 [2024-11-21 03:44:29.541271] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.135 qpair failed and we were unable to recover it. 00:27:49.135 [2024-11-21 03:44:29.551000] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.135 [2024-11-21 03:44:29.551110] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.135 [2024-11-21 03:44:29.551137] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.135 [2024-11-21 03:44:29.551151] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.135 [2024-11-21 03:44:29.551164] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:49.135 [2024-11-21 03:44:29.551196] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.135 qpair failed and we were unable to recover it. 00:27:49.135 [2024-11-21 03:44:29.561049] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.135 [2024-11-21 03:44:29.561179] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.135 [2024-11-21 03:44:29.561205] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.135 [2024-11-21 03:44:29.561219] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.135 [2024-11-21 03:44:29.561232] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:49.135 [2024-11-21 03:44:29.561264] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.135 qpair failed and we were unable to recover it. 00:27:49.135 [2024-11-21 03:44:29.571107] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.135 [2024-11-21 03:44:29.571230] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.135 [2024-11-21 03:44:29.571256] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.135 [2024-11-21 03:44:29.571270] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.135 [2024-11-21 03:44:29.571283] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:49.135 [2024-11-21 03:44:29.571312] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.136 qpair failed and we were unable to recover it. 00:27:49.136 [2024-11-21 03:44:29.581106] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.136 [2024-11-21 03:44:29.581219] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.136 [2024-11-21 03:44:29.581244] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.136 [2024-11-21 03:44:29.581259] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.136 [2024-11-21 03:44:29.581271] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:49.136 [2024-11-21 03:44:29.581309] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.136 qpair failed and we were unable to recover it. 00:27:49.136 [2024-11-21 03:44:29.591156] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.136 [2024-11-21 03:44:29.591275] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.136 [2024-11-21 03:44:29.591301] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.136 [2024-11-21 03:44:29.591314] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.136 [2024-11-21 03:44:29.591327] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:49.136 [2024-11-21 03:44:29.591357] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.136 qpair failed and we were unable to recover it. 00:27:49.136 [2024-11-21 03:44:29.601230] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.136 [2024-11-21 03:44:29.601335] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.136 [2024-11-21 03:44:29.601361] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.136 [2024-11-21 03:44:29.601376] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.136 [2024-11-21 03:44:29.601389] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:49.136 [2024-11-21 03:44:29.601419] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.136 qpair failed and we were unable to recover it. 00:27:49.136 [2024-11-21 03:44:29.611185] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.136 [2024-11-21 03:44:29.611290] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.136 [2024-11-21 03:44:29.611316] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.136 [2024-11-21 03:44:29.611330] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.136 [2024-11-21 03:44:29.611343] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:49.136 [2024-11-21 03:44:29.611372] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.136 qpair failed and we were unable to recover it. 00:27:49.136 [2024-11-21 03:44:29.621281] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.136 [2024-11-21 03:44:29.621389] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.136 [2024-11-21 03:44:29.621415] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.136 [2024-11-21 03:44:29.621430] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.136 [2024-11-21 03:44:29.621443] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:49.136 [2024-11-21 03:44:29.621487] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.136 qpair failed and we were unable to recover it. 00:27:49.136 [2024-11-21 03:44:29.631256] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.136 [2024-11-21 03:44:29.631359] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.136 [2024-11-21 03:44:29.631389] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.136 [2024-11-21 03:44:29.631404] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.136 [2024-11-21 03:44:29.631417] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:49.136 [2024-11-21 03:44:29.631447] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.136 qpair failed and we were unable to recover it. 00:27:49.136 [2024-11-21 03:44:29.641328] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.136 [2024-11-21 03:44:29.641442] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.136 [2024-11-21 03:44:29.641469] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.136 [2024-11-21 03:44:29.641484] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.136 [2024-11-21 03:44:29.641496] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:49.136 [2024-11-21 03:44:29.641525] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.136 qpair failed and we were unable to recover it. 00:27:49.136 [2024-11-21 03:44:29.651352] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.136 [2024-11-21 03:44:29.651476] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.136 [2024-11-21 03:44:29.651500] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.136 [2024-11-21 03:44:29.651514] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.136 [2024-11-21 03:44:29.651527] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:49.136 [2024-11-21 03:44:29.651556] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.136 qpair failed and we were unable to recover it. 00:27:49.136 [2024-11-21 03:44:29.661340] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.136 [2024-11-21 03:44:29.661444] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.136 [2024-11-21 03:44:29.661469] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.136 [2024-11-21 03:44:29.661483] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.136 [2024-11-21 03:44:29.661496] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:49.136 [2024-11-21 03:44:29.661525] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.136 qpair failed and we were unable to recover it. 00:27:49.136 [2024-11-21 03:44:29.671386] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.136 [2024-11-21 03:44:29.671495] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.136 [2024-11-21 03:44:29.671520] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.136 [2024-11-21 03:44:29.671535] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.136 [2024-11-21 03:44:29.671547] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:49.136 [2024-11-21 03:44:29.671586] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.136 qpair failed and we were unable to recover it. 00:27:49.136 [2024-11-21 03:44:29.681422] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.136 [2024-11-21 03:44:29.681528] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.136 [2024-11-21 03:44:29.681554] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.136 [2024-11-21 03:44:29.681569] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.136 [2024-11-21 03:44:29.681582] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:49.136 [2024-11-21 03:44:29.681611] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.136 qpair failed and we were unable to recover it. 00:27:49.136 [2024-11-21 03:44:29.691427] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.136 [2024-11-21 03:44:29.691584] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.136 [2024-11-21 03:44:29.691609] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.136 [2024-11-21 03:44:29.691624] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.136 [2024-11-21 03:44:29.691637] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:49.136 [2024-11-21 03:44:29.691665] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.136 qpair failed and we were unable to recover it. 00:27:49.136 [2024-11-21 03:44:29.701531] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.136 [2024-11-21 03:44:29.701632] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.136 [2024-11-21 03:44:29.701657] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.136 [2024-11-21 03:44:29.701672] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.136 [2024-11-21 03:44:29.701684] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:49.136 [2024-11-21 03:44:29.701714] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.136 qpair failed and we were unable to recover it. 00:27:49.136 [2024-11-21 03:44:29.711471] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.136 [2024-11-21 03:44:29.711570] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.136 [2024-11-21 03:44:29.711595] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.137 [2024-11-21 03:44:29.711609] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.137 [2024-11-21 03:44:29.711621] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:49.137 [2024-11-21 03:44:29.711650] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.137 qpair failed and we were unable to recover it. 00:27:49.137 [2024-11-21 03:44:29.721507] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.137 [2024-11-21 03:44:29.721614] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.137 [2024-11-21 03:44:29.721643] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.137 [2024-11-21 03:44:29.721658] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.137 [2024-11-21 03:44:29.721671] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:49.137 [2024-11-21 03:44:29.721712] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.137 qpair failed and we were unable to recover it. 00:27:49.137 [2024-11-21 03:44:29.731541] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.137 [2024-11-21 03:44:29.731645] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.137 [2024-11-21 03:44:29.731670] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.137 [2024-11-21 03:44:29.731684] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.137 [2024-11-21 03:44:29.731697] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:49.137 [2024-11-21 03:44:29.731726] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.137 qpair failed and we were unable to recover it. 00:27:49.137 [2024-11-21 03:44:29.741539] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.137 [2024-11-21 03:44:29.741641] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.137 [2024-11-21 03:44:29.741666] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.137 [2024-11-21 03:44:29.741680] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.137 [2024-11-21 03:44:29.741695] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:49.137 [2024-11-21 03:44:29.741725] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.137 qpair failed and we were unable to recover it. 00:27:49.137 [2024-11-21 03:44:29.751581] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.137 [2024-11-21 03:44:29.751738] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.137 [2024-11-21 03:44:29.751762] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.137 [2024-11-21 03:44:29.751775] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.137 [2024-11-21 03:44:29.751787] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:49.137 [2024-11-21 03:44:29.751816] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.137 qpair failed and we were unable to recover it. 00:27:49.137 [2024-11-21 03:44:29.761690] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.137 [2024-11-21 03:44:29.761807] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.137 [2024-11-21 03:44:29.761833] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.137 [2024-11-21 03:44:29.761847] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.137 [2024-11-21 03:44:29.761866] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:49.137 [2024-11-21 03:44:29.761897] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.137 qpair failed and we were unable to recover it. 00:27:49.137 [2024-11-21 03:44:29.771661] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.137 [2024-11-21 03:44:29.771814] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.137 [2024-11-21 03:44:29.771839] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.137 [2024-11-21 03:44:29.771853] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.137 [2024-11-21 03:44:29.771867] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:49.137 [2024-11-21 03:44:29.771908] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.137 qpair failed and we were unable to recover it. 00:27:49.399 [2024-11-21 03:44:29.781710] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.399 [2024-11-21 03:44:29.781812] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.399 [2024-11-21 03:44:29.781838] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.399 [2024-11-21 03:44:29.781852] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.399 [2024-11-21 03:44:29.781865] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:49.399 [2024-11-21 03:44:29.781894] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.399 qpair failed and we were unable to recover it. 00:27:49.399 [2024-11-21 03:44:29.791715] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.399 [2024-11-21 03:44:29.791823] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.399 [2024-11-21 03:44:29.791848] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.399 [2024-11-21 03:44:29.791861] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.399 [2024-11-21 03:44:29.791874] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:49.399 [2024-11-21 03:44:29.791903] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.399 qpair failed and we were unable to recover it. 00:27:49.399 [2024-11-21 03:44:29.801742] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.399 [2024-11-21 03:44:29.801854] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.399 [2024-11-21 03:44:29.801887] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.399 [2024-11-21 03:44:29.801903] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.399 [2024-11-21 03:44:29.801916] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:49.399 [2024-11-21 03:44:29.801946] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.399 qpair failed and we were unable to recover it. 00:27:49.399 [2024-11-21 03:44:29.811789] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.399 [2024-11-21 03:44:29.811911] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.399 [2024-11-21 03:44:29.811937] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.399 [2024-11-21 03:44:29.811951] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.399 [2024-11-21 03:44:29.811966] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:49.399 [2024-11-21 03:44:29.811998] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.399 qpair failed and we were unable to recover it. 00:27:49.399 [2024-11-21 03:44:29.821810] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.399 [2024-11-21 03:44:29.821917] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.399 [2024-11-21 03:44:29.821942] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.399 [2024-11-21 03:44:29.821956] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.399 [2024-11-21 03:44:29.821969] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:49.400 [2024-11-21 03:44:29.822010] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.400 qpair failed and we were unable to recover it. 00:27:49.400 [2024-11-21 03:44:29.831844] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.400 [2024-11-21 03:44:29.831965] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.400 [2024-11-21 03:44:29.831991] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.400 [2024-11-21 03:44:29.832005] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.400 [2024-11-21 03:44:29.832018] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:49.400 [2024-11-21 03:44:29.832047] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.400 qpair failed and we were unable to recover it. 00:27:49.400 [2024-11-21 03:44:29.841842] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.400 [2024-11-21 03:44:29.841948] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.400 [2024-11-21 03:44:29.841973] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.400 [2024-11-21 03:44:29.841988] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.400 [2024-11-21 03:44:29.842001] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:49.400 [2024-11-21 03:44:29.842032] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.400 qpair failed and we were unable to recover it. 00:27:49.400 [2024-11-21 03:44:29.851878] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.400 [2024-11-21 03:44:29.851986] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.400 [2024-11-21 03:44:29.852011] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.400 [2024-11-21 03:44:29.852032] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.400 [2024-11-21 03:44:29.852046] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:49.400 [2024-11-21 03:44:29.852084] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.400 qpair failed and we were unable to recover it. 00:27:49.400 [2024-11-21 03:44:29.861878] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.400 [2024-11-21 03:44:29.862009] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.400 [2024-11-21 03:44:29.862034] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.400 [2024-11-21 03:44:29.862048] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.400 [2024-11-21 03:44:29.862061] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:49.400 [2024-11-21 03:44:29.862098] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.400 qpair failed and we were unable to recover it. 00:27:49.400 [2024-11-21 03:44:29.871958] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.400 [2024-11-21 03:44:29.872052] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.400 [2024-11-21 03:44:29.872089] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.400 [2024-11-21 03:44:29.872105] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.400 [2024-11-21 03:44:29.872117] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:49.400 [2024-11-21 03:44:29.872149] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.400 qpair failed and we were unable to recover it. 00:27:49.400 [2024-11-21 03:44:29.881961] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.400 [2024-11-21 03:44:29.882077] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.400 [2024-11-21 03:44:29.882102] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.400 [2024-11-21 03:44:29.882117] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.400 [2024-11-21 03:44:29.882130] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:49.400 [2024-11-21 03:44:29.882159] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.400 qpair failed and we were unable to recover it. 00:27:49.400 [2024-11-21 03:44:29.891979] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.400 [2024-11-21 03:44:29.892090] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.400 [2024-11-21 03:44:29.892116] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.400 [2024-11-21 03:44:29.892130] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.400 [2024-11-21 03:44:29.892142] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:49.400 [2024-11-21 03:44:29.892173] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.400 qpair failed and we were unable to recover it. 00:27:49.400 [2024-11-21 03:44:29.902088] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.400 [2024-11-21 03:44:29.902217] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.400 [2024-11-21 03:44:29.902266] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.400 [2024-11-21 03:44:29.902282] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.400 [2024-11-21 03:44:29.902295] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:49.400 [2024-11-21 03:44:29.902338] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:49.400 qpair failed and we were unable to recover it. 00:27:49.400 [2024-11-21 03:44:29.912075] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.400 [2024-11-21 03:44:29.912181] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.400 [2024-11-21 03:44:29.912213] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.400 [2024-11-21 03:44:29.912229] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.400 [2024-11-21 03:44:29.912242] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:49.400 [2024-11-21 03:44:29.912273] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:49.400 qpair failed and we were unable to recover it. 00:27:49.400 [2024-11-21 03:44:29.922103] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.400 [2024-11-21 03:44:29.922237] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.400 [2024-11-21 03:44:29.922265] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.400 [2024-11-21 03:44:29.922279] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.400 [2024-11-21 03:44:29.922292] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:49.400 [2024-11-21 03:44:29.922324] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:49.400 qpair failed and we were unable to recover it. 00:27:49.400 [2024-11-21 03:44:29.932114] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.400 [2024-11-21 03:44:29.932219] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.400 [2024-11-21 03:44:29.932246] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.400 [2024-11-21 03:44:29.932261] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.400 [2024-11-21 03:44:29.932274] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:49.400 [2024-11-21 03:44:29.932305] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:49.400 qpair failed and we were unable to recover it. 00:27:49.400 [2024-11-21 03:44:29.942128] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.400 [2024-11-21 03:44:29.942270] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.400 [2024-11-21 03:44:29.942296] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.400 [2024-11-21 03:44:29.942317] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.400 [2024-11-21 03:44:29.942331] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:49.400 [2024-11-21 03:44:29.942363] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:49.400 qpair failed and we were unable to recover it. 00:27:49.400 [2024-11-21 03:44:29.952165] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.400 [2024-11-21 03:44:29.952269] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.400 [2024-11-21 03:44:29.952296] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.400 [2024-11-21 03:44:29.952310] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.400 [2024-11-21 03:44:29.952324] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:49.400 [2024-11-21 03:44:29.952355] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:49.400 qpair failed and we were unable to recover it. 00:27:49.400 [2024-11-21 03:44:29.962185] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.401 [2024-11-21 03:44:29.962284] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.401 [2024-11-21 03:44:29.962310] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.401 [2024-11-21 03:44:29.962324] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.401 [2024-11-21 03:44:29.962337] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:49.401 [2024-11-21 03:44:29.962367] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:49.401 qpair failed and we were unable to recover it. 00:27:49.401 [2024-11-21 03:44:29.972244] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.401 [2024-11-21 03:44:29.972354] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.401 [2024-11-21 03:44:29.972380] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.401 [2024-11-21 03:44:29.972395] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.401 [2024-11-21 03:44:29.972408] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:49.401 [2024-11-21 03:44:29.972438] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:49.401 qpair failed and we were unable to recover it. 00:27:49.401 [2024-11-21 03:44:29.982282] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.401 [2024-11-21 03:44:29.982392] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.401 [2024-11-21 03:44:29.982419] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.401 [2024-11-21 03:44:29.982434] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.401 [2024-11-21 03:44:29.982448] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:49.401 [2024-11-21 03:44:29.982478] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:49.401 qpair failed and we were unable to recover it. 00:27:49.401 [2024-11-21 03:44:29.992309] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.401 [2024-11-21 03:44:29.992413] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.401 [2024-11-21 03:44:29.992439] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.401 [2024-11-21 03:44:29.992453] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.401 [2024-11-21 03:44:29.992466] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:49.401 [2024-11-21 03:44:29.992495] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:49.401 qpair failed and we were unable to recover it. 00:27:49.401 [2024-11-21 03:44:30.002341] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.401 [2024-11-21 03:44:30.002446] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.401 [2024-11-21 03:44:30.002471] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.401 [2024-11-21 03:44:30.002486] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.401 [2024-11-21 03:44:30.002499] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:49.401 [2024-11-21 03:44:30.002531] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:49.401 qpair failed and we were unable to recover it. 00:27:49.401 [2024-11-21 03:44:30.012451] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.401 [2024-11-21 03:44:30.012566] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.401 [2024-11-21 03:44:30.012594] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.401 [2024-11-21 03:44:30.012616] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.401 [2024-11-21 03:44:30.012638] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:49.401 [2024-11-21 03:44:30.012678] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:49.401 qpair failed and we were unable to recover it. 00:27:49.401 [2024-11-21 03:44:30.022413] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.401 [2024-11-21 03:44:30.022539] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.401 [2024-11-21 03:44:30.022573] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.401 [2024-11-21 03:44:30.022597] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.401 [2024-11-21 03:44:30.022619] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:49.401 [2024-11-21 03:44:30.022663] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:49.401 qpair failed and we were unable to recover it. 00:27:49.401 [2024-11-21 03:44:30.032444] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.401 [2024-11-21 03:44:30.032574] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.401 [2024-11-21 03:44:30.032619] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.401 [2024-11-21 03:44:30.032642] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.401 [2024-11-21 03:44:30.032662] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:49.401 [2024-11-21 03:44:30.032708] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:49.401 qpair failed and we were unable to recover it. 00:27:49.401 [2024-11-21 03:44:30.042491] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.401 [2024-11-21 03:44:30.042645] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.401 [2024-11-21 03:44:30.042679] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.401 [2024-11-21 03:44:30.042701] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.401 [2024-11-21 03:44:30.042723] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:49.401 [2024-11-21 03:44:30.042799] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:49.401 qpair failed and we were unable to recover it. 00:27:49.659 [2024-11-21 03:44:30.052504] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.659 [2024-11-21 03:44:30.052621] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.659 [2024-11-21 03:44:30.052649] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.659 [2024-11-21 03:44:30.052664] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.659 [2024-11-21 03:44:30.052677] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:49.659 [2024-11-21 03:44:30.052709] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:49.659 qpair failed and we were unable to recover it. 00:27:49.659 [2024-11-21 03:44:30.062569] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.659 [2024-11-21 03:44:30.062709] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.659 [2024-11-21 03:44:30.062735] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.659 [2024-11-21 03:44:30.062750] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.659 [2024-11-21 03:44:30.062762] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:49.659 [2024-11-21 03:44:30.062793] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:49.659 qpair failed and we were unable to recover it. 00:27:49.659 [2024-11-21 03:44:30.072533] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.659 [2024-11-21 03:44:30.072666] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.659 [2024-11-21 03:44:30.072694] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.659 [2024-11-21 03:44:30.072708] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.659 [2024-11-21 03:44:30.072721] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:49.659 [2024-11-21 03:44:30.072757] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:49.659 qpair failed and we were unable to recover it. 00:27:49.659 [2024-11-21 03:44:30.082524] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.659 [2024-11-21 03:44:30.082624] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.659 [2024-11-21 03:44:30.082650] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.659 [2024-11-21 03:44:30.082664] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.659 [2024-11-21 03:44:30.082676] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:49.659 [2024-11-21 03:44:30.082708] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:49.659 qpair failed and we were unable to recover it. 00:27:49.659 [2024-11-21 03:44:30.092589] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.659 [2024-11-21 03:44:30.092716] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.659 [2024-11-21 03:44:30.092743] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.659 [2024-11-21 03:44:30.092758] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.659 [2024-11-21 03:44:30.092771] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:49.659 [2024-11-21 03:44:30.092801] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:49.659 qpair failed and we were unable to recover it. 00:27:49.659 [2024-11-21 03:44:30.102640] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.659 [2024-11-21 03:44:30.102785] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.659 [2024-11-21 03:44:30.102811] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.659 [2024-11-21 03:44:30.102826] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.659 [2024-11-21 03:44:30.102839] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:49.660 [2024-11-21 03:44:30.102868] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:49.660 qpair failed and we were unable to recover it. 00:27:49.660 [2024-11-21 03:44:30.112655] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.660 [2024-11-21 03:44:30.112792] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.660 [2024-11-21 03:44:30.112819] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.660 [2024-11-21 03:44:30.112833] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.660 [2024-11-21 03:44:30.112846] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:49.660 [2024-11-21 03:44:30.112887] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:49.660 qpair failed and we were unable to recover it. 00:27:49.660 [2024-11-21 03:44:30.122659] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.660 [2024-11-21 03:44:30.122774] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.660 [2024-11-21 03:44:30.122806] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.660 [2024-11-21 03:44:30.122822] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.660 [2024-11-21 03:44:30.122834] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:49.660 [2024-11-21 03:44:30.122864] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:49.660 qpair failed and we were unable to recover it. 00:27:49.660 [2024-11-21 03:44:30.132719] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.660 [2024-11-21 03:44:30.132883] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.660 [2024-11-21 03:44:30.132910] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.660 [2024-11-21 03:44:30.132924] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.660 [2024-11-21 03:44:30.132938] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:49.660 [2024-11-21 03:44:30.132968] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:49.660 qpair failed and we were unable to recover it. 00:27:49.660 [2024-11-21 03:44:30.142765] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.660 [2024-11-21 03:44:30.142877] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.660 [2024-11-21 03:44:30.142903] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.660 [2024-11-21 03:44:30.142917] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.660 [2024-11-21 03:44:30.142930] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:49.660 [2024-11-21 03:44:30.142962] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:49.660 qpair failed and we were unable to recover it. 00:27:49.660 [2024-11-21 03:44:30.152737] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.660 [2024-11-21 03:44:30.152883] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.660 [2024-11-21 03:44:30.152908] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.660 [2024-11-21 03:44:30.152922] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.660 [2024-11-21 03:44:30.152935] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:49.660 [2024-11-21 03:44:30.152964] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:49.660 qpair failed and we were unable to recover it. 00:27:49.660 [2024-11-21 03:44:30.162748] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.660 [2024-11-21 03:44:30.162853] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.660 [2024-11-21 03:44:30.162878] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.660 [2024-11-21 03:44:30.162892] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.660 [2024-11-21 03:44:30.162905] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:49.660 [2024-11-21 03:44:30.162941] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:49.660 qpair failed and we were unable to recover it. 00:27:49.660 [2024-11-21 03:44:30.172880] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.660 [2024-11-21 03:44:30.173000] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.660 [2024-11-21 03:44:30.173026] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.660 [2024-11-21 03:44:30.173041] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.660 [2024-11-21 03:44:30.173053] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:49.660 [2024-11-21 03:44:30.173094] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:49.660 qpair failed and we were unable to recover it. 00:27:49.660 [2024-11-21 03:44:30.182816] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.660 [2024-11-21 03:44:30.182943] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.660 [2024-11-21 03:44:30.182968] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.660 [2024-11-21 03:44:30.182982] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.660 [2024-11-21 03:44:30.182994] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:49.660 [2024-11-21 03:44:30.183024] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:49.660 qpair failed and we were unable to recover it. 00:27:49.660 [2024-11-21 03:44:30.192837] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.660 [2024-11-21 03:44:30.192972] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.660 [2024-11-21 03:44:30.192997] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.660 [2024-11-21 03:44:30.193011] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.660 [2024-11-21 03:44:30.193024] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:49.660 [2024-11-21 03:44:30.193054] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:49.660 qpair failed and we were unable to recover it. 00:27:49.660 [2024-11-21 03:44:30.202863] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.660 [2024-11-21 03:44:30.202984] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.660 [2024-11-21 03:44:30.203009] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.660 [2024-11-21 03:44:30.203023] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.660 [2024-11-21 03:44:30.203036] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:49.660 [2024-11-21 03:44:30.203065] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:49.660 qpair failed and we were unable to recover it. 00:27:49.660 [2024-11-21 03:44:30.212908] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.660 [2024-11-21 03:44:30.213034] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.660 [2024-11-21 03:44:30.213074] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.660 [2024-11-21 03:44:30.213092] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.660 [2024-11-21 03:44:30.213108] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:49.660 [2024-11-21 03:44:30.213139] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:49.660 qpair failed and we were unable to recover it. 00:27:49.660 [2024-11-21 03:44:30.222909] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.660 [2024-11-21 03:44:30.223023] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.660 [2024-11-21 03:44:30.223049] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.660 [2024-11-21 03:44:30.223063] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.660 [2024-11-21 03:44:30.223085] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:49.660 [2024-11-21 03:44:30.223117] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:49.660 qpair failed and we were unable to recover it. 00:27:49.660 [2024-11-21 03:44:30.232960] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.660 [2024-11-21 03:44:30.233063] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.660 [2024-11-21 03:44:30.233096] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.660 [2024-11-21 03:44:30.233111] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.660 [2024-11-21 03:44:30.233124] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:49.660 [2024-11-21 03:44:30.233166] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:49.660 qpair failed and we were unable to recover it. 00:27:49.660 [2024-11-21 03:44:30.242970] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.660 [2024-11-21 03:44:30.243079] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.660 [2024-11-21 03:44:30.243105] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.660 [2024-11-21 03:44:30.243119] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.660 [2024-11-21 03:44:30.243132] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:49.660 [2024-11-21 03:44:30.243164] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:49.660 qpair failed and we were unable to recover it. 00:27:49.660 [2024-11-21 03:44:30.253019] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.660 [2024-11-21 03:44:30.253137] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.660 [2024-11-21 03:44:30.253162] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.660 [2024-11-21 03:44:30.253177] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.660 [2024-11-21 03:44:30.253196] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:49.660 [2024-11-21 03:44:30.253226] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:49.660 qpair failed and we were unable to recover it. 00:27:49.660 [2024-11-21 03:44:30.263017] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.660 [2024-11-21 03:44:30.263132] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.660 [2024-11-21 03:44:30.263158] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.660 [2024-11-21 03:44:30.263172] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.660 [2024-11-21 03:44:30.263184] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:49.660 [2024-11-21 03:44:30.263214] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:49.660 qpair failed and we were unable to recover it. 00:27:49.660 [2024-11-21 03:44:30.273148] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.660 [2024-11-21 03:44:30.273285] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.660 [2024-11-21 03:44:30.273312] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.660 [2024-11-21 03:44:30.273326] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.660 [2024-11-21 03:44:30.273341] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:49.660 [2024-11-21 03:44:30.273372] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:49.660 qpair failed and we were unable to recover it. 00:27:49.660 [2024-11-21 03:44:30.283106] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.660 [2024-11-21 03:44:30.283215] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.660 [2024-11-21 03:44:30.283241] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.660 [2024-11-21 03:44:30.283255] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.660 [2024-11-21 03:44:30.283268] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:49.660 [2024-11-21 03:44:30.283298] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:49.660 qpair failed and we were unable to recover it. 00:27:49.660 [2024-11-21 03:44:30.293135] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.660 [2024-11-21 03:44:30.293251] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.660 [2024-11-21 03:44:30.293278] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.660 [2024-11-21 03:44:30.293292] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.660 [2024-11-21 03:44:30.293305] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:49.660 [2024-11-21 03:44:30.293359] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:49.660 qpair failed and we were unable to recover it. 00:27:49.660 [2024-11-21 03:44:30.303148] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.660 [2024-11-21 03:44:30.303272] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.660 [2024-11-21 03:44:30.303298] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.660 [2024-11-21 03:44:30.303313] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.660 [2024-11-21 03:44:30.303326] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:49.660 [2024-11-21 03:44:30.303355] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:49.660 qpair failed and we were unable to recover it. 00:27:49.918 [2024-11-21 03:44:30.313190] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.918 [2024-11-21 03:44:30.313316] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.918 [2024-11-21 03:44:30.313343] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.918 [2024-11-21 03:44:30.313357] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.918 [2024-11-21 03:44:30.313370] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:49.918 [2024-11-21 03:44:30.313399] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:49.918 qpair failed and we were unable to recover it. 00:27:49.918 [2024-11-21 03:44:30.323188] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.918 [2024-11-21 03:44:30.323316] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.918 [2024-11-21 03:44:30.323341] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.918 [2024-11-21 03:44:30.323355] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.918 [2024-11-21 03:44:30.323368] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:49.918 [2024-11-21 03:44:30.323398] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:49.918 qpair failed and we were unable to recover it. 00:27:49.918 [2024-11-21 03:44:30.333364] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.919 [2024-11-21 03:44:30.333469] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.919 [2024-11-21 03:44:30.333495] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.919 [2024-11-21 03:44:30.333509] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.919 [2024-11-21 03:44:30.333521] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:49.919 [2024-11-21 03:44:30.333551] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:49.919 qpair failed and we were unable to recover it. 00:27:49.919 [2024-11-21 03:44:30.343271] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.919 [2024-11-21 03:44:30.343399] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.919 [2024-11-21 03:44:30.343424] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.919 [2024-11-21 03:44:30.343438] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.919 [2024-11-21 03:44:30.343457] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:49.919 [2024-11-21 03:44:30.343487] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:49.919 qpair failed and we were unable to recover it. 00:27:49.919 [2024-11-21 03:44:30.353298] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.919 [2024-11-21 03:44:30.353406] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.919 [2024-11-21 03:44:30.353433] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.919 [2024-11-21 03:44:30.353447] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.919 [2024-11-21 03:44:30.353460] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:49.919 [2024-11-21 03:44:30.353501] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:49.919 qpair failed and we were unable to recover it. 00:27:49.919 [2024-11-21 03:44:30.363318] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.919 [2024-11-21 03:44:30.363428] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.919 [2024-11-21 03:44:30.363454] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.919 [2024-11-21 03:44:30.363468] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.919 [2024-11-21 03:44:30.363481] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:49.919 [2024-11-21 03:44:30.363510] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:49.919 qpair failed and we were unable to recover it. 00:27:49.919 [2024-11-21 03:44:30.373417] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.919 [2024-11-21 03:44:30.373569] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.919 [2024-11-21 03:44:30.373595] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.919 [2024-11-21 03:44:30.373609] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.919 [2024-11-21 03:44:30.373622] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:49.919 [2024-11-21 03:44:30.373663] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:49.919 qpair failed and we were unable to recover it. 00:27:49.919 [2024-11-21 03:44:30.383366] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.919 [2024-11-21 03:44:30.383470] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.919 [2024-11-21 03:44:30.383496] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.919 [2024-11-21 03:44:30.383511] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.919 [2024-11-21 03:44:30.383525] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:49.919 [2024-11-21 03:44:30.383556] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:49.919 qpair failed and we were unable to recover it. 00:27:49.919 [2024-11-21 03:44:30.393432] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.919 [2024-11-21 03:44:30.393580] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.919 [2024-11-21 03:44:30.393606] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.919 [2024-11-21 03:44:30.393620] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.919 [2024-11-21 03:44:30.393633] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:49.919 [2024-11-21 03:44:30.393664] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:49.919 qpair failed and we were unable to recover it. 00:27:49.919 [2024-11-21 03:44:30.403466] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.919 [2024-11-21 03:44:30.403599] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.919 [2024-11-21 03:44:30.403625] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.919 [2024-11-21 03:44:30.403640] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.919 [2024-11-21 03:44:30.403652] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:49.919 [2024-11-21 03:44:30.403682] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:49.919 qpair failed and we were unable to recover it. 00:27:49.919 [2024-11-21 03:44:30.413517] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.919 [2024-11-21 03:44:30.413657] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.919 [2024-11-21 03:44:30.413683] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.919 [2024-11-21 03:44:30.413697] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.919 [2024-11-21 03:44:30.413710] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:49.919 [2024-11-21 03:44:30.413740] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:49.919 qpair failed and we were unable to recover it. 00:27:49.919 [2024-11-21 03:44:30.423506] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.919 [2024-11-21 03:44:30.423618] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.919 [2024-11-21 03:44:30.423647] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.919 [2024-11-21 03:44:30.423664] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.919 [2024-11-21 03:44:30.423678] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:49.919 [2024-11-21 03:44:30.423723] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:49.919 qpair failed and we were unable to recover it. 00:27:49.919 [2024-11-21 03:44:30.433576] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.919 [2024-11-21 03:44:30.433684] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.919 [2024-11-21 03:44:30.433713] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.919 [2024-11-21 03:44:30.433733] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.919 [2024-11-21 03:44:30.433747] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:49.919 [2024-11-21 03:44:30.433779] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:49.919 qpair failed and we were unable to recover it. 00:27:49.919 [2024-11-21 03:44:30.443545] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.919 [2024-11-21 03:44:30.443647] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.919 [2024-11-21 03:44:30.443672] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.919 [2024-11-21 03:44:30.443686] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.919 [2024-11-21 03:44:30.443698] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:49.919 [2024-11-21 03:44:30.443728] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:49.919 qpair failed and we were unable to recover it. 00:27:49.919 [2024-11-21 03:44:30.453621] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.919 [2024-11-21 03:44:30.453732] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.919 [2024-11-21 03:44:30.453758] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.919 [2024-11-21 03:44:30.453772] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.919 [2024-11-21 03:44:30.453784] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:49.919 [2024-11-21 03:44:30.453814] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:49.919 qpair failed and we were unable to recover it. 00:27:49.919 [2024-11-21 03:44:30.463647] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.919 [2024-11-21 03:44:30.463766] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.919 [2024-11-21 03:44:30.463792] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.919 [2024-11-21 03:44:30.463806] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.919 [2024-11-21 03:44:30.463819] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:49.919 [2024-11-21 03:44:30.463848] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:49.919 qpair failed and we were unable to recover it. 00:27:49.919 [2024-11-21 03:44:30.473675] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.919 [2024-11-21 03:44:30.473775] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.919 [2024-11-21 03:44:30.473801] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.919 [2024-11-21 03:44:30.473815] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.919 [2024-11-21 03:44:30.473828] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:49.919 [2024-11-21 03:44:30.473860] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:49.919 qpair failed and we were unable to recover it. 00:27:49.919 [2024-11-21 03:44:30.483687] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.919 [2024-11-21 03:44:30.483814] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.919 [2024-11-21 03:44:30.483840] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.919 [2024-11-21 03:44:30.483853] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.919 [2024-11-21 03:44:30.483866] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:49.920 [2024-11-21 03:44:30.483896] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:49.920 qpair failed and we were unable to recover it. 00:27:49.920 [2024-11-21 03:44:30.493776] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.920 [2024-11-21 03:44:30.493926] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.920 [2024-11-21 03:44:30.493951] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.920 [2024-11-21 03:44:30.493965] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.920 [2024-11-21 03:44:30.493977] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:49.920 [2024-11-21 03:44:30.494009] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:49.920 qpair failed and we were unable to recover it. 00:27:49.920 [2024-11-21 03:44:30.503769] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.920 [2024-11-21 03:44:30.503870] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.920 [2024-11-21 03:44:30.503896] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.920 [2024-11-21 03:44:30.503910] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.920 [2024-11-21 03:44:30.503925] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:49.920 [2024-11-21 03:44:30.503955] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:49.920 qpair failed and we were unable to recover it. 00:27:49.920 [2024-11-21 03:44:30.513769] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.920 [2024-11-21 03:44:30.513866] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.920 [2024-11-21 03:44:30.513891] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.920 [2024-11-21 03:44:30.513905] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.920 [2024-11-21 03:44:30.513918] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:49.920 [2024-11-21 03:44:30.513949] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:49.920 qpair failed and we were unable to recover it. 00:27:49.920 [2024-11-21 03:44:30.523799] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.920 [2024-11-21 03:44:30.523897] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.920 [2024-11-21 03:44:30.523931] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.920 [2024-11-21 03:44:30.523946] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.920 [2024-11-21 03:44:30.523959] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:49.920 [2024-11-21 03:44:30.523988] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:49.920 qpair failed and we were unable to recover it. 00:27:49.920 [2024-11-21 03:44:30.533862] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.920 [2024-11-21 03:44:30.533969] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.920 [2024-11-21 03:44:30.533994] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.920 [2024-11-21 03:44:30.534009] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.920 [2024-11-21 03:44:30.534021] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:49.920 [2024-11-21 03:44:30.534050] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:49.920 qpair failed and we were unable to recover it. 00:27:49.920 [2024-11-21 03:44:30.543883] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.920 [2024-11-21 03:44:30.543991] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.920 [2024-11-21 03:44:30.544016] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.920 [2024-11-21 03:44:30.544031] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.920 [2024-11-21 03:44:30.544044] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:49.920 [2024-11-21 03:44:30.544080] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:49.920 qpair failed and we were unable to recover it. 00:27:49.920 [2024-11-21 03:44:30.553909] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:49.920 [2024-11-21 03:44:30.554030] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:49.920 [2024-11-21 03:44:30.554056] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:49.920 [2024-11-21 03:44:30.554080] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:49.920 [2024-11-21 03:44:30.554095] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:49.920 [2024-11-21 03:44:30.554138] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:49.920 qpair failed and we were unable to recover it. 00:27:50.179 [2024-11-21 03:44:30.563952] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.179 [2024-11-21 03:44:30.564098] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.179 [2024-11-21 03:44:30.564125] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.179 [2024-11-21 03:44:30.564139] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.179 [2024-11-21 03:44:30.564151] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.179 [2024-11-21 03:44:30.564182] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.179 qpair failed and we were unable to recover it. 00:27:50.179 [2024-11-21 03:44:30.573954] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.179 [2024-11-21 03:44:30.574079] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.180 [2024-11-21 03:44:30.574105] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.180 [2024-11-21 03:44:30.574119] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.180 [2024-11-21 03:44:30.574132] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.180 [2024-11-21 03:44:30.574163] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.180 qpair failed and we were unable to recover it. 00:27:50.180 [2024-11-21 03:44:30.583994] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.180 [2024-11-21 03:44:30.584100] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.180 [2024-11-21 03:44:30.584126] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.180 [2024-11-21 03:44:30.584140] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.180 [2024-11-21 03:44:30.584155] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.180 [2024-11-21 03:44:30.584185] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.180 qpair failed and we were unable to recover it. 00:27:50.180 [2024-11-21 03:44:30.594039] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.180 [2024-11-21 03:44:30.594151] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.180 [2024-11-21 03:44:30.594176] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.180 [2024-11-21 03:44:30.594190] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.180 [2024-11-21 03:44:30.594203] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.180 [2024-11-21 03:44:30.594233] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.180 qpair failed and we were unable to recover it. 00:27:50.180 [2024-11-21 03:44:30.604034] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.180 [2024-11-21 03:44:30.604144] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.180 [2024-11-21 03:44:30.604170] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.180 [2024-11-21 03:44:30.604184] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.180 [2024-11-21 03:44:30.604197] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.180 [2024-11-21 03:44:30.604228] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.180 qpair failed and we were unable to recover it. 00:27:50.180 [2024-11-21 03:44:30.614086] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.180 [2024-11-21 03:44:30.614191] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.180 [2024-11-21 03:44:30.614221] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.180 [2024-11-21 03:44:30.614237] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.180 [2024-11-21 03:44:30.614249] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.180 [2024-11-21 03:44:30.614280] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.180 qpair failed and we were unable to recover it. 00:27:50.180 [2024-11-21 03:44:30.624108] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.180 [2024-11-21 03:44:30.624218] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.180 [2024-11-21 03:44:30.624244] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.180 [2024-11-21 03:44:30.624258] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.180 [2024-11-21 03:44:30.624270] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.180 [2024-11-21 03:44:30.624302] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.180 qpair failed and we were unable to recover it. 00:27:50.180 [2024-11-21 03:44:30.634127] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.180 [2024-11-21 03:44:30.634257] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.180 [2024-11-21 03:44:30.634282] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.180 [2024-11-21 03:44:30.634297] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.180 [2024-11-21 03:44:30.634309] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.180 [2024-11-21 03:44:30.634341] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.180 qpair failed and we were unable to recover it. 00:27:50.180 [2024-11-21 03:44:30.644249] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.180 [2024-11-21 03:44:30.644355] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.180 [2024-11-21 03:44:30.644381] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.180 [2024-11-21 03:44:30.644395] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.180 [2024-11-21 03:44:30.644406] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.180 [2024-11-21 03:44:30.644435] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.180 qpair failed and we were unable to recover it. 00:27:50.180 [2024-11-21 03:44:30.654171] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.180 [2024-11-21 03:44:30.654277] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.180 [2024-11-21 03:44:30.654303] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.180 [2024-11-21 03:44:30.654317] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.180 [2024-11-21 03:44:30.654330] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.180 [2024-11-21 03:44:30.654365] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.180 qpair failed and we were unable to recover it. 00:27:50.180 [2024-11-21 03:44:30.664230] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.180 [2024-11-21 03:44:30.664354] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.180 [2024-11-21 03:44:30.664383] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.180 [2024-11-21 03:44:30.664398] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.180 [2024-11-21 03:44:30.664410] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.180 [2024-11-21 03:44:30.664453] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.180 qpair failed and we were unable to recover it. 00:27:50.180 [2024-11-21 03:44:30.674238] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.180 [2024-11-21 03:44:30.674356] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.180 [2024-11-21 03:44:30.674384] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.180 [2024-11-21 03:44:30.674399] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.180 [2024-11-21 03:44:30.674416] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.180 [2024-11-21 03:44:30.674446] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.180 qpair failed and we were unable to recover it. 00:27:50.180 [2024-11-21 03:44:30.684305] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.180 [2024-11-21 03:44:30.684466] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.180 [2024-11-21 03:44:30.684493] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.180 [2024-11-21 03:44:30.684507] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.180 [2024-11-21 03:44:30.684520] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.180 [2024-11-21 03:44:30.684550] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.180 qpair failed and we were unable to recover it. 00:27:50.180 [2024-11-21 03:44:30.694417] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.180 [2024-11-21 03:44:30.694527] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.180 [2024-11-21 03:44:30.694555] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.180 [2024-11-21 03:44:30.694571] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.180 [2024-11-21 03:44:30.694584] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.180 [2024-11-21 03:44:30.694615] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.180 qpair failed and we were unable to recover it. 00:27:50.180 [2024-11-21 03:44:30.704315] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.180 [2024-11-21 03:44:30.704424] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.180 [2024-11-21 03:44:30.704455] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.180 [2024-11-21 03:44:30.704471] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.180 [2024-11-21 03:44:30.704484] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.181 [2024-11-21 03:44:30.704513] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.181 qpair failed and we were unable to recover it. 00:27:50.181 [2024-11-21 03:44:30.714341] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.181 [2024-11-21 03:44:30.714445] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.181 [2024-11-21 03:44:30.714472] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.181 [2024-11-21 03:44:30.714486] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.181 [2024-11-21 03:44:30.714498] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.181 [2024-11-21 03:44:30.714527] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.181 qpair failed and we were unable to recover it. 00:27:50.181 [2024-11-21 03:44:30.724394] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.181 [2024-11-21 03:44:30.724495] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.181 [2024-11-21 03:44:30.724524] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.181 [2024-11-21 03:44:30.724539] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.181 [2024-11-21 03:44:30.724552] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.181 [2024-11-21 03:44:30.724583] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.181 qpair failed and we were unable to recover it. 00:27:50.181 [2024-11-21 03:44:30.734443] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.181 [2024-11-21 03:44:30.734552] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.181 [2024-11-21 03:44:30.734578] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.181 [2024-11-21 03:44:30.734592] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.181 [2024-11-21 03:44:30.734605] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.181 [2024-11-21 03:44:30.734634] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.181 qpair failed and we were unable to recover it. 00:27:50.181 [2024-11-21 03:44:30.744433] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.181 [2024-11-21 03:44:30.744581] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.181 [2024-11-21 03:44:30.744608] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.181 [2024-11-21 03:44:30.744624] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.181 [2024-11-21 03:44:30.744647] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.181 [2024-11-21 03:44:30.744680] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.181 qpair failed and we were unable to recover it. 00:27:50.181 [2024-11-21 03:44:30.754551] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.181 [2024-11-21 03:44:30.754657] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.181 [2024-11-21 03:44:30.754682] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.181 [2024-11-21 03:44:30.754696] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.181 [2024-11-21 03:44:30.754708] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.181 [2024-11-21 03:44:30.754736] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.181 qpair failed and we were unable to recover it. 00:27:50.181 [2024-11-21 03:44:30.764510] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.181 [2024-11-21 03:44:30.764607] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.181 [2024-11-21 03:44:30.764633] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.181 [2024-11-21 03:44:30.764648] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.181 [2024-11-21 03:44:30.764661] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.181 [2024-11-21 03:44:30.764703] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.181 qpair failed and we were unable to recover it. 00:27:50.181 [2024-11-21 03:44:30.774537] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.181 [2024-11-21 03:44:30.774643] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.181 [2024-11-21 03:44:30.774668] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.181 [2024-11-21 03:44:30.774682] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.181 [2024-11-21 03:44:30.774695] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.181 [2024-11-21 03:44:30.774724] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.181 qpair failed and we were unable to recover it. 00:27:50.181 [2024-11-21 03:44:30.784556] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.181 [2024-11-21 03:44:30.784661] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.181 [2024-11-21 03:44:30.784687] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.181 [2024-11-21 03:44:30.784701] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.181 [2024-11-21 03:44:30.784714] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.181 [2024-11-21 03:44:30.784743] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.181 qpair failed and we were unable to recover it. 00:27:50.181 [2024-11-21 03:44:30.794629] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.181 [2024-11-21 03:44:30.794749] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.181 [2024-11-21 03:44:30.794776] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.181 [2024-11-21 03:44:30.794790] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.181 [2024-11-21 03:44:30.794803] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.181 [2024-11-21 03:44:30.794832] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.181 qpair failed and we were unable to recover it. 00:27:50.181 [2024-11-21 03:44:30.804615] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.181 [2024-11-21 03:44:30.804714] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.181 [2024-11-21 03:44:30.804740] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.181 [2024-11-21 03:44:30.804755] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.181 [2024-11-21 03:44:30.804768] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.181 [2024-11-21 03:44:30.804799] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.181 qpair failed and we were unable to recover it. 00:27:50.181 [2024-11-21 03:44:30.814667] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.181 [2024-11-21 03:44:30.814770] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.181 [2024-11-21 03:44:30.814795] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.181 [2024-11-21 03:44:30.814809] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.181 [2024-11-21 03:44:30.814822] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.181 [2024-11-21 03:44:30.814851] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.181 qpair failed and we were unable to recover it. 00:27:50.441 [2024-11-21 03:44:30.824685] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.441 [2024-11-21 03:44:30.824806] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.441 [2024-11-21 03:44:30.824838] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.441 [2024-11-21 03:44:30.824852] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.441 [2024-11-21 03:44:30.824865] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.441 [2024-11-21 03:44:30.824896] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.441 qpair failed and we were unable to recover it. 00:27:50.441 [2024-11-21 03:44:30.834743] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.441 [2024-11-21 03:44:30.834857] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.441 [2024-11-21 03:44:30.834886] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.441 [2024-11-21 03:44:30.834901] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.441 [2024-11-21 03:44:30.834919] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.441 [2024-11-21 03:44:30.834951] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.441 qpair failed and we were unable to recover it. 00:27:50.441 [2024-11-21 03:44:30.844729] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.441 [2024-11-21 03:44:30.844833] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.441 [2024-11-21 03:44:30.844859] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.441 [2024-11-21 03:44:30.844874] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.441 [2024-11-21 03:44:30.844887] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.441 [2024-11-21 03:44:30.844916] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.441 qpair failed and we were unable to recover it. 00:27:50.441 [2024-11-21 03:44:30.854783] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.441 [2024-11-21 03:44:30.854893] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.441 [2024-11-21 03:44:30.854919] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.442 [2024-11-21 03:44:30.854934] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.442 [2024-11-21 03:44:30.854947] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.442 [2024-11-21 03:44:30.854976] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.442 qpair failed and we were unable to recover it. 00:27:50.442 [2024-11-21 03:44:30.864852] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.442 [2024-11-21 03:44:30.864955] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.442 [2024-11-21 03:44:30.864984] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.442 [2024-11-21 03:44:30.864999] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.442 [2024-11-21 03:44:30.865012] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.442 [2024-11-21 03:44:30.865053] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.442 qpair failed and we were unable to recover it. 00:27:50.442 [2024-11-21 03:44:30.874831] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.442 [2024-11-21 03:44:30.874934] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.442 [2024-11-21 03:44:30.874960] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.442 [2024-11-21 03:44:30.874975] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.442 [2024-11-21 03:44:30.874988] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.442 [2024-11-21 03:44:30.875018] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.442 qpair failed and we were unable to recover it. 00:27:50.442 [2024-11-21 03:44:30.884843] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.442 [2024-11-21 03:44:30.884963] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.442 [2024-11-21 03:44:30.884989] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.442 [2024-11-21 03:44:30.885003] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.442 [2024-11-21 03:44:30.885017] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.442 [2024-11-21 03:44:30.885045] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.442 qpair failed and we were unable to recover it. 00:27:50.442 [2024-11-21 03:44:30.894976] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.442 [2024-11-21 03:44:30.895095] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.442 [2024-11-21 03:44:30.895121] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.442 [2024-11-21 03:44:30.895136] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.442 [2024-11-21 03:44:30.895149] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.442 [2024-11-21 03:44:30.895179] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.442 qpair failed and we were unable to recover it. 00:27:50.442 [2024-11-21 03:44:30.904964] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.442 [2024-11-21 03:44:30.905064] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.442 [2024-11-21 03:44:30.905100] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.442 [2024-11-21 03:44:30.905114] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.442 [2024-11-21 03:44:30.905127] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.442 [2024-11-21 03:44:30.905158] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.442 qpair failed and we were unable to recover it. 00:27:50.442 [2024-11-21 03:44:30.915008] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.442 [2024-11-21 03:44:30.915126] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.442 [2024-11-21 03:44:30.915152] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.442 [2024-11-21 03:44:30.915166] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.442 [2024-11-21 03:44:30.915178] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.442 [2024-11-21 03:44:30.915208] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.442 qpair failed and we were unable to recover it. 00:27:50.442 [2024-11-21 03:44:30.925024] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.442 [2024-11-21 03:44:30.925150] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.442 [2024-11-21 03:44:30.925176] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.442 [2024-11-21 03:44:30.925197] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.442 [2024-11-21 03:44:30.925211] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.442 [2024-11-21 03:44:30.925241] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.442 qpair failed and we were unable to recover it. 00:27:50.442 [2024-11-21 03:44:30.935041] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.442 [2024-11-21 03:44:30.935158] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.442 [2024-11-21 03:44:30.935184] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.442 [2024-11-21 03:44:30.935198] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.442 [2024-11-21 03:44:30.935212] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.442 [2024-11-21 03:44:30.935242] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.442 qpair failed and we were unable to recover it. 00:27:50.442 [2024-11-21 03:44:30.945074] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.442 [2024-11-21 03:44:30.945214] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.442 [2024-11-21 03:44:30.945240] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.442 [2024-11-21 03:44:30.945254] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.442 [2024-11-21 03:44:30.945267] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.442 [2024-11-21 03:44:30.945308] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.442 qpair failed and we were unable to recover it. 00:27:50.442 [2024-11-21 03:44:30.955116] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.442 [2024-11-21 03:44:30.955261] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.442 [2024-11-21 03:44:30.955285] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.442 [2024-11-21 03:44:30.955300] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.442 [2024-11-21 03:44:30.955312] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.442 [2024-11-21 03:44:30.955344] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.442 qpair failed and we were unable to recover it. 00:27:50.442 [2024-11-21 03:44:30.965083] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.442 [2024-11-21 03:44:30.965190] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.442 [2024-11-21 03:44:30.965216] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.442 [2024-11-21 03:44:30.965230] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.442 [2024-11-21 03:44:30.965242] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.442 [2024-11-21 03:44:30.965272] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.442 qpair failed and we were unable to recover it. 00:27:50.442 [2024-11-21 03:44:30.975133] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.442 [2024-11-21 03:44:30.975243] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.442 [2024-11-21 03:44:30.975268] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.442 [2024-11-21 03:44:30.975282] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.442 [2024-11-21 03:44:30.975298] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.442 [2024-11-21 03:44:30.975328] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.442 qpair failed and we were unable to recover it. 00:27:50.442 [2024-11-21 03:44:30.985179] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.442 [2024-11-21 03:44:30.985284] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.442 [2024-11-21 03:44:30.985309] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.442 [2024-11-21 03:44:30.985323] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.442 [2024-11-21 03:44:30.985336] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.442 [2024-11-21 03:44:30.985367] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.442 qpair failed and we were unable to recover it. 00:27:50.442 [2024-11-21 03:44:30.995183] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.442 [2024-11-21 03:44:30.995338] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.442 [2024-11-21 03:44:30.995365] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.442 [2024-11-21 03:44:30.995380] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.442 [2024-11-21 03:44:30.995397] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.442 [2024-11-21 03:44:30.995430] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.442 qpair failed and we were unable to recover it. 00:27:50.442 [2024-11-21 03:44:31.005214] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.442 [2024-11-21 03:44:31.005322] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.442 [2024-11-21 03:44:31.005349] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.442 [2024-11-21 03:44:31.005364] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.442 [2024-11-21 03:44:31.005377] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.442 [2024-11-21 03:44:31.005407] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.442 qpair failed and we were unable to recover it. 00:27:50.442 [2024-11-21 03:44:31.015245] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.442 [2024-11-21 03:44:31.015383] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.442 [2024-11-21 03:44:31.015409] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.442 [2024-11-21 03:44:31.015429] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.442 [2024-11-21 03:44:31.015443] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.442 [2024-11-21 03:44:31.015475] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.442 qpair failed and we were unable to recover it. 00:27:50.442 [2024-11-21 03:44:31.025300] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.442 [2024-11-21 03:44:31.025415] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.442 [2024-11-21 03:44:31.025442] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.442 [2024-11-21 03:44:31.025456] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.442 [2024-11-21 03:44:31.025469] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.442 [2024-11-21 03:44:31.025500] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.442 qpair failed and we were unable to recover it. 00:27:50.442 [2024-11-21 03:44:31.035268] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.442 [2024-11-21 03:44:31.035381] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.442 [2024-11-21 03:44:31.035407] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.442 [2024-11-21 03:44:31.035421] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.442 [2024-11-21 03:44:31.035433] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.442 [2024-11-21 03:44:31.035463] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.442 qpair failed and we were unable to recover it. 00:27:50.442 [2024-11-21 03:44:31.045294] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.442 [2024-11-21 03:44:31.045398] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.442 [2024-11-21 03:44:31.045424] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.442 [2024-11-21 03:44:31.045438] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.442 [2024-11-21 03:44:31.045450] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.442 [2024-11-21 03:44:31.045495] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.442 qpair failed and we were unable to recover it. 00:27:50.442 [2024-11-21 03:44:31.055345] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.443 [2024-11-21 03:44:31.055453] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.443 [2024-11-21 03:44:31.055479] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.443 [2024-11-21 03:44:31.055493] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.443 [2024-11-21 03:44:31.055506] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.443 [2024-11-21 03:44:31.055536] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.443 qpair failed and we were unable to recover it. 00:27:50.443 [2024-11-21 03:44:31.065344] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.443 [2024-11-21 03:44:31.065458] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.443 [2024-11-21 03:44:31.065484] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.443 [2024-11-21 03:44:31.065498] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.443 [2024-11-21 03:44:31.065511] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.443 [2024-11-21 03:44:31.065540] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.443 qpair failed and we were unable to recover it. 00:27:50.443 [2024-11-21 03:44:31.075366] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.443 [2024-11-21 03:44:31.075463] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.443 [2024-11-21 03:44:31.075488] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.443 [2024-11-21 03:44:31.075502] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.443 [2024-11-21 03:44:31.075514] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.443 [2024-11-21 03:44:31.075545] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.443 qpair failed and we were unable to recover it. 00:27:50.443 [2024-11-21 03:44:31.085423] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.443 [2024-11-21 03:44:31.085536] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.443 [2024-11-21 03:44:31.085563] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.443 [2024-11-21 03:44:31.085586] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.443 [2024-11-21 03:44:31.085600] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.443 [2024-11-21 03:44:31.085630] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.443 qpair failed and we were unable to recover it. 00:27:50.703 [2024-11-21 03:44:31.095482] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.703 [2024-11-21 03:44:31.095603] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.703 [2024-11-21 03:44:31.095628] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.703 [2024-11-21 03:44:31.095642] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.703 [2024-11-21 03:44:31.095655] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.703 [2024-11-21 03:44:31.095686] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.703 qpair failed and we were unable to recover it. 00:27:50.703 [2024-11-21 03:44:31.105514] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.703 [2024-11-21 03:44:31.105619] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.703 [2024-11-21 03:44:31.105651] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.703 [2024-11-21 03:44:31.105666] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.703 [2024-11-21 03:44:31.105678] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.703 [2024-11-21 03:44:31.105708] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.703 qpair failed and we were unable to recover it. 00:27:50.703 [2024-11-21 03:44:31.115548] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.703 [2024-11-21 03:44:31.115649] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.703 [2024-11-21 03:44:31.115674] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.703 [2024-11-21 03:44:31.115689] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.703 [2024-11-21 03:44:31.115701] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.703 [2024-11-21 03:44:31.115742] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.703 qpair failed and we were unable to recover it. 00:27:50.703 [2024-11-21 03:44:31.125559] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.703 [2024-11-21 03:44:31.125693] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.703 [2024-11-21 03:44:31.125719] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.703 [2024-11-21 03:44:31.125733] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.703 [2024-11-21 03:44:31.125747] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.703 [2024-11-21 03:44:31.125777] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.703 qpair failed and we were unable to recover it. 00:27:50.703 [2024-11-21 03:44:31.135692] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.703 [2024-11-21 03:44:31.135798] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.703 [2024-11-21 03:44:31.135824] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.703 [2024-11-21 03:44:31.135838] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.704 [2024-11-21 03:44:31.135850] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.704 [2024-11-21 03:44:31.135879] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.704 qpair failed and we were unable to recover it. 00:27:50.704 [2024-11-21 03:44:31.145596] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.704 [2024-11-21 03:44:31.145700] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.704 [2024-11-21 03:44:31.145725] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.704 [2024-11-21 03:44:31.145739] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.704 [2024-11-21 03:44:31.145752] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.704 [2024-11-21 03:44:31.145787] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.704 qpair failed and we were unable to recover it. 00:27:50.704 [2024-11-21 03:44:31.155613] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.704 [2024-11-21 03:44:31.155717] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.704 [2024-11-21 03:44:31.155743] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.704 [2024-11-21 03:44:31.155756] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.704 [2024-11-21 03:44:31.155769] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.704 [2024-11-21 03:44:31.155800] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.704 qpair failed and we were unable to recover it. 00:27:50.704 [2024-11-21 03:44:31.165689] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.704 [2024-11-21 03:44:31.165794] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.704 [2024-11-21 03:44:31.165823] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.704 [2024-11-21 03:44:31.165838] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.704 [2024-11-21 03:44:31.165851] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.704 [2024-11-21 03:44:31.165883] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.704 qpair failed and we were unable to recover it. 00:27:50.704 [2024-11-21 03:44:31.175708] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.704 [2024-11-21 03:44:31.175840] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.704 [2024-11-21 03:44:31.175867] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.704 [2024-11-21 03:44:31.175882] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.704 [2024-11-21 03:44:31.175899] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.704 [2024-11-21 03:44:31.175943] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.704 qpair failed and we were unable to recover it. 00:27:50.704 [2024-11-21 03:44:31.185762] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.704 [2024-11-21 03:44:31.185885] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.704 [2024-11-21 03:44:31.185913] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.704 [2024-11-21 03:44:31.185928] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.704 [2024-11-21 03:44:31.185945] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.704 [2024-11-21 03:44:31.185977] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.704 qpair failed and we were unable to recover it. 00:27:50.704 [2024-11-21 03:44:31.195751] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.704 [2024-11-21 03:44:31.195851] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.704 [2024-11-21 03:44:31.195882] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.704 [2024-11-21 03:44:31.195897] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.704 [2024-11-21 03:44:31.195910] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.704 [2024-11-21 03:44:31.195940] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.704 qpair failed and we were unable to recover it. 00:27:50.704 [2024-11-21 03:44:31.205854] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.704 [2024-11-21 03:44:31.205993] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.704 [2024-11-21 03:44:31.206019] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.704 [2024-11-21 03:44:31.206033] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.704 [2024-11-21 03:44:31.206045] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.704 [2024-11-21 03:44:31.206082] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.704 qpair failed and we were unable to recover it. 00:27:50.704 [2024-11-21 03:44:31.215810] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.704 [2024-11-21 03:44:31.215918] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.704 [2024-11-21 03:44:31.215944] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.704 [2024-11-21 03:44:31.215958] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.704 [2024-11-21 03:44:31.215972] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.704 [2024-11-21 03:44:31.216015] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.704 qpair failed and we were unable to recover it. 00:27:50.704 [2024-11-21 03:44:31.225807] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.704 [2024-11-21 03:44:31.225919] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.704 [2024-11-21 03:44:31.225945] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.704 [2024-11-21 03:44:31.225958] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.704 [2024-11-21 03:44:31.225971] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.704 [2024-11-21 03:44:31.226000] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.704 qpair failed and we were unable to recover it. 00:27:50.704 [2024-11-21 03:44:31.235888] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.704 [2024-11-21 03:44:31.236014] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.704 [2024-11-21 03:44:31.236041] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.704 [2024-11-21 03:44:31.236057] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.704 [2024-11-21 03:44:31.236082] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.704 [2024-11-21 03:44:31.236138] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.704 qpair failed and we were unable to recover it. 00:27:50.704 [2024-11-21 03:44:31.245865] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.704 [2024-11-21 03:44:31.245965] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.704 [2024-11-21 03:44:31.245992] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.704 [2024-11-21 03:44:31.246006] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.704 [2024-11-21 03:44:31.246018] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.704 [2024-11-21 03:44:31.246048] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.704 qpair failed and we were unable to recover it. 00:27:50.704 [2024-11-21 03:44:31.255998] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.704 [2024-11-21 03:44:31.256115] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.704 [2024-11-21 03:44:31.256143] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.704 [2024-11-21 03:44:31.256159] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.704 [2024-11-21 03:44:31.256172] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.704 [2024-11-21 03:44:31.256204] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.704 qpair failed and we were unable to recover it. 00:27:50.704 [2024-11-21 03:44:31.266027] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.704 [2024-11-21 03:44:31.266139] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.704 [2024-11-21 03:44:31.266165] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.704 [2024-11-21 03:44:31.266179] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.704 [2024-11-21 03:44:31.266193] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.704 [2024-11-21 03:44:31.266223] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.704 qpair failed and we were unable to recover it. 00:27:50.705 [2024-11-21 03:44:31.275977] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.705 [2024-11-21 03:44:31.276088] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.705 [2024-11-21 03:44:31.276115] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.705 [2024-11-21 03:44:31.276129] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.705 [2024-11-21 03:44:31.276142] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.705 [2024-11-21 03:44:31.276171] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.705 qpair failed and we were unable to recover it. 00:27:50.705 [2024-11-21 03:44:31.286014] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.705 [2024-11-21 03:44:31.286129] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.705 [2024-11-21 03:44:31.286156] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.705 [2024-11-21 03:44:31.286170] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.705 [2024-11-21 03:44:31.286182] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.705 [2024-11-21 03:44:31.286212] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.705 qpair failed and we were unable to recover it. 00:27:50.705 [2024-11-21 03:44:31.296119] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.705 [2024-11-21 03:44:31.296228] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.705 [2024-11-21 03:44:31.296254] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.705 [2024-11-21 03:44:31.296268] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.705 [2024-11-21 03:44:31.296281] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.705 [2024-11-21 03:44:31.296312] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.705 qpair failed and we were unable to recover it. 00:27:50.705 [2024-11-21 03:44:31.306189] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.705 [2024-11-21 03:44:31.306320] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.705 [2024-11-21 03:44:31.306346] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.705 [2024-11-21 03:44:31.306360] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.705 [2024-11-21 03:44:31.306374] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.705 [2024-11-21 03:44:31.306404] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.705 qpair failed and we were unable to recover it. 00:27:50.705 [2024-11-21 03:44:31.316121] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.705 [2024-11-21 03:44:31.316221] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.705 [2024-11-21 03:44:31.316246] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.705 [2024-11-21 03:44:31.316260] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.705 [2024-11-21 03:44:31.316273] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.705 [2024-11-21 03:44:31.316304] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.705 qpair failed and we were unable to recover it. 00:27:50.705 [2024-11-21 03:44:31.326109] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.705 [2024-11-21 03:44:31.326215] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.705 [2024-11-21 03:44:31.326240] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.705 [2024-11-21 03:44:31.326254] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.705 [2024-11-21 03:44:31.326273] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.705 [2024-11-21 03:44:31.326303] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.705 qpair failed and we were unable to recover it. 00:27:50.705 [2024-11-21 03:44:31.336208] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.705 [2024-11-21 03:44:31.336364] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.705 [2024-11-21 03:44:31.336391] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.705 [2024-11-21 03:44:31.336405] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.705 [2024-11-21 03:44:31.336417] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.705 [2024-11-21 03:44:31.336446] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.705 qpair failed and we were unable to recover it. 00:27:50.705 [2024-11-21 03:44:31.346196] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.705 [2024-11-21 03:44:31.346303] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.705 [2024-11-21 03:44:31.346329] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.705 [2024-11-21 03:44:31.346343] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.705 [2024-11-21 03:44:31.346356] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.705 [2024-11-21 03:44:31.346397] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.705 qpair failed and we were unable to recover it. 00:27:50.964 [2024-11-21 03:44:31.356193] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.964 [2024-11-21 03:44:31.356303] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.964 [2024-11-21 03:44:31.356330] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.964 [2024-11-21 03:44:31.356344] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.964 [2024-11-21 03:44:31.356357] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.964 [2024-11-21 03:44:31.356387] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.964 qpair failed and we were unable to recover it. 00:27:50.964 [2024-11-21 03:44:31.366237] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.964 [2024-11-21 03:44:31.366362] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.964 [2024-11-21 03:44:31.366390] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.964 [2024-11-21 03:44:31.366405] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.964 [2024-11-21 03:44:31.366417] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.964 [2024-11-21 03:44:31.366448] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.965 qpair failed and we were unable to recover it. 00:27:50.965 [2024-11-21 03:44:31.376280] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.965 [2024-11-21 03:44:31.376400] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.965 [2024-11-21 03:44:31.376427] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.965 [2024-11-21 03:44:31.376441] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.965 [2024-11-21 03:44:31.376454] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.965 [2024-11-21 03:44:31.376484] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.965 qpair failed and we were unable to recover it. 00:27:50.965 [2024-11-21 03:44:31.386286] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.965 [2024-11-21 03:44:31.386391] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.965 [2024-11-21 03:44:31.386417] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.965 [2024-11-21 03:44:31.386431] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.965 [2024-11-21 03:44:31.386444] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.965 [2024-11-21 03:44:31.386474] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.965 qpair failed and we were unable to recover it. 00:27:50.965 [2024-11-21 03:44:31.396371] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.965 [2024-11-21 03:44:31.396473] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.965 [2024-11-21 03:44:31.396499] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.965 [2024-11-21 03:44:31.396513] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.965 [2024-11-21 03:44:31.396527] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.965 [2024-11-21 03:44:31.396556] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.965 qpair failed and we were unable to recover it. 00:27:50.965 [2024-11-21 03:44:31.406425] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.965 [2024-11-21 03:44:31.406528] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.965 [2024-11-21 03:44:31.406554] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.965 [2024-11-21 03:44:31.406568] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.965 [2024-11-21 03:44:31.406580] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.965 [2024-11-21 03:44:31.406609] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.965 qpair failed and we were unable to recover it. 00:27:50.965 [2024-11-21 03:44:31.416503] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.965 [2024-11-21 03:44:31.416616] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.965 [2024-11-21 03:44:31.416642] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.965 [2024-11-21 03:44:31.416663] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.965 [2024-11-21 03:44:31.416676] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.965 [2024-11-21 03:44:31.416707] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.965 qpair failed and we were unable to recover it. 00:27:50.965 [2024-11-21 03:44:31.426467] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.965 [2024-11-21 03:44:31.426571] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.965 [2024-11-21 03:44:31.426598] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.965 [2024-11-21 03:44:31.426612] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.965 [2024-11-21 03:44:31.426625] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.965 [2024-11-21 03:44:31.426655] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.965 qpair failed and we were unable to recover it. 00:27:50.965 [2024-11-21 03:44:31.436560] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.965 [2024-11-21 03:44:31.436669] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.965 [2024-11-21 03:44:31.436694] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.965 [2024-11-21 03:44:31.436708] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.965 [2024-11-21 03:44:31.436720] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.965 [2024-11-21 03:44:31.436750] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.965 qpair failed and we were unable to recover it. 00:27:50.965 [2024-11-21 03:44:31.446507] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.965 [2024-11-21 03:44:31.446624] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.965 [2024-11-21 03:44:31.446649] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.965 [2024-11-21 03:44:31.446663] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.965 [2024-11-21 03:44:31.446676] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.965 [2024-11-21 03:44:31.446705] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.965 qpair failed and we were unable to recover it. 00:27:50.965 [2024-11-21 03:44:31.456574] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.965 [2024-11-21 03:44:31.456683] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.965 [2024-11-21 03:44:31.456709] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.965 [2024-11-21 03:44:31.456723] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.965 [2024-11-21 03:44:31.456735] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.965 [2024-11-21 03:44:31.456766] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.965 qpair failed and we were unable to recover it. 00:27:50.965 [2024-11-21 03:44:31.466653] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.965 [2024-11-21 03:44:31.466801] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.965 [2024-11-21 03:44:31.466829] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.965 [2024-11-21 03:44:31.466844] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.965 [2024-11-21 03:44:31.466858] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.965 [2024-11-21 03:44:31.466887] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.965 qpair failed and we were unable to recover it. 00:27:50.965 [2024-11-21 03:44:31.476591] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.965 [2024-11-21 03:44:31.476694] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.965 [2024-11-21 03:44:31.476720] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.965 [2024-11-21 03:44:31.476734] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.965 [2024-11-21 03:44:31.476747] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.965 [2024-11-21 03:44:31.476779] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.965 qpair failed and we were unable to recover it. 00:27:50.965 [2024-11-21 03:44:31.486640] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.965 [2024-11-21 03:44:31.486745] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.965 [2024-11-21 03:44:31.486772] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.965 [2024-11-21 03:44:31.486787] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.965 [2024-11-21 03:44:31.486801] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.965 [2024-11-21 03:44:31.486833] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.965 qpair failed and we were unable to recover it. 00:27:50.965 [2024-11-21 03:44:31.496740] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.965 [2024-11-21 03:44:31.496857] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.965 [2024-11-21 03:44:31.496883] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.965 [2024-11-21 03:44:31.496898] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.965 [2024-11-21 03:44:31.496911] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.965 [2024-11-21 03:44:31.496940] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.965 qpair failed and we were unable to recover it. 00:27:50.965 [2024-11-21 03:44:31.506725] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.966 [2024-11-21 03:44:31.506853] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.966 [2024-11-21 03:44:31.506878] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.966 [2024-11-21 03:44:31.506898] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.966 [2024-11-21 03:44:31.506912] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.966 [2024-11-21 03:44:31.506943] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.966 qpair failed and we were unable to recover it. 00:27:50.966 [2024-11-21 03:44:31.516810] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.966 [2024-11-21 03:44:31.516912] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.966 [2024-11-21 03:44:31.516938] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.966 [2024-11-21 03:44:31.516951] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.966 [2024-11-21 03:44:31.516964] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.966 [2024-11-21 03:44:31.516993] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.966 qpair failed and we were unable to recover it. 00:27:50.966 [2024-11-21 03:44:31.526740] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.966 [2024-11-21 03:44:31.526844] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.966 [2024-11-21 03:44:31.526870] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.966 [2024-11-21 03:44:31.526885] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.966 [2024-11-21 03:44:31.526897] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.966 [2024-11-21 03:44:31.526926] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.966 qpair failed and we were unable to recover it. 00:27:50.966 [2024-11-21 03:44:31.536781] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.966 [2024-11-21 03:44:31.536901] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.966 [2024-11-21 03:44:31.536927] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.966 [2024-11-21 03:44:31.536941] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.966 [2024-11-21 03:44:31.536953] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.966 [2024-11-21 03:44:31.536982] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.966 qpair failed and we were unable to recover it. 00:27:50.966 [2024-11-21 03:44:31.546843] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.966 [2024-11-21 03:44:31.546992] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.966 [2024-11-21 03:44:31.547018] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.966 [2024-11-21 03:44:31.547032] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.966 [2024-11-21 03:44:31.547045] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.966 [2024-11-21 03:44:31.547083] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.966 qpair failed and we were unable to recover it. 00:27:50.966 [2024-11-21 03:44:31.556842] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.966 [2024-11-21 03:44:31.556946] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.966 [2024-11-21 03:44:31.556973] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.966 [2024-11-21 03:44:31.556987] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.966 [2024-11-21 03:44:31.557000] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.966 [2024-11-21 03:44:31.557041] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.966 qpair failed and we were unable to recover it. 00:27:50.966 [2024-11-21 03:44:31.566863] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.966 [2024-11-21 03:44:31.566961] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.966 [2024-11-21 03:44:31.566986] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.966 [2024-11-21 03:44:31.567000] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.966 [2024-11-21 03:44:31.567014] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.966 [2024-11-21 03:44:31.567043] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.966 qpair failed and we were unable to recover it. 00:27:50.966 [2024-11-21 03:44:31.576925] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.966 [2024-11-21 03:44:31.577042] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.966 [2024-11-21 03:44:31.577077] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.966 [2024-11-21 03:44:31.577094] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.966 [2024-11-21 03:44:31.577107] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.966 [2024-11-21 03:44:31.577136] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.966 qpair failed and we were unable to recover it. 00:27:50.966 [2024-11-21 03:44:31.586953] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.966 [2024-11-21 03:44:31.587063] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.966 [2024-11-21 03:44:31.587098] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.966 [2024-11-21 03:44:31.587112] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.966 [2024-11-21 03:44:31.587124] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.966 [2024-11-21 03:44:31.587156] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.966 qpair failed and we were unable to recover it. 00:27:50.966 [2024-11-21 03:44:31.596987] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.966 [2024-11-21 03:44:31.597102] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.966 [2024-11-21 03:44:31.597137] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.966 [2024-11-21 03:44:31.597152] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.966 [2024-11-21 03:44:31.597165] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.966 [2024-11-21 03:44:31.597195] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.966 qpair failed and we were unable to recover it. 00:27:50.966 [2024-11-21 03:44:31.606993] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:50.966 [2024-11-21 03:44:31.607122] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:50.966 [2024-11-21 03:44:31.607149] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:50.966 [2024-11-21 03:44:31.607163] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:50.966 [2024-11-21 03:44:31.607180] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:50.966 [2024-11-21 03:44:31.607209] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:50.966 qpair failed and we were unable to recover it. 00:27:51.226 [2024-11-21 03:44:31.617040] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.226 [2024-11-21 03:44:31.617168] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.226 [2024-11-21 03:44:31.617194] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.226 [2024-11-21 03:44:31.617208] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.226 [2024-11-21 03:44:31.617222] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:51.226 [2024-11-21 03:44:31.617265] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:51.226 qpair failed and we were unable to recover it. 00:27:51.226 [2024-11-21 03:44:31.627112] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.226 [2024-11-21 03:44:31.627259] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.226 [2024-11-21 03:44:31.627287] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.226 [2024-11-21 03:44:31.627302] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.226 [2024-11-21 03:44:31.627315] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:51.226 [2024-11-21 03:44:31.627345] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:51.226 qpair failed and we were unable to recover it. 00:27:51.226 [2024-11-21 03:44:31.637104] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.226 [2024-11-21 03:44:31.637258] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.226 [2024-11-21 03:44:31.637284] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.226 [2024-11-21 03:44:31.637298] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.226 [2024-11-21 03:44:31.637310] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:51.226 [2024-11-21 03:44:31.637346] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:51.226 qpair failed and we were unable to recover it. 00:27:51.226 [2024-11-21 03:44:31.647097] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.226 [2024-11-21 03:44:31.647204] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.226 [2024-11-21 03:44:31.647229] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.226 [2024-11-21 03:44:31.647244] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.226 [2024-11-21 03:44:31.647255] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:51.226 [2024-11-21 03:44:31.647284] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:51.226 qpair failed and we were unable to recover it. 00:27:51.226 [2024-11-21 03:44:31.657136] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.226 [2024-11-21 03:44:31.657242] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.226 [2024-11-21 03:44:31.657268] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.226 [2024-11-21 03:44:31.657282] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.226 [2024-11-21 03:44:31.657295] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:51.226 [2024-11-21 03:44:31.657325] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:51.226 qpair failed and we were unable to recover it. 00:27:51.226 [2024-11-21 03:44:31.667178] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.226 [2024-11-21 03:44:31.667316] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.226 [2024-11-21 03:44:31.667342] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.226 [2024-11-21 03:44:31.667356] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.226 [2024-11-21 03:44:31.667369] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:51.227 [2024-11-21 03:44:31.667400] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:51.227 qpair failed and we were unable to recover it. 00:27:51.227 [2024-11-21 03:44:31.677225] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.227 [2024-11-21 03:44:31.677340] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.227 [2024-11-21 03:44:31.677366] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.227 [2024-11-21 03:44:31.677380] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.227 [2024-11-21 03:44:31.677391] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:51.227 [2024-11-21 03:44:31.677422] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:51.227 qpair failed and we were unable to recover it. 00:27:51.227 [2024-11-21 03:44:31.687333] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.227 [2024-11-21 03:44:31.687472] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.227 [2024-11-21 03:44:31.687503] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.227 [2024-11-21 03:44:31.687518] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.227 [2024-11-21 03:44:31.687531] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:51.227 [2024-11-21 03:44:31.687560] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:51.227 qpair failed and we were unable to recover it. 00:27:51.227 [2024-11-21 03:44:31.697247] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.227 [2024-11-21 03:44:31.697354] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.227 [2024-11-21 03:44:31.697379] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.227 [2024-11-21 03:44:31.697393] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.227 [2024-11-21 03:44:31.697406] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:51.227 [2024-11-21 03:44:31.697436] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:51.227 qpair failed and we were unable to recover it. 00:27:51.227 [2024-11-21 03:44:31.707304] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.227 [2024-11-21 03:44:31.707430] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.227 [2024-11-21 03:44:31.707457] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.227 [2024-11-21 03:44:31.707471] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.227 [2024-11-21 03:44:31.707483] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:51.227 [2024-11-21 03:44:31.707512] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:51.227 qpair failed and we were unable to recover it. 00:27:51.227 [2024-11-21 03:44:31.717314] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.227 [2024-11-21 03:44:31.717408] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.227 [2024-11-21 03:44:31.717434] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.227 [2024-11-21 03:44:31.717448] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.227 [2024-11-21 03:44:31.717460] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:51.227 [2024-11-21 03:44:31.717489] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:51.227 qpair failed and we were unable to recover it. 00:27:51.227 [2024-11-21 03:44:31.727354] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.227 [2024-11-21 03:44:31.727458] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.227 [2024-11-21 03:44:31.727486] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.227 [2024-11-21 03:44:31.727501] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.227 [2024-11-21 03:44:31.727514] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:51.227 [2024-11-21 03:44:31.727549] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:51.227 qpair failed and we were unable to recover it. 00:27:51.227 [2024-11-21 03:44:31.737400] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.227 [2024-11-21 03:44:31.737504] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.227 [2024-11-21 03:44:31.737529] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.227 [2024-11-21 03:44:31.737544] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.227 [2024-11-21 03:44:31.737557] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:51.227 [2024-11-21 03:44:31.737600] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:51.227 qpair failed and we were unable to recover it. 00:27:51.227 [2024-11-21 03:44:31.747416] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.227 [2024-11-21 03:44:31.747516] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.227 [2024-11-21 03:44:31.747542] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.227 [2024-11-21 03:44:31.747556] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.227 [2024-11-21 03:44:31.747569] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:51.227 [2024-11-21 03:44:31.747599] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:51.227 qpair failed and we were unable to recover it. 00:27:51.227 [2024-11-21 03:44:31.757499] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.227 [2024-11-21 03:44:31.757631] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.227 [2024-11-21 03:44:31.757655] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.227 [2024-11-21 03:44:31.757670] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.227 [2024-11-21 03:44:31.757681] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:51.227 [2024-11-21 03:44:31.757710] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:51.227 qpair failed and we were unable to recover it. 00:27:51.227 [2024-11-21 03:44:31.767463] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.227 [2024-11-21 03:44:31.767562] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.227 [2024-11-21 03:44:31.767588] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.227 [2024-11-21 03:44:31.767602] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.227 [2024-11-21 03:44:31.767615] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:51.227 [2024-11-21 03:44:31.767645] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:51.227 qpair failed and we were unable to recover it. 00:27:51.227 [2024-11-21 03:44:31.777503] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.227 [2024-11-21 03:44:31.777609] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.227 [2024-11-21 03:44:31.777640] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.227 [2024-11-21 03:44:31.777655] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.227 [2024-11-21 03:44:31.777668] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:51.227 [2024-11-21 03:44:31.777710] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:51.227 qpair failed and we were unable to recover it. 00:27:51.227 [2024-11-21 03:44:31.787554] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.227 [2024-11-21 03:44:31.787674] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.227 [2024-11-21 03:44:31.787699] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.227 [2024-11-21 03:44:31.787713] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.227 [2024-11-21 03:44:31.787726] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:51.227 [2024-11-21 03:44:31.787756] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:51.227 qpair failed and we were unable to recover it. 00:27:51.227 [2024-11-21 03:44:31.797562] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.227 [2024-11-21 03:44:31.797678] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.227 [2024-11-21 03:44:31.797704] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.227 [2024-11-21 03:44:31.797718] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.227 [2024-11-21 03:44:31.797731] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:51.227 [2024-11-21 03:44:31.797760] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:51.227 qpair failed and we were unable to recover it. 00:27:51.227 [2024-11-21 03:44:31.807604] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.228 [2024-11-21 03:44:31.807710] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.228 [2024-11-21 03:44:31.807736] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.228 [2024-11-21 03:44:31.807751] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.228 [2024-11-21 03:44:31.807764] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:51.228 [2024-11-21 03:44:31.807795] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:51.228 qpair failed and we were unable to recover it. 00:27:51.228 [2024-11-21 03:44:31.817661] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.228 [2024-11-21 03:44:31.817778] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.228 [2024-11-21 03:44:31.817805] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.228 [2024-11-21 03:44:31.817819] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.228 [2024-11-21 03:44:31.817838] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:51.228 [2024-11-21 03:44:31.817868] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:51.228 qpair failed and we were unable to recover it. 00:27:51.228 [2024-11-21 03:44:31.827753] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.228 [2024-11-21 03:44:31.827868] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.228 [2024-11-21 03:44:31.827893] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.228 [2024-11-21 03:44:31.827908] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.228 [2024-11-21 03:44:31.827921] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:51.228 [2024-11-21 03:44:31.827951] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:51.228 qpair failed and we were unable to recover it. 00:27:51.228 [2024-11-21 03:44:31.837688] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.228 [2024-11-21 03:44:31.837794] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.228 [2024-11-21 03:44:31.837820] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.228 [2024-11-21 03:44:31.837834] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.228 [2024-11-21 03:44:31.837848] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:51.228 [2024-11-21 03:44:31.837877] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:51.228 qpair failed and we were unable to recover it. 00:27:51.228 [2024-11-21 03:44:31.847703] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.228 [2024-11-21 03:44:31.847834] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.228 [2024-11-21 03:44:31.847860] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.228 [2024-11-21 03:44:31.847873] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.228 [2024-11-21 03:44:31.847887] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:51.228 [2024-11-21 03:44:31.847917] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:51.228 qpair failed and we were unable to recover it. 00:27:51.228 [2024-11-21 03:44:31.857782] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.228 [2024-11-21 03:44:31.857891] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.228 [2024-11-21 03:44:31.857917] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.228 [2024-11-21 03:44:31.857931] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.228 [2024-11-21 03:44:31.857944] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:51.228 [2024-11-21 03:44:31.857973] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:51.228 qpair failed and we were unable to recover it. 00:27:51.228 [2024-11-21 03:44:31.867790] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.228 [2024-11-21 03:44:31.867915] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.228 [2024-11-21 03:44:31.867941] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.228 [2024-11-21 03:44:31.867955] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.228 [2024-11-21 03:44:31.867968] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:51.228 [2024-11-21 03:44:31.867996] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:51.228 qpair failed and we were unable to recover it. 00:27:51.488 [2024-11-21 03:44:31.877815] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.488 [2024-11-21 03:44:31.877917] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.488 [2024-11-21 03:44:31.877943] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.488 [2024-11-21 03:44:31.877957] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.488 [2024-11-21 03:44:31.877969] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:51.488 [2024-11-21 03:44:31.877998] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:51.488 qpair failed and we were unable to recover it. 00:27:51.488 [2024-11-21 03:44:31.887832] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.488 [2024-11-21 03:44:31.887932] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.488 [2024-11-21 03:44:31.887957] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.488 [2024-11-21 03:44:31.887972] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.488 [2024-11-21 03:44:31.887985] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:51.488 [2024-11-21 03:44:31.888014] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:51.488 qpair failed and we were unable to recover it. 00:27:51.488 [2024-11-21 03:44:31.897897] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.488 [2024-11-21 03:44:31.898052] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.488 [2024-11-21 03:44:31.898086] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.488 [2024-11-21 03:44:31.898102] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.488 [2024-11-21 03:44:31.898115] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:51.488 [2024-11-21 03:44:31.898144] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:51.488 qpair failed and we were unable to recover it. 00:27:51.488 [2024-11-21 03:44:31.907919] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.488 [2024-11-21 03:44:31.908024] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.488 [2024-11-21 03:44:31.908049] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.488 [2024-11-21 03:44:31.908063] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.488 [2024-11-21 03:44:31.908092] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:51.488 [2024-11-21 03:44:31.908124] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:51.488 qpair failed and we were unable to recover it. 00:27:51.488 [2024-11-21 03:44:31.917965] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.488 [2024-11-21 03:44:31.918095] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.488 [2024-11-21 03:44:31.918121] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.488 [2024-11-21 03:44:31.918135] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.488 [2024-11-21 03:44:31.918148] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:51.488 [2024-11-21 03:44:31.918178] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:51.488 qpair failed and we were unable to recover it. 00:27:51.488 [2024-11-21 03:44:31.927981] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.488 [2024-11-21 03:44:31.928090] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.488 [2024-11-21 03:44:31.928119] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.488 [2024-11-21 03:44:31.928133] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.488 [2024-11-21 03:44:31.928146] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:51.488 [2024-11-21 03:44:31.928177] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:51.488 qpair failed and we were unable to recover it. 00:27:51.488 [2024-11-21 03:44:31.938095] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.488 [2024-11-21 03:44:31.938203] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.488 [2024-11-21 03:44:31.938231] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.488 [2024-11-21 03:44:31.938248] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.488 [2024-11-21 03:44:31.938261] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:51.488 [2024-11-21 03:44:31.938293] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:51.488 qpair failed and we were unable to recover it. 00:27:51.488 [2024-11-21 03:44:31.948054] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.488 [2024-11-21 03:44:31.948171] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.488 [2024-11-21 03:44:31.948197] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.488 [2024-11-21 03:44:31.948212] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.488 [2024-11-21 03:44:31.948225] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:51.488 [2024-11-21 03:44:31.948255] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:51.488 qpair failed and we were unable to recover it. 00:27:51.488 [2024-11-21 03:44:31.958045] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.488 [2024-11-21 03:44:31.958163] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.488 [2024-11-21 03:44:31.958189] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.489 [2024-11-21 03:44:31.958203] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.489 [2024-11-21 03:44:31.958219] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:51.489 [2024-11-21 03:44:31.958249] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:51.489 qpair failed and we were unable to recover it. 00:27:51.489 [2024-11-21 03:44:31.968176] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.489 [2024-11-21 03:44:31.968288] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.489 [2024-11-21 03:44:31.968317] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.489 [2024-11-21 03:44:31.968332] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.489 [2024-11-21 03:44:31.968345] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:51.489 [2024-11-21 03:44:31.968375] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:51.489 qpair failed and we were unable to recover it. 00:27:51.489 [2024-11-21 03:44:31.978180] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.489 [2024-11-21 03:44:31.978327] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.489 [2024-11-21 03:44:31.978352] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.489 [2024-11-21 03:44:31.978367] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.489 [2024-11-21 03:44:31.978379] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:51.489 [2024-11-21 03:44:31.978409] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:51.489 qpair failed and we were unable to recover it. 00:27:51.489 [2024-11-21 03:44:31.988144] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.489 [2024-11-21 03:44:31.988256] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.489 [2024-11-21 03:44:31.988281] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.489 [2024-11-21 03:44:31.988296] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.489 [2024-11-21 03:44:31.988309] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:51.489 [2024-11-21 03:44:31.988339] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:51.489 qpair failed and we were unable to recover it. 00:27:51.489 [2024-11-21 03:44:31.998227] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.489 [2024-11-21 03:44:31.998359] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.489 [2024-11-21 03:44:31.998384] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.489 [2024-11-21 03:44:31.998407] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.489 [2024-11-21 03:44:31.998421] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:51.489 [2024-11-21 03:44:31.998452] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:51.489 qpair failed and we were unable to recover it. 00:27:51.489 [2024-11-21 03:44:32.008198] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.489 [2024-11-21 03:44:32.008301] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.489 [2024-11-21 03:44:32.008328] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.489 [2024-11-21 03:44:32.008342] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.489 [2024-11-21 03:44:32.008355] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:51.489 [2024-11-21 03:44:32.008384] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:51.489 qpair failed and we were unable to recover it. 00:27:51.489 [2024-11-21 03:44:32.018249] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.489 [2024-11-21 03:44:32.018356] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.489 [2024-11-21 03:44:32.018381] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.489 [2024-11-21 03:44:32.018395] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.489 [2024-11-21 03:44:32.018409] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:51.489 [2024-11-21 03:44:32.018438] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:51.489 qpair failed and we were unable to recover it. 00:27:51.489 [2024-11-21 03:44:32.028285] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.489 [2024-11-21 03:44:32.028388] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.489 [2024-11-21 03:44:32.028414] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.489 [2024-11-21 03:44:32.028428] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.489 [2024-11-21 03:44:32.028441] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:51.489 [2024-11-21 03:44:32.028471] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:51.489 qpair failed and we were unable to recover it. 00:27:51.489 [2024-11-21 03:44:32.038279] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.489 [2024-11-21 03:44:32.038382] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.489 [2024-11-21 03:44:32.038409] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.489 [2024-11-21 03:44:32.038423] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.489 [2024-11-21 03:44:32.038436] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:51.489 [2024-11-21 03:44:32.038464] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:51.489 qpair failed and we were unable to recover it. 00:27:51.489 [2024-11-21 03:44:32.048325] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.489 [2024-11-21 03:44:32.048446] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.489 [2024-11-21 03:44:32.048473] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.489 [2024-11-21 03:44:32.048488] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.489 [2024-11-21 03:44:32.048505] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:51.489 [2024-11-21 03:44:32.048536] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:51.489 qpair failed and we were unable to recover it. 00:27:51.489 [2024-11-21 03:44:32.058414] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.489 [2024-11-21 03:44:32.058520] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.489 [2024-11-21 03:44:32.058547] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.489 [2024-11-21 03:44:32.058561] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.489 [2024-11-21 03:44:32.058573] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:51.489 [2024-11-21 03:44:32.058602] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:51.489 qpair failed and we were unable to recover it. 00:27:51.489 [2024-11-21 03:44:32.068390] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.489 [2024-11-21 03:44:32.068498] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.489 [2024-11-21 03:44:32.068524] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.489 [2024-11-21 03:44:32.068539] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.489 [2024-11-21 03:44:32.068551] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:51.489 [2024-11-21 03:44:32.068582] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:51.489 qpair failed and we were unable to recover it. 00:27:51.489 [2024-11-21 03:44:32.078414] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.489 [2024-11-21 03:44:32.078539] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.489 [2024-11-21 03:44:32.078565] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.489 [2024-11-21 03:44:32.078579] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.489 [2024-11-21 03:44:32.078593] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:51.489 [2024-11-21 03:44:32.078621] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:51.489 qpair failed and we were unable to recover it. 00:27:51.489 [2024-11-21 03:44:32.088461] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.489 [2024-11-21 03:44:32.088573] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.489 [2024-11-21 03:44:32.088604] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.489 [2024-11-21 03:44:32.088619] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.489 [2024-11-21 03:44:32.088632] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:51.489 [2024-11-21 03:44:32.088662] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:51.490 qpair failed and we were unable to recover it. 00:27:51.490 [2024-11-21 03:44:32.098529] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.490 [2024-11-21 03:44:32.098636] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.490 [2024-11-21 03:44:32.098662] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.490 [2024-11-21 03:44:32.098676] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.490 [2024-11-21 03:44:32.098689] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:51.490 [2024-11-21 03:44:32.098720] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:51.490 qpair failed and we were unable to recover it. 00:27:51.490 [2024-11-21 03:44:32.108524] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.490 [2024-11-21 03:44:32.108648] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.490 [2024-11-21 03:44:32.108674] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.490 [2024-11-21 03:44:32.108688] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.490 [2024-11-21 03:44:32.108707] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:51.490 [2024-11-21 03:44:32.108736] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:51.490 qpair failed and we were unable to recover it. 00:27:51.490 [2024-11-21 03:44:32.118549] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.490 [2024-11-21 03:44:32.118690] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.490 [2024-11-21 03:44:32.118715] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.490 [2024-11-21 03:44:32.118729] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.490 [2024-11-21 03:44:32.118741] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:51.490 [2024-11-21 03:44:32.118772] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:51.490 qpair failed and we were unable to recover it. 00:27:51.490 [2024-11-21 03:44:32.128591] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.490 [2024-11-21 03:44:32.128717] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.490 [2024-11-21 03:44:32.128743] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.490 [2024-11-21 03:44:32.128757] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.490 [2024-11-21 03:44:32.128770] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:51.490 [2024-11-21 03:44:32.128801] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:51.490 qpair failed and we were unable to recover it. 00:27:51.750 [2024-11-21 03:44:32.138605] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.750 [2024-11-21 03:44:32.138712] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.750 [2024-11-21 03:44:32.138738] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.750 [2024-11-21 03:44:32.138752] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.750 [2024-11-21 03:44:32.138765] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:51.750 [2024-11-21 03:44:32.138794] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:51.750 qpair failed and we were unable to recover it. 00:27:51.750 [2024-11-21 03:44:32.148644] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.750 [2024-11-21 03:44:32.148753] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.750 [2024-11-21 03:44:32.148779] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.750 [2024-11-21 03:44:32.148793] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.750 [2024-11-21 03:44:32.148807] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:51.750 [2024-11-21 03:44:32.148849] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:51.750 qpair failed and we were unable to recover it. 00:27:51.750 [2024-11-21 03:44:32.158746] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.750 [2024-11-21 03:44:32.158849] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.750 [2024-11-21 03:44:32.158875] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.750 [2024-11-21 03:44:32.158889] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.750 [2024-11-21 03:44:32.158902] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:51.750 [2024-11-21 03:44:32.158931] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:51.750 qpair failed and we were unable to recover it. 00:27:51.750 [2024-11-21 03:44:32.168696] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.750 [2024-11-21 03:44:32.168809] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.750 [2024-11-21 03:44:32.168834] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.750 [2024-11-21 03:44:32.168848] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.750 [2024-11-21 03:44:32.168861] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:51.750 [2024-11-21 03:44:32.168891] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:51.750 qpair failed and we were unable to recover it. 00:27:51.750 [2024-11-21 03:44:32.178751] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.750 [2024-11-21 03:44:32.178857] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.750 [2024-11-21 03:44:32.178888] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.750 [2024-11-21 03:44:32.178902] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.750 [2024-11-21 03:44:32.178916] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:51.750 [2024-11-21 03:44:32.178945] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:51.750 qpair failed and we were unable to recover it. 00:27:51.750 [2024-11-21 03:44:32.188769] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.750 [2024-11-21 03:44:32.188875] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.750 [2024-11-21 03:44:32.188901] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.750 [2024-11-21 03:44:32.188915] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.750 [2024-11-21 03:44:32.188928] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:51.750 [2024-11-21 03:44:32.188969] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:51.750 qpair failed and we were unable to recover it. 00:27:51.750 [2024-11-21 03:44:32.198776] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.750 [2024-11-21 03:44:32.198888] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.750 [2024-11-21 03:44:32.198914] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.750 [2024-11-21 03:44:32.198929] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.750 [2024-11-21 03:44:32.198943] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:51.750 [2024-11-21 03:44:32.198973] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:51.750 qpair failed and we were unable to recover it. 00:27:51.750 [2024-11-21 03:44:32.208836] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.750 [2024-11-21 03:44:32.208939] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.750 [2024-11-21 03:44:32.208964] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.750 [2024-11-21 03:44:32.208978] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.750 [2024-11-21 03:44:32.208991] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:51.750 [2024-11-21 03:44:32.209023] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:51.750 qpair failed and we were unable to recover it. 00:27:51.750 [2024-11-21 03:44:32.218905] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.750 [2024-11-21 03:44:32.219060] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.750 [2024-11-21 03:44:32.219094] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.750 [2024-11-21 03:44:32.219109] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.750 [2024-11-21 03:44:32.219122] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:51.750 [2024-11-21 03:44:32.219158] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:51.750 qpair failed and we were unable to recover it. 00:27:51.750 [2024-11-21 03:44:32.228858] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.750 [2024-11-21 03:44:32.228962] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.751 [2024-11-21 03:44:32.228987] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.751 [2024-11-21 03:44:32.229001] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.751 [2024-11-21 03:44:32.229014] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:51.751 [2024-11-21 03:44:32.229045] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:51.751 qpair failed and we were unable to recover it. 00:27:51.751 [2024-11-21 03:44:32.238914] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.751 [2024-11-21 03:44:32.239043] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.751 [2024-11-21 03:44:32.239076] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.751 [2024-11-21 03:44:32.239093] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.751 [2024-11-21 03:44:32.239106] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:51.751 [2024-11-21 03:44:32.239136] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:51.751 qpair failed and we were unable to recover it. 00:27:51.751 [2024-11-21 03:44:32.248953] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.751 [2024-11-21 03:44:32.249057] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.751 [2024-11-21 03:44:32.249090] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.751 [2024-11-21 03:44:32.249105] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.751 [2024-11-21 03:44:32.249118] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:51.751 [2024-11-21 03:44:32.249148] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:51.751 qpair failed and we were unable to recover it. 00:27:51.751 [2024-11-21 03:44:32.258997] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.751 [2024-11-21 03:44:32.259115] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.751 [2024-11-21 03:44:32.259141] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.751 [2024-11-21 03:44:32.259155] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.751 [2024-11-21 03:44:32.259167] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:51.751 [2024-11-21 03:44:32.259197] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:51.751 qpair failed and we were unable to recover it. 00:27:51.751 [2024-11-21 03:44:32.269039] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.751 [2024-11-21 03:44:32.269154] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.751 [2024-11-21 03:44:32.269185] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.751 [2024-11-21 03:44:32.269200] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.751 [2024-11-21 03:44:32.269213] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:51.751 [2024-11-21 03:44:32.269243] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:51.751 qpair failed and we were unable to recover it. 00:27:51.751 [2024-11-21 03:44:32.279006] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.751 [2024-11-21 03:44:32.279108] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.751 [2024-11-21 03:44:32.279134] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.751 [2024-11-21 03:44:32.279148] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.751 [2024-11-21 03:44:32.279161] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:51.751 [2024-11-21 03:44:32.279193] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:51.751 qpair failed and we were unable to recover it. 00:27:51.751 [2024-11-21 03:44:32.289055] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.751 [2024-11-21 03:44:32.289176] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.751 [2024-11-21 03:44:32.289201] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.751 [2024-11-21 03:44:32.289216] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.751 [2024-11-21 03:44:32.289228] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:51.751 [2024-11-21 03:44:32.289257] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:51.751 qpair failed and we were unable to recover it. 00:27:51.751 [2024-11-21 03:44:32.299149] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.751 [2024-11-21 03:44:32.299291] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.751 [2024-11-21 03:44:32.299317] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.751 [2024-11-21 03:44:32.299331] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.751 [2024-11-21 03:44:32.299343] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:51.751 [2024-11-21 03:44:32.299373] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:51.751 qpair failed and we were unable to recover it. 00:27:51.751 [2024-11-21 03:44:32.309126] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.751 [2024-11-21 03:44:32.309231] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.751 [2024-11-21 03:44:32.309256] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.751 [2024-11-21 03:44:32.309270] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.751 [2024-11-21 03:44:32.309288] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:51.751 [2024-11-21 03:44:32.309319] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:51.751 qpair failed and we were unable to recover it. 00:27:51.751 [2024-11-21 03:44:32.319148] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.751 [2024-11-21 03:44:32.319259] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.751 [2024-11-21 03:44:32.319285] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.751 [2024-11-21 03:44:32.319299] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.751 [2024-11-21 03:44:32.319313] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:51.751 [2024-11-21 03:44:32.319343] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:51.751 qpair failed and we were unable to recover it. 00:27:51.751 [2024-11-21 03:44:32.329203] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.751 [2024-11-21 03:44:32.329305] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.751 [2024-11-21 03:44:32.329330] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.751 [2024-11-21 03:44:32.329344] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.751 [2024-11-21 03:44:32.329357] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:51.751 [2024-11-21 03:44:32.329387] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:51.751 qpair failed and we were unable to recover it. 00:27:51.751 [2024-11-21 03:44:32.339288] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.751 [2024-11-21 03:44:32.339394] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.751 [2024-11-21 03:44:32.339419] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.751 [2024-11-21 03:44:32.339433] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.751 [2024-11-21 03:44:32.339446] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:51.751 [2024-11-21 03:44:32.339475] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:51.751 qpair failed and we were unable to recover it. 00:27:51.751 [2024-11-21 03:44:32.349218] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.751 [2024-11-21 03:44:32.349326] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.751 [2024-11-21 03:44:32.349351] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.751 [2024-11-21 03:44:32.349365] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.751 [2024-11-21 03:44:32.349378] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:51.751 [2024-11-21 03:44:32.349407] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:51.751 qpair failed and we were unable to recover it. 00:27:51.751 [2024-11-21 03:44:32.359265] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.751 [2024-11-21 03:44:32.359369] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.751 [2024-11-21 03:44:32.359394] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.751 [2024-11-21 03:44:32.359409] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.751 [2024-11-21 03:44:32.359422] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:51.752 [2024-11-21 03:44:32.359451] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:51.752 qpair failed and we were unable to recover it. 00:27:51.752 [2024-11-21 03:44:32.369371] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.752 [2024-11-21 03:44:32.369470] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.752 [2024-11-21 03:44:32.369495] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.752 [2024-11-21 03:44:32.369509] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.752 [2024-11-21 03:44:32.369522] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:51.752 [2024-11-21 03:44:32.369553] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:51.752 qpair failed and we were unable to recover it. 00:27:51.752 [2024-11-21 03:44:32.379333] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.752 [2024-11-21 03:44:32.379473] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.752 [2024-11-21 03:44:32.379498] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.752 [2024-11-21 03:44:32.379512] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.752 [2024-11-21 03:44:32.379524] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:51.752 [2024-11-21 03:44:32.379553] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:51.752 qpair failed and we were unable to recover it. 00:27:51.752 [2024-11-21 03:44:32.389404] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:51.752 [2024-11-21 03:44:32.389506] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:51.752 [2024-11-21 03:44:32.389531] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:51.752 [2024-11-21 03:44:32.389545] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:51.752 [2024-11-21 03:44:32.389558] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:51.752 [2024-11-21 03:44:32.389589] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:51.752 qpair failed and we were unable to recover it. 00:27:52.010 [2024-11-21 03:44:32.399389] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.010 [2024-11-21 03:44:32.399508] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.010 [2024-11-21 03:44:32.399533] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.010 [2024-11-21 03:44:32.399547] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.010 [2024-11-21 03:44:32.399566] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.010 [2024-11-21 03:44:32.399597] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.010 qpair failed and we were unable to recover it. 00:27:52.010 [2024-11-21 03:44:32.409388] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.010 [2024-11-21 03:44:32.409497] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.010 [2024-11-21 03:44:32.409523] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.010 [2024-11-21 03:44:32.409536] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.010 [2024-11-21 03:44:32.409549] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.010 [2024-11-21 03:44:32.409581] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.011 qpair failed and we were unable to recover it. 00:27:52.011 [2024-11-21 03:44:32.419432] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.011 [2024-11-21 03:44:32.419540] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.011 [2024-11-21 03:44:32.419566] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.011 [2024-11-21 03:44:32.419580] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.011 [2024-11-21 03:44:32.419593] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.011 [2024-11-21 03:44:32.419623] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.011 qpair failed and we were unable to recover it. 00:27:52.011 [2024-11-21 03:44:32.429437] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.011 [2024-11-21 03:44:32.429542] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.011 [2024-11-21 03:44:32.429567] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.011 [2024-11-21 03:44:32.429581] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.011 [2024-11-21 03:44:32.429594] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.011 [2024-11-21 03:44:32.429623] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.011 qpair failed and we were unable to recover it. 00:27:52.011 [2024-11-21 03:44:32.439494] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.011 [2024-11-21 03:44:32.439601] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.011 [2024-11-21 03:44:32.439627] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.011 [2024-11-21 03:44:32.439641] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.011 [2024-11-21 03:44:32.439654] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.011 [2024-11-21 03:44:32.439683] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.011 qpair failed and we were unable to recover it. 00:27:52.011 [2024-11-21 03:44:32.449539] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.011 [2024-11-21 03:44:32.449668] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.011 [2024-11-21 03:44:32.449695] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.011 [2024-11-21 03:44:32.449709] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.011 [2024-11-21 03:44:32.449722] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.011 [2024-11-21 03:44:32.449751] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.011 qpair failed and we were unable to recover it. 00:27:52.011 [2024-11-21 03:44:32.459577] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.011 [2024-11-21 03:44:32.459686] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.011 [2024-11-21 03:44:32.459712] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.011 [2024-11-21 03:44:32.459726] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.011 [2024-11-21 03:44:32.459740] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.011 [2024-11-21 03:44:32.459770] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.011 qpair failed and we were unable to recover it. 00:27:52.011 [2024-11-21 03:44:32.469690] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.011 [2024-11-21 03:44:32.469842] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.011 [2024-11-21 03:44:32.469869] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.011 [2024-11-21 03:44:32.469885] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.011 [2024-11-21 03:44:32.469902] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.011 [2024-11-21 03:44:32.469933] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.011 qpair failed and we were unable to recover it. 00:27:52.011 [2024-11-21 03:44:32.479629] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.011 [2024-11-21 03:44:32.479744] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.011 [2024-11-21 03:44:32.479770] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.011 [2024-11-21 03:44:32.479785] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.011 [2024-11-21 03:44:32.479798] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.011 [2024-11-21 03:44:32.479828] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.011 qpair failed and we were unable to recover it. 00:27:52.011 [2024-11-21 03:44:32.489643] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.011 [2024-11-21 03:44:32.489745] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.011 [2024-11-21 03:44:32.489771] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.011 [2024-11-21 03:44:32.489791] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.011 [2024-11-21 03:44:32.489804] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.011 [2024-11-21 03:44:32.489834] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.011 qpair failed and we were unable to recover it. 00:27:52.011 [2024-11-21 03:44:32.499696] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.011 [2024-11-21 03:44:32.499812] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.011 [2024-11-21 03:44:32.499839] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.011 [2024-11-21 03:44:32.499853] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.011 [2024-11-21 03:44:32.499866] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.011 [2024-11-21 03:44:32.499912] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.011 qpair failed and we were unable to recover it. 00:27:52.011 [2024-11-21 03:44:32.509683] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.011 [2024-11-21 03:44:32.509788] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.011 [2024-11-21 03:44:32.509814] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.011 [2024-11-21 03:44:32.509829] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.011 [2024-11-21 03:44:32.509842] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.011 [2024-11-21 03:44:32.509872] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.011 qpair failed and we were unable to recover it. 00:27:52.011 [2024-11-21 03:44:32.519720] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.011 [2024-11-21 03:44:32.519849] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.011 [2024-11-21 03:44:32.519875] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.011 [2024-11-21 03:44:32.519889] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.011 [2024-11-21 03:44:32.519902] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.011 [2024-11-21 03:44:32.519931] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.011 qpair failed and we were unable to recover it. 00:27:52.011 [2024-11-21 03:44:32.529760] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.012 [2024-11-21 03:44:32.529866] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.012 [2024-11-21 03:44:32.529895] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.012 [2024-11-21 03:44:32.529909] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.012 [2024-11-21 03:44:32.529922] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.012 [2024-11-21 03:44:32.529954] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.012 qpair failed and we were unable to recover it. 00:27:52.012 [2024-11-21 03:44:32.539778] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.012 [2024-11-21 03:44:32.539902] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.012 [2024-11-21 03:44:32.539928] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.012 [2024-11-21 03:44:32.539943] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.012 [2024-11-21 03:44:32.539956] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.012 [2024-11-21 03:44:32.539987] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.012 qpair failed and we were unable to recover it. 00:27:52.012 [2024-11-21 03:44:32.549800] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.012 [2024-11-21 03:44:32.549927] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.012 [2024-11-21 03:44:32.549953] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.012 [2024-11-21 03:44:32.549967] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.012 [2024-11-21 03:44:32.549980] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.012 [2024-11-21 03:44:32.550009] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.012 qpair failed and we were unable to recover it. 00:27:52.012 [2024-11-21 03:44:32.559945] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.012 [2024-11-21 03:44:32.560082] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.012 [2024-11-21 03:44:32.560108] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.012 [2024-11-21 03:44:32.560122] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.012 [2024-11-21 03:44:32.560135] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.012 [2024-11-21 03:44:32.560165] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.012 qpair failed and we were unable to recover it. 00:27:52.012 [2024-11-21 03:44:32.569855] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.012 [2024-11-21 03:44:32.569960] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.012 [2024-11-21 03:44:32.569986] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.012 [2024-11-21 03:44:32.570000] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.012 [2024-11-21 03:44:32.570014] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.012 [2024-11-21 03:44:32.570045] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.012 qpair failed and we were unable to recover it. 00:27:52.012 [2024-11-21 03:44:32.580023] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.012 [2024-11-21 03:44:32.580154] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.012 [2024-11-21 03:44:32.580181] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.012 [2024-11-21 03:44:32.580201] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.012 [2024-11-21 03:44:32.580214] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.012 [2024-11-21 03:44:32.580245] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.012 qpair failed and we were unable to recover it. 00:27:52.012 [2024-11-21 03:44:32.589911] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.012 [2024-11-21 03:44:32.590018] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.012 [2024-11-21 03:44:32.590043] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.012 [2024-11-21 03:44:32.590057] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.012 [2024-11-21 03:44:32.590078] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.012 [2024-11-21 03:44:32.590110] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.012 qpair failed and we were unable to recover it. 00:27:52.012 [2024-11-21 03:44:32.600017] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.012 [2024-11-21 03:44:32.600117] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.012 [2024-11-21 03:44:32.600142] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.012 [2024-11-21 03:44:32.600157] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.012 [2024-11-21 03:44:32.600170] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.012 [2024-11-21 03:44:32.600199] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.012 qpair failed and we were unable to recover it. 00:27:52.012 [2024-11-21 03:44:32.610004] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.012 [2024-11-21 03:44:32.610114] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.012 [2024-11-21 03:44:32.610141] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.012 [2024-11-21 03:44:32.610156] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.012 [2024-11-21 03:44:32.610168] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.012 [2024-11-21 03:44:32.610197] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.012 qpair failed and we were unable to recover it. 00:27:52.012 [2024-11-21 03:44:32.620016] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.012 [2024-11-21 03:44:32.620127] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.012 [2024-11-21 03:44:32.620154] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.012 [2024-11-21 03:44:32.620169] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.012 [2024-11-21 03:44:32.620182] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.012 [2024-11-21 03:44:32.620224] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.012 qpair failed and we were unable to recover it. 00:27:52.012 [2024-11-21 03:44:32.630031] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.012 [2024-11-21 03:44:32.630138] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.012 [2024-11-21 03:44:32.630164] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.012 [2024-11-21 03:44:32.630179] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.012 [2024-11-21 03:44:32.630193] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.012 [2024-11-21 03:44:32.630235] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.012 qpair failed and we were unable to recover it. 00:27:52.012 [2024-11-21 03:44:32.640056] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.012 [2024-11-21 03:44:32.640170] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.013 [2024-11-21 03:44:32.640196] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.013 [2024-11-21 03:44:32.640211] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.013 [2024-11-21 03:44:32.640224] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.013 [2024-11-21 03:44:32.640267] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.013 qpair failed and we were unable to recover it. 00:27:52.013 [2024-11-21 03:44:32.650065] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.013 [2024-11-21 03:44:32.650172] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.013 [2024-11-21 03:44:32.650197] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.013 [2024-11-21 03:44:32.650211] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.013 [2024-11-21 03:44:32.650223] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.013 [2024-11-21 03:44:32.650252] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.013 qpair failed and we were unable to recover it. 00:27:52.272 [2024-11-21 03:44:32.660141] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.272 [2024-11-21 03:44:32.660257] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.272 [2024-11-21 03:44:32.660283] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.272 [2024-11-21 03:44:32.660298] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.272 [2024-11-21 03:44:32.660311] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.272 [2024-11-21 03:44:32.660341] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.272 qpair failed and we were unable to recover it. 00:27:52.272 [2024-11-21 03:44:32.670186] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.272 [2024-11-21 03:44:32.670298] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.272 [2024-11-21 03:44:32.670329] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.272 [2024-11-21 03:44:32.670344] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.272 [2024-11-21 03:44:32.670357] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.272 [2024-11-21 03:44:32.670387] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.272 qpair failed and we were unable to recover it. 00:27:52.272 [2024-11-21 03:44:32.680215] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.272 [2024-11-21 03:44:32.680371] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.272 [2024-11-21 03:44:32.680400] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.272 [2024-11-21 03:44:32.680416] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.272 [2024-11-21 03:44:32.680429] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.272 [2024-11-21 03:44:32.680460] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.272 qpair failed and we were unable to recover it. 00:27:52.272 [2024-11-21 03:44:32.690297] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.272 [2024-11-21 03:44:32.690401] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.272 [2024-11-21 03:44:32.690427] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.272 [2024-11-21 03:44:32.690442] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.272 [2024-11-21 03:44:32.690454] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.272 [2024-11-21 03:44:32.690485] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.272 qpair failed and we were unable to recover it. 00:27:52.272 [2024-11-21 03:44:32.700267] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.272 [2024-11-21 03:44:32.700378] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.272 [2024-11-21 03:44:32.700404] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.272 [2024-11-21 03:44:32.700418] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.272 [2024-11-21 03:44:32.700431] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.272 [2024-11-21 03:44:32.700460] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.272 qpair failed and we were unable to recover it. 00:27:52.272 [2024-11-21 03:44:32.710264] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.272 [2024-11-21 03:44:32.710368] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.272 [2024-11-21 03:44:32.710394] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.272 [2024-11-21 03:44:32.710409] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.272 [2024-11-21 03:44:32.710422] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.272 [2024-11-21 03:44:32.710470] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.272 qpair failed and we were unable to recover it. 00:27:52.272 [2024-11-21 03:44:32.720311] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.272 [2024-11-21 03:44:32.720420] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.272 [2024-11-21 03:44:32.720445] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.272 [2024-11-21 03:44:32.720459] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.272 [2024-11-21 03:44:32.720473] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.272 [2024-11-21 03:44:32.720502] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.272 qpair failed and we were unable to recover it. 00:27:52.272 [2024-11-21 03:44:32.730405] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.272 [2024-11-21 03:44:32.730539] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.272 [2024-11-21 03:44:32.730565] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.272 [2024-11-21 03:44:32.730578] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.272 [2024-11-21 03:44:32.730591] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.272 [2024-11-21 03:44:32.730620] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.272 qpair failed and we were unable to recover it. 00:27:52.272 [2024-11-21 03:44:32.740466] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.272 [2024-11-21 03:44:32.740581] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.272 [2024-11-21 03:44:32.740607] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.272 [2024-11-21 03:44:32.740621] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.272 [2024-11-21 03:44:32.740634] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.272 [2024-11-21 03:44:32.740665] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.272 qpair failed and we were unable to recover it. 00:27:52.272 [2024-11-21 03:44:32.750366] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.272 [2024-11-21 03:44:32.750477] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.272 [2024-11-21 03:44:32.750503] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.272 [2024-11-21 03:44:32.750517] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.272 [2024-11-21 03:44:32.750530] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.273 [2024-11-21 03:44:32.750559] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.273 qpair failed and we were unable to recover it. 00:27:52.273 [2024-11-21 03:44:32.760406] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.273 [2024-11-21 03:44:32.760511] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.273 [2024-11-21 03:44:32.760544] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.273 [2024-11-21 03:44:32.760558] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.273 [2024-11-21 03:44:32.760570] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.273 [2024-11-21 03:44:32.760599] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.273 qpair failed and we were unable to recover it. 00:27:52.273 [2024-11-21 03:44:32.770441] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.273 [2024-11-21 03:44:32.770545] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.273 [2024-11-21 03:44:32.770571] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.273 [2024-11-21 03:44:32.770586] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.273 [2024-11-21 03:44:32.770599] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.273 [2024-11-21 03:44:32.770640] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.273 qpair failed and we were unable to recover it. 00:27:52.273 [2024-11-21 03:44:32.780503] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.273 [2024-11-21 03:44:32.780659] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.273 [2024-11-21 03:44:32.780685] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.273 [2024-11-21 03:44:32.780699] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.273 [2024-11-21 03:44:32.780712] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.273 [2024-11-21 03:44:32.780743] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.273 qpair failed and we were unable to recover it. 00:27:52.273 [2024-11-21 03:44:32.790489] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.273 [2024-11-21 03:44:32.790591] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.273 [2024-11-21 03:44:32.790616] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.273 [2024-11-21 03:44:32.790630] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.273 [2024-11-21 03:44:32.790643] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.273 [2024-11-21 03:44:32.790674] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.273 qpair failed and we were unable to recover it. 00:27:52.273 [2024-11-21 03:44:32.800511] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.273 [2024-11-21 03:44:32.800613] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.273 [2024-11-21 03:44:32.800639] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.273 [2024-11-21 03:44:32.800653] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.273 [2024-11-21 03:44:32.800678] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.273 [2024-11-21 03:44:32.800709] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.273 qpair failed and we were unable to recover it. 00:27:52.273 [2024-11-21 03:44:32.810582] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.273 [2024-11-21 03:44:32.810709] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.273 [2024-11-21 03:44:32.810734] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.273 [2024-11-21 03:44:32.810748] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.273 [2024-11-21 03:44:32.810760] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.273 [2024-11-21 03:44:32.810791] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.273 qpair failed and we were unable to recover it. 00:27:52.273 [2024-11-21 03:44:32.820614] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.273 [2024-11-21 03:44:32.820732] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.273 [2024-11-21 03:44:32.820757] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.273 [2024-11-21 03:44:32.820772] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.273 [2024-11-21 03:44:32.820784] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.273 [2024-11-21 03:44:32.820814] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.273 qpair failed and we were unable to recover it. 00:27:52.273 [2024-11-21 03:44:32.830650] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.273 [2024-11-21 03:44:32.830759] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.273 [2024-11-21 03:44:32.830784] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.273 [2024-11-21 03:44:32.830799] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.273 [2024-11-21 03:44:32.830812] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.273 [2024-11-21 03:44:32.830842] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.273 qpair failed and we were unable to recover it. 00:27:52.273 [2024-11-21 03:44:32.840624] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.273 [2024-11-21 03:44:32.840726] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.273 [2024-11-21 03:44:32.840751] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.273 [2024-11-21 03:44:32.840765] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.273 [2024-11-21 03:44:32.840777] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.273 [2024-11-21 03:44:32.840808] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.273 qpair failed and we were unable to recover it. 00:27:52.273 [2024-11-21 03:44:32.850751] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.273 [2024-11-21 03:44:32.850858] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.273 [2024-11-21 03:44:32.850884] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.273 [2024-11-21 03:44:32.850898] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.273 [2024-11-21 03:44:32.850911] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.273 [2024-11-21 03:44:32.850942] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.273 qpair failed and we were unable to recover it. 00:27:52.273 [2024-11-21 03:44:32.860794] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.273 [2024-11-21 03:44:32.860908] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.273 [2024-11-21 03:44:32.860933] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.273 [2024-11-21 03:44:32.860947] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.273 [2024-11-21 03:44:32.860960] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.273 [2024-11-21 03:44:32.860988] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.273 qpair failed and we were unable to recover it. 00:27:52.273 [2024-11-21 03:44:32.870716] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.273 [2024-11-21 03:44:32.870823] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.273 [2024-11-21 03:44:32.870848] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.273 [2024-11-21 03:44:32.870862] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.273 [2024-11-21 03:44:32.870874] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.273 [2024-11-21 03:44:32.870904] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.273 qpair failed and we were unable to recover it. 00:27:52.273 [2024-11-21 03:44:32.880753] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.273 [2024-11-21 03:44:32.880897] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.273 [2024-11-21 03:44:32.880923] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.273 [2024-11-21 03:44:32.880938] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.273 [2024-11-21 03:44:32.880950] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.273 [2024-11-21 03:44:32.880979] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.273 qpair failed and we were unable to recover it. 00:27:52.273 [2024-11-21 03:44:32.890809] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.273 [2024-11-21 03:44:32.890911] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.274 [2024-11-21 03:44:32.890938] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.274 [2024-11-21 03:44:32.890953] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.274 [2024-11-21 03:44:32.890976] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.274 [2024-11-21 03:44:32.891022] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.274 qpair failed and we were unable to recover it. 00:27:52.274 [2024-11-21 03:44:32.900824] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.274 [2024-11-21 03:44:32.900928] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.274 [2024-11-21 03:44:32.900954] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.274 [2024-11-21 03:44:32.900968] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.274 [2024-11-21 03:44:32.900981] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.274 [2024-11-21 03:44:32.901012] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.274 qpair failed and we were unable to recover it. 00:27:52.274 [2024-11-21 03:44:32.910921] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.274 [2024-11-21 03:44:32.911022] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.274 [2024-11-21 03:44:32.911047] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.274 [2024-11-21 03:44:32.911061] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.274 [2024-11-21 03:44:32.911081] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.274 [2024-11-21 03:44:32.911113] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.274 qpair failed and we were unable to recover it. 00:27:52.535 [2024-11-21 03:44:32.920879] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.535 [2024-11-21 03:44:32.920988] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.535 [2024-11-21 03:44:32.921014] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.535 [2024-11-21 03:44:32.921027] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.535 [2024-11-21 03:44:32.921040] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.535 [2024-11-21 03:44:32.921079] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.535 qpair failed and we were unable to recover it. 00:27:52.535 [2024-11-21 03:44:32.930907] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.535 [2024-11-21 03:44:32.931035] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.535 [2024-11-21 03:44:32.931060] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.535 [2024-11-21 03:44:32.931082] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.535 [2024-11-21 03:44:32.931097] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.535 [2024-11-21 03:44:32.931126] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.535 qpair failed and we were unable to recover it. 00:27:52.535 [2024-11-21 03:44:32.940944] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.535 [2024-11-21 03:44:32.941061] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.535 [2024-11-21 03:44:32.941098] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.535 [2024-11-21 03:44:32.941113] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.535 [2024-11-21 03:44:32.941126] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.535 [2024-11-21 03:44:32.941154] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.535 qpair failed and we were unable to recover it. 00:27:52.535 [2024-11-21 03:44:32.950954] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.535 [2024-11-21 03:44:32.951102] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.535 [2024-11-21 03:44:32.951134] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.535 [2024-11-21 03:44:32.951152] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.535 [2024-11-21 03:44:32.951166] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.535 [2024-11-21 03:44:32.951196] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.535 qpair failed and we were unable to recover it. 00:27:52.535 [2024-11-21 03:44:32.961057] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.535 [2024-11-21 03:44:32.961211] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.535 [2024-11-21 03:44:32.961237] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.535 [2024-11-21 03:44:32.961252] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.535 [2024-11-21 03:44:32.961264] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.535 [2024-11-21 03:44:32.961293] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.535 qpair failed and we were unable to recover it. 00:27:52.535 [2024-11-21 03:44:32.971032] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.535 [2024-11-21 03:44:32.971146] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.535 [2024-11-21 03:44:32.971172] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.535 [2024-11-21 03:44:32.971186] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.535 [2024-11-21 03:44:32.971198] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.535 [2024-11-21 03:44:32.971228] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.535 qpair failed and we were unable to recover it. 00:27:52.535 [2024-11-21 03:44:32.981042] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.535 [2024-11-21 03:44:32.981155] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.535 [2024-11-21 03:44:32.981181] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.535 [2024-11-21 03:44:32.981202] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.535 [2024-11-21 03:44:32.981216] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.535 [2024-11-21 03:44:32.981247] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.535 qpair failed and we were unable to recover it. 00:27:52.535 [2024-11-21 03:44:32.991122] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.535 [2024-11-21 03:44:32.991257] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.535 [2024-11-21 03:44:32.991283] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.535 [2024-11-21 03:44:32.991297] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.535 [2024-11-21 03:44:32.991310] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.535 [2024-11-21 03:44:32.991339] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.535 qpair failed and we were unable to recover it. 00:27:52.535 [2024-11-21 03:44:33.001132] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.535 [2024-11-21 03:44:33.001282] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.535 [2024-11-21 03:44:33.001308] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.535 [2024-11-21 03:44:33.001322] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.535 [2024-11-21 03:44:33.001336] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.535 [2024-11-21 03:44:33.001367] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.535 qpair failed and we were unable to recover it. 00:27:52.535 [2024-11-21 03:44:33.011162] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.535 [2024-11-21 03:44:33.011284] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.535 [2024-11-21 03:44:33.011310] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.535 [2024-11-21 03:44:33.011323] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.535 [2024-11-21 03:44:33.011337] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.535 [2024-11-21 03:44:33.011367] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.535 qpair failed and we were unable to recover it. 00:27:52.535 [2024-11-21 03:44:33.021160] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.535 [2024-11-21 03:44:33.021263] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.535 [2024-11-21 03:44:33.021288] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.536 [2024-11-21 03:44:33.021302] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.536 [2024-11-21 03:44:33.021315] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.536 [2024-11-21 03:44:33.021345] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.536 qpair failed and we were unable to recover it. 00:27:52.536 [2024-11-21 03:44:33.031275] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.536 [2024-11-21 03:44:33.031381] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.536 [2024-11-21 03:44:33.031406] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.536 [2024-11-21 03:44:33.031419] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.536 [2024-11-21 03:44:33.031432] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.536 [2024-11-21 03:44:33.031461] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.536 qpair failed and we were unable to recover it. 00:27:52.536 [2024-11-21 03:44:33.041267] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.536 [2024-11-21 03:44:33.041385] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.536 [2024-11-21 03:44:33.041411] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.536 [2024-11-21 03:44:33.041426] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.536 [2024-11-21 03:44:33.041439] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.536 [2024-11-21 03:44:33.041467] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.536 qpair failed and we were unable to recover it. 00:27:52.536 [2024-11-21 03:44:33.051234] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.536 [2024-11-21 03:44:33.051338] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.536 [2024-11-21 03:44:33.051363] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.536 [2024-11-21 03:44:33.051377] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.536 [2024-11-21 03:44:33.051392] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.536 [2024-11-21 03:44:33.051422] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.536 qpair failed and we were unable to recover it. 00:27:52.536 [2024-11-21 03:44:33.061304] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.536 [2024-11-21 03:44:33.061430] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.536 [2024-11-21 03:44:33.061455] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.536 [2024-11-21 03:44:33.061468] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.536 [2024-11-21 03:44:33.061481] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.536 [2024-11-21 03:44:33.061512] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.536 qpair failed and we were unable to recover it. 00:27:52.536 [2024-11-21 03:44:33.071372] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.536 [2024-11-21 03:44:33.071492] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.536 [2024-11-21 03:44:33.071517] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.536 [2024-11-21 03:44:33.071537] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.536 [2024-11-21 03:44:33.071551] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.536 [2024-11-21 03:44:33.071582] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.536 qpair failed and we were unable to recover it. 00:27:52.536 [2024-11-21 03:44:33.081342] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.536 [2024-11-21 03:44:33.081475] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.536 [2024-11-21 03:44:33.081500] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.536 [2024-11-21 03:44:33.081515] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.536 [2024-11-21 03:44:33.081527] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.536 [2024-11-21 03:44:33.081556] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.536 qpair failed and we were unable to recover it. 00:27:52.536 [2024-11-21 03:44:33.091376] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.536 [2024-11-21 03:44:33.091480] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.536 [2024-11-21 03:44:33.091505] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.536 [2024-11-21 03:44:33.091519] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.536 [2024-11-21 03:44:33.091532] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.536 [2024-11-21 03:44:33.091562] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.536 qpair failed and we were unable to recover it. 00:27:52.536 [2024-11-21 03:44:33.101450] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.536 [2024-11-21 03:44:33.101560] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.536 [2024-11-21 03:44:33.101586] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.536 [2024-11-21 03:44:33.101600] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.536 [2024-11-21 03:44:33.101612] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.536 [2024-11-21 03:44:33.101641] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.536 qpair failed and we were unable to recover it. 00:27:52.536 [2024-11-21 03:44:33.111501] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.536 [2024-11-21 03:44:33.111602] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.536 [2024-11-21 03:44:33.111628] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.536 [2024-11-21 03:44:33.111642] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.536 [2024-11-21 03:44:33.111654] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.536 [2024-11-21 03:44:33.111683] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.536 qpair failed and we were unable to recover it. 00:27:52.536 [2024-11-21 03:44:33.121452] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.536 [2024-11-21 03:44:33.121548] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.536 [2024-11-21 03:44:33.121574] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.536 [2024-11-21 03:44:33.121587] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.536 [2024-11-21 03:44:33.121600] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.536 [2024-11-21 03:44:33.121629] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.536 qpair failed and we were unable to recover it. 00:27:52.536 [2024-11-21 03:44:33.131488] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.536 [2024-11-21 03:44:33.131588] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.536 [2024-11-21 03:44:33.131613] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.536 [2024-11-21 03:44:33.131627] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.536 [2024-11-21 03:44:33.131640] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.536 [2024-11-21 03:44:33.131670] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.536 qpair failed and we were unable to recover it. 00:27:52.536 [2024-11-21 03:44:33.141599] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.536 [2024-11-21 03:44:33.141704] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.536 [2024-11-21 03:44:33.141729] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.536 [2024-11-21 03:44:33.141743] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.536 [2024-11-21 03:44:33.141756] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.536 [2024-11-21 03:44:33.141784] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.536 qpair failed and we were unable to recover it. 00:27:52.536 [2024-11-21 03:44:33.151612] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.536 [2024-11-21 03:44:33.151762] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.536 [2024-11-21 03:44:33.151788] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.536 [2024-11-21 03:44:33.151802] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.537 [2024-11-21 03:44:33.151815] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.537 [2024-11-21 03:44:33.151858] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.537 qpair failed and we were unable to recover it. 00:27:52.537 [2024-11-21 03:44:33.161578] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.537 [2024-11-21 03:44:33.161687] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.537 [2024-11-21 03:44:33.161719] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.537 [2024-11-21 03:44:33.161735] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.537 [2024-11-21 03:44:33.161748] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.537 [2024-11-21 03:44:33.161777] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.537 qpair failed and we were unable to recover it. 00:27:52.537 [2024-11-21 03:44:33.171682] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.537 [2024-11-21 03:44:33.171787] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.537 [2024-11-21 03:44:33.171813] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.537 [2024-11-21 03:44:33.171828] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.537 [2024-11-21 03:44:33.171841] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.537 [2024-11-21 03:44:33.171870] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.537 qpair failed and we were unable to recover it. 00:27:52.798 [2024-11-21 03:44:33.181713] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.798 [2024-11-21 03:44:33.181822] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.798 [2024-11-21 03:44:33.181848] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.798 [2024-11-21 03:44:33.181863] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.798 [2024-11-21 03:44:33.181876] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.798 [2024-11-21 03:44:33.181905] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.798 qpair failed and we were unable to recover it. 00:27:52.798 [2024-11-21 03:44:33.191647] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.798 [2024-11-21 03:44:33.191748] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.798 [2024-11-21 03:44:33.191775] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.798 [2024-11-21 03:44:33.191789] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.798 [2024-11-21 03:44:33.191802] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.798 [2024-11-21 03:44:33.191831] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.798 qpair failed and we were unable to recover it. 00:27:52.798 [2024-11-21 03:44:33.201695] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.798 [2024-11-21 03:44:33.201809] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.798 [2024-11-21 03:44:33.201835] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.798 [2024-11-21 03:44:33.201849] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.798 [2024-11-21 03:44:33.201862] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.798 [2024-11-21 03:44:33.201899] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.798 qpair failed and we were unable to recover it. 00:27:52.798 [2024-11-21 03:44:33.211799] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.798 [2024-11-21 03:44:33.211906] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.798 [2024-11-21 03:44:33.211931] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.798 [2024-11-21 03:44:33.211945] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.798 [2024-11-21 03:44:33.211959] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.798 [2024-11-21 03:44:33.211988] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.798 qpair failed and we were unable to recover it. 00:27:52.798 [2024-11-21 03:44:33.221743] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.798 [2024-11-21 03:44:33.221849] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.798 [2024-11-21 03:44:33.221875] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.798 [2024-11-21 03:44:33.221889] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.798 [2024-11-21 03:44:33.221902] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.798 [2024-11-21 03:44:33.221932] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.798 qpair failed and we were unable to recover it. 00:27:52.798 [2024-11-21 03:44:33.231800] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.798 [2024-11-21 03:44:33.231904] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.798 [2024-11-21 03:44:33.231931] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.798 [2024-11-21 03:44:33.231945] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.798 [2024-11-21 03:44:33.231957] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.798 [2024-11-21 03:44:33.231986] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.798 qpair failed and we were unable to recover it. 00:27:52.798 [2024-11-21 03:44:33.241832] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.798 [2024-11-21 03:44:33.241933] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.798 [2024-11-21 03:44:33.241958] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.798 [2024-11-21 03:44:33.241972] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.798 [2024-11-21 03:44:33.241985] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.799 [2024-11-21 03:44:33.242014] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.799 qpair failed and we were unable to recover it. 00:27:52.799 [2024-11-21 03:44:33.251834] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.799 [2024-11-21 03:44:33.251938] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.799 [2024-11-21 03:44:33.251970] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.799 [2024-11-21 03:44:33.251985] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.799 [2024-11-21 03:44:33.251998] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.799 [2024-11-21 03:44:33.252027] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.799 qpair failed and we were unable to recover it. 00:27:52.799 [2024-11-21 03:44:33.261841] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.799 [2024-11-21 03:44:33.261949] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.799 [2024-11-21 03:44:33.261974] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.799 [2024-11-21 03:44:33.261988] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.799 [2024-11-21 03:44:33.262001] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.799 [2024-11-21 03:44:33.262032] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.799 qpair failed and we were unable to recover it. 00:27:52.799 [2024-11-21 03:44:33.271911] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.799 [2024-11-21 03:44:33.272057] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.799 [2024-11-21 03:44:33.272097] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.799 [2024-11-21 03:44:33.272112] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.799 [2024-11-21 03:44:33.272126] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.799 [2024-11-21 03:44:33.272168] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.799 qpair failed and we were unable to recover it. 00:27:52.799 [2024-11-21 03:44:33.281911] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.799 [2024-11-21 03:44:33.282018] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.799 [2024-11-21 03:44:33.282044] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.799 [2024-11-21 03:44:33.282058] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.799 [2024-11-21 03:44:33.282078] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.799 [2024-11-21 03:44:33.282110] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.799 qpair failed and we were unable to recover it. 00:27:52.799 [2024-11-21 03:44:33.292038] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.799 [2024-11-21 03:44:33.292149] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.799 [2024-11-21 03:44:33.292174] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.799 [2024-11-21 03:44:33.292188] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.799 [2024-11-21 03:44:33.292201] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.799 [2024-11-21 03:44:33.292236] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.799 qpair failed and we were unable to recover it. 00:27:52.799 [2024-11-21 03:44:33.302012] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.799 [2024-11-21 03:44:33.302120] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.799 [2024-11-21 03:44:33.302146] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.799 [2024-11-21 03:44:33.302161] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.799 [2024-11-21 03:44:33.302173] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.799 [2024-11-21 03:44:33.302203] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.799 qpair failed and we were unable to recover it. 00:27:52.799 [2024-11-21 03:44:33.312006] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.799 [2024-11-21 03:44:33.312156] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.799 [2024-11-21 03:44:33.312182] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.799 [2024-11-21 03:44:33.312196] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.799 [2024-11-21 03:44:33.312209] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.799 [2024-11-21 03:44:33.312237] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.799 qpair failed and we were unable to recover it. 00:27:52.799 [2024-11-21 03:44:33.322014] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.799 [2024-11-21 03:44:33.322114] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.799 [2024-11-21 03:44:33.322140] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.799 [2024-11-21 03:44:33.322154] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.799 [2024-11-21 03:44:33.322168] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.799 [2024-11-21 03:44:33.322198] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.799 qpair failed and we were unable to recover it. 00:27:52.799 [2024-11-21 03:44:33.332087] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.799 [2024-11-21 03:44:33.332190] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.799 [2024-11-21 03:44:33.332218] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.799 [2024-11-21 03:44:33.332232] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.799 [2024-11-21 03:44:33.332244] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.799 [2024-11-21 03:44:33.332275] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.799 qpair failed and we were unable to recover it. 00:27:52.799 [2024-11-21 03:44:33.342096] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.799 [2024-11-21 03:44:33.342207] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.799 [2024-11-21 03:44:33.342238] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.799 [2024-11-21 03:44:33.342253] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.799 [2024-11-21 03:44:33.342264] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.799 [2024-11-21 03:44:33.342294] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.799 qpair failed and we were unable to recover it. 00:27:52.799 [2024-11-21 03:44:33.352108] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.799 [2024-11-21 03:44:33.352210] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.799 [2024-11-21 03:44:33.352236] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.799 [2024-11-21 03:44:33.352250] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.799 [2024-11-21 03:44:33.352263] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.799 [2024-11-21 03:44:33.352293] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.799 qpair failed and we were unable to recover it. 00:27:52.799 [2024-11-21 03:44:33.362135] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.800 [2024-11-21 03:44:33.362235] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.800 [2024-11-21 03:44:33.362260] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.800 [2024-11-21 03:44:33.362274] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.800 [2024-11-21 03:44:33.362288] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.800 [2024-11-21 03:44:33.362316] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.800 qpair failed and we were unable to recover it. 00:27:52.800 [2024-11-21 03:44:33.372184] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.800 [2024-11-21 03:44:33.372293] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.800 [2024-11-21 03:44:33.372319] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.800 [2024-11-21 03:44:33.372333] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.800 [2024-11-21 03:44:33.372346] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.800 [2024-11-21 03:44:33.372377] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.800 qpair failed and we were unable to recover it. 00:27:52.800 [2024-11-21 03:44:33.382292] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.800 [2024-11-21 03:44:33.382401] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.800 [2024-11-21 03:44:33.382428] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.800 [2024-11-21 03:44:33.382442] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.800 [2024-11-21 03:44:33.382460] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.800 [2024-11-21 03:44:33.382490] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.800 qpair failed and we were unable to recover it. 00:27:52.800 [2024-11-21 03:44:33.392316] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.800 [2024-11-21 03:44:33.392455] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.800 [2024-11-21 03:44:33.392483] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.800 [2024-11-21 03:44:33.392497] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.800 [2024-11-21 03:44:33.392509] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.800 [2024-11-21 03:44:33.392539] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.800 qpair failed and we were unable to recover it. 00:27:52.800 [2024-11-21 03:44:33.402250] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.800 [2024-11-21 03:44:33.402349] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.800 [2024-11-21 03:44:33.402375] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.800 [2024-11-21 03:44:33.402389] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.800 [2024-11-21 03:44:33.402402] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.800 [2024-11-21 03:44:33.402431] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.800 qpair failed and we were unable to recover it. 00:27:52.800 [2024-11-21 03:44:33.412270] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.800 [2024-11-21 03:44:33.412372] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.800 [2024-11-21 03:44:33.412398] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.800 [2024-11-21 03:44:33.412412] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.800 [2024-11-21 03:44:33.412425] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.800 [2024-11-21 03:44:33.412454] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.800 qpair failed and we were unable to recover it. 00:27:52.800 [2024-11-21 03:44:33.422334] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.800 [2024-11-21 03:44:33.422436] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.800 [2024-11-21 03:44:33.422461] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.800 [2024-11-21 03:44:33.422474] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.800 [2024-11-21 03:44:33.422487] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.800 [2024-11-21 03:44:33.422516] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.800 qpair failed and we were unable to recover it. 00:27:52.800 [2024-11-21 03:44:33.432348] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.800 [2024-11-21 03:44:33.432462] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.800 [2024-11-21 03:44:33.432488] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.800 [2024-11-21 03:44:33.432502] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.800 [2024-11-21 03:44:33.432515] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.800 [2024-11-21 03:44:33.432546] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.800 qpair failed and we were unable to recover it. 00:27:52.800 [2024-11-21 03:44:33.442377] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:52.800 [2024-11-21 03:44:33.442486] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:52.800 [2024-11-21 03:44:33.442512] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:52.800 [2024-11-21 03:44:33.442526] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:52.800 [2024-11-21 03:44:33.442539] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:52.800 [2024-11-21 03:44:33.442568] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:52.800 qpair failed and we were unable to recover it. 00:27:53.062 [2024-11-21 03:44:33.452431] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.062 [2024-11-21 03:44:33.452539] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.062 [2024-11-21 03:44:33.452565] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.062 [2024-11-21 03:44:33.452579] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.062 [2024-11-21 03:44:33.452592] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:53.062 [2024-11-21 03:44:33.452622] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:53.062 qpair failed and we were unable to recover it. 00:27:53.062 [2024-11-21 03:44:33.462462] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.062 [2024-11-21 03:44:33.462572] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.062 [2024-11-21 03:44:33.462598] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.062 [2024-11-21 03:44:33.462612] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.062 [2024-11-21 03:44:33.462624] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:53.062 [2024-11-21 03:44:33.462655] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:53.062 qpair failed and we were unable to recover it. 00:27:53.062 [2024-11-21 03:44:33.472484] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.062 [2024-11-21 03:44:33.472587] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.062 [2024-11-21 03:44:33.472612] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.062 [2024-11-21 03:44:33.472626] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.062 [2024-11-21 03:44:33.472646] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:53.062 [2024-11-21 03:44:33.472679] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:53.062 qpair failed and we were unable to recover it. 00:27:53.062 [2024-11-21 03:44:33.482478] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.062 [2024-11-21 03:44:33.482580] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.062 [2024-11-21 03:44:33.482606] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.062 [2024-11-21 03:44:33.482620] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.062 [2024-11-21 03:44:33.482632] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:53.062 [2024-11-21 03:44:33.482674] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:53.062 qpair failed and we were unable to recover it. 00:27:53.062 [2024-11-21 03:44:33.492619] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.062 [2024-11-21 03:44:33.492758] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.062 [2024-11-21 03:44:33.492784] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.062 [2024-11-21 03:44:33.492800] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.062 [2024-11-21 03:44:33.492815] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:53.062 [2024-11-21 03:44:33.492846] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:53.062 qpair failed and we were unable to recover it. 00:27:53.062 [2024-11-21 03:44:33.502624] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.062 [2024-11-21 03:44:33.502741] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.062 [2024-11-21 03:44:33.502769] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.062 [2024-11-21 03:44:33.502785] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.062 [2024-11-21 03:44:33.502798] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:53.062 [2024-11-21 03:44:33.502829] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:53.062 qpair failed and we were unable to recover it. 00:27:53.062 [2024-11-21 03:44:33.512582] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.062 [2024-11-21 03:44:33.512699] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.062 [2024-11-21 03:44:33.512726] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.062 [2024-11-21 03:44:33.512740] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.062 [2024-11-21 03:44:33.512753] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:53.062 [2024-11-21 03:44:33.512783] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:53.062 qpair failed and we were unable to recover it. 00:27:53.062 [2024-11-21 03:44:33.522650] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.062 [2024-11-21 03:44:33.522754] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.062 [2024-11-21 03:44:33.522780] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.062 [2024-11-21 03:44:33.522794] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.062 [2024-11-21 03:44:33.522806] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:53.062 [2024-11-21 03:44:33.522837] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:53.062 qpair failed and we were unable to recover it. 00:27:53.062 [2024-11-21 03:44:33.532620] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.062 [2024-11-21 03:44:33.532720] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.063 [2024-11-21 03:44:33.532745] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.063 [2024-11-21 03:44:33.532760] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.063 [2024-11-21 03:44:33.532773] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:53.063 [2024-11-21 03:44:33.532802] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:53.063 qpair failed and we were unable to recover it. 00:27:53.063 [2024-11-21 03:44:33.542742] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.063 [2024-11-21 03:44:33.542853] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.063 [2024-11-21 03:44:33.542879] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.063 [2024-11-21 03:44:33.542894] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.063 [2024-11-21 03:44:33.542907] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:53.063 [2024-11-21 03:44:33.542936] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:53.063 qpair failed and we were unable to recover it. 00:27:53.063 [2024-11-21 03:44:33.552703] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.063 [2024-11-21 03:44:33.552808] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.063 [2024-11-21 03:44:33.552834] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.063 [2024-11-21 03:44:33.552848] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.063 [2024-11-21 03:44:33.552861] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:53.063 [2024-11-21 03:44:33.552892] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:53.063 qpair failed and we were unable to recover it. 00:27:53.063 [2024-11-21 03:44:33.562753] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.063 [2024-11-21 03:44:33.562908] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.063 [2024-11-21 03:44:33.562935] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.063 [2024-11-21 03:44:33.562959] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.063 [2024-11-21 03:44:33.562974] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:53.063 [2024-11-21 03:44:33.563003] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:53.063 qpair failed and we were unable to recover it. 00:27:53.063 [2024-11-21 03:44:33.572767] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.063 [2024-11-21 03:44:33.572878] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.063 [2024-11-21 03:44:33.572904] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.063 [2024-11-21 03:44:33.572918] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.063 [2024-11-21 03:44:33.572932] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:53.063 [2024-11-21 03:44:33.572962] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:53.063 qpair failed and we were unable to recover it. 00:27:53.063 [2024-11-21 03:44:33.582804] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.063 [2024-11-21 03:44:33.582909] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.063 [2024-11-21 03:44:33.582935] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.063 [2024-11-21 03:44:33.582950] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.063 [2024-11-21 03:44:33.582962] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:53.063 [2024-11-21 03:44:33.583006] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:53.063 qpair failed and we were unable to recover it. 00:27:53.063 [2024-11-21 03:44:33.592837] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.063 [2024-11-21 03:44:33.592946] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.063 [2024-11-21 03:44:33.592972] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.063 [2024-11-21 03:44:33.592986] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.063 [2024-11-21 03:44:33.592999] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:53.063 [2024-11-21 03:44:33.593028] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:53.063 qpair failed and we were unable to recover it. 00:27:53.063 [2024-11-21 03:44:33.602853] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.063 [2024-11-21 03:44:33.602955] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.063 [2024-11-21 03:44:33.602981] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.063 [2024-11-21 03:44:33.602996] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.063 [2024-11-21 03:44:33.603009] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:53.063 [2024-11-21 03:44:33.603039] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:53.063 qpair failed and we were unable to recover it. 00:27:53.063 [2024-11-21 03:44:33.612897] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.063 [2024-11-21 03:44:33.613004] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.063 [2024-11-21 03:44:33.613030] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.063 [2024-11-21 03:44:33.613044] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.063 [2024-11-21 03:44:33.613057] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:53.063 [2024-11-21 03:44:33.613119] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:53.063 qpair failed and we were unable to recover it. 00:27:53.063 [2024-11-21 03:44:33.622942] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.063 [2024-11-21 03:44:33.623052] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.063 [2024-11-21 03:44:33.623087] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.063 [2024-11-21 03:44:33.623102] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.063 [2024-11-21 03:44:33.623115] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:53.063 [2024-11-21 03:44:33.623144] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:53.063 qpair failed and we were unable to recover it. 00:27:53.063 [2024-11-21 03:44:33.633000] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.063 [2024-11-21 03:44:33.633104] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.063 [2024-11-21 03:44:33.633130] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.063 [2024-11-21 03:44:33.633144] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.063 [2024-11-21 03:44:33.633156] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:53.063 [2024-11-21 03:44:33.633185] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:53.063 qpair failed and we were unable to recover it. 00:27:53.063 [2024-11-21 03:44:33.642978] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.063 [2024-11-21 03:44:33.643082] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.063 [2024-11-21 03:44:33.643109] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.063 [2024-11-21 03:44:33.643123] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.063 [2024-11-21 03:44:33.643136] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:53.063 [2024-11-21 03:44:33.643166] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:53.063 qpair failed and we were unable to recover it. 00:27:53.063 [2024-11-21 03:44:33.653099] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.063 [2024-11-21 03:44:33.653199] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.063 [2024-11-21 03:44:33.653229] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.063 [2024-11-21 03:44:33.653244] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.063 [2024-11-21 03:44:33.653256] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:53.063 [2024-11-21 03:44:33.653285] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:53.063 qpair failed and we were unable to recover it. 00:27:53.063 [2024-11-21 03:44:33.663032] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.063 [2024-11-21 03:44:33.663139] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.063 [2024-11-21 03:44:33.663165] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.063 [2024-11-21 03:44:33.663179] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.064 [2024-11-21 03:44:33.663191] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:53.064 [2024-11-21 03:44:33.663222] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:53.064 qpair failed and we were unable to recover it. 00:27:53.064 [2024-11-21 03:44:33.673101] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.064 [2024-11-21 03:44:33.673213] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.064 [2024-11-21 03:44:33.673240] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.064 [2024-11-21 03:44:33.673254] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.064 [2024-11-21 03:44:33.673267] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:53.064 [2024-11-21 03:44:33.673308] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:53.064 qpair failed and we were unable to recover it. 00:27:53.064 [2024-11-21 03:44:33.683183] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.064 [2024-11-21 03:44:33.683320] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.064 [2024-11-21 03:44:33.683345] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.064 [2024-11-21 03:44:33.683360] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.064 [2024-11-21 03:44:33.683372] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:53.064 [2024-11-21 03:44:33.683402] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:53.064 qpair failed and we were unable to recover it. 00:27:53.064 [2024-11-21 03:44:33.693158] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.064 [2024-11-21 03:44:33.693261] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.064 [2024-11-21 03:44:33.693287] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.064 [2024-11-21 03:44:33.693301] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.064 [2024-11-21 03:44:33.693314] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:53.064 [2024-11-21 03:44:33.693348] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:53.064 qpair failed and we were unable to recover it. 00:27:53.064 [2024-11-21 03:44:33.703250] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.064 [2024-11-21 03:44:33.703354] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.064 [2024-11-21 03:44:33.703380] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.064 [2024-11-21 03:44:33.703395] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.064 [2024-11-21 03:44:33.703408] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:53.064 [2024-11-21 03:44:33.703438] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:53.064 qpair failed and we were unable to recover it. 00:27:53.326 [2024-11-21 03:44:33.713277] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.326 [2024-11-21 03:44:33.713385] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.326 [2024-11-21 03:44:33.713412] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.326 [2024-11-21 03:44:33.713426] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.326 [2024-11-21 03:44:33.713439] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:53.326 [2024-11-21 03:44:33.713470] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:53.326 qpair failed and we were unable to recover it. 00:27:53.326 [2024-11-21 03:44:33.723266] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.326 [2024-11-21 03:44:33.723411] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.326 [2024-11-21 03:44:33.723438] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.326 [2024-11-21 03:44:33.723453] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.326 [2024-11-21 03:44:33.723466] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:53.326 [2024-11-21 03:44:33.723498] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:53.326 qpair failed and we were unable to recover it. 00:27:53.326 [2024-11-21 03:44:33.733330] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.326 [2024-11-21 03:44:33.733435] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.326 [2024-11-21 03:44:33.733461] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.326 [2024-11-21 03:44:33.733475] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.326 [2024-11-21 03:44:33.733488] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:53.326 [2024-11-21 03:44:33.733519] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:53.326 qpair failed and we were unable to recover it. 00:27:53.326 [2024-11-21 03:44:33.743298] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.327 [2024-11-21 03:44:33.743406] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.327 [2024-11-21 03:44:33.743438] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.327 [2024-11-21 03:44:33.743453] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.327 [2024-11-21 03:44:33.743466] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:53.327 [2024-11-21 03:44:33.743495] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:53.327 qpair failed and we were unable to recover it. 00:27:53.327 [2024-11-21 03:44:33.753329] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.327 [2024-11-21 03:44:33.753464] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.327 [2024-11-21 03:44:33.753490] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.327 [2024-11-21 03:44:33.753504] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.327 [2024-11-21 03:44:33.753517] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:53.327 [2024-11-21 03:44:33.753547] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:53.327 qpair failed and we were unable to recover it. 00:27:53.327 [2024-11-21 03:44:33.763360] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.327 [2024-11-21 03:44:33.763466] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.327 [2024-11-21 03:44:33.763490] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.327 [2024-11-21 03:44:33.763504] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.327 [2024-11-21 03:44:33.763516] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:53.327 [2024-11-21 03:44:33.763544] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:53.327 qpair failed and we were unable to recover it. 00:27:53.327 [2024-11-21 03:44:33.773354] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.327 [2024-11-21 03:44:33.773487] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.327 [2024-11-21 03:44:33.773513] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.327 [2024-11-21 03:44:33.773528] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.327 [2024-11-21 03:44:33.773540] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:53.327 [2024-11-21 03:44:33.773571] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:53.327 qpair failed and we were unable to recover it. 00:27:53.327 [2024-11-21 03:44:33.783497] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.327 [2024-11-21 03:44:33.783606] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.327 [2024-11-21 03:44:33.783633] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.327 [2024-11-21 03:44:33.783647] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.327 [2024-11-21 03:44:33.783662] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:53.327 [2024-11-21 03:44:33.783697] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:53.327 qpair failed and we were unable to recover it. 00:27:53.327 [2024-11-21 03:44:33.793422] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.327 [2024-11-21 03:44:33.793543] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.327 [2024-11-21 03:44:33.793569] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.327 [2024-11-21 03:44:33.793583] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.327 [2024-11-21 03:44:33.793596] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:53.327 [2024-11-21 03:44:33.793627] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:53.327 qpair failed and we were unable to recover it. 00:27:53.327 [2024-11-21 03:44:33.803454] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.327 [2024-11-21 03:44:33.803580] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.327 [2024-11-21 03:44:33.803610] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.327 [2024-11-21 03:44:33.803625] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.327 [2024-11-21 03:44:33.803638] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:53.327 [2024-11-21 03:44:33.803667] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:53.327 qpair failed and we were unable to recover it. 00:27:53.327 [2024-11-21 03:44:33.813470] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.327 [2024-11-21 03:44:33.813570] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.327 [2024-11-21 03:44:33.813596] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.327 [2024-11-21 03:44:33.813609] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.327 [2024-11-21 03:44:33.813622] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:53.327 [2024-11-21 03:44:33.813652] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:53.327 qpair failed and we were unable to recover it. 00:27:53.327 [2024-11-21 03:44:33.823533] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.327 [2024-11-21 03:44:33.823641] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.327 [2024-11-21 03:44:33.823666] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.327 [2024-11-21 03:44:33.823680] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.327 [2024-11-21 03:44:33.823693] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:53.327 [2024-11-21 03:44:33.823721] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:53.327 qpair failed and we were unable to recover it. 00:27:53.327 [2024-11-21 03:44:33.833530] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.327 [2024-11-21 03:44:33.833641] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.327 [2024-11-21 03:44:33.833671] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.327 [2024-11-21 03:44:33.833686] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.327 [2024-11-21 03:44:33.833700] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:53.327 [2024-11-21 03:44:33.833741] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:53.327 qpair failed and we were unable to recover it. 00:27:53.327 [2024-11-21 03:44:33.843570] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.327 [2024-11-21 03:44:33.843671] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.327 [2024-11-21 03:44:33.843696] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.327 [2024-11-21 03:44:33.843710] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.327 [2024-11-21 03:44:33.843722] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:53.327 [2024-11-21 03:44:33.843752] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:53.327 qpair failed and we were unable to recover it. 00:27:53.327 [2024-11-21 03:44:33.853584] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.327 [2024-11-21 03:44:33.853682] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.327 [2024-11-21 03:44:33.853707] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.327 [2024-11-21 03:44:33.853721] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.327 [2024-11-21 03:44:33.853734] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:53.327 [2024-11-21 03:44:33.853762] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:53.327 qpair failed and we were unable to recover it. 00:27:53.327 [2024-11-21 03:44:33.863628] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.327 [2024-11-21 03:44:33.863739] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.327 [2024-11-21 03:44:33.863765] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.327 [2024-11-21 03:44:33.863779] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.327 [2024-11-21 03:44:33.863792] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:53.327 [2024-11-21 03:44:33.863821] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:53.327 qpair failed and we were unable to recover it. 00:27:53.327 [2024-11-21 03:44:33.873663] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.327 [2024-11-21 03:44:33.873773] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.327 [2024-11-21 03:44:33.873799] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.327 [2024-11-21 03:44:33.873813] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.328 [2024-11-21 03:44:33.873832] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:53.328 [2024-11-21 03:44:33.873862] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:53.328 qpair failed and we were unable to recover it. 00:27:53.328 [2024-11-21 03:44:33.883682] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.328 [2024-11-21 03:44:33.883786] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.328 [2024-11-21 03:44:33.883811] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.328 [2024-11-21 03:44:33.883825] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.328 [2024-11-21 03:44:33.883837] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:53.328 [2024-11-21 03:44:33.883868] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:53.328 qpair failed and we were unable to recover it. 00:27:53.328 [2024-11-21 03:44:33.893719] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.328 [2024-11-21 03:44:33.893829] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.328 [2024-11-21 03:44:33.893855] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.328 [2024-11-21 03:44:33.893869] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.328 [2024-11-21 03:44:33.893882] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:53.328 [2024-11-21 03:44:33.893911] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:53.328 qpair failed and we were unable to recover it. 00:27:53.328 [2024-11-21 03:44:33.903850] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.328 [2024-11-21 03:44:33.903964] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.328 [2024-11-21 03:44:33.903990] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.328 [2024-11-21 03:44:33.904004] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.328 [2024-11-21 03:44:33.904017] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:53.328 [2024-11-21 03:44:33.904046] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:53.328 qpair failed and we were unable to recover it. 00:27:53.328 [2024-11-21 03:44:33.913805] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.328 [2024-11-21 03:44:33.913921] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.328 [2024-11-21 03:44:33.913948] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.328 [2024-11-21 03:44:33.913963] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.328 [2024-11-21 03:44:33.913979] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:53.328 [2024-11-21 03:44:33.914012] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:53.328 qpair failed and we were unable to recover it. 00:27:53.328 [2024-11-21 03:44:33.923846] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.328 [2024-11-21 03:44:33.923956] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.328 [2024-11-21 03:44:33.923984] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.328 [2024-11-21 03:44:33.923999] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.328 [2024-11-21 03:44:33.924012] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:53.328 [2024-11-21 03:44:33.924046] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:53.328 qpair failed and we were unable to recover it. 00:27:53.328 [2024-11-21 03:44:33.933837] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.328 [2024-11-21 03:44:33.933935] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.328 [2024-11-21 03:44:33.933962] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.328 [2024-11-21 03:44:33.933976] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.328 [2024-11-21 03:44:33.933989] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0328000b90 00:27:53.328 [2024-11-21 03:44:33.934030] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:53.328 qpair failed and we were unable to recover it. 00:27:53.328 [2024-11-21 03:44:33.943949] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.328 [2024-11-21 03:44:33.944063] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.328 [2024-11-21 03:44:33.944103] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.328 [2024-11-21 03:44:33.944130] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.328 [2024-11-21 03:44:33.944144] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2462cb0 00:27:53.328 [2024-11-21 03:44:33.944176] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:53.328 qpair failed and we were unable to recover it. 00:27:53.328 [2024-11-21 03:44:33.953902] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.328 [2024-11-21 03:44:33.954057] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.328 [2024-11-21 03:44:33.954094] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.328 [2024-11-21 03:44:33.954111] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.328 [2024-11-21 03:44:33.954126] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2462cb0 00:27:53.328 [2024-11-21 03:44:33.954156] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:53.328 qpair failed and we were unable to recover it. 00:27:53.328 [2024-11-21 03:44:33.963953] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.328 [2024-11-21 03:44:33.964083] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.328 [2024-11-21 03:44:33.964118] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.328 [2024-11-21 03:44:33.964140] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.328 [2024-11-21 03:44:33.964161] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0324000b90 00:27:53.328 [2024-11-21 03:44:33.964194] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:53.328 qpair failed and we were unable to recover it. 00:27:53.588 [2024-11-21 03:44:33.973991] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.588 [2024-11-21 03:44:33.974112] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.588 [2024-11-21 03:44:33.974145] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.588 [2024-11-21 03:44:33.974161] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.588 [2024-11-21 03:44:33.974175] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:53.588 [2024-11-21 03:44:33.974207] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:53.588 qpair failed and we were unable to recover it. 00:27:53.588 [2024-11-21 03:44:33.983990] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.588 [2024-11-21 03:44:33.984126] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.588 [2024-11-21 03:44:33.984153] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.588 [2024-11-21 03:44:33.984168] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.588 [2024-11-21 03:44:33.984181] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0330000b90 00:27:53.588 [2024-11-21 03:44:33.984211] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:53.588 qpair failed and we were unable to recover it. 00:27:53.588 [2024-11-21 03:44:33.984348] nvme_ctrlr.c:4339:nvme_ctrlr_keep_alive: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Submitting Keep Alive failed 00:27:53.588 A controller has encountered a failure and is being reset. 00:27:53.588 [2024-11-21 03:44:33.994031] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:53.588 [2024-11-21 03:44:33.994151] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:53.588 [2024-11-21 03:44:33.994184] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:53.588 [2024-11-21 03:44:33.994200] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:53.588 [2024-11-21 03:44:33.994214] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f0324000b90 00:27:53.588 [2024-11-21 03:44:33.994245] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:53.588 qpair failed and we were unable to recover it. 00:27:53.588 [2024-11-21 03:44:33.994358] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2470600 (9): Bad file descriptor 00:27:53.588 Controller properly reset. 00:27:53.588 Initializing NVMe Controllers 00:27:53.588 Attaching to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:53.588 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:53.588 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 0 00:27:53.588 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 1 00:27:53.588 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 2 00:27:53.588 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 3 00:27:53.588 Initialization complete. Launching workers. 00:27:53.588 Starting thread on core 1 00:27:53.588 Starting thread on core 2 00:27:53.588 Starting thread on core 3 00:27:53.588 Starting thread on core 0 00:27:53.588 03:44:34 -- host/target_disconnect.sh@59 -- # sync 00:27:53.588 00:27:53.588 real 0m11.531s 00:27:53.588 user 0m21.464s 00:27:53.588 sys 0m5.176s 00:27:53.588 03:44:34 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:53.588 03:44:34 -- common/autotest_common.sh@10 -- # set +x 00:27:53.588 ************************************ 00:27:53.588 END TEST nvmf_target_disconnect_tc2 00:27:53.588 ************************************ 00:27:53.588 03:44:34 -- host/target_disconnect.sh@80 -- # '[' -n '' ']' 00:27:53.588 03:44:34 -- host/target_disconnect.sh@84 -- # trap - SIGINT SIGTERM EXIT 00:27:53.588 03:44:34 -- host/target_disconnect.sh@85 -- # nvmftestfini 00:27:53.588 03:44:34 -- nvmf/common.sh@476 -- # nvmfcleanup 00:27:53.588 03:44:34 -- nvmf/common.sh@116 -- # sync 00:27:53.588 03:44:34 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:27:53.588 03:44:34 -- nvmf/common.sh@119 -- # set +e 00:27:53.588 03:44:34 -- nvmf/common.sh@120 -- # for i in {1..20} 00:27:53.588 03:44:34 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:27:53.588 rmmod nvme_tcp 00:27:53.588 rmmod nvme_fabrics 00:27:53.588 rmmod nvme_keyring 00:27:53.588 03:44:34 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:27:53.588 03:44:34 -- nvmf/common.sh@123 -- # set -e 00:27:53.588 03:44:34 -- nvmf/common.sh@124 -- # return 0 00:27:53.588 03:44:34 -- nvmf/common.sh@477 -- # '[' -n 3174947 ']' 00:27:53.588 03:44:34 -- nvmf/common.sh@478 -- # killprocess 3174947 00:27:53.588 03:44:34 -- common/autotest_common.sh@936 -- # '[' -z 3174947 ']' 00:27:53.588 03:44:34 -- common/autotest_common.sh@940 -- # kill -0 3174947 00:27:53.588 03:44:34 -- common/autotest_common.sh@941 -- # uname 00:27:53.588 03:44:34 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:53.588 03:44:34 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3174947 00:27:53.588 03:44:34 -- common/autotest_common.sh@942 -- # process_name=reactor_4 00:27:53.588 03:44:34 -- common/autotest_common.sh@946 -- # '[' reactor_4 = sudo ']' 00:27:53.588 03:44:34 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3174947' 00:27:53.588 killing process with pid 3174947 00:27:53.588 03:44:34 -- common/autotest_common.sh@955 -- # kill 3174947 00:27:53.588 03:44:34 -- common/autotest_common.sh@960 -- # wait 3174947 00:27:53.846 03:44:34 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:27:53.846 03:44:34 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:27:53.846 03:44:34 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:27:53.846 03:44:34 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:27:53.846 03:44:34 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:27:53.846 03:44:34 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:53.847 03:44:34 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:53.847 03:44:34 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:56.385 03:44:36 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:27:56.385 00:27:56.385 real 0m16.321s 00:27:56.385 user 0m47.956s 00:27:56.385 sys 0m7.081s 00:27:56.385 03:44:36 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:56.385 03:44:36 -- common/autotest_common.sh@10 -- # set +x 00:27:56.385 ************************************ 00:27:56.385 END TEST nvmf_target_disconnect 00:27:56.385 ************************************ 00:27:56.385 03:44:36 -- nvmf/nvmf.sh@127 -- # timing_exit host 00:27:56.385 03:44:36 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:56.385 03:44:36 -- common/autotest_common.sh@10 -- # set +x 00:27:56.385 03:44:36 -- nvmf/nvmf.sh@129 -- # trap - SIGINT SIGTERM EXIT 00:27:56.385 00:27:56.385 real 21m22.443s 00:27:56.385 user 61m50.652s 00:27:56.385 sys 4m58.642s 00:27:56.385 03:44:36 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:56.385 03:44:36 -- common/autotest_common.sh@10 -- # set +x 00:27:56.385 ************************************ 00:27:56.385 END TEST nvmf_tcp 00:27:56.385 ************************************ 00:27:56.385 03:44:36 -- spdk/autotest.sh@283 -- # [[ 0 -eq 0 ]] 00:27:56.385 03:44:36 -- spdk/autotest.sh@284 -- # run_test spdkcli_nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:27:56.385 03:44:36 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:27:56.385 03:44:36 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:56.385 03:44:36 -- common/autotest_common.sh@10 -- # set +x 00:27:56.385 ************************************ 00:27:56.385 START TEST spdkcli_nvmf_tcp 00:27:56.385 ************************************ 00:27:56.386 03:44:36 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:27:56.386 * Looking for test storage... 00:27:56.386 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:27:56.386 03:44:36 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:27:56.386 03:44:36 -- common/autotest_common.sh@1690 -- # lcov --version 00:27:56.386 03:44:36 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:27:56.386 03:44:36 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:27:56.386 03:44:36 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:27:56.386 03:44:36 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:27:56.386 03:44:36 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:27:56.386 03:44:36 -- scripts/common.sh@335 -- # IFS=.-: 00:27:56.386 03:44:36 -- scripts/common.sh@335 -- # read -ra ver1 00:27:56.386 03:44:36 -- scripts/common.sh@336 -- # IFS=.-: 00:27:56.386 03:44:36 -- scripts/common.sh@336 -- # read -ra ver2 00:27:56.386 03:44:36 -- scripts/common.sh@337 -- # local 'op=<' 00:27:56.386 03:44:36 -- scripts/common.sh@339 -- # ver1_l=2 00:27:56.386 03:44:36 -- scripts/common.sh@340 -- # ver2_l=1 00:27:56.386 03:44:36 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:27:56.386 03:44:36 -- scripts/common.sh@343 -- # case "$op" in 00:27:56.386 03:44:36 -- scripts/common.sh@344 -- # : 1 00:27:56.386 03:44:36 -- scripts/common.sh@363 -- # (( v = 0 )) 00:27:56.386 03:44:36 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:27:56.386 03:44:36 -- scripts/common.sh@364 -- # decimal 1 00:27:56.386 03:44:36 -- scripts/common.sh@352 -- # local d=1 00:27:56.386 03:44:36 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:27:56.386 03:44:36 -- scripts/common.sh@354 -- # echo 1 00:27:56.386 03:44:36 -- scripts/common.sh@364 -- # ver1[v]=1 00:27:56.386 03:44:36 -- scripts/common.sh@365 -- # decimal 2 00:27:56.386 03:44:36 -- scripts/common.sh@352 -- # local d=2 00:27:56.386 03:44:36 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:27:56.386 03:44:36 -- scripts/common.sh@354 -- # echo 2 00:27:56.386 03:44:36 -- scripts/common.sh@365 -- # ver2[v]=2 00:27:56.386 03:44:36 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:27:56.386 03:44:36 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:27:56.386 03:44:36 -- scripts/common.sh@367 -- # return 0 00:27:56.386 03:44:36 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:27:56.386 03:44:36 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:27:56.386 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:56.386 --rc genhtml_branch_coverage=1 00:27:56.386 --rc genhtml_function_coverage=1 00:27:56.386 --rc genhtml_legend=1 00:27:56.386 --rc geninfo_all_blocks=1 00:27:56.386 --rc geninfo_unexecuted_blocks=1 00:27:56.386 00:27:56.386 ' 00:27:56.386 03:44:36 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:27:56.386 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:56.386 --rc genhtml_branch_coverage=1 00:27:56.386 --rc genhtml_function_coverage=1 00:27:56.386 --rc genhtml_legend=1 00:27:56.386 --rc geninfo_all_blocks=1 00:27:56.386 --rc geninfo_unexecuted_blocks=1 00:27:56.386 00:27:56.386 ' 00:27:56.386 03:44:36 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:27:56.386 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:56.386 --rc genhtml_branch_coverage=1 00:27:56.386 --rc genhtml_function_coverage=1 00:27:56.386 --rc genhtml_legend=1 00:27:56.386 --rc geninfo_all_blocks=1 00:27:56.386 --rc geninfo_unexecuted_blocks=1 00:27:56.386 00:27:56.386 ' 00:27:56.386 03:44:36 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:27:56.386 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:56.386 --rc genhtml_branch_coverage=1 00:27:56.386 --rc genhtml_function_coverage=1 00:27:56.386 --rc genhtml_legend=1 00:27:56.386 --rc geninfo_all_blocks=1 00:27:56.386 --rc geninfo_unexecuted_blocks=1 00:27:56.386 00:27:56.386 ' 00:27:56.386 03:44:36 -- spdkcli/nvmf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:27:56.386 03:44:36 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:27:56.386 03:44:36 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:27:56.386 03:44:36 -- spdkcli/nvmf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:27:56.386 03:44:36 -- nvmf/common.sh@7 -- # uname -s 00:27:56.386 03:44:36 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:56.386 03:44:36 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:56.386 03:44:36 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:56.386 03:44:36 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:56.386 03:44:36 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:56.386 03:44:36 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:56.386 03:44:36 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:56.386 03:44:36 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:56.386 03:44:36 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:56.386 03:44:36 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:56.386 03:44:36 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:27:56.386 03:44:36 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:27:56.386 03:44:36 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:56.386 03:44:36 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:56.386 03:44:36 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:56.386 03:44:36 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:56.386 03:44:36 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:56.386 03:44:36 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:56.386 03:44:36 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:56.386 03:44:36 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:56.386 03:44:36 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:56.386 03:44:36 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:56.386 03:44:36 -- paths/export.sh@5 -- # export PATH 00:27:56.386 03:44:36 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:56.386 03:44:36 -- nvmf/common.sh@46 -- # : 0 00:27:56.386 03:44:36 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:27:56.386 03:44:36 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:27:56.386 03:44:36 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:27:56.386 03:44:36 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:56.386 03:44:36 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:56.386 03:44:36 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:27:56.386 03:44:36 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:27:56.386 03:44:36 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:27:56.386 03:44:36 -- spdkcli/nvmf.sh@12 -- # MATCH_FILE=spdkcli_nvmf.test 00:27:56.386 03:44:36 -- spdkcli/nvmf.sh@13 -- # SPDKCLI_BRANCH=/nvmf 00:27:56.386 03:44:36 -- spdkcli/nvmf.sh@15 -- # trap cleanup EXIT 00:27:56.386 03:44:36 -- spdkcli/nvmf.sh@17 -- # timing_enter run_nvmf_tgt 00:27:56.386 03:44:36 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:56.386 03:44:36 -- common/autotest_common.sh@10 -- # set +x 00:27:56.386 03:44:36 -- spdkcli/nvmf.sh@18 -- # run_nvmf_tgt 00:27:56.386 03:44:36 -- spdkcli/common.sh@33 -- # nvmf_tgt_pid=3176178 00:27:56.386 03:44:36 -- spdkcli/common.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x3 -p 0 00:27:56.386 03:44:36 -- spdkcli/common.sh@34 -- # waitforlisten 3176178 00:27:56.386 03:44:36 -- common/autotest_common.sh@829 -- # '[' -z 3176178 ']' 00:27:56.387 03:44:36 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:56.387 03:44:36 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:56.387 03:44:36 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:56.387 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:56.387 03:44:36 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:56.387 03:44:36 -- common/autotest_common.sh@10 -- # set +x 00:27:56.387 [2024-11-21 03:44:36.729290] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:56.387 [2024-11-21 03:44:36.729392] [ DPDK EAL parameters: nvmf --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3176178 ] 00:27:56.387 EAL: No free 2048 kB hugepages reported on node 1 00:27:56.387 [2024-11-21 03:44:36.785832] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:27:56.387 [2024-11-21 03:44:36.897059] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:56.387 [2024-11-21 03:44:36.897293] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:56.387 [2024-11-21 03:44:36.897300] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:57.322 03:44:37 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:57.322 03:44:37 -- common/autotest_common.sh@862 -- # return 0 00:27:57.322 03:44:37 -- spdkcli/nvmf.sh@19 -- # timing_exit run_nvmf_tgt 00:27:57.322 03:44:37 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:57.322 03:44:37 -- common/autotest_common.sh@10 -- # set +x 00:27:57.322 03:44:37 -- spdkcli/nvmf.sh@21 -- # NVMF_TARGET_IP=127.0.0.1 00:27:57.322 03:44:37 -- spdkcli/nvmf.sh@22 -- # [[ tcp == \r\d\m\a ]] 00:27:57.322 03:44:37 -- spdkcli/nvmf.sh@27 -- # timing_enter spdkcli_create_nvmf_config 00:27:57.322 03:44:37 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:57.322 03:44:37 -- common/autotest_common.sh@10 -- # set +x 00:27:57.322 03:44:37 -- spdkcli/nvmf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/bdevs/malloc create 32 512 Malloc1'\'' '\''Malloc1'\'' True 00:27:57.322 '\''/bdevs/malloc create 32 512 Malloc2'\'' '\''Malloc2'\'' True 00:27:57.322 '\''/bdevs/malloc create 32 512 Malloc3'\'' '\''Malloc3'\'' True 00:27:57.322 '\''/bdevs/malloc create 32 512 Malloc4'\'' '\''Malloc4'\'' True 00:27:57.322 '\''/bdevs/malloc create 32 512 Malloc5'\'' '\''Malloc5'\'' True 00:27:57.322 '\''/bdevs/malloc create 32 512 Malloc6'\'' '\''Malloc6'\'' True 00:27:57.322 '\''nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192'\'' '\'''\'' True 00:27:57.322 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:27:57.322 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1'\'' '\''Malloc3'\'' True 00:27:57.322 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2'\'' '\''Malloc4'\'' True 00:27:57.322 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:27:57.322 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:27:57.322 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2'\'' '\''Malloc2'\'' True 00:27:57.322 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:27:57.322 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:27:57.322 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1'\'' '\''Malloc1'\'' True 00:27:57.322 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:27:57.322 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:27:57.322 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:27:57.322 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:27:57.323 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True'\'' '\''Allow any host'\'' 00:27:57.323 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False'\'' '\''Allow any host'\'' True 00:27:57.323 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:27:57.323 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4'\'' '\''127.0.0.1:4262'\'' True 00:27:57.323 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:27:57.323 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5'\'' '\''Malloc5'\'' True 00:27:57.323 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6'\'' '\''Malloc6'\'' True 00:27:57.323 '\''/nvmf/referral create tcp 127.0.0.2 4030 IPv4'\'' 00:27:57.323 ' 00:27:57.583 [2024-11-21 03:44:38.168920] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:28:00.118 [2024-11-21 03:44:40.350342] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:01.056 [2024-11-21 03:44:41.590861] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4260 *** 00:28:03.590 [2024-11-21 03:44:43.878020] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4261 *** 00:28:05.526 [2024-11-21 03:44:45.864533] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4262 *** 00:28:06.903 Executing command: ['/bdevs/malloc create 32 512 Malloc1', 'Malloc1', True] 00:28:06.903 Executing command: ['/bdevs/malloc create 32 512 Malloc2', 'Malloc2', True] 00:28:06.903 Executing command: ['/bdevs/malloc create 32 512 Malloc3', 'Malloc3', True] 00:28:06.903 Executing command: ['/bdevs/malloc create 32 512 Malloc4', 'Malloc4', True] 00:28:06.903 Executing command: ['/bdevs/malloc create 32 512 Malloc5', 'Malloc5', True] 00:28:06.903 Executing command: ['/bdevs/malloc create 32 512 Malloc6', 'Malloc6', True] 00:28:06.903 Executing command: ['nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192', '', True] 00:28:06.903 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode1', True] 00:28:06.903 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1', 'Malloc3', True] 00:28:06.903 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2', 'Malloc4', True] 00:28:06.903 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:28:06.903 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:28:06.903 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2', 'Malloc2', True] 00:28:06.903 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:28:06.903 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:28:06.903 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1', 'Malloc1', True] 00:28:06.903 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:28:06.903 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:28:06.903 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1', 'nqn.2014-08.org.spdk:cnode1', True] 00:28:06.903 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:28:06.903 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True', 'Allow any host', False] 00:28:06.903 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False', 'Allow any host', True] 00:28:06.903 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:28:06.903 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4', '127.0.0.1:4262', True] 00:28:06.903 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:28:06.903 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5', 'Malloc5', True] 00:28:06.903 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6', 'Malloc6', True] 00:28:06.903 Executing command: ['/nvmf/referral create tcp 127.0.0.2 4030 IPv4', False] 00:28:06.903 03:44:47 -- spdkcli/nvmf.sh@66 -- # timing_exit spdkcli_create_nvmf_config 00:28:06.903 03:44:47 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:06.903 03:44:47 -- common/autotest_common.sh@10 -- # set +x 00:28:06.903 03:44:47 -- spdkcli/nvmf.sh@68 -- # timing_enter spdkcli_check_match 00:28:06.903 03:44:47 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:06.903 03:44:47 -- common/autotest_common.sh@10 -- # set +x 00:28:06.903 03:44:47 -- spdkcli/nvmf.sh@69 -- # check_match 00:28:06.903 03:44:47 -- spdkcli/common.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdkcli.py ll /nvmf 00:28:07.470 03:44:47 -- spdkcli/common.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/match/match /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test.match 00:28:07.470 03:44:47 -- spdkcli/common.sh@46 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test 00:28:07.470 03:44:47 -- spdkcli/nvmf.sh@70 -- # timing_exit spdkcli_check_match 00:28:07.470 03:44:47 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:07.470 03:44:47 -- common/autotest_common.sh@10 -- # set +x 00:28:07.470 03:44:47 -- spdkcli/nvmf.sh@72 -- # timing_enter spdkcli_clear_nvmf_config 00:28:07.470 03:44:47 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:07.470 03:44:47 -- common/autotest_common.sh@10 -- # set +x 00:28:07.470 03:44:47 -- spdkcli/nvmf.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1'\'' '\''Malloc3'\'' 00:28:07.470 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all'\'' '\''Malloc4'\'' 00:28:07.470 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:28:07.470 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' 00:28:07.470 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262'\'' '\''127.0.0.1:4262'\'' 00:28:07.470 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all'\'' '\''127.0.0.1:4261'\'' 00:28:07.470 '\''/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3'\'' '\''nqn.2014-08.org.spdk:cnode3'\'' 00:28:07.470 '\''/nvmf/subsystem delete_all'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:28:07.470 '\''/bdevs/malloc delete Malloc6'\'' '\''Malloc6'\'' 00:28:07.470 '\''/bdevs/malloc delete Malloc5'\'' '\''Malloc5'\'' 00:28:07.470 '\''/bdevs/malloc delete Malloc4'\'' '\''Malloc4'\'' 00:28:07.470 '\''/bdevs/malloc delete Malloc3'\'' '\''Malloc3'\'' 00:28:07.470 '\''/bdevs/malloc delete Malloc2'\'' '\''Malloc2'\'' 00:28:07.470 '\''/bdevs/malloc delete Malloc1'\'' '\''Malloc1'\'' 00:28:07.470 ' 00:28:12.746 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1', 'Malloc3', False] 00:28:12.746 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all', 'Malloc4', False] 00:28:12.746 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', False] 00:28:12.746 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all', 'nqn.2014-08.org.spdk:cnode1', False] 00:28:12.746 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262', '127.0.0.1:4262', False] 00:28:12.746 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all', '127.0.0.1:4261', False] 00:28:12.746 Executing command: ['/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3', 'nqn.2014-08.org.spdk:cnode3', False] 00:28:12.746 Executing command: ['/nvmf/subsystem delete_all', 'nqn.2014-08.org.spdk:cnode2', False] 00:28:12.746 Executing command: ['/bdevs/malloc delete Malloc6', 'Malloc6', False] 00:28:12.746 Executing command: ['/bdevs/malloc delete Malloc5', 'Malloc5', False] 00:28:12.746 Executing command: ['/bdevs/malloc delete Malloc4', 'Malloc4', False] 00:28:12.746 Executing command: ['/bdevs/malloc delete Malloc3', 'Malloc3', False] 00:28:12.746 Executing command: ['/bdevs/malloc delete Malloc2', 'Malloc2', False] 00:28:12.746 Executing command: ['/bdevs/malloc delete Malloc1', 'Malloc1', False] 00:28:12.746 03:44:53 -- spdkcli/nvmf.sh@88 -- # timing_exit spdkcli_clear_nvmf_config 00:28:12.746 03:44:53 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:12.746 03:44:53 -- common/autotest_common.sh@10 -- # set +x 00:28:12.746 03:44:53 -- spdkcli/nvmf.sh@90 -- # killprocess 3176178 00:28:12.746 03:44:53 -- common/autotest_common.sh@936 -- # '[' -z 3176178 ']' 00:28:12.746 03:44:53 -- common/autotest_common.sh@940 -- # kill -0 3176178 00:28:12.746 03:44:53 -- common/autotest_common.sh@941 -- # uname 00:28:12.746 03:44:53 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:12.746 03:44:53 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3176178 00:28:12.746 03:44:53 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:28:12.746 03:44:53 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:28:12.746 03:44:53 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3176178' 00:28:12.746 killing process with pid 3176178 00:28:12.746 03:44:53 -- common/autotest_common.sh@955 -- # kill 3176178 00:28:12.746 [2024-11-21 03:44:53.314276] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:28:12.746 03:44:53 -- common/autotest_common.sh@960 -- # wait 3176178 00:28:13.004 03:44:53 -- spdkcli/nvmf.sh@1 -- # cleanup 00:28:13.004 03:44:53 -- spdkcli/common.sh@10 -- # '[' -n '' ']' 00:28:13.004 03:44:53 -- spdkcli/common.sh@13 -- # '[' -n 3176178 ']' 00:28:13.005 03:44:53 -- spdkcli/common.sh@14 -- # killprocess 3176178 00:28:13.005 03:44:53 -- common/autotest_common.sh@936 -- # '[' -z 3176178 ']' 00:28:13.005 03:44:53 -- common/autotest_common.sh@940 -- # kill -0 3176178 00:28:13.005 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (3176178) - No such process 00:28:13.005 03:44:53 -- common/autotest_common.sh@963 -- # echo 'Process with pid 3176178 is not found' 00:28:13.005 Process with pid 3176178 is not found 00:28:13.005 03:44:53 -- spdkcli/common.sh@16 -- # '[' -n '' ']' 00:28:13.005 03:44:53 -- spdkcli/common.sh@19 -- # '[' -n '' ']' 00:28:13.005 03:44:53 -- spdkcli/common.sh@22 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_nvmf.test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_details_vhost.test /tmp/sample_aio 00:28:13.005 00:28:13.005 real 0m17.043s 00:28:13.005 user 0m36.260s 00:28:13.005 sys 0m0.801s 00:28:13.005 03:44:53 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:13.005 03:44:53 -- common/autotest_common.sh@10 -- # set +x 00:28:13.005 ************************************ 00:28:13.005 END TEST spdkcli_nvmf_tcp 00:28:13.005 ************************************ 00:28:13.005 03:44:53 -- spdk/autotest.sh@285 -- # run_test nvmf_identify_passthru /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:28:13.005 03:44:53 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:28:13.005 03:44:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:13.005 03:44:53 -- common/autotest_common.sh@10 -- # set +x 00:28:13.005 ************************************ 00:28:13.005 START TEST nvmf_identify_passthru 00:28:13.005 ************************************ 00:28:13.005 03:44:53 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:28:13.264 * Looking for test storage... 00:28:13.264 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:28:13.264 03:44:53 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:28:13.264 03:44:53 -- common/autotest_common.sh@1690 -- # lcov --version 00:28:13.264 03:44:53 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:28:13.264 03:44:53 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:28:13.264 03:44:53 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:28:13.264 03:44:53 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:28:13.264 03:44:53 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:28:13.264 03:44:53 -- scripts/common.sh@335 -- # IFS=.-: 00:28:13.264 03:44:53 -- scripts/common.sh@335 -- # read -ra ver1 00:28:13.264 03:44:53 -- scripts/common.sh@336 -- # IFS=.-: 00:28:13.264 03:44:53 -- scripts/common.sh@336 -- # read -ra ver2 00:28:13.264 03:44:53 -- scripts/common.sh@337 -- # local 'op=<' 00:28:13.264 03:44:53 -- scripts/common.sh@339 -- # ver1_l=2 00:28:13.264 03:44:53 -- scripts/common.sh@340 -- # ver2_l=1 00:28:13.264 03:44:53 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:28:13.264 03:44:53 -- scripts/common.sh@343 -- # case "$op" in 00:28:13.264 03:44:53 -- scripts/common.sh@344 -- # : 1 00:28:13.264 03:44:53 -- scripts/common.sh@363 -- # (( v = 0 )) 00:28:13.264 03:44:53 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:28:13.264 03:44:53 -- scripts/common.sh@364 -- # decimal 1 00:28:13.264 03:44:53 -- scripts/common.sh@352 -- # local d=1 00:28:13.264 03:44:53 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:28:13.264 03:44:53 -- scripts/common.sh@354 -- # echo 1 00:28:13.264 03:44:53 -- scripts/common.sh@364 -- # ver1[v]=1 00:28:13.264 03:44:53 -- scripts/common.sh@365 -- # decimal 2 00:28:13.264 03:44:53 -- scripts/common.sh@352 -- # local d=2 00:28:13.264 03:44:53 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:28:13.264 03:44:53 -- scripts/common.sh@354 -- # echo 2 00:28:13.264 03:44:53 -- scripts/common.sh@365 -- # ver2[v]=2 00:28:13.264 03:44:53 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:28:13.264 03:44:53 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:28:13.264 03:44:53 -- scripts/common.sh@367 -- # return 0 00:28:13.264 03:44:53 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:28:13.264 03:44:53 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:28:13.264 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:13.264 --rc genhtml_branch_coverage=1 00:28:13.264 --rc genhtml_function_coverage=1 00:28:13.264 --rc genhtml_legend=1 00:28:13.264 --rc geninfo_all_blocks=1 00:28:13.264 --rc geninfo_unexecuted_blocks=1 00:28:13.264 00:28:13.264 ' 00:28:13.264 03:44:53 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:28:13.264 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:13.264 --rc genhtml_branch_coverage=1 00:28:13.264 --rc genhtml_function_coverage=1 00:28:13.264 --rc genhtml_legend=1 00:28:13.264 --rc geninfo_all_blocks=1 00:28:13.264 --rc geninfo_unexecuted_blocks=1 00:28:13.264 00:28:13.264 ' 00:28:13.264 03:44:53 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:28:13.264 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:13.264 --rc genhtml_branch_coverage=1 00:28:13.264 --rc genhtml_function_coverage=1 00:28:13.264 --rc genhtml_legend=1 00:28:13.264 --rc geninfo_all_blocks=1 00:28:13.264 --rc geninfo_unexecuted_blocks=1 00:28:13.264 00:28:13.264 ' 00:28:13.264 03:44:53 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:28:13.264 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:13.264 --rc genhtml_branch_coverage=1 00:28:13.264 --rc genhtml_function_coverage=1 00:28:13.264 --rc genhtml_legend=1 00:28:13.264 --rc geninfo_all_blocks=1 00:28:13.264 --rc geninfo_unexecuted_blocks=1 00:28:13.264 00:28:13.264 ' 00:28:13.264 03:44:53 -- target/identify_passthru.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:28:13.264 03:44:53 -- nvmf/common.sh@7 -- # uname -s 00:28:13.264 03:44:53 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:13.264 03:44:53 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:13.264 03:44:53 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:13.264 03:44:53 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:13.264 03:44:53 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:13.264 03:44:53 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:13.264 03:44:53 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:13.264 03:44:53 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:13.264 03:44:53 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:13.264 03:44:53 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:13.264 03:44:53 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:28:13.264 03:44:53 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:28:13.264 03:44:53 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:13.264 03:44:53 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:13.264 03:44:53 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:13.264 03:44:53 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:13.264 03:44:53 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:13.264 03:44:53 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:13.264 03:44:53 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:13.264 03:44:53 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:13.264 03:44:53 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:13.265 03:44:53 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:13.265 03:44:53 -- paths/export.sh@5 -- # export PATH 00:28:13.265 03:44:53 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:13.265 03:44:53 -- nvmf/common.sh@46 -- # : 0 00:28:13.265 03:44:53 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:28:13.265 03:44:53 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:28:13.265 03:44:53 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:28:13.265 03:44:53 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:13.265 03:44:53 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:13.265 03:44:53 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:28:13.265 03:44:53 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:28:13.265 03:44:53 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:28:13.265 03:44:53 -- target/identify_passthru.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:13.265 03:44:53 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:13.265 03:44:53 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:13.265 03:44:53 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:13.265 03:44:53 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:13.265 03:44:53 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:13.265 03:44:53 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:13.265 03:44:53 -- paths/export.sh@5 -- # export PATH 00:28:13.265 03:44:53 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:13.265 03:44:53 -- target/identify_passthru.sh@12 -- # nvmftestinit 00:28:13.265 03:44:53 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:28:13.265 03:44:53 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:28:13.265 03:44:53 -- nvmf/common.sh@436 -- # prepare_net_devs 00:28:13.265 03:44:53 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:28:13.265 03:44:53 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:28:13.265 03:44:53 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:13.265 03:44:53 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:28:13.265 03:44:53 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:13.265 03:44:53 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:28:13.265 03:44:53 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:28:13.265 03:44:53 -- nvmf/common.sh@284 -- # xtrace_disable 00:28:13.265 03:44:53 -- common/autotest_common.sh@10 -- # set +x 00:28:15.168 03:44:55 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:28:15.168 03:44:55 -- nvmf/common.sh@290 -- # pci_devs=() 00:28:15.168 03:44:55 -- nvmf/common.sh@290 -- # local -a pci_devs 00:28:15.168 03:44:55 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:28:15.168 03:44:55 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:28:15.168 03:44:55 -- nvmf/common.sh@292 -- # pci_drivers=() 00:28:15.168 03:44:55 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:28:15.168 03:44:55 -- nvmf/common.sh@294 -- # net_devs=() 00:28:15.168 03:44:55 -- nvmf/common.sh@294 -- # local -ga net_devs 00:28:15.169 03:44:55 -- nvmf/common.sh@295 -- # e810=() 00:28:15.169 03:44:55 -- nvmf/common.sh@295 -- # local -ga e810 00:28:15.169 03:44:55 -- nvmf/common.sh@296 -- # x722=() 00:28:15.169 03:44:55 -- nvmf/common.sh@296 -- # local -ga x722 00:28:15.169 03:44:55 -- nvmf/common.sh@297 -- # mlx=() 00:28:15.169 03:44:55 -- nvmf/common.sh@297 -- # local -ga mlx 00:28:15.169 03:44:55 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:28:15.169 03:44:55 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:28:15.169 03:44:55 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:28:15.169 03:44:55 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:28:15.169 03:44:55 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:28:15.169 03:44:55 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:28:15.169 03:44:55 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:28:15.169 03:44:55 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:28:15.169 03:44:55 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:28:15.169 03:44:55 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:28:15.169 03:44:55 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:28:15.169 03:44:55 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:28:15.169 03:44:55 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:28:15.169 03:44:55 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:28:15.169 03:44:55 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:28:15.169 03:44:55 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:28:15.169 03:44:55 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:28:15.169 03:44:55 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:15.169 03:44:55 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:28:15.169 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:28:15.169 03:44:55 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:15.169 03:44:55 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:15.169 03:44:55 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:15.169 03:44:55 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:15.169 03:44:55 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:15.169 03:44:55 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:15.169 03:44:55 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:28:15.169 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:28:15.169 03:44:55 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:15.169 03:44:55 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:15.169 03:44:55 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:15.169 03:44:55 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:15.169 03:44:55 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:15.169 03:44:55 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:28:15.169 03:44:55 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:28:15.169 03:44:55 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:28:15.169 03:44:55 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:15.169 03:44:55 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:15.169 03:44:55 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:15.169 03:44:55 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:15.169 03:44:55 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:28:15.169 Found net devices under 0000:0a:00.0: cvl_0_0 00:28:15.169 03:44:55 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:15.169 03:44:55 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:15.169 03:44:55 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:15.169 03:44:55 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:15.169 03:44:55 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:15.169 03:44:55 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:28:15.169 Found net devices under 0000:0a:00.1: cvl_0_1 00:28:15.169 03:44:55 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:15.169 03:44:55 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:28:15.169 03:44:55 -- nvmf/common.sh@402 -- # is_hw=yes 00:28:15.169 03:44:55 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:28:15.169 03:44:55 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:28:15.169 03:44:55 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:28:15.169 03:44:55 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:28:15.169 03:44:55 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:28:15.169 03:44:55 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:28:15.169 03:44:55 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:28:15.169 03:44:55 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:28:15.169 03:44:55 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:28:15.169 03:44:55 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:28:15.169 03:44:55 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:28:15.169 03:44:55 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:28:15.169 03:44:55 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:28:15.169 03:44:55 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:28:15.169 03:44:55 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:28:15.169 03:44:55 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:28:15.430 03:44:55 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:28:15.430 03:44:55 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:28:15.430 03:44:55 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:28:15.430 03:44:55 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:28:15.430 03:44:55 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:28:15.430 03:44:55 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:28:15.430 03:44:55 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:28:15.430 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:28:15.430 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.277 ms 00:28:15.430 00:28:15.430 --- 10.0.0.2 ping statistics --- 00:28:15.430 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:15.430 rtt min/avg/max/mdev = 0.277/0.277/0.277/0.000 ms 00:28:15.430 03:44:55 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:28:15.430 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:28:15.430 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.107 ms 00:28:15.430 00:28:15.430 --- 10.0.0.1 ping statistics --- 00:28:15.430 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:15.430 rtt min/avg/max/mdev = 0.107/0.107/0.107/0.000 ms 00:28:15.430 03:44:55 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:28:15.430 03:44:55 -- nvmf/common.sh@410 -- # return 0 00:28:15.430 03:44:55 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:28:15.430 03:44:55 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:28:15.430 03:44:55 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:28:15.430 03:44:55 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:28:15.430 03:44:55 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:28:15.430 03:44:55 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:28:15.430 03:44:55 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:28:15.430 03:44:55 -- target/identify_passthru.sh@14 -- # timing_enter nvme_identify 00:28:15.430 03:44:55 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:15.430 03:44:55 -- common/autotest_common.sh@10 -- # set +x 00:28:15.430 03:44:55 -- target/identify_passthru.sh@16 -- # get_first_nvme_bdf 00:28:15.430 03:44:55 -- common/autotest_common.sh@1519 -- # bdfs=() 00:28:15.430 03:44:55 -- common/autotest_common.sh@1519 -- # local bdfs 00:28:15.430 03:44:55 -- common/autotest_common.sh@1520 -- # bdfs=($(get_nvme_bdfs)) 00:28:15.430 03:44:55 -- common/autotest_common.sh@1520 -- # get_nvme_bdfs 00:28:15.430 03:44:55 -- common/autotest_common.sh@1508 -- # bdfs=() 00:28:15.430 03:44:55 -- common/autotest_common.sh@1508 -- # local bdfs 00:28:15.430 03:44:55 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:28:15.430 03:44:55 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:28:15.430 03:44:55 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:28:15.430 03:44:55 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:28:15.430 03:44:55 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:28:15.430 03:44:55 -- common/autotest_common.sh@1522 -- # echo 0000:88:00.0 00:28:15.430 03:44:55 -- target/identify_passthru.sh@16 -- # bdf=0000:88:00.0 00:28:15.430 03:44:55 -- target/identify_passthru.sh@17 -- # '[' -z 0000:88:00.0 ']' 00:28:15.430 03:44:55 -- target/identify_passthru.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:88:00.0' -i 0 00:28:15.431 03:44:55 -- target/identify_passthru.sh@23 -- # grep 'Serial Number:' 00:28:15.431 03:44:55 -- target/identify_passthru.sh@23 -- # awk '{print $3}' 00:28:15.431 EAL: No free 2048 kB hugepages reported on node 1 00:28:19.620 03:45:00 -- target/identify_passthru.sh@23 -- # nvme_serial_number=PHLJ916004901P0FGN 00:28:19.620 03:45:00 -- target/identify_passthru.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:88:00.0' -i 0 00:28:19.620 03:45:00 -- target/identify_passthru.sh@24 -- # grep 'Model Number:' 00:28:19.620 03:45:00 -- target/identify_passthru.sh@24 -- # awk '{print $3}' 00:28:19.620 EAL: No free 2048 kB hugepages reported on node 1 00:28:23.809 03:45:04 -- target/identify_passthru.sh@24 -- # nvme_model_number=INTEL 00:28:23.809 03:45:04 -- target/identify_passthru.sh@26 -- # timing_exit nvme_identify 00:28:23.809 03:45:04 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:23.810 03:45:04 -- common/autotest_common.sh@10 -- # set +x 00:28:23.810 03:45:04 -- target/identify_passthru.sh@28 -- # timing_enter start_nvmf_tgt 00:28:23.810 03:45:04 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:23.810 03:45:04 -- common/autotest_common.sh@10 -- # set +x 00:28:23.810 03:45:04 -- target/identify_passthru.sh@31 -- # nvmfpid=3181027 00:28:23.810 03:45:04 -- target/identify_passthru.sh@30 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:28:23.810 03:45:04 -- target/identify_passthru.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:28:23.810 03:45:04 -- target/identify_passthru.sh@35 -- # waitforlisten 3181027 00:28:23.810 03:45:04 -- common/autotest_common.sh@829 -- # '[' -z 3181027 ']' 00:28:23.810 03:45:04 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:23.810 03:45:04 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:23.810 03:45:04 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:23.810 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:23.810 03:45:04 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:23.810 03:45:04 -- common/autotest_common.sh@10 -- # set +x 00:28:23.810 [2024-11-21 03:45:04.443948] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:28:23.810 [2024-11-21 03:45:04.444027] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:24.068 EAL: No free 2048 kB hugepages reported on node 1 00:28:24.068 [2024-11-21 03:45:04.508255] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:28:24.068 [2024-11-21 03:45:04.618607] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:24.068 [2024-11-21 03:45:04.618763] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:28:24.068 [2024-11-21 03:45:04.618781] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:28:24.068 [2024-11-21 03:45:04.618794] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:28:24.068 [2024-11-21 03:45:04.618845] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:28:24.068 [2024-11-21 03:45:04.619148] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:28:24.068 [2024-11-21 03:45:04.619175] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:28:24.068 [2024-11-21 03:45:04.619178] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:24.068 03:45:04 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:24.068 03:45:04 -- common/autotest_common.sh@862 -- # return 0 00:28:24.068 03:45:04 -- target/identify_passthru.sh@36 -- # rpc_cmd -v nvmf_set_config --passthru-identify-ctrlr 00:28:24.068 03:45:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:24.068 03:45:04 -- common/autotest_common.sh@10 -- # set +x 00:28:24.068 INFO: Log level set to 20 00:28:24.068 INFO: Requests: 00:28:24.068 { 00:28:24.068 "jsonrpc": "2.0", 00:28:24.068 "method": "nvmf_set_config", 00:28:24.068 "id": 1, 00:28:24.068 "params": { 00:28:24.068 "admin_cmd_passthru": { 00:28:24.068 "identify_ctrlr": true 00:28:24.068 } 00:28:24.068 } 00:28:24.068 } 00:28:24.068 00:28:24.068 INFO: response: 00:28:24.068 { 00:28:24.068 "jsonrpc": "2.0", 00:28:24.069 "id": 1, 00:28:24.069 "result": true 00:28:24.069 } 00:28:24.069 00:28:24.069 03:45:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:24.069 03:45:04 -- target/identify_passthru.sh@37 -- # rpc_cmd -v framework_start_init 00:28:24.069 03:45:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:24.069 03:45:04 -- common/autotest_common.sh@10 -- # set +x 00:28:24.069 INFO: Setting log level to 20 00:28:24.069 INFO: Setting log level to 20 00:28:24.069 INFO: Log level set to 20 00:28:24.069 INFO: Log level set to 20 00:28:24.069 INFO: Requests: 00:28:24.069 { 00:28:24.069 "jsonrpc": "2.0", 00:28:24.069 "method": "framework_start_init", 00:28:24.069 "id": 1 00:28:24.069 } 00:28:24.069 00:28:24.069 INFO: Requests: 00:28:24.069 { 00:28:24.069 "jsonrpc": "2.0", 00:28:24.069 "method": "framework_start_init", 00:28:24.069 "id": 1 00:28:24.069 } 00:28:24.069 00:28:24.329 [2024-11-21 03:45:04.783294] nvmf_tgt.c: 423:nvmf_tgt_advance_state: *NOTICE*: Custom identify ctrlr handler enabled 00:28:24.329 INFO: response: 00:28:24.329 { 00:28:24.329 "jsonrpc": "2.0", 00:28:24.329 "id": 1, 00:28:24.329 "result": true 00:28:24.329 } 00:28:24.329 00:28:24.329 INFO: response: 00:28:24.329 { 00:28:24.329 "jsonrpc": "2.0", 00:28:24.329 "id": 1, 00:28:24.329 "result": true 00:28:24.329 } 00:28:24.329 00:28:24.329 03:45:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:24.329 03:45:04 -- target/identify_passthru.sh@38 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:28:24.329 03:45:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:24.329 03:45:04 -- common/autotest_common.sh@10 -- # set +x 00:28:24.329 INFO: Setting log level to 40 00:28:24.329 INFO: Setting log level to 40 00:28:24.329 INFO: Setting log level to 40 00:28:24.329 [2024-11-21 03:45:04.793196] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:24.329 03:45:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:24.329 03:45:04 -- target/identify_passthru.sh@39 -- # timing_exit start_nvmf_tgt 00:28:24.329 03:45:04 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:24.329 03:45:04 -- common/autotest_common.sh@10 -- # set +x 00:28:24.329 03:45:04 -- target/identify_passthru.sh@41 -- # rpc_cmd bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:88:00.0 00:28:24.329 03:45:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:24.329 03:45:04 -- common/autotest_common.sh@10 -- # set +x 00:28:27.617 Nvme0n1 00:28:27.617 03:45:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:27.617 03:45:07 -- target/identify_passthru.sh@42 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 1 00:28:27.617 03:45:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:27.617 03:45:07 -- common/autotest_common.sh@10 -- # set +x 00:28:27.617 03:45:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:27.617 03:45:07 -- target/identify_passthru.sh@43 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:28:27.617 03:45:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:27.617 03:45:07 -- common/autotest_common.sh@10 -- # set +x 00:28:27.617 03:45:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:27.617 03:45:07 -- target/identify_passthru.sh@44 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:27.617 03:45:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:27.617 03:45:07 -- common/autotest_common.sh@10 -- # set +x 00:28:27.617 [2024-11-21 03:45:07.681266] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:27.617 03:45:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:27.617 03:45:07 -- target/identify_passthru.sh@46 -- # rpc_cmd nvmf_get_subsystems 00:28:27.617 03:45:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:27.617 03:45:07 -- common/autotest_common.sh@10 -- # set +x 00:28:27.617 [2024-11-21 03:45:07.688962] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:28:27.617 [ 00:28:27.617 { 00:28:27.617 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:28:27.617 "subtype": "Discovery", 00:28:27.617 "listen_addresses": [], 00:28:27.617 "allow_any_host": true, 00:28:27.617 "hosts": [] 00:28:27.617 }, 00:28:27.617 { 00:28:27.617 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:28:27.617 "subtype": "NVMe", 00:28:27.617 "listen_addresses": [ 00:28:27.617 { 00:28:27.617 "transport": "TCP", 00:28:27.617 "trtype": "TCP", 00:28:27.617 "adrfam": "IPv4", 00:28:27.617 "traddr": "10.0.0.2", 00:28:27.617 "trsvcid": "4420" 00:28:27.617 } 00:28:27.617 ], 00:28:27.617 "allow_any_host": true, 00:28:27.617 "hosts": [], 00:28:27.617 "serial_number": "SPDK00000000000001", 00:28:27.617 "model_number": "SPDK bdev Controller", 00:28:27.617 "max_namespaces": 1, 00:28:27.617 "min_cntlid": 1, 00:28:27.617 "max_cntlid": 65519, 00:28:27.617 "namespaces": [ 00:28:27.617 { 00:28:27.617 "nsid": 1, 00:28:27.617 "bdev_name": "Nvme0n1", 00:28:27.617 "name": "Nvme0n1", 00:28:27.617 "nguid": "AD571E1D4EBE4F85AA40A7E0CB7B8686", 00:28:27.617 "uuid": "ad571e1d-4ebe-4f85-aa40-a7e0cb7b8686" 00:28:27.617 } 00:28:27.617 ] 00:28:27.617 } 00:28:27.617 ] 00:28:27.617 03:45:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:27.617 03:45:07 -- target/identify_passthru.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:28:27.617 03:45:07 -- target/identify_passthru.sh@54 -- # grep 'Serial Number:' 00:28:27.617 03:45:07 -- target/identify_passthru.sh@54 -- # awk '{print $3}' 00:28:27.617 EAL: No free 2048 kB hugepages reported on node 1 00:28:27.617 03:45:07 -- target/identify_passthru.sh@54 -- # nvmf_serial_number=PHLJ916004901P0FGN 00:28:27.618 03:45:07 -- target/identify_passthru.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:28:27.618 03:45:07 -- target/identify_passthru.sh@61 -- # grep 'Model Number:' 00:28:27.618 03:45:07 -- target/identify_passthru.sh@61 -- # awk '{print $3}' 00:28:27.618 EAL: No free 2048 kB hugepages reported on node 1 00:28:27.618 03:45:08 -- target/identify_passthru.sh@61 -- # nvmf_model_number=INTEL 00:28:27.618 03:45:08 -- target/identify_passthru.sh@63 -- # '[' PHLJ916004901P0FGN '!=' PHLJ916004901P0FGN ']' 00:28:27.618 03:45:08 -- target/identify_passthru.sh@68 -- # '[' INTEL '!=' INTEL ']' 00:28:27.618 03:45:08 -- target/identify_passthru.sh@73 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:28:27.618 03:45:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:27.618 03:45:08 -- common/autotest_common.sh@10 -- # set +x 00:28:27.618 03:45:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:27.618 03:45:08 -- target/identify_passthru.sh@75 -- # trap - SIGINT SIGTERM EXIT 00:28:27.618 03:45:08 -- target/identify_passthru.sh@77 -- # nvmftestfini 00:28:27.618 03:45:08 -- nvmf/common.sh@476 -- # nvmfcleanup 00:28:27.618 03:45:08 -- nvmf/common.sh@116 -- # sync 00:28:27.618 03:45:08 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:28:27.618 03:45:08 -- nvmf/common.sh@119 -- # set +e 00:28:27.618 03:45:08 -- nvmf/common.sh@120 -- # for i in {1..20} 00:28:27.618 03:45:08 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:28:27.618 rmmod nvme_tcp 00:28:27.618 rmmod nvme_fabrics 00:28:27.618 rmmod nvme_keyring 00:28:27.618 03:45:08 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:28:27.618 03:45:08 -- nvmf/common.sh@123 -- # set -e 00:28:27.618 03:45:08 -- nvmf/common.sh@124 -- # return 0 00:28:27.618 03:45:08 -- nvmf/common.sh@477 -- # '[' -n 3181027 ']' 00:28:27.618 03:45:08 -- nvmf/common.sh@478 -- # killprocess 3181027 00:28:27.618 03:45:08 -- common/autotest_common.sh@936 -- # '[' -z 3181027 ']' 00:28:27.618 03:45:08 -- common/autotest_common.sh@940 -- # kill -0 3181027 00:28:27.618 03:45:08 -- common/autotest_common.sh@941 -- # uname 00:28:27.618 03:45:08 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:27.618 03:45:08 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3181027 00:28:27.618 03:45:08 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:28:27.618 03:45:08 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:28:27.618 03:45:08 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3181027' 00:28:27.618 killing process with pid 3181027 00:28:27.618 03:45:08 -- common/autotest_common.sh@955 -- # kill 3181027 00:28:27.618 [2024-11-21 03:45:08.134716] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:28:27.618 03:45:08 -- common/autotest_common.sh@960 -- # wait 3181027 00:28:29.519 03:45:09 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:28:29.519 03:45:09 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:28:29.519 03:45:09 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:28:29.519 03:45:09 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:28:29.519 03:45:09 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:28:29.519 03:45:09 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:29.519 03:45:09 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:28:29.519 03:45:09 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:31.424 03:45:11 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:28:31.424 00:28:31.424 real 0m18.168s 00:28:31.424 user 0m26.864s 00:28:31.424 sys 0m2.340s 00:28:31.424 03:45:11 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:31.424 03:45:11 -- common/autotest_common.sh@10 -- # set +x 00:28:31.424 ************************************ 00:28:31.424 END TEST nvmf_identify_passthru 00:28:31.424 ************************************ 00:28:31.424 03:45:11 -- spdk/autotest.sh@287 -- # run_test nvmf_dif /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:28:31.424 03:45:11 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:28:31.424 03:45:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:31.424 03:45:11 -- common/autotest_common.sh@10 -- # set +x 00:28:31.424 ************************************ 00:28:31.424 START TEST nvmf_dif 00:28:31.424 ************************************ 00:28:31.424 03:45:11 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:28:31.424 * Looking for test storage... 00:28:31.424 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:28:31.424 03:45:11 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:28:31.424 03:45:11 -- common/autotest_common.sh@1690 -- # lcov --version 00:28:31.424 03:45:11 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:28:31.424 03:45:11 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:28:31.424 03:45:11 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:28:31.424 03:45:11 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:28:31.424 03:45:11 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:28:31.424 03:45:11 -- scripts/common.sh@335 -- # IFS=.-: 00:28:31.424 03:45:11 -- scripts/common.sh@335 -- # read -ra ver1 00:28:31.424 03:45:11 -- scripts/common.sh@336 -- # IFS=.-: 00:28:31.424 03:45:11 -- scripts/common.sh@336 -- # read -ra ver2 00:28:31.424 03:45:11 -- scripts/common.sh@337 -- # local 'op=<' 00:28:31.424 03:45:11 -- scripts/common.sh@339 -- # ver1_l=2 00:28:31.424 03:45:11 -- scripts/common.sh@340 -- # ver2_l=1 00:28:31.424 03:45:11 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:28:31.424 03:45:11 -- scripts/common.sh@343 -- # case "$op" in 00:28:31.424 03:45:11 -- scripts/common.sh@344 -- # : 1 00:28:31.424 03:45:11 -- scripts/common.sh@363 -- # (( v = 0 )) 00:28:31.424 03:45:11 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:28:31.424 03:45:11 -- scripts/common.sh@364 -- # decimal 1 00:28:31.424 03:45:11 -- scripts/common.sh@352 -- # local d=1 00:28:31.424 03:45:11 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:28:31.424 03:45:11 -- scripts/common.sh@354 -- # echo 1 00:28:31.424 03:45:11 -- scripts/common.sh@364 -- # ver1[v]=1 00:28:31.424 03:45:11 -- scripts/common.sh@365 -- # decimal 2 00:28:31.424 03:45:11 -- scripts/common.sh@352 -- # local d=2 00:28:31.424 03:45:11 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:28:31.424 03:45:11 -- scripts/common.sh@354 -- # echo 2 00:28:31.424 03:45:11 -- scripts/common.sh@365 -- # ver2[v]=2 00:28:31.424 03:45:11 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:28:31.424 03:45:11 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:28:31.424 03:45:11 -- scripts/common.sh@367 -- # return 0 00:28:31.424 03:45:11 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:28:31.424 03:45:11 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:28:31.424 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:31.424 --rc genhtml_branch_coverage=1 00:28:31.424 --rc genhtml_function_coverage=1 00:28:31.424 --rc genhtml_legend=1 00:28:31.424 --rc geninfo_all_blocks=1 00:28:31.424 --rc geninfo_unexecuted_blocks=1 00:28:31.424 00:28:31.424 ' 00:28:31.424 03:45:11 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:28:31.424 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:31.424 --rc genhtml_branch_coverage=1 00:28:31.424 --rc genhtml_function_coverage=1 00:28:31.424 --rc genhtml_legend=1 00:28:31.424 --rc geninfo_all_blocks=1 00:28:31.424 --rc geninfo_unexecuted_blocks=1 00:28:31.424 00:28:31.424 ' 00:28:31.424 03:45:11 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:28:31.424 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:31.424 --rc genhtml_branch_coverage=1 00:28:31.424 --rc genhtml_function_coverage=1 00:28:31.424 --rc genhtml_legend=1 00:28:31.424 --rc geninfo_all_blocks=1 00:28:31.424 --rc geninfo_unexecuted_blocks=1 00:28:31.424 00:28:31.424 ' 00:28:31.424 03:45:11 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:28:31.424 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:31.424 --rc genhtml_branch_coverage=1 00:28:31.424 --rc genhtml_function_coverage=1 00:28:31.424 --rc genhtml_legend=1 00:28:31.424 --rc geninfo_all_blocks=1 00:28:31.424 --rc geninfo_unexecuted_blocks=1 00:28:31.424 00:28:31.424 ' 00:28:31.424 03:45:11 -- target/dif.sh@13 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:28:31.424 03:45:11 -- nvmf/common.sh@7 -- # uname -s 00:28:31.424 03:45:11 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:31.424 03:45:11 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:31.424 03:45:11 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:31.424 03:45:11 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:31.424 03:45:11 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:31.424 03:45:11 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:31.424 03:45:11 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:31.424 03:45:11 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:31.424 03:45:11 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:31.424 03:45:11 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:31.424 03:45:11 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:28:31.424 03:45:11 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:28:31.424 03:45:11 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:31.424 03:45:11 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:31.424 03:45:11 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:31.424 03:45:11 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:31.424 03:45:11 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:31.424 03:45:11 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:31.424 03:45:11 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:31.425 03:45:11 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:31.425 03:45:11 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:31.425 03:45:11 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:31.425 03:45:11 -- paths/export.sh@5 -- # export PATH 00:28:31.425 03:45:11 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:31.425 03:45:11 -- nvmf/common.sh@46 -- # : 0 00:28:31.425 03:45:11 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:28:31.425 03:45:11 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:28:31.425 03:45:11 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:28:31.425 03:45:11 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:31.425 03:45:11 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:31.425 03:45:11 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:28:31.425 03:45:11 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:28:31.425 03:45:11 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:28:31.425 03:45:11 -- target/dif.sh@15 -- # NULL_META=16 00:28:31.425 03:45:11 -- target/dif.sh@15 -- # NULL_BLOCK_SIZE=512 00:28:31.425 03:45:11 -- target/dif.sh@15 -- # NULL_SIZE=64 00:28:31.425 03:45:11 -- target/dif.sh@15 -- # NULL_DIF=1 00:28:31.425 03:45:11 -- target/dif.sh@135 -- # nvmftestinit 00:28:31.425 03:45:11 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:28:31.425 03:45:11 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:28:31.425 03:45:11 -- nvmf/common.sh@436 -- # prepare_net_devs 00:28:31.425 03:45:11 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:28:31.425 03:45:11 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:28:31.425 03:45:11 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:31.425 03:45:11 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:28:31.425 03:45:11 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:31.425 03:45:11 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:28:31.425 03:45:11 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:28:31.425 03:45:11 -- nvmf/common.sh@284 -- # xtrace_disable 00:28:31.425 03:45:11 -- common/autotest_common.sh@10 -- # set +x 00:28:33.327 03:45:13 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:28:33.328 03:45:13 -- nvmf/common.sh@290 -- # pci_devs=() 00:28:33.328 03:45:13 -- nvmf/common.sh@290 -- # local -a pci_devs 00:28:33.328 03:45:13 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:28:33.328 03:45:13 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:28:33.328 03:45:13 -- nvmf/common.sh@292 -- # pci_drivers=() 00:28:33.328 03:45:13 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:28:33.328 03:45:13 -- nvmf/common.sh@294 -- # net_devs=() 00:28:33.328 03:45:13 -- nvmf/common.sh@294 -- # local -ga net_devs 00:28:33.328 03:45:13 -- nvmf/common.sh@295 -- # e810=() 00:28:33.328 03:45:13 -- nvmf/common.sh@295 -- # local -ga e810 00:28:33.328 03:45:13 -- nvmf/common.sh@296 -- # x722=() 00:28:33.328 03:45:13 -- nvmf/common.sh@296 -- # local -ga x722 00:28:33.328 03:45:13 -- nvmf/common.sh@297 -- # mlx=() 00:28:33.328 03:45:13 -- nvmf/common.sh@297 -- # local -ga mlx 00:28:33.328 03:45:13 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:28:33.328 03:45:13 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:28:33.328 03:45:13 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:28:33.328 03:45:13 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:28:33.328 03:45:13 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:28:33.328 03:45:13 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:28:33.328 03:45:13 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:28:33.328 03:45:13 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:28:33.328 03:45:13 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:28:33.328 03:45:13 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:28:33.328 03:45:13 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:28:33.328 03:45:13 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:28:33.328 03:45:13 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:28:33.328 03:45:13 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:28:33.328 03:45:13 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:28:33.328 03:45:13 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:28:33.328 03:45:13 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:28:33.328 03:45:13 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:33.328 03:45:13 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:28:33.328 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:28:33.328 03:45:13 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:33.328 03:45:13 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:33.328 03:45:13 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:33.328 03:45:13 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:33.328 03:45:13 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:33.328 03:45:13 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:33.328 03:45:13 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:28:33.328 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:28:33.328 03:45:13 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:33.328 03:45:13 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:33.328 03:45:13 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:33.328 03:45:13 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:33.328 03:45:13 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:33.328 03:45:13 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:28:33.328 03:45:13 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:28:33.328 03:45:13 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:28:33.328 03:45:13 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:33.328 03:45:13 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:33.328 03:45:13 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:33.328 03:45:13 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:33.328 03:45:13 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:28:33.328 Found net devices under 0000:0a:00.0: cvl_0_0 00:28:33.328 03:45:13 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:33.328 03:45:13 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:33.328 03:45:13 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:33.328 03:45:13 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:33.328 03:45:13 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:33.328 03:45:13 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:28:33.328 Found net devices under 0000:0a:00.1: cvl_0_1 00:28:33.328 03:45:13 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:33.328 03:45:13 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:28:33.328 03:45:13 -- nvmf/common.sh@402 -- # is_hw=yes 00:28:33.328 03:45:13 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:28:33.328 03:45:13 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:28:33.328 03:45:13 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:28:33.328 03:45:13 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:28:33.328 03:45:13 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:28:33.328 03:45:13 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:28:33.328 03:45:13 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:28:33.328 03:45:13 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:28:33.328 03:45:13 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:28:33.328 03:45:13 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:28:33.328 03:45:13 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:28:33.328 03:45:13 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:28:33.328 03:45:13 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:28:33.328 03:45:13 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:28:33.328 03:45:13 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:28:33.328 03:45:13 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:28:33.328 03:45:13 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:28:33.328 03:45:13 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:28:33.328 03:45:13 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:28:33.587 03:45:13 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:28:33.587 03:45:14 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:28:33.587 03:45:14 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:28:33.587 03:45:14 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:28:33.587 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:28:33.587 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.221 ms 00:28:33.587 00:28:33.587 --- 10.0.0.2 ping statistics --- 00:28:33.587 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:33.587 rtt min/avg/max/mdev = 0.221/0.221/0.221/0.000 ms 00:28:33.587 03:45:14 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:28:33.587 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:28:33.587 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.098 ms 00:28:33.587 00:28:33.587 --- 10.0.0.1 ping statistics --- 00:28:33.587 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:33.587 rtt min/avg/max/mdev = 0.098/0.098/0.098/0.000 ms 00:28:33.587 03:45:14 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:28:33.587 03:45:14 -- nvmf/common.sh@410 -- # return 0 00:28:33.587 03:45:14 -- nvmf/common.sh@438 -- # '[' iso == iso ']' 00:28:33.587 03:45:14 -- nvmf/common.sh@439 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:28:34.525 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:28:34.525 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:28:34.525 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:28:34.525 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:28:34.525 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:28:34.525 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:28:34.525 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:28:34.525 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:28:34.525 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:28:34.525 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:28:34.525 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:28:34.525 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:28:34.525 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:28:34.525 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:28:34.525 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:28:34.525 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:28:34.525 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:28:34.784 03:45:15 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:28:34.784 03:45:15 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:28:34.784 03:45:15 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:28:34.784 03:45:15 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:28:34.784 03:45:15 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:28:34.784 03:45:15 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:28:34.784 03:45:15 -- target/dif.sh@136 -- # NVMF_TRANSPORT_OPTS+=' --dif-insert-or-strip' 00:28:34.784 03:45:15 -- target/dif.sh@137 -- # nvmfappstart 00:28:34.784 03:45:15 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:28:34.784 03:45:15 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:34.784 03:45:15 -- common/autotest_common.sh@10 -- # set +x 00:28:34.784 03:45:15 -- nvmf/common.sh@469 -- # nvmfpid=3184852 00:28:34.784 03:45:15 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF 00:28:34.784 03:45:15 -- nvmf/common.sh@470 -- # waitforlisten 3184852 00:28:34.784 03:45:15 -- common/autotest_common.sh@829 -- # '[' -z 3184852 ']' 00:28:34.784 03:45:15 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:34.784 03:45:15 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:34.784 03:45:15 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:34.784 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:34.784 03:45:15 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:34.784 03:45:15 -- common/autotest_common.sh@10 -- # set +x 00:28:34.784 [2024-11-21 03:45:15.364596] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:28:34.784 [2024-11-21 03:45:15.364670] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:34.784 EAL: No free 2048 kB hugepages reported on node 1 00:28:34.784 [2024-11-21 03:45:15.426536] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:35.043 [2024-11-21 03:45:15.529167] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:35.043 [2024-11-21 03:45:15.529325] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:28:35.043 [2024-11-21 03:45:15.529343] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:28:35.043 [2024-11-21 03:45:15.529356] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:28:35.043 [2024-11-21 03:45:15.529401] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:35.982 03:45:16 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:35.982 03:45:16 -- common/autotest_common.sh@862 -- # return 0 00:28:35.982 03:45:16 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:28:35.982 03:45:16 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:35.982 03:45:16 -- common/autotest_common.sh@10 -- # set +x 00:28:35.982 03:45:16 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:28:35.982 03:45:16 -- target/dif.sh@139 -- # create_transport 00:28:35.982 03:45:16 -- target/dif.sh@50 -- # rpc_cmd nvmf_create_transport -t tcp -o --dif-insert-or-strip 00:28:35.982 03:45:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:35.982 03:45:16 -- common/autotest_common.sh@10 -- # set +x 00:28:35.982 [2024-11-21 03:45:16.402928] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:35.982 03:45:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:35.982 03:45:16 -- target/dif.sh@141 -- # run_test fio_dif_1_default fio_dif_1 00:28:35.982 03:45:16 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:28:35.982 03:45:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:35.982 03:45:16 -- common/autotest_common.sh@10 -- # set +x 00:28:35.982 ************************************ 00:28:35.982 START TEST fio_dif_1_default 00:28:35.982 ************************************ 00:28:35.982 03:45:16 -- common/autotest_common.sh@1114 -- # fio_dif_1 00:28:35.982 03:45:16 -- target/dif.sh@86 -- # create_subsystems 0 00:28:35.982 03:45:16 -- target/dif.sh@28 -- # local sub 00:28:35.982 03:45:16 -- target/dif.sh@30 -- # for sub in "$@" 00:28:35.982 03:45:16 -- target/dif.sh@31 -- # create_subsystem 0 00:28:35.982 03:45:16 -- target/dif.sh@18 -- # local sub_id=0 00:28:35.982 03:45:16 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:28:35.982 03:45:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:35.982 03:45:16 -- common/autotest_common.sh@10 -- # set +x 00:28:35.982 bdev_null0 00:28:35.982 03:45:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:35.982 03:45:16 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:28:35.982 03:45:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:35.982 03:45:16 -- common/autotest_common.sh@10 -- # set +x 00:28:35.982 03:45:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:35.982 03:45:16 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:28:35.982 03:45:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:35.982 03:45:16 -- common/autotest_common.sh@10 -- # set +x 00:28:35.982 03:45:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:35.982 03:45:16 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:28:35.982 03:45:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:35.982 03:45:16 -- common/autotest_common.sh@10 -- # set +x 00:28:35.982 [2024-11-21 03:45:16.443244] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:35.982 03:45:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:35.982 03:45:16 -- target/dif.sh@87 -- # fio /dev/fd/62 00:28:35.982 03:45:16 -- target/dif.sh@87 -- # create_json_sub_conf 0 00:28:35.982 03:45:16 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:28:35.982 03:45:16 -- nvmf/common.sh@520 -- # config=() 00:28:35.982 03:45:16 -- nvmf/common.sh@520 -- # local subsystem config 00:28:35.982 03:45:16 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:35.982 03:45:16 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:35.982 { 00:28:35.982 "params": { 00:28:35.982 "name": "Nvme$subsystem", 00:28:35.982 "trtype": "$TEST_TRANSPORT", 00:28:35.982 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:35.982 "adrfam": "ipv4", 00:28:35.982 "trsvcid": "$NVMF_PORT", 00:28:35.982 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:35.982 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:35.982 "hdgst": ${hdgst:-false}, 00:28:35.982 "ddgst": ${ddgst:-false} 00:28:35.982 }, 00:28:35.982 "method": "bdev_nvme_attach_controller" 00:28:35.982 } 00:28:35.983 EOF 00:28:35.983 )") 00:28:35.983 03:45:16 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:35.983 03:45:16 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:35.983 03:45:16 -- target/dif.sh@82 -- # gen_fio_conf 00:28:35.983 03:45:16 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:28:35.983 03:45:16 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:28:35.983 03:45:16 -- target/dif.sh@54 -- # local file 00:28:35.983 03:45:16 -- common/autotest_common.sh@1328 -- # local sanitizers 00:28:35.983 03:45:16 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:35.983 03:45:16 -- target/dif.sh@56 -- # cat 00:28:35.983 03:45:16 -- common/autotest_common.sh@1330 -- # shift 00:28:35.983 03:45:16 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:28:35.983 03:45:16 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:35.983 03:45:16 -- nvmf/common.sh@542 -- # cat 00:28:35.983 03:45:16 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:35.983 03:45:16 -- common/autotest_common.sh@1334 -- # grep libasan 00:28:35.983 03:45:16 -- target/dif.sh@72 -- # (( file = 1 )) 00:28:35.983 03:45:16 -- target/dif.sh@72 -- # (( file <= files )) 00:28:35.983 03:45:16 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:35.983 03:45:16 -- nvmf/common.sh@544 -- # jq . 00:28:35.983 03:45:16 -- nvmf/common.sh@545 -- # IFS=, 00:28:35.983 03:45:16 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:28:35.983 "params": { 00:28:35.983 "name": "Nvme0", 00:28:35.983 "trtype": "tcp", 00:28:35.983 "traddr": "10.0.0.2", 00:28:35.983 "adrfam": "ipv4", 00:28:35.983 "trsvcid": "4420", 00:28:35.983 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:28:35.983 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:28:35.983 "hdgst": false, 00:28:35.983 "ddgst": false 00:28:35.983 }, 00:28:35.983 "method": "bdev_nvme_attach_controller" 00:28:35.983 }' 00:28:35.983 03:45:16 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:35.983 03:45:16 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:35.983 03:45:16 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:35.983 03:45:16 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:35.983 03:45:16 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:28:35.983 03:45:16 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:35.983 03:45:16 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:35.983 03:45:16 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:35.983 03:45:16 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:28:35.983 03:45:16 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:36.243 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:28:36.243 fio-3.35 00:28:36.243 Starting 1 thread 00:28:36.243 EAL: No free 2048 kB hugepages reported on node 1 00:28:36.809 [2024-11-21 03:45:17.190895] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:28:36.809 [2024-11-21 03:45:17.190958] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:28:46.777 00:28:46.777 filename0: (groupid=0, jobs=1): err= 0: pid=3185167: Thu Nov 21 03:45:27 2024 00:28:46.777 read: IOPS=97, BW=390KiB/s (399kB/s)(3904KiB/10010msec) 00:28:46.777 slat (nsec): min=6504, max=67276, avg=8289.59, stdev=3189.77 00:28:46.777 clat (usec): min=40821, max=47009, avg=40998.32, stdev=385.18 00:28:46.777 lat (usec): min=40828, max=47031, avg=41006.61, stdev=385.69 00:28:46.777 clat percentiles (usec): 00:28:46.777 | 1.00th=[40633], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:28:46.777 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:28:46.777 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:28:46.777 | 99.00th=[41157], 99.50th=[41157], 99.90th=[46924], 99.95th=[46924], 00:28:46.777 | 99.99th=[46924] 00:28:46.777 bw ( KiB/s): min= 384, max= 416, per=99.48%, avg=388.80, stdev=11.72, samples=20 00:28:46.777 iops : min= 96, max= 104, avg=97.20, stdev= 2.93, samples=20 00:28:46.777 lat (msec) : 50=100.00% 00:28:46.777 cpu : usr=91.82%, sys=7.90%, ctx=29, majf=0, minf=284 00:28:46.777 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:28:46.777 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:46.777 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:46.777 issued rwts: total=976,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:46.777 latency : target=0, window=0, percentile=100.00%, depth=4 00:28:46.777 00:28:46.777 Run status group 0 (all jobs): 00:28:46.777 READ: bw=390KiB/s (399kB/s), 390KiB/s-390KiB/s (399kB/s-399kB/s), io=3904KiB (3998kB), run=10010-10010msec 00:28:47.036 03:45:27 -- target/dif.sh@88 -- # destroy_subsystems 0 00:28:47.036 03:45:27 -- target/dif.sh@43 -- # local sub 00:28:47.036 03:45:27 -- target/dif.sh@45 -- # for sub in "$@" 00:28:47.036 03:45:27 -- target/dif.sh@46 -- # destroy_subsystem 0 00:28:47.036 03:45:27 -- target/dif.sh@36 -- # local sub_id=0 00:28:47.036 03:45:27 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:28:47.036 03:45:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:47.036 03:45:27 -- common/autotest_common.sh@10 -- # set +x 00:28:47.036 03:45:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:47.036 03:45:27 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:28:47.036 03:45:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:47.036 03:45:27 -- common/autotest_common.sh@10 -- # set +x 00:28:47.036 03:45:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:47.036 00:28:47.036 real 0m11.131s 00:28:47.036 user 0m10.238s 00:28:47.036 sys 0m1.102s 00:28:47.036 03:45:27 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:47.036 03:45:27 -- common/autotest_common.sh@10 -- # set +x 00:28:47.036 ************************************ 00:28:47.036 END TEST fio_dif_1_default 00:28:47.036 ************************************ 00:28:47.036 03:45:27 -- target/dif.sh@142 -- # run_test fio_dif_1_multi_subsystems fio_dif_1_multi_subsystems 00:28:47.036 03:45:27 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:28:47.036 03:45:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:47.036 03:45:27 -- common/autotest_common.sh@10 -- # set +x 00:28:47.036 ************************************ 00:28:47.036 START TEST fio_dif_1_multi_subsystems 00:28:47.036 ************************************ 00:28:47.036 03:45:27 -- common/autotest_common.sh@1114 -- # fio_dif_1_multi_subsystems 00:28:47.036 03:45:27 -- target/dif.sh@92 -- # local files=1 00:28:47.036 03:45:27 -- target/dif.sh@94 -- # create_subsystems 0 1 00:28:47.036 03:45:27 -- target/dif.sh@28 -- # local sub 00:28:47.036 03:45:27 -- target/dif.sh@30 -- # for sub in "$@" 00:28:47.036 03:45:27 -- target/dif.sh@31 -- # create_subsystem 0 00:28:47.036 03:45:27 -- target/dif.sh@18 -- # local sub_id=0 00:28:47.036 03:45:27 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:28:47.036 03:45:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:47.036 03:45:27 -- common/autotest_common.sh@10 -- # set +x 00:28:47.036 bdev_null0 00:28:47.036 03:45:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:47.036 03:45:27 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:28:47.036 03:45:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:47.036 03:45:27 -- common/autotest_common.sh@10 -- # set +x 00:28:47.037 03:45:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:47.037 03:45:27 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:28:47.037 03:45:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:47.037 03:45:27 -- common/autotest_common.sh@10 -- # set +x 00:28:47.037 03:45:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:47.037 03:45:27 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:28:47.037 03:45:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:47.037 03:45:27 -- common/autotest_common.sh@10 -- # set +x 00:28:47.037 [2024-11-21 03:45:27.594476] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:47.037 03:45:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:47.037 03:45:27 -- target/dif.sh@30 -- # for sub in "$@" 00:28:47.037 03:45:27 -- target/dif.sh@31 -- # create_subsystem 1 00:28:47.037 03:45:27 -- target/dif.sh@18 -- # local sub_id=1 00:28:47.037 03:45:27 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:28:47.037 03:45:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:47.037 03:45:27 -- common/autotest_common.sh@10 -- # set +x 00:28:47.037 bdev_null1 00:28:47.037 03:45:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:47.037 03:45:27 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:28:47.037 03:45:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:47.037 03:45:27 -- common/autotest_common.sh@10 -- # set +x 00:28:47.037 03:45:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:47.037 03:45:27 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:28:47.037 03:45:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:47.037 03:45:27 -- common/autotest_common.sh@10 -- # set +x 00:28:47.037 03:45:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:47.037 03:45:27 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:47.037 03:45:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:47.037 03:45:27 -- common/autotest_common.sh@10 -- # set +x 00:28:47.037 03:45:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:47.037 03:45:27 -- target/dif.sh@95 -- # fio /dev/fd/62 00:28:47.037 03:45:27 -- target/dif.sh@95 -- # create_json_sub_conf 0 1 00:28:47.037 03:45:27 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:28:47.037 03:45:27 -- nvmf/common.sh@520 -- # config=() 00:28:47.037 03:45:27 -- nvmf/common.sh@520 -- # local subsystem config 00:28:47.037 03:45:27 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:47.037 03:45:27 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:47.037 03:45:27 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:47.037 { 00:28:47.037 "params": { 00:28:47.037 "name": "Nvme$subsystem", 00:28:47.037 "trtype": "$TEST_TRANSPORT", 00:28:47.037 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:47.037 "adrfam": "ipv4", 00:28:47.037 "trsvcid": "$NVMF_PORT", 00:28:47.037 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:47.037 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:47.037 "hdgst": ${hdgst:-false}, 00:28:47.037 "ddgst": ${ddgst:-false} 00:28:47.037 }, 00:28:47.037 "method": "bdev_nvme_attach_controller" 00:28:47.037 } 00:28:47.037 EOF 00:28:47.037 )") 00:28:47.037 03:45:27 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:47.037 03:45:27 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:28:47.037 03:45:27 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:28:47.037 03:45:27 -- common/autotest_common.sh@1328 -- # local sanitizers 00:28:47.037 03:45:27 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:47.037 03:45:27 -- target/dif.sh@82 -- # gen_fio_conf 00:28:47.037 03:45:27 -- common/autotest_common.sh@1330 -- # shift 00:28:47.037 03:45:27 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:28:47.037 03:45:27 -- target/dif.sh@54 -- # local file 00:28:47.037 03:45:27 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:47.037 03:45:27 -- target/dif.sh@56 -- # cat 00:28:47.037 03:45:27 -- nvmf/common.sh@542 -- # cat 00:28:47.037 03:45:27 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:47.037 03:45:27 -- common/autotest_common.sh@1334 -- # grep libasan 00:28:47.037 03:45:27 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:47.037 03:45:27 -- target/dif.sh@72 -- # (( file = 1 )) 00:28:47.037 03:45:27 -- target/dif.sh@72 -- # (( file <= files )) 00:28:47.037 03:45:27 -- target/dif.sh@73 -- # cat 00:28:47.037 03:45:27 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:47.037 03:45:27 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:47.037 { 00:28:47.037 "params": { 00:28:47.037 "name": "Nvme$subsystem", 00:28:47.037 "trtype": "$TEST_TRANSPORT", 00:28:47.037 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:47.037 "adrfam": "ipv4", 00:28:47.037 "trsvcid": "$NVMF_PORT", 00:28:47.037 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:47.037 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:47.037 "hdgst": ${hdgst:-false}, 00:28:47.037 "ddgst": ${ddgst:-false} 00:28:47.037 }, 00:28:47.037 "method": "bdev_nvme_attach_controller" 00:28:47.037 } 00:28:47.037 EOF 00:28:47.037 )") 00:28:47.037 03:45:27 -- nvmf/common.sh@542 -- # cat 00:28:47.037 03:45:27 -- target/dif.sh@72 -- # (( file++ )) 00:28:47.037 03:45:27 -- target/dif.sh@72 -- # (( file <= files )) 00:28:47.037 03:45:27 -- nvmf/common.sh@544 -- # jq . 00:28:47.037 03:45:27 -- nvmf/common.sh@545 -- # IFS=, 00:28:47.037 03:45:27 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:28:47.037 "params": { 00:28:47.037 "name": "Nvme0", 00:28:47.037 "trtype": "tcp", 00:28:47.037 "traddr": "10.0.0.2", 00:28:47.037 "adrfam": "ipv4", 00:28:47.037 "trsvcid": "4420", 00:28:47.037 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:28:47.037 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:28:47.037 "hdgst": false, 00:28:47.037 "ddgst": false 00:28:47.037 }, 00:28:47.037 "method": "bdev_nvme_attach_controller" 00:28:47.037 },{ 00:28:47.037 "params": { 00:28:47.037 "name": "Nvme1", 00:28:47.037 "trtype": "tcp", 00:28:47.037 "traddr": "10.0.0.2", 00:28:47.037 "adrfam": "ipv4", 00:28:47.037 "trsvcid": "4420", 00:28:47.037 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:28:47.037 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:28:47.037 "hdgst": false, 00:28:47.037 "ddgst": false 00:28:47.037 }, 00:28:47.037 "method": "bdev_nvme_attach_controller" 00:28:47.037 }' 00:28:47.037 03:45:27 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:47.037 03:45:27 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:47.037 03:45:27 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:47.037 03:45:27 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:47.037 03:45:27 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:28:47.037 03:45:27 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:47.037 03:45:27 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:47.037 03:45:27 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:47.037 03:45:27 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:28:47.037 03:45:27 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:47.295 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:28:47.295 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:28:47.295 fio-3.35 00:28:47.295 Starting 2 threads 00:28:47.296 EAL: No free 2048 kB hugepages reported on node 1 00:28:48.232 [2024-11-21 03:45:28.540946] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:28:48.232 [2024-11-21 03:45:28.541029] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:28:58.199 00:28:58.199 filename0: (groupid=0, jobs=1): err= 0: pid=3186657: Thu Nov 21 03:45:38 2024 00:28:58.199 read: IOPS=142, BW=568KiB/s (582kB/s)(5696KiB/10028msec) 00:28:58.199 slat (nsec): min=6844, max=69306, avg=8666.99, stdev=3135.55 00:28:58.199 clat (usec): min=549, max=44565, avg=28139.91, stdev=18986.26 00:28:58.199 lat (usec): min=556, max=44595, avg=28148.57, stdev=18986.31 00:28:58.199 clat percentiles (usec): 00:28:58.199 | 1.00th=[ 586], 5.00th=[ 627], 10.00th=[ 644], 20.00th=[ 668], 00:28:58.199 | 30.00th=[ 734], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:28:58.199 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[42206], 00:28:58.199 | 99.00th=[42206], 99.50th=[42730], 99.90th=[44303], 99.95th=[44827], 00:28:58.199 | 99.99th=[44827] 00:28:58.199 bw ( KiB/s): min= 352, max= 768, per=43.07%, avg=568.00, stdev=179.19, samples=20 00:28:58.199 iops : min= 88, max= 192, avg=142.00, stdev=44.80, samples=20 00:28:58.199 lat (usec) : 750=30.34%, 1000=1.83% 00:28:58.199 lat (msec) : 2=0.14%, 50=67.70% 00:28:58.199 cpu : usr=95.39%, sys=4.30%, ctx=19, majf=0, minf=237 00:28:58.199 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:28:58.199 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:58.199 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:58.199 issued rwts: total=1424,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:58.199 latency : target=0, window=0, percentile=100.00%, depth=4 00:28:58.199 filename1: (groupid=0, jobs=1): err= 0: pid=3186658: Thu Nov 21 03:45:38 2024 00:28:58.199 read: IOPS=187, BW=749KiB/s (767kB/s)(7520KiB/10040msec) 00:28:58.199 slat (nsec): min=6821, max=37828, avg=8456.85, stdev=2393.90 00:28:58.199 clat (usec): min=571, max=44542, avg=21334.26, stdev=20300.74 00:28:58.199 lat (usec): min=578, max=44580, avg=21342.71, stdev=20300.56 00:28:58.199 clat percentiles (usec): 00:28:58.199 | 1.00th=[ 619], 5.00th=[ 635], 10.00th=[ 652], 20.00th=[ 668], 00:28:58.199 | 30.00th=[ 685], 40.00th=[ 709], 50.00th=[41157], 60.00th=[41157], 00:28:58.199 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:28:58.199 | 99.00th=[41681], 99.50th=[42206], 99.90th=[44303], 99.95th=[44303], 00:28:58.199 | 99.99th=[44303] 00:28:58.199 bw ( KiB/s): min= 670, max= 768, per=56.98%, avg=750.30, stdev=33.85, samples=20 00:28:58.200 iops : min= 167, max= 192, avg=187.55, stdev= 8.53, samples=20 00:28:58.200 lat (usec) : 750=44.52%, 1000=4.41% 00:28:58.200 lat (msec) : 2=0.21%, 50=50.85% 00:28:58.200 cpu : usr=95.42%, sys=4.27%, ctx=14, majf=0, minf=147 00:28:58.200 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:28:58.200 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:58.200 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:58.200 issued rwts: total=1880,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:58.200 latency : target=0, window=0, percentile=100.00%, depth=4 00:28:58.200 00:28:58.200 Run status group 0 (all jobs): 00:28:58.200 READ: bw=1316KiB/s (1348kB/s), 568KiB/s-749KiB/s (582kB/s-767kB/s), io=12.9MiB (13.5MB), run=10028-10040msec 00:28:58.460 03:45:38 -- target/dif.sh@96 -- # destroy_subsystems 0 1 00:28:58.460 03:45:38 -- target/dif.sh@43 -- # local sub 00:28:58.460 03:45:38 -- target/dif.sh@45 -- # for sub in "$@" 00:28:58.460 03:45:38 -- target/dif.sh@46 -- # destroy_subsystem 0 00:28:58.460 03:45:38 -- target/dif.sh@36 -- # local sub_id=0 00:28:58.460 03:45:38 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:28:58.460 03:45:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:58.460 03:45:38 -- common/autotest_common.sh@10 -- # set +x 00:28:58.460 03:45:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:58.460 03:45:38 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:28:58.460 03:45:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:58.460 03:45:38 -- common/autotest_common.sh@10 -- # set +x 00:28:58.460 03:45:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:58.460 03:45:38 -- target/dif.sh@45 -- # for sub in "$@" 00:28:58.460 03:45:38 -- target/dif.sh@46 -- # destroy_subsystem 1 00:28:58.460 03:45:38 -- target/dif.sh@36 -- # local sub_id=1 00:28:58.460 03:45:38 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:28:58.460 03:45:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:58.460 03:45:38 -- common/autotest_common.sh@10 -- # set +x 00:28:58.460 03:45:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:58.460 03:45:38 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:28:58.460 03:45:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:58.460 03:45:38 -- common/autotest_common.sh@10 -- # set +x 00:28:58.460 03:45:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:58.460 00:28:58.460 real 0m11.384s 00:28:58.460 user 0m20.454s 00:28:58.460 sys 0m1.179s 00:28:58.460 03:45:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:58.460 03:45:38 -- common/autotest_common.sh@10 -- # set +x 00:28:58.460 ************************************ 00:28:58.460 END TEST fio_dif_1_multi_subsystems 00:28:58.460 ************************************ 00:28:58.460 03:45:38 -- target/dif.sh@143 -- # run_test fio_dif_rand_params fio_dif_rand_params 00:28:58.460 03:45:38 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:28:58.460 03:45:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:58.460 03:45:38 -- common/autotest_common.sh@10 -- # set +x 00:28:58.460 ************************************ 00:28:58.460 START TEST fio_dif_rand_params 00:28:58.460 ************************************ 00:28:58.460 03:45:38 -- common/autotest_common.sh@1114 -- # fio_dif_rand_params 00:28:58.460 03:45:38 -- target/dif.sh@100 -- # local NULL_DIF 00:28:58.460 03:45:38 -- target/dif.sh@101 -- # local bs numjobs runtime iodepth files 00:28:58.460 03:45:38 -- target/dif.sh@103 -- # NULL_DIF=3 00:28:58.460 03:45:38 -- target/dif.sh@103 -- # bs=128k 00:28:58.460 03:45:38 -- target/dif.sh@103 -- # numjobs=3 00:28:58.460 03:45:38 -- target/dif.sh@103 -- # iodepth=3 00:28:58.460 03:45:38 -- target/dif.sh@103 -- # runtime=5 00:28:58.460 03:45:38 -- target/dif.sh@105 -- # create_subsystems 0 00:28:58.460 03:45:38 -- target/dif.sh@28 -- # local sub 00:28:58.460 03:45:38 -- target/dif.sh@30 -- # for sub in "$@" 00:28:58.460 03:45:38 -- target/dif.sh@31 -- # create_subsystem 0 00:28:58.460 03:45:38 -- target/dif.sh@18 -- # local sub_id=0 00:28:58.460 03:45:38 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:28:58.460 03:45:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:58.460 03:45:38 -- common/autotest_common.sh@10 -- # set +x 00:28:58.460 bdev_null0 00:28:58.460 03:45:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:58.460 03:45:38 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:28:58.460 03:45:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:58.460 03:45:38 -- common/autotest_common.sh@10 -- # set +x 00:28:58.460 03:45:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:58.460 03:45:38 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:28:58.460 03:45:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:58.460 03:45:38 -- common/autotest_common.sh@10 -- # set +x 00:28:58.460 03:45:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:58.460 03:45:39 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:28:58.460 03:45:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:58.460 03:45:39 -- common/autotest_common.sh@10 -- # set +x 00:28:58.460 [2024-11-21 03:45:39.011189] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:58.460 03:45:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:58.460 03:45:39 -- target/dif.sh@106 -- # fio /dev/fd/62 00:28:58.460 03:45:39 -- target/dif.sh@106 -- # create_json_sub_conf 0 00:28:58.460 03:45:39 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:28:58.460 03:45:39 -- nvmf/common.sh@520 -- # config=() 00:28:58.460 03:45:39 -- nvmf/common.sh@520 -- # local subsystem config 00:28:58.460 03:45:39 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:58.460 03:45:39 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:58.460 03:45:39 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:58.460 { 00:28:58.460 "params": { 00:28:58.460 "name": "Nvme$subsystem", 00:28:58.460 "trtype": "$TEST_TRANSPORT", 00:28:58.460 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:58.460 "adrfam": "ipv4", 00:28:58.460 "trsvcid": "$NVMF_PORT", 00:28:58.460 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:58.460 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:58.460 "hdgst": ${hdgst:-false}, 00:28:58.460 "ddgst": ${ddgst:-false} 00:28:58.460 }, 00:28:58.460 "method": "bdev_nvme_attach_controller" 00:28:58.460 } 00:28:58.460 EOF 00:28:58.460 )") 00:28:58.460 03:45:39 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:58.460 03:45:39 -- target/dif.sh@82 -- # gen_fio_conf 00:28:58.460 03:45:39 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:28:58.460 03:45:39 -- target/dif.sh@54 -- # local file 00:28:58.460 03:45:39 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:28:58.460 03:45:39 -- target/dif.sh@56 -- # cat 00:28:58.460 03:45:39 -- common/autotest_common.sh@1328 -- # local sanitizers 00:28:58.460 03:45:39 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:58.460 03:45:39 -- common/autotest_common.sh@1330 -- # shift 00:28:58.460 03:45:39 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:28:58.460 03:45:39 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:58.460 03:45:39 -- nvmf/common.sh@542 -- # cat 00:28:58.460 03:45:39 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:58.460 03:45:39 -- target/dif.sh@72 -- # (( file = 1 )) 00:28:58.460 03:45:39 -- common/autotest_common.sh@1334 -- # grep libasan 00:28:58.460 03:45:39 -- target/dif.sh@72 -- # (( file <= files )) 00:28:58.460 03:45:39 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:58.460 03:45:39 -- nvmf/common.sh@544 -- # jq . 00:28:58.460 03:45:39 -- nvmf/common.sh@545 -- # IFS=, 00:28:58.460 03:45:39 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:28:58.460 "params": { 00:28:58.460 "name": "Nvme0", 00:28:58.460 "trtype": "tcp", 00:28:58.460 "traddr": "10.0.0.2", 00:28:58.460 "adrfam": "ipv4", 00:28:58.460 "trsvcid": "4420", 00:28:58.460 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:28:58.460 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:28:58.460 "hdgst": false, 00:28:58.460 "ddgst": false 00:28:58.460 }, 00:28:58.460 "method": "bdev_nvme_attach_controller" 00:28:58.460 }' 00:28:58.460 03:45:39 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:58.460 03:45:39 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:58.460 03:45:39 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:58.460 03:45:39 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:58.460 03:45:39 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:28:58.460 03:45:39 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:58.460 03:45:39 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:58.460 03:45:39 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:58.460 03:45:39 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:28:58.460 03:45:39 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:58.719 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:28:58.719 ... 00:28:58.719 fio-3.35 00:28:58.719 Starting 3 threads 00:28:58.719 EAL: No free 2048 kB hugepages reported on node 1 00:28:59.285 [2024-11-21 03:45:39.881913] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:28:59.285 [2024-11-21 03:45:39.881968] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:29:04.552 00:29:04.552 filename0: (groupid=0, jobs=1): err= 0: pid=3188101: Thu Nov 21 03:45:45 2024 00:29:04.552 read: IOPS=227, BW=28.4MiB/s (29.8MB/s)(142MiB/5004msec) 00:29:04.552 slat (nsec): min=7115, max=42343, avg=16407.39, stdev=4413.37 00:29:04.552 clat (usec): min=4246, max=91144, avg=13191.33, stdev=9982.68 00:29:04.552 lat (usec): min=4257, max=91162, avg=13207.74, stdev=9982.55 00:29:04.552 clat percentiles (usec): 00:29:04.552 | 1.00th=[ 5014], 5.00th=[ 6194], 10.00th=[ 7439], 20.00th=[ 8455], 00:29:04.552 | 30.00th=[ 9372], 40.00th=[10552], 50.00th=[11338], 60.00th=[11863], 00:29:04.552 | 70.00th=[12518], 80.00th=[13435], 90.00th=[15008], 95.00th=[46924], 00:29:04.552 | 99.00th=[52691], 99.50th=[54789], 99.90th=[55837], 99.95th=[90702], 00:29:04.552 | 99.99th=[90702] 00:29:04.552 bw ( KiB/s): min=18432, max=35584, per=33.60%, avg=29025.90, stdev=5650.95, samples=10 00:29:04.552 iops : min= 144, max= 278, avg=226.70, stdev=44.23, samples=10 00:29:04.552 lat (msec) : 10=34.24%, 20=59.77%, 50=2.20%, 100=3.79% 00:29:04.552 cpu : usr=94.68%, sys=4.84%, ctx=14, majf=0, minf=104 00:29:04.552 IO depths : 1=0.3%, 2=99.7%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:04.552 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:04.552 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:04.552 issued rwts: total=1136,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:04.552 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:04.552 filename0: (groupid=0, jobs=1): err= 0: pid=3188102: Thu Nov 21 03:45:45 2024 00:29:04.552 read: IOPS=242, BW=30.3MiB/s (31.7MB/s)(153MiB/5044msec) 00:29:04.552 slat (nsec): min=5015, max=82948, avg=16633.51, stdev=5063.89 00:29:04.552 clat (usec): min=4323, max=90171, avg=12370.51, stdev=8700.94 00:29:04.552 lat (usec): min=4335, max=90190, avg=12387.15, stdev=8700.78 00:29:04.552 clat percentiles (usec): 00:29:04.552 | 1.00th=[ 5145], 5.00th=[ 5932], 10.00th=[ 7439], 20.00th=[ 8455], 00:29:04.552 | 30.00th=[ 8979], 40.00th=[10028], 50.00th=[10945], 60.00th=[11731], 00:29:04.552 | 70.00th=[12387], 80.00th=[13435], 90.00th=[14877], 95.00th=[16450], 00:29:04.552 | 99.00th=[54264], 99.50th=[55837], 99.90th=[58983], 99.95th=[89654], 00:29:04.552 | 99.99th=[89654] 00:29:04.552 bw ( KiB/s): min=23296, max=39168, per=36.10%, avg=31186.80, stdev=4322.11, samples=10 00:29:04.552 iops : min= 182, max= 306, avg=243.60, stdev=33.78, samples=10 00:29:04.552 lat (msec) : 10=39.97%, 20=55.94%, 50=1.80%, 100=2.29% 00:29:04.552 cpu : usr=93.28%, sys=5.57%, ctx=292, majf=0, minf=207 00:29:04.552 IO depths : 1=0.7%, 2=99.3%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:04.552 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:04.552 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:04.552 issued rwts: total=1221,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:04.552 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:04.552 filename0: (groupid=0, jobs=1): err= 0: pid=3188103: Thu Nov 21 03:45:45 2024 00:29:04.552 read: IOPS=208, BW=26.1MiB/s (27.3MB/s)(131MiB/5018msec) 00:29:04.552 slat (nsec): min=4734, max=72835, avg=15884.44, stdev=4577.06 00:29:04.552 clat (usec): min=4513, max=55819, avg=14356.42, stdev=11259.97 00:29:04.552 lat (usec): min=4526, max=55838, avg=14372.30, stdev=11259.97 00:29:04.552 clat percentiles (usec): 00:29:04.552 | 1.00th=[ 5014], 5.00th=[ 7308], 10.00th=[ 7963], 20.00th=[ 8848], 00:29:04.552 | 30.00th=[10028], 40.00th=[10945], 50.00th=[11469], 60.00th=[12125], 00:29:04.552 | 70.00th=[12780], 80.00th=[13829], 90.00th=[15926], 95.00th=[50070], 00:29:04.552 | 99.00th=[53740], 99.50th=[54264], 99.90th=[55313], 99.95th=[55837], 00:29:04.552 | 99.99th=[55837] 00:29:04.552 bw ( KiB/s): min=17152, max=36608, per=30.94%, avg=26726.40, stdev=5870.29, samples=10 00:29:04.552 iops : min= 134, max= 286, avg=208.80, stdev=45.86, samples=10 00:29:04.552 lat (msec) : 10=30.09%, 20=61.60%, 50=2.96%, 100=5.35% 00:29:04.552 cpu : usr=95.52%, sys=4.03%, ctx=15, majf=0, minf=52 00:29:04.552 IO depths : 1=0.2%, 2=99.8%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:04.552 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:04.552 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:04.552 issued rwts: total=1047,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:04.552 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:04.552 00:29:04.552 Run status group 0 (all jobs): 00:29:04.552 READ: bw=84.4MiB/s (88.5MB/s), 26.1MiB/s-30.3MiB/s (27.3MB/s-31.7MB/s), io=426MiB (446MB), run=5004-5044msec 00:29:04.812 03:45:45 -- target/dif.sh@107 -- # destroy_subsystems 0 00:29:04.812 03:45:45 -- target/dif.sh@43 -- # local sub 00:29:04.812 03:45:45 -- target/dif.sh@45 -- # for sub in "$@" 00:29:04.812 03:45:45 -- target/dif.sh@46 -- # destroy_subsystem 0 00:29:04.812 03:45:45 -- target/dif.sh@36 -- # local sub_id=0 00:29:04.812 03:45:45 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:29:04.812 03:45:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:04.812 03:45:45 -- common/autotest_common.sh@10 -- # set +x 00:29:04.812 03:45:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:04.812 03:45:45 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:29:04.812 03:45:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:04.812 03:45:45 -- common/autotest_common.sh@10 -- # set +x 00:29:04.812 03:45:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:04.812 03:45:45 -- target/dif.sh@109 -- # NULL_DIF=2 00:29:04.812 03:45:45 -- target/dif.sh@109 -- # bs=4k 00:29:04.812 03:45:45 -- target/dif.sh@109 -- # numjobs=8 00:29:04.812 03:45:45 -- target/dif.sh@109 -- # iodepth=16 00:29:04.812 03:45:45 -- target/dif.sh@109 -- # runtime= 00:29:04.812 03:45:45 -- target/dif.sh@109 -- # files=2 00:29:04.812 03:45:45 -- target/dif.sh@111 -- # create_subsystems 0 1 2 00:29:04.812 03:45:45 -- target/dif.sh@28 -- # local sub 00:29:04.812 03:45:45 -- target/dif.sh@30 -- # for sub in "$@" 00:29:04.812 03:45:45 -- target/dif.sh@31 -- # create_subsystem 0 00:29:04.812 03:45:45 -- target/dif.sh@18 -- # local sub_id=0 00:29:04.812 03:45:45 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 2 00:29:04.812 03:45:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:04.812 03:45:45 -- common/autotest_common.sh@10 -- # set +x 00:29:04.812 bdev_null0 00:29:04.812 03:45:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:04.812 03:45:45 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:29:04.812 03:45:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:04.812 03:45:45 -- common/autotest_common.sh@10 -- # set +x 00:29:04.812 03:45:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:04.812 03:45:45 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:29:04.812 03:45:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:04.812 03:45:45 -- common/autotest_common.sh@10 -- # set +x 00:29:04.812 03:45:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:04.812 03:45:45 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:29:04.812 03:45:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:04.812 03:45:45 -- common/autotest_common.sh@10 -- # set +x 00:29:04.812 [2024-11-21 03:45:45.370057] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:04.812 03:45:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:04.812 03:45:45 -- target/dif.sh@30 -- # for sub in "$@" 00:29:04.812 03:45:45 -- target/dif.sh@31 -- # create_subsystem 1 00:29:04.812 03:45:45 -- target/dif.sh@18 -- # local sub_id=1 00:29:04.812 03:45:45 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 2 00:29:04.812 03:45:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:04.812 03:45:45 -- common/autotest_common.sh@10 -- # set +x 00:29:04.812 bdev_null1 00:29:04.812 03:45:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:04.812 03:45:45 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:29:04.812 03:45:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:04.812 03:45:45 -- common/autotest_common.sh@10 -- # set +x 00:29:04.812 03:45:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:04.812 03:45:45 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:29:04.812 03:45:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:04.812 03:45:45 -- common/autotest_common.sh@10 -- # set +x 00:29:04.812 03:45:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:04.812 03:45:45 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:29:04.812 03:45:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:04.812 03:45:45 -- common/autotest_common.sh@10 -- # set +x 00:29:04.812 03:45:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:04.812 03:45:45 -- target/dif.sh@30 -- # for sub in "$@" 00:29:04.812 03:45:45 -- target/dif.sh@31 -- # create_subsystem 2 00:29:04.812 03:45:45 -- target/dif.sh@18 -- # local sub_id=2 00:29:04.812 03:45:45 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null2 64 512 --md-size 16 --dif-type 2 00:29:04.812 03:45:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:04.812 03:45:45 -- common/autotest_common.sh@10 -- # set +x 00:29:04.812 bdev_null2 00:29:04.812 03:45:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:04.812 03:45:45 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 --serial-number 53313233-2 --allow-any-host 00:29:04.812 03:45:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:04.812 03:45:45 -- common/autotest_common.sh@10 -- # set +x 00:29:04.812 03:45:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:04.812 03:45:45 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 bdev_null2 00:29:04.812 03:45:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:04.812 03:45:45 -- common/autotest_common.sh@10 -- # set +x 00:29:04.812 03:45:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:04.812 03:45:45 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:29:04.812 03:45:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:04.812 03:45:45 -- common/autotest_common.sh@10 -- # set +x 00:29:04.812 03:45:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:04.812 03:45:45 -- target/dif.sh@112 -- # fio /dev/fd/62 00:29:04.812 03:45:45 -- target/dif.sh@112 -- # create_json_sub_conf 0 1 2 00:29:04.812 03:45:45 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 2 00:29:04.812 03:45:45 -- nvmf/common.sh@520 -- # config=() 00:29:04.812 03:45:45 -- nvmf/common.sh@520 -- # local subsystem config 00:29:04.812 03:45:45 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:04.812 03:45:45 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:04.812 { 00:29:04.812 "params": { 00:29:04.812 "name": "Nvme$subsystem", 00:29:04.812 "trtype": "$TEST_TRANSPORT", 00:29:04.812 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:04.812 "adrfam": "ipv4", 00:29:04.812 "trsvcid": "$NVMF_PORT", 00:29:04.812 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:04.812 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:04.812 "hdgst": ${hdgst:-false}, 00:29:04.812 "ddgst": ${ddgst:-false} 00:29:04.812 }, 00:29:04.812 "method": "bdev_nvme_attach_controller" 00:29:04.812 } 00:29:04.812 EOF 00:29:04.812 )") 00:29:04.812 03:45:45 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:04.812 03:45:45 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:04.812 03:45:45 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:29:04.813 03:45:45 -- target/dif.sh@82 -- # gen_fio_conf 00:29:04.813 03:45:45 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:29:04.813 03:45:45 -- target/dif.sh@54 -- # local file 00:29:04.813 03:45:45 -- common/autotest_common.sh@1328 -- # local sanitizers 00:29:04.813 03:45:45 -- target/dif.sh@56 -- # cat 00:29:04.813 03:45:45 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:04.813 03:45:45 -- common/autotest_common.sh@1330 -- # shift 00:29:04.813 03:45:45 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:29:04.813 03:45:45 -- nvmf/common.sh@542 -- # cat 00:29:04.813 03:45:45 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:04.813 03:45:45 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:04.813 03:45:45 -- target/dif.sh@72 -- # (( file = 1 )) 00:29:04.813 03:45:45 -- common/autotest_common.sh@1334 -- # grep libasan 00:29:04.813 03:45:45 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:04.813 03:45:45 -- target/dif.sh@72 -- # (( file <= files )) 00:29:04.813 03:45:45 -- target/dif.sh@73 -- # cat 00:29:04.813 03:45:45 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:04.813 03:45:45 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:04.813 { 00:29:04.813 "params": { 00:29:04.813 "name": "Nvme$subsystem", 00:29:04.813 "trtype": "$TEST_TRANSPORT", 00:29:04.813 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:04.813 "adrfam": "ipv4", 00:29:04.813 "trsvcid": "$NVMF_PORT", 00:29:04.813 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:04.813 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:04.813 "hdgst": ${hdgst:-false}, 00:29:04.813 "ddgst": ${ddgst:-false} 00:29:04.813 }, 00:29:04.813 "method": "bdev_nvme_attach_controller" 00:29:04.813 } 00:29:04.813 EOF 00:29:04.813 )") 00:29:04.813 03:45:45 -- nvmf/common.sh@542 -- # cat 00:29:04.813 03:45:45 -- target/dif.sh@72 -- # (( file++ )) 00:29:04.813 03:45:45 -- target/dif.sh@72 -- # (( file <= files )) 00:29:04.813 03:45:45 -- target/dif.sh@73 -- # cat 00:29:04.813 03:45:45 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:04.813 03:45:45 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:04.813 { 00:29:04.813 "params": { 00:29:04.813 "name": "Nvme$subsystem", 00:29:04.813 "trtype": "$TEST_TRANSPORT", 00:29:04.813 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:04.813 "adrfam": "ipv4", 00:29:04.813 "trsvcid": "$NVMF_PORT", 00:29:04.813 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:04.813 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:04.813 "hdgst": ${hdgst:-false}, 00:29:04.813 "ddgst": ${ddgst:-false} 00:29:04.813 }, 00:29:04.813 "method": "bdev_nvme_attach_controller" 00:29:04.813 } 00:29:04.813 EOF 00:29:04.813 )") 00:29:04.813 03:45:45 -- target/dif.sh@72 -- # (( file++ )) 00:29:04.813 03:45:45 -- target/dif.sh@72 -- # (( file <= files )) 00:29:04.813 03:45:45 -- nvmf/common.sh@542 -- # cat 00:29:04.813 03:45:45 -- nvmf/common.sh@544 -- # jq . 00:29:04.813 03:45:45 -- nvmf/common.sh@545 -- # IFS=, 00:29:04.813 03:45:45 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:29:04.813 "params": { 00:29:04.813 "name": "Nvme0", 00:29:04.813 "trtype": "tcp", 00:29:04.813 "traddr": "10.0.0.2", 00:29:04.813 "adrfam": "ipv4", 00:29:04.813 "trsvcid": "4420", 00:29:04.813 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:29:04.813 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:29:04.813 "hdgst": false, 00:29:04.813 "ddgst": false 00:29:04.813 }, 00:29:04.813 "method": "bdev_nvme_attach_controller" 00:29:04.813 },{ 00:29:04.813 "params": { 00:29:04.813 "name": "Nvme1", 00:29:04.813 "trtype": "tcp", 00:29:04.813 "traddr": "10.0.0.2", 00:29:04.813 "adrfam": "ipv4", 00:29:04.813 "trsvcid": "4420", 00:29:04.813 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:29:04.813 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:29:04.813 "hdgst": false, 00:29:04.813 "ddgst": false 00:29:04.813 }, 00:29:04.813 "method": "bdev_nvme_attach_controller" 00:29:04.813 },{ 00:29:04.813 "params": { 00:29:04.813 "name": "Nvme2", 00:29:04.813 "trtype": "tcp", 00:29:04.813 "traddr": "10.0.0.2", 00:29:04.813 "adrfam": "ipv4", 00:29:04.813 "trsvcid": "4420", 00:29:04.813 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:29:04.813 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:29:04.813 "hdgst": false, 00:29:04.813 "ddgst": false 00:29:04.813 }, 00:29:04.813 "method": "bdev_nvme_attach_controller" 00:29:04.813 }' 00:29:05.072 03:45:45 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:05.072 03:45:45 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:05.072 03:45:45 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:05.072 03:45:45 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:05.072 03:45:45 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:29:05.072 03:45:45 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:05.072 03:45:45 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:05.072 03:45:45 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:05.072 03:45:45 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:29:05.072 03:45:45 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:05.072 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:29:05.072 ... 00:29:05.072 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:29:05.072 ... 00:29:05.072 filename2: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:29:05.072 ... 00:29:05.072 fio-3.35 00:29:05.072 Starting 24 threads 00:29:05.330 EAL: No free 2048 kB hugepages reported on node 1 00:29:05.896 [2024-11-21 03:45:46.443507] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:29:05.896 [2024-11-21 03:45:46.443566] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:29:18.232 00:29:18.232 filename0: (groupid=0, jobs=1): err= 0: pid=3188962: Thu Nov 21 03:45:56 2024 00:29:18.232 read: IOPS=67, BW=268KiB/s (275kB/s)(2712KiB/10116msec) 00:29:18.232 slat (usec): min=7, max=116, avg=43.27, stdev=31.41 00:29:18.232 clat (msec): min=82, max=396, avg=238.00, stdev=45.47 00:29:18.232 lat (msec): min=82, max=396, avg=238.04, stdev=45.47 00:29:18.232 clat percentiles (msec): 00:29:18.232 | 1.00th=[ 83], 5.00th=[ 148], 10.00th=[ 192], 20.00th=[ 207], 00:29:18.232 | 30.00th=[ 218], 40.00th=[ 230], 50.00th=[ 243], 60.00th=[ 253], 00:29:18.232 | 70.00th=[ 268], 80.00th=[ 271], 90.00th=[ 279], 95.00th=[ 292], 00:29:18.232 | 99.00th=[ 330], 99.50th=[ 397], 99.90th=[ 397], 99.95th=[ 397], 00:29:18.232 | 99.99th=[ 397] 00:29:18.232 bw ( KiB/s): min= 128, max= 384, per=4.56%, avg=264.80, stdev=57.68, samples=20 00:29:18.232 iops : min= 32, max= 96, avg=66.20, stdev=14.42, samples=20 00:29:18.232 lat (msec) : 100=2.36%, 250=54.57%, 500=43.07% 00:29:18.232 cpu : usr=97.71%, sys=1.47%, ctx=83, majf=0, minf=29 00:29:18.232 IO depths : 1=3.5%, 2=8.4%, 4=20.8%, 8=58.3%, 16=9.0%, 32=0.0%, >=64=0.0% 00:29:18.232 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.232 complete : 0=0.0%, 4=92.8%, 8=1.5%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.232 issued rwts: total=678,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:18.232 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:18.232 filename0: (groupid=0, jobs=1): err= 0: pid=3188963: Thu Nov 21 03:45:56 2024 00:29:18.232 read: IOPS=79, BW=316KiB/s (324kB/s)(3200KiB/10115msec) 00:29:18.232 slat (nsec): min=4320, max=86635, avg=20118.08, stdev=19994.64 00:29:18.232 clat (msec): min=13, max=278, avg=202.11, stdev=44.05 00:29:18.232 lat (msec): min=13, max=278, avg=202.13, stdev=44.05 00:29:18.232 clat percentiles (msec): 00:29:18.232 | 1.00th=[ 14], 5.00th=[ 148], 10.00th=[ 157], 20.00th=[ 176], 00:29:18.232 | 30.00th=[ 178], 40.00th=[ 192], 50.00th=[ 203], 60.00th=[ 218], 00:29:18.232 | 70.00th=[ 220], 80.00th=[ 232], 90.00th=[ 253], 95.00th=[ 268], 00:29:18.232 | 99.00th=[ 279], 99.50th=[ 279], 99.90th=[ 279], 99.95th=[ 279], 00:29:18.232 | 99.99th=[ 279] 00:29:18.232 bw ( KiB/s): min= 256, max= 384, per=5.41%, avg=313.60, stdev=65.33, samples=20 00:29:18.232 iops : min= 64, max= 96, avg=78.40, stdev=16.33, samples=20 00:29:18.232 lat (msec) : 20=1.75%, 100=0.50%, 250=83.75%, 500=14.00% 00:29:18.232 cpu : usr=98.24%, sys=1.18%, ctx=16, majf=0, minf=36 00:29:18.232 IO depths : 1=6.1%, 2=12.4%, 4=25.0%, 8=50.1%, 16=6.4%, 32=0.0%, >=64=0.0% 00:29:18.232 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.232 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.232 issued rwts: total=800,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:18.232 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:18.232 filename0: (groupid=0, jobs=1): err= 0: pid=3188964: Thu Nov 21 03:45:56 2024 00:29:18.232 read: IOPS=55, BW=222KiB/s (227kB/s)(2240KiB/10089msec) 00:29:18.232 slat (nsec): min=8979, max=98678, avg=41458.46, stdev=22262.78 00:29:18.232 clat (msec): min=141, max=532, avg=287.89, stdev=66.12 00:29:18.232 lat (msec): min=141, max=532, avg=287.93, stdev=66.11 00:29:18.232 clat percentiles (msec): 00:29:18.232 | 1.00th=[ 153], 5.00th=[ 215], 10.00th=[ 218], 20.00th=[ 226], 00:29:18.232 | 30.00th=[ 251], 40.00th=[ 268], 50.00th=[ 279], 60.00th=[ 288], 00:29:18.232 | 70.00th=[ 309], 80.00th=[ 338], 90.00th=[ 388], 95.00th=[ 405], 00:29:18.232 | 99.00th=[ 498], 99.50th=[ 531], 99.90th=[ 531], 99.95th=[ 531], 00:29:18.232 | 99.99th=[ 531] 00:29:18.232 bw ( KiB/s): min= 128, max= 384, per=3.75%, avg=217.60, stdev=69.14, samples=20 00:29:18.232 iops : min= 32, max= 96, avg=54.40, stdev=17.29, samples=20 00:29:18.232 lat (msec) : 250=31.43%, 500=67.86%, 750=0.71% 00:29:18.232 cpu : usr=98.63%, sys=0.92%, ctx=117, majf=0, minf=28 00:29:18.232 IO depths : 1=3.2%, 2=9.5%, 4=25.0%, 8=53.0%, 16=9.3%, 32=0.0%, >=64=0.0% 00:29:18.232 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.232 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.232 issued rwts: total=560,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:18.232 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:18.232 filename0: (groupid=0, jobs=1): err= 0: pid=3188965: Thu Nov 21 03:45:56 2024 00:29:18.232 read: IOPS=63, BW=253KiB/s (259kB/s)(2560KiB/10105msec) 00:29:18.232 slat (nsec): min=8242, max=81049, avg=23626.75, stdev=12383.08 00:29:18.232 clat (msec): min=131, max=422, avg=250.67, stdev=49.27 00:29:18.232 lat (msec): min=131, max=422, avg=250.69, stdev=49.27 00:29:18.232 clat percentiles (msec): 00:29:18.232 | 1.00th=[ 140], 5.00th=[ 153], 10.00th=[ 178], 20.00th=[ 215], 00:29:18.232 | 30.00th=[ 232], 40.00th=[ 245], 50.00th=[ 255], 60.00th=[ 268], 00:29:18.232 | 70.00th=[ 275], 80.00th=[ 279], 90.00th=[ 305], 95.00th=[ 317], 00:29:18.232 | 99.00th=[ 384], 99.50th=[ 418], 99.90th=[ 422], 99.95th=[ 422], 00:29:18.232 | 99.99th=[ 422] 00:29:18.232 bw ( KiB/s): min= 128, max= 384, per=4.30%, avg=249.50, stdev=60.84, samples=20 00:29:18.232 iops : min= 32, max= 96, avg=62.35, stdev=15.21, samples=20 00:29:18.232 lat (msec) : 250=43.44%, 500=56.56% 00:29:18.232 cpu : usr=98.40%, sys=1.01%, ctx=98, majf=0, minf=32 00:29:18.232 IO depths : 1=2.2%, 2=8.4%, 4=25.0%, 8=54.1%, 16=10.3%, 32=0.0%, >=64=0.0% 00:29:18.232 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.233 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.233 issued rwts: total=640,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:18.233 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:18.233 filename0: (groupid=0, jobs=1): err= 0: pid=3188967: Thu Nov 21 03:45:56 2024 00:29:18.233 read: IOPS=55, BW=224KiB/s (229kB/s)(2240KiB/10013msec) 00:29:18.233 slat (nsec): min=7602, max=81544, avg=25613.03, stdev=10452.46 00:29:18.233 clat (msec): min=157, max=535, avg=285.86, stdev=64.35 00:29:18.233 lat (msec): min=157, max=535, avg=285.88, stdev=64.35 00:29:18.233 clat percentiles (msec): 00:29:18.233 | 1.00th=[ 159], 5.00th=[ 194], 10.00th=[ 215], 20.00th=[ 222], 00:29:18.233 | 30.00th=[ 247], 40.00th=[ 268], 50.00th=[ 279], 60.00th=[ 292], 00:29:18.233 | 70.00th=[ 309], 80.00th=[ 338], 90.00th=[ 388], 95.00th=[ 405], 00:29:18.233 | 99.00th=[ 414], 99.50th=[ 414], 99.90th=[ 535], 99.95th=[ 535], 00:29:18.233 | 99.99th=[ 535] 00:29:18.233 bw ( KiB/s): min= 128, max= 368, per=3.75%, avg=217.60, stdev=67.56, samples=20 00:29:18.233 iops : min= 32, max= 92, avg=54.40, stdev=16.89, samples=20 00:29:18.233 lat (msec) : 250=31.43%, 500=68.21%, 750=0.36% 00:29:18.233 cpu : usr=98.48%, sys=1.11%, ctx=21, majf=0, minf=26 00:29:18.233 IO depths : 1=2.5%, 2=8.8%, 4=25.0%, 8=53.8%, 16=10.0%, 32=0.0%, >=64=0.0% 00:29:18.233 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.233 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.233 issued rwts: total=560,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:18.233 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:18.233 filename0: (groupid=0, jobs=1): err= 0: pid=3188968: Thu Nov 21 03:45:56 2024 00:29:18.233 read: IOPS=58, BW=234KiB/s (240kB/s)(2368KiB/10107msec) 00:29:18.233 slat (nsec): min=7974, max=58545, avg=23553.91, stdev=10523.89 00:29:18.233 clat (msec): min=137, max=514, avg=272.93, stdev=60.01 00:29:18.233 lat (msec): min=137, max=514, avg=272.95, stdev=60.00 00:29:18.233 clat percentiles (msec): 00:29:18.233 | 1.00th=[ 140], 5.00th=[ 207], 10.00th=[ 215], 20.00th=[ 222], 00:29:18.233 | 30.00th=[ 243], 40.00th=[ 253], 50.00th=[ 268], 60.00th=[ 275], 00:29:18.233 | 70.00th=[ 292], 80.00th=[ 309], 90.00th=[ 372], 95.00th=[ 388], 00:29:18.233 | 99.00th=[ 472], 99.50th=[ 493], 99.90th=[ 514], 99.95th=[ 514], 00:29:18.233 | 99.99th=[ 514] 00:29:18.233 bw ( KiB/s): min= 128, max= 384, per=3.97%, avg=230.30, stdev=65.71, samples=20 00:29:18.233 iops : min= 32, max= 96, avg=57.55, stdev=16.42, samples=20 00:29:18.233 lat (msec) : 250=36.15%, 500=63.51%, 750=0.34% 00:29:18.233 cpu : usr=98.82%, sys=0.81%, ctx=17, majf=0, minf=31 00:29:18.233 IO depths : 1=2.9%, 2=9.1%, 4=25.0%, 8=53.4%, 16=9.6%, 32=0.0%, >=64=0.0% 00:29:18.233 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.233 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.233 issued rwts: total=592,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:18.233 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:18.233 filename0: (groupid=0, jobs=1): err= 0: pid=3188969: Thu Nov 21 03:45:56 2024 00:29:18.233 read: IOPS=55, BW=222KiB/s (227kB/s)(2240KiB/10089msec) 00:29:18.233 slat (usec): min=7, max=139, avg=73.93, stdev=24.27 00:29:18.233 clat (msec): min=148, max=517, avg=287.62, stdev=66.92 00:29:18.233 lat (msec): min=148, max=517, avg=287.69, stdev=66.94 00:29:18.233 clat percentiles (msec): 00:29:18.233 | 1.00th=[ 153], 5.00th=[ 197], 10.00th=[ 215], 20.00th=[ 220], 00:29:18.233 | 30.00th=[ 243], 40.00th=[ 271], 50.00th=[ 279], 60.00th=[ 292], 00:29:18.233 | 70.00th=[ 309], 80.00th=[ 347], 90.00th=[ 384], 95.00th=[ 405], 00:29:18.233 | 99.00th=[ 502], 99.50th=[ 518], 99.90th=[ 518], 99.95th=[ 518], 00:29:18.233 | 99.99th=[ 518] 00:29:18.233 bw ( KiB/s): min= 128, max= 256, per=3.75%, avg=217.60, stdev=55.28, samples=20 00:29:18.233 iops : min= 32, max= 64, avg=54.40, stdev=13.82, samples=20 00:29:18.233 lat (msec) : 250=33.39%, 500=65.89%, 750=0.71% 00:29:18.233 cpu : usr=98.19%, sys=1.18%, ctx=15, majf=0, minf=26 00:29:18.233 IO depths : 1=3.4%, 2=9.6%, 4=25.0%, 8=52.9%, 16=9.1%, 32=0.0%, >=64=0.0% 00:29:18.233 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.233 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.233 issued rwts: total=560,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:18.233 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:18.233 filename0: (groupid=0, jobs=1): err= 0: pid=3188970: Thu Nov 21 03:45:56 2024 00:29:18.233 read: IOPS=55, BW=222KiB/s (227kB/s)(2240KiB/10089msec) 00:29:18.233 slat (nsec): min=5862, max=79474, avg=25903.25, stdev=9135.30 00:29:18.233 clat (msec): min=215, max=411, avg=287.99, stdev=58.28 00:29:18.233 lat (msec): min=215, max=411, avg=288.02, stdev=58.28 00:29:18.233 clat percentiles (msec): 00:29:18.233 | 1.00th=[ 215], 5.00th=[ 218], 10.00th=[ 218], 20.00th=[ 226], 00:29:18.233 | 30.00th=[ 251], 40.00th=[ 268], 50.00th=[ 279], 60.00th=[ 288], 00:29:18.233 | 70.00th=[ 309], 80.00th=[ 334], 90.00th=[ 388], 95.00th=[ 405], 00:29:18.233 | 99.00th=[ 414], 99.50th=[ 414], 99.90th=[ 414], 99.95th=[ 414], 00:29:18.233 | 99.99th=[ 414] 00:29:18.233 bw ( KiB/s): min= 128, max= 384, per=3.75%, avg=217.60, stdev=73.12, samples=20 00:29:18.233 iops : min= 32, max= 96, avg=54.40, stdev=18.28, samples=20 00:29:18.233 lat (msec) : 250=25.89%, 500=74.11% 00:29:18.233 cpu : usr=97.72%, sys=1.49%, ctx=45, majf=0, minf=23 00:29:18.233 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:29:18.233 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.233 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.233 issued rwts: total=560,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:18.233 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:18.233 filename1: (groupid=0, jobs=1): err= 0: pid=3188971: Thu Nov 21 03:45:56 2024 00:29:18.233 read: IOPS=55, BW=222KiB/s (227kB/s)(2240KiB/10092msec) 00:29:18.233 slat (usec): min=15, max=136, avg=79.05, stdev=21.56 00:29:18.233 clat (msec): min=146, max=518, avg=287.63, stdev=66.51 00:29:18.233 lat (msec): min=146, max=518, avg=287.71, stdev=66.53 00:29:18.233 clat percentiles (msec): 00:29:18.233 | 1.00th=[ 153], 5.00th=[ 194], 10.00th=[ 215], 20.00th=[ 220], 00:29:18.233 | 30.00th=[ 245], 40.00th=[ 271], 50.00th=[ 279], 60.00th=[ 296], 00:29:18.233 | 70.00th=[ 309], 80.00th=[ 347], 90.00th=[ 384], 95.00th=[ 405], 00:29:18.233 | 99.00th=[ 439], 99.50th=[ 514], 99.90th=[ 518], 99.95th=[ 518], 00:29:18.233 | 99.99th=[ 518] 00:29:18.233 bw ( KiB/s): min= 128, max= 256, per=3.75%, avg=217.60, stdev=58.59, samples=20 00:29:18.233 iops : min= 32, max= 64, avg=54.40, stdev=14.65, samples=20 00:29:18.233 lat (msec) : 250=32.50%, 500=66.79%, 750=0.71% 00:29:18.233 cpu : usr=97.98%, sys=1.27%, ctx=26, majf=0, minf=29 00:29:18.233 IO depths : 1=3.2%, 2=9.5%, 4=25.0%, 8=53.0%, 16=9.3%, 32=0.0%, >=64=0.0% 00:29:18.233 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.233 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.233 issued rwts: total=560,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:18.233 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:18.233 filename1: (groupid=0, jobs=1): err= 0: pid=3188972: Thu Nov 21 03:45:56 2024 00:29:18.233 read: IOPS=56, BW=228KiB/s (233kB/s)(2304KiB/10113msec) 00:29:18.233 slat (usec): min=12, max=151, avg=78.02, stdev=23.11 00:29:18.233 clat (msec): min=82, max=533, avg=278.35, stdev=80.17 00:29:18.233 lat (msec): min=82, max=533, avg=278.43, stdev=80.18 00:29:18.233 clat percentiles (msec): 00:29:18.233 | 1.00th=[ 83], 5.00th=[ 148], 10.00th=[ 207], 20.00th=[ 218], 00:29:18.233 | 30.00th=[ 243], 40.00th=[ 251], 50.00th=[ 271], 60.00th=[ 288], 00:29:18.233 | 70.00th=[ 309], 80.00th=[ 338], 90.00th=[ 388], 95.00th=[ 405], 00:29:18.233 | 99.00th=[ 477], 99.50th=[ 531], 99.90th=[ 535], 99.95th=[ 535], 00:29:18.233 | 99.99th=[ 535] 00:29:18.233 bw ( KiB/s): min= 128, max= 384, per=3.87%, avg=224.00, stdev=76.82, samples=20 00:29:18.233 iops : min= 32, max= 96, avg=56.00, stdev=19.21, samples=20 00:29:18.233 lat (msec) : 100=2.78%, 250=35.59%, 500=60.94%, 750=0.69% 00:29:18.233 cpu : usr=97.90%, sys=1.27%, ctx=43, majf=0, minf=25 00:29:18.233 IO depths : 1=3.3%, 2=9.5%, 4=25.0%, 8=53.0%, 16=9.2%, 32=0.0%, >=64=0.0% 00:29:18.233 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.233 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.233 issued rwts: total=576,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:18.233 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:18.233 filename1: (groupid=0, jobs=1): err= 0: pid=3188974: Thu Nov 21 03:45:56 2024 00:29:18.233 read: IOPS=76, BW=308KiB/s (315kB/s)(3116KiB/10117msec) 00:29:18.233 slat (usec): min=6, max=169, avg=69.83, stdev=21.63 00:29:18.233 clat (msec): min=9, max=518, avg=207.34, stdev=91.55 00:29:18.233 lat (msec): min=9, max=518, avg=207.41, stdev=91.56 00:29:18.233 clat percentiles (msec): 00:29:18.233 | 1.00th=[ 14], 5.00th=[ 93], 10.00th=[ 138], 20.00th=[ 146], 00:29:18.233 | 30.00th=[ 157], 40.00th=[ 171], 50.00th=[ 182], 60.00th=[ 190], 00:29:18.233 | 70.00th=[ 205], 80.00th=[ 305], 90.00th=[ 376], 95.00th=[ 397], 00:29:18.233 | 99.00th=[ 405], 99.50th=[ 405], 99.90th=[ 518], 99.95th=[ 518], 00:29:18.233 | 99.99th=[ 518] 00:29:18.233 bw ( KiB/s): min= 128, max= 617, per=5.27%, avg=305.25, stdev=129.70, samples=20 00:29:18.233 iops : min= 32, max= 154, avg=76.30, stdev=32.39, samples=20 00:29:18.233 lat (msec) : 10=0.90%, 20=1.16%, 100=4.11%, 250=70.22%, 500=23.36% 00:29:18.233 lat (msec) : 750=0.26% 00:29:18.233 cpu : usr=98.19%, sys=1.12%, ctx=37, majf=0, minf=55 00:29:18.233 IO depths : 1=0.9%, 2=2.3%, 4=10.0%, 8=75.0%, 16=11.8%, 32=0.0%, >=64=0.0% 00:29:18.233 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.233 complete : 0=0.0%, 4=89.9%, 8=4.8%, 16=5.3%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.233 issued rwts: total=779,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:18.233 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:18.233 filename1: (groupid=0, jobs=1): err= 0: pid=3188975: Thu Nov 21 03:45:56 2024 00:29:18.233 read: IOPS=60, BW=241KiB/s (246kB/s)(2432KiB/10105msec) 00:29:18.233 slat (usec): min=7, max=118, avg=54.15, stdev=28.13 00:29:18.233 clat (msec): min=147, max=407, avg=264.67, stdev=45.64 00:29:18.233 lat (msec): min=147, max=407, avg=264.72, stdev=45.64 00:29:18.233 clat percentiles (msec): 00:29:18.233 | 1.00th=[ 161], 5.00th=[ 192], 10.00th=[ 215], 20.00th=[ 220], 00:29:18.233 | 30.00th=[ 251], 40.00th=[ 255], 50.00th=[ 266], 60.00th=[ 275], 00:29:18.233 | 70.00th=[ 284], 80.00th=[ 305], 90.00th=[ 326], 95.00th=[ 342], 00:29:18.233 | 99.00th=[ 363], 99.50th=[ 393], 99.90th=[ 409], 99.95th=[ 409], 00:29:18.233 | 99.99th=[ 409] 00:29:18.233 bw ( KiB/s): min= 128, max= 368, per=4.08%, avg=236.75, stdev=58.03, samples=20 00:29:18.234 iops : min= 32, max= 92, avg=59.15, stdev=14.57, samples=20 00:29:18.234 lat (msec) : 250=28.95%, 500=71.05% 00:29:18.234 cpu : usr=98.27%, sys=1.07%, ctx=51, majf=0, minf=29 00:29:18.234 IO depths : 1=3.3%, 2=9.5%, 4=25.0%, 8=53.0%, 16=9.2%, 32=0.0%, >=64=0.0% 00:29:18.234 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.234 complete : 0=0.0%, 4=94.1%, 8=0.2%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.234 issued rwts: total=608,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:18.234 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:18.234 filename1: (groupid=0, jobs=1): err= 0: pid=3188976: Thu Nov 21 03:45:56 2024 00:29:18.234 read: IOPS=67, BW=269KiB/s (276kB/s)(2720KiB/10107msec) 00:29:18.234 slat (nsec): min=7317, max=70592, avg=19224.70, stdev=13231.75 00:29:18.234 clat (msec): min=112, max=414, avg=237.60, stdev=69.80 00:29:18.234 lat (msec): min=112, max=414, avg=237.62, stdev=69.81 00:29:18.234 clat percentiles (msec): 00:29:18.234 | 1.00th=[ 115], 5.00th=[ 138], 10.00th=[ 144], 20.00th=[ 159], 00:29:18.234 | 30.00th=[ 182], 40.00th=[ 222], 50.00th=[ 255], 60.00th=[ 271], 00:29:18.234 | 70.00th=[ 279], 80.00th=[ 292], 90.00th=[ 317], 95.00th=[ 342], 00:29:18.234 | 99.00th=[ 414], 99.50th=[ 414], 99.90th=[ 414], 99.95th=[ 414], 00:29:18.234 | 99.99th=[ 414] 00:29:18.234 bw ( KiB/s): min= 128, max= 432, per=4.58%, avg=265.50, stdev=92.93, samples=20 00:29:18.234 iops : min= 32, max= 108, avg=66.35, stdev=23.24, samples=20 00:29:18.234 lat (msec) : 250=47.35%, 500=52.65% 00:29:18.234 cpu : usr=98.58%, sys=0.99%, ctx=16, majf=0, minf=31 00:29:18.234 IO depths : 1=3.2%, 2=7.6%, 4=19.3%, 8=60.4%, 16=9.4%, 32=0.0%, >=64=0.0% 00:29:18.234 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.234 complete : 0=0.0%, 4=92.5%, 8=2.0%, 16=5.5%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.234 issued rwts: total=680,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:18.234 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:18.234 filename1: (groupid=0, jobs=1): err= 0: pid=3188977: Thu Nov 21 03:45:56 2024 00:29:18.234 read: IOPS=55, BW=221KiB/s (227kB/s)(2232KiB/10088msec) 00:29:18.234 slat (nsec): min=8161, max=87979, avg=31697.04, stdev=19160.35 00:29:18.234 clat (msec): min=147, max=548, avg=288.70, stdev=65.99 00:29:18.234 lat (msec): min=148, max=548, avg=288.73, stdev=65.98 00:29:18.234 clat percentiles (msec): 00:29:18.234 | 1.00th=[ 174], 5.00th=[ 215], 10.00th=[ 218], 20.00th=[ 226], 00:29:18.234 | 30.00th=[ 251], 40.00th=[ 268], 50.00th=[ 284], 60.00th=[ 288], 00:29:18.234 | 70.00th=[ 309], 80.00th=[ 338], 90.00th=[ 388], 95.00th=[ 405], 00:29:18.234 | 99.00th=[ 531], 99.50th=[ 535], 99.90th=[ 550], 99.95th=[ 550], 00:29:18.234 | 99.99th=[ 550] 00:29:18.234 bw ( KiB/s): min= 112, max= 368, per=3.73%, avg=216.80, stdev=71.64, samples=20 00:29:18.234 iops : min= 28, max= 92, avg=54.20, stdev=17.91, samples=20 00:29:18.234 lat (msec) : 250=27.60%, 500=71.33%, 750=1.08% 00:29:18.234 cpu : usr=98.56%, sys=1.01%, ctx=27, majf=0, minf=28 00:29:18.234 IO depths : 1=3.6%, 2=9.9%, 4=25.1%, 8=52.7%, 16=8.8%, 32=0.0%, >=64=0.0% 00:29:18.234 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.234 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.234 issued rwts: total=558,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:18.234 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:18.234 filename1: (groupid=0, jobs=1): err= 0: pid=3188979: Thu Nov 21 03:45:56 2024 00:29:18.234 read: IOPS=55, BW=224KiB/s (229kB/s)(2240KiB/10011msec) 00:29:18.234 slat (usec): min=12, max=197, avg=40.63, stdev=31.38 00:29:18.234 clat (msec): min=150, max=489, avg=285.72, stdev=61.83 00:29:18.234 lat (msec): min=150, max=489, avg=285.76, stdev=61.84 00:29:18.234 clat percentiles (msec): 00:29:18.234 | 1.00th=[ 178], 5.00th=[ 215], 10.00th=[ 218], 20.00th=[ 222], 00:29:18.234 | 30.00th=[ 243], 40.00th=[ 271], 50.00th=[ 275], 60.00th=[ 288], 00:29:18.234 | 70.00th=[ 305], 80.00th=[ 342], 90.00th=[ 384], 95.00th=[ 405], 00:29:18.234 | 99.00th=[ 414], 99.50th=[ 435], 99.90th=[ 489], 99.95th=[ 489], 00:29:18.234 | 99.99th=[ 489] 00:29:18.234 bw ( KiB/s): min= 128, max= 256, per=3.75%, avg=217.60, stdev=60.18, samples=20 00:29:18.234 iops : min= 32, max= 64, avg=54.40, stdev=15.05, samples=20 00:29:18.234 lat (msec) : 250=32.50%, 500=67.50% 00:29:18.234 cpu : usr=97.76%, sys=1.45%, ctx=48, majf=0, minf=28 00:29:18.234 IO depths : 1=4.8%, 2=11.1%, 4=25.0%, 8=51.4%, 16=7.7%, 32=0.0%, >=64=0.0% 00:29:18.234 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.234 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.234 issued rwts: total=560,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:18.234 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:18.234 filename1: (groupid=0, jobs=1): err= 0: pid=3188980: Thu Nov 21 03:45:56 2024 00:29:18.234 read: IOPS=55, BW=222KiB/s (227kB/s)(2240KiB/10091msec) 00:29:18.234 slat (nsec): min=3870, max=67341, avg=25774.68, stdev=9925.16 00:29:18.234 clat (msec): min=215, max=520, avg=288.06, stdev=55.85 00:29:18.234 lat (msec): min=215, max=520, avg=288.09, stdev=55.85 00:29:18.234 clat percentiles (msec): 00:29:18.234 | 1.00th=[ 215], 5.00th=[ 218], 10.00th=[ 218], 20.00th=[ 228], 00:29:18.234 | 30.00th=[ 253], 40.00th=[ 268], 50.00th=[ 279], 60.00th=[ 288], 00:29:18.234 | 70.00th=[ 309], 80.00th=[ 338], 90.00th=[ 384], 95.00th=[ 405], 00:29:18.234 | 99.00th=[ 405], 99.50th=[ 405], 99.90th=[ 523], 99.95th=[ 523], 00:29:18.234 | 99.99th=[ 523] 00:29:18.234 bw ( KiB/s): min= 127, max= 384, per=3.75%, avg=217.55, stdev=73.18, samples=20 00:29:18.234 iops : min= 31, max= 96, avg=54.35, stdev=18.35, samples=20 00:29:18.234 lat (msec) : 250=23.21%, 500=76.43%, 750=0.36% 00:29:18.234 cpu : usr=98.35%, sys=1.14%, ctx=25, majf=0, minf=27 00:29:18.234 IO depths : 1=5.7%, 2=12.0%, 4=25.0%, 8=50.5%, 16=6.8%, 32=0.0%, >=64=0.0% 00:29:18.234 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.234 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.234 issued rwts: total=560,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:18.234 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:18.234 filename2: (groupid=0, jobs=1): err= 0: pid=3188981: Thu Nov 21 03:45:56 2024 00:29:18.234 read: IOPS=55, BW=222KiB/s (227kB/s)(2240KiB/10090msec) 00:29:18.234 slat (usec): min=5, max=131, avg=78.95, stdev=19.35 00:29:18.234 clat (msec): min=215, max=410, avg=287.57, stdev=58.25 00:29:18.234 lat (msec): min=215, max=410, avg=287.65, stdev=58.26 00:29:18.234 clat percentiles (msec): 00:29:18.234 | 1.00th=[ 215], 5.00th=[ 218], 10.00th=[ 218], 20.00th=[ 226], 00:29:18.234 | 30.00th=[ 251], 40.00th=[ 266], 50.00th=[ 279], 60.00th=[ 288], 00:29:18.234 | 70.00th=[ 309], 80.00th=[ 338], 90.00th=[ 388], 95.00th=[ 405], 00:29:18.234 | 99.00th=[ 409], 99.50th=[ 409], 99.90th=[ 409], 99.95th=[ 409], 00:29:18.234 | 99.99th=[ 409] 00:29:18.234 bw ( KiB/s): min= 128, max= 384, per=3.75%, avg=217.60, stdev=73.12, samples=20 00:29:18.234 iops : min= 32, max= 96, avg=54.40, stdev=18.28, samples=20 00:29:18.234 lat (msec) : 250=27.14%, 500=72.86% 00:29:18.234 cpu : usr=97.38%, sys=1.52%, ctx=45, majf=0, minf=23 00:29:18.234 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:29:18.234 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.234 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.234 issued rwts: total=560,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:18.234 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:18.234 filename2: (groupid=0, jobs=1): err= 0: pid=3188982: Thu Nov 21 03:45:56 2024 00:29:18.234 read: IOPS=56, BW=227KiB/s (233kB/s)(2296KiB/10108msec) 00:29:18.234 slat (usec): min=10, max=151, avg=74.80, stdev=23.93 00:29:18.234 clat (msec): min=147, max=547, avg=280.85, stdev=69.89 00:29:18.234 lat (msec): min=147, max=547, avg=280.92, stdev=69.91 00:29:18.234 clat percentiles (msec): 00:29:18.234 | 1.00th=[ 150], 5.00th=[ 192], 10.00th=[ 215], 20.00th=[ 218], 00:29:18.234 | 30.00th=[ 243], 40.00th=[ 253], 50.00th=[ 271], 60.00th=[ 288], 00:29:18.234 | 70.00th=[ 305], 80.00th=[ 338], 90.00th=[ 388], 95.00th=[ 409], 00:29:18.234 | 99.00th=[ 527], 99.50th=[ 531], 99.90th=[ 550], 99.95th=[ 550], 00:29:18.234 | 99.99th=[ 550] 00:29:18.234 bw ( KiB/s): min= 112, max= 368, per=3.85%, avg=223.15, stdev=69.02, samples=20 00:29:18.234 iops : min= 28, max= 92, avg=55.75, stdev=17.30, samples=20 00:29:18.234 lat (msec) : 250=36.41%, 500=62.54%, 750=1.05% 00:29:18.234 cpu : usr=98.16%, sys=1.10%, ctx=32, majf=0, minf=33 00:29:18.234 IO depths : 1=3.3%, 2=9.6%, 4=25.1%, 8=53.0%, 16=9.1%, 32=0.0%, >=64=0.0% 00:29:18.234 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.234 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.234 issued rwts: total=574,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:18.234 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:18.234 filename2: (groupid=0, jobs=1): err= 0: pid=3188983: Thu Nov 21 03:45:56 2024 00:29:18.234 read: IOPS=55, BW=222KiB/s (227kB/s)(2240KiB/10087msec) 00:29:18.234 slat (usec): min=8, max=102, avg=52.94, stdev=28.39 00:29:18.234 clat (msec): min=215, max=534, avg=287.71, stdev=57.39 00:29:18.234 lat (msec): min=215, max=534, avg=287.76, stdev=57.37 00:29:18.234 clat percentiles (msec): 00:29:18.234 | 1.00th=[ 215], 5.00th=[ 218], 10.00th=[ 218], 20.00th=[ 228], 00:29:18.234 | 30.00th=[ 253], 40.00th=[ 268], 50.00th=[ 279], 60.00th=[ 288], 00:29:18.234 | 70.00th=[ 309], 80.00th=[ 334], 90.00th=[ 384], 95.00th=[ 405], 00:29:18.234 | 99.00th=[ 414], 99.50th=[ 506], 99.90th=[ 535], 99.95th=[ 535], 00:29:18.234 | 99.99th=[ 535] 00:29:18.234 bw ( KiB/s): min= 128, max= 384, per=3.75%, avg=217.60, stdev=71.82, samples=20 00:29:18.234 iops : min= 32, max= 96, avg=54.40, stdev=17.95, samples=20 00:29:18.234 lat (msec) : 250=25.89%, 500=73.39%, 750=0.71% 00:29:18.234 cpu : usr=98.26%, sys=1.00%, ctx=63, majf=0, minf=27 00:29:18.234 IO depths : 1=5.7%, 2=12.0%, 4=25.0%, 8=50.5%, 16=6.8%, 32=0.0%, >=64=0.0% 00:29:18.234 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.234 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.234 issued rwts: total=560,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:18.234 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:18.234 filename2: (groupid=0, jobs=1): err= 0: pid=3188984: Thu Nov 21 03:45:56 2024 00:29:18.234 read: IOPS=55, BW=222KiB/s (227kB/s)(2240KiB/10106msec) 00:29:18.234 slat (nsec): min=10218, max=62470, avg=28945.86, stdev=8097.31 00:29:18.234 clat (msec): min=137, max=535, avg=286.43, stdev=63.39 00:29:18.234 lat (msec): min=137, max=535, avg=286.46, stdev=63.39 00:29:18.234 clat percentiles (msec): 00:29:18.234 | 1.00th=[ 207], 5.00th=[ 213], 10.00th=[ 215], 20.00th=[ 224], 00:29:18.235 | 30.00th=[ 243], 40.00th=[ 266], 50.00th=[ 275], 60.00th=[ 288], 00:29:18.235 | 70.00th=[ 309], 80.00th=[ 338], 90.00th=[ 388], 95.00th=[ 405], 00:29:18.235 | 99.00th=[ 414], 99.50th=[ 481], 99.90th=[ 535], 99.95th=[ 535], 00:29:18.235 | 99.99th=[ 535] 00:29:18.235 bw ( KiB/s): min= 128, max= 384, per=3.75%, avg=217.50, stdev=73.06, samples=20 00:29:18.235 iops : min= 32, max= 96, avg=54.35, stdev=18.25, samples=20 00:29:18.235 lat (msec) : 250=33.93%, 500=65.71%, 750=0.36% 00:29:18.235 cpu : usr=97.92%, sys=1.44%, ctx=18, majf=0, minf=29 00:29:18.235 IO depths : 1=5.9%, 2=12.1%, 4=25.0%, 8=50.4%, 16=6.6%, 32=0.0%, >=64=0.0% 00:29:18.235 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.235 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.235 issued rwts: total=560,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:18.235 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:18.235 filename2: (groupid=0, jobs=1): err= 0: pid=3188986: Thu Nov 21 03:45:56 2024 00:29:18.235 read: IOPS=72, BW=292KiB/s (299kB/s)(2952KiB/10113msec) 00:29:18.235 slat (nsec): min=3759, max=99817, avg=24306.91, stdev=24424.40 00:29:18.235 clat (msec): min=82, max=407, avg=218.40, stdev=42.50 00:29:18.235 lat (msec): min=82, max=407, avg=218.43, stdev=42.50 00:29:18.235 clat percentiles (msec): 00:29:18.235 | 1.00th=[ 84], 5.00th=[ 148], 10.00th=[ 169], 20.00th=[ 190], 00:29:18.235 | 30.00th=[ 205], 40.00th=[ 211], 50.00th=[ 215], 60.00th=[ 222], 00:29:18.235 | 70.00th=[ 243], 80.00th=[ 253], 90.00th=[ 268], 95.00th=[ 271], 00:29:18.235 | 99.00th=[ 326], 99.50th=[ 409], 99.90th=[ 409], 99.95th=[ 409], 00:29:18.235 | 99.99th=[ 409] 00:29:18.235 bw ( KiB/s): min= 176, max= 384, per=4.98%, avg=288.80, stdev=59.30, samples=20 00:29:18.235 iops : min= 44, max= 96, avg=72.20, stdev=14.82, samples=20 00:29:18.235 lat (msec) : 100=2.17%, 250=73.98%, 500=23.85% 00:29:18.235 cpu : usr=98.54%, sys=1.01%, ctx=23, majf=0, minf=27 00:29:18.235 IO depths : 1=1.8%, 2=4.6%, 4=14.6%, 8=68.2%, 16=10.8%, 32=0.0%, >=64=0.0% 00:29:18.235 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.235 complete : 0=0.0%, 4=91.1%, 8=3.4%, 16=5.5%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.235 issued rwts: total=738,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:18.235 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:18.235 filename2: (groupid=0, jobs=1): err= 0: pid=3188987: Thu Nov 21 03:45:56 2024 00:29:18.235 read: IOPS=62, BW=249KiB/s (255kB/s)(2496KiB/10034msec) 00:29:18.235 slat (usec): min=5, max=205, avg=64.24, stdev=31.53 00:29:18.235 clat (msec): min=13, max=373, avg=256.70, stdev=61.40 00:29:18.235 lat (msec): min=13, max=373, avg=256.77, stdev=61.42 00:29:18.235 clat percentiles (msec): 00:29:18.235 | 1.00th=[ 14], 5.00th=[ 114], 10.00th=[ 194], 20.00th=[ 220], 00:29:18.235 | 30.00th=[ 243], 40.00th=[ 255], 50.00th=[ 271], 60.00th=[ 275], 00:29:18.235 | 70.00th=[ 279], 80.00th=[ 305], 90.00th=[ 338], 95.00th=[ 347], 00:29:18.235 | 99.00th=[ 376], 99.50th=[ 376], 99.90th=[ 376], 99.95th=[ 376], 00:29:18.235 | 99.99th=[ 376] 00:29:18.235 bw ( KiB/s): min= 128, max= 384, per=4.20%, avg=243.20, stdev=70.72, samples=20 00:29:18.235 iops : min= 32, max= 96, avg=60.80, stdev=17.68, samples=20 00:29:18.235 lat (msec) : 20=2.24%, 100=0.64%, 250=34.62%, 500=62.50% 00:29:18.235 cpu : usr=97.59%, sys=1.52%, ctx=89, majf=0, minf=28 00:29:18.235 IO depths : 1=6.1%, 2=12.3%, 4=25.0%, 8=50.2%, 16=6.4%, 32=0.0%, >=64=0.0% 00:29:18.235 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.235 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.235 issued rwts: total=624,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:18.235 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:18.235 filename2: (groupid=0, jobs=1): err= 0: pid=3188988: Thu Nov 21 03:45:56 2024 00:29:18.235 read: IOPS=62, BW=249KiB/s (255kB/s)(2520KiB/10112msec) 00:29:18.235 slat (usec): min=5, max=105, avg=24.60, stdev=15.62 00:29:18.235 clat (msec): min=137, max=448, avg=255.86, stdev=53.10 00:29:18.235 lat (msec): min=137, max=448, avg=255.89, stdev=53.10 00:29:18.235 clat percentiles (msec): 00:29:18.235 | 1.00th=[ 140], 5.00th=[ 153], 10.00th=[ 176], 20.00th=[ 218], 00:29:18.235 | 30.00th=[ 232], 40.00th=[ 249], 50.00th=[ 255], 60.00th=[ 271], 00:29:18.235 | 70.00th=[ 279], 80.00th=[ 296], 90.00th=[ 317], 95.00th=[ 338], 00:29:18.235 | 99.00th=[ 401], 99.50th=[ 422], 99.90th=[ 447], 99.95th=[ 447], 00:29:18.235 | 99.99th=[ 447] 00:29:18.235 bw ( KiB/s): min= 128, max= 384, per=4.23%, avg=245.60, stdev=62.78, samples=20 00:29:18.235 iops : min= 32, max= 96, avg=61.40, stdev=15.70, samples=20 00:29:18.235 lat (msec) : 250=41.90%, 500=58.10% 00:29:18.235 cpu : usr=98.05%, sys=1.29%, ctx=139, majf=0, minf=28 00:29:18.235 IO depths : 1=2.4%, 2=7.9%, 4=22.9%, 8=56.7%, 16=10.2%, 32=0.0%, >=64=0.0% 00:29:18.235 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.235 complete : 0=0.0%, 4=93.5%, 8=0.9%, 16=5.6%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.235 issued rwts: total=630,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:18.235 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:18.235 filename2: (groupid=0, jobs=1): err= 0: pid=3188989: Thu Nov 21 03:45:56 2024 00:29:18.235 read: IOPS=55, BW=222KiB/s (227kB/s)(2240KiB/10093msec) 00:29:18.235 slat (usec): min=5, max=137, avg=33.49, stdev=29.08 00:29:18.235 clat (msec): min=147, max=519, avg=288.09, stdev=67.33 00:29:18.235 lat (msec): min=147, max=519, avg=288.13, stdev=67.33 00:29:18.235 clat percentiles (msec): 00:29:18.235 | 1.00th=[ 153], 5.00th=[ 197], 10.00th=[ 215], 20.00th=[ 222], 00:29:18.235 | 30.00th=[ 243], 40.00th=[ 271], 50.00th=[ 279], 60.00th=[ 296], 00:29:18.235 | 70.00th=[ 309], 80.00th=[ 347], 90.00th=[ 384], 95.00th=[ 405], 00:29:18.235 | 99.00th=[ 502], 99.50th=[ 518], 99.90th=[ 518], 99.95th=[ 518], 00:29:18.235 | 99.99th=[ 518] 00:29:18.235 bw ( KiB/s): min= 128, max= 272, per=3.75%, avg=217.60, stdev=55.52, samples=20 00:29:18.235 iops : min= 32, max= 68, avg=54.40, stdev=13.88, samples=20 00:29:18.235 lat (msec) : 250=32.86%, 500=66.07%, 750=1.07% 00:29:18.235 cpu : usr=97.98%, sys=1.33%, ctx=21, majf=0, minf=33 00:29:18.235 IO depths : 1=3.2%, 2=9.5%, 4=25.0%, 8=53.0%, 16=9.3%, 32=0.0%, >=64=0.0% 00:29:18.235 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.235 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:18.235 issued rwts: total=560,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:18.235 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:18.235 00:29:18.235 Run status group 0 (all jobs): 00:29:18.235 READ: bw=5787KiB/s (5926kB/s), 221KiB/s-316KiB/s (227kB/s-324kB/s), io=57.2MiB (60.0MB), run=10011-10117msec 00:29:18.235 03:45:56 -- target/dif.sh@113 -- # destroy_subsystems 0 1 2 00:29:18.235 03:45:56 -- target/dif.sh@43 -- # local sub 00:29:18.235 03:45:56 -- target/dif.sh@45 -- # for sub in "$@" 00:29:18.235 03:45:56 -- target/dif.sh@46 -- # destroy_subsystem 0 00:29:18.235 03:45:56 -- target/dif.sh@36 -- # local sub_id=0 00:29:18.235 03:45:56 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:29:18.235 03:45:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:18.235 03:45:56 -- common/autotest_common.sh@10 -- # set +x 00:29:18.235 03:45:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:18.235 03:45:57 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:29:18.235 03:45:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:18.235 03:45:57 -- common/autotest_common.sh@10 -- # set +x 00:29:18.235 03:45:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:18.235 03:45:57 -- target/dif.sh@45 -- # for sub in "$@" 00:29:18.235 03:45:57 -- target/dif.sh@46 -- # destroy_subsystem 1 00:29:18.235 03:45:57 -- target/dif.sh@36 -- # local sub_id=1 00:29:18.235 03:45:57 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:29:18.235 03:45:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:18.235 03:45:57 -- common/autotest_common.sh@10 -- # set +x 00:29:18.235 03:45:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:18.235 03:45:57 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:29:18.235 03:45:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:18.235 03:45:57 -- common/autotest_common.sh@10 -- # set +x 00:29:18.235 03:45:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:18.235 03:45:57 -- target/dif.sh@45 -- # for sub in "$@" 00:29:18.235 03:45:57 -- target/dif.sh@46 -- # destroy_subsystem 2 00:29:18.235 03:45:57 -- target/dif.sh@36 -- # local sub_id=2 00:29:18.235 03:45:57 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:29:18.235 03:45:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:18.235 03:45:57 -- common/autotest_common.sh@10 -- # set +x 00:29:18.235 03:45:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:18.235 03:45:57 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null2 00:29:18.235 03:45:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:18.235 03:45:57 -- common/autotest_common.sh@10 -- # set +x 00:29:18.235 03:45:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:18.235 03:45:57 -- target/dif.sh@115 -- # NULL_DIF=1 00:29:18.235 03:45:57 -- target/dif.sh@115 -- # bs=8k,16k,128k 00:29:18.235 03:45:57 -- target/dif.sh@115 -- # numjobs=2 00:29:18.235 03:45:57 -- target/dif.sh@115 -- # iodepth=8 00:29:18.235 03:45:57 -- target/dif.sh@115 -- # runtime=5 00:29:18.235 03:45:57 -- target/dif.sh@115 -- # files=1 00:29:18.235 03:45:57 -- target/dif.sh@117 -- # create_subsystems 0 1 00:29:18.235 03:45:57 -- target/dif.sh@28 -- # local sub 00:29:18.235 03:45:57 -- target/dif.sh@30 -- # for sub in "$@" 00:29:18.235 03:45:57 -- target/dif.sh@31 -- # create_subsystem 0 00:29:18.235 03:45:57 -- target/dif.sh@18 -- # local sub_id=0 00:29:18.235 03:45:57 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:29:18.235 03:45:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:18.235 03:45:57 -- common/autotest_common.sh@10 -- # set +x 00:29:18.235 bdev_null0 00:29:18.235 03:45:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:18.235 03:45:57 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:29:18.235 03:45:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:18.235 03:45:57 -- common/autotest_common.sh@10 -- # set +x 00:29:18.235 03:45:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:18.235 03:45:57 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:29:18.235 03:45:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:18.235 03:45:57 -- common/autotest_common.sh@10 -- # set +x 00:29:18.235 03:45:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:18.236 03:45:57 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:29:18.236 03:45:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:18.236 03:45:57 -- common/autotest_common.sh@10 -- # set +x 00:29:18.236 [2024-11-21 03:45:57.071649] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:18.236 03:45:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:18.236 03:45:57 -- target/dif.sh@30 -- # for sub in "$@" 00:29:18.236 03:45:57 -- target/dif.sh@31 -- # create_subsystem 1 00:29:18.236 03:45:57 -- target/dif.sh@18 -- # local sub_id=1 00:29:18.236 03:45:57 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:29:18.236 03:45:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:18.236 03:45:57 -- common/autotest_common.sh@10 -- # set +x 00:29:18.236 bdev_null1 00:29:18.236 03:45:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:18.236 03:45:57 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:29:18.236 03:45:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:18.236 03:45:57 -- common/autotest_common.sh@10 -- # set +x 00:29:18.236 03:45:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:18.236 03:45:57 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:29:18.236 03:45:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:18.236 03:45:57 -- common/autotest_common.sh@10 -- # set +x 00:29:18.236 03:45:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:18.236 03:45:57 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:29:18.236 03:45:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:18.236 03:45:57 -- common/autotest_common.sh@10 -- # set +x 00:29:18.236 03:45:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:18.236 03:45:57 -- target/dif.sh@118 -- # fio /dev/fd/62 00:29:18.236 03:45:57 -- target/dif.sh@118 -- # create_json_sub_conf 0 1 00:29:18.236 03:45:57 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:29:18.236 03:45:57 -- nvmf/common.sh@520 -- # config=() 00:29:18.236 03:45:57 -- nvmf/common.sh@520 -- # local subsystem config 00:29:18.236 03:45:57 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:18.236 03:45:57 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:18.236 { 00:29:18.236 "params": { 00:29:18.236 "name": "Nvme$subsystem", 00:29:18.236 "trtype": "$TEST_TRANSPORT", 00:29:18.236 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:18.236 "adrfam": "ipv4", 00:29:18.236 "trsvcid": "$NVMF_PORT", 00:29:18.236 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:18.236 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:18.236 "hdgst": ${hdgst:-false}, 00:29:18.236 "ddgst": ${ddgst:-false} 00:29:18.236 }, 00:29:18.236 "method": "bdev_nvme_attach_controller" 00:29:18.236 } 00:29:18.236 EOF 00:29:18.236 )") 00:29:18.236 03:45:57 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:18.236 03:45:57 -- target/dif.sh@82 -- # gen_fio_conf 00:29:18.236 03:45:57 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:18.236 03:45:57 -- target/dif.sh@54 -- # local file 00:29:18.236 03:45:57 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:29:18.236 03:45:57 -- target/dif.sh@56 -- # cat 00:29:18.236 03:45:57 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:29:18.236 03:45:57 -- common/autotest_common.sh@1328 -- # local sanitizers 00:29:18.236 03:45:57 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:18.236 03:45:57 -- common/autotest_common.sh@1330 -- # shift 00:29:18.236 03:45:57 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:29:18.236 03:45:57 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:18.236 03:45:57 -- nvmf/common.sh@542 -- # cat 00:29:18.236 03:45:57 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:18.236 03:45:57 -- target/dif.sh@72 -- # (( file = 1 )) 00:29:18.236 03:45:57 -- common/autotest_common.sh@1334 -- # grep libasan 00:29:18.236 03:45:57 -- target/dif.sh@72 -- # (( file <= files )) 00:29:18.236 03:45:57 -- target/dif.sh@73 -- # cat 00:29:18.236 03:45:57 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:18.236 03:45:57 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:18.236 03:45:57 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:18.236 { 00:29:18.236 "params": { 00:29:18.236 "name": "Nvme$subsystem", 00:29:18.236 "trtype": "$TEST_TRANSPORT", 00:29:18.236 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:18.236 "adrfam": "ipv4", 00:29:18.236 "trsvcid": "$NVMF_PORT", 00:29:18.236 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:18.236 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:18.236 "hdgst": ${hdgst:-false}, 00:29:18.236 "ddgst": ${ddgst:-false} 00:29:18.236 }, 00:29:18.236 "method": "bdev_nvme_attach_controller" 00:29:18.236 } 00:29:18.236 EOF 00:29:18.236 )") 00:29:18.236 03:45:57 -- nvmf/common.sh@542 -- # cat 00:29:18.236 03:45:57 -- target/dif.sh@72 -- # (( file++ )) 00:29:18.236 03:45:57 -- target/dif.sh@72 -- # (( file <= files )) 00:29:18.236 03:45:57 -- nvmf/common.sh@544 -- # jq . 00:29:18.236 03:45:57 -- nvmf/common.sh@545 -- # IFS=, 00:29:18.236 03:45:57 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:29:18.236 "params": { 00:29:18.236 "name": "Nvme0", 00:29:18.236 "trtype": "tcp", 00:29:18.236 "traddr": "10.0.0.2", 00:29:18.236 "adrfam": "ipv4", 00:29:18.236 "trsvcid": "4420", 00:29:18.236 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:29:18.236 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:29:18.236 "hdgst": false, 00:29:18.236 "ddgst": false 00:29:18.236 }, 00:29:18.236 "method": "bdev_nvme_attach_controller" 00:29:18.236 },{ 00:29:18.236 "params": { 00:29:18.236 "name": "Nvme1", 00:29:18.236 "trtype": "tcp", 00:29:18.236 "traddr": "10.0.0.2", 00:29:18.236 "adrfam": "ipv4", 00:29:18.236 "trsvcid": "4420", 00:29:18.236 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:29:18.236 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:29:18.236 "hdgst": false, 00:29:18.236 "ddgst": false 00:29:18.236 }, 00:29:18.236 "method": "bdev_nvme_attach_controller" 00:29:18.236 }' 00:29:18.236 03:45:57 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:18.236 03:45:57 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:18.236 03:45:57 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:18.236 03:45:57 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:18.236 03:45:57 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:29:18.236 03:45:57 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:18.236 03:45:57 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:18.236 03:45:57 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:18.236 03:45:57 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:29:18.236 03:45:57 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:18.236 filename0: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:29:18.236 ... 00:29:18.236 filename1: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:29:18.236 ... 00:29:18.236 fio-3.35 00:29:18.236 Starting 4 threads 00:29:18.236 EAL: No free 2048 kB hugepages reported on node 1 00:29:18.236 [2024-11-21 03:45:57.924656] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:29:18.236 [2024-11-21 03:45:57.924744] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:29:22.419 00:29:22.419 filename0: (groupid=0, jobs=1): err= 0: pid=3190443: Thu Nov 21 03:46:03 2024 00:29:22.419 read: IOPS=1921, BW=15.0MiB/s (15.7MB/s)(75.1MiB/5001msec) 00:29:22.419 slat (nsec): min=6976, max=63051, avg=15649.62, stdev=8516.14 00:29:22.419 clat (usec): min=551, max=8450, avg=4109.92, stdev=599.02 00:29:22.419 lat (usec): min=563, max=8478, avg=4125.57, stdev=598.65 00:29:22.419 clat percentiles (usec): 00:29:22.419 | 1.00th=[ 2835], 5.00th=[ 3425], 10.00th=[ 3621], 20.00th=[ 3818], 00:29:22.419 | 30.00th=[ 3916], 40.00th=[ 3982], 50.00th=[ 4047], 60.00th=[ 4113], 00:29:22.419 | 70.00th=[ 4178], 80.00th=[ 4293], 90.00th=[ 4424], 95.00th=[ 5538], 00:29:22.419 | 99.00th=[ 6325], 99.50th=[ 6521], 99.90th=[ 7373], 99.95th=[ 7898], 00:29:22.419 | 99.99th=[ 8455] 00:29:22.419 bw ( KiB/s): min=15056, max=15616, per=24.72%, avg=15358.22, stdev=169.22, samples=9 00:29:22.419 iops : min= 1882, max= 1952, avg=1919.78, stdev=21.15, samples=9 00:29:22.419 lat (usec) : 750=0.05%, 1000=0.08% 00:29:22.419 lat (msec) : 2=0.29%, 4=40.97%, 10=58.61% 00:29:22.419 cpu : usr=95.78%, sys=3.66%, ctx=9, majf=0, minf=9 00:29:22.419 IO depths : 1=0.1%, 2=9.3%, 4=63.9%, 8=26.8%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:22.419 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:22.419 complete : 0=0.0%, 4=91.8%, 8=8.2%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:22.419 issued rwts: total=9610,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:22.419 latency : target=0, window=0, percentile=100.00%, depth=8 00:29:22.419 filename0: (groupid=0, jobs=1): err= 0: pid=3190444: Thu Nov 21 03:46:03 2024 00:29:22.419 read: IOPS=1929, BW=15.1MiB/s (15.8MB/s)(75.4MiB/5002msec) 00:29:22.419 slat (usec): min=6, max=101, avg=16.16, stdev= 9.29 00:29:22.419 clat (usec): min=785, max=7350, avg=4091.06, stdev=597.40 00:29:22.419 lat (usec): min=799, max=7359, avg=4107.22, stdev=596.96 00:29:22.419 clat percentiles (usec): 00:29:22.419 | 1.00th=[ 2802], 5.00th=[ 3326], 10.00th=[ 3556], 20.00th=[ 3752], 00:29:22.419 | 30.00th=[ 3884], 40.00th=[ 3982], 50.00th=[ 4047], 60.00th=[ 4113], 00:29:22.419 | 70.00th=[ 4178], 80.00th=[ 4293], 90.00th=[ 4490], 95.00th=[ 5473], 00:29:22.419 | 99.00th=[ 6259], 99.50th=[ 6456], 99.90th=[ 7111], 99.95th=[ 7177], 00:29:22.419 | 99.99th=[ 7373] 00:29:22.419 bw ( KiB/s): min=15152, max=15920, per=24.84%, avg=15436.60, stdev=230.57, samples=10 00:29:22.419 iops : min= 1894, max= 1990, avg=1929.50, stdev=28.90, samples=10 00:29:22.419 lat (usec) : 1000=0.03% 00:29:22.419 lat (msec) : 2=0.28%, 4=43.12%, 10=56.57% 00:29:22.419 cpu : usr=95.34%, sys=4.06%, ctx=10, majf=0, minf=9 00:29:22.419 IO depths : 1=0.1%, 2=8.5%, 4=64.4%, 8=27.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:22.419 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:22.419 complete : 0=0.0%, 4=92.1%, 8=7.9%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:22.419 issued rwts: total=9653,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:22.419 latency : target=0, window=0, percentile=100.00%, depth=8 00:29:22.419 filename1: (groupid=0, jobs=1): err= 0: pid=3190445: Thu Nov 21 03:46:03 2024 00:29:22.419 read: IOPS=1943, BW=15.2MiB/s (15.9MB/s)(75.9MiB/5003msec) 00:29:22.419 slat (usec): min=6, max=105, avg=16.34, stdev= 9.36 00:29:22.419 clat (usec): min=618, max=7374, avg=4059.67, stdev=572.26 00:29:22.419 lat (usec): min=630, max=7382, avg=4076.01, stdev=572.13 00:29:22.419 clat percentiles (usec): 00:29:22.419 | 1.00th=[ 2704], 5.00th=[ 3326], 10.00th=[ 3556], 20.00th=[ 3752], 00:29:22.419 | 30.00th=[ 3884], 40.00th=[ 3982], 50.00th=[ 4015], 60.00th=[ 4080], 00:29:22.419 | 70.00th=[ 4178], 80.00th=[ 4228], 90.00th=[ 4424], 95.00th=[ 5276], 00:29:22.419 | 99.00th=[ 6128], 99.50th=[ 6390], 99.90th=[ 6915], 99.95th=[ 7111], 00:29:22.419 | 99.99th=[ 7373] 00:29:22.419 bw ( KiB/s): min=15152, max=15840, per=25.02%, avg=15544.00, stdev=215.49, samples=10 00:29:22.419 iops : min= 1894, max= 1980, avg=1943.00, stdev=26.94, samples=10 00:29:22.419 lat (usec) : 750=0.02%, 1000=0.08% 00:29:22.419 lat (msec) : 2=0.27%, 4=44.73%, 10=54.90% 00:29:22.419 cpu : usr=95.28%, sys=4.08%, ctx=11, majf=0, minf=9 00:29:22.419 IO depths : 1=0.1%, 2=10.8%, 4=62.4%, 8=26.8%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:22.419 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:22.419 complete : 0=0.0%, 4=91.8%, 8=8.2%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:22.419 issued rwts: total=9721,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:22.419 latency : target=0, window=0, percentile=100.00%, depth=8 00:29:22.419 filename1: (groupid=0, jobs=1): err= 0: pid=3190446: Thu Nov 21 03:46:03 2024 00:29:22.419 read: IOPS=1974, BW=15.4MiB/s (16.2MB/s)(77.2MiB/5004msec) 00:29:22.419 slat (nsec): min=3780, max=60858, avg=18130.31, stdev=7856.07 00:29:22.419 clat (usec): min=865, max=9525, avg=3993.83, stdev=557.73 00:29:22.419 lat (usec): min=885, max=9541, avg=4011.96, stdev=557.98 00:29:22.419 clat percentiles (usec): 00:29:22.419 | 1.00th=[ 2671], 5.00th=[ 3163], 10.00th=[ 3425], 20.00th=[ 3654], 00:29:22.419 | 30.00th=[ 3818], 40.00th=[ 3916], 50.00th=[ 4015], 60.00th=[ 4080], 00:29:22.419 | 70.00th=[ 4146], 80.00th=[ 4228], 90.00th=[ 4359], 95.00th=[ 4948], 00:29:22.419 | 99.00th=[ 5866], 99.50th=[ 6194], 99.90th=[ 7177], 99.95th=[ 9503], 00:29:22.419 | 99.99th=[ 9503] 00:29:22.419 bw ( KiB/s): min=15248, max=16656, per=25.42%, avg=15795.20, stdev=478.98, samples=10 00:29:22.419 iops : min= 1906, max= 2082, avg=1974.40, stdev=59.87, samples=10 00:29:22.419 lat (usec) : 1000=0.05% 00:29:22.419 lat (msec) : 2=0.25%, 4=48.28%, 10=51.42% 00:29:22.419 cpu : usr=95.00%, sys=4.16%, ctx=87, majf=0, minf=9 00:29:22.419 IO depths : 1=0.1%, 2=7.7%, 4=64.0%, 8=28.3%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:22.419 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:22.419 complete : 0=0.0%, 4=93.0%, 8=7.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:22.419 issued rwts: total=9880,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:22.419 latency : target=0, window=0, percentile=100.00%, depth=8 00:29:22.419 00:29:22.419 Run status group 0 (all jobs): 00:29:22.419 READ: bw=60.7MiB/s (63.6MB/s), 15.0MiB/s-15.4MiB/s (15.7MB/s-16.2MB/s), io=304MiB (318MB), run=5001-5004msec 00:29:22.678 03:46:03 -- target/dif.sh@119 -- # destroy_subsystems 0 1 00:29:22.678 03:46:03 -- target/dif.sh@43 -- # local sub 00:29:22.678 03:46:03 -- target/dif.sh@45 -- # for sub in "$@" 00:29:22.678 03:46:03 -- target/dif.sh@46 -- # destroy_subsystem 0 00:29:22.678 03:46:03 -- target/dif.sh@36 -- # local sub_id=0 00:29:22.678 03:46:03 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:29:22.678 03:46:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:22.678 03:46:03 -- common/autotest_common.sh@10 -- # set +x 00:29:22.678 03:46:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:22.678 03:46:03 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:29:22.678 03:46:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:22.678 03:46:03 -- common/autotest_common.sh@10 -- # set +x 00:29:22.678 03:46:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:22.678 03:46:03 -- target/dif.sh@45 -- # for sub in "$@" 00:29:22.678 03:46:03 -- target/dif.sh@46 -- # destroy_subsystem 1 00:29:22.679 03:46:03 -- target/dif.sh@36 -- # local sub_id=1 00:29:22.679 03:46:03 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:29:22.679 03:46:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:22.679 03:46:03 -- common/autotest_common.sh@10 -- # set +x 00:29:22.679 03:46:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:22.679 03:46:03 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:29:22.679 03:46:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:22.679 03:46:03 -- common/autotest_common.sh@10 -- # set +x 00:29:22.679 03:46:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:22.679 00:29:22.679 real 0m24.335s 00:29:22.679 user 4m35.771s 00:29:22.679 sys 0m5.398s 00:29:22.679 03:46:03 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:22.679 03:46:03 -- common/autotest_common.sh@10 -- # set +x 00:29:22.679 ************************************ 00:29:22.679 END TEST fio_dif_rand_params 00:29:22.679 ************************************ 00:29:22.937 03:46:03 -- target/dif.sh@144 -- # run_test fio_dif_digest fio_dif_digest 00:29:22.937 03:46:03 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:22.937 03:46:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:22.937 03:46:03 -- common/autotest_common.sh@10 -- # set +x 00:29:22.937 ************************************ 00:29:22.937 START TEST fio_dif_digest 00:29:22.937 ************************************ 00:29:22.937 03:46:03 -- common/autotest_common.sh@1114 -- # fio_dif_digest 00:29:22.937 03:46:03 -- target/dif.sh@123 -- # local NULL_DIF 00:29:22.937 03:46:03 -- target/dif.sh@124 -- # local bs numjobs runtime iodepth files 00:29:22.937 03:46:03 -- target/dif.sh@125 -- # local hdgst ddgst 00:29:22.937 03:46:03 -- target/dif.sh@127 -- # NULL_DIF=3 00:29:22.937 03:46:03 -- target/dif.sh@127 -- # bs=128k,128k,128k 00:29:22.937 03:46:03 -- target/dif.sh@127 -- # numjobs=3 00:29:22.937 03:46:03 -- target/dif.sh@127 -- # iodepth=3 00:29:22.937 03:46:03 -- target/dif.sh@127 -- # runtime=10 00:29:22.937 03:46:03 -- target/dif.sh@128 -- # hdgst=true 00:29:22.937 03:46:03 -- target/dif.sh@128 -- # ddgst=true 00:29:22.937 03:46:03 -- target/dif.sh@130 -- # create_subsystems 0 00:29:22.937 03:46:03 -- target/dif.sh@28 -- # local sub 00:29:22.937 03:46:03 -- target/dif.sh@30 -- # for sub in "$@" 00:29:22.937 03:46:03 -- target/dif.sh@31 -- # create_subsystem 0 00:29:22.937 03:46:03 -- target/dif.sh@18 -- # local sub_id=0 00:29:22.937 03:46:03 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:29:22.937 03:46:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:22.937 03:46:03 -- common/autotest_common.sh@10 -- # set +x 00:29:22.937 bdev_null0 00:29:22.937 03:46:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:22.937 03:46:03 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:29:22.937 03:46:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:22.937 03:46:03 -- common/autotest_common.sh@10 -- # set +x 00:29:22.937 03:46:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:22.937 03:46:03 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:29:22.937 03:46:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:22.937 03:46:03 -- common/autotest_common.sh@10 -- # set +x 00:29:22.937 03:46:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:22.937 03:46:03 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:29:22.937 03:46:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:22.937 03:46:03 -- common/autotest_common.sh@10 -- # set +x 00:29:22.937 [2024-11-21 03:46:03.365734] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:22.937 03:46:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:22.937 03:46:03 -- target/dif.sh@131 -- # fio /dev/fd/62 00:29:22.937 03:46:03 -- target/dif.sh@131 -- # create_json_sub_conf 0 00:29:22.937 03:46:03 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:29:22.937 03:46:03 -- nvmf/common.sh@520 -- # config=() 00:29:22.937 03:46:03 -- nvmf/common.sh@520 -- # local subsystem config 00:29:22.937 03:46:03 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:22.937 03:46:03 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:22.937 03:46:03 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:22.937 { 00:29:22.937 "params": { 00:29:22.937 "name": "Nvme$subsystem", 00:29:22.937 "trtype": "$TEST_TRANSPORT", 00:29:22.937 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:22.937 "adrfam": "ipv4", 00:29:22.937 "trsvcid": "$NVMF_PORT", 00:29:22.938 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:22.938 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:22.938 "hdgst": ${hdgst:-false}, 00:29:22.938 "ddgst": ${ddgst:-false} 00:29:22.938 }, 00:29:22.938 "method": "bdev_nvme_attach_controller" 00:29:22.938 } 00:29:22.938 EOF 00:29:22.938 )") 00:29:22.938 03:46:03 -- target/dif.sh@82 -- # gen_fio_conf 00:29:22.938 03:46:03 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:22.938 03:46:03 -- target/dif.sh@54 -- # local file 00:29:22.938 03:46:03 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:29:22.938 03:46:03 -- target/dif.sh@56 -- # cat 00:29:22.938 03:46:03 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:29:22.938 03:46:03 -- common/autotest_common.sh@1328 -- # local sanitizers 00:29:22.938 03:46:03 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:22.938 03:46:03 -- common/autotest_common.sh@1330 -- # shift 00:29:22.938 03:46:03 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:29:22.938 03:46:03 -- nvmf/common.sh@542 -- # cat 00:29:22.938 03:46:03 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:22.938 03:46:03 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:22.938 03:46:03 -- target/dif.sh@72 -- # (( file = 1 )) 00:29:22.938 03:46:03 -- target/dif.sh@72 -- # (( file <= files )) 00:29:22.938 03:46:03 -- common/autotest_common.sh@1334 -- # grep libasan 00:29:22.938 03:46:03 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:22.938 03:46:03 -- nvmf/common.sh@544 -- # jq . 00:29:22.938 03:46:03 -- nvmf/common.sh@545 -- # IFS=, 00:29:22.938 03:46:03 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:29:22.938 "params": { 00:29:22.938 "name": "Nvme0", 00:29:22.938 "trtype": "tcp", 00:29:22.938 "traddr": "10.0.0.2", 00:29:22.938 "adrfam": "ipv4", 00:29:22.938 "trsvcid": "4420", 00:29:22.938 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:29:22.938 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:29:22.938 "hdgst": true, 00:29:22.938 "ddgst": true 00:29:22.938 }, 00:29:22.938 "method": "bdev_nvme_attach_controller" 00:29:22.938 }' 00:29:22.938 03:46:03 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:22.938 03:46:03 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:22.938 03:46:03 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:22.938 03:46:03 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:22.938 03:46:03 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:29:22.938 03:46:03 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:22.938 03:46:03 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:22.938 03:46:03 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:22.938 03:46:03 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:29:22.938 03:46:03 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:23.196 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:29:23.196 ... 00:29:23.196 fio-3.35 00:29:23.196 Starting 3 threads 00:29:23.196 EAL: No free 2048 kB hugepages reported on node 1 00:29:23.456 [2024-11-21 03:46:04.009004] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:29:23.456 [2024-11-21 03:46:04.009089] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:29:35.653 00:29:35.653 filename0: (groupid=0, jobs=1): err= 0: pid=3191214: Thu Nov 21 03:46:14 2024 00:29:35.653 read: IOPS=201, BW=25.2MiB/s (26.4MB/s)(253MiB/10046msec) 00:29:35.653 slat (nsec): min=7295, max=96550, avg=13211.41, stdev=3296.47 00:29:35.653 clat (usec): min=11453, max=55642, avg=14837.64, stdev=1636.27 00:29:35.653 lat (usec): min=11466, max=55655, avg=14850.85, stdev=1636.32 00:29:35.653 clat percentiles (usec): 00:29:35.653 | 1.00th=[12256], 5.00th=[13042], 10.00th=[13435], 20.00th=[13829], 00:29:35.653 | 30.00th=[14222], 40.00th=[14484], 50.00th=[14746], 60.00th=[15008], 00:29:35.653 | 70.00th=[15401], 80.00th=[15795], 90.00th=[16319], 95.00th=[16909], 00:29:35.653 | 99.00th=[17957], 99.50th=[17957], 99.90th=[19268], 99.95th=[46924], 00:29:35.653 | 99.99th=[55837] 00:29:35.653 bw ( KiB/s): min=24576, max=27904, per=32.84%, avg=25894.40, stdev=1007.96, samples=20 00:29:35.653 iops : min= 192, max= 218, avg=202.30, stdev= 7.87, samples=20 00:29:35.653 lat (msec) : 20=99.90%, 50=0.05%, 100=0.05% 00:29:35.653 cpu : usr=93.19%, sys=6.32%, ctx=32, majf=0, minf=204 00:29:35.653 IO depths : 1=0.2%, 2=99.8%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:35.654 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:35.654 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:35.654 issued rwts: total=2026,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:35.654 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:35.654 filename0: (groupid=0, jobs=1): err= 0: pid=3191215: Thu Nov 21 03:46:14 2024 00:29:35.654 read: IOPS=203, BW=25.5MiB/s (26.7MB/s)(256MiB/10048msec) 00:29:35.654 slat (nsec): min=7475, max=89959, avg=13183.91, stdev=3220.07 00:29:35.654 clat (usec): min=11114, max=51817, avg=14680.81, stdev=1573.39 00:29:35.654 lat (usec): min=11127, max=51830, avg=14693.99, stdev=1573.33 00:29:35.654 clat percentiles (usec): 00:29:35.654 | 1.00th=[12125], 5.00th=[12911], 10.00th=[13304], 20.00th=[13829], 00:29:35.654 | 30.00th=[14091], 40.00th=[14353], 50.00th=[14615], 60.00th=[14877], 00:29:35.654 | 70.00th=[15139], 80.00th=[15533], 90.00th=[16057], 95.00th=[16581], 00:29:35.654 | 99.00th=[17433], 99.50th=[17957], 99.90th=[19268], 99.95th=[49546], 00:29:35.654 | 99.99th=[51643] 00:29:35.654 bw ( KiB/s): min=25088, max=27648, per=33.20%, avg=26178.50, stdev=761.52, samples=20 00:29:35.654 iops : min= 196, max= 216, avg=204.50, stdev= 5.98, samples=20 00:29:35.654 lat (msec) : 20=99.90%, 50=0.05%, 100=0.05% 00:29:35.654 cpu : usr=92.42%, sys=7.09%, ctx=25, majf=0, minf=241 00:29:35.654 IO depths : 1=0.3%, 2=99.7%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:35.654 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:35.654 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:35.654 issued rwts: total=2048,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:35.654 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:35.654 filename0: (groupid=0, jobs=1): err= 0: pid=3191216: Thu Nov 21 03:46:14 2024 00:29:35.654 read: IOPS=211, BW=26.4MiB/s (27.7MB/s)(264MiB/10007msec) 00:29:35.654 slat (nsec): min=7432, max=55889, avg=13422.59, stdev=4171.21 00:29:35.654 clat (usec): min=10488, max=25177, avg=14176.45, stdev=1175.27 00:29:35.654 lat (usec): min=10500, max=25217, avg=14189.87, stdev=1175.44 00:29:35.654 clat percentiles (usec): 00:29:35.654 | 1.00th=[11600], 5.00th=[12256], 10.00th=[12780], 20.00th=[13304], 00:29:35.654 | 30.00th=[13566], 40.00th=[13829], 50.00th=[14091], 60.00th=[14484], 00:29:35.654 | 70.00th=[14746], 80.00th=[15008], 90.00th=[15533], 95.00th=[16057], 00:29:35.654 | 99.00th=[17171], 99.50th=[17695], 99.90th=[20579], 99.95th=[20579], 00:29:35.654 | 99.99th=[25297] 00:29:35.654 bw ( KiB/s): min=25344, max=28672, per=34.29%, avg=27033.60, stdev=937.48, samples=20 00:29:35.654 iops : min= 198, max= 224, avg=211.20, stdev= 7.32, samples=20 00:29:35.654 lat (msec) : 20=99.86%, 50=0.14% 00:29:35.654 cpu : usr=92.12%, sys=7.29%, ctx=46, majf=0, minf=117 00:29:35.654 IO depths : 1=0.1%, 2=99.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:35.654 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:35.654 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:35.654 issued rwts: total=2115,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:35.654 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:35.654 00:29:35.654 Run status group 0 (all jobs): 00:29:35.654 READ: bw=77.0MiB/s (80.7MB/s), 25.2MiB/s-26.4MiB/s (26.4MB/s-27.7MB/s), io=774MiB (811MB), run=10007-10048msec 00:29:35.654 03:46:14 -- target/dif.sh@132 -- # destroy_subsystems 0 00:29:35.654 03:46:14 -- target/dif.sh@43 -- # local sub 00:29:35.654 03:46:14 -- target/dif.sh@45 -- # for sub in "$@" 00:29:35.654 03:46:14 -- target/dif.sh@46 -- # destroy_subsystem 0 00:29:35.654 03:46:14 -- target/dif.sh@36 -- # local sub_id=0 00:29:35.654 03:46:14 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:29:35.654 03:46:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:35.654 03:46:14 -- common/autotest_common.sh@10 -- # set +x 00:29:35.654 03:46:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:35.654 03:46:14 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:29:35.654 03:46:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:35.654 03:46:14 -- common/autotest_common.sh@10 -- # set +x 00:29:35.654 03:46:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:35.654 00:29:35.654 real 0m11.078s 00:29:35.654 user 0m29.010s 00:29:35.654 sys 0m2.361s 00:29:35.654 03:46:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:35.654 03:46:14 -- common/autotest_common.sh@10 -- # set +x 00:29:35.654 ************************************ 00:29:35.654 END TEST fio_dif_digest 00:29:35.654 ************************************ 00:29:35.654 03:46:14 -- target/dif.sh@146 -- # trap - SIGINT SIGTERM EXIT 00:29:35.654 03:46:14 -- target/dif.sh@147 -- # nvmftestfini 00:29:35.654 03:46:14 -- nvmf/common.sh@476 -- # nvmfcleanup 00:29:35.654 03:46:14 -- nvmf/common.sh@116 -- # sync 00:29:35.654 03:46:14 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:29:35.654 03:46:14 -- nvmf/common.sh@119 -- # set +e 00:29:35.654 03:46:14 -- nvmf/common.sh@120 -- # for i in {1..20} 00:29:35.654 03:46:14 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:29:35.654 rmmod nvme_tcp 00:29:35.654 rmmod nvme_fabrics 00:29:35.654 rmmod nvme_keyring 00:29:35.654 03:46:14 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:29:35.654 03:46:14 -- nvmf/common.sh@123 -- # set -e 00:29:35.654 03:46:14 -- nvmf/common.sh@124 -- # return 0 00:29:35.654 03:46:14 -- nvmf/common.sh@477 -- # '[' -n 3184852 ']' 00:29:35.654 03:46:14 -- nvmf/common.sh@478 -- # killprocess 3184852 00:29:35.654 03:46:14 -- common/autotest_common.sh@936 -- # '[' -z 3184852 ']' 00:29:35.654 03:46:14 -- common/autotest_common.sh@940 -- # kill -0 3184852 00:29:35.654 03:46:14 -- common/autotest_common.sh@941 -- # uname 00:29:35.654 03:46:14 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:35.654 03:46:14 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3184852 00:29:35.654 03:46:14 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:29:35.654 03:46:14 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:29:35.654 03:46:14 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3184852' 00:29:35.654 killing process with pid 3184852 00:29:35.654 03:46:14 -- common/autotest_common.sh@955 -- # kill 3184852 00:29:35.654 03:46:14 -- common/autotest_common.sh@960 -- # wait 3184852 00:29:35.654 03:46:14 -- nvmf/common.sh@480 -- # '[' iso == iso ']' 00:29:35.654 03:46:14 -- nvmf/common.sh@481 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:29:35.654 Waiting for block devices as requested 00:29:35.654 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:29:35.654 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:29:35.654 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:29:35.654 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:29:35.654 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:29:35.913 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:29:35.913 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:29:35.913 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:29:35.913 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:29:36.171 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:29:36.171 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:29:36.171 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:29:36.171 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:29:36.171 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:29:36.429 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:29:36.429 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:29:36.429 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:29:36.687 03:46:17 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:29:36.687 03:46:17 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:29:36.687 03:46:17 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:29:36.687 03:46:17 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:29:36.687 03:46:17 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:36.687 03:46:17 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:29:36.687 03:46:17 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:38.588 03:46:19 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:29:38.588 00:29:38.588 real 1m7.314s 00:29:38.588 user 6m33.838s 00:29:38.588 sys 0m16.236s 00:29:38.588 03:46:19 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:38.588 03:46:19 -- common/autotest_common.sh@10 -- # set +x 00:29:38.588 ************************************ 00:29:38.588 END TEST nvmf_dif 00:29:38.588 ************************************ 00:29:38.588 03:46:19 -- spdk/autotest.sh@288 -- # run_test nvmf_abort_qd_sizes /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:29:38.588 03:46:19 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:38.588 03:46:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:38.588 03:46:19 -- common/autotest_common.sh@10 -- # set +x 00:29:38.588 ************************************ 00:29:38.588 START TEST nvmf_abort_qd_sizes 00:29:38.588 ************************************ 00:29:38.588 03:46:19 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:29:38.588 * Looking for test storage... 00:29:38.588 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:29:38.588 03:46:19 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:29:38.588 03:46:19 -- common/autotest_common.sh@1690 -- # lcov --version 00:29:38.588 03:46:19 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:29:38.846 03:46:19 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:29:38.846 03:46:19 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:29:38.846 03:46:19 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:29:38.846 03:46:19 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:29:38.846 03:46:19 -- scripts/common.sh@335 -- # IFS=.-: 00:29:38.846 03:46:19 -- scripts/common.sh@335 -- # read -ra ver1 00:29:38.846 03:46:19 -- scripts/common.sh@336 -- # IFS=.-: 00:29:38.846 03:46:19 -- scripts/common.sh@336 -- # read -ra ver2 00:29:38.846 03:46:19 -- scripts/common.sh@337 -- # local 'op=<' 00:29:38.846 03:46:19 -- scripts/common.sh@339 -- # ver1_l=2 00:29:38.846 03:46:19 -- scripts/common.sh@340 -- # ver2_l=1 00:29:38.846 03:46:19 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:29:38.846 03:46:19 -- scripts/common.sh@343 -- # case "$op" in 00:29:38.846 03:46:19 -- scripts/common.sh@344 -- # : 1 00:29:38.846 03:46:19 -- scripts/common.sh@363 -- # (( v = 0 )) 00:29:38.846 03:46:19 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:29:38.846 03:46:19 -- scripts/common.sh@364 -- # decimal 1 00:29:38.846 03:46:19 -- scripts/common.sh@352 -- # local d=1 00:29:38.846 03:46:19 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:29:38.846 03:46:19 -- scripts/common.sh@354 -- # echo 1 00:29:38.846 03:46:19 -- scripts/common.sh@364 -- # ver1[v]=1 00:29:38.846 03:46:19 -- scripts/common.sh@365 -- # decimal 2 00:29:38.846 03:46:19 -- scripts/common.sh@352 -- # local d=2 00:29:38.846 03:46:19 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:29:38.846 03:46:19 -- scripts/common.sh@354 -- # echo 2 00:29:38.846 03:46:19 -- scripts/common.sh@365 -- # ver2[v]=2 00:29:38.846 03:46:19 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:29:38.846 03:46:19 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:29:38.846 03:46:19 -- scripts/common.sh@367 -- # return 0 00:29:38.846 03:46:19 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:29:38.846 03:46:19 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:29:38.846 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:38.846 --rc genhtml_branch_coverage=1 00:29:38.846 --rc genhtml_function_coverage=1 00:29:38.846 --rc genhtml_legend=1 00:29:38.846 --rc geninfo_all_blocks=1 00:29:38.846 --rc geninfo_unexecuted_blocks=1 00:29:38.846 00:29:38.846 ' 00:29:38.846 03:46:19 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:29:38.846 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:38.846 --rc genhtml_branch_coverage=1 00:29:38.846 --rc genhtml_function_coverage=1 00:29:38.846 --rc genhtml_legend=1 00:29:38.846 --rc geninfo_all_blocks=1 00:29:38.846 --rc geninfo_unexecuted_blocks=1 00:29:38.846 00:29:38.846 ' 00:29:38.846 03:46:19 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:29:38.846 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:38.846 --rc genhtml_branch_coverage=1 00:29:38.846 --rc genhtml_function_coverage=1 00:29:38.846 --rc genhtml_legend=1 00:29:38.846 --rc geninfo_all_blocks=1 00:29:38.846 --rc geninfo_unexecuted_blocks=1 00:29:38.846 00:29:38.846 ' 00:29:38.846 03:46:19 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:29:38.846 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:38.846 --rc genhtml_branch_coverage=1 00:29:38.846 --rc genhtml_function_coverage=1 00:29:38.846 --rc genhtml_legend=1 00:29:38.846 --rc geninfo_all_blocks=1 00:29:38.846 --rc geninfo_unexecuted_blocks=1 00:29:38.846 00:29:38.846 ' 00:29:38.846 03:46:19 -- target/abort_qd_sizes.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:29:38.846 03:46:19 -- nvmf/common.sh@7 -- # uname -s 00:29:38.846 03:46:19 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:29:38.846 03:46:19 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:29:38.846 03:46:19 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:29:38.846 03:46:19 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:29:38.846 03:46:19 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:29:38.846 03:46:19 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:29:38.846 03:46:19 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:29:38.846 03:46:19 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:29:38.846 03:46:19 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:29:38.846 03:46:19 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:29:38.846 03:46:19 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:29:38.846 03:46:19 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:29:38.846 03:46:19 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:29:38.846 03:46:19 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:29:38.846 03:46:19 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:29:38.846 03:46:19 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:29:38.846 03:46:19 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:29:38.846 03:46:19 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:29:38.846 03:46:19 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:29:38.847 03:46:19 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:38.847 03:46:19 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:38.847 03:46:19 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:38.847 03:46:19 -- paths/export.sh@5 -- # export PATH 00:29:38.847 03:46:19 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:38.847 03:46:19 -- nvmf/common.sh@46 -- # : 0 00:29:38.847 03:46:19 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:29:38.847 03:46:19 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:29:38.847 03:46:19 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:29:38.847 03:46:19 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:29:38.847 03:46:19 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:29:38.847 03:46:19 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:29:38.847 03:46:19 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:29:38.847 03:46:19 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:29:38.847 03:46:19 -- target/abort_qd_sizes.sh@73 -- # nvmftestinit 00:29:38.847 03:46:19 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:29:38.847 03:46:19 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:29:38.847 03:46:19 -- nvmf/common.sh@436 -- # prepare_net_devs 00:29:38.847 03:46:19 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:29:38.847 03:46:19 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:29:38.847 03:46:19 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:38.847 03:46:19 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:29:38.847 03:46:19 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:38.847 03:46:19 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:29:38.847 03:46:19 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:29:38.847 03:46:19 -- nvmf/common.sh@284 -- # xtrace_disable 00:29:38.847 03:46:19 -- common/autotest_common.sh@10 -- # set +x 00:29:40.748 03:46:21 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:29:40.748 03:46:21 -- nvmf/common.sh@290 -- # pci_devs=() 00:29:40.748 03:46:21 -- nvmf/common.sh@290 -- # local -a pci_devs 00:29:40.748 03:46:21 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:29:40.748 03:46:21 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:29:40.748 03:46:21 -- nvmf/common.sh@292 -- # pci_drivers=() 00:29:40.748 03:46:21 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:29:40.748 03:46:21 -- nvmf/common.sh@294 -- # net_devs=() 00:29:40.748 03:46:21 -- nvmf/common.sh@294 -- # local -ga net_devs 00:29:40.748 03:46:21 -- nvmf/common.sh@295 -- # e810=() 00:29:40.748 03:46:21 -- nvmf/common.sh@295 -- # local -ga e810 00:29:40.748 03:46:21 -- nvmf/common.sh@296 -- # x722=() 00:29:40.748 03:46:21 -- nvmf/common.sh@296 -- # local -ga x722 00:29:40.748 03:46:21 -- nvmf/common.sh@297 -- # mlx=() 00:29:40.748 03:46:21 -- nvmf/common.sh@297 -- # local -ga mlx 00:29:40.748 03:46:21 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:29:40.748 03:46:21 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:29:40.748 03:46:21 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:29:40.748 03:46:21 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:29:40.748 03:46:21 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:29:40.748 03:46:21 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:29:40.748 03:46:21 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:29:40.748 03:46:21 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:29:40.748 03:46:21 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:29:40.748 03:46:21 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:29:40.748 03:46:21 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:29:40.748 03:46:21 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:29:40.748 03:46:21 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:29:40.748 03:46:21 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:29:40.748 03:46:21 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:29:40.748 03:46:21 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:29:40.748 03:46:21 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:29:40.748 03:46:21 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:40.748 03:46:21 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:29:40.748 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:29:40.748 03:46:21 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:40.748 03:46:21 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:40.748 03:46:21 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:40.748 03:46:21 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:40.748 03:46:21 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:40.748 03:46:21 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:40.748 03:46:21 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:29:40.748 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:29:40.748 03:46:21 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:40.748 03:46:21 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:40.748 03:46:21 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:40.748 03:46:21 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:40.748 03:46:21 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:40.748 03:46:21 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:29:40.748 03:46:21 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:29:40.748 03:46:21 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:29:40.748 03:46:21 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:40.748 03:46:21 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:40.748 03:46:21 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:40.748 03:46:21 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:40.748 03:46:21 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:29:40.748 Found net devices under 0000:0a:00.0: cvl_0_0 00:29:40.748 03:46:21 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:40.748 03:46:21 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:40.748 03:46:21 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:40.748 03:46:21 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:40.748 03:46:21 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:40.748 03:46:21 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:29:40.748 Found net devices under 0000:0a:00.1: cvl_0_1 00:29:40.748 03:46:21 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:40.748 03:46:21 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:29:40.748 03:46:21 -- nvmf/common.sh@402 -- # is_hw=yes 00:29:40.748 03:46:21 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:29:40.748 03:46:21 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:29:40.748 03:46:21 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:29:40.748 03:46:21 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:29:40.748 03:46:21 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:29:40.748 03:46:21 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:29:40.748 03:46:21 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:29:40.748 03:46:21 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:29:40.748 03:46:21 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:29:40.748 03:46:21 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:29:40.748 03:46:21 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:29:40.748 03:46:21 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:29:40.748 03:46:21 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:29:40.748 03:46:21 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:29:40.748 03:46:21 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:29:40.748 03:46:21 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:29:40.748 03:46:21 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:29:40.748 03:46:21 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:29:40.748 03:46:21 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:29:40.749 03:46:21 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:29:40.749 03:46:21 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:29:40.749 03:46:21 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:29:40.749 03:46:21 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:29:40.749 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:29:40.749 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.205 ms 00:29:40.749 00:29:40.749 --- 10.0.0.2 ping statistics --- 00:29:40.749 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:40.749 rtt min/avg/max/mdev = 0.205/0.205/0.205/0.000 ms 00:29:40.749 03:46:21 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:29:40.749 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:29:40.749 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.074 ms 00:29:40.749 00:29:40.749 --- 10.0.0.1 ping statistics --- 00:29:40.749 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:40.749 rtt min/avg/max/mdev = 0.074/0.074/0.074/0.000 ms 00:29:40.749 03:46:21 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:29:40.749 03:46:21 -- nvmf/common.sh@410 -- # return 0 00:29:40.749 03:46:21 -- nvmf/common.sh@438 -- # '[' iso == iso ']' 00:29:40.749 03:46:21 -- nvmf/common.sh@439 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:29:42.124 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:29:42.124 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:29:42.124 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:29:42.124 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:29:42.124 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:29:42.124 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:29:42.124 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:29:42.124 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:29:42.124 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:29:42.124 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:29:42.124 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:29:42.124 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:29:42.124 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:29:42.124 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:29:42.124 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:29:42.124 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:29:43.058 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:29:43.316 03:46:23 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:29:43.316 03:46:23 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:29:43.316 03:46:23 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:29:43.316 03:46:23 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:29:43.316 03:46:23 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:29:43.316 03:46:23 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:29:43.316 03:46:23 -- target/abort_qd_sizes.sh@74 -- # nvmfappstart -m 0xf 00:29:43.316 03:46:23 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:29:43.316 03:46:23 -- common/autotest_common.sh@722 -- # xtrace_disable 00:29:43.316 03:46:23 -- common/autotest_common.sh@10 -- # set +x 00:29:43.316 03:46:23 -- nvmf/common.sh@469 -- # nvmfpid=3196230 00:29:43.316 03:46:23 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xf 00:29:43.316 03:46:23 -- nvmf/common.sh@470 -- # waitforlisten 3196230 00:29:43.316 03:46:23 -- common/autotest_common.sh@829 -- # '[' -z 3196230 ']' 00:29:43.316 03:46:23 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:43.316 03:46:23 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:43.316 03:46:23 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:43.316 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:43.316 03:46:23 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:43.316 03:46:23 -- common/autotest_common.sh@10 -- # set +x 00:29:43.316 [2024-11-21 03:46:23.822869] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:43.316 [2024-11-21 03:46:23.822930] [ DPDK EAL parameters: nvmf -c 0xf --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:43.316 EAL: No free 2048 kB hugepages reported on node 1 00:29:43.316 [2024-11-21 03:46:23.888216] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:29:43.575 [2024-11-21 03:46:24.000007] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:43.575 [2024-11-21 03:46:24.000179] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:43.575 [2024-11-21 03:46:24.000198] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:43.575 [2024-11-21 03:46:24.000210] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:43.575 [2024-11-21 03:46:24.000262] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:43.575 [2024-11-21 03:46:24.000320] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:29:43.575 [2024-11-21 03:46:24.000388] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:29:43.575 [2024-11-21 03:46:24.000391] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:44.507 03:46:24 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:44.507 03:46:24 -- common/autotest_common.sh@862 -- # return 0 00:29:44.507 03:46:24 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:29:44.507 03:46:24 -- common/autotest_common.sh@728 -- # xtrace_disable 00:29:44.507 03:46:24 -- common/autotest_common.sh@10 -- # set +x 00:29:44.507 03:46:24 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:44.507 03:46:24 -- target/abort_qd_sizes.sh@76 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini || :; clean_kernel_target' SIGINT SIGTERM EXIT 00:29:44.507 03:46:24 -- target/abort_qd_sizes.sh@78 -- # mapfile -t nvmes 00:29:44.507 03:46:24 -- target/abort_qd_sizes.sh@78 -- # nvme_in_userspace 00:29:44.507 03:46:24 -- scripts/common.sh@311 -- # local bdf bdfs 00:29:44.507 03:46:24 -- scripts/common.sh@312 -- # local nvmes 00:29:44.507 03:46:24 -- scripts/common.sh@314 -- # [[ -n 0000:88:00.0 ]] 00:29:44.507 03:46:24 -- scripts/common.sh@315 -- # nvmes=(${pci_bus_cache["0x010802"]}) 00:29:44.507 03:46:24 -- scripts/common.sh@320 -- # for bdf in "${nvmes[@]}" 00:29:44.507 03:46:24 -- scripts/common.sh@321 -- # [[ -e /sys/bus/pci/drivers/nvme/0000:88:00.0 ]] 00:29:44.507 03:46:24 -- scripts/common.sh@322 -- # uname -s 00:29:44.507 03:46:24 -- scripts/common.sh@322 -- # [[ Linux == FreeBSD ]] 00:29:44.507 03:46:24 -- scripts/common.sh@325 -- # bdfs+=("$bdf") 00:29:44.507 03:46:24 -- scripts/common.sh@327 -- # (( 1 )) 00:29:44.507 03:46:24 -- scripts/common.sh@328 -- # printf '%s\n' 0000:88:00.0 00:29:44.507 03:46:24 -- target/abort_qd_sizes.sh@79 -- # (( 1 > 0 )) 00:29:44.507 03:46:24 -- target/abort_qd_sizes.sh@81 -- # nvme=0000:88:00.0 00:29:44.507 03:46:24 -- target/abort_qd_sizes.sh@83 -- # run_test spdk_target_abort spdk_target 00:29:44.507 03:46:24 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:44.507 03:46:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:44.507 03:46:24 -- common/autotest_common.sh@10 -- # set +x 00:29:44.507 ************************************ 00:29:44.507 START TEST spdk_target_abort 00:29:44.507 ************************************ 00:29:44.507 03:46:24 -- common/autotest_common.sh@1114 -- # spdk_target 00:29:44.507 03:46:24 -- target/abort_qd_sizes.sh@43 -- # local name=spdk_target 00:29:44.507 03:46:24 -- target/abort_qd_sizes.sh@44 -- # local subnqn=nqn.2016-06.io.spdk:spdk_target 00:29:44.507 03:46:24 -- target/abort_qd_sizes.sh@46 -- # rpc_cmd bdev_nvme_attach_controller -t pcie -a 0000:88:00.0 -b spdk_target 00:29:44.507 03:46:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:44.507 03:46:24 -- common/autotest_common.sh@10 -- # set +x 00:29:47.788 spdk_targetn1 00:29:47.788 03:46:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:47.788 03:46:27 -- target/abort_qd_sizes.sh@48 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:29:47.788 03:46:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:47.788 03:46:27 -- common/autotest_common.sh@10 -- # set +x 00:29:47.788 [2024-11-21 03:46:27.685030] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:47.788 03:46:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:47.788 03:46:27 -- target/abort_qd_sizes.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:spdk_target -a -s SPDKISFASTANDAWESOME 00:29:47.788 03:46:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:47.788 03:46:27 -- common/autotest_common.sh@10 -- # set +x 00:29:47.788 03:46:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:47.788 03:46:27 -- target/abort_qd_sizes.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:spdk_target spdk_targetn1 00:29:47.788 03:46:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:47.788 03:46:27 -- common/autotest_common.sh@10 -- # set +x 00:29:47.788 03:46:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:47.788 03:46:27 -- target/abort_qd_sizes.sh@51 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:spdk_target -t tcp -a 10.0.0.2 -s 4420 00:29:47.788 03:46:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:47.788 03:46:27 -- common/autotest_common.sh@10 -- # set +x 00:29:47.788 [2024-11-21 03:46:27.717395] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:47.788 03:46:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:47.788 03:46:27 -- target/abort_qd_sizes.sh@53 -- # rabort tcp IPv4 10.0.0.2 4420 nqn.2016-06.io.spdk:spdk_target 00:29:47.788 03:46:27 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:29:47.788 03:46:27 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:29:47.788 03:46:27 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.2 00:29:47.788 03:46:27 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:29:47.788 03:46:27 -- target/abort_qd_sizes.sh@21 -- # local subnqn=nqn.2016-06.io.spdk:spdk_target 00:29:47.788 03:46:27 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:29:47.788 03:46:27 -- target/abort_qd_sizes.sh@24 -- # local target r 00:29:47.788 03:46:27 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:29:47.788 03:46:27 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:47.788 03:46:27 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:29:47.788 03:46:27 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:47.788 03:46:27 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:29:47.788 03:46:27 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:47.788 03:46:27 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2' 00:29:47.788 03:46:27 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:47.788 03:46:27 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:29:47.788 03:46:27 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:47.788 03:46:27 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:29:47.788 03:46:27 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:29:47.788 03:46:27 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:29:47.788 EAL: No free 2048 kB hugepages reported on node 1 00:29:51.080 Initializing NVMe Controllers 00:29:51.080 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:29:51.080 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:29:51.080 Initialization complete. Launching workers. 00:29:51.080 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 11508, failed: 0 00:29:51.080 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 1240, failed to submit 10268 00:29:51.080 success 728, unsuccess 512, failed 0 00:29:51.080 03:46:31 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:29:51.080 03:46:31 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:29:51.080 EAL: No free 2048 kB hugepages reported on node 1 00:29:54.357 Initializing NVMe Controllers 00:29:54.357 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:29:54.357 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:29:54.357 Initialization complete. Launching workers. 00:29:54.357 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 8742, failed: 0 00:29:54.357 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 1234, failed to submit 7508 00:29:54.357 success 315, unsuccess 919, failed 0 00:29:54.357 03:46:34 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:29:54.357 03:46:34 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:29:54.357 EAL: No free 2048 kB hugepages reported on node 1 00:29:57.637 Initializing NVMe Controllers 00:29:57.637 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:29:57.637 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:29:57.637 Initialization complete. Launching workers. 00:29:57.637 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 31312, failed: 0 00:29:57.637 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 2620, failed to submit 28692 00:29:57.637 success 537, unsuccess 2083, failed 0 00:29:57.637 03:46:37 -- target/abort_qd_sizes.sh@55 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:spdk_target 00:29:57.637 03:46:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:57.637 03:46:37 -- common/autotest_common.sh@10 -- # set +x 00:29:57.637 03:46:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:57.637 03:46:37 -- target/abort_qd_sizes.sh@56 -- # rpc_cmd bdev_nvme_detach_controller spdk_target 00:29:57.637 03:46:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:57.637 03:46:37 -- common/autotest_common.sh@10 -- # set +x 00:29:58.571 03:46:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:58.571 03:46:38 -- target/abort_qd_sizes.sh@62 -- # killprocess 3196230 00:29:58.571 03:46:38 -- common/autotest_common.sh@936 -- # '[' -z 3196230 ']' 00:29:58.571 03:46:38 -- common/autotest_common.sh@940 -- # kill -0 3196230 00:29:58.571 03:46:38 -- common/autotest_common.sh@941 -- # uname 00:29:58.571 03:46:38 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:58.571 03:46:38 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 3196230 00:29:58.571 03:46:38 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:29:58.571 03:46:38 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:29:58.571 03:46:38 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 3196230' 00:29:58.571 killing process with pid 3196230 00:29:58.571 03:46:38 -- common/autotest_common.sh@955 -- # kill 3196230 00:29:58.571 03:46:38 -- common/autotest_common.sh@960 -- # wait 3196230 00:29:58.828 00:29:58.828 real 0m14.387s 00:29:58.828 user 0m56.703s 00:29:58.828 sys 0m2.788s 00:29:58.828 03:46:39 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:58.828 03:46:39 -- common/autotest_common.sh@10 -- # set +x 00:29:58.828 ************************************ 00:29:58.828 END TEST spdk_target_abort 00:29:58.828 ************************************ 00:29:58.828 03:46:39 -- target/abort_qd_sizes.sh@84 -- # run_test kernel_target_abort kernel_target 00:29:58.828 03:46:39 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:58.828 03:46:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:58.828 03:46:39 -- common/autotest_common.sh@10 -- # set +x 00:29:58.828 ************************************ 00:29:58.828 START TEST kernel_target_abort 00:29:58.828 ************************************ 00:29:58.828 03:46:39 -- common/autotest_common.sh@1114 -- # kernel_target 00:29:58.828 03:46:39 -- target/abort_qd_sizes.sh@66 -- # local name=kernel_target 00:29:58.828 03:46:39 -- target/abort_qd_sizes.sh@68 -- # configure_kernel_target kernel_target 00:29:58.828 03:46:39 -- nvmf/common.sh@621 -- # kernel_name=kernel_target 00:29:58.828 03:46:39 -- nvmf/common.sh@622 -- # nvmet=/sys/kernel/config/nvmet 00:29:58.828 03:46:39 -- nvmf/common.sh@623 -- # kernel_subsystem=/sys/kernel/config/nvmet/subsystems/kernel_target 00:29:58.828 03:46:39 -- nvmf/common.sh@624 -- # kernel_namespace=/sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:29:58.828 03:46:39 -- nvmf/common.sh@625 -- # kernel_port=/sys/kernel/config/nvmet/ports/1 00:29:58.828 03:46:39 -- nvmf/common.sh@627 -- # local block nvme 00:29:58.828 03:46:39 -- nvmf/common.sh@629 -- # [[ ! -e /sys/module/nvmet ]] 00:29:58.828 03:46:39 -- nvmf/common.sh@630 -- # modprobe nvmet 00:29:58.828 03:46:39 -- nvmf/common.sh@633 -- # [[ -e /sys/kernel/config/nvmet ]] 00:29:58.828 03:46:39 -- nvmf/common.sh@635 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:29:59.762 Waiting for block devices as requested 00:29:59.762 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:30:00.020 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:30:00.020 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:30:00.278 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:30:00.278 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:30:00.278 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:30:00.278 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:30:00.539 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:30:00.539 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:30:00.539 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:30:00.539 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:30:00.831 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:30:00.831 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:30:00.831 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:30:00.831 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:30:01.110 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:30:01.110 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:30:01.110 03:46:41 -- nvmf/common.sh@638 -- # for block in /sys/block/nvme* 00:30:01.110 03:46:41 -- nvmf/common.sh@639 -- # [[ -e /sys/block/nvme0n1 ]] 00:30:01.110 03:46:41 -- nvmf/common.sh@640 -- # block_in_use nvme0n1 00:30:01.110 03:46:41 -- scripts/common.sh@380 -- # local block=nvme0n1 pt 00:30:01.110 03:46:41 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:30:01.110 No valid GPT data, bailing 00:30:01.372 03:46:41 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:30:01.372 03:46:41 -- scripts/common.sh@393 -- # pt= 00:30:01.372 03:46:41 -- scripts/common.sh@394 -- # return 1 00:30:01.372 03:46:41 -- nvmf/common.sh@640 -- # nvme=/dev/nvme0n1 00:30:01.372 03:46:41 -- nvmf/common.sh@643 -- # [[ -b /dev/nvme0n1 ]] 00:30:01.372 03:46:41 -- nvmf/common.sh@645 -- # mkdir /sys/kernel/config/nvmet/subsystems/kernel_target 00:30:01.372 03:46:41 -- nvmf/common.sh@646 -- # mkdir /sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:30:01.372 03:46:41 -- nvmf/common.sh@647 -- # mkdir /sys/kernel/config/nvmet/ports/1 00:30:01.372 03:46:41 -- nvmf/common.sh@652 -- # echo SPDK-kernel_target 00:30:01.372 03:46:41 -- nvmf/common.sh@654 -- # echo 1 00:30:01.372 03:46:41 -- nvmf/common.sh@655 -- # echo /dev/nvme0n1 00:30:01.372 03:46:41 -- nvmf/common.sh@656 -- # echo 1 00:30:01.372 03:46:41 -- nvmf/common.sh@662 -- # echo 10.0.0.1 00:30:01.372 03:46:41 -- nvmf/common.sh@663 -- # echo tcp 00:30:01.372 03:46:41 -- nvmf/common.sh@664 -- # echo 4420 00:30:01.372 03:46:41 -- nvmf/common.sh@665 -- # echo ipv4 00:30:01.372 03:46:41 -- nvmf/common.sh@668 -- # ln -s /sys/kernel/config/nvmet/subsystems/kernel_target /sys/kernel/config/nvmet/ports/1/subsystems/ 00:30:01.372 03:46:41 -- nvmf/common.sh@671 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.1 -t tcp -s 4420 00:30:01.372 00:30:01.372 Discovery Log Number of Records 2, Generation counter 2 00:30:01.372 =====Discovery Log Entry 0====== 00:30:01.372 trtype: tcp 00:30:01.372 adrfam: ipv4 00:30:01.372 subtype: current discovery subsystem 00:30:01.372 treq: not specified, sq flow control disable supported 00:30:01.372 portid: 1 00:30:01.372 trsvcid: 4420 00:30:01.372 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:30:01.372 traddr: 10.0.0.1 00:30:01.372 eflags: none 00:30:01.372 sectype: none 00:30:01.372 =====Discovery Log Entry 1====== 00:30:01.372 trtype: tcp 00:30:01.372 adrfam: ipv4 00:30:01.372 subtype: nvme subsystem 00:30:01.372 treq: not specified, sq flow control disable supported 00:30:01.372 portid: 1 00:30:01.372 trsvcid: 4420 00:30:01.372 subnqn: kernel_target 00:30:01.372 traddr: 10.0.0.1 00:30:01.372 eflags: none 00:30:01.372 sectype: none 00:30:01.372 03:46:41 -- target/abort_qd_sizes.sh@69 -- # rabort tcp IPv4 10.0.0.1 4420 kernel_target 00:30:01.372 03:46:41 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:30:01.372 03:46:41 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:30:01.372 03:46:41 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.1 00:30:01.372 03:46:41 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:30:01.372 03:46:41 -- target/abort_qd_sizes.sh@21 -- # local subnqn=kernel_target 00:30:01.372 03:46:41 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:30:01.372 03:46:41 -- target/abort_qd_sizes.sh@24 -- # local target r 00:30:01.372 03:46:41 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:30:01.372 03:46:41 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:01.372 03:46:41 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:30:01.372 03:46:41 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:01.372 03:46:41 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:30:01.372 03:46:41 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:01.372 03:46:41 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1' 00:30:01.372 03:46:41 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:01.372 03:46:41 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420' 00:30:01.372 03:46:41 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:01.372 03:46:41 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:30:01.372 03:46:41 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:30:01.372 03:46:41 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:30:01.372 EAL: No free 2048 kB hugepages reported on node 1 00:30:04.651 Initializing NVMe Controllers 00:30:04.651 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:30:04.651 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:30:04.651 Initialization complete. Launching workers. 00:30:04.651 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 39368, failed: 0 00:30:04.651 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 39368, failed to submit 0 00:30:04.651 success 0, unsuccess 39368, failed 0 00:30:04.651 03:46:44 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:30:04.651 03:46:44 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:30:04.651 EAL: No free 2048 kB hugepages reported on node 1 00:30:07.931 Initializing NVMe Controllers 00:30:07.931 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:30:07.931 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:30:07.931 Initialization complete. Launching workers. 00:30:07.931 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 73811, failed: 0 00:30:07.931 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 18618, failed to submit 55193 00:30:07.931 success 0, unsuccess 18618, failed 0 00:30:07.931 03:46:48 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:30:07.931 03:46:48 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:30:07.931 EAL: No free 2048 kB hugepages reported on node 1 00:30:11.210 Initializing NVMe Controllers 00:30:11.210 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:30:11.210 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:30:11.210 Initialization complete. Launching workers. 00:30:11.210 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 72048, failed: 0 00:30:11.210 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 17990, failed to submit 54058 00:30:11.210 success 0, unsuccess 17990, failed 0 00:30:11.210 03:46:51 -- target/abort_qd_sizes.sh@70 -- # clean_kernel_target 00:30:11.210 03:46:51 -- nvmf/common.sh@675 -- # [[ -e /sys/kernel/config/nvmet/subsystems/kernel_target ]] 00:30:11.210 03:46:51 -- nvmf/common.sh@677 -- # echo 0 00:30:11.210 03:46:51 -- nvmf/common.sh@679 -- # rm -f /sys/kernel/config/nvmet/ports/1/subsystems/kernel_target 00:30:11.210 03:46:51 -- nvmf/common.sh@680 -- # rmdir /sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:30:11.210 03:46:51 -- nvmf/common.sh@681 -- # rmdir /sys/kernel/config/nvmet/ports/1 00:30:11.210 03:46:51 -- nvmf/common.sh@682 -- # rmdir /sys/kernel/config/nvmet/subsystems/kernel_target 00:30:11.210 03:46:51 -- nvmf/common.sh@684 -- # modules=(/sys/module/nvmet/holders/*) 00:30:11.210 03:46:51 -- nvmf/common.sh@686 -- # modprobe -r nvmet_tcp nvmet 00:30:11.210 00:30:11.210 real 0m11.956s 00:30:11.210 user 0m5.343s 00:30:11.210 sys 0m2.453s 00:30:11.210 03:46:51 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:11.210 03:46:51 -- common/autotest_common.sh@10 -- # set +x 00:30:11.210 ************************************ 00:30:11.210 END TEST kernel_target_abort 00:30:11.210 ************************************ 00:30:11.210 03:46:51 -- target/abort_qd_sizes.sh@86 -- # trap - SIGINT SIGTERM EXIT 00:30:11.210 03:46:51 -- target/abort_qd_sizes.sh@87 -- # nvmftestfini 00:30:11.210 03:46:51 -- nvmf/common.sh@476 -- # nvmfcleanup 00:30:11.210 03:46:51 -- nvmf/common.sh@116 -- # sync 00:30:11.210 03:46:51 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:30:11.210 03:46:51 -- nvmf/common.sh@119 -- # set +e 00:30:11.210 03:46:51 -- nvmf/common.sh@120 -- # for i in {1..20} 00:30:11.210 03:46:51 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:30:11.210 rmmod nvme_tcp 00:30:11.210 rmmod nvme_fabrics 00:30:11.210 rmmod nvme_keyring 00:30:11.210 03:46:51 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:30:11.210 03:46:51 -- nvmf/common.sh@123 -- # set -e 00:30:11.210 03:46:51 -- nvmf/common.sh@124 -- # return 0 00:30:11.210 03:46:51 -- nvmf/common.sh@477 -- # '[' -n 3196230 ']' 00:30:11.210 03:46:51 -- nvmf/common.sh@478 -- # killprocess 3196230 00:30:11.210 03:46:51 -- common/autotest_common.sh@936 -- # '[' -z 3196230 ']' 00:30:11.210 03:46:51 -- common/autotest_common.sh@940 -- # kill -0 3196230 00:30:11.210 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (3196230) - No such process 00:30:11.210 03:46:51 -- common/autotest_common.sh@963 -- # echo 'Process with pid 3196230 is not found' 00:30:11.210 Process with pid 3196230 is not found 00:30:11.210 03:46:51 -- nvmf/common.sh@480 -- # '[' iso == iso ']' 00:30:11.210 03:46:51 -- nvmf/common.sh@481 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:30:12.143 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:30:12.143 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:30:12.143 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:30:12.143 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:30:12.143 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:30:12.143 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:30:12.143 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:30:12.143 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:30:12.143 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:30:12.143 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:30:12.143 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:30:12.143 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:30:12.143 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:30:12.143 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:30:12.143 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:30:12.143 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:30:12.143 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:30:12.143 03:46:52 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:30:12.143 03:46:52 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:30:12.143 03:46:52 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:30:12.143 03:46:52 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:30:12.143 03:46:52 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:12.143 03:46:52 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:30:12.143 03:46:52 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:14.674 03:46:54 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:30:14.674 00:30:14.674 real 0m35.638s 00:30:14.674 user 1m4.521s 00:30:14.674 sys 0m8.679s 00:30:14.674 03:46:54 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:14.674 03:46:54 -- common/autotest_common.sh@10 -- # set +x 00:30:14.674 ************************************ 00:30:14.674 END TEST nvmf_abort_qd_sizes 00:30:14.674 ************************************ 00:30:14.674 03:46:54 -- spdk/autotest.sh@298 -- # '[' 0 -eq 1 ']' 00:30:14.674 03:46:54 -- spdk/autotest.sh@302 -- # '[' 0 -eq 1 ']' 00:30:14.674 03:46:54 -- spdk/autotest.sh@306 -- # '[' 0 -eq 1 ']' 00:30:14.674 03:46:54 -- spdk/autotest.sh@311 -- # '[' 0 -eq 1 ']' 00:30:14.674 03:46:54 -- spdk/autotest.sh@320 -- # '[' 0 -eq 1 ']' 00:30:14.674 03:46:54 -- spdk/autotest.sh@325 -- # '[' 0 -eq 1 ']' 00:30:14.674 03:46:54 -- spdk/autotest.sh@329 -- # '[' 0 -eq 1 ']' 00:30:14.674 03:46:54 -- spdk/autotest.sh@333 -- # '[' 0 -eq 1 ']' 00:30:14.674 03:46:54 -- spdk/autotest.sh@337 -- # '[' 0 -eq 1 ']' 00:30:14.674 03:46:54 -- spdk/autotest.sh@342 -- # '[' 0 -eq 1 ']' 00:30:14.674 03:46:54 -- spdk/autotest.sh@346 -- # '[' 0 -eq 1 ']' 00:30:14.674 03:46:54 -- spdk/autotest.sh@353 -- # [[ 0 -eq 1 ]] 00:30:14.674 03:46:54 -- spdk/autotest.sh@357 -- # [[ 0 -eq 1 ]] 00:30:14.674 03:46:54 -- spdk/autotest.sh@361 -- # [[ 0 -eq 1 ]] 00:30:14.674 03:46:54 -- spdk/autotest.sh@365 -- # [[ 0 -eq 1 ]] 00:30:14.674 03:46:54 -- spdk/autotest.sh@370 -- # trap - SIGINT SIGTERM EXIT 00:30:14.674 03:46:54 -- spdk/autotest.sh@372 -- # timing_enter post_cleanup 00:30:14.674 03:46:54 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:14.674 03:46:54 -- common/autotest_common.sh@10 -- # set +x 00:30:14.674 03:46:54 -- spdk/autotest.sh@373 -- # autotest_cleanup 00:30:14.674 03:46:54 -- common/autotest_common.sh@1381 -- # local autotest_es=0 00:30:14.674 03:46:54 -- common/autotest_common.sh@1382 -- # xtrace_disable 00:30:14.674 03:46:54 -- common/autotest_common.sh@10 -- # set +x 00:30:16.051 INFO: APP EXITING 00:30:16.051 INFO: killing all VMs 00:30:16.051 INFO: killing vhost app 00:30:16.051 INFO: EXIT DONE 00:30:16.988 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:30:16.988 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:30:16.988 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:30:17.247 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:30:17.247 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:30:17.247 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:30:17.247 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:30:17.247 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:30:17.247 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:30:17.247 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:30:17.247 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:30:17.247 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:30:17.247 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:30:17.247 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:30:17.247 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:30:17.247 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:30:17.247 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:30:18.624 Cleaning 00:30:18.624 Removing: /var/run/dpdk/spdk0/config 00:30:18.624 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-0 00:30:18.624 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-1 00:30:18.624 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-2 00:30:18.624 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-3 00:30:18.624 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-0 00:30:18.624 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-1 00:30:18.624 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-2 00:30:18.624 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-3 00:30:18.624 Removing: /var/run/dpdk/spdk0/fbarray_memzone 00:30:18.624 Removing: /var/run/dpdk/spdk0/hugepage_info 00:30:18.624 Removing: /var/run/dpdk/spdk1/config 00:30:18.624 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-0 00:30:18.624 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-1 00:30:18.624 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-2 00:30:18.624 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-3 00:30:18.624 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-0 00:30:18.624 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-1 00:30:18.624 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-2 00:30:18.624 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-3 00:30:18.624 Removing: /var/run/dpdk/spdk1/fbarray_memzone 00:30:18.624 Removing: /var/run/dpdk/spdk1/hugepage_info 00:30:18.624 Removing: /var/run/dpdk/spdk1/mp_socket 00:30:18.624 Removing: /var/run/dpdk/spdk2/config 00:30:18.624 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-0 00:30:18.624 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-1 00:30:18.624 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-2 00:30:18.624 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-3 00:30:18.624 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-0 00:30:18.624 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-1 00:30:18.624 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-2 00:30:18.624 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-3 00:30:18.624 Removing: /var/run/dpdk/spdk2/fbarray_memzone 00:30:18.624 Removing: /var/run/dpdk/spdk2/hugepage_info 00:30:18.624 Removing: /var/run/dpdk/spdk3/config 00:30:18.624 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-0 00:30:18.624 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-1 00:30:18.624 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-2 00:30:18.624 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-3 00:30:18.624 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-0 00:30:18.624 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-1 00:30:18.624 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-2 00:30:18.624 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-3 00:30:18.624 Removing: /var/run/dpdk/spdk3/fbarray_memzone 00:30:18.624 Removing: /var/run/dpdk/spdk3/hugepage_info 00:30:18.624 Removing: /var/run/dpdk/spdk4/config 00:30:18.624 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-0 00:30:18.624 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-1 00:30:18.624 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-2 00:30:18.884 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-3 00:30:18.884 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-0 00:30:18.884 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-1 00:30:18.884 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-2 00:30:18.884 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-3 00:30:18.884 Removing: /var/run/dpdk/spdk4/fbarray_memzone 00:30:18.884 Removing: /var/run/dpdk/spdk4/hugepage_info 00:30:18.884 Removing: /dev/shm/bdev_svc_trace.1 00:30:18.884 Removing: /dev/shm/nvmf_trace.0 00:30:18.884 Removing: /dev/shm/spdk_tgt_trace.pid2927274 00:30:18.884 Removing: /var/run/dpdk/spdk0 00:30:18.884 Removing: /var/run/dpdk/spdk1 00:30:18.884 Removing: /var/run/dpdk/spdk2 00:30:18.884 Removing: /var/run/dpdk/spdk3 00:30:18.884 Removing: /var/run/dpdk/spdk4 00:30:18.884 Removing: /var/run/dpdk/spdk_pid2925547 00:30:18.884 Removing: /var/run/dpdk/spdk_pid2926418 00:30:18.884 Removing: /var/run/dpdk/spdk_pid2927274 00:30:18.884 Removing: /var/run/dpdk/spdk_pid2927772 00:30:18.884 Removing: /var/run/dpdk/spdk_pid2929220 00:30:18.884 Removing: /var/run/dpdk/spdk_pid2930573 00:30:18.884 Removing: /var/run/dpdk/spdk_pid2931014 00:30:18.884 Removing: /var/run/dpdk/spdk_pid2931345 00:30:18.884 Removing: /var/run/dpdk/spdk_pid2931678 00:30:18.884 Removing: /var/run/dpdk/spdk_pid2931892 00:30:18.884 Removing: /var/run/dpdk/spdk_pid2932055 00:30:18.884 Removing: /var/run/dpdk/spdk_pid2932271 00:30:18.884 Removing: /var/run/dpdk/spdk_pid2932524 00:30:18.884 Removing: /var/run/dpdk/spdk_pid2933095 00:30:18.884 Removing: /var/run/dpdk/spdk_pid2935666 00:30:18.884 Removing: /var/run/dpdk/spdk_pid2935844 00:30:18.884 Removing: /var/run/dpdk/spdk_pid2936145 00:30:18.884 Removing: /var/run/dpdk/spdk_pid2936285 00:30:18.884 Removing: /var/run/dpdk/spdk_pid2936597 00:30:18.884 Removing: /var/run/dpdk/spdk_pid2936739 00:30:18.884 Removing: /var/run/dpdk/spdk_pid2937180 00:30:18.884 Removing: /var/run/dpdk/spdk_pid2937319 00:30:18.884 Removing: /var/run/dpdk/spdk_pid2937487 00:30:18.884 Removing: /var/run/dpdk/spdk_pid2937631 00:30:18.884 Removing: /var/run/dpdk/spdk_pid2937795 00:30:18.884 Removing: /var/run/dpdk/spdk_pid2937939 00:30:18.884 Removing: /var/run/dpdk/spdk_pid2938317 00:30:18.884 Removing: /var/run/dpdk/spdk_pid2938560 00:30:18.884 Removing: /var/run/dpdk/spdk_pid2938808 00:30:18.884 Removing: /var/run/dpdk/spdk_pid2938981 00:30:18.884 Removing: /var/run/dpdk/spdk_pid2939133 00:30:18.884 Removing: /var/run/dpdk/spdk_pid2939193 00:30:18.884 Removing: /var/run/dpdk/spdk_pid2939395 00:30:18.884 Removing: /var/run/dpdk/spdk_pid2939618 00:30:18.884 Removing: /var/run/dpdk/spdk_pid2939764 00:30:18.884 Removing: /var/run/dpdk/spdk_pid2939917 00:30:18.884 Removing: /var/run/dpdk/spdk_pid2940191 00:30:18.884 Removing: /var/run/dpdk/spdk_pid2940346 00:30:18.884 Removing: /var/run/dpdk/spdk_pid2940492 00:30:18.884 Removing: /var/run/dpdk/spdk_pid2940770 00:30:18.884 Removing: /var/run/dpdk/spdk_pid2940920 00:30:18.884 Removing: /var/run/dpdk/spdk_pid2941076 00:30:18.884 Removing: /var/run/dpdk/spdk_pid2941341 00:30:18.884 Removing: /var/run/dpdk/spdk_pid2941504 00:30:18.884 Removing: /var/run/dpdk/spdk_pid2941650 00:30:18.884 Removing: /var/run/dpdk/spdk_pid2941893 00:30:18.884 Removing: /var/run/dpdk/spdk_pid2942077 00:30:18.884 Removing: /var/run/dpdk/spdk_pid2942231 00:30:18.884 Removing: /var/run/dpdk/spdk_pid2942402 00:30:18.884 Removing: /var/run/dpdk/spdk_pid2942651 00:30:18.884 Removing: /var/run/dpdk/spdk_pid2942799 00:30:18.884 Removing: /var/run/dpdk/spdk_pid2942958 00:30:18.884 Removing: /var/run/dpdk/spdk_pid2943217 00:30:18.884 Removing: /var/run/dpdk/spdk_pid2943382 00:30:18.884 Removing: /var/run/dpdk/spdk_pid2943526 00:30:18.884 Removing: /var/run/dpdk/spdk_pid2943804 00:30:18.884 Removing: /var/run/dpdk/spdk_pid2943948 00:30:18.884 Removing: /var/run/dpdk/spdk_pid2944112 00:30:18.884 Removing: /var/run/dpdk/spdk_pid2944372 00:30:18.884 Removing: /var/run/dpdk/spdk_pid2944533 00:30:18.884 Removing: /var/run/dpdk/spdk_pid2944676 00:30:18.884 Removing: /var/run/dpdk/spdk_pid2944962 00:30:18.884 Removing: /var/run/dpdk/spdk_pid2945102 00:30:18.884 Removing: /var/run/dpdk/spdk_pid2945266 00:30:18.884 Removing: /var/run/dpdk/spdk_pid2945528 00:30:18.884 Removing: /var/run/dpdk/spdk_pid2945695 00:30:18.884 Removing: /var/run/dpdk/spdk_pid2945843 00:30:18.884 Removing: /var/run/dpdk/spdk_pid2946125 00:30:18.884 Removing: /var/run/dpdk/spdk_pid2946269 00:30:18.884 Removing: /var/run/dpdk/spdk_pid2946431 00:30:18.884 Removing: /var/run/dpdk/spdk_pid2946693 00:30:18.884 Removing: /var/run/dpdk/spdk_pid2946853 00:30:18.884 Removing: /var/run/dpdk/spdk_pid2947050 00:30:18.884 Removing: /var/run/dpdk/spdk_pid2947267 00:30:18.884 Removing: /var/run/dpdk/spdk_pid2949373 00:30:18.884 Removing: /var/run/dpdk/spdk_pid3006164 00:30:18.884 Removing: /var/run/dpdk/spdk_pid3008947 00:30:18.884 Removing: /var/run/dpdk/spdk_pid3016066 00:30:18.884 Removing: /var/run/dpdk/spdk_pid3020042 00:30:18.884 Removing: /var/run/dpdk/spdk_pid3022440 00:30:18.884 Removing: /var/run/dpdk/spdk_pid3022973 00:30:18.884 Removing: /var/run/dpdk/spdk_pid3028072 00:30:18.884 Removing: /var/run/dpdk/spdk_pid3028358 00:30:18.884 Removing: /var/run/dpdk/spdk_pid3031048 00:30:18.884 Removing: /var/run/dpdk/spdk_pid3034950 00:30:18.884 Removing: /var/run/dpdk/spdk_pid3037192 00:30:18.884 Removing: /var/run/dpdk/spdk_pid3043955 00:30:19.143 Removing: /var/run/dpdk/spdk_pid3049373 00:30:19.143 Removing: /var/run/dpdk/spdk_pid3050717 00:30:19.143 Removing: /var/run/dpdk/spdk_pid3051402 00:30:19.143 Removing: /var/run/dpdk/spdk_pid3062672 00:30:19.143 Removing: /var/run/dpdk/spdk_pid3064986 00:30:19.143 Removing: /var/run/dpdk/spdk_pid3067894 00:30:19.143 Removing: /var/run/dpdk/spdk_pid3069112 00:30:19.143 Removing: /var/run/dpdk/spdk_pid3070483 00:30:19.143 Removing: /var/run/dpdk/spdk_pid3070643 00:30:19.143 Removing: /var/run/dpdk/spdk_pid3070912 00:30:19.143 Removing: /var/run/dpdk/spdk_pid3071072 00:30:19.143 Removing: /var/run/dpdk/spdk_pid3071661 00:30:19.143 Removing: /var/run/dpdk/spdk_pid3073150 00:30:19.143 Removing: /var/run/dpdk/spdk_pid3074119 00:30:19.143 Removing: /var/run/dpdk/spdk_pid3074620 00:30:19.143 Removing: /var/run/dpdk/spdk_pid3078122 00:30:19.143 Removing: /var/run/dpdk/spdk_pid3081709 00:30:19.143 Removing: /var/run/dpdk/spdk_pid3085352 00:30:19.143 Removing: /var/run/dpdk/spdk_pid3109788 00:30:19.143 Removing: /var/run/dpdk/spdk_pid3112625 00:30:19.143 Removing: /var/run/dpdk/spdk_pid3116593 00:30:19.143 Removing: /var/run/dpdk/spdk_pid3118078 00:30:19.143 Removing: /var/run/dpdk/spdk_pid3119324 00:30:19.143 Removing: /var/run/dpdk/spdk_pid3122033 00:30:19.143 Removing: /var/run/dpdk/spdk_pid3124566 00:30:19.143 Removing: /var/run/dpdk/spdk_pid3128965 00:30:19.143 Removing: /var/run/dpdk/spdk_pid3128967 00:30:19.143 Removing: /var/run/dpdk/spdk_pid3131921 00:30:19.143 Removing: /var/run/dpdk/spdk_pid3132059 00:30:19.143 Removing: /var/run/dpdk/spdk_pid3132290 00:30:19.143 Removing: /var/run/dpdk/spdk_pid3132594 00:30:19.143 Removing: /var/run/dpdk/spdk_pid3132605 00:30:19.143 Removing: /var/run/dpdk/spdk_pid3133713 00:30:19.143 Removing: /var/run/dpdk/spdk_pid3134929 00:30:19.143 Removing: /var/run/dpdk/spdk_pid3136152 00:30:19.143 Removing: /var/run/dpdk/spdk_pid3137370 00:30:19.143 Removing: /var/run/dpdk/spdk_pid3138676 00:30:19.143 Removing: /var/run/dpdk/spdk_pid3139922 00:30:19.143 Removing: /var/run/dpdk/spdk_pid3143817 00:30:19.143 Removing: /var/run/dpdk/spdk_pid3144154 00:30:19.143 Removing: /var/run/dpdk/spdk_pid3145598 00:30:19.143 Removing: /var/run/dpdk/spdk_pid3146353 00:30:19.143 Removing: /var/run/dpdk/spdk_pid3150770 00:30:19.143 Removing: /var/run/dpdk/spdk_pid3152876 00:30:19.143 Removing: /var/run/dpdk/spdk_pid3156561 00:30:19.143 Removing: /var/run/dpdk/spdk_pid3160196 00:30:19.143 Removing: /var/run/dpdk/spdk_pid3163868 00:30:19.143 Removing: /var/run/dpdk/spdk_pid3164296 00:30:19.143 Removing: /var/run/dpdk/spdk_pid3164831 00:30:19.143 Removing: /var/run/dpdk/spdk_pid3165253 00:30:19.143 Removing: /var/run/dpdk/spdk_pid3165853 00:30:19.143 Removing: /var/run/dpdk/spdk_pid3166403 00:30:19.143 Removing: /var/run/dpdk/spdk_pid3166955 00:30:19.143 Removing: /var/run/dpdk/spdk_pid3167459 00:30:19.143 Removing: /var/run/dpdk/spdk_pid3170206 00:30:19.143 Removing: /var/run/dpdk/spdk_pid3170353 00:30:19.143 Removing: /var/run/dpdk/spdk_pid3174224 00:30:19.143 Removing: /var/run/dpdk/spdk_pid3174481 00:30:19.143 Removing: /var/run/dpdk/spdk_pid3176178 00:30:19.143 Removing: /var/run/dpdk/spdk_pid3181703 00:30:19.143 Removing: /var/run/dpdk/spdk_pid3181732 00:30:19.143 Removing: /var/run/dpdk/spdk_pid3185034 00:30:19.143 Removing: /var/run/dpdk/spdk_pid3186474 00:30:19.143 Removing: /var/run/dpdk/spdk_pid3187920 00:30:19.143 Removing: /var/run/dpdk/spdk_pid3188804 00:30:19.143 Removing: /var/run/dpdk/spdk_pid3190265 00:30:19.143 Removing: /var/run/dpdk/spdk_pid3191156 00:30:19.143 Removing: /var/run/dpdk/spdk_pid3196679 00:30:19.143 Removing: /var/run/dpdk/spdk_pid3197077 00:30:19.143 Removing: /var/run/dpdk/spdk_pid3197479 00:30:19.143 Removing: /var/run/dpdk/spdk_pid3199037 00:30:19.143 Removing: /var/run/dpdk/spdk_pid3199380 00:30:19.143 Removing: /var/run/dpdk/spdk_pid3199784 00:30:19.143 Clean 00:30:19.143 killing process with pid 2897313 00:30:27.261 killing process with pid 2897310 00:30:27.261 killing process with pid 2897312 00:30:27.519 killing process with pid 2897311 00:30:27.519 03:47:08 -- common/autotest_common.sh@1446 -- # return 0 00:30:27.519 03:47:08 -- spdk/autotest.sh@374 -- # timing_exit post_cleanup 00:30:27.519 03:47:08 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:27.519 03:47:08 -- common/autotest_common.sh@10 -- # set +x 00:30:27.519 03:47:08 -- spdk/autotest.sh@376 -- # timing_exit autotest 00:30:27.519 03:47:08 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:27.519 03:47:08 -- common/autotest_common.sh@10 -- # set +x 00:30:27.519 03:47:08 -- spdk/autotest.sh@377 -- # chmod a+r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:30:27.519 03:47:08 -- spdk/autotest.sh@379 -- # [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log ]] 00:30:27.519 03:47:08 -- spdk/autotest.sh@379 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log 00:30:27.519 03:47:08 -- spdk/autotest.sh@381 -- # [[ y == y ]] 00:30:27.519 03:47:08 -- spdk/autotest.sh@383 -- # hostname 00:30:27.519 03:47:08 -- spdk/autotest.sh@383 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -c --no-external -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -t spdk-gp-11 -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info 00:30:27.778 geninfo: WARNING: invalid characters removed from testname! 00:30:54.322 03:47:34 -- spdk/autotest.sh@384 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:30:57.603 03:47:38 -- spdk/autotest.sh@385 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/dpdk/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:31:00.129 03:47:40 -- spdk/autotest.sh@389 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info --ignore-errors unused,unused '/usr/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:31:02.658 03:47:43 -- spdk/autotest.sh@390 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/examples/vmd/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:31:05.942 03:47:45 -- spdk/autotest.sh@391 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_lspci/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:31:07.842 03:47:48 -- spdk/autotest.sh@392 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_top/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:31:10.459 03:47:51 -- spdk/autotest.sh@393 -- # rm -f cov_base.info cov_test.info OLD_STDOUT OLD_STDERR 00:31:10.718 03:47:51 -- common/autotest_common.sh@1689 -- $ [[ y == y ]] 00:31:10.718 03:47:51 -- common/autotest_common.sh@1690 -- $ lcov --version 00:31:10.718 03:47:51 -- common/autotest_common.sh@1690 -- $ awk '{print $NF}' 00:31:10.718 03:47:51 -- common/autotest_common.sh@1690 -- $ lt 1.15 2 00:31:10.718 03:47:51 -- scripts/common.sh@372 -- $ cmp_versions 1.15 '<' 2 00:31:10.718 03:47:51 -- scripts/common.sh@332 -- $ local ver1 ver1_l 00:31:10.719 03:47:51 -- scripts/common.sh@333 -- $ local ver2 ver2_l 00:31:10.719 03:47:51 -- scripts/common.sh@335 -- $ IFS=.-: 00:31:10.719 03:47:51 -- scripts/common.sh@335 -- $ read -ra ver1 00:31:10.719 03:47:51 -- scripts/common.sh@336 -- $ IFS=.-: 00:31:10.719 03:47:51 -- scripts/common.sh@336 -- $ read -ra ver2 00:31:10.719 03:47:51 -- scripts/common.sh@337 -- $ local 'op=<' 00:31:10.719 03:47:51 -- scripts/common.sh@339 -- $ ver1_l=2 00:31:10.719 03:47:51 -- scripts/common.sh@340 -- $ ver2_l=1 00:31:10.719 03:47:51 -- scripts/common.sh@342 -- $ local lt=0 gt=0 eq=0 v 00:31:10.719 03:47:51 -- scripts/common.sh@343 -- $ case "$op" in 00:31:10.719 03:47:51 -- scripts/common.sh@344 -- $ : 1 00:31:10.719 03:47:51 -- scripts/common.sh@363 -- $ (( v = 0 )) 00:31:10.719 03:47:51 -- scripts/common.sh@363 -- $ (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:31:10.719 03:47:51 -- scripts/common.sh@364 -- $ decimal 1 00:31:10.719 03:47:51 -- scripts/common.sh@352 -- $ local d=1 00:31:10.719 03:47:51 -- scripts/common.sh@353 -- $ [[ 1 =~ ^[0-9]+$ ]] 00:31:10.719 03:47:51 -- scripts/common.sh@354 -- $ echo 1 00:31:10.719 03:47:51 -- scripts/common.sh@364 -- $ ver1[v]=1 00:31:10.719 03:47:51 -- scripts/common.sh@365 -- $ decimal 2 00:31:10.719 03:47:51 -- scripts/common.sh@352 -- $ local d=2 00:31:10.719 03:47:51 -- scripts/common.sh@353 -- $ [[ 2 =~ ^[0-9]+$ ]] 00:31:10.719 03:47:51 -- scripts/common.sh@354 -- $ echo 2 00:31:10.719 03:47:51 -- scripts/common.sh@365 -- $ ver2[v]=2 00:31:10.719 03:47:51 -- scripts/common.sh@366 -- $ (( ver1[v] > ver2[v] )) 00:31:10.719 03:47:51 -- scripts/common.sh@367 -- $ (( ver1[v] < ver2[v] )) 00:31:10.719 03:47:51 -- scripts/common.sh@367 -- $ return 0 00:31:10.719 03:47:51 -- common/autotest_common.sh@1691 -- $ lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:31:10.719 03:47:51 -- common/autotest_common.sh@1703 -- $ export 'LCOV_OPTS= 00:31:10.719 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:10.719 --rc genhtml_branch_coverage=1 00:31:10.719 --rc genhtml_function_coverage=1 00:31:10.719 --rc genhtml_legend=1 00:31:10.719 --rc geninfo_all_blocks=1 00:31:10.719 --rc geninfo_unexecuted_blocks=1 00:31:10.719 00:31:10.719 ' 00:31:10.719 03:47:51 -- common/autotest_common.sh@1703 -- $ LCOV_OPTS=' 00:31:10.719 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:10.719 --rc genhtml_branch_coverage=1 00:31:10.719 --rc genhtml_function_coverage=1 00:31:10.719 --rc genhtml_legend=1 00:31:10.719 --rc geninfo_all_blocks=1 00:31:10.719 --rc geninfo_unexecuted_blocks=1 00:31:10.719 00:31:10.719 ' 00:31:10.719 03:47:51 -- common/autotest_common.sh@1704 -- $ export 'LCOV=lcov 00:31:10.719 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:10.719 --rc genhtml_branch_coverage=1 00:31:10.719 --rc genhtml_function_coverage=1 00:31:10.719 --rc genhtml_legend=1 00:31:10.719 --rc geninfo_all_blocks=1 00:31:10.719 --rc geninfo_unexecuted_blocks=1 00:31:10.719 00:31:10.719 ' 00:31:10.719 03:47:51 -- common/autotest_common.sh@1704 -- $ LCOV='lcov 00:31:10.719 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:10.719 --rc genhtml_branch_coverage=1 00:31:10.719 --rc genhtml_function_coverage=1 00:31:10.719 --rc genhtml_legend=1 00:31:10.719 --rc geninfo_all_blocks=1 00:31:10.719 --rc geninfo_unexecuted_blocks=1 00:31:10.719 00:31:10.719 ' 00:31:10.719 03:47:51 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:31:10.719 03:47:51 -- scripts/common.sh@433 -- $ [[ -e /bin/wpdk_common.sh ]] 00:31:10.719 03:47:51 -- scripts/common.sh@441 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:31:10.719 03:47:51 -- scripts/common.sh@442 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:31:10.719 03:47:51 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:10.719 03:47:51 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:10.719 03:47:51 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:10.719 03:47:51 -- paths/export.sh@5 -- $ export PATH 00:31:10.719 03:47:51 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:10.719 03:47:51 -- common/autobuild_common.sh@439 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:31:10.719 03:47:51 -- common/autobuild_common.sh@440 -- $ date +%s 00:31:10.719 03:47:51 -- common/autobuild_common.sh@440 -- $ mktemp -dt spdk_1732157271.XXXXXX 00:31:10.719 03:47:51 -- common/autobuild_common.sh@440 -- $ SPDK_WORKSPACE=/tmp/spdk_1732157271.F4LaNI 00:31:10.719 03:47:51 -- common/autobuild_common.sh@442 -- $ [[ -n '' ]] 00:31:10.719 03:47:51 -- common/autobuild_common.sh@446 -- $ '[' -n '' ']' 00:31:10.719 03:47:51 -- common/autobuild_common.sh@449 -- $ scanbuild_exclude='--exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/' 00:31:10.719 03:47:51 -- common/autobuild_common.sh@453 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:31:10.719 03:47:51 -- common/autobuild_common.sh@455 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/ --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:31:10.719 03:47:51 -- common/autobuild_common.sh@456 -- $ get_config_params 00:31:10.719 03:47:51 -- common/autotest_common.sh@397 -- $ xtrace_disable 00:31:10.719 03:47:51 -- common/autotest_common.sh@10 -- $ set +x 00:31:10.719 03:47:51 -- common/autobuild_common.sh@456 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk' 00:31:10.719 03:47:51 -- spdk/autopackage.sh@10 -- $ MAKEFLAGS=-j48 00:31:10.719 03:47:51 -- spdk/autopackage.sh@11 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:31:10.719 03:47:51 -- spdk/autopackage.sh@13 -- $ [[ 0 -eq 1 ]] 00:31:10.719 03:47:51 -- spdk/autopackage.sh@18 -- $ [[ 1 -eq 0 ]] 00:31:10.719 03:47:51 -- spdk/autopackage.sh@18 -- $ [[ 0 -eq 0 ]] 00:31:10.719 03:47:51 -- spdk/autopackage.sh@19 -- $ timing_finish 00:31:10.719 03:47:51 -- common/autotest_common.sh@734 -- $ flamegraph=/usr/local/FlameGraph/flamegraph.pl 00:31:10.719 03:47:51 -- common/autotest_common.sh@735 -- $ '[' -x /usr/local/FlameGraph/flamegraph.pl ']' 00:31:10.719 03:47:51 -- common/autotest_common.sh@737 -- $ /usr/local/FlameGraph/flamegraph.pl --title 'Build Timing' --nametype Step: --countname seconds /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:31:10.719 03:47:51 -- spdk/autopackage.sh@20 -- $ exit 0 00:31:10.719 + [[ -n 2854383 ]] 00:31:10.719 + sudo kill 2854383 00:31:10.730 [Pipeline] } 00:31:10.746 [Pipeline] // stage 00:31:10.751 [Pipeline] } 00:31:10.766 [Pipeline] // timeout 00:31:10.771 [Pipeline] } 00:31:10.785 [Pipeline] // catchError 00:31:10.790 [Pipeline] } 00:31:10.805 [Pipeline] // wrap 00:31:10.812 [Pipeline] } 00:31:10.825 [Pipeline] // catchError 00:31:10.834 [Pipeline] stage 00:31:10.837 [Pipeline] { (Epilogue) 00:31:10.850 [Pipeline] catchError 00:31:10.852 [Pipeline] { 00:31:10.865 [Pipeline] echo 00:31:10.868 Cleanup processes 00:31:10.874 [Pipeline] sh 00:31:11.161 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:31:11.162 3211766 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:31:11.176 [Pipeline] sh 00:31:11.461 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:31:11.461 ++ grep -v 'sudo pgrep' 00:31:11.461 ++ awk '{print $1}' 00:31:11.461 + sudo kill -9 00:31:11.461 + true 00:31:11.474 [Pipeline] sh 00:31:11.759 + jbp/jenkins/jjb-config/jobs/scripts/compress_artifacts.sh 00:31:21.740 [Pipeline] sh 00:31:22.026 + jbp/jenkins/jjb-config/jobs/scripts/check_artifacts_size.sh 00:31:22.026 Artifacts sizes are good 00:31:22.043 [Pipeline] archiveArtifacts 00:31:22.053 Archiving artifacts 00:31:22.206 [Pipeline] sh 00:31:22.492 + sudo chown -R sys_sgci: /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:31:22.508 [Pipeline] cleanWs 00:31:22.518 [WS-CLEANUP] Deleting project workspace... 00:31:22.518 [WS-CLEANUP] Deferred wipeout is used... 00:31:22.526 [WS-CLEANUP] done 00:31:22.528 [Pipeline] } 00:31:22.545 [Pipeline] // catchError 00:31:22.556 [Pipeline] sh 00:31:22.841 + logger -p user.info -t JENKINS-CI 00:31:22.850 [Pipeline] } 00:31:22.866 [Pipeline] // stage 00:31:22.871 [Pipeline] } 00:31:22.885 [Pipeline] // node 00:31:22.890 [Pipeline] End of Pipeline 00:31:22.928 Finished: SUCCESS